2024-05-07T13:47:12.796 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-07T13:47:12.796 DEBUG:teuthology.run:Teuthology command: teuthology --description rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} --archive /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430 --name cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi --owner scheduled_cbodley@teuthology --verbose -- /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430/orig.config.yaml 2024-05-07T13:47:12.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-07T13:47:12.927 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430 branch: wip-cbodley2-testing description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} email: null first_in_suite: false job_id: '7695430' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cbodley2-testing ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED sha1: 1dfb479e40144c07778a01ea762def8ca56f6eee ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1dfb479e40144c07778a01ea762def8ca56f6eee rgw: frontend: beast s3tests: force-branch: ceph-squid thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cbodley2-testing sha1: 1dfb479e40144c07778a01ea762def8ca56f6eee owner: scheduled_cbodley@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 4511 sha1: 1dfb479e40144c07778a01ea762def8ca56f6eee sleep_before_teardown: 0 suite: rgw suite_branch: wip-cbodley2-testing suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1dfb479e40144c07778a01ea762def8ca56f6eee/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1dfb479e40144c07778a01ea762def8ca56f6eee targets: smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK9J577KADgwtBiu1Oe26V//NDan17tbCa/gSbHAwddI1hW884gX6rSBb2zmekLPs/7goLpums5VanyvMjoMhms= smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdtBNLKvxqhfHDsQjPxjW6lWe9DAX5mA4R+rTPTFUSPoBTtesQKOWuJ+YZnRYJJmOYLQ++Qp8F/KXXKdj1Dkrk= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_bucket_quota.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-07_13:33:35 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-07T13:47:12.927 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1dfb479e40144c07778a01ea762def8ca56f6eee/qa; will attempt to use it 2024-05-07T13:47:12.928 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1dfb479e40144c07778a01ea762def8ca56f6eee/qa/tasks 2024-05-07T13:47:12.928 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-07T13:47:12.929 INFO:teuthology.task.internal:Checking packages... 2024-05-07T13:47:12.957 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '1dfb479e40144c07778a01ea762def8ca56f6eee' 2024-05-07T13:47:12.958 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-07T13:47:12.958 INFO:teuthology.packaging:ref: None 2024-05-07T13:47:12.958 INFO:teuthology.packaging:tag: None 2024-05-07T13:47:12.958 INFO:teuthology.packaging:branch: wip-cbodley2-testing 2024-05-07T13:47:12.958 INFO:teuthology.packaging:sha1: 1dfb479e40144c07778a01ea762def8ca56f6eee 2024-05-07T13:47:12.958 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cbodley2-testing 2024-05-07T13:47:13.174 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2521-g1dfb479e-1jammy 2024-05-07T13:47:13.175 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-07T13:47:13.182 INFO:teuthology.task.internal:no buildpackages task found 2024-05-07T13:47:13.182 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-07T13:47:13.216 INFO:teuthology.task.internal:Saving configuration 2024-05-07T13:47:13.232 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-07T13:47:13.238 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-07T13:47:13.265 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-07 13:41:26.709527', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAID76MwJQTggRgdfWlpKI9LgxvP7NBT9Lu00B7POvCnX3'} 2024-05-07T13:47:13.290 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-07 13:41:26.707765', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPlLgTq13jPwdoZxwzpyAhcT/9SxmCaO6tm/9hjS1h+9'} 2024-05-07T13:47:13.290 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-07T13:47:13.297 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-05-07T13:47:13.297 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-05-07T13:47:13.297 INFO:teuthology.run_tasks:Running task console_log... 2024-05-07T13:47:13.365 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f452ba35280>, signals=[15]) 2024-05-07T13:47:13.366 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-07T13:47:13.372 INFO:teuthology.task.internal:Opening connections... 2024-05-07T13:47:13.372 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2024-05-07T13:47:13.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:47:13.456 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-05-07T13:47:13.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:47:13.537 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-07T13:47:13.545 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-05-07T13:47:13.550 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-05-07T13:47:13.550 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-05-07T13:47:13.595 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-07T13:47:13.595 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Ubuntu" 2024-05-07T13:47:13.595 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="22.04" 2024-05-07T13:47:13.595 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-07T13:47:13.595 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_CODENAME=jammy 2024-05-07T13:47:13.595 INFO:teuthology.orchestra.run.smithi106.stdout:ID=ubuntu 2024-05-07T13:47:13.595 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE=debian 2024-05-07T13:47:13.595 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-07T13:47:13.595 INFO:teuthology.orchestra.run.smithi106.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-07T13:47:13.596 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-07T13:47:13.596 INFO:teuthology.orchestra.run.smithi106.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-07T13:47:13.596 INFO:teuthology.orchestra.run.smithi106.stdout:UBUNTU_CODENAME=jammy 2024-05-07T13:47:13.596 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-05-07T13:47:13.620 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-05-07T13:47:13.625 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-05-07T13:47:13.625 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-05-07T13:47:13.673 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-07T13:47:13.673 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2024-05-07T13:47:13.673 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="22.04" 2024-05-07T13:47:13.673 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-07T13:47:13.673 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=jammy 2024-05-07T13:47:13.673 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2024-05-07T13:47:13.673 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2024-05-07T13:47:13.673 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-07T13:47:13.673 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-07T13:47:13.673 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-07T13:47:13.673 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-07T13:47:13.673 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=jammy 2024-05-07T13:47:13.674 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-05-07T13:47:13.703 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-07T13:47:13.712 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-07T13:47:13.718 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-07T13:47:13.718 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2024-05-07T13:47:13.720 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-05-07T13:47:13.725 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-07T13:47:13.731 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-07T13:47:13.731 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2024-05-07T13:47:13.769 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-05-07T13:47:13.779 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-07T13:47:13.832 INFO:teuthology.run_tasks:Running task kernel... 2024-05-07T13:47:13.847 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-05-07T13:47:13.847 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-05-07T13:47:13.847 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-07T13:47:13.848 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-07T13:47:13.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T13:47:13.852 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-05-07T13:47:13.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T13:47:13.853 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-05-07T13:47:13.899 INFO:teuthology.orchestra.run.smithi106.stdout:5.15.0-56-generic 2024-05-07T13:47:13.900 INFO:teuthology.task.kernel:Running kernel on smithi106: 5.15.0-56-generic 2024-05-07T13:47:13.900 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2024-05-07T13:47:13.901 INFO:teuthology.orchestra.run.smithi107.stdout:5.15.0-56-generic 2024-05-07T13:47:13.901 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.15.0-56-generic 2024-05-07T13:47:13.902 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get clean 2024-05-07T13:47:14.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2024-05-07T13:47:14.034 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2024-05-07T13:47:14.166 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-07T13:47:14.172 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-07T13:47:14.189 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-07T13:47:14.268 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-07T13:47:14.271 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-07T13:47:14.279 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-07T13:47:14.353 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-07T13:47:14.384 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [454 kB] 2024-05-07T13:47:14.386 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-07T13:47:14.482 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,400 kB] 2024-05-07T13:47:14.500 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-07T13:47:14.514 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-07T13:47:14.521 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-07T13:47:14.522 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-07T13:47:14.528 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [244 kB] 2024-05-07T13:47:14.532 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-07T13:47:14.533 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,779 kB] 2024-05-07T13:47:14.552 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-07T13:47:14.553 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-07T13:47:14.557 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-07T13:47:14.557 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,072 kB] 2024-05-07T13:47:14.568 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [701 kB] 2024-05-07T13:47:14.575 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-07T13:47:14.576 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [302 kB] 2024-05-07T13:47:14.581 INFO:teuthology.orchestra.run.smithi107.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-07T13:47:14.582 INFO:teuthology.orchestra.run.smithi107.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-07T13:47:14.593 INFO:teuthology.orchestra.run.smithi107.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-07T13:47:14.596 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-07T13:47:14.598 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-07T13:47:14.598 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-07T13:47:14.598 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-07T13:47:14.599 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-07T13:47:14.601 INFO:teuthology.orchestra.run.smithi107.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-07T13:47:14.603 INFO:teuthology.orchestra.run.smithi107.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-07T13:47:14.603 INFO:teuthology.orchestra.run.smithi107.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-07T13:47:14.603 INFO:teuthology.orchestra.run.smithi107.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-07T13:47:14.615 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-07T13:47:14.615 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-07T13:47:14.616 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-07T13:47:14.616 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-07T13:47:14.635 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-07T13:47:14.636 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-07T13:47:14.636 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-07T13:47:14.636 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-07T13:47:14.636 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-07T13:47:14.637 INFO:teuthology.orchestra.run.smithi107.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-07T13:47:14.638 INFO:teuthology.orchestra.run.smithi107.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-07T13:47:14.706 INFO:teuthology.orchestra.run.smithi107.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-07T13:47:14.707 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [454 kB] 2024-05-07T13:47:14.845 INFO:teuthology.orchestra.run.smithi107.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-07T13:47:14.993 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,400 kB] 2024-05-07T13:47:15.158 INFO:teuthology.orchestra.run.smithi107.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-07T13:47:15.160 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [244 kB] 2024-05-07T13:47:15.173 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-07T13:47:15.174 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-07T13:47:15.175 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,779 kB] 2024-05-07T13:47:15.197 INFO:teuthology.orchestra.run.smithi107.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-07T13:47:15.212 INFO:teuthology.orchestra.run.smithi107.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-07T13:47:15.213 INFO:teuthology.orchestra.run.smithi107.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-07T13:47:15.215 INFO:teuthology.orchestra.run.smithi107.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-07T13:47:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [302 kB] 2024-05-07T13:47:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-07T13:47:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-07T13:47:15.276 INFO:teuthology.orchestra.run.smithi107.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-07T13:47:15.284 INFO:teuthology.orchestra.run.smithi107.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-07T13:47:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-07T13:47:15.448 INFO:teuthology.orchestra.run.smithi107.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [701 kB] 2024-05-07T13:47:15.465 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-07T13:47:15.870 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-07T13:47:15.875 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-07T13:47:15.875 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-07T13:47:15.889 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-07T13:47:15.892 INFO:teuthology.orchestra.run.smithi106.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-07T13:47:16.024 INFO:teuthology.orchestra.run.smithi107.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,072 kB] 2024-05-07T13:47:16.135 INFO:teuthology.orchestra.run.smithi107.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-07T13:47:16.155 INFO:teuthology.orchestra.run.smithi107.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-07T13:47:16.156 INFO:teuthology.orchestra.run.smithi107.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-07T13:47:16.156 INFO:teuthology.orchestra.run.smithi107.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-07T13:47:16.160 INFO:teuthology.orchestra.run.smithi107.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-07T13:47:16.161 INFO:teuthology.orchestra.run.smithi107.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-07T13:47:16.161 INFO:teuthology.orchestra.run.smithi107.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-07T13:47:16.165 INFO:teuthology.orchestra.run.smithi107.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-07T13:47:16.169 INFO:teuthology.orchestra.run.smithi107.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-07T13:47:16.334 INFO:teuthology.orchestra.run.smithi107.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-07T13:47:16.416 INFO:teuthology.orchestra.run.smithi107.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-07T13:47:16.498 INFO:teuthology.orchestra.run.smithi107.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-07T13:47:16.579 INFO:teuthology.orchestra.run.smithi107.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-07T13:47:16.610 INFO:teuthology.orchestra.run.smithi107.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-07T13:47:20.167 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 13.3 MB in 2s (7,203 kB/s) 2024-05-07T13:47:20.923 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 13.3 MB in 3s (5,286 kB/s) 2024-05-07T13:47:21.456 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-05-07T13:47:21.473 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-07T13:47:21.532 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-05-07T13:47:21.728 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2024-05-07T13:47:21.729 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2024-05-07T13:47:21.883 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2024-05-07T13:47:21.883 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-07T13:47:21.883 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-07T13:47:21.884 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-07T13:47:21.884 INFO:teuthology.orchestra.run.smithi106.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-07T13:47:21.884 INFO:teuthology.orchestra.run.smithi106.stdout: python2.7-minimal 2024-05-07T13:47:21.884 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-07T13:47:21.885 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2024-05-07T13:47:21.885 INFO:teuthology.orchestra.run.smithi106.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-07T13:47:21.885 INFO:teuthology.orchestra.run.smithi106.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-07T13:47:21.885 INFO:teuthology.orchestra.run.smithi106.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-07T13:47:21.886 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2024-05-07T13:47:21.887 INFO:teuthology.orchestra.run.smithi106.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-07T13:47:21.887 INFO:teuthology.orchestra.run.smithi106.stdout:Recommended packages: 2024-05-07T13:47:21.887 INFO:teuthology.orchestra.run.smithi106.stdout: thermald 2024-05-07T13:47:21.933 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2024-05-07T13:47:21.933 INFO:teuthology.orchestra.run.smithi106.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-07T13:47:21.933 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-07T13:47:21.934 INFO:teuthology.orchestra.run.smithi106.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-07T13:47:21.935 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages will be upgraded: 2024-05-07T13:47:21.935 INFO:teuthology.orchestra.run.smithi106.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-07T13:47:22.115 INFO:teuthology.orchestra.run.smithi106.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-07T13:47:22.115 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 113 MB of archives. 2024-05-07T13:47:22.115 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-07T13:47:22.115 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-07T13:47:22.193 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-07T13:47:22.210 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-07T13:47:22.269 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-07T13:47:22.466 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-05-07T13:47:22.466 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-05-07T13:47:22.642 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-05-07T13:47:22.642 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-07T13:47:22.642 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-07T13:47:22.643 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-07T13:47:22.643 INFO:teuthology.orchestra.run.smithi107.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-07T13:47:22.643 INFO:teuthology.orchestra.run.smithi107.stdout: python2.7-minimal 2024-05-07T13:47:22.643 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-07T13:47:22.644 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2024-05-07T13:47:22.644 INFO:teuthology.orchestra.run.smithi107.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-07T13:47:22.644 INFO:teuthology.orchestra.run.smithi107.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-07T13:47:22.644 INFO:teuthology.orchestra.run.smithi107.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-07T13:47:22.645 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2024-05-07T13:47:22.645 INFO:teuthology.orchestra.run.smithi107.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-07T13:47:22.645 INFO:teuthology.orchestra.run.smithi107.stdout:Recommended packages: 2024-05-07T13:47:22.646 INFO:teuthology.orchestra.run.smithi107.stdout: thermald 2024-05-07T13:47:22.688 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2024-05-07T13:47:22.688 INFO:teuthology.orchestra.run.smithi107.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-07T13:47:22.688 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-07T13:47:22.688 INFO:teuthology.orchestra.run.smithi107.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-07T13:47:22.689 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages will be upgraded: 2024-05-07T13:47:22.689 INFO:teuthology.orchestra.run.smithi107.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-07T13:47:22.746 INFO:teuthology.orchestra.run.smithi107.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-07T13:47:22.746 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 113 MB of archives. 2024-05-07T13:47:22.746 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-07T13:47:22.746 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-07T13:47:23.218 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-07T13:47:23.336 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-07T13:47:23.507 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-07T13:47:23.854 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-07T13:47:24.331 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-07T13:47:24.332 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-07T13:47:24.332 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-07T13:47:24.470 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-07T13:47:24.493 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-07T13:47:24.952 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 113 MB in 2s (60.9 MB/s) 2024-05-07T13:47:25.119 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-07T13:47:26.020 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-07T13:47:26.020 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-07T13:47:26.021 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-07T13:47:27.030 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-07T13:47:27.134 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-07T13:47:27.134 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-07T13:47:27.138 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-07T13:47:27.216 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:27.528 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 113 MB in 5s (21.8 MB/s) 2024-05-07T13:47:27.700 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-07T13:47:29.509 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-07T13:47:29.530 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-07T13:47:29.613 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:29.716 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-07T13:47:29.720 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-07T13:47:29.797 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:29.995 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-07T13:47:30.016 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-07T13:47:30.053 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:31.864 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-07T13:47:31.885 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-07T13:47:31.956 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:32.417 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-07T13:47:32.437 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-07T13:47:32.478 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:36.795 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-07T13:47:36.913 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-07T13:47:37.247 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-07T13:47:37.375 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-07T13:47:37.678 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-07T13:47:37.689 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-07T13:47:37.720 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-07T13:47:39.273 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-07T13:47:39.400 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-07T13:47:39.674 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-07T13:47:39.778 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-07T13:47:40.072 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-07T13:47:40.083 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-07T13:47:40.122 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-07T13:47:43.453 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-07T13:47:43.489 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-07T13:47:43.527 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:45.809 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-07T13:47:45.846 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-07T13:47:45.876 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:46.113 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-07T13:47:46.236 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-07T13:47:46.545 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-07T13:47:46.658 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:46.784 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-07T13:47:46.912 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:48.248 INFO:teuthology.orchestra.run.smithi107.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-07T13:47:48.248 INFO:teuthology.orchestra.run.smithi107.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-07T13:47:48.248 INFO:teuthology.orchestra.run.smithi107.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-07T13:47:48.248 INFO:teuthology.orchestra.run.smithi107.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-07T13:47:48.413 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:48.443 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-07T13:47:48.569 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-07T13:47:48.893 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-07T13:47:49.015 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:49.141 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-07T13:47:49.269 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:50.406 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:50.616 INFO:teuthology.orchestra.run.smithi106.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-07T13:47:50.616 INFO:teuthology.orchestra.run.smithi106.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-07T13:47:50.616 INFO:teuthology.orchestra.run.smithi106.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-07T13:47:50.616 INFO:teuthology.orchestra.run.smithi106.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-07T13:47:50.779 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:51.799 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-07T13:47:51.925 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-07T13:47:52.051 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:52.110 INFO:teuthology.orchestra.run.smithi107.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-07T13:47:52.110 INFO:teuthology.orchestra.run.smithi107.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-07T13:47:52.189 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:53.566 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-07T13:47:53.691 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-07T13:47:53.818 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-07T13:47:53.877 INFO:teuthology.orchestra.run.smithi106.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-07T13:47:53.877 INFO:teuthology.orchestra.run.smithi106.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-07T13:48:06.600 INFO:teuthology.orchestra.run.smithi107.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-07T13:48:06.601 INFO:teuthology.orchestra.run.smithi107.stdout:Sourcing file `/etc/default/grub' 2024-05-07T13:48:06.617 INFO:teuthology.orchestra.run.smithi107.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-07T13:48:06.642 INFO:teuthology.orchestra.run.smithi107.stdout:Generating grub configuration file ... 2024-05-07T13:48:06.937 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-07T13:48:06.957 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-07T13:48:07.246 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-07T13:48:07.251 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-07T13:48:07.324 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-07T13:48:07.330 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-07T13:48:07.503 INFO:teuthology.orchestra.run.smithi107.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-07T13:48:07.503 INFO:teuthology.orchestra.run.smithi107.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-07T13:48:07.503 INFO:teuthology.orchestra.run.smithi107.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-07T13:48:07.553 INFO:teuthology.orchestra.run.smithi107.stdout:done 2024-05-07T13:48:07.636 INFO:teuthology.orchestra.run.smithi106.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-07T13:48:07.636 INFO:teuthology.orchestra.run.smithi106.stdout:Sourcing file `/etc/default/grub' 2024-05-07T13:48:07.654 INFO:teuthology.orchestra.run.smithi106.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-07T13:48:07.678 INFO:teuthology.orchestra.run.smithi106.stdout:Generating grub configuration file ... 2024-05-07T13:48:07.956 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-07T13:48:07.975 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-07T13:48:08.021 DEBUG:teuthology.orchestra.run.smithi107:> dpkg -s linux-image-generic 2024-05-07T13:48:08.037 INFO:teuthology.orchestra.run.smithi107.stdout:Package: linux-image-generic 2024-05-07T13:48:08.038 INFO:teuthology.orchestra.run.smithi107.stdout:Status: install ok installed 2024-05-07T13:48:08.038 INFO:teuthology.orchestra.run.smithi107.stdout:Priority: optional 2024-05-07T13:48:08.038 INFO:teuthology.orchestra.run.smithi107.stdout:Section: kernel 2024-05-07T13:48:08.038 INFO:teuthology.orchestra.run.smithi107.stdout:Installed-Size: 21 2024-05-07T13:48:08.038 INFO:teuthology.orchestra.run.smithi107.stdout:Maintainer: Ubuntu Kernel Team 2024-05-07T13:48:08.038 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: amd64 2024-05-07T13:48:08.038 INFO:teuthology.orchestra.run.smithi107.stdout:Source: linux-meta 2024-05-07T13:48:08.038 INFO:teuthology.orchestra.run.smithi107.stdout:Version: 5.15.0.106.106 2024-05-07T13:48:08.038 INFO:teuthology.orchestra.run.smithi107.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-07T13:48:08.038 INFO:teuthology.orchestra.run.smithi107.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-07T13:48:08.038 INFO:teuthology.orchestra.run.smithi107.stdout:Recommends: thermald 2024-05-07T13:48:08.038 INFO:teuthology.orchestra.run.smithi107.stdout:Description: Generic Linux kernel image 2024-05-07T13:48:08.039 INFO:teuthology.orchestra.run.smithi107.stdout: This package will always depend on the latest generic kernel image 2024-05-07T13:48:08.039 INFO:teuthology.orchestra.run.smithi107.stdout: available. 2024-05-07T13:48:08.039 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-07T13:48:08.039 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-07T13:48:08.039 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-07T13:48:08.039 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-07T13:48:08.039 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2024-05-07T13:48:08.040 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get clean 2024-05-07T13:48:08.209 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2024-05-07T13:48:08.283 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-07T13:48:08.289 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-07T13:48:08.365 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-07T13:48:08.370 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-07T13:48:08.370 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-07T13:48:08.457 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-07T13:48:08.551 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-07T13:48:08.559 INFO:teuthology.orchestra.run.smithi106.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-07T13:48:08.559 INFO:teuthology.orchestra.run.smithi106.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-07T13:48:08.559 INFO:teuthology.orchestra.run.smithi106.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-07T13:48:08.607 INFO:teuthology.orchestra.run.smithi106.stdout:done 2024-05-07T13:48:08.623 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-07T13:48:09.099 DEBUG:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic 2024-05-07T13:48:09.117 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic 2024-05-07T13:48:09.117 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2024-05-07T13:48:09.117 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2024-05-07T13:48:09.117 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2024-05-07T13:48:09.117 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 21 2024-05-07T13:48:09.117 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2024-05-07T13:48:09.117 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2024-05-07T13:48:09.117 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta 2024-05-07T13:48:09.118 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 5.15.0.106.106 2024-05-07T13:48:09.118 INFO:teuthology.orchestra.run.smithi106.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-07T13:48:09.118 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-07T13:48:09.118 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2024-05-07T13:48:09.118 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2024-05-07T13:48:09.118 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2024-05-07T13:48:09.118 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2024-05-07T13:48:09.118 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-07T13:48:09.118 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-07T13:48:09.118 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-07T13:48:09.119 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-07T13:48:09.119 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi106.front.sepia.ceph.com, path=None, version=distro) 2024-05-07T13:48:09.119 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2024-05-07T13:48:09.300 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2024-05-07T13:48:09.422 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-07T13:48:09.436 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-07T13:48:09.460 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-07T13:48:09.534 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-07T13:48:09.745 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-07T13:48:09.763 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-07T13:48:09.821 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-07T13:48:10.022 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-05-07T13:48:10.023 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-05-07T13:48:10.196 INFO:teuthology.orchestra.run.smithi107.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-07T13:48:10.196 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-05-07T13:48:10.196 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-07T13:48:10.196 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-07T13:48:10.196 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-07T13:48:10.196 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-07T13:48:10.196 INFO:teuthology.orchestra.run.smithi107.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-07T13:48:10.196 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-07T13:48:10.234 INFO:teuthology.orchestra.run.smithi107.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-07T13:48:10.235 DEBUG:teuthology.orchestra.run.smithi107:> dpkg -s linux-image-generic 2024-05-07T13:48:10.251 INFO:teuthology.orchestra.run.smithi107.stdout:Package: linux-image-generic 2024-05-07T13:48:10.251 INFO:teuthology.orchestra.run.smithi107.stdout:Status: install ok installed 2024-05-07T13:48:10.251 INFO:teuthology.orchestra.run.smithi107.stdout:Priority: optional 2024-05-07T13:48:10.251 INFO:teuthology.orchestra.run.smithi107.stdout:Section: kernel 2024-05-07T13:48:10.251 INFO:teuthology.orchestra.run.smithi107.stdout:Installed-Size: 21 2024-05-07T13:48:10.251 INFO:teuthology.orchestra.run.smithi107.stdout:Maintainer: Ubuntu Kernel Team 2024-05-07T13:48:10.251 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: amd64 2024-05-07T13:48:10.251 INFO:teuthology.orchestra.run.smithi107.stdout:Source: linux-meta 2024-05-07T13:48:10.251 INFO:teuthology.orchestra.run.smithi107.stdout:Version: 5.15.0.106.106 2024-05-07T13:48:10.251 INFO:teuthology.orchestra.run.smithi107.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-07T13:48:10.251 INFO:teuthology.orchestra.run.smithi107.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-07T13:48:10.251 INFO:teuthology.orchestra.run.smithi107.stdout:Recommends: thermald 2024-05-07T13:48:10.252 INFO:teuthology.orchestra.run.smithi107.stdout:Description: Generic Linux kernel image 2024-05-07T13:48:10.252 INFO:teuthology.orchestra.run.smithi107.stdout: This package will always depend on the latest generic kernel image 2024-05-07T13:48:10.252 INFO:teuthology.orchestra.run.smithi107.stdout: available. 2024-05-07T13:48:10.252 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-05-07T13:48:10.296 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.cv2sbx0f8s 2024-05-07T13:48:10.296 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub/grub.cfg /tmp/tmp.cv2sbx0f8s 2024-05-07T13:48:10.364 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.cv2sbx0f8s 2024-05-07T13:48:10.481 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.cv2sbx0f8s is 10KB 2024-05-07T13:48:10.493 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.cv2sbx0f8s 2024-05-07T13:48:10.499 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-07T13:48:10.552 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T13:48:10.552 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-07T13:48:10.552 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-07T13:48:10.621 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-07T13:48:10.622 DEBUG:teuthology.orchestra.run.smithi107:> sudo update-grub 2024-05-07T13:48:10.845 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-05-07T13:48:10.863 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-07T13:48:10.925 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-05-07T13:48:11.134 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2024-05-07T13:48:11.134 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2024-05-07T13:48:11.310 INFO:teuthology.orchestra.run.smithi106.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-07T13:48:11.310 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2024-05-07T13:48:11.310 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-07T13:48:11.310 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-07T13:48:11.310 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-07T13:48:11.311 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-07T13:48:11.311 INFO:teuthology.orchestra.run.smithi106.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-07T13:48:11.311 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-07T13:48:11.352 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-07T13:48:11.354 DEBUG:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic 2024-05-07T13:48:11.369 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic 2024-05-07T13:48:11.370 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2024-05-07T13:48:11.370 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2024-05-07T13:48:11.370 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2024-05-07T13:48:11.370 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 21 2024-05-07T13:48:11.370 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2024-05-07T13:48:11.370 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2024-05-07T13:48:11.370 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta 2024-05-07T13:48:11.370 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 5.15.0.106.106 2024-05-07T13:48:11.370 INFO:teuthology.orchestra.run.smithi106.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-07T13:48:11.370 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-07T13:48:11.370 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2024-05-07T13:48:11.370 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2024-05-07T13:48:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2024-05-07T13:48:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2024-05-07T13:48:11.371 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-05-07T13:48:11.418 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.D2pKJGYuln 2024-05-07T13:48:11.418 DEBUG:teuthology.orchestra.run.smithi106:> sudo cp /boot/grub/grub.cfg /tmp/tmp.D2pKJGYuln 2024-05-07T13:48:11.476 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.D2pKJGYuln 2024-05-07T13:48:11.597 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.D2pKJGYuln is 10KB 2024-05-07T13:48:11.611 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.D2pKJGYuln 2024-05-07T13:48:11.617 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-07T13:48:11.671 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T13:48:11.671 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-07T13:48:11.671 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-07T13:48:11.738 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-07T13:48:11.738 DEBUG:teuthology.orchestra.run.smithi106:> sudo update-grub 2024-05-07T13:48:11.826 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub' 2024-05-07T13:48:11.827 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-07T13:48:11.829 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-05-07T13:48:12.019 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-07T13:48:12.025 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-07T13:48:12.274 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-07T13:48:12.279 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-07T13:48:12.323 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-07T13:48:12.328 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-07T13:48:12.453 INFO:teuthology.orchestra.run.smithi107.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-07T13:48:12.453 INFO:teuthology.orchestra.run.smithi107.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-07T13:48:12.453 INFO:teuthology.orchestra.run.smithi107.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-07T13:48:12.474 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-05-07T13:48:12.483 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-05-07T13:48:12.960 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub' 2024-05-07T13:48:12.961 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-07T13:48:12.962 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2024-05-07T13:48:13.147 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-07T13:48:13.153 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-07T13:48:13.390 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-07T13:48:13.396 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-07T13:48:13.438 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-07T13:48:13.443 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-07T13:48:13.586 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-07T13:48:13.587 INFO:teuthology.orchestra.run.smithi106.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-07T13:48:13.587 INFO:teuthology.orchestra.run.smithi106.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-07T13:48:13.601 INFO:teuthology.orchestra.run.smithi106.stderr:done 2024-05-07T13:48:13.610 DEBUG:teuthology.orchestra.run.smithi106:> sudo shutdown -r now 2024-05-07T13:48:42.514 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-07T13:48:42.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-07T13:48:42.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:48:43.614 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-07T13:48:43.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-07T13:48:43.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:49:02.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-05-07T13:49:11.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-07T13:49:11.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:49:14.178 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-05-07T13:49:16.958 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-05-07T13:49:25.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-07T13:49:25.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:49:26.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-07T13:49:26.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:49:44.606 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-05-07T13:49:59.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-07T13:49:59.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:49:59.872 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-05-07T13:50:00.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-07T13:50:00.478 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-106-generic"... 2024-05-07T13:50:00.478 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-05-07T13:50:00.528 INFO:teuthology.orchestra.run.smithi106.stdout:5.15.0-106-generic 2024-05-07T13:50:00.528 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-07T13:50:00.528 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-07T13:50:00.528 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-07T13:50:01.529 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-07T13:50:01.529 DEBUG:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-07T13:50:01.602 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2024-05-07T13:50:01.629 DEBUG:teuthology.parallel:result is None 2024-05-07T13:50:25.971 DEBUG:teuthology.orchestra.remote:timed out 2024-05-07T13:50:37.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-07T13:50:37.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:50:38.360 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-05-07T13:50:38.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-07T13:50:38.929 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-106-generic"... 2024-05-07T13:50:38.930 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-05-07T13:50:38.980 INFO:teuthology.orchestra.run.smithi107.stdout:5.15.0-106-generic 2024-05-07T13:50:38.980 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-07T13:50:38.980 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-07T13:50:38.980 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-07T13:50:39.981 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-07T13:50:39.981 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-07T13:50:40.335 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-05-07T13:50:40.379 DEBUG:teuthology.parallel:result is None 2024-05-07T13:50:40.379 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-07T13:50:40.387 INFO:teuthology.task.internal:Creating test directory... 2024-05-07T13:50:40.387 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-07T13:50:40.390 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-07T13:50:40.395 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-07T13:50:40.404 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-07T13:50:40.414 INFO:teuthology.task.internal:Creating archive directory... 2024-05-07T13:50:40.415 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-07T13:50:40.436 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-07T13:50:40.462 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-07T13:50:40.468 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-07T13:50:40.469 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-07T13:50:40.497 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-07T13:50:40.517 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T13:50:40.525 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T13:50:40.561 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T13:50:40.569 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-07T13:50:40.571 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-07T13:50:40.578 INFO:teuthology.task.internal:Configuring sudo... 2024-05-07T13:50:40.579 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-07T13:50:40.581 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-07T13:50:40.593 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-07T13:50:40.603 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-07T13:50:40.603 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-07T13:50:40.636 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-07T13:50:40.642 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T13:50:40.687 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T13:50:40.735 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T13:50:40.735 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-07T13:50:40.792 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-07T13:50:40.798 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-07T13:50:40.846 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T13:50:40.846 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-07T13:50:40.904 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2024-05-07T13:50:40.907 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-05-07T13:50:40.977 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-07T13:50:40.985 INFO:teuthology.task.internal:Starting timer... 2024-05-07T13:50:40.985 INFO:teuthology.run_tasks:Running task pcp... 2024-05-07T13:50:40.999 INFO:teuthology.run_tasks:Running task selinux... 2024-05-07T13:50:41.006 DEBUG:teuthology.task.selinux:Excluding smithi106: OS 'ubuntu' does not support SELinux 2024-05-07T13:50:41.006 DEBUG:teuthology.task.selinux:Excluding smithi107: OS 'ubuntu' does not support SELinux 2024-05-07T13:50:41.007 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-07T13:50:41.007 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-07T13:50:41.007 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-07T13:50:41.007 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-07T13:50:41.015 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-07T13:50:41.020 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-07T13:50:41.195 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-07T13:50:41.211 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-07T13:50:41.212 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi106.front.sepia.ceph.com,smithi107.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-07T13:57:46.691 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi106.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com')] 2024-05-07T13:57:46.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-07T13:57:46.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:57:46.778 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-05-07T13:57:46.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-05-07T13:57:46.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-07T13:57:46.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-07T13:57:46.940 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-05-07T13:57:47.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-07T13:57:47.015 INFO:teuthology.run_tasks:Running task clock... 2024-05-07T13:57:47.026 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-07T13:57:47.026 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-07T13:57:47.026 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T13:57:47.029 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-07T13:57:47.029 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T13:57:47.056 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-07T13:57:47.056 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: Command line: ntpd -gq 2024-05-07T13:57:47.056 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: ---------------------------------------------------- 2024-05-07T13:57:47.056 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: ntp-4 is maintained by Network Time Foundation, 2024-05-07T13:57:47.056 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-07T13:57:47.056 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: corporation. Support and training for ntp-4 are 2024-05-07T13:57:47.057 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: available at https://www.nwtime.org/support 2024-05-07T13:57:47.057 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: ---------------------------------------------------- 2024-05-07T13:57:47.058 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: proto: precision = 0.046 usec (-24) 2024-05-07T13:57:47.058 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: basedate set to 2022-02-04 2024-05-07T13:57:47.058 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: gps base set to 2022-02-06 (week 2196) 2024-05-07T13:57:47.058 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-07T13:57:47.058 INFO:teuthology.orchestra.run.smithi106.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-07T13:57:47.058 INFO:teuthology.orchestra.run.smithi106.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-07T13:57:47.059 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: restrict ::: KOD does nothing without LIMITED. 2024-05-07T13:57:47.059 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: Listen and drop on 0 v6wildcard [::]:123 2024-05-07T13:57:47.060 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-07T13:57:47.060 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: Listen normally on 2 lo 127.0.0.1:123 2024-05-07T13:57:47.060 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: Listen normally on 3 enp3s0f1 172.21.15.106:123 2024-05-07T13:57:47.060 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: Listen normally on 4 lo [::1]:123 2024-05-07T13:57:47.060 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce6d%5]:123 2024-05-07T13:57:47.060 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:47 ntpd[17236]: Listening on routing socket on fd #22 for interface updates 2024-05-07T13:57:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-07T13:57:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: Command line: ntpd -gq 2024-05-07T13:57:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: ---------------------------------------------------- 2024-05-07T13:57:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: ntp-4 is maintained by Network Time Foundation, 2024-05-07T13:57:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-07T13:57:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: corporation. Support and training for ntp-4 are 2024-05-07T13:57:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: available at https://www.nwtime.org/support 2024-05-07T13:57:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: ---------------------------------------------------- 2024-05-07T13:57:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: proto: precision = 0.046 usec (-24) 2024-05-07T13:57:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: basedate set to 2022-02-04 2024-05-07T13:57:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: gps base set to 2022-02-06 (week 2196) 2024-05-07T13:57:47.085 INFO:teuthology.orchestra.run.smithi107.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-07T13:57:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-07T13:57:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: restrict ::: KOD does nothing without LIMITED. 2024-05-07T13:57:47.086 INFO:teuthology.orchestra.run.smithi107.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-07T13:57:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: Listen and drop on 0 v6wildcard [::]:123 2024-05-07T13:57:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-07T13:57:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: Listen normally on 2 lo 127.0.0.1:123 2024-05-07T13:57:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: Listen normally on 3 enp3s0f1 172.21.15.107:123 2024-05-07T13:57:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: Listen normally on 4 lo [::1]:123 2024-05-07T13:57:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:47eb%5]:123 2024-05-07T13:57:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:47 ntpd[17292]: Listening on routing socket on fd #22 for interface updates 2024-05-07T13:57:48.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:48 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:48.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:48 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:48.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:48 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:48.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:48 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:48.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:48 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:48.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:48 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:48.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:48 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:48.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:48 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:48.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:48 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:48.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:48 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:48.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:48 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:48.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:48 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:48.084 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:48 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:48.084 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:48 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:48.084 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:48 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:48.084 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:48 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:48.084 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:48 ntpd[17292]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:48.085 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:48 ntpd[17292]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:50.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:50 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:50.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:50 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:50.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:50 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:50.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:50 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:50.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:50 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:50.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:50 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:50.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:50 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:50.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:50 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:50.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:50 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:50.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:50 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:50.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:50 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:50.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:50 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:50.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:50.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:50.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:50.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:50.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:50.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:50.087 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:50.087 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:50.087 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:50.087 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:50.087 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:50.087 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:50.087 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:50.087 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:50.088 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:50.088 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:50.088 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:50.088 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:50 ntpd[17292]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:51.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:51 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:51.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:51 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:51.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:51 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:51.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:51 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:51.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:51 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:51.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:51 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:51.083 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:51 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:51.084 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:51 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:52.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:52.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:52.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:52.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:52.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:52.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:52.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:52.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:52.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:52.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:52.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:52.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:52.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:52.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:52 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:52.085 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:52.085 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:52.085 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:52.085 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:52.085 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:52.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:52.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:52.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:52.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:52.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:52.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:52.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:52.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:52.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:52.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:52.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:52.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:52.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:52 ntpd[17292]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:53.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:53 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:53.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:53 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:53.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:53 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:53.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:53 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:53.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:53 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:53.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:53 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:54.057 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:54 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:54.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:54 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:54.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:54 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:54.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:54 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:54.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:54 ntpd[17236]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:54.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:54 ntpd[17236]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:54.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:54 ntpd[17236]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:54.058 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:54 ntpd[17236]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:54.058 INFO:teuthology.orchestra.run.smithi106.stdout: 7 May 13:57:54 ntpd[17236]: ntpd: time slew +0.003622 s 2024-05-07T13:57:54.059 INFO:teuthology.orchestra.run.smithi106.stdout:ntpd: time slew +0.003622s 2024-05-07T13:57:54.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:54 ntpd[17236]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-07T13:57:54.059 INFO:teuthology.orchestra.run.smithi106.stderr: 7 May 13:57:54 ntpd[17236]: can't open /var/log/ntpstats/loopstats.20240507: Permission denied 2024-05-07T13:57:54.085 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:54.085 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:54.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:54.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:54.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:54.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:54.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:54.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:54.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:54.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:54.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-07T13:57:54.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: can't open /var/log/ntpstats/rawstats.20240507: Permission denied 2024-05-07T13:57:54.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-07T13:57:54.086 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: can't open /var/log/ntpstats/peerstats.20240507: Permission denied 2024-05-07T13:57:54.087 INFO:teuthology.orchestra.run.smithi107.stdout: 7 May 13:57:54 ntpd[17292]: ntpd: time slew +0.002639 s 2024-05-07T13:57:54.087 INFO:teuthology.orchestra.run.smithi107.stdout:ntpd: time slew +0.002639s 2024-05-07T13:57:54.087 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-07T13:57:54.087 INFO:teuthology.orchestra.run.smithi107.stderr: 7 May 13:57:54 ntpd[17292]: can't open /var/log/ntpstats/loopstats.20240507: Permission denied 2024-05-07T13:57:54.187 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2024-05-07T13:57:54.187 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2024-05-07T13:57:54.187 INFO:teuthology.orchestra.run.smithi106.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-07T13:57:54.187 INFO:teuthology.orchestra.run.smithi106.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-07T13:57:54.187 INFO:teuthology.orchestra.run.smithi106.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-07T13:57:54.187 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-07T13:57:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: remote refid st t when poll reach delay offset jitter 2024-05-07T13:57:54.210 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================== 2024-05-07T13:57:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-07T13:57:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-07T13:57:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-07T13:57:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-07T13:57:54.211 INFO:teuthology.run_tasks:Running task install... 2024-05-07T13:57:54.220 DEBUG:teuthology.task.install:project ceph 2024-05-07T13:57:54.220 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee'}} 2024-05-07T13:57:54.220 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee'} 2024-05-07T13:57:54.220 INFO:teuthology.task.install:Using flavor: default 2024-05-07T13:57:54.226 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-07T13:57:54.226 INFO:teuthology.task.install:extra packages: [] 2024-05-07T13:57:54.227 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-key list | grep Ceph 2024-05-07T13:57:54.227 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-key list | grep Ceph 2024-05-07T13:57:54.292 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-07T13:57:54.311 INFO:teuthology.orchestra.run.smithi107.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-07T13:57:54.321 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-07T13:57:54.321 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph.com (release key) 2024-05-07T13:57:54.322 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-07T13:57:54.322 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1dfb479e40144c07778a01ea762def8ca56f6eee 2024-05-07T13:57:54.340 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-07T13:57:54.340 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph.com (release key) 2024-05-07T13:57:54.341 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-07T13:57:54.341 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1dfb479e40144c07778a01ea762def8ca56f6eee 2024-05-07T13:57:54.479 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default/ 2024-05-07T13:57:54.480 INFO:teuthology.task.install.deb:Package version is 19.0.0-2521-g1dfb479e-1jammy 2024-05-07T13:57:54.558 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default/ 2024-05-07T13:57:54.559 INFO:teuthology.task.install.deb:Package version is 19.0.0-2521-g1dfb479e-1jammy 2024-05-07T13:57:54.662 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T13:57:54.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-07T13:57:54.676 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2024-05-07T13:57:54.729 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T13:57:54.730 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-07T13:57:54.744 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2024-05-07T13:57:54.846 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-07T13:57:54.861 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-07T13:57:54.862 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-07T13:57:54.884 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-07T13:57:54.921 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-07T13:57:54.934 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-07T13:57:54.956 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy InRelease 2024-05-07T13:57:54.963 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy InRelease 2024-05-07T13:57:54.985 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-05-07T13:57:54.993 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2024-05-07T13:57:55.006 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-07T13:57:55.021 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-07T13:57:55.027 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-05-07T13:57:55.029 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-07T13:57:55.033 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-07T13:57:55.054 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-05-07T13:57:55.066 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-05-07T13:57:55.107 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-05-07T13:57:55.196 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 139 kB in 0s (411 kB/s) 2024-05-07T13:57:55.277 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 147 kB in 0s (415 kB/s) 2024-05-07T13:57:56.184 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-05-07T13:57:56.199 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2521-g1dfb479e-1jammy cephadm=19.0.0-2521-g1dfb479e-1jammy ceph-mds=19.0.0-2521-g1dfb479e-1jammy ceph-mgr=19.0.0-2521-g1dfb479e-1jammy ceph-common=19.0.0-2521-g1dfb479e-1jammy ceph-fuse=19.0.0-2521-g1dfb479e-1jammy ceph-test=19.0.0-2521-g1dfb479e-1jammy ceph-volume=19.0.0-2521-g1dfb479e-1jammy radosgw=19.0.0-2521-g1dfb479e-1jammy python3-rados=19.0.0-2521-g1dfb479e-1jammy python3-rgw=19.0.0-2521-g1dfb479e-1jammy python3-cephfs=19.0.0-2521-g1dfb479e-1jammy python3-rbd=19.0.0-2521-g1dfb479e-1jammy libcephfs2=19.0.0-2521-g1dfb479e-1jammy libcephfs-dev=19.0.0-2521-g1dfb479e-1jammy librados2=19.0.0-2521-g1dfb479e-1jammy librbd1=19.0.0-2521-g1dfb479e-1jammy rbd-fuse=19.0.0-2521-g1dfb479e-1jammy 2024-05-07T13:57:56.244 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-07T13:57:56.260 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2521-g1dfb479e-1jammy cephadm=19.0.0-2521-g1dfb479e-1jammy ceph-mds=19.0.0-2521-g1dfb479e-1jammy ceph-mgr=19.0.0-2521-g1dfb479e-1jammy ceph-common=19.0.0-2521-g1dfb479e-1jammy ceph-fuse=19.0.0-2521-g1dfb479e-1jammy ceph-test=19.0.0-2521-g1dfb479e-1jammy ceph-volume=19.0.0-2521-g1dfb479e-1jammy radosgw=19.0.0-2521-g1dfb479e-1jammy python3-rados=19.0.0-2521-g1dfb479e-1jammy python3-rgw=19.0.0-2521-g1dfb479e-1jammy python3-cephfs=19.0.0-2521-g1dfb479e-1jammy python3-rbd=19.0.0-2521-g1dfb479e-1jammy libcephfs2=19.0.0-2521-g1dfb479e-1jammy libcephfs-dev=19.0.0-2521-g1dfb479e-1jammy librados2=19.0.0-2521-g1dfb479e-1jammy librbd1=19.0.0-2521-g1dfb479e-1jammy rbd-fuse=19.0.0-2521-g1dfb479e-1jammy 2024-05-07T13:57:56.262 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-05-07T13:57:56.327 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-05-07T13:57:56.441 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2024-05-07T13:57:56.442 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2024-05-07T13:57:56.527 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-05-07T13:57:56.527 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-05-07T13:57:56.613 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2024-05-07T13:57:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-07T13:57:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-07T13:57:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-07T13:57:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-07T13:57:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-07T13:57:56.613 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-07T13:57:56.615 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2024-05-07T13:57:56.615 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-07T13:57:56.616 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-07T13:57:56.616 INFO:teuthology.orchestra.run.smithi106.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-07T13:57:56.616 INFO:teuthology.orchestra.run.smithi106.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-07T13:57:56.616 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-07T13:57:56.616 INFO:teuthology.orchestra.run.smithi106.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-07T13:57:56.616 INFO:teuthology.orchestra.run.smithi106.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-07T13:57:56.617 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-07T13:57:56.617 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-07T13:57:56.617 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-07T13:57:56.617 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-07T13:57:56.617 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-07T13:57:56.617 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-07T13:57:56.617 INFO:teuthology.orchestra.run.smithi106.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-07T13:57:56.617 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-07T13:57:56.617 INFO:teuthology.orchestra.run.smithi106.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-07T13:57:56.617 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-07T13:57:56.617 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-07T13:57:56.617 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-07T13:57:56.618 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-07T13:57:56.618 INFO:teuthology.orchestra.run.smithi106.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-07T13:57:56.618 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-07T13:57:56.618 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-07T13:57:56.618 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet zip 2024-05-07T13:57:56.618 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2024-05-07T13:57:56.618 INFO:teuthology.orchestra.run.smithi106.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-07T13:57:56.618 INFO:teuthology.orchestra.run.smithi106.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-07T13:57:56.618 INFO:teuthology.orchestra.run.smithi106.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-07T13:57:56.618 INFO:teuthology.orchestra.run.smithi106.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-07T13:57:56.618 INFO:teuthology.orchestra.run.smithi106.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-07T13:57:56.618 INFO:teuthology.orchestra.run.smithi106.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-07T13:57:56.619 INFO:teuthology.orchestra.run.smithi106.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-07T13:57:56.619 INFO:teuthology.orchestra.run.smithi106.stdout:Recommended packages: 2024-05-07T13:57:56.619 INFO:teuthology.orchestra.run.smithi106.stdout: btrfs-tools 2024-05-07T13:57:56.716 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2024-05-07T13:57:56.716 INFO:teuthology.orchestra.run.smithi106.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-07T13:57:56.716 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-07T13:57:56.716 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-07T13:57:56.716 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-07T13:57:56.716 INFO:teuthology.orchestra.run.smithi106.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-07T13:57:56.717 INFO:teuthology.orchestra.run.smithi106.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-07T13:57:56.717 INFO:teuthology.orchestra.run.smithi106.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-07T13:57:56.717 INFO:teuthology.orchestra.run.smithi106.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-07T13:57:56.717 INFO:teuthology.orchestra.run.smithi106.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-07T13:57:56.717 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-07T13:57:56.717 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-07T13:57:56.717 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-07T13:57:56.717 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-07T13:57:56.717 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-07T13:57:56.717 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-07T13:57:56.718 INFO:teuthology.orchestra.run.smithi106.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-07T13:57:56.718 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-07T13:57:56.718 INFO:teuthology.orchestra.run.smithi106.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-07T13:57:56.718 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-07T13:57:56.718 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-07T13:57:56.718 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-07T13:57:56.718 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-07T13:57:56.718 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-07T13:57:56.719 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-07T13:57:56.719 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-07T13:57:56.719 INFO:teuthology.orchestra.run.smithi106.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-07T13:57:56.721 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-05-07T13:57:56.721 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-07T13:57:56.721 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-07T13:57:56.721 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-07T13:57:56.722 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-07T13:57:56.722 INFO:teuthology.orchestra.run.smithi107.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-07T13:57:56.722 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-07T13:57:56.723 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2024-05-07T13:57:56.723 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-07T13:57:56.723 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-07T13:57:56.723 INFO:teuthology.orchestra.run.smithi107.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-07T13:57:56.723 INFO:teuthology.orchestra.run.smithi107.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-07T13:57:56.723 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-07T13:57:56.725 INFO:teuthology.orchestra.run.smithi107.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-07T13:57:56.725 INFO:teuthology.orchestra.run.smithi107.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-07T13:57:56.725 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-07T13:57:56.725 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-07T13:57:56.725 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-07T13:57:56.726 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-07T13:57:56.726 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-07T13:57:56.726 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-07T13:57:56.726 INFO:teuthology.orchestra.run.smithi107.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-07T13:57:56.726 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-07T13:57:56.726 INFO:teuthology.orchestra.run.smithi107.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-07T13:57:56.726 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-07T13:57:56.726 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-07T13:57:56.726 INFO:teuthology.orchestra.run.smithi107.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-07T13:57:56.726 INFO:teuthology.orchestra.run.smithi107.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-07T13:57:56.726 INFO:teuthology.orchestra.run.smithi107.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-07T13:57:56.727 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-07T13:57:56.727 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-07T13:57:56.727 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet zip 2024-05-07T13:57:56.727 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2024-05-07T13:57:56.727 INFO:teuthology.orchestra.run.smithi107.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-07T13:57:56.727 INFO:teuthology.orchestra.run.smithi107.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-07T13:57:56.727 INFO:teuthology.orchestra.run.smithi107.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-07T13:57:56.727 INFO:teuthology.orchestra.run.smithi107.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-07T13:57:56.727 INFO:teuthology.orchestra.run.smithi107.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-07T13:57:56.727 INFO:teuthology.orchestra.run.smithi107.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-07T13:57:56.727 INFO:teuthology.orchestra.run.smithi107.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-07T13:57:56.727 INFO:teuthology.orchestra.run.smithi107.stdout:Recommended packages: 2024-05-07T13:57:56.728 INFO:teuthology.orchestra.run.smithi107.stdout: btrfs-tools 2024-05-07T13:57:56.781 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-07T13:57:56.781 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 180 MB of archives. 2024-05-07T13:57:56.781 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 822 MB of additional disk space will be used. 2024-05-07T13:57:56.782 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-07T13:57:56.825 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2024-05-07T13:57:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-07T13:57:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-07T13:57:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-07T13:57:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-07T13:57:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-07T13:57:56.825 INFO:teuthology.orchestra.run.smithi107.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-07T13:57:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-07T13:57:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-07T13:57:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-07T13:57:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-07T13:57:56.827 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-07T13:57:56.828 INFO:teuthology.orchestra.run.smithi107.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-07T13:57:56.883 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-07T13:57:56.886 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-07T13:57:56.890 INFO:teuthology.orchestra.run.smithi107.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-07T13:57:56.890 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 180 MB of archives. 2024-05-07T13:57:56.890 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 822 MB of additional disk space will be used. 2024-05-07T13:57:56.890 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-07T13:57:56.905 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-07T13:57:56.967 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2521-g1dfb479e-1jammy [3,546 kB] 2024-05-07T13:57:56.977 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-07T13:57:56.982 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-07T13:57:56.991 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-07T13:57:56.994 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-07T13:57:56.995 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-07T13:57:56.997 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-07T13:57:56.998 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-07T13:57:56.999 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-07T13:57:57.006 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-07T13:57:57.008 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-07T13:57:57.010 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-07T13:57:57.012 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-07T13:57:57.014 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-07T13:57:57.021 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-07T13:57:57.023 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-07T13:57:57.025 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-07T13:57:57.027 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-07T13:57:57.040 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-07T13:57:57.041 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-07T13:57:57.042 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-07T13:57:57.042 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-07T13:57:57.042 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-07T13:57:57.043 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-07T13:57:57.060 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-07T13:57:57.061 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-07T13:57:57.061 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-07T13:57:57.064 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-07T13:57:57.080 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-07T13:57:57.081 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-07T13:57:57.081 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-07T13:57:57.082 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-07T13:57:57.082 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-07T13:57:57.083 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-07T13:57:57.085 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-07T13:57:57.099 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-07T13:57:57.100 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-07T13:57:57.101 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-07T13:57:57.103 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-07T13:57:57.104 INFO:teuthology.orchestra.run.smithi107.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-07T13:57:57.107 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-07T13:57:57.113 INFO:teuthology.orchestra.run.smithi107.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-07T13:57:57.115 INFO:teuthology.orchestra.run.smithi107.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-07T13:57:57.117 INFO:teuthology.orchestra.run.smithi107.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-07T13:57:57.119 INFO:teuthology.orchestra.run.smithi107.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-07T13:57:57.120 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-07T13:57:57.121 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-07T13:57:57.122 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-07T13:57:57.124 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2521-g1dfb479e-1jammy [3,546 kB] 2024-05-07T13:57:57.124 INFO:teuthology.orchestra.run.smithi107.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-07T13:57:57.124 INFO:teuthology.orchestra.run.smithi106.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-07T13:57:57.125 INFO:teuthology.orchestra.run.smithi106.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-07T13:57:57.126 INFO:teuthology.orchestra.run.smithi107.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-07T13:57:57.128 INFO:teuthology.orchestra.run.smithi107.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-07T13:57:57.139 INFO:teuthology.orchestra.run.smithi106.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-07T13:57:57.140 INFO:teuthology.orchestra.run.smithi106.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-07T13:57:57.143 INFO:teuthology.orchestra.run.smithi106.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-07T13:57:57.143 INFO:teuthology.orchestra.run.smithi106.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-07T13:57:57.144 INFO:teuthology.orchestra.run.smithi107.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-07T13:57:57.144 INFO:teuthology.orchestra.run.smithi107.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-07T13:57:57.145 INFO:teuthology.orchestra.run.smithi107.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-07T13:57:57.146 INFO:teuthology.orchestra.run.smithi107.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-07T13:57:57.146 INFO:teuthology.orchestra.run.smithi107.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-07T13:57:57.147 INFO:teuthology.orchestra.run.smithi107.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-07T13:57:57.147 INFO:teuthology.orchestra.run.smithi107.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-07T13:57:57.159 INFO:teuthology.orchestra.run.smithi106.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-07T13:57:57.161 INFO:teuthology.orchestra.run.smithi106.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-07T13:57:57.170 INFO:teuthology.orchestra.run.smithi107.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-07T13:57:57.171 INFO:teuthology.orchestra.run.smithi107.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-07T13:57:57.171 INFO:teuthology.orchestra.run.smithi107.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-07T13:57:57.179 INFO:teuthology.orchestra.run.smithi107.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2521-g1dfb479e-1jammy [3,216 kB] 2024-05-07T13:57:57.206 INFO:teuthology.orchestra.run.smithi107.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-07T13:57:57.207 INFO:teuthology.orchestra.run.smithi107.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-07T13:57:57.208 INFO:teuthology.orchestra.run.smithi107.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-07T13:57:57.208 INFO:teuthology.orchestra.run.smithi107.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-07T13:57:57.210 INFO:teuthology.orchestra.run.smithi107.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-07T13:57:57.210 INFO:teuthology.orchestra.run.smithi107.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-07T13:57:57.210 INFO:teuthology.orchestra.run.smithi107.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-07T13:57:57.215 INFO:teuthology.orchestra.run.smithi106.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-07T13:57:57.216 INFO:teuthology.orchestra.run.smithi106.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-07T13:57:57.218 INFO:teuthology.orchestra.run.smithi106.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-07T13:57:57.218 INFO:teuthology.orchestra.run.smithi106.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-07T13:57:57.219 INFO:teuthology.orchestra.run.smithi106.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-07T13:57:57.232 INFO:teuthology.orchestra.run.smithi107.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-07T13:57:57.233 INFO:teuthology.orchestra.run.smithi107.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-07T13:57:57.233 INFO:teuthology.orchestra.run.smithi107.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-07T13:57:57.237 INFO:teuthology.orchestra.run.smithi106.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-07T13:57:57.239 INFO:teuthology.orchestra.run.smithi106.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-07T13:57:57.239 INFO:teuthology.orchestra.run.smithi106.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-07T13:57:57.255 INFO:teuthology.orchestra.run.smithi107.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-07T13:57:57.255 INFO:teuthology.orchestra.run.smithi106.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-07T13:57:57.256 INFO:teuthology.orchestra.run.smithi106.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-07T13:57:57.256 INFO:teuthology.orchestra.run.smithi107.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-07T13:57:57.256 INFO:teuthology.orchestra.run.smithi107.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-07T13:57:57.258 INFO:teuthology.orchestra.run.smithi107.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-07T13:57:57.260 INFO:teuthology.orchestra.run.smithi107.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-07T13:57:57.264 INFO:teuthology.orchestra.run.smithi107.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-07T13:57:57.264 INFO:teuthology.orchestra.run.smithi106.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-07T13:57:57.265 INFO:teuthology.orchestra.run.smithi106.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-07T13:57:57.266 INFO:teuthology.orchestra.run.smithi107.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-07T13:57:57.266 INFO:teuthology.orchestra.run.smithi106.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-07T13:57:57.266 INFO:teuthology.orchestra.run.smithi106.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-07T13:57:57.266 INFO:teuthology.orchestra.run.smithi106.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-07T13:57:57.267 INFO:teuthology.orchestra.run.smithi106.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-07T13:57:57.270 INFO:teuthology.orchestra.run.smithi106.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-07T13:57:57.275 INFO:teuthology.orchestra.run.smithi107.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-07T13:57:57.276 INFO:teuthology.orchestra.run.smithi107.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-07T13:57:57.281 INFO:teuthology.orchestra.run.smithi107.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-07T13:57:57.282 INFO:teuthology.orchestra.run.smithi107.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2521-g1dfb479e-1jammy [711 kB] 2024-05-07T13:57:57.284 INFO:teuthology.orchestra.run.smithi106.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-07T13:57:57.286 INFO:teuthology.orchestra.run.smithi106.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-07T13:57:57.286 INFO:teuthology.orchestra.run.smithi106.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-07T13:57:57.294 INFO:teuthology.orchestra.run.smithi107.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-07T13:57:57.296 INFO:teuthology.orchestra.run.smithi107.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-07T13:57:57.300 INFO:teuthology.orchestra.run.smithi107.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-07T13:57:57.305 INFO:teuthology.orchestra.run.smithi107.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2521-g1dfb479e-1jammy [356 kB] 2024-05-07T13:57:57.317 INFO:teuthology.orchestra.run.smithi107.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2521-g1dfb479e-1jammy [32.8 kB] 2024-05-07T13:57:57.317 INFO:teuthology.orchestra.run.smithi106.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-07T13:57:57.318 INFO:teuthology.orchestra.run.smithi107.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2521-g1dfb479e-1jammy [180 kB] 2024-05-07T13:57:57.321 INFO:teuthology.orchestra.run.smithi106.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-07T13:57:57.322 INFO:teuthology.orchestra.run.smithi106.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-07T13:57:57.323 INFO:teuthology.orchestra.run.smithi106.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-07T13:57:57.326 INFO:teuthology.orchestra.run.smithi107.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2521-g1dfb479e-1jammy [67.0 kB] 2024-05-07T13:57:57.328 INFO:teuthology.orchestra.run.smithi106.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-07T13:57:57.329 INFO:teuthology.orchestra.run.smithi106.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-07T13:57:57.329 INFO:teuthology.orchestra.run.smithi107.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2521-g1dfb479e-1jammy [330 kB] 2024-05-07T13:57:57.332 INFO:teuthology.orchestra.run.smithi106.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-07T13:57:57.340 INFO:teuthology.orchestra.run.smithi107.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2521-g1dfb479e-1jammy [6,780 kB] 2024-05-07T13:57:57.345 INFO:teuthology.orchestra.run.smithi106.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-07T13:57:57.345 INFO:teuthology.orchestra.run.smithi106.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-07T13:57:57.346 INFO:teuthology.orchestra.run.smithi106.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-07T13:57:57.365 INFO:teuthology.orchestra.run.smithi106.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-07T13:57:57.366 INFO:teuthology.orchestra.run.smithi106.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-07T13:57:57.374 INFO:teuthology.orchestra.run.smithi106.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-07T13:57:57.374 INFO:teuthology.orchestra.run.smithi106.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-07T13:57:57.375 INFO:teuthology.orchestra.run.smithi106.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-07T13:57:57.375 INFO:teuthology.orchestra.run.smithi107.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-07T13:57:57.376 INFO:teuthology.orchestra.run.smithi107.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-07T13:57:57.377 INFO:teuthology.orchestra.run.smithi106.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-07T13:57:57.377 INFO:teuthology.orchestra.run.smithi106.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-07T13:57:57.378 INFO:teuthology.orchestra.run.smithi107.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-07T13:57:57.378 INFO:teuthology.orchestra.run.smithi107.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-07T13:57:57.379 INFO:teuthology.orchestra.run.smithi107.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-07T13:57:57.404 INFO:teuthology.orchestra.run.smithi107.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-07T13:57:57.406 INFO:teuthology.orchestra.run.smithi107.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-07T13:57:57.406 INFO:teuthology.orchestra.run.smithi107.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-07T13:57:57.423 INFO:teuthology.orchestra.run.smithi107.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-07T13:57:57.423 INFO:teuthology.orchestra.run.smithi107.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-07T13:57:57.437 INFO:teuthology.orchestra.run.smithi107.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-07T13:57:57.439 INFO:teuthology.orchestra.run.smithi107.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-07T13:57:57.439 INFO:teuthology.orchestra.run.smithi107.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-07T13:57:57.440 INFO:teuthology.orchestra.run.smithi107.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-07T13:57:57.440 INFO:teuthology.orchestra.run.smithi107.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-07T13:57:57.440 INFO:teuthology.orchestra.run.smithi107.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-07T13:57:57.443 INFO:teuthology.orchestra.run.smithi107.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-07T13:57:57.454 INFO:teuthology.orchestra.run.smithi107.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-07T13:57:57.456 INFO:teuthology.orchestra.run.smithi107.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-07T13:57:57.456 INFO:teuthology.orchestra.run.smithi107.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-07T13:57:57.474 INFO:teuthology.orchestra.run.smithi107.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-07T13:57:57.477 INFO:teuthology.orchestra.run.smithi107.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-07T13:57:57.478 INFO:teuthology.orchestra.run.smithi107.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-07T13:57:57.478 INFO:teuthology.orchestra.run.smithi107.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-07T13:57:57.484 INFO:teuthology.orchestra.run.smithi107.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-07T13:57:57.485 INFO:teuthology.orchestra.run.smithi107.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-07T13:57:57.489 INFO:teuthology.orchestra.run.smithi107.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-07T13:57:57.493 INFO:teuthology.orchestra.run.smithi107.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-07T13:57:57.494 INFO:teuthology.orchestra.run.smithi107.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-07T13:57:57.494 INFO:teuthology.orchestra.run.smithi107.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-07T13:57:57.513 INFO:teuthology.orchestra.run.smithi107.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-07T13:57:57.514 INFO:teuthology.orchestra.run.smithi107.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-07T13:57:57.523 INFO:teuthology.orchestra.run.smithi107.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-07T13:57:57.524 INFO:teuthology.orchestra.run.smithi107.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-07T13:57:57.524 INFO:teuthology.orchestra.run.smithi107.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-07T13:57:57.526 INFO:teuthology.orchestra.run.smithi107.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-07T13:57:57.527 INFO:teuthology.orchestra.run.smithi107.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-07T13:57:57.577 INFO:teuthology.orchestra.run.smithi107.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2521-g1dfb479e-1jammy [112 kB] 2024-05-07T13:57:57.580 INFO:teuthology.orchestra.run.smithi107.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2521-g1dfb479e-1jammy [466 kB] 2024-05-07T13:57:57.595 INFO:teuthology.orchestra.run.smithi107.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2521-g1dfb479e-1jammy [25.6 MB] 2024-05-07T13:57:58.577 INFO:teuthology.orchestra.run.smithi107.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2521-g1dfb479e-1jammy [5,084 kB] 2024-05-07T13:57:58.672 INFO:teuthology.orchestra.run.smithi107.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2521-g1dfb479e-1jammy [244 kB] 2024-05-07T13:57:58.678 INFO:teuthology.orchestra.run.smithi107.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2521-g1dfb479e-1jammy [124 kB] 2024-05-07T13:57:58.682 INFO:teuthology.orchestra.run.smithi107.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2521-g1dfb479e-1jammy [1,526 kB] 2024-05-07T13:57:58.736 INFO:teuthology.orchestra.run.smithi107.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2521-g1dfb479e-1jammy [6,246 kB] 2024-05-07T13:57:58.958 INFO:teuthology.orchestra.run.smithi107.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2521-g1dfb479e-1jammy [22.7 MB] 2024-05-07T13:57:59.144 INFO:teuthology.orchestra.run.smithi106.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2521-g1dfb479e-1jammy [3,216 kB] 2024-05-07T13:57:59.839 INFO:teuthology.orchestra.run.smithi107.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2521-g1dfb479e-1jammy [14.0 kB] 2024-05-07T13:57:59.840 INFO:teuthology.orchestra.run.smithi107.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2521-g1dfb479e-1jammy [869 kB] 2024-05-07T13:57:59.857 INFO:teuthology.orchestra.run.smithi107.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2521-g1dfb479e-1jammy [2,437 kB] 2024-05-07T13:57:59.897 INFO:teuthology.orchestra.run.smithi107.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2521-g1dfb479e-1jammy [791 kB] 2024-05-07T13:57:59.907 INFO:teuthology.orchestra.run.smithi107.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2521-g1dfb479e-1jammy [148 kB] 2024-05-07T13:57:59.908 INFO:teuthology.orchestra.run.smithi107.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2521-g1dfb479e-1jammy [2,331 kB] 2024-05-07T13:57:59.979 INFO:teuthology.orchestra.run.smithi107.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2521-g1dfb479e-1jammy [8,625 kB] 2024-05-07T13:58:00.280 INFO:teuthology.orchestra.run.smithi107.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2521-g1dfb479e-1jammy [14.2 kB] 2024-05-07T13:58:00.281 INFO:teuthology.orchestra.run.smithi107.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2521-g1dfb479e-1jammy [50.7 MB] 2024-05-07T13:58:00.852 INFO:teuthology.orchestra.run.smithi106.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2521-g1dfb479e-1jammy [711 kB] 2024-05-07T13:58:01.229 INFO:teuthology.orchestra.run.smithi106.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2521-g1dfb479e-1jammy [356 kB] 2024-05-07T13:58:01.389 INFO:teuthology.orchestra.run.smithi106.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2521-g1dfb479e-1jammy [32.8 kB] 2024-05-07T13:58:01.448 INFO:teuthology.orchestra.run.smithi106.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2521-g1dfb479e-1jammy [180 kB] 2024-05-07T13:58:01.537 INFO:teuthology.orchestra.run.smithi106.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2521-g1dfb479e-1jammy [67.0 kB] 2024-05-07T13:58:01.540 INFO:teuthology.orchestra.run.smithi106.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2521-g1dfb479e-1jammy [330 kB] 2024-05-07T13:58:01.763 INFO:teuthology.orchestra.run.smithi106.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2521-g1dfb479e-1jammy [6,780 kB] 2024-05-07T13:58:02.384 INFO:teuthology.orchestra.run.smithi107.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2521-g1dfb479e-1jammy [121 kB] 2024-05-07T13:58:02.386 INFO:teuthology.orchestra.run.smithi107.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2521-g1dfb479e-1jammy [38.9 kB] 2024-05-07T13:58:02.387 INFO:teuthology.orchestra.run.smithi107.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2521-g1dfb479e-1jammy [13.4 MB] 2024-05-07T13:58:02.746 INFO:teuthology.orchestra.run.smithi107.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2521-g1dfb479e-1jammy [91.5 kB] 2024-05-07T13:58:03.191 INFO:teuthology.orchestra.run.smithi106.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2521-g1dfb479e-1jammy [112 kB] 2024-05-07T13:58:03.193 INFO:teuthology.orchestra.run.smithi106.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2521-g1dfb479e-1jammy [466 kB] 2024-05-07T13:58:03.254 INFO:teuthology.orchestra.run.smithi106.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2521-g1dfb479e-1jammy [25.6 MB] 2024-05-07T13:58:03.308 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 180 MB in 6s (30.4 MB/s) 2024-05-07T13:58:03.436 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-07T13:58:03.535 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-07T13:58:03.540 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-07T13:58:03.618 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-07T13:58:03.939 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-07T13:58:03.965 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-07T13:58:04.005 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-07T13:58:04.350 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-07T13:58:04.377 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-07T13:58:04.417 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-07T13:58:04.829 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-07T13:58:04.855 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-07T13:58:04.895 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-07T13:58:05.307 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-07T13:58:05.333 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-07T13:58:05.449 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-07T13:58:05.802 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-07T13:58:05.829 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-07T13:58:05.834 INFO:teuthology.orchestra.run.smithi106.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2521-g1dfb479e-1jammy [5,084 kB] 2024-05-07T13:58:05.868 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-07T13:58:06.189 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-07T13:58:06.189 INFO:teuthology.orchestra.run.smithi106.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2521-g1dfb479e-1jammy [244 kB] 2024-05-07T13:58:06.208 INFO:teuthology.orchestra.run.smithi106.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2521-g1dfb479e-1jammy [124 kB] 2024-05-07T13:58:06.215 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-07T13:58:06.226 INFO:teuthology.orchestra.run.smithi106.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2521-g1dfb479e-1jammy [1,526 kB] 2024-05-07T13:58:06.247 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-07T13:58:06.333 INFO:teuthology.orchestra.run.smithi106.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2521-g1dfb479e-1jammy [6,246 kB] 2024-05-07T13:58:06.575 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librados2. 2024-05-07T13:58:06.601 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../007-librados2_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:06.641 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librados2 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:06.797 INFO:teuthology.orchestra.run.smithi106.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2521-g1dfb479e-1jammy [22.7 MB] 2024-05-07T13:58:07.094 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librbd1. 2024-05-07T13:58:07.120 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../008-librbd1_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:07.161 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librbd1 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:07.572 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libcephfs2. 2024-05-07T13:58:07.598 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:07.630 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libcephfs2 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:07.916 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rados. 2024-05-07T13:58:07.943 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:07.983 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rados (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:08.311 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-07T13:58:08.337 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:08.377 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-ceph-argparse (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:08.475 INFO:teuthology.orchestra.run.smithi106.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2521-g1dfb479e-1jammy [14.0 kB] 2024-05-07T13:58:08.475 INFO:teuthology.orchestra.run.smithi106.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2521-g1dfb479e-1jammy [869 kB] 2024-05-07T13:58:08.492 INFO:teuthology.orchestra.run.smithi106.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2521-g1dfb479e-1jammy [2,437 kB] 2024-05-07T13:58:08.607 INFO:teuthology.orchestra.run.smithi106.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2521-g1dfb479e-1jammy [791 kB] 2024-05-07T13:58:08.630 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cephfs. 2024-05-07T13:58:08.650 INFO:teuthology.orchestra.run.smithi106.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2521-g1dfb479e-1jammy [148 kB] 2024-05-07T13:58:08.653 INFO:teuthology.orchestra.run.smithi106.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2521-g1dfb479e-1jammy [2,331 kB] 2024-05-07T13:58:08.656 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:08.705 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cephfs (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:08.796 INFO:teuthology.orchestra.run.smithi106.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2521-g1dfb479e-1jammy [8,625 kB] 2024-05-07T13:58:08.966 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-07T13:58:08.992 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:09.025 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-ceph-common (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:09.277 INFO:teuthology.orchestra.run.smithi106.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2521-g1dfb479e-1jammy [14.2 kB] 2024-05-07T13:58:09.278 INFO:teuthology.orchestra.run.smithi106.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2521-g1dfb479e-1jammy [50.7 MB] 2024-05-07T13:58:09.336 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-07T13:58:09.362 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-07T13:58:09.402 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-07T13:58:09.740 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-prettytable. 2024-05-07T13:58:09.765 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-07T13:58:09.806 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-07T13:58:10.033 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rbd. 2024-05-07T13:58:10.049 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:10.083 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rbd (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:10.645 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-07T13:58:10.671 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-07T13:58:10.711 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-07T13:58:11.006 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-07T13:58:11.032 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-07T13:58:11.072 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-07T13:58:11.367 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-07T13:58:11.382 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-07T13:58:11.417 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-07T13:58:11.737 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package lua5.1. 2024-05-07T13:58:11.763 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-07T13:58:11.803 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-07T13:58:12.045 INFO:teuthology.orchestra.run.smithi106.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2521-g1dfb479e-1jammy [121 kB] 2024-05-07T13:58:12.047 INFO:teuthology.orchestra.run.smithi106.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2521-g1dfb479e-1jammy [38.9 kB] 2024-05-07T13:58:12.048 INFO:teuthology.orchestra.run.smithi106.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2521-g1dfb479e-1jammy [13.4 MB] 2024-05-07T13:58:12.123 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package lua-any. 2024-05-07T13:58:12.138 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-07T13:58:12.182 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-07T13:58:12.418 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package zip. 2024-05-07T13:58:12.424 INFO:teuthology.orchestra.run.smithi106.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cbodley2-testing/1dfb479e40144c07778a01ea762def8ca56f6eee/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2521-g1dfb479e-1jammy [91.5 kB] 2024-05-07T13:58:12.444 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-07T13:58:12.476 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking zip (3.0-12build2) ... 2024-05-07T13:58:12.805 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package unzip. 2024-05-07T13:58:12.835 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-07T13:58:12.872 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-07T13:58:12.982 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 180 MB in 16s (11.4 MB/s) 2024-05-07T13:58:13.129 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-07T13:58:13.223 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-07T13:58:13.228 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-07T13:58:13.267 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package luarocks. 2024-05-07T13:58:13.293 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-07T13:58:13.303 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-07T13:58:13.333 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-07T13:58:13.582 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-07T13:58:13.608 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-07T13:58:13.648 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-07T13:58:13.691 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librgw2. 2024-05-07T13:58:13.707 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../025-librgw2_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:13.741 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librgw2 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:13.993 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-07T13:58:14.019 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-07T13:58:14.059 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-07T13:58:14.261 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rgw. 2024-05-07T13:58:14.287 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:14.327 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rgw (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:14.505 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-07T13:58:14.531 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-07T13:58:14.580 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-07T13:58:14.672 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-07T13:58:14.699 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-07T13:58:14.738 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-07T13:58:14.975 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-07T13:58:15.001 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-07T13:58:15.033 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libradosstriper1. 2024-05-07T13:58:15.041 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-07T13:58:15.049 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:15.083 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libradosstriper1 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:15.495 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-common. 2024-05-07T13:58:15.522 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:15.589 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-common (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:15.720 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-07T13:58:15.747 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-07T13:58:15.794 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-07T13:58:16.140 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-07T13:58:16.165 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-07T13:58:16.206 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-07T13:58:16.551 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librados2. 2024-05-07T13:58:16.577 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../007-librados2_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:16.618 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librados2 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:16.951 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-base. 2024-05-07T13:58:16.977 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:17.026 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-base (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:17.053 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librbd1. 2024-05-07T13:58:17.080 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../008-librbd1_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:17.119 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librbd1 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:17.572 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-07T13:58:17.572 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs2. 2024-05-07T13:58:17.587 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-07T13:58:17.599 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:17.622 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-07T13:58:17.639 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs2 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:17.892 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rados. 2024-05-07T13:58:18.050 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:18.050 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rados (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:18.050 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cheroot. 2024-05-07T13:58:18.050 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-07T13:58:18.050 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-07T13:58:18.270 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-07T13:58:18.296 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:18.302 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-07T13:58:18.318 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-07T13:58:18.336 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-argparse (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:18.352 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-07T13:58:18.588 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cephfs. 2024-05-07T13:58:18.604 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:18.647 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cephfs (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:18.656 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-07T13:58:18.682 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-07T13:58:18.722 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-07T13:58:18.975 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-07T13:58:19.001 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:19.008 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-07T13:58:19.035 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-07T13:58:19.041 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-common (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:19.075 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-07T13:58:19.344 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-07T13:58:19.345 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-tempora. 2024-05-07T13:58:19.359 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-07T13:58:19.360 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-07T13:58:19.394 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-07T13:58:19.395 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-07T13:58:19.673 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-portend. 2024-05-07T13:58:19.697 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-prettytable. 2024-05-07T13:58:19.699 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-07T13:58:19.723 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-07T13:58:19.739 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-07T13:58:19.764 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-07T13:58:20.042 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-07T13:58:20.058 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rbd. 2024-05-07T13:58:20.069 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-07T13:58:20.073 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:20.109 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-07T13:58:20.116 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rbd (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:20.387 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-07T13:58:20.413 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-07T13:58:20.453 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-07T13:58:20.478 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-07T13:58:20.504 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-07T13:58:20.544 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-07T13:58:20.805 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-07T13:58:20.820 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-07T13:58:20.855 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-07T13:58:21.016 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-natsort. 2024-05-07T13:58:21.042 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-07T13:58:21.082 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-07T13:58:21.159 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-07T13:58:21.185 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-07T13:58:21.225 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-07T13:58:21.385 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-logutils. 2024-05-07T13:58:21.412 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-07T13:58:21.452 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-07T13:58:21.561 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package lua5.1. 2024-05-07T13:58:21.588 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-07T13:58:21.628 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-07T13:58:21.713 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-07T13:58:21.740 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-07T13:58:21.780 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-07T13:58:21.931 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package lua-any. 2024-05-07T13:58:21.946 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-07T13:58:21.989 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-07T13:58:22.083 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-mako. 2024-05-07T13:58:22.109 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-07T13:58:22.149 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-07T13:58:22.217 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package zip. 2024-05-07T13:58:22.233 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-07T13:58:22.275 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking zip (3.0-12build2) ... 2024-05-07T13:58:22.436 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-07T13:58:22.451 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-07T13:58:22.486 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-07T13:58:22.595 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package unzip. 2024-05-07T13:58:22.621 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-07T13:58:22.662 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-07T13:58:22.772 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-07T13:58:22.799 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-07T13:58:22.839 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-07T13:58:23.058 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package luarocks. 2024-05-07T13:58:23.084 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-07T13:58:23.124 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-07T13:58:23.142 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-webob. 2024-05-07T13:58:23.168 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-07T13:58:23.208 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-07T13:58:23.499 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librgw2. 2024-05-07T13:58:23.525 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../025-librgw2_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:23.565 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librgw2 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:23.570 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-waitress. 2024-05-07T13:58:23.596 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-07T13:58:23.639 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-07T13:58:23.897 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-tempita. 2024-05-07T13:58:23.910 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-07T13:58:23.939 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-07T13:58:24.093 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rgw. 2024-05-07T13:58:24.119 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:24.159 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rgw (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:24.234 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-paste. 2024-05-07T13:58:24.260 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-07T13:58:24.300 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-07T13:58:24.529 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-07T13:58:24.555 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-07T13:58:24.595 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-07T13:58:24.595 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-07T13:58:24.611 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-07T13:58:24.645 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-07T13:58:24.873 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libradosstriper1. 2024-05-07T13:58:24.899 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:24.940 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libradosstriper1 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:24.948 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-07T13:58:24.975 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-07T13:58:25.015 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-07T13:58:25.360 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-webtest. 2024-05-07T13:58:25.360 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-common. 2024-05-07T13:58:25.387 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:25.387 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-07T13:58:25.426 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-07T13:58:25.427 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-common (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:25.713 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pecan. 2024-05-07T13:58:25.728 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-07T13:58:25.763 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-07T13:58:26.226 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-certifi. 2024-05-07T13:58:26.241 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-07T13:58:26.276 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-07T13:58:26.546 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-idna. 2024-05-07T13:58:26.572 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-07T13:58:26.612 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-07T13:58:26.773 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-base. 2024-05-07T13:58:26.800 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:26.841 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-base (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:26.924 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-urllib3. 2024-05-07T13:58:26.950 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-07T13:58:26.990 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-07T13:58:27.310 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-requests. 2024-05-07T13:58:27.337 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-07T13:58:27.377 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-07T13:58:27.445 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-07T13:58:27.471 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-07T13:58:27.511 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-07T13:58:27.697 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-07T13:58:27.723 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-07T13:58:27.763 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-07T13:58:27.772 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cheroot. 2024-05-07T13:58:27.798 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-07T13:58:27.830 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-07T13:58:28.033 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-07T13:58:28.048 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:28.083 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:28.125 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-07T13:58:28.152 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-07T13:58:28.192 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-07T13:58:28.480 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-07T13:58:28.495 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-07T13:58:28.506 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:28.521 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-07T13:58:28.555 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:28.561 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-07T13:58:28.808 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-07T13:58:28.834 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-07T13:58:28.864 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-07T13:58:28.865 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-07T13:58:28.891 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-07T13:58:28.931 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-07T13:58:29.194 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-openssl. 2024-05-07T13:58:29.220 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-07T13:58:29.236 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempora. 2024-05-07T13:58:29.260 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-07T13:58:29.262 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-07T13:58:29.302 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-07T13:58:29.605 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-portend. 2024-05-07T13:58:29.613 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr. 2024-05-07T13:58:29.631 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-07T13:58:29.640 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:29.672 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-07T13:58:29.680 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:29.950 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-07T13:58:29.976 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-07T13:58:30.016 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-07T13:58:30.042 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mon. 2024-05-07T13:58:30.068 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:30.100 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mon (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:31.053 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-07T13:58:31.080 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-07T13:58:31.120 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-07T13:58:31.448 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-natsort. 2024-05-07T13:58:31.475 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-07T13:58:31.515 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-07T13:58:31.629 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-osd. 2024-05-07T13:58:31.655 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:31.695 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-osd (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:31.801 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-logutils. 2024-05-07T13:58:31.828 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-07T13:58:31.868 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-07T13:58:32.179 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-07T13:58:32.205 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-07T13:58:32.245 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-07T13:58:32.515 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-mako. 2024-05-07T13:58:32.541 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-07T13:58:32.640 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-07T13:58:32.807 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph. 2024-05-07T13:58:32.823 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../066-ceph_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:32.865 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:32.943 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-07T13:58:32.970 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-07T13:58:33.002 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-07T13:58:33.250 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-fuse. 2024-05-07T13:58:33.277 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:33.279 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-07T13:58:33.306 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-07T13:58:33.326 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-fuse (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:33.346 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-07T13:58:33.665 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webob. 2024-05-07T13:58:33.692 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-07T13:58:33.732 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-07T13:58:33.763 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mds. 2024-05-07T13:58:33.790 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:33.838 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mds (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:34.102 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-waitress. 2024-05-07T13:58:34.128 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-07T13:58:34.192 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-07T13:58:34.258 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package cephadm. 2024-05-07T13:58:34.285 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../069-cephadm_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:34.324 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking cephadm (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:34.496 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempita. 2024-05-07T13:58:34.523 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-07T13:58:34.563 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-07T13:58:34.636 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-07T13:58:34.662 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-07T13:58:34.702 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-07T13:58:34.807 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-paste. 2024-05-07T13:58:34.834 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-07T13:58:34.866 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-07T13:58:35.039 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-07T13:58:35.066 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-07T13:58:35.105 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-07T13:58:35.186 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-07T13:58:35.212 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-07T13:58:35.252 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-07T13:58:35.805 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-07T13:58:35.832 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-07T13:58:35.872 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-07T13:58:36.152 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-babel. 2024-05-07T13:58:36.175 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webtest. 2024-05-07T13:58:36.179 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-07T13:58:36.201 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-07T13:58:36.218 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-07T13:58:36.241 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-07T13:58:36.494 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pecan. 2024-05-07T13:58:36.510 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-07T13:58:36.544 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-07T13:58:36.580 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jinja2. 2024-05-07T13:58:36.607 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-07T13:58:36.647 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-07T13:58:36.916 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-certifi. 2024-05-07T13:58:36.943 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-07T13:58:36.982 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-07T13:58:36.992 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-07T13:58:37.018 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:37.058 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:37.260 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-idna. 2024-05-07T13:58:37.287 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-07T13:58:37.318 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-07T13:58:37.420 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-07T13:58:37.446 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-07T13:58:37.486 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-07T13:58:37.621 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-urllib3. 2024-05-07T13:58:37.648 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-07T13:58:37.688 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-07T13:58:37.791 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-routes. 2024-05-07T13:58:37.818 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-07T13:58:37.858 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-07T13:58:38.016 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-requests. 2024-05-07T13:58:38.043 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-07T13:58:38.082 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-07T13:58:38.194 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-07T13:58:38.221 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:38.260 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:38.403 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-07T13:58:38.429 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-07T13:58:38.469 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-07T13:58:38.781 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-07T13:58:38.807 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:38.847 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:39.227 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-07T13:58:39.254 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:39.285 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:39.590 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-07T13:58:39.606 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-07T13:58:39.640 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-07T13:58:39.655 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-07T13:58:39.682 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-07T13:58:39.730 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-07T13:58:40.077 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-joblib. 2024-05-07T13:58:40.082 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-openssl. 2024-05-07T13:58:40.103 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-07T13:58:40.109 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-07T13:58:40.135 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-07T13:58:40.157 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-07T13:58:40.496 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-07T13:58:40.502 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr. 2024-05-07T13:58:40.523 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-07T13:58:40.529 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:40.562 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-07T13:58:40.568 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:40.874 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-sklearn. 2024-05-07T13:58:40.901 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-07T13:58:40.940 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-07T13:58:41.014 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mon. 2024-05-07T13:58:41.041 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:41.088 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mon (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:41.632 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-07T13:58:41.659 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:41.834 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-osd. 2024-05-07T13:58:41.861 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:41.908 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-osd (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:41.942 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:42.929 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph. 2024-05-07T13:58:42.929 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cachetools. 2024-05-07T13:58:42.944 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../066-ceph_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:42.946 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-07T13:58:42.978 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:42.986 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-07T13:58:43.264 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-07T13:58:43.264 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-fuse. 2024-05-07T13:58:43.291 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-07T13:58:43.291 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:43.331 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-fuse (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:43.347 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-07T13:58:43.642 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-07T13:58:43.658 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-07T13:58:43.692 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-07T13:58:43.717 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mds. 2024-05-07T13:58:43.744 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:43.784 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mds (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:43.945 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rsa. 2024-05-07T13:58:43.972 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-07T13:58:44.003 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-07T13:58:44.129 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephadm. 2024-05-07T13:58:44.155 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../069-cephadm_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:44.195 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephadm (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:44.315 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-google-auth. 2024-05-07T13:58:44.342 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-07T13:58:44.381 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-07T13:58:44.548 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-07T13:58:44.575 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-07T13:58:44.623 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-07T13:58:44.685 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-07T13:58:44.711 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-07T13:58:44.750 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-07T13:58:44.984 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-07T13:58:45.011 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-07T13:58:45.059 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-07T13:58:45.062 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-websocket. 2024-05-07T13:58:45.089 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-07T13:58:45.128 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-07T13:58:45.432 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-07T13:58:45.459 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-07T13:58:45.498 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-07T13:58:46.098 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-babel. 2024-05-07T13:58:46.119 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-07T13:58:46.164 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-07T13:58:46.170 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-07T13:58:46.198 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:46.236 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:46.514 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-07T13:58:46.517 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jinja2. 2024-05-07T13:58:46.542 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-07T13:58:46.544 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-07T13:58:46.572 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-07T13:58:46.584 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-07T13:58:46.900 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-07T13:58:46.928 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-07T13:58:46.937 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-07T13:58:46.964 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:46.967 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-07T13:58:47.003 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:47.227 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package jq. 2024-05-07T13:58:47.243 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-07T13:58:47.285 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-07T13:58:47.349 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-07T13:58:47.376 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-07T13:58:47.415 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-07T13:58:47.538 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package socat. 2024-05-07T13:58:47.565 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-07T13:58:47.605 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-07T13:58:47.718 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-routes. 2024-05-07T13:58:47.744 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-07T13:58:47.784 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-07T13:58:47.899 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package xmlstarlet. 2024-05-07T13:58:47.915 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-07T13:58:47.949 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-07T13:58:48.121 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-07T13:58:48.148 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:48.187 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:48.303 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-test. 2024-05-07T13:58:48.319 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:48.361 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-test (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:49.443 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-07T13:58:49.459 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-07T13:58:49.500 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-07T13:58:49.996 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-joblib. 2024-05-07T13:58:50.023 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-07T13:58:50.063 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-07T13:58:50.399 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-07T13:58:50.415 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-07T13:58:50.449 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-07T13:58:50.582 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-volume. 2024-05-07T13:58:50.609 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:50.648 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-volume (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:50.718 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn. 2024-05-07T13:58:50.745 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-07T13:58:50.793 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-07T13:58:50.952 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-07T13:58:50.968 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:51.010 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libcephfs-dev (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:51.304 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-07T13:58:51.332 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-07T13:58:51.371 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-07T13:58:51.477 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-07T13:58:51.504 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:51.629 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:51.792 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-07T13:58:51.820 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-07T13:58:51.859 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-07T13:58:52.512 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package nvme-cli. 2024-05-07T13:58:52.542 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-07T13:58:52.579 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-07T13:58:52.591 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cachetools. 2024-05-07T13:58:52.618 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-07T13:58:52.649 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-07T13:58:52.952 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-07T13:58:52.967 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package pkg-config. 2024-05-07T13:58:52.979 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-07T13:58:52.995 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-07T13:58:53.019 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-07T13:58:53.025 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-07T13:58:53.236 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-07T13:58:53.252 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-07T13:58:53.294 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-07T13:58:53.364 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-07T13:58:53.391 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-07T13:58:53.430 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-07T13:58:53.725 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rsa. 2024-05-07T13:58:53.752 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-07T13:58:53.755 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-07T13:58:53.783 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-07T13:58:53.791 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-07T13:58:53.822 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-07T13:58:54.075 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pastescript. 2024-05-07T13:58:54.079 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-google-auth. 2024-05-07T13:58:54.102 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-07T13:58:54.106 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-07T13:58:54.133 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-07T13:58:54.137 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-07T13:58:54.394 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pluggy. 2024-05-07T13:58:54.398 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-07T13:58:54.410 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-07T13:58:54.414 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-07T13:58:54.444 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-07T13:58:54.448 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-07T13:58:54.747 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-psutil. 2024-05-07T13:58:54.751 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-websocket. 2024-05-07T13:58:54.775 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-07T13:58:54.779 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-07T13:58:54.813 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-07T13:58:54.818 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-07T13:58:55.138 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-07T13:58:55.158 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-py. 2024-05-07T13:58:55.165 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-07T13:58:55.186 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-07T13:58:55.204 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-07T13:58:55.224 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-07T13:58:55.503 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pygments. 2024-05-07T13:58:55.531 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-07T13:58:55.569 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-07T13:58:55.901 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-07T13:58:55.919 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:58:55.960 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:56.015 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-07T13:58:56.042 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-07T13:58:56.081 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-07T13:58:56.288 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-07T13:58:56.315 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-07T13:58:56.354 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-07T13:58:56.392 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-toml. 2024-05-07T13:58:56.421 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-07T13:58:56.458 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-07T13:58:56.761 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pytest. 2024-05-07T13:58:56.789 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-07T13:58:56.827 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-07T13:58:56.857 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-07T13:58:56.884 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-07T13:58:56.924 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-07T13:58:57.156 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-simplejson. 2024-05-07T13:58:57.183 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-07T13:58:57.185 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package jq. 2024-05-07T13:58:57.212 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-07T13:58:57.222 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-07T13:58:57.251 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-07T13:58:57.505 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package socat. 2024-05-07T13:58:57.508 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-07T13:58:57.532 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-07T13:58:57.535 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-07T13:58:57.571 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-07T13:58:57.574 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-07T13:58:57.866 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package xmlstarlet. 2024-05-07T13:58:57.881 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-07T13:58:57.916 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-07T13:58:58.270 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-test. 2024-05-07T13:58:58.286 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:58.328 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-test (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:58.345 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package radosgw. 2024-05-07T13:58:58.373 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../116-radosgw_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:58.411 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking radosgw (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:59.190 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package rbd-fuse. 2024-05-07T13:58:59.217 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:58:59.258 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking rbd-fuse (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:58:59.551 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-07T13:58:59.802 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-07T13:58:59.928 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-07T13:59:00.185 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-07T13:59:00.536 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-07T13:59:00.649 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-volume. 2024-05-07T13:59:00.676 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2521-g1dfb479e-1jammy_all.deb ... 2024-05-07T13:59:00.707 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-volume (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:00.954 INFO:teuthology.orchestra.run.smithi107.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-07T13:59:00.986 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-07T13:59:01.002 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:59:01.012 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up cephadm (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:01.036 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs-dev (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:01.306 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-07T13:59:01.333 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-07T13:59:01.372 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-07T13:59:01.520 INFO:teuthology.orchestra.run.smithi107.stdout:Adding system user cephadm....done 2024-05-07T13:59:01.643 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-07T13:59:01.718 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-07T13:59:01.746 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-07T13:59:01.784 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-07T13:59:01.945 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-07T13:59:02.097 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package nvme-cli. 2024-05-07T13:59:02.125 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-07T13:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-07T13:59:02.179 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-07T13:59:02.297 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-07T13:59:02.561 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package pkg-config. 2024-05-07T13:59:02.588 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-07T13:59:02.627 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-07T13:59:02.698 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-07T13:59:02.913 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-07T13:59:02.941 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-07T13:59:02.957 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-07T13:59:02.980 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-07T13:59:03.083 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-07T13:59:03.385 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-07T13:59:03.408 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-07T13:59:03.436 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-07T13:59:03.474 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-07T13:59:03.745 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-07T13:59:03.777 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastescript. 2024-05-07T13:59:03.805 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-07T13:59:03.844 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-07T13:59:04.004 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-07T13:59:04.131 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pluggy. 2024-05-07T13:59:04.147 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-07T13:59:04.180 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-07T13:59:04.281 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-07T13:59:04.467 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-psutil. 2024-05-07T13:59:04.495 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-07T13:59:04.498 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-07T13:59:04.533 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-07T13:59:04.733 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-07T13:59:04.861 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-py. 2024-05-07T13:59:04.889 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-07T13:59:04.928 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-07T13:59:05.001 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-07T13:59:05.273 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pygments. 2024-05-07T13:59:05.300 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-07T13:59:05.326 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-ceph-argparse (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:05.339 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-07T13:59:05.586 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-07T13:59:05.712 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-07T13:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-07T13:59:05.793 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-07T13:59:05.826 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-07T13:59:05.837 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-07T13:59:05.964 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-07T13:59:06.105 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-toml. 2024-05-07T13:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-07T13:59:06.179 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-07T13:59:06.214 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-07T13:59:06.647 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-07T13:59:06.671 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-07T13:59:06.734 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-07T13:59:06.832 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pytest. 2024-05-07T13:59:06.860 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-07T13:59:06.860 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-07T13:59:06.899 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-07T13:59:07.202 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplejson. 2024-05-07T13:59:07.218 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-07T13:59:07.219 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-07T13:59:07.260 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-07T13:59:07.345 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-07T13:59:07.523 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-07T13:59:07.539 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-07T13:59:07.581 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-07T13:59:07.621 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-07T13:59:07.881 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-07T13:59:08.174 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up zip (3.0-12build2) ... 2024-05-07T13:59:08.299 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-07T13:59:08.302 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package radosgw. 2024-05-07T13:59:08.330 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../116-radosgw_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:59:08.368 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking radosgw (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:08.976 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-07T13:59:09.172 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-fuse. 2024-05-07T13:59:09.188 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2521-g1dfb479e-1jammy_amd64.deb ... 2024-05-07T13:59:09.229 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-fuse (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:09.235 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-07T13:59:09.336 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-07T13:59:09.437 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-07T13:59:09.543 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-07T13:59:09.739 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-07T13:59:09.818 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-07T13:59:09.944 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-07T13:59:10.114 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-07T13:59:10.234 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-07T13:59:10.357 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-07T13:59:10.530 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-07T13:59:10.734 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-07T13:59:10.939 INFO:teuthology.orchestra.run.smithi106.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-07T13:59:11.013 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephadm (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:11.018 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-07T13:59:11.361 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-07T13:59:11.554 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user cephadm....done 2024-05-07T13:59:11.612 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-07T13:59:11.685 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-07T13:59:11.746 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-ceph-common (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:11.978 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-07T13:59:12.006 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-idna (3.3-1) ... 2024-05-07T13:59:12.229 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-07T13:59:12.323 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-07T13:59:12.364 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-07T13:59:12.623 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-07T13:59:12.891 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-07T13:59:13.042 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-07T13:59:13.344 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-07T13:59:13.504 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-07T13:59:13.696 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-07T13:59:13.730 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-07T13:59:13.839 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-07T13:59:13.956 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-07T13:59:14.082 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-07T13:59:14.225 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-07T13:59:14.249 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-07T13:59:14.350 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-07T13:59:14.492 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-07T13:59:14.643 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-07T13:59:14.751 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-07T13:59:14.911 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-07T13:59:14.994 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-07T13:59:15.162 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-07T13:59:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-argparse (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:15.280 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-07T13:59:15.513 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-07T13:59:15.573 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-07T13:59:15.638 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-07T13:59:15.773 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-07T13:59:15.832 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-07T13:59:15.899 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-07T13:59:16.083 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-07T13:59:16.166 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-07T13:59:16.334 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-07T13:59:16.556 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-07T13:59:16.585 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-07T13:59:16.588 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-07T13:59:16.653 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-07T13:59:16.787 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-07T13:59:16.852 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-07T13:59:16.962 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-07T13:59:17.147 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-07T13:59:17.247 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-07T13:59:17.306 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-07T13:59:17.364 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-07T13:59:17.574 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-07T13:59:17.648 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-07T13:59:17.859 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-07T13:59:17.958 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-07T13:59:18.160 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up zip (3.0-12build2) ... 2024-05-07T13:59:18.217 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-07T13:59:18.286 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-07T13:59:18.360 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-07T13:59:18.486 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-07T13:59:18.575 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-07T13:59:18.812 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-07T13:59:18.913 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-07T13:59:18.938 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-07T13:59:19.231 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-07T13:59:19.290 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-07T13:59:19.382 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-07T13:59:19.532 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-07T13:59:19.533 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-07T13:59:19.658 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-07T13:59:19.859 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-07T13:59:19.909 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-07T13:59:20.035 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-07T13:59:20.243 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-07T13:59:20.353 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-07T13:59:20.494 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-07T13:59:20.670 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-07T13:59:20.863 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-07T13:59:20.938 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-07T13:59:21.039 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-07T13:59:21.164 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-07T13:59:21.298 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-07T13:59:21.541 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-07T13:59:21.549 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-07T13:59:21.834 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-07T13:59:21.894 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-07T13:59:21.968 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-common (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:22.279 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-07T13:59:22.286 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-idna (3.3-1) ... 2024-05-07T13:59:22.555 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-07T13:59:22.612 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-07T13:59:22.904 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-07T13:59:23.034 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librados2 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:23.160 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:23.285 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-07T13:59:23.613 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libcephfs2 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:23.734 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-07T13:59:23.773 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libradosstriper1 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:23.899 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-07T13:59:23.994 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-07T13:59:24.129 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-07T13:59:24.175 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librbd1 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:24.301 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-modules-core (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:24.405 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-07T13:59:24.427 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-fuse (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:24.556 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-07T13:59:24.638 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-07T13:59:24.639 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-07T13:59:24.724 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-07T13:59:25.050 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-07T13:59:25.179 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libcephfs-dev (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:25.309 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-07T13:59:25.321 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rados (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:25.569 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-07T13:59:25.695 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-07T13:59:25.781 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librgw2 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:25.907 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-07T13:59:25.997 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-07T13:59:26.273 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-07T13:59:26.574 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-07T13:59:26.858 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-07T13:59:27.127 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rbd (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:27.134 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-07T13:59:27.252 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up rbd-fuse (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:27.373 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rgw (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:27.419 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-07T13:59:27.482 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cephfs (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:27.545 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-07T13:59:27.583 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-common (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:27.837 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-07T13:59:28.014 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-07T13:59:28.142 INFO:teuthology.orchestra.run.smithi107.stdout:Adding group ceph....done 2024-05-07T13:59:28.323 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-07T13:59:28.477 INFO:teuthology.orchestra.run.smithi107.stdout:Adding system user ceph....done 2024-05-07T13:59:28.595 INFO:teuthology.orchestra.run.smithi107.stdout:Setting system user ceph properties....done 2024-05-07T13:59:28.614 INFO:teuthology.orchestra.run.smithi107.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-07T13:59:28.666 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-07T13:59:28.758 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-07T13:59:28.942 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-07T13:59:29.068 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-07T13:59:29.075 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-07T13:59:29.194 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-07T13:59:29.284 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-07T13:59:29.529 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-07T13:59:29.542 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-test (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:29.664 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-07T13:59:29.668 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up radosgw (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:30.074 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-07T13:59:30.126 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-07T13:59:30.126 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-07T13:59:30.367 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-07T13:59:30.518 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-07T13:59:30.603 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-base (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:30.794 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-07T13:59:30.920 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-07T13:59:30.958 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-07T13:59:31.229 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-07T13:59:31.455 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mds (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:31.564 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-07T13:59:31.677 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-07T13:59:31.677 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-07T13:59:31.857 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-07T13:59:32.008 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-07T13:59:32.165 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:32.300 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-07T13:59:32.386 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-07T13:59:32.386 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-07T13:59:32.577 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-07T13:59:32.858 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-osd (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:32.930 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-07T13:59:33.142 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-07T13:59:33.143 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-07T13:59:33.315 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-07T13:59:33.625 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-07T13:59:33.627 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:33.753 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:33.904 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mon (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:33.969 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-07T13:59:34.098 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librados2 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:34.117 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-07T13:59:34.117 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-07T13:59:34.229 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:34.380 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-07T13:59:34.621 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-cephadm (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:34.783 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs2 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:34.798 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:34.924 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-dashboard (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:34.926 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libradosstriper1 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:35.052 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-07T13:59:35.075 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-volume (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:35.354 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librbd1 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:35.419 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-07T13:59:35.480 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-modules-core (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:35.511 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-07T13:59:35.631 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-fuse (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:35.655 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-07T13:59:35.859 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-07T13:59:35.860 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-07T13:59:36.365 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs-dev (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:36.491 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rados (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:36.617 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librgw2 (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:36.743 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-07T13:59:36.773 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-07T13:59:37.417 INFO:teuthology.orchestra.run.smithi107.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-07T13:59:37.423 DEBUG:teuthology.parallel:result is None 2024-05-07T13:59:37.889 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rbd (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:38.040 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-fuse (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:38.208 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rgw (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:38.358 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cephfs (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:38.510 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-common (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:39.128 INFO:teuthology.orchestra.run.smithi106.stdout:Adding group ceph....done 2024-05-07T13:59:39.521 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user ceph....done 2024-05-07T13:59:39.731 INFO:teuthology.orchestra.run.smithi106.stdout:Setting system user ceph properties....done 2024-05-07T13:59:39.752 INFO:teuthology.orchestra.run.smithi106.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-07T13:59:39.892 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-07T13:59:40.239 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-07T13:59:40.712 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-test (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:40.829 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up radosgw (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:41.255 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-07T13:59:41.255 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-07T13:59:41.698 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-base (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:42.068 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-07T13:59:42.541 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mds (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:42.788 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-07T13:59:42.788 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-07T13:59:43.260 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:43.496 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-07T13:59:43.496 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-07T13:59:43.953 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-osd (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:44.219 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-07T13:59:44.219 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-07T13:59:44.696 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:44.856 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:45.041 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mon (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:45.269 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-07T13:59:45.270 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-07T13:59:45.817 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-cephadm (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:46.010 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:46.136 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-dashboard (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:46.287 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-volume (19.0.0-2521-g1dfb479e-1jammy) ... 2024-05-07T13:59:46.632 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-07T13:59:46.758 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-07T13:59:46.927 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-07T13:59:48.237 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-07T13:59:48.898 INFO:teuthology.orchestra.run.smithi106.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-07T13:59:48.902 DEBUG:teuthology.parallel:result is None 2024-05-07T13:59:48.903 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1dfb479e40144c07778a01ea762def8ca56f6eee 2024-05-07T13:59:49.053 DEBUG:teuthology.orchestra.run.smithi106:> dpkg-query -W -f '${Version}' ceph 2024-05-07T13:59:49.072 INFO:teuthology.orchestra.run.smithi106.stdout:19.0.0-2521-g1dfb479e-1jammy 2024-05-07T13:59:49.072 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2521-g1dfb479e-1jammy 2024-05-07T13:59:49.073 INFO:teuthology.task.install:The correct ceph version 19.0.0-2521-g1dfb479e-1jammy is installed. 2024-05-07T13:59:49.074 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1dfb479e40144c07778a01ea762def8ca56f6eee 2024-05-07T13:59:49.320 DEBUG:teuthology.orchestra.run.smithi107:> dpkg-query -W -f '${Version}' ceph 2024-05-07T13:59:49.340 INFO:teuthology.orchestra.run.smithi107.stdout:19.0.0-2521-g1dfb479e-1jammy 2024-05-07T13:59:49.340 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2521-g1dfb479e-1jammy 2024-05-07T13:59:49.340 INFO:teuthology.task.install:The correct ceph version 19.0.0-2521-g1dfb479e-1jammy is installed. 2024-05-07T13:59:49.342 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-07T13:59:49.342 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T13:59:49.342 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-07T13:59:49.354 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T13:59:49.354 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-07T13:59:49.394 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-07T13:59:49.394 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T13:59:49.394 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2024-05-07T13:59:49.409 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-07T13:59:49.464 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T13:59:49.464 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-05-07T13:59:49.478 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-07T13:59:49.533 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-07T13:59:49.533 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T13:59:49.533 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-07T13:59:49.546 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-07T13:59:49.601 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T13:59:49.601 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-07T13:59:49.614 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-07T13:59:49.669 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-07T13:59:49.669 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T13:59:49.669 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2024-05-07T13:59:49.682 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-07T13:59:49.737 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T13:59:49.737 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-05-07T13:59:49.750 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-07T13:59:49.806 INFO:teuthology.run_tasks:Running task ceph... 2024-05-07T13:59:49.902 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-07T13:59:49.902 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2024-05-07T13:59:49.904 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-05-07T13:59:49.916 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-07T13:59:49.917 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-07T13:59:49.959 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-07T13:59:49.971 INFO:tasks.ceph:Creating extra log directories... 2024-05-07T13:59:49.971 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-07T13:59:50.015 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-07T13:59:50.038 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-07T13:59:50.038 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-07T13:59:50.038 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430', 'branch': 'wip-cbodley2-testing', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}', 'email': None, 'first_in_suite': False, 'job_id': '7695430', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cbodley2-testing'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-squid'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley2-testing', 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4511, 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cbodley2-testing', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1dfb479e40144c07778a01ea762def8ca56f6eee/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee', 'targets': {'smithi106.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK9J577KADgwtBiu1Oe26V//NDan17tbCa/gSbHAwddI1hW884gX6rSBb2zmekLPs/7goLpums5VanyvMjoMhms=', 'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLdtBNLKvxqhfHDsQjPxjW6lWe9DAX5mA4R+rTPTFUSPoBTtesQKOWuJ+YZnRYJJmOYLQ++Qp8F/KXXKdj1Dkrk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_bucket_quota.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-07_13:33:35', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-07T13:59:50.039 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-07T13:59:50.071 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-07T13:59:50.076 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2024-05-07T13:59:50.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-05-07T13:59:50.131 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T13:59:50.131 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2024-05-07T13:59:50.178 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-07T13:59:50.178 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2024-05-07T13:59:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-07T13:59:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:59:50.227 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-05-07T13:59:50.227 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:59:50.227 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-07 13:54:28.683303679 +0000 2024-05-07T13:59:50.227 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-07 13:54:28.415306071 +0000 2024-05-07T13:59:50.227 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-07 13:54:28.415306071 +0000 2024-05-07T13:59:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-05-07T13:59:50.228 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-07T13:59:50.281 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-07T13:59:50.281 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-07T13:59:50.281 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000383786 s, 1.3 MB/s 2024-05-07T13:59:50.282 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-07T13:59:50.331 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2024-05-07T13:59:50.377 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-07T13:59:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:59:50.378 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-05-07T13:59:50.378 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:59:50.378 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-07 13:54:29.151299498 +0000 2024-05-07T13:59:50.378 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-07 13:54:28.919301571 +0000 2024-05-07T13:59:50.378 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-07 13:54:28.919301571 +0000 2024-05-07T13:59:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-05-07T13:59:50.378 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-07T13:59:50.430 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-07T13:59:50.431 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-07T13:59:50.431 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000409216 s, 1.3 MB/s 2024-05-07T13:59:50.432 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-07T13:59:50.479 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2024-05-07T13:59:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-07T13:59:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:59:50.526 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-05-07T13:59:50.526 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:59:50.526 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-07 13:54:29.623295281 +0000 2024-05-07T13:59:50.526 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-07 13:54:29.367297567 +0000 2024-05-07T13:59:50.526 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-07 13:54:29.367297567 +0000 2024-05-07T13:59:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-05-07T13:59:50.526 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-07T13:59:50.578 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-07T13:59:50.579 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-07T13:59:50.579 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000414926 s, 1.2 MB/s 2024-05-07T13:59:50.580 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-07T13:59:50.627 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2024-05-07T13:59:50.675 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-07T13:59:50.676 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:59:50.676 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-05-07T13:59:50.676 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:59:50.676 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-05-07 13:54:30.127290778 +0000 2024-05-07T13:59:50.676 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-05-07 13:54:29.859293172 +0000 2024-05-07T13:59:50.676 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-05-07 13:54:29.859293172 +0000 2024-05-07T13:59:50.676 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-05-07T13:59:50.677 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-07T13:59:50.728 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-05-07T13:59:50.729 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-05-07T13:59:50.729 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000286876 s, 1.8 MB/s 2024-05-07T13:59:50.730 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-07T13:59:50.779 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-07T13:59:50.780 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T13:59:50.780 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-05-07T13:59:50.786 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-07T13:59:50.786 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-05-07T13:59:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-07T13:59:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:59:50.834 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-05-07T13:59:50.834 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:59:50.835 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-07 13:54:28.207971578 +0000 2024-05-07T13:59:50.835 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-07 13:54:27.963973756 +0000 2024-05-07T13:59:50.835 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-07 13:54:27.963973756 +0000 2024-05-07T13:59:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-05-07T13:59:50.835 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-07T13:59:50.889 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-07T13:59:50.889 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-07T13:59:50.889 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000412899 s, 1.2 MB/s 2024-05-07T13:59:50.890 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-07T13:59:50.939 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-05-07T13:59:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-07T13:59:50.986 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:59:50.987 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-05-07T13:59:50.987 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:59:50.987 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-07 13:54:28.711967076 +0000 2024-05-07T13:59:50.987 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-07 13:54:28.439969505 +0000 2024-05-07T13:59:50.987 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-07 13:54:28.439969505 +0000 2024-05-07T13:59:50.987 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-05-07T13:59:50.987 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-07T13:59:51.044 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-07T13:59:51.045 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-07T13:59:51.045 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000452661 s, 1.1 MB/s 2024-05-07T13:59:51.046 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-07T13:59:51.095 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-05-07T13:59:51.142 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-07T13:59:51.143 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:59:51.143 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-05-07T13:59:51.143 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:59:51.143 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-07 13:54:29.159963074 +0000 2024-05-07T13:59:51.143 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-07 13:54:28.915965253 +0000 2024-05-07T13:59:51.144 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-07 13:54:28.915965253 +0000 2024-05-07T13:59:51.144 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-05-07T13:59:51.144 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-07T13:59:51.196 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-07T13:59:51.197 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-07T13:59:51.197 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000398932 s, 1.3 MB/s 2024-05-07T13:59:51.198 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-07T13:59:51.247 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-05-07T13:59:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-07T13:59:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-07T13:59:51.294 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-05-07T13:59:51.294 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-07T13:59:51.294 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-07 13:54:29.647958714 +0000 2024-05-07T13:59:51.294 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-07 13:54:29.391961002 +0000 2024-05-07T13:59:51.294 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-07 13:54:29.391961002 +0000 2024-05-07T13:59:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-05-07T13:59:51.295 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-07T13:59:51.348 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-07T13:59:51.348 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-07T13:59:51.349 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000384534 s, 1.3 MB/s 2024-05-07T13:59:51.349 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-07T13:59:51.401 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-07T13:59:51.401 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-07T13:59:51.401 INFO:tasks.ceph:Generating config... 2024-05-07T13:59:51.403 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-05-07T13:59:51.403 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-07T13:59:51.403 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-07T13:59:51.403 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-07T13:59:51.403 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-07T13:59:51.403 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-07T13:59:51.403 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-07T13:59:51.403 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-07T13:59:51.403 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-07T13:59:51.403 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-07T13:59:51.403 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-07T13:59:51.404 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-07T13:59:51.404 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-07T13:59:51.404 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-07T13:59:51.404 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-07T13:59:51.404 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-07T13:59:51.404 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-07T13:59:51.404 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-07T13:59:51.404 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-07T13:59:51.404 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-07T13:59:51.404 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-07T13:59:51.404 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-07T13:59:51.404 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-07T13:59:51.404 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-05-07T13:59:51.405 INFO:tasks.ceph:Setting up mon.a... 2024-05-07T13:59:51.405 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-07T13:59:51.439 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.keyring 2024-05-07T13:59:51.460 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-07T13:59:51.537 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-07T13:59:51.593 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.106'), ('mon.c', '[v2:172.21.15.106:3301,v1:172.21.15.106:6790]'), ('mon.b', '172.21.15.107')] 2024-05-07T13:59:51.594 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790],172.21.15.107'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-05-07T13:59:51.594 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T13:59:51.594 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-07T13:59:51.643 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.106 --addv c '[v2:172.21.15.106:3301,v1:172.21.15.106:6790]' --add b 172.21.15.107 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:59:51.728 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:59:51.728 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: generated fsid 0d349e2f-0c2b-4aab-8a22-181c69b40dbb 2024-05-07T13:59:51.728 INFO:teuthology.orchestra.run.smithi106.stdout:setting min_mon_release = quincy 2024-05-07T13:59:51.728 INFO:teuthology.orchestra.run.smithi106.stdout:epoch 0 2024-05-07T13:59:51.729 INFO:teuthology.orchestra.run.smithi106.stdout:fsid 0d349e2f-0c2b-4aab-8a22-181c69b40dbb 2024-05-07T13:59:51.729 INFO:teuthology.orchestra.run.smithi106.stdout:last_changed 2024-05-07T13:59:51.745684+0000 2024-05-07T13:59:51.729 INFO:teuthology.orchestra.run.smithi106.stdout:created 2024-05-07T13:59:51.745684+0000 2024-05-07T13:59:51.729 INFO:teuthology.orchestra.run.smithi106.stdout:min_mon_release 17 (quincy) 2024-05-07T13:59:51.729 INFO:teuthology.orchestra.run.smithi106.stdout:election_strategy: 1 2024-05-07T13:59:51.729 INFO:teuthology.orchestra.run.smithi106.stdout:0: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.a 2024-05-07T13:59:51.729 INFO:teuthology.orchestra.run.smithi106.stdout:1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.b 2024-05-07T13:59:51.729 INFO:teuthology.orchestra.run.smithi106.stdout:2: [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] mon.c 2024-05-07T13:59:51.729 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-07T13:59:51.730 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-07T13:59:51.779 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0d349e2f-0c2b-4aab-8a22-181c69b40dbb... 2024-05-07T13:59:51.780 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-07T13:59:51.823 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-07T13:59:51.852 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2024-05-07T13:59:51.852 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2024-05-07T13:59:51.852 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-07T13:59:51.852 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2024-05-07T13:59:51.852 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.852 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2024-05-07T13:59:51.852 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.853 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2024-05-07T13:59:51.854 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.854 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2024-05-07T13:59:51.854 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2024-05-07T13:59:51.854 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2024-05-07T13:59:51.854 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2024-05-07T13:59:51.854 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2024-05-07T13:59:51.854 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2024-05-07T13:59:51.854 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2024-05-07T13:59:51.854 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-07T13:59:51.854 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-07T13:59:51.854 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2024-05-07T13:59:51.854 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.854 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790],172.21.15.107" 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 0d349e2f-0c2b-4aab-8a22-181c69b40dbb 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2024-05-07T13:59:51.855 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.856 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2024-05-07T13:59:51.856 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2024-05-07T13:59:51.856 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2024-05-07T13:59:51.856 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.856 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2024-05-07T13:59:51.856 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2024-05-07T13:59:51.856 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.856 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2024-05-07T13:59:51.856 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2024-05-07T13:59:51.856 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2024-05-07T13:59:51.856 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug trim objects = true 2024-05-07T13:59:51.856 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.856 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2024-05-07T13:59:51.857 INFO:teuthology.orchestra.run.smithi106.stdout: bdev async discard = True 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: bdev enable discard = True 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = bitmap 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 1/20 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 1/20 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 4/10 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: osd blocked scrub grace period = 3600 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2024-05-07T13:59:51.858 INFO:teuthology.orchestra.run.smithi106.stdout: osd max markdown count = 1000 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout: osd shutdown pgref assert = True 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2024-05-07T13:59:51.859 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.860 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout: rgw relaxed s3 bucket names = True 2024-05-07T13:59:51.861 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2024-05-07T13:59:51.862 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2024-05-07T13:59:51.862 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2024-05-07T13:59:51.862 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-05-07T13:59:51.862 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-05-07T13:59:51.862 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-07T13:59:51.862 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-05-07T13:59:51.863 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.863 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-05-07T13:59:51.863 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.863 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-05-07T13:59:51.863 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.863 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-05-07T13:59:51.863 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-05-07T13:59:51.863 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.863 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-05-07T13:59:51.863 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-05-07T13:59:51.863 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.863 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-05-07T13:59:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-05-07T13:59:51.865 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790],172.21.15.107" 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 0d349e2f-0c2b-4aab-8a22-181c69b40dbb 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-05-07T13:59:51.866 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug trim objects = true 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-05-07T13:59:51.867 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.868 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-05-07T13:59:51.868 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-05-07T13:59:51.868 INFO:teuthology.orchestra.run.smithi107.stdout: bdev async discard = True 2024-05-07T13:59:51.868 INFO:teuthology.orchestra.run.smithi107.stdout: bdev enable discard = True 2024-05-07T13:59:51.868 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore allocator = bitmap 2024-05-07T13:59:51.868 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-05-07T13:59:51.868 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-05-07T13:59:51.868 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-05-07T13:59:51.868 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-05-07T13:59:51.868 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-07T13:59:51.868 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-05-07T13:59:51.868 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-05-07T13:59:51.868 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout: osd blocked scrub grace period = 3600 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout: osd max markdown count = 1000 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout: osd shutdown pgref assert = True 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-05-07T13:59:51.869 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-05-07T13:59:51.870 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-05-07T13:59:51.871 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-05-07T13:59:51.872 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-05-07T13:59:51.872 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-05-07T13:59:51.872 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-07T13:59:51.872 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-07T13:59:51.872 INFO:teuthology.orchestra.run.smithi107.stdout: rgw relaxed s3 bucket names = True 2024-05-07T13:59:51.872 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-05-07T13:59:51.872 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-05-07T13:59:51.872 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-05-07T13:59:51.873 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-07T13:59:51.874 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-07T13:59:51.964 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-07T13:59:51.965 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T13:59:51.965 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-07T13:59:51.970 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T13:59:51.970 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-07T13:59:52.018 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2024-05-07T13:59:52.018 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T13:59:52.018 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-07T13:59:52.018 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-07T13:59:52.080 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T13:59:52.080 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:59:52.126 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-05-07T13:59:52.126 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T13:59:52.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-07T13:59:52.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-07T13:59:52.149 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T13:59:52.149 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:59:52.198 INFO:tasks.ceph:Setting up mon nodes... 2024-05-07T13:59:52.198 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-07T13:59:52.199 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-07T13:59:52.241 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-07T13:59:52.244 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-07T13:59:52.287 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-07T13:59:52.301 INFO:tasks.ceph:Setting up mds nodes... 2024-05-07T13:59:52.301 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-07T13:59:52.301 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-07T13:59:52.334 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-07T13:59:52.345 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-07T13:59:52.380 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-07T13:59:52.389 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-07T13:59:52.390 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-07T13:59:52.390 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-07T13:59:52.402 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-07T13:59:52.402 INFO:tasks.ceph:role: osd.0 2024-05-07T13:59:52.402 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-07T13:59:52.402 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-07T13:59:52.468 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T13:59:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T13:59:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T13:59:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-07T13:59:52.468 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T13:59:52.469 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-05-07T13:59:52.469 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T13:59:52.469 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-07T13:59:52.469 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T13:59:52.469 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T13:59:52.925 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-05-07T13:59:52.927 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-05-07T13:59:52.927 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-07T13:59:53.011 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-07T13:59:53.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T13:59:53.063 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-05-07T13:59:53.063 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-07T13:59:53.115 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-07T13:59:53.115 INFO:tasks.ceph:role: osd.1 2024-05-07T13:59:53.116 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-07T13:59:53.116 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-07T13:59:53.177 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T13:59:53.178 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T13:59:53.178 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T13:59:53.178 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-07T13:59:53.178 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T13:59:53.178 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-05-07T13:59:53.178 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T13:59:53.178 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-07T13:59:53.178 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T13:59:53.178 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T13:59:53.641 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-05-07T13:59:53.642 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-05-07T13:59:53.643 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-07T13:59:53.781 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-07T13:59:53.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T13:59:53.794 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-05-07T13:59:53.794 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-07T13:59:53.850 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-07T13:59:53.850 INFO:tasks.ceph:role: osd.2 2024-05-07T13:59:53.850 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-07T13:59:53.850 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-07T13:59:53.914 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T13:59:53.914 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T13:59:53.914 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T13:59:53.914 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-07T13:59:53.914 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T13:59:53.914 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-05-07T13:59:53.914 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T13:59:53.914 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-07T13:59:53.915 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T13:59:53.915 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T13:59:54.403 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-05-07T13:59:54.405 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-05-07T13:59:54.405 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-07T13:59:54.550 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-07T13:59:54.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T13:59:54.562 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-05-07T13:59:54.563 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-07T13:59:54.622 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-07T13:59:54.622 INFO:tasks.ceph:role: osd.3 2024-05-07T13:59:54.622 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-07T13:59:54.622 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-07T13:59:54.685 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T13:59:54.685 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T13:59:54.685 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T13:59:54.685 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-07T13:59:54.685 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T13:59:54.685 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-05-07T13:59:54.685 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T13:59:54.685 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-07T13:59:54.685 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T13:59:54.685 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T13:59:55.119 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-05-07T13:59:55.121 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-05-07T13:59:55.121 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-07T13:59:55.217 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-07T13:59:55.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T13:59:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-05-07T13:59:55.227 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:59:55.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T13:59:55.352+0000 7fe685c3a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-07T13:59:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T13:59:55.352+0000 7fe685c3a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-07T13:59:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T13:59:55.352+0000 7fe685c3a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-07T13:59:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T13:59:55.352+0000 7fe685c3a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-07T13:59:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T13:59:55.352+0000 7fe685c3a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-07T13:59:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T13:59:55.356+0000 7fe685c3a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-07T13:59:58.319 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-07T13:59:58.333 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T13:59:58.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T13:59:58.428+0000 7f1a841887c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-07T13:59:58.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T13:59:58.428+0000 7f1a841887c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-07T13:59:58.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T13:59:58.428+0000 7f1a841887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-07T13:59:58.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T13:59:58.428+0000 7f1a841887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-07T13:59:58.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T13:59:58.428+0000 7f1a841887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-07T13:59:58.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T13:59:58.432+0000 7f1a841887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-07T14:00:01.394 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-07T14:00:01.455 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T14:00:01.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T14:00:01.548+0000 7f869264f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-07T14:00:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T14:00:01.548+0000 7f869264f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-07T14:00:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T14:00:01.548+0000 7f869264f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-07T14:00:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T14:00:01.548+0000 7f869264f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-07T14:00:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T14:00:01.548+0000 7f869264f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-07T14:00:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T14:00:01.548+0000 7f869264f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-07T14:00:04.521 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-07T14:00:04.579 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T14:00:04.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T14:00:04.672+0000 7f10ebeba7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-07T14:00:04.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T14:00:04.672+0000 7f10ebeba7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-07T14:00:04.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T14:00:04.672+0000 7f10ebeba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-07T14:00:04.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T14:00:04.672+0000 7f10ebeba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-07T14:00:04.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T14:00:04.672+0000 7f10ebeba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-07T14:00:04.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-05-07T14:00:04.672+0000 7f10ebeba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-07T14:00:07.661 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-07T14:00:07.718 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-07T14:00:07.733 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-07T14:00:07.733 INFO:tasks.ceph:role: osd.4 2024-05-07T14:00:07.733 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-07T14:00:07.733 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-07T14:00:07.797 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T14:00:07.797 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T14:00:07.797 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T14:00:07.797 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-07T14:00:07.797 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T14:00:07.798 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-07T14:00:07.798 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T14:00:07.798 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-07T14:00:07.798 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T14:00:07.798 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T14:00:08.262 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-07T14:00:08.264 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-07T14:00:08.264 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-07T14:00:08.362 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-07T14:00:08.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T14:00:08.372 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-05-07T14:00:08.372 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-07T14:00:08.423 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-07T14:00:08.423 INFO:tasks.ceph:role: osd.5 2024-05-07T14:00:08.423 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-07T14:00:08.423 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-07T14:00:08.489 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T14:00:08.490 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T14:00:08.490 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T14:00:08.490 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-07T14:00:08.490 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T14:00:08.490 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-07T14:00:08.490 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T14:00:08.490 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-07T14:00:08.490 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T14:00:08.490 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T14:00:08.958 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-07T14:00:08.960 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-07T14:00:08.960 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-07T14:00:09.112 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-07T14:00:09.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T14:00:09.124 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-05-07T14:00:09.124 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-07T14:00:09.177 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-07T14:00:09.177 INFO:tasks.ceph:role: osd.6 2024-05-07T14:00:09.177 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-07T14:00:09.178 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-07T14:00:09.241 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T14:00:09.242 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T14:00:09.242 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T14:00:09.242 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-07T14:00:09.242 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T14:00:09.242 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-07T14:00:09.242 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T14:00:09.242 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-07T14:00:09.242 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T14:00:09.242 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T14:00:09.724 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-07T14:00:09.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-07T14:00:09.727 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-07T14:00:09.871 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-07T14:00:09.882 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-05-07T14:00:09.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T14:00:09.883 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-07T14:00:09.936 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-07T14:00:09.936 INFO:tasks.ceph:role: osd.7 2024-05-07T14:00:09.937 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-07T14:00:09.937 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-07T14:00:10.000 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-07T14:00:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-07T14:00:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-07T14:00:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-07T14:00:10.000 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-07T14:00:10.000 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-07T14:00:10.001 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-07T14:00:10.001 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-07T14:00:10.001 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-07T14:00:10.001 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-07T14:00:10.437 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-07T14:00:10.440 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-07T14:00:10.440 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-07T14:00:10.540 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-07T14:00:10.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T14:00:10.550 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-05-07T14:00:10.551 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T14:00:10.663 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:10.674+0000 7f0b29fbc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-07T14:00:10.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:10.678+0000 7f0b29fbc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-07T14:00:10.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:10.678+0000 7f0b29fbc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-07T14:00:10.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:10.678+0000 7f0b29fbc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-07T14:00:10.665 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:10.678+0000 7f0b29fbc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-07T14:00:10.666 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:10.678+0000 7f0b29fbc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-07T14:00:13.663 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-07T14:00:13.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T14:00:13.760 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:13.774+0000 7f16e54247c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-07T14:00:13.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:13.774+0000 7f16e54247c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-07T14:00:13.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:13.774+0000 7f16e54247c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-07T14:00:13.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:13.774+0000 7f16e54247c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-07T14:00:13.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:13.774+0000 7f16e54247c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-07T14:00:13.761 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:13.778+0000 7f16e54247c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-07T14:00:16.750 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-07T14:00:16.805 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T14:00:16.887 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:16.902+0000 7fd1aa5107c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-07T14:00:16.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:16.902+0000 7fd1aa5107c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-07T14:00:16.888 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:16.902+0000 7fd1aa5107c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-07T14:00:16.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:16.902+0000 7fd1aa5107c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-07T14:00:16.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:16.902+0000 7fd1aa5107c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-07T14:00:16.889 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:16.906+0000 7fd1aa5107c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-07T14:00:19.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-07T14:00:19.930 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-07T14:00:20.011 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:20.026+0000 7fdbbac407c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-07T14:00:20.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:20.026+0000 7fdbbac407c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-07T14:00:20.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:20.026+0000 7fdbbac407c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-07T14:00:20.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:20.026+0000 7fdbbac407c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-07T14:00:20.012 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:20.026+0000 7fdbbac407c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-07T14:00:20.013 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-07T14:00:20.026+0000 7fdbbac407c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-07T14:00:22.993 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-07T14:00:23.050 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-07T14:00:23.050 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T14:00:23.051 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-07T14:00:23.065 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T14:00:23.065 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-07T14:00:23.121 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T14:00:23.122 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-07T14:00:23.177 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T14:00:23.177 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-07T14:00:23.233 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T14:00:23.233 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-07T14:00:23.288 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T14:00:23.288 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-07T14:00:23.302 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T14:00:23.302 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-07T14:00:23.357 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T14:00:23.357 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-07T14:00:23.413 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T14:00:23.413 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-07T14:00:23.469 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T14:00:23.469 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-07T14:00:23.525 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T14:00:23.525 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-07T14:00:23.531 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T14:00:23.531 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-07T14:00:23.574 INFO:tasks.ceph:Adding keys to all mons... 2024-05-07T14:00:23.574 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-07T14:00:23.576 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-07T14:00:23.624 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.y] 2024-05-07T14:00:23.624 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDYMzpm8HtsDxAAFstQCA6CZ1JAa2nzevER8g== 2024-05-07T14:00:23.624 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDbMzpmDbhMFRAAxo7oApapopLuw5FhXCnBOA== 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDeMzpmaO7kGRAAb79ksSaj0A0igeZC4FLvAA== 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDhMzpmOz/tIBAAD7buIqfuyZfXPO0/WKDcMQ== 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDkMzpmPG9aKBAAqJR07reBmjWruiZ5TtPZzg== 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDYMzpmw5glEhAAO0tS1GbD45MrWd+p8cVI6Q== 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDqMzpmueyZKBAAh+nISLGy9Z9O3C557+68eg== 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDtMzpmEK9XLhAASdp++HZXKTPGUwxsy/JWPg== 2024-05-07T14:00:23.625 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.6] 2024-05-07T14:00:23.626 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDwMzpmusP3NRAAaxwshOThl+q80tDVbR9H8g== 2024-05-07T14:00:23.626 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.7] 2024-05-07T14:00:23.626 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD0MzpmD7LAARAAGUSEkck4B1vZijdqjQjGug== 2024-05-07T14:00:23.626 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2024-05-07T14:00:23.626 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDYMzpmnEr5FBAAETiRZOMtVfbRGzOTpqq+mw== 2024-05-07T14:00:23.626 INFO:teuthology.orchestra.run.smithi106.stdout:[client.1] 2024-05-07T14:00:23.626 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDYMzpmDg2yFxAAbPQZcXZA6D/62XQufEmeQg== 2024-05-07T14:00:23.628 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.y] 2024-05-07T14:00:23.628 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDYMzpm8HtsDxAAFstQCA6CZ1JAa2nzevER8g== 2024-05-07T14:00:23.628 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2024-05-07T14:00:23.628 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDbMzpmDbhMFRAAxo7oApapopLuw5FhXCnBOA== 2024-05-07T14:00:23.628 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2024-05-07T14:00:23.628 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDeMzpmaO7kGRAAb79ksSaj0A0igeZC4FLvAA== 2024-05-07T14:00:23.628 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2024-05-07T14:00:23.628 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDhMzpmOz/tIBAAD7buIqfuyZfXPO0/WKDcMQ== 2024-05-07T14:00:23.628 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2024-05-07T14:00:23.628 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDkMzpmPG9aKBAAqJR07reBmjWruiZ5TtPZzg== 2024-05-07T14:00:23.628 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2024-05-07T14:00:23.628 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDYMzpmw5glEhAAO0tS1GbD45MrWd+p8cVI6Q== 2024-05-07T14:00:23.629 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.4] 2024-05-07T14:00:23.629 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDqMzpmueyZKBAAh+nISLGy9Z9O3C557+68eg== 2024-05-07T14:00:23.629 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.5] 2024-05-07T14:00:23.629 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDtMzpmEK9XLhAASdp++HZXKTPGUwxsy/JWPg== 2024-05-07T14:00:23.629 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.6] 2024-05-07T14:00:23.629 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDwMzpmusP3NRAAaxwshOThl+q80tDVbR9H8g== 2024-05-07T14:00:23.629 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.7] 2024-05-07T14:00:23.629 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQD0MzpmD7LAARAAGUSEkck4B1vZijdqjQjGug== 2024-05-07T14:00:23.629 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-05-07T14:00:23.629 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDYMzpmnEr5FBAAETiRZOMtVfbRGzOTpqq+mw== 2024-05-07T14:00:23.629 INFO:teuthology.orchestra.run.smithi107.stdout:[client.1] 2024-05-07T14:00:23.629 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQDYMzpmDg2yFxAAbPQZcXZA6D/62XQufEmeQg== 2024-05-07T14:00:23.630 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-07T14:00:23.671 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-07T14:00:23.717 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:23.719 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:23.797 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:23.799 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:23.880 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:23.882 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:23.957 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:23.959 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:24.034 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-07T14:00:24.036 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-07T14:00:24.087 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:24.118 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:24.168 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:24.203 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:24.247 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:24.287 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:24.327 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:24.367 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-07T14:00:24.408 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-07T14:00:24.446 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-07T14:00:24.491 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-07T14:00:24.530 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-07T14:00:24.574 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-07T14:00:24.574 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-07T14:00:24.624 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-07T14:00:24.710 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-07T14:00:24.763 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-07T14:00:24.815 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-07T14:00:24.900 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-07T14:00:24.952 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-07T14:00:24.966 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-07T14:00:25.063 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-07T14:00:25.074 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-07T14:00:25.076 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-07T14:00:25.121 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-07T14:00:25.121 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-07T14:00:25.121 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-07T14:00:25.124 INFO:tasks.ceph.mon.a:Started 2024-05-07T14:00:25.124 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-07T14:00:25.124 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-07T14:00:25.126 INFO:tasks.ceph.mon.c:Started 2024-05-07T14:00:25.126 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-07T14:00:25.127 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-07T14:00:25.166 INFO:tasks.ceph.mon.b:Started 2024-05-07T14:00:25.166 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-07T14:00:25.167 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-07T14:00:25.167 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-07T14:00:25.169 INFO:tasks.ceph.mgr.y:Started 2024-05-07T14:00:25.169 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-07T14:00:25.170 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-07T14:00:25.171 INFO:tasks.ceph.mgr.x:Started 2024-05-07T14:00:25.172 INFO:tasks.ceph:Setting crush tunables to default 2024-05-07T14:00:25.172 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd crush tunables default 2024-05-07T14:00:30.685 INFO:teuthology.orchestra.run.smithi106.stderr:adjusted tunables profile to default 2024-05-07T14:00:30.704 INFO:tasks.ceph:check_enable_crimson: False 2024-05-07T14:00:30.704 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-07T14:00:30.705 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T14:00:30.705 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-07T14:00:30.715 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T14:00:30.715 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-07T14:00:30.767 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T14:00:30.767 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-07T14:00:30.799 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:30.811+0000 7fb5e5aa7180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-07T14:00:30.808 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T14:00:30.809 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-07T14:00:30.863 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T14:00:30.863 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-07T14:00:30.878 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T14:00:30.878 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-07T14:00:30.934 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T14:00:30.934 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-07T14:00:30.989 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-07T14:00:30.990 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-07T14:00:31.049 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new e76f5d56-1400-488e-b58f-7af657fa63ab 0 2024-05-07T14:00:31.072 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:31.086+0000 7f56661af180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-07T14:00:31.251 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:31.263+0000 7fb5e5aa7180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-07T14:00:31.289 INFO:teuthology.orchestra.run.smithi107.stdout:0 2024-05-07T14:00:31.306 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new aad5864b-9a5f-426f-a8fd-15d02590106e 1 2024-05-07T14:00:31.441 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:31.455+0000 7fb5e5aa7180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-07T14:00:31.512 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-05-07T14:00:31.531 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new eea131cd-e4ca-4360-a8a0-5005a2d827d1 2 2024-05-07T14:00:31.583 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:31.598+0000 7f56661af180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-07T14:00:31.729 INFO:teuthology.orchestra.run.smithi107.stdout:2 2024-05-07T14:00:31.746 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new bdcb438c-1d40-45a2-8e8a-f29ba9c98909 3 2024-05-07T14:00:31.796 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:31.810+0000 7f56661af180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-07T14:00:31.930 INFO:teuthology.orchestra.run.smithi107.stdout:3 2024-05-07T14:00:31.945 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 703f4a52-4283-4395-bc29-4de194d4a4ef 4 2024-05-07T14:00:31.985 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:31.995+0000 7fb5e5aa7180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-07T14:00:32.038 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:32.051+0000 7fb5e5aa7180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-07T14:00:32.091 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:32.103+0000 7fb5e5aa7180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-07T14:00:32.167 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:32.179+0000 7fb5e5aa7180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-07T14:00:32.186 INFO:teuthology.orchestra.run.smithi107.stdout:4 2024-05-07T14:00:32.203 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 8b70f365-8b0d-429e-b3f8-601a37cfb6ac 5 2024-05-07T14:00:32.219 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:32.231+0000 7fb5e5aa7180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-07T14:00:32.296 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:32.307+0000 7fb5e5aa7180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-07T14:00:32.348 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:32.359+0000 7fb5e5aa7180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-07T14:00:32.394 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:32.410+0000 7f56661af180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-07T14:00:32.402 INFO:teuthology.orchestra.run.smithi107.stdout:5 2024-05-07T14:00:32.418 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new b65085d6-47af-4dfc-91a8-cdc7a6fa937c 6 2024-05-07T14:00:32.451 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:32.466+0000 7f56661af180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-07T14:00:32.498 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:32.511+0000 7fb5e5aa7180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-07T14:00:32.509 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:32.522+0000 7f56661af180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-07T14:00:32.561 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:32.571+0000 7fb5e5aa7180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-07T14:00:32.591 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:32.606+0000 7f56661af180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-07T14:00:32.624 INFO:teuthology.orchestra.run.smithi107.stdout:6 2024-05-07T14:00:32.640 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 9a808e41-afba-400f-886a-8f17689bebda 7 2024-05-07T14:00:32.646 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:32.662+0000 7f56661af180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-07T14:00:32.725 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:32.738+0000 7f56661af180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-07T14:00:32.781 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:32.794+0000 7f56661af180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-07T14:00:32.844 INFO:teuthology.orchestra.run.smithi107.stdout:7 2024-05-07T14:00:32.860 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-07T14:00:32.860 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-07T14:00:32.864 INFO:tasks.ceph.osd.0:Started 2024-05-07T14:00:32.864 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-07T14:00:32.864 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-07T14:00:32.867 INFO:tasks.ceph.osd.1:Started 2024-05-07T14:00:32.867 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-07T14:00:32.867 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-07T14:00:32.870 INFO:tasks.ceph.osd.2:Started 2024-05-07T14:00:32.870 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-07T14:00:32.870 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-07T14:00:32.873 INFO:tasks.ceph.osd.3:Started 2024-05-07T14:00:32.873 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-07T14:00:32.873 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-07T14:00:32.875 INFO:tasks.ceph.osd.4:Started 2024-05-07T14:00:32.875 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-07T14:00:32.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-07T14:00:32.877 INFO:tasks.ceph.osd.5:Started 2024-05-07T14:00:32.878 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-07T14:00:32.878 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-07T14:00:32.880 INFO:tasks.ceph.osd.6:Started 2024-05-07T14:00:32.880 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-07T14:00:32.880 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-07T14:00:32.882 INFO:tasks.ceph.osd.7:Started 2024-05-07T14:00:32.883 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T14:00:32.962 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:32.978+0000 7f56661af180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-07T14:00:33.024 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:33.038+0000 7f56661af180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-07T14:00:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:00:33.125 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":10,"fsid":"0d349e2f-0c2b-4aab-8a22-181c69b40dbb","created":"2024-05-07T14:00:30.482506+0000","modified":"2024-05-07T14:00:32.857383+0000","last_up_change":"0.000000","last_in_change":"2024-05-07T14:00:32.857383+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e76f5d56-1400-488e-b58f-7af657fa63ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aad5864b-9a5f-426f-a8fd-15d02590106e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eea131cd-e4ca-4360-a8a0-5005a2d827d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bdcb438c-1d40-45a2-8e8a-f29ba9c98909","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"703f4a52-4283-4395-bc29-4de194d4a4ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8b70f365-8b0d-429e-b3f8-601a37cfb6ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b65085d6-47af-4dfc-91a8-cdc7a6fa937c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9a808e41-afba-400f-886a-8f17689bebda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T14:00:33.142 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-07T14:00:33.142 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-07T14:00:33.243 INFO:tasks.ceph.mgr.y.smithi106.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-07T14:00:33.243 INFO:tasks.ceph.mgr.y.smithi106.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-07T14:00:33.243 INFO:tasks.ceph.mgr.y.smithi106.stderr: from numpy import show_config as show_numpy_config 2024-05-07T14:00:33.299 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:33.311+0000 7fb5e5aa7180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-07T14:00:33.445 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:33.455+0000 7fb5e5aa7180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-07T14:00:33.506 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:00:33.522+0000 7f66dc8917c0 -1 Falling back to public interface 2024-05-07T14:00:33.509 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:00:33.526+0000 7f37586687c0 -1 Falling back to public interface 2024-05-07T14:00:33.522 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:00:33.538+0000 7f8e940777c0 -1 Falling back to public interface 2024-05-07T14:00:33.525 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:00:33.542+0000 7f3fa632a7c0 -1 Falling back to public interface 2024-05-07T14:00:33.550 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:00:33.563+0000 7f3151c7c7c0 -1 Falling back to public interface 2024-05-07T14:00:33.550 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:00:33.563+0000 7f739b3c07c0 -1 Falling back to public interface 2024-05-07T14:00:33.558 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:00:33.571+0000 7f447843e7c0 -1 Falling back to public interface 2024-05-07T14:00:33.565 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:00:33.579+0000 7f347fec47c0 -1 Falling back to public interface 2024-05-07T14:00:33.608 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:33.619+0000 7fb5e5aa7180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-07T14:00:33.671 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:33.683+0000 7fb5e5aa7180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-07T14:00:33.686 INFO:tasks.ceph.mgr.x.smithi107.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-07T14:00:33.686 INFO:tasks.ceph.mgr.x.smithi107.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-07T14:00:33.686 INFO:tasks.ceph.mgr.x.smithi107.stderr: from numpy import show_config as show_numpy_config 2024-05-07T14:00:33.782 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:33.798+0000 7f56661af180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-07T14:00:33.802 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:33.815+0000 7fb5e5aa7180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-07T14:00:33.948 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-07T14:00:33.967 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:33.982+0000 7f56661af180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-07T14:00:34.130 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:34.146+0000 7f56661af180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-07T14:00:34.178 INFO:teuthology.misc.health.smithi106.stdout: 2024-05-07T14:00:34.178 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":10,"fsid":"0d349e2f-0c2b-4aab-8a22-181c69b40dbb","created":"2024-05-07T14:00:30.482506+0000","modified":"2024-05-07T14:00:32.857383+0000","last_up_change":"0.000000","last_in_change":"2024-05-07T14:00:32.857383+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e76f5d56-1400-488e-b58f-7af657fa63ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aad5864b-9a5f-426f-a8fd-15d02590106e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eea131cd-e4ca-4360-a8a0-5005a2d827d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bdcb438c-1d40-45a2-8e8a-f29ba9c98909","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"703f4a52-4283-4395-bc29-4de194d4a4ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8b70f365-8b0d-429e-b3f8-601a37cfb6ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b65085d6-47af-4dfc-91a8-cdc7a6fa937c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9a808e41-afba-400f-886a-8f17689bebda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T14:00:34.192 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-07T14:00:34.200 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:34.214+0000 7f56661af180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-07T14:00:34.347 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:34.362+0000 7f56661af180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-07T14:00:34.490 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:34.503+0000 7fb5e5aa7180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-07T14:00:34.565 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:34.579+0000 7fb5e5aa7180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-07T14:00:34.744 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:34.755+0000 7fb5e5aa7180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-07T14:00:34.817 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:34.831+0000 7fb5e5aa7180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-07T14:00:34.982 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:34.998+0000 7f56661af180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-07T14:00:35.057 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:35.074+0000 7f56661af180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-07T14:00:35.101 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:35.115+0000 7fb5e5aa7180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-07T14:00:35.162 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:35.175+0000 7fb5e5aa7180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-07T14:00:35.240 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:35.254+0000 7f56661af180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-07T14:00:35.314 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:35.330+0000 7f56661af180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-07T14:00:35.602 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:35.618+0000 7f56661af180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-07T14:00:35.663 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-07T14:00:35.678+0000 7f56661af180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-07T14:00:36.208 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:36.219+0000 7fb58cdf1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-07T14:00:36.208 INFO:tasks.ceph.mgr.y.smithi106.stderr:2024-05-07T14:00:36.219+0000 7fb58cdf1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-07T14:00:37.243 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:00:37.258+0000 7f66dc8917c0 -1 osd.5 0 log_to_monitors true 2024-05-07T14:00:37.367 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:00:37.379+0000 7f3151c7c7c0 -1 osd.0 0 log_to_monitors true 2024-05-07T14:00:37.369 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:00:37.386+0000 7f3fa632a7c0 -1 osd.6 0 log_to_monitors true 2024-05-07T14:00:37.394 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:00:37.407+0000 7f347fec47c0 -1 osd.2 0 log_to_monitors true 2024-05-07T14:00:37.419 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:00:37.434+0000 7f37586687c0 -1 osd.7 0 log_to_monitors true 2024-05-07T14:00:37.487 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:00:37.502+0000 7f8e940777c0 -1 osd.4 0 log_to_monitors true 2024-05-07T14:00:37.516 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:00:37.527+0000 7f447843e7c0 -1 osd.1 0 log_to_monitors true 2024-05-07T14:00:37.532 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:00:37.543+0000 7f739b3c07c0 -1 osd.3 0 log_to_monitors true 2024-05-07T14:00:40.637 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:00:40.654+0000 7f8e91033640 -1 osd.4 0 waiting for initial osdmap 2024-05-07T14:00:40.667 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:00:40.682+0000 7f8e87e44640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T14:00:40.693 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:00:40.710+0000 7f66d8017640 -1 osd.5 0 waiting for initial osdmap 2024-05-07T14:00:40.722 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:00:40.738+0000 7f66d065e640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T14:00:40.724 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:00:40.735+0000 7f7396b46640 -1 osd.3 0 waiting for initial osdmap 2024-05-07T14:00:40.732 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:00:40.743+0000 7f314d402640 -1 osd.0 0 waiting for initial osdmap 2024-05-07T14:00:40.738 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:00:40.754+0000 7f3fa1ab0640 -1 osd.6 0 waiting for initial osdmap 2024-05-07T14:00:40.745 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:00:40.755+0000 7f4473bc4640 -1 osd.1 0 waiting for initial osdmap 2024-05-07T14:00:40.745 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:00:40.759+0000 7f738f18d640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T14:00:40.749 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:00:40.763+0000 7f347b64a640 -1 osd.2 0 waiting for initial osdmap 2024-05-07T14:00:40.760 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:00:40.771+0000 7f3145a49640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T14:00:40.766 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:00:40.782+0000 7f3f9a0f7640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T14:00:40.782 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:00:40.798+0000 7f3755624640 -1 osd.7 0 waiting for initial osdmap 2024-05-07T14:00:40.785 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:00:40.799+0000 7f3473c91640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T14:00:40.789 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:00:40.803+0000 7f446c20b640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T14:00:40.806 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:00:40.822+0000 7f374c435640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T14:00:40.999 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-07T14:00:41.298 INFO:teuthology.misc.health.smithi106.stdout: 2024-05-07T14:00:41.298 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":12,"fsid":"0d349e2f-0c2b-4aab-8a22-181c69b40dbb","created":"2024-05-07T14:00:30.482506+0000","modified":"2024-05-07T14:00:38.576760+0000","last_up_change":"0.000000","last_in_change":"2024-05-07T14:00:32.857383+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e76f5d56-1400-488e-b58f-7af657fa63ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aad5864b-9a5f-426f-a8fd-15d02590106e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eea131cd-e4ca-4360-a8a0-5005a2d827d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"bdcb438c-1d40-45a2-8e8a-f29ba9c98909","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"703f4a52-4283-4395-bc29-4de194d4a4ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8b70f365-8b0d-429e-b3f8-601a37cfb6ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b65085d6-47af-4dfc-91a8-cdc7a6fa937c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9a808e41-afba-400f-886a-8f17689bebda","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T14:00:41.315 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-07T14:00:48.121 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-07T14:00:48.421 INFO:teuthology.misc.health.smithi106.stdout: 2024-05-07T14:00:48.421 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":17,"fsid":"0d349e2f-0c2b-4aab-8a22-181c69b40dbb","created":"2024-05-07T14:00:30.482506+0000","modified":"2024-05-07T14:00:45.826270+0000","last_up_change":"2024-05-07T14:00:41.658097+0000","last_in_change":"2024-05-07T14:00:32.857383+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T14:00:43.291253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e76f5d56-1400-488e-b58f-7af657fa63ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6801","nonce":3743893730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6803","nonce":3743893730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6809","nonce":3743893730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6805","nonce":3743893730}]},"public_addr":"172.21.15.106:6801/3743893730","cluster_addr":"172.21.15.106:6803/3743893730","heartbeat_back_addr":"172.21.15.106:6809/3743893730","heartbeat_front_addr":"172.21.15.106:6805/3743893730","state":["exists","up"]},{"osd":1,"uuid":"aad5864b-9a5f-426f-a8fd-15d02590106e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6817","nonce":3901521345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6819","nonce":3901521345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6823","nonce":3901521345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6821","nonce":3901521345}]},"public_addr":"172.21.15.106:6817/3901521345","cluster_addr":"172.21.15.106:6819/3901521345","heartbeat_back_addr":"172.21.15.106:6823/3901521345","heartbeat_front_addr":"172.21.15.106:6821/3901521345","state":["exists","up"]},{"osd":2,"uuid":"eea131cd-e4ca-4360-a8a0-5005a2d827d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6825","nonce":1784825450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6827","nonce":1784825450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6831","nonce":1784825450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6829","nonce":1784825450}]},"public_addr":"172.21.15.106:6825/1784825450","cluster_addr":"172.21.15.106:6827/1784825450","heartbeat_back_addr":"172.21.15.106:6831/1784825450","heartbeat_front_addr":"172.21.15.106:6829/1784825450","state":["exists","up"]},{"osd":3,"uuid":"bdcb438c-1d40-45a2-8e8a-f29ba9c98909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6808","nonce":123863977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6811","nonce":123863977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6815","nonce":123863977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6813","nonce":123863977}]},"public_addr":"172.21.15.106:6808/123863977","cluster_addr":"172.21.15.106:6811/123863977","heartbeat_back_addr":"172.21.15.106:6815/123863977","heartbeat_front_addr":"172.21.15.106:6813/123863977","state":["exists","up"]},{"osd":4,"uuid":"703f4a52-4283-4395-bc29-4de194d4a4ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6817","nonce":3575310712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6819","nonce":3575310712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6824","nonce":3575310712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6821","nonce":3575310712}]},"public_addr":"172.21.15.107:6817/3575310712","cluster_addr":"172.21.15.107:6819/3575310712","heartbeat_back_addr":"172.21.15.107:6824/3575310712","heartbeat_front_addr":"172.21.15.107:6821/3575310712","state":["exists","up"]},{"osd":5,"uuid":"8b70f365-8b0d-429e-b3f8-601a37cfb6ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6801","nonce":2178038050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6803","nonce":2178038050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6807","nonce":2178038050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6805","nonce":2178038050}]},"public_addr":"172.21.15.107:6801/2178038050","cluster_addr":"172.21.15.107:6803/2178038050","heartbeat_back_addr":"172.21.15.107:6807/2178038050","heartbeat_front_addr":"172.21.15.107:6805/2178038050","state":["exists","up"]},{"osd":6,"uuid":"b65085d6-47af-4dfc-91a8-cdc7a6fa937c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6825","nonce":3168866293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6827","nonce":3168866293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6831","nonce":3168866293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6829","nonce":3168866293}]},"public_addr":"172.21.15.107:6825/3168866293","cluster_addr":"172.21.15.107:6827/3168866293","heartbeat_back_addr":"172.21.15.107:6831/3168866293","heartbeat_front_addr":"172.21.15.107:6829/3168866293","state":["exists","up"]},{"osd":7,"uuid":"9a808e41-afba-400f-886a-8f17689bebda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":1073700008},{"type":"v1","addr":"172.21.15.107:6809","nonce":1073700008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1073700008},{"type":"v1","addr":"172.21.15.107:6811","nonce":1073700008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1073700008},{"type":"v1","addr":"172.21.15.107:6815","nonce":1073700008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1073700008},{"type":"v1","addr":"172.21.15.107:6813","nonce":1073700008}]},"public_addr":"172.21.15.107:6809/1073700008","cluster_addr":"172.21.15.107:6811/1073700008","heartbeat_back_addr":"172.21.15.107:6815/1073700008","heartbeat_front_addr":"172.21.15.107:6813/1073700008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.435492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.545586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.430790+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.530476+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.487321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.254353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.381089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.430233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T14:00:48.438 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-07T14:00:48.439 INFO:tasks.ceph:Creating RBD pool 2024-05-07T14:00:48.439 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-07T14:00:48.891 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'rbd' created 2024-05-07T14:00:48.919 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-07T14:00:49.906 INFO:teuthology.orchestra.run.smithi106.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-07T14:00:49.933 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-07T14:00:49.933 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-07T14:00:49.933 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-07T14:00:49.934 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-07T14:00:49.934 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-07T14:00:50.273 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:00:50.291 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":3435218280},{"type":"v1","addr":"172.21.15.106:6833","nonce":3435218280}]},"active_addr":"172.21.15.106:6833/3435218280","active_change":"2024-05-07T14:00:35.202213+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3168002694}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3846797088}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":1505106460}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":2146058806}]}]} 2024-05-07T14:00:50.299 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-07T14:00:50.299 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-07T14:00:50.299 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T14:00:50.589 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:00:50.589 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":19,"fsid":"0d349e2f-0c2b-4aab-8a22-181c69b40dbb","created":"2024-05-07T14:00:30.482506+0000","modified":"2024-05-07T14:00:49.909878+0000","last_up_change":"2024-05-07T14:00:41.658097+0000","last_in_change":"2024-05-07T14:00:32.857383+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T14:00:43.291253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T14:00:48.791671+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e76f5d56-1400-488e-b58f-7af657fa63ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6801","nonce":3743893730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6803","nonce":3743893730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6809","nonce":3743893730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6805","nonce":3743893730}]},"public_addr":"172.21.15.106:6801/3743893730","cluster_addr":"172.21.15.106:6803/3743893730","heartbeat_back_addr":"172.21.15.106:6809/3743893730","heartbeat_front_addr":"172.21.15.106:6805/3743893730","state":["exists","up"]},{"osd":1,"uuid":"aad5864b-9a5f-426f-a8fd-15d02590106e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6817","nonce":3901521345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6819","nonce":3901521345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6823","nonce":3901521345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6821","nonce":3901521345}]},"public_addr":"172.21.15.106:6817/3901521345","cluster_addr":"172.21.15.106:6819/3901521345","heartbeat_back_addr":"172.21.15.106:6823/3901521345","heartbeat_front_addr":"172.21.15.106:6821/3901521345","state":["exists","up"]},{"osd":2,"uuid":"eea131cd-e4ca-4360-a8a0-5005a2d827d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6825","nonce":1784825450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6827","nonce":1784825450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6831","nonce":1784825450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6829","nonce":1784825450}]},"public_addr":"172.21.15.106:6825/1784825450","cluster_addr":"172.21.15.106:6827/1784825450","heartbeat_back_addr":"172.21.15.106:6831/1784825450","heartbeat_front_addr":"172.21.15.106:6829/1784825450","state":["exists","up"]},{"osd":3,"uuid":"bdcb438c-1d40-45a2-8e8a-f29ba9c98909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6808","nonce":123863977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6811","nonce":123863977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6815","nonce":123863977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6813","nonce":123863977}]},"public_addr":"172.21.15.106:6808/123863977","cluster_addr":"172.21.15.106:6811/123863977","heartbeat_back_addr":"172.21.15.106:6815/123863977","heartbeat_front_addr":"172.21.15.106:6813/123863977","state":["exists","up"]},{"osd":4,"uuid":"703f4a52-4283-4395-bc29-4de194d4a4ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6817","nonce":3575310712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6819","nonce":3575310712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6824","nonce":3575310712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6821","nonce":3575310712}]},"public_addr":"172.21.15.107:6817/3575310712","cluster_addr":"172.21.15.107:6819/3575310712","heartbeat_back_addr":"172.21.15.107:6824/3575310712","heartbeat_front_addr":"172.21.15.107:6821/3575310712","state":["exists","up"]},{"osd":5,"uuid":"8b70f365-8b0d-429e-b3f8-601a37cfb6ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6801","nonce":2178038050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6803","nonce":2178038050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6807","nonce":2178038050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6805","nonce":2178038050}]},"public_addr":"172.21.15.107:6801/2178038050","cluster_addr":"172.21.15.107:6803/2178038050","heartbeat_back_addr":"172.21.15.107:6807/2178038050","heartbeat_front_addr":"172.21.15.107:6805/2178038050","state":["exists","up"]},{"osd":6,"uuid":"b65085d6-47af-4dfc-91a8-cdc7a6fa937c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6825","nonce":3168866293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6827","nonce":3168866293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6831","nonce":3168866293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6829","nonce":3168866293}]},"public_addr":"172.21.15.107:6825/3168866293","cluster_addr":"172.21.15.107:6827/3168866293","heartbeat_back_addr":"172.21.15.107:6831/3168866293","heartbeat_front_addr":"172.21.15.107:6829/3168866293","state":["exists","up"]},{"osd":7,"uuid":"9a808e41-afba-400f-886a-8f17689bebda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":1073700008},{"type":"v1","addr":"172.21.15.107:6809","nonce":1073700008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1073700008},{"type":"v1","addr":"172.21.15.107:6811","nonce":1073700008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1073700008},{"type":"v1","addr":"172.21.15.107:6815","nonce":1073700008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1073700008},{"type":"v1","addr":"172.21.15.107:6813","nonce":1073700008}]},"public_addr":"172.21.15.107:6809/1073700008","cluster_addr":"172.21.15.107:6811/1073700008","heartbeat_back_addr":"172.21.15.107:6815/1073700008","heartbeat_front_addr":"172.21.15.107:6813/1073700008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.435492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.545586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.430790+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.530476+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.487321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.254353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.381089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.430233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T14:00:50.608 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-07T14:00:50.608 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T14:00:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:00:50.914 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"0d349e2f-0c2b-4aab-8a22-181c69b40dbb","created":"2024-05-07T14:00:30.482506+0000","modified":"2024-05-07T14:00:50.917428+0000","last_up_change":"2024-05-07T14:00:41.658097+0000","last_in_change":"2024-05-07T14:00:32.857383+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T14:00:43.291253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T14:00:48.791671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e76f5d56-1400-488e-b58f-7af657fa63ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6801","nonce":3743893730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6803","nonce":3743893730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6809","nonce":3743893730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6805","nonce":3743893730}]},"public_addr":"172.21.15.106:6801/3743893730","cluster_addr":"172.21.15.106:6803/3743893730","heartbeat_back_addr":"172.21.15.106:6809/3743893730","heartbeat_front_addr":"172.21.15.106:6805/3743893730","state":["exists","up"]},{"osd":1,"uuid":"aad5864b-9a5f-426f-a8fd-15d02590106e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6817","nonce":3901521345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6819","nonce":3901521345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6823","nonce":3901521345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6821","nonce":3901521345}]},"public_addr":"172.21.15.106:6817/3901521345","cluster_addr":"172.21.15.106:6819/3901521345","heartbeat_back_addr":"172.21.15.106:6823/3901521345","heartbeat_front_addr":"172.21.15.106:6821/3901521345","state":["exists","up"]},{"osd":2,"uuid":"eea131cd-e4ca-4360-a8a0-5005a2d827d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6825","nonce":1784825450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6827","nonce":1784825450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6831","nonce":1784825450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6829","nonce":1784825450}]},"public_addr":"172.21.15.106:6825/1784825450","cluster_addr":"172.21.15.106:6827/1784825450","heartbeat_back_addr":"172.21.15.106:6831/1784825450","heartbeat_front_addr":"172.21.15.106:6829/1784825450","state":["exists","up"]},{"osd":3,"uuid":"bdcb438c-1d40-45a2-8e8a-f29ba9c98909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6808","nonce":123863977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6811","nonce":123863977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6815","nonce":123863977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6813","nonce":123863977}]},"public_addr":"172.21.15.106:6808/123863977","cluster_addr":"172.21.15.106:6811/123863977","heartbeat_back_addr":"172.21.15.106:6815/123863977","heartbeat_front_addr":"172.21.15.106:6813/123863977","state":["exists","up"]},{"osd":4,"uuid":"703f4a52-4283-4395-bc29-4de194d4a4ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6817","nonce":3575310712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6819","nonce":3575310712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6824","nonce":3575310712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6821","nonce":3575310712}]},"public_addr":"172.21.15.107:6817/3575310712","cluster_addr":"172.21.15.107:6819/3575310712","heartbeat_back_addr":"172.21.15.107:6824/3575310712","heartbeat_front_addr":"172.21.15.107:6821/3575310712","state":["exists","up"]},{"osd":5,"uuid":"8b70f365-8b0d-429e-b3f8-601a37cfb6ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6801","nonce":2178038050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6803","nonce":2178038050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6807","nonce":2178038050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6805","nonce":2178038050}]},"public_addr":"172.21.15.107:6801/2178038050","cluster_addr":"172.21.15.107:6803/2178038050","heartbeat_back_addr":"172.21.15.107:6807/2178038050","heartbeat_front_addr":"172.21.15.107:6805/2178038050","state":["exists","up"]},{"osd":6,"uuid":"b65085d6-47af-4dfc-91a8-cdc7a6fa937c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6825","nonce":3168866293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6827","nonce":3168866293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6831","nonce":3168866293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6829","nonce":3168866293}]},"public_addr":"172.21.15.107:6825/3168866293","cluster_addr":"172.21.15.107:6827/3168866293","heartbeat_back_addr":"172.21.15.107:6831/3168866293","heartbeat_front_addr":"172.21.15.107:6829/3168866293","state":["exists","up"]},{"osd":7,"uuid":"9a808e41-afba-400f-886a-8f17689bebda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":1073700008},{"type":"v1","addr":"172.21.15.107:6809","nonce":1073700008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":1073700008},{"type":"v1","addr":"172.21.15.107:6811","nonce":1073700008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":1073700008},{"type":"v1","addr":"172.21.15.107:6815","nonce":1073700008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":1073700008},{"type":"v1","addr":"172.21.15.107:6813","nonce":1073700008}]},"public_addr":"172.21.15.107:6809/1073700008","cluster_addr":"172.21.15.107:6811/1073700008","heartbeat_back_addr":"172.21.15.107:6815/1073700008","heartbeat_front_addr":"172.21.15.107:6813/1073700008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.435492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.545586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.430790+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.530476+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.487321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.254353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.381089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.430233+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T14:00:50.933 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-07T14:00:50.934 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-07T14:00:50.934 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-07T14:00:50.935 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-07T14:00:50.935 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-07T14:00:50.935 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-07T14:00:50.936 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-07T14:00:50.936 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-07T14:00:51.185 INFO:teuthology.orchestra.run.smithi106.stdout:55834574852 2024-05-07T14:00:51.185 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-07T14:00:51.199 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-05-07T14:00:51.199 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-07T14:00:51.204 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-05-07T14:00:51.204 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-07T14:00:51.206 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-05-07T14:00:51.206 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-07T14:00:51.207 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-05-07T14:00:51.207 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-07T14:00:51.211 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-05-07T14:00:51.211 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-07T14:00:51.217 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-05-07T14:00:51.218 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-07T14:00:51.221 INFO:teuthology.orchestra.run.smithi106.stdout:55834574852 2024-05-07T14:00:51.222 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-07T14:00:51.684 INFO:teuthology.orchestra.run.smithi106.stdout:55834574851 2024-05-07T14:00:51.697 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-05-07T14:00:51.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-05-07T14:00:51.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-05-07T14:00:51.736 INFO:teuthology.orchestra.run.smithi106.stdout:55834574852 2024-05-07T14:00:51.736 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-05-07T14:00:51.738 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-05-07T14:00:51.758 INFO:teuthology.orchestra.run.smithi106.stdout:55834574851 2024-05-07T14:00:51.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-05-07T14:00:51.761 INFO:teuthology.orchestra.run.smithi106.stdout:55834574852 2024-05-07T14:00:51.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-05-07T14:00:51.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-05-07T14:00:51.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-05-07T14:00:51.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-05-07T14:00:51.790 INFO:teuthology.orchestra.run.smithi106.stdout:55834574852 2024-05-07T14:00:51.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-05-07T14:00:52.714 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-07T14:00:52.720 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-07T14:00:52.761 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-07T14:00:52.770 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-07T14:00:52.770 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-07T14:00:52.780 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-07T14:00:52.784 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-07T14:00:52.807 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-07T14:00:53.220 INFO:teuthology.orchestra.run.smithi106.stdout:55834574852 2024-05-07T14:00:53.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-05-07T14:00:53.246 DEBUG:teuthology.parallel:result is None 2024-05-07T14:00:53.278 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-05-07T14:00:53.282 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-05-07T14:00:53.287 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-05-07T14:00:53.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-05-07T14:00:53.310 DEBUG:teuthology.parallel:result is None 2024-05-07T14:00:53.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-05-07T14:00:53.310 DEBUG:teuthology.parallel:result is None 2024-05-07T14:00:53.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-05-07T14:00:53.315 DEBUG:teuthology.parallel:result is None 2024-05-07T14:00:53.321 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2024-05-07T14:00:53.324 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-05-07T14:00:53.335 INFO:teuthology.orchestra.run.smithi106.stdout:55834574852 2024-05-07T14:00:53.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-05-07T14:00:53.344 DEBUG:teuthology.parallel:result is None 2024-05-07T14:00:53.345 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2024-05-07T14:00:53.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-05-07T14:00:53.350 DEBUG:teuthology.parallel:result is None 2024-05-07T14:00:53.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-05-07T14:00:53.356 DEBUG:teuthology.parallel:result is None 2024-05-07T14:00:53.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-05-07T14:00:53.364 DEBUG:teuthology.parallel:result is None 2024-05-07T14:00:53.364 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-07T14:00:53.364 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:00:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:00:53.675 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:00:53.691 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-05-07T14:00:53.215014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218960,"kb_used_data":2760,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755760,"statfs":{"total":773094113280,"available":772869898240,"internally_reserved":0,"allocated":2826240,"data_stored":1722616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.303755"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:51.345762+0000","last_change":"2024-05-07T14:00:49.938879+0000","last_active":"2024-05-07T14:00:51.345762+0000","last_peered":"2024-05-07T14:00:51.345762+0000","last_clean":"2024-05-07T14:00:51.345762+0000","last_became_active":"2024-05-07T14:00:49.938066+0000","last_became_peered":"2024-05-07T14:00:49.938066+0000","last_unstale":"2024-05-07T14:00:51.345762+0000","last_undegraded":"2024-05-07T14:00:51.345762+0000","last_fullsized":"2024-05-07T14:00:51.345762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:50.923918+0000","last_change":"2024-05-07T14:00:49.936072+0000","last_active":"2024-05-07T14:00:50.923918+0000","last_peered":"2024-05-07T14:00:50.923918+0000","last_clean":"2024-05-07T14:00:50.923918+0000","last_became_active":"2024-05-07T14:00:49.935768+0000","last_became_peered":"2024-05-07T14:00:49.935768+0000","last_unstale":"2024-05-07T14:00:50.923918+0000","last_undegraded":"2024-05-07T14:00:50.923918+0000","last_fullsized":"2024-05-07T14:00:50.923918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:50.923439+0000","last_change":"2024-05-07T14:00:49.928907+0000","last_active":"2024-05-07T14:00:50.923439+0000","last_peered":"2024-05-07T14:00:50.923439+0000","last_clean":"2024-05-07T14:00:50.923439+0000","last_became_active":"2024-05-07T14:00:49.928146+0000","last_became_peered":"2024-05-07T14:00:49.928146+0000","last_unstale":"2024-05-07T14:00:50.923439+0000","last_undegraded":"2024-05-07T14:00:50.923439+0000","last_fullsized":"2024-05-07T14:00:50.923439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:07.032835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:50.923788+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:00:50.923788+0000","last_peered":"2024-05-07T14:00:50.923788+0000","last_clean":"2024-05-07T14:00:50.923788+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:00:50.923788+0000","last_undegraded":"2024-05-07T14:00:50.923788+0000","last_fullsized":"2024-05-07T14:00:50.923788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:51.345811+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:00:51.345811+0000","last_peered":"2024-05-07T14:00:51.345811+0000","last_clean":"2024-05-07T14:00:51.345811+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:00:51.345811+0000","last_undegraded":"2024-05-07T14:00:51.345811+0000","last_fullsized":"2024-05-07T14:00:51.345811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:51.344746+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:00:51.344746+0000","last_peered":"2024-05-07T14:00:51.344746+0000","last_clean":"2024-05-07T14:00:51.344746+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:00:51.344746+0000","last_undegraded":"2024-05-07T14:00:51.344746+0000","last_fullsized":"2024-05-07T14:00:51.344746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:50.923344+0000","last_change":"2024-05-07T14:00:49.930222+0000","last_active":"2024-05-07T14:00:50.923344+0000","last_peered":"2024-05-07T14:00:50.923344+0000","last_clean":"2024-05-07T14:00:50.923344+0000","last_became_active":"2024-05-07T14:00:49.929538+0000","last_became_peered":"2024-05-07T14:00:49.929538+0000","last_unstale":"2024-05-07T14:00:50.923344+0000","last_undegraded":"2024-05-07T14:00:50.923344+0000","last_fullsized":"2024-05-07T14:00:50.923344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:43.069683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:51.345842+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:00:51.345842+0000","last_peered":"2024-05-07T14:00:51.345842+0000","last_clean":"2024-05-07T14:00:51.345842+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:00:51.345842+0000","last_undegraded":"2024-05-07T14:00:51.345842+0000","last_fullsized":"2024-05-07T14:00:51.345842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:50.923120+0000","last_change":"2024-05-07T14:00:45.460158+0000","last_active":"2024-05-07T14:00:50.923120+0000","last_peered":"2024-05-07T14:00:50.923120+0000","last_clean":"2024-05-07T14:00:50.923120+0000","last_became_active":"2024-05-07T14:00:45.458198+0000","last_became_peered":"2024-05-07T14:00:45.458198+0000","last_unstale":"2024-05-07T14:00:50.923120+0000","last_undegraded":"2024-05-07T14:00:50.923120+0000","last_fullsized":"2024-05-07T14:00:50.923120+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:18.582514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":658103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":658103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:00:53.692 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:00:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:00:53.966 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:00:53.982 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-05-07T14:00:53.215014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218960,"kb_used_data":2760,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755760,"statfs":{"total":773094113280,"available":772869898240,"internally_reserved":0,"allocated":2826240,"data_stored":1722616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.303755"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:51.345762+0000","last_change":"2024-05-07T14:00:49.938879+0000","last_active":"2024-05-07T14:00:51.345762+0000","last_peered":"2024-05-07T14:00:51.345762+0000","last_clean":"2024-05-07T14:00:51.345762+0000","last_became_active":"2024-05-07T14:00:49.938066+0000","last_became_peered":"2024-05-07T14:00:49.938066+0000","last_unstale":"2024-05-07T14:00:51.345762+0000","last_undegraded":"2024-05-07T14:00:51.345762+0000","last_fullsized":"2024-05-07T14:00:51.345762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:50.923918+0000","last_change":"2024-05-07T14:00:49.936072+0000","last_active":"2024-05-07T14:00:50.923918+0000","last_peered":"2024-05-07T14:00:50.923918+0000","last_clean":"2024-05-07T14:00:50.923918+0000","last_became_active":"2024-05-07T14:00:49.935768+0000","last_became_peered":"2024-05-07T14:00:49.935768+0000","last_unstale":"2024-05-07T14:00:50.923918+0000","last_undegraded":"2024-05-07T14:00:50.923918+0000","last_fullsized":"2024-05-07T14:00:50.923918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:50.923439+0000","last_change":"2024-05-07T14:00:49.928907+0000","last_active":"2024-05-07T14:00:50.923439+0000","last_peered":"2024-05-07T14:00:50.923439+0000","last_clean":"2024-05-07T14:00:50.923439+0000","last_became_active":"2024-05-07T14:00:49.928146+0000","last_became_peered":"2024-05-07T14:00:49.928146+0000","last_unstale":"2024-05-07T14:00:50.923439+0000","last_undegraded":"2024-05-07T14:00:50.923439+0000","last_fullsized":"2024-05-07T14:00:50.923439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:07.032835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:50.923788+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:00:50.923788+0000","last_peered":"2024-05-07T14:00:50.923788+0000","last_clean":"2024-05-07T14:00:50.923788+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:00:50.923788+0000","last_undegraded":"2024-05-07T14:00:50.923788+0000","last_fullsized":"2024-05-07T14:00:50.923788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:51.345811+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:00:51.345811+0000","last_peered":"2024-05-07T14:00:51.345811+0000","last_clean":"2024-05-07T14:00:51.345811+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:00:51.345811+0000","last_undegraded":"2024-05-07T14:00:51.345811+0000","last_fullsized":"2024-05-07T14:00:51.345811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:51.344746+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:00:51.344746+0000","last_peered":"2024-05-07T14:00:51.344746+0000","last_clean":"2024-05-07T14:00:51.344746+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:00:51.344746+0000","last_undegraded":"2024-05-07T14:00:51.344746+0000","last_fullsized":"2024-05-07T14:00:51.344746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:50.923344+0000","last_change":"2024-05-07T14:00:49.930222+0000","last_active":"2024-05-07T14:00:50.923344+0000","last_peered":"2024-05-07T14:00:50.923344+0000","last_clean":"2024-05-07T14:00:50.923344+0000","last_became_active":"2024-05-07T14:00:49.929538+0000","last_became_peered":"2024-05-07T14:00:49.929538+0000","last_unstale":"2024-05-07T14:00:50.923344+0000","last_undegraded":"2024-05-07T14:00:50.923344+0000","last_fullsized":"2024-05-07T14:00:50.923344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:43.069683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:51.345842+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:00:51.345842+0000","last_peered":"2024-05-07T14:00:51.345842+0000","last_clean":"2024-05-07T14:00:51.345842+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:00:51.345842+0000","last_undegraded":"2024-05-07T14:00:51.345842+0000","last_fullsized":"2024-05-07T14:00:51.345842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-07T14:00:50.923120+0000","last_change":"2024-05-07T14:00:45.460158+0000","last_active":"2024-05-07T14:00:50.923120+0000","last_peered":"2024-05-07T14:00:50.923120+0000","last_clean":"2024-05-07T14:00:50.923120+0000","last_became_active":"2024-05-07T14:00:45.458198+0000","last_became_peered":"2024-05-07T14:00:45.458198+0000","last_unstale":"2024-05-07T14:00:50.923120+0000","last_undegraded":"2024-05-07T14:00:50.923120+0000","last_fullsized":"2024-05-07T14:00:50.923120+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:18.582514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":658103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":658103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:00:53.983 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-07T14:00:53.983 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-07T14:00:53.983 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-07T14:00:53.983 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-07T14:00:54.280 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:00:54.281 INFO:teuthology.orchestra.run.smithi106.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-07T14:00:54.298 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-07T14:00:54.299 INFO:teuthology.run_tasks:Running task rgw... 2024-05-07T14:00:54.316 DEBUG:tasks.rgw:config is {'client.0': None} 2024-05-07T14:00:54.316 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-05-07T14:00:54.317 INFO:tasks.rgw:Creating data pools 2024-05-07T14:00:54.317 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-07T14:00:54.317 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-05-07T14:00:54.935 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'default.rgw.buckets.data' created 2024-05-07T14:00:54.978 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-05-07T14:00:55.931 INFO:teuthology.orchestra.run.smithi106.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-05-07T14:00:55.974 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-05-07T14:00:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'default.rgw.buckets.index' created 2024-05-07T14:00:56.980 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-05-07T14:00:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-05-07T14:00:57.997 DEBUG:tasks.rgw:Pools created 2024-05-07T14:00:57.997 INFO:tasks.rgw:Starting rgw... 2024-05-07T14:00:57.998 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-07T14:00:57.998 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-07T14:00:57.998 DEBUG:teuthology.orchestra.run.smithi106:> sudo echo -n http://smithi106.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-07T14:00:58.010 INFO:teuthology.orchestra.run.smithi106.stdout:http://smithi106.front.sepia.ceph.com:80 2024-05-07T14:00:58.010 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-07T14:00:58.062 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-07T14:00:58.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-07T14:00:58.106 INFO:tasks.rgw.client.0:Started 2024-05-07T14:00:58.106 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi106.front.sepia.ceph.com:80/ 2024-05-07T14:00:58.106 DEBUG:teuthology.orchestra.run.smithi106:> curl http://smithi106.front.sepia.ceph.com:80/ 2024-05-07T14:00:58.135 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-07T14:00:58.136 INFO:teuthology.orchestra.run.smithi106.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-07T14:00:58.136 INFO:teuthology.orchestra.run.smithi106.stderr: Dload Upload Total Spent Left Speed 2024-05-07T14:00:58.136 INFO:teuthology.orchestra.run.smithi106.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-07T14:00:58.136 INFO:teuthology.orchestra.run.smithi106.stderr:curl: (7) Failed to connect to smithi106.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-07T14:00:59.137 DEBUG:teuthology.orchestra.run.smithi106:> curl http://smithi106.front.sepia.ceph.com:80/ 2024-05-07T14:00:59.150 INFO:teuthology.orchestra.run.smithi106.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-07T14:00:59.150 INFO:teuthology.orchestra.run.smithi106.stderr: Dload Upload Total Spent Left Speed 2024-05-07T14:00:59.150 INFO:teuthology.orchestra.run.smithi106.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-07T14:00:59.150 INFO:teuthology.orchestra.run.smithi106.stderr:curl: (7) Failed to connect to smithi106.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-07T14:00:59.151 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-07T14:01:01.152 DEBUG:teuthology.orchestra.run.smithi106:> curl http://smithi106.front.sepia.ceph.com:80/ 2024-05-07T14:01:01.164 INFO:teuthology.orchestra.run.smithi106.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-07T14:01:01.164 INFO:teuthology.orchestra.run.smithi106.stderr: Dload Upload Total Spent Left Speed 2024-05-07T14:01:01.164 INFO:teuthology.orchestra.run.smithi106.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-07T14:01:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:curl: (7) Failed to connect to smithi106.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-07T14:01:01.165 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-07T14:01:05.166 DEBUG:teuthology.orchestra.run.smithi106:> curl http://smithi106.front.sepia.ceph.com:80/ 2024-05-07T14:01:05.178 INFO:teuthology.orchestra.run.smithi106.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-07T14:01:05.178 INFO:teuthology.orchestra.run.smithi106.stderr: Dload Upload Total Spent Left Speed 2024-05-07T14:01:05.178 INFO:teuthology.orchestra.run.smithi106.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-07T14:01:05.178 INFO:teuthology.orchestra.run.smithi106.stderr:curl: (7) Failed to connect to smithi106.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-07T14:01:05.179 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-07T14:01:07.148 INFO:tasks.rgw.client.0.smithi106.stdout:2024-05-07T14:01:07.163+0000 7f98943a1a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-05-07T14:01:13.180 DEBUG:teuthology.orchestra.run.smithi106:> curl http://smithi106.front.sepia.ceph.com:80/ 2024-05-07T14:01:13.192 INFO:teuthology.orchestra.run.smithi106.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-07T14:01:13.192 INFO:teuthology.orchestra.run.smithi106.stderr: Dload Upload Total Spent Left Speed 2024-05-07T14:01:13.195 INFO:teuthology.orchestra.run.smithi106.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 55048 0 --:--:-- --:--:-- --:--:-- 62333 2024-05-07T14:01:13.196 INFO:teuthology.orchestra.run.smithi106.stdout:anonymous 2024-05-07T14:01:13.197 INFO:teuthology.run_tasks:Running task thrashosds... 2024-05-07T14:01:13.237 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-05-07T14:01:13.237 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-cbodley2-testing'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-squid'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley2-testing', 'sha1': '1dfb479e40144c07778a01ea762def8ca56f6eee'}} 2024-05-07T14:01:13.238 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-05-07T14:01:13.238 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-05-07T14:01:13.575 INFO:tasks.thrashosds:Beginning thrashosds... 2024-05-07T14:01:13.575 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-07T14:01:13.575 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:01:13.915 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:01:13.921 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:01:13.934 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-05-07T14:01:13.221958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224656,"kb_used_data":4328,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750064,"statfs":{"total":773094113280,"available":772864065536,"internally_reserved":0,"allocated":4431872,"data_stored":2490830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003194"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011932+0000","last_change":"2024-05-07T14:00:55.983744+0000","last_active":"2024-05-07T14:01:07.011932+0000","last_peered":"2024-05-07T14:01:07.011932+0000","last_clean":"2024-05-07T14:01:07.011932+0000","last_became_active":"2024-05-07T14:00:55.982993+0000","last_became_peered":"2024-05-07T14:00:55.982993+0000","last_unstale":"2024-05-07T14:01:07.011932+0000","last_undegraded":"2024-05-07T14:01:07.011932+0000","last_fullsized":"2024-05-07T14:01:07.011932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042114+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:01:07.042114+0000","last_peered":"2024-05-07T14:01:07.042114+0000","last_clean":"2024-05-07T14:01:07.042114+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:01:07.042114+0000","last_undegraded":"2024-05-07T14:01:07.042114+0000","last_fullsized":"2024-05-07T14:01:07.042114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.026608+0000","last_change":"2024-05-07T14:00:55.973967+0000","last_active":"2024-05-07T14:01:07.026608+0000","last_peered":"2024-05-07T14:01:07.026608+0000","last_clean":"2024-05-07T14:01:07.026608+0000","last_became_active":"2024-05-07T14:00:55.973677+0000","last_became_peered":"2024-05-07T14:00:55.973677+0000","last_unstale":"2024-05-07T14:01:07.026608+0000","last_undegraded":"2024-05-07T14:01:07.026608+0000","last_fullsized":"2024-05-07T14:01:07.026608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011178+0000","last_change":"2024-05-07T14:00:57.988092+0000","last_active":"2024-05-07T14:01:07.011178+0000","last_peered":"2024-05-07T14:01:07.011178+0000","last_clean":"2024-05-07T14:01:07.011178+0000","last_became_active":"2024-05-07T14:00:57.987091+0000","last_became_peered":"2024-05-07T14:00:57.987091+0000","last_unstale":"2024-05-07T14:01:07.011178+0000","last_undegraded":"2024-05-07T14:01:07.011178+0000","last_fullsized":"2024-05-07T14:01:07.011178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010811+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:01:07.010811+0000","last_peered":"2024-05-07T14:01:07.010811+0000","last_clean":"2024-05-07T14:01:07.010811+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:01:07.010811+0000","last_undegraded":"2024-05-07T14:01:07.010811+0000","last_fullsized":"2024-05-07T14:01:07.010811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015164+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:01:07.015164+0000","last_peered":"2024-05-07T14:01:07.015164+0000","last_clean":"2024-05-07T14:01:07.015164+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:01:07.015164+0000","last_undegraded":"2024-05-07T14:01:07.015164+0000","last_fullsized":"2024-05-07T14:01:07.015164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043568+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:01:07.043568+0000","last_peered":"2024-05-07T14:01:07.043568+0000","last_clean":"2024-05-07T14:01:07.043568+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:01:07.043568+0000","last_undegraded":"2024-05-07T14:01:07.043568+0000","last_fullsized":"2024-05-07T14:01:07.043568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010709+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:01:07.010709+0000","last_peered":"2024-05-07T14:01:07.010709+0000","last_clean":"2024-05-07T14:01:07.010709+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:01:07.010709+0000","last_undegraded":"2024-05-07T14:01:07.010709+0000","last_fullsized":"2024-05-07T14:01:07.010709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011458+0000","last_change":"2024-05-07T14:00:55.973419+0000","last_active":"2024-05-07T14:01:07.011458+0000","last_peered":"2024-05-07T14:01:07.011458+0000","last_clean":"2024-05-07T14:01:07.011458+0000","last_became_active":"2024-05-07T14:00:55.963467+0000","last_became_peered":"2024-05-07T14:00:55.963467+0000","last_unstale":"2024-05-07T14:01:07.011458+0000","last_undegraded":"2024-05-07T14:01:07.011458+0000","last_fullsized":"2024-05-07T14:01:07.011458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047047+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:01:07.047047+0000","last_peered":"2024-05-07T14:01:07.047047+0000","last_clean":"2024-05-07T14:01:07.047047+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:01:07.047047+0000","last_undegraded":"2024-05-07T14:01:07.047047+0000","last_fullsized":"2024-05-07T14:01:07.047047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042809+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:01:07.042809+0000","last_peered":"2024-05-07T14:01:07.042809+0000","last_clean":"2024-05-07T14:01:07.042809+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:01:07.042809+0000","last_undegraded":"2024-05-07T14:01:07.042809+0000","last_fullsized":"2024-05-07T14:01:07.042809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014767+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:01:07.014767+0000","last_peered":"2024-05-07T14:01:07.014767+0000","last_clean":"2024-05-07T14:01:07.014767+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:01:07.014767+0000","last_undegraded":"2024-05-07T14:01:07.014767+0000","last_fullsized":"2024-05-07T14:01:07.014767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011472+0000","last_change":"2024-05-07T14:00:55.962579+0000","last_active":"2024-05-07T14:01:07.011472+0000","last_peered":"2024-05-07T14:01:07.011472+0000","last_clean":"2024-05-07T14:01:07.011472+0000","last_became_active":"2024-05-07T14:00:55.961815+0000","last_became_peered":"2024-05-07T14:00:55.961815+0000","last_unstale":"2024-05-07T14:01:07.011472+0000","last_undegraded":"2024-05-07T14:01:07.011472+0000","last_fullsized":"2024-05-07T14:01:07.011472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043533+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:01:07.043533+0000","last_peered":"2024-05-07T14:01:07.043533+0000","last_clean":"2024-05-07T14:01:07.043533+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:01:07.043533+0000","last_undegraded":"2024-05-07T14:01:07.043533+0000","last_fullsized":"2024-05-07T14:01:07.043533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028241+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:01:07.028241+0000","last_peered":"2024-05-07T14:01:07.028241+0000","last_clean":"2024-05-07T14:01:07.028241+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:01:07.028241+0000","last_undegraded":"2024-05-07T14:01:07.028241+0000","last_fullsized":"2024-05-07T14:01:07.028241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.064044+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:01:07.064044+0000","last_peered":"2024-05-07T14:01:07.064044+0000","last_clean":"2024-05-07T14:01:07.064044+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:01:07.064044+0000","last_undegraded":"2024-05-07T14:01:07.064044+0000","last_fullsized":"2024-05-07T14:01:07.064044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014523+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:01:07.014523+0000","last_peered":"2024-05-07T14:01:07.014523+0000","last_clean":"2024-05-07T14:01:07.014523+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:01:07.014523+0000","last_undegraded":"2024-05-07T14:01:07.014523+0000","last_fullsized":"2024-05-07T14:01:07.014523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012206+0000","last_change":"2024-05-07T14:00:56.003776+0000","last_active":"2024-05-07T14:01:07.012206+0000","last_peered":"2024-05-07T14:01:07.012206+0000","last_clean":"2024-05-07T14:01:07.012206+0000","last_became_active":"2024-05-07T14:00:56.002996+0000","last_became_peered":"2024-05-07T14:00:56.002996+0000","last_unstale":"2024-05-07T14:01:07.012206+0000","last_undegraded":"2024-05-07T14:01:07.012206+0000","last_fullsized":"2024-05-07T14:01:07.012206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:17.583140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011336+0000","last_change":"2024-05-07T14:00:57.987026+0000","last_active":"2024-05-07T14:01:07.011336+0000","last_peered":"2024-05-07T14:01:07.011336+0000","last_clean":"2024-05-07T14:01:07.011336+0000","last_became_active":"2024-05-07T14:00:57.986048+0000","last_became_peered":"2024-05-07T14:00:57.986048+0000","last_unstale":"2024-05-07T14:01:07.011336+0000","last_undegraded":"2024-05-07T14:01:07.011336+0000","last_fullsized":"2024-05-07T14:01:07.011336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.048099+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:01:07.048099+0000","last_peered":"2024-05-07T14:01:07.048099+0000","last_clean":"2024-05-07T14:01:07.048099+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:01:07.048099+0000","last_undegraded":"2024-05-07T14:01:07.048099+0000","last_fullsized":"2024-05-07T14:01:07.048099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043347+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:01:07.043347+0000","last_peered":"2024-05-07T14:01:07.043347+0000","last_clean":"2024-05-07T14:01:07.043347+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:01:07.043347+0000","last_undegraded":"2024-05-07T14:01:07.043347+0000","last_fullsized":"2024-05-07T14:01:07.043347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047840+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:01:07.047840+0000","last_peered":"2024-05-07T14:01:07.047840+0000","last_clean":"2024-05-07T14:01:07.047840+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:01:07.047840+0000","last_undegraded":"2024-05-07T14:01:07.047840+0000","last_fullsized":"2024-05-07T14:01:07.047840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062799+0000","last_change":"2024-05-07T14:00:57.995304+0000","last_active":"2024-05-07T14:01:07.062799+0000","last_peered":"2024-05-07T14:01:07.062799+0000","last_clean":"2024-05-07T14:01:07.062799+0000","last_became_active":"2024-05-07T14:00:57.977809+0000","last_became_peered":"2024-05-07T14:00:57.977809+0000","last_unstale":"2024-05-07T14:01:07.062799+0000","last_undegraded":"2024-05-07T14:01:07.062799+0000","last_fullsized":"2024-05-07T14:01:07.062799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:42.772959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014571+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:01:07.014571+0000","last_peered":"2024-05-07T14:01:07.014571+0000","last_clean":"2024-05-07T14:01:07.014571+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:01:07.014571+0000","last_undegraded":"2024-05-07T14:01:07.014571+0000","last_fullsized":"2024-05-07T14:01:07.014571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.063763+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:01:07.063763+0000","last_peered":"2024-05-07T14:01:07.063763+0000","last_clean":"2024-05-07T14:01:07.063763+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:01:07.063763+0000","last_undegraded":"2024-05-07T14:01:07.063763+0000","last_fullsized":"2024-05-07T14:01:07.063763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028533+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:01:07.028533+0000","last_peered":"2024-05-07T14:01:07.028533+0000","last_clean":"2024-05-07T14:01:07.028533+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:01:07.028533+0000","last_undegraded":"2024-05-07T14:01:07.028533+0000","last_fullsized":"2024-05-07T14:01:07.028533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014927+0000","last_change":"2024-05-07T14:00:58.008214+0000","last_active":"2024-05-07T14:01:07.014927+0000","last_peered":"2024-05-07T14:01:07.014927+0000","last_clean":"2024-05-07T14:01:07.014927+0000","last_became_active":"2024-05-07T14:00:58.005516+0000","last_became_peered":"2024-05-07T14:00:58.005516+0000","last_unstale":"2024-05-07T14:01:07.014927+0000","last_undegraded":"2024-05-07T14:01:07.014927+0000","last_fullsized":"2024-05-07T14:01:07.014927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010119+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:01:07.010119+0000","last_peered":"2024-05-07T14:01:07.010119+0000","last_clean":"2024-05-07T14:01:07.010119+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:01:07.010119+0000","last_undegraded":"2024-05-07T14:01:07.010119+0000","last_fullsized":"2024-05-07T14:01:07.010119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.013823+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:01:07.013823+0000","last_peered":"2024-05-07T14:01:07.013823+0000","last_clean":"2024-05-07T14:01:07.013823+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:01:07.013823+0000","last_undegraded":"2024-05-07T14:01:07.013823+0000","last_fullsized":"2024-05-07T14:01:07.013823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029690+0000","last_change":"2024-05-07T14:00:57.988107+0000","last_active":"2024-05-07T14:01:07.029690+0000","last_peered":"2024-05-07T14:01:07.029690+0000","last_clean":"2024-05-07T14:01:07.029690+0000","last_became_active":"2024-05-07T14:00:57.987604+0000","last_became_peered":"2024-05-07T14:00:57.987604+0000","last_unstale":"2024-05-07T14:01:07.029690+0000","last_undegraded":"2024-05-07T14:01:07.029690+0000","last_fullsized":"2024-05-07T14:01:07.029690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011838+0000","last_change":"2024-05-07T14:00:55.975648+0000","last_active":"2024-05-07T14:01:07.011838+0000","last_peered":"2024-05-07T14:01:07.011838+0000","last_clean":"2024-05-07T14:01:07.011838+0000","last_became_active":"2024-05-07T14:00:55.974335+0000","last_became_peered":"2024-05-07T14:00:55.974335+0000","last_unstale":"2024-05-07T14:01:07.011838+0000","last_undegraded":"2024-05-07T14:01:07.011838+0000","last_fullsized":"2024-05-07T14:01:07.011838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043299+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:01:07.043299+0000","last_peered":"2024-05-07T14:01:07.043299+0000","last_clean":"2024-05-07T14:01:07.043299+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:01:07.043299+0000","last_undegraded":"2024-05-07T14:01:07.043299+0000","last_fullsized":"2024-05-07T14:01:07.043299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.429425+0000","last_change":"2024-05-07T14:01:01.993679+0000","last_active":"2024-05-07T14:01:07.429425+0000","last_peered":"2024-05-07T14:01:07.429425+0000","last_clean":"2024-05-07T14:01:07.429425+0000","last_became_active":"2024-05-07T14:01:01.993241+0000","last_became_peered":"2024-05-07T14:01:01.993241+0000","last_unstale":"2024-05-07T14:01:07.429425+0000","last_undegraded":"2024-05-07T14:01:07.429425+0000","last_fullsized":"2024-05-07T14:01:07.429425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011515+0000","last_change":"2024-05-07T14:01:04.017472+0000","last_active":"2024-05-07T14:01:07.011515+0000","last_peered":"2024-05-07T14:01:07.011515+0000","last_clean":"2024-05-07T14:01:07.011515+0000","last_became_active":"2024-05-07T14:01:04.016757+0000","last_became_peered":"2024-05-07T14:01:04.016757+0000","last_unstale":"2024-05-07T14:01:07.011515+0000","last_undegraded":"2024-05-07T14:01:07.011515+0000","last_fullsized":"2024-05-07T14:01:07.011515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042729+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:01:07.042729+0000","last_peered":"2024-05-07T14:01:07.042729+0000","last_clean":"2024-05-07T14:01:07.042729+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:01:07.042729+0000","last_undegraded":"2024-05-07T14:01:07.042729+0000","last_fullsized":"2024-05-07T14:01:07.042729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044362+0000","last_change":"2024-05-07T14:00:57.984789+0000","last_active":"2024-05-07T14:01:07.044362+0000","last_peered":"2024-05-07T14:01:07.044362+0000","last_clean":"2024-05-07T14:01:07.044362+0000","last_became_active":"2024-05-07T14:00:57.983524+0000","last_became_peered":"2024-05-07T14:00:57.983524+0000","last_unstale":"2024-05-07T14:01:07.044362+0000","last_undegraded":"2024-05-07T14:01:07.044362+0000","last_fullsized":"2024-05-07T14:01:07.044362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010345+0000","last_change":"2024-05-07T14:00:55.989797+0000","last_active":"2024-05-07T14:01:07.010345+0000","last_peered":"2024-05-07T14:01:07.010345+0000","last_clean":"2024-05-07T14:01:07.010345+0000","last_became_active":"2024-05-07T14:00:55.989449+0000","last_became_peered":"2024-05-07T14:00:55.989449+0000","last_unstale":"2024-05-07T14:01:07.010345+0000","last_undegraded":"2024-05-07T14:01:07.010345+0000","last_fullsized":"2024-05-07T14:01:07.010345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029228+0000","last_change":"2024-05-07T14:00:59.983880+0000","last_active":"2024-05-07T14:01:07.029228+0000","last_peered":"2024-05-07T14:01:07.029228+0000","last_clean":"2024-05-07T14:01:07.029228+0000","last_became_active":"2024-05-07T14:00:59.983186+0000","last_became_peered":"2024-05-07T14:00:59.983186+0000","last_unstale":"2024-05-07T14:01:07.029228+0000","last_undegraded":"2024-05-07T14:01:07.029228+0000","last_fullsized":"2024-05-07T14:01:07.029228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:27.067433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.810642+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:01:07.810642+0000","last_peered":"2024-05-07T14:01:07.810642+0000","last_clean":"2024-05-07T14:01:07.810642+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:01:07.810642+0000","last_undegraded":"2024-05-07T14:01:07.810642+0000","last_fullsized":"2024-05-07T14:01:07.810642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014939+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:01:07.014939+0000","last_peered":"2024-05-07T14:01:07.014939+0000","last_clean":"2024-05-07T14:01:07.014939+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:01:07.014939+0000","last_undegraded":"2024-05-07T14:01:07.014939+0000","last_fullsized":"2024-05-07T14:01:07.014939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.009796+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:01:07.009796+0000","last_peered":"2024-05-07T14:01:07.009796+0000","last_clean":"2024-05-07T14:01:07.009796+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:01:07.009796+0000","last_undegraded":"2024-05-07T14:01:07.009796+0000","last_fullsized":"2024-05-07T14:01:07.009796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011727+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:01:07.011727+0000","last_peered":"2024-05-07T14:01:07.011727+0000","last_clean":"2024-05-07T14:01:07.011727+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:01:07.011727+0000","last_undegraded":"2024-05-07T14:01:07.011727+0000","last_fullsized":"2024-05-07T14:01:07.011727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011585+0000","last_change":"2024-05-07T14:00:55.986233+0000","last_active":"2024-05-07T14:01:07.011585+0000","last_peered":"2024-05-07T14:01:07.011585+0000","last_clean":"2024-05-07T14:01:07.011585+0000","last_became_active":"2024-05-07T14:00:55.984927+0000","last_became_peered":"2024-05-07T14:00:55.984927+0000","last_unstale":"2024-05-07T14:01:07.011585+0000","last_undegraded":"2024-05-07T14:01:07.011585+0000","last_fullsized":"2024-05-07T14:01:07.011585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.032393+0000","last_change":"2024-05-07T14:00:59.992166+0000","last_active":"2024-05-07T14:01:07.032393+0000","last_peered":"2024-05-07T14:01:07.032393+0000","last_clean":"2024-05-07T14:01:07.032393+0000","last_became_active":"2024-05-07T14:00:59.991408+0000","last_became_peered":"2024-05-07T14:00:59.991408+0000","last_unstale":"2024-05-07T14:01:07.032393+0000","last_undegraded":"2024-05-07T14:01:07.032393+0000","last_fullsized":"2024-05-07T14:01:07.032393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.866115+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:01:07.866115+0000","last_peered":"2024-05-07T14:01:07.866115+0000","last_clean":"2024-05-07T14:01:07.866115+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:01:07.866115+0000","last_undegraded":"2024-05-07T14:01:07.866115+0000","last_fullsized":"2024-05-07T14:01:07.866115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.600205+0000","last_change":"2024-05-07T14:01:04.007238+0000","last_active":"2024-05-07T14:01:07.600205+0000","last_peered":"2024-05-07T14:01:07.600205+0000","last_clean":"2024-05-07T14:01:07.600205+0000","last_became_active":"2024-05-07T14:01:04.006204+0000","last_became_peered":"2024-05-07T14:01:04.006204+0000","last_unstale":"2024-05-07T14:01:07.600205+0000","last_undegraded":"2024-05-07T14:01:07.600205+0000","last_fullsized":"2024-05-07T14:01:07.600205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014365+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:01:07.014365+0000","last_peered":"2024-05-07T14:01:07.014365+0000","last_clean":"2024-05-07T14:01:07.014365+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:01:07.014365+0000","last_undegraded":"2024-05-07T14:01:07.014365+0000","last_fullsized":"2024-05-07T14:01:07.014365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.031726+0000","last_change":"2024-05-07T14:00:57.998824+0000","last_active":"2024-05-07T14:01:07.031726+0000","last_peered":"2024-05-07T14:01:07.031726+0000","last_clean":"2024-05-07T14:01:07.031726+0000","last_became_active":"2024-05-07T14:00:57.998316+0000","last_became_peered":"2024-05-07T14:00:57.998316+0000","last_unstale":"2024-05-07T14:01:07.031726+0000","last_undegraded":"2024-05-07T14:01:07.031726+0000","last_fullsized":"2024-05-07T14:01:07.031726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046090+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:01:07.046090+0000","last_peered":"2024-05-07T14:01:07.046090+0000","last_clean":"2024-05-07T14:01:07.046090+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:01:07.046090+0000","last_undegraded":"2024-05-07T14:01:07.046090+0000","last_fullsized":"2024-05-07T14:01:07.046090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043527+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:01:07.043527+0000","last_peered":"2024-05-07T14:01:07.043527+0000","last_clean":"2024-05-07T14:01:07.043527+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:01:07.043527+0000","last_undegraded":"2024-05-07T14:01:07.043527+0000","last_fullsized":"2024-05-07T14:01:07.043527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.871853+0000","last_change":"2024-05-07T14:01:02.151107+0000","last_active":"2024-05-07T14:01:07.871853+0000","last_peered":"2024-05-07T14:01:07.871853+0000","last_clean":"2024-05-07T14:01:07.871853+0000","last_became_active":"2024-05-07T14:01:02.150351+0000","last_became_peered":"2024-05-07T14:01:02.150351+0000","last_unstale":"2024-05-07T14:01:07.871853+0000","last_undegraded":"2024-05-07T14:01:07.871853+0000","last_fullsized":"2024-05-07T14:01:07.871853+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:28:13.159757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.604006+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:01:07.604006+0000","last_peered":"2024-05-07T14:01:07.604006+0000","last_clean":"2024-05-07T14:01:07.604006+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:01:07.604006+0000","last_undegraded":"2024-05-07T14:01:07.604006+0000","last_fullsized":"2024-05-07T14:01:07.604006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042520+0000","last_change":"2024-05-07T14:00:57.979757+0000","last_active":"2024-05-07T14:01:07.042520+0000","last_peered":"2024-05-07T14:01:07.042520+0000","last_clean":"2024-05-07T14:01:07.042520+0000","last_became_active":"2024-05-07T14:00:57.979030+0000","last_became_peered":"2024-05-07T14:00:57.979030+0000","last_unstale":"2024-05-07T14:01:07.042520+0000","last_undegraded":"2024-05-07T14:01:07.042520+0000","last_fullsized":"2024-05-07T14:01:07.042520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012283+0000","last_change":"2024-05-07T14:00:55.980339+0000","last_active":"2024-05-07T14:01:07.012283+0000","last_peered":"2024-05-07T14:01:07.012283+0000","last_clean":"2024-05-07T14:01:07.012283+0000","last_became_active":"2024-05-07T14:00:55.979609+0000","last_became_peered":"2024-05-07T14:00:55.979609+0000","last_unstale":"2024-05-07T14:01:07.012283+0000","last_undegraded":"2024-05-07T14:01:07.012283+0000","last_fullsized":"2024-05-07T14:01:07.012283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:52.518278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010329+0000","last_change":"2024-05-07T14:00:59.982771+0000","last_active":"2024-05-07T14:01:07.010329+0000","last_peered":"2024-05-07T14:01:07.010329+0000","last_clean":"2024-05-07T14:01:07.010329+0000","last_became_active":"2024-05-07T14:00:59.982018+0000","last_became_peered":"2024-05-07T14:00:59.982018+0000","last_unstale":"2024-05-07T14:01:07.010329+0000","last_undegraded":"2024-05-07T14:01:07.010329+0000","last_fullsized":"2024-05-07T14:01:07.010329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:47.657483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.970711+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:01:07.970711+0000","last_peered":"2024-05-07T14:01:07.970711+0000","last_clean":"2024-05-07T14:01:07.970711+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:01:07.970711+0000","last_undegraded":"2024-05-07T14:01:07.970711+0000","last_fullsized":"2024-05-07T14:01:07.970711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.024708+0000","last_change":"2024-05-07T14:01:04.021895+0000","last_active":"2024-05-07T14:01:07.024708+0000","last_peered":"2024-05-07T14:01:07.024708+0000","last_clean":"2024-05-07T14:01:07.024708+0000","last_became_active":"2024-05-07T14:01:04.021043+0000","last_became_peered":"2024-05-07T14:01:04.021043+0000","last_unstale":"2024-05-07T14:01:07.024708+0000","last_undegraded":"2024-05-07T14:01:07.024708+0000","last_fullsized":"2024-05-07T14:01:07.024708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:58.601458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043212+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:01:07.043212+0000","last_peered":"2024-05-07T14:01:07.043212+0000","last_clean":"2024-05-07T14:01:07.043212+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:01:07.043212+0000","last_undegraded":"2024-05-07T14:01:07.043212+0000","last_fullsized":"2024-05-07T14:01:07.043212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016201+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:01:07.016201+0000","last_peered":"2024-05-07T14:01:07.016201+0000","last_clean":"2024-05-07T14:01:07.016201+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:01:07.016201+0000","last_undegraded":"2024-05-07T14:01:07.016201+0000","last_fullsized":"2024-05-07T14:01:07.016201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012063+0000","last_change":"2024-05-07T14:00:55.980488+0000","last_active":"2024-05-07T14:01:07.012063+0000","last_peered":"2024-05-07T14:01:07.012063+0000","last_clean":"2024-05-07T14:01:07.012063+0000","last_became_active":"2024-05-07T14:00:55.979688+0000","last_became_peered":"2024-05-07T14:00:55.979688+0000","last_unstale":"2024-05-07T14:01:07.012063+0000","last_undegraded":"2024-05-07T14:01:07.012063+0000","last_fullsized":"2024-05-07T14:01:07.012063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:32.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062272+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:01:07.062272+0000","last_peered":"2024-05-07T14:01:07.062272+0000","last_clean":"2024-05-07T14:01:07.062272+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:01:07.062272+0000","last_undegraded":"2024-05-07T14:01:07.062272+0000","last_fullsized":"2024-05-07T14:01:07.062272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.846471+0000","last_change":"2024-05-07T14:01:02.014265+0000","last_active":"2024-05-07T14:01:07.846471+0000","last_peered":"2024-05-07T14:01:07.846471+0000","last_clean":"2024-05-07T14:01:07.846471+0000","last_became_active":"2024-05-07T14:01:02.009335+0000","last_became_peered":"2024-05-07T14:01:02.009335+0000","last_unstale":"2024-05-07T14:01:07.846471+0000","last_undegraded":"2024-05-07T14:01:07.846471+0000","last_fullsized":"2024-05-07T14:01:07.846471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027424+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:01:07.027424+0000","last_peered":"2024-05-07T14:01:07.027424+0000","last_clean":"2024-05-07T14:01:07.027424+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:01:07.027424+0000","last_undegraded":"2024-05-07T14:01:07.027424+0000","last_fullsized":"2024-05-07T14:01:07.027424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047055+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:01:07.047055+0000","last_peered":"2024-05-07T14:01:07.047055+0000","last_clean":"2024-05-07T14:01:07.047055+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:01:07.047055+0000","last_undegraded":"2024-05-07T14:01:07.047055+0000","last_fullsized":"2024-05-07T14:01:07.047055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047036+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:01:07.047036+0000","last_peered":"2024-05-07T14:01:07.047036+0000","last_clean":"2024-05-07T14:01:07.047036+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:01:07.047036+0000","last_undegraded":"2024-05-07T14:01:07.047036+0000","last_fullsized":"2024-05-07T14:01:07.047036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.013487+0000","last_change":"2024-05-07T14:00:56.008026+0000","last_active":"2024-05-07T14:01:07.013487+0000","last_peered":"2024-05-07T14:01:07.013487+0000","last_clean":"2024-05-07T14:01:07.013487+0000","last_became_active":"2024-05-07T14:00:56.007374+0000","last_became_peered":"2024-05-07T14:00:56.007374+0000","last_unstale":"2024-05-07T14:01:07.013487+0000","last_undegraded":"2024-05-07T14:01:07.013487+0000","last_fullsized":"2024-05-07T14:01:07.013487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.063155+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:01:07.063155+0000","last_peered":"2024-05-07T14:01:07.063155+0000","last_clean":"2024-05-07T14:01:07.063155+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:01:07.063155+0000","last_undegraded":"2024-05-07T14:01:07.063155+0000","last_fullsized":"2024-05-07T14:01:07.063155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.759117+0000","last_change":"2024-05-07T14:01:01.997489+0000","last_active":"2024-05-07T14:01:07.759117+0000","last_peered":"2024-05-07T14:01:07.759117+0000","last_clean":"2024-05-07T14:01:07.759117+0000","last_became_active":"2024-05-07T14:01:01.994656+0000","last_became_peered":"2024-05-07T14:01:01.994656+0000","last_unstale":"2024-05-07T14:01:07.759117+0000","last_undegraded":"2024-05-07T14:01:07.759117+0000","last_fullsized":"2024-05-07T14:01:07.759117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:12.091721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.609523+0000","last_change":"2024-05-07T14:01:04.009157+0000","last_active":"2024-05-07T14:01:07.609523+0000","last_peered":"2024-05-07T14:01:07.609523+0000","last_clean":"2024-05-07T14:01:07.609523+0000","last_became_active":"2024-05-07T14:01:04.008594+0000","last_became_peered":"2024-05-07T14:01:04.008594+0000","last_unstale":"2024-05-07T14:01:07.609523+0000","last_undegraded":"2024-05-07T14:01:07.609523+0000","last_fullsized":"2024-05-07T14:01:07.609523+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011204+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:01:07.011204+0000","last_peered":"2024-05-07T14:01:07.011204+0000","last_clean":"2024-05-07T14:01:07.011204+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:01:07.011204+0000","last_undegraded":"2024-05-07T14:01:07.011204+0000","last_fullsized":"2024-05-07T14:01:07.011204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012761+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:01:07.012761+0000","last_peered":"2024-05-07T14:01:07.012761+0000","last_clean":"2024-05-07T14:01:07.012761+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:01:07.012761+0000","last_undegraded":"2024-05-07T14:01:07.012761+0000","last_fullsized":"2024-05-07T14:01:07.012761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044345+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:01:07.044345+0000","last_peered":"2024-05-07T14:01:07.044345+0000","last_clean":"2024-05-07T14:01:07.044345+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:01:07.044345+0000","last_undegraded":"2024-05-07T14:01:07.044345+0000","last_fullsized":"2024-05-07T14:01:07.044345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062667+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:01:07.062667+0000","last_peered":"2024-05-07T14:01:07.062667+0000","last_clean":"2024-05-07T14:01:07.062667+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:01:07.062667+0000","last_undegraded":"2024-05-07T14:01:07.062667+0000","last_fullsized":"2024-05-07T14:01:07.062667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.384403+0000","last_change":"2024-05-07T14:01:01.995144+0000","last_active":"2024-05-07T14:01:07.384403+0000","last_peered":"2024-05-07T14:01:07.384403+0000","last_clean":"2024-05-07T14:01:07.384403+0000","last_became_active":"2024-05-07T14:01:01.993073+0000","last_became_peered":"2024-05-07T14:01:01.993073+0000","last_unstale":"2024-05-07T14:01:07.384403+0000","last_undegraded":"2024-05-07T14:01:07.384403+0000","last_fullsized":"2024-05-07T14:01:07.384403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:54.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062104+0000","last_change":"2024-05-07T14:01:04.012216+0000","last_active":"2024-05-07T14:01:07.062104+0000","last_peered":"2024-05-07T14:01:07.062104+0000","last_clean":"2024-05-07T14:01:07.062104+0000","last_became_active":"2024-05-07T14:01:04.011476+0000","last_became_peered":"2024-05-07T14:01:04.011476+0000","last_unstale":"2024-05-07T14:01:07.062104+0000","last_undegraded":"2024-05-07T14:01:07.062104+0000","last_fullsized":"2024-05-07T14:01:07.062104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:46.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027274+0000","last_change":"2024-05-07T14:01:06.024311+0000","last_active":"2024-05-07T14:01:07.027274+0000","last_peered":"2024-05-07T14:01:07.027274+0000","last_clean":"2024-05-07T14:01:07.027274+0000","last_became_active":"2024-05-07T14:01:06.023404+0000","last_became_peered":"2024-05-07T14:01:06.023404+0000","last_unstale":"2024-05-07T14:01:07.027274+0000","last_undegraded":"2024-05-07T14:01:07.027274+0000","last_fullsized":"2024-05-07T14:01:07.027274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:26.544302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015168+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:01:07.015168+0000","last_peered":"2024-05-07T14:01:07.015168+0000","last_clean":"2024-05-07T14:01:07.015168+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:01:07.015168+0000","last_undegraded":"2024-05-07T14:01:07.015168+0000","last_fullsized":"2024-05-07T14:01:07.015168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027553+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:01:07.027553+0000","last_peered":"2024-05-07T14:01:07.027553+0000","last_clean":"2024-05-07T14:01:07.027553+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:01:07.027553+0000","last_undegraded":"2024-05-07T14:01:07.027553+0000","last_fullsized":"2024-05-07T14:01:07.027553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062994+0000","last_change":"2024-05-07T14:00:59.992897+0000","last_active":"2024-05-07T14:01:07.062994+0000","last_peered":"2024-05-07T14:01:07.062994+0000","last_clean":"2024-05-07T14:01:07.062994+0000","last_became_active":"2024-05-07T14:00:59.992067+0000","last_became_peered":"2024-05-07T14:00:59.992067+0000","last_unstale":"2024-05-07T14:01:07.062994+0000","last_undegraded":"2024-05-07T14:01:07.062994+0000","last_fullsized":"2024-05-07T14:01:07.062994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:19.526884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.906371+0000","last_change":"2024-05-07T14:01:02.012335+0000","last_active":"2024-05-07T14:01:07.906371+0000","last_peered":"2024-05-07T14:01:07.906371+0000","last_clean":"2024-05-07T14:01:07.906371+0000","last_became_active":"2024-05-07T14:01:02.011651+0000","last_became_peered":"2024-05-07T14:01:02.011651+0000","last_unstale":"2024-05-07T14:01:07.906371+0000","last_undegraded":"2024-05-07T14:01:07.906371+0000","last_fullsized":"2024-05-07T14:01:07.906371+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011489+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:01:07.011489+0000","last_peered":"2024-05-07T14:01:07.011489+0000","last_clean":"2024-05-07T14:01:07.011489+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:01:07.011489+0000","last_undegraded":"2024-05-07T14:01:07.011489+0000","last_fullsized":"2024-05-07T14:01:07.011489+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027519+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:01:07.027519+0000","last_peered":"2024-05-07T14:01:07.027519+0000","last_clean":"2024-05-07T14:01:07.027519+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:01:07.027519+0000","last_undegraded":"2024-05-07T14:01:07.027519+0000","last_fullsized":"2024-05-07T14:01:07.027519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015273+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:01:07.015273+0000","last_peered":"2024-05-07T14:01:07.015273+0000","last_clean":"2024-05-07T14:01:07.015273+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:01:07.015273+0000","last_undegraded":"2024-05-07T14:01:07.015273+0000","last_fullsized":"2024-05-07T14:01:07.015273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047206+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:01:07.047206+0000","last_peered":"2024-05-07T14:01:07.047206+0000","last_clean":"2024-05-07T14:01:07.047206+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:01:07.047206+0000","last_undegraded":"2024-05-07T14:01:07.047206+0000","last_fullsized":"2024-05-07T14:01:07.047206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025080+0000","last_change":"2024-05-07T14:01:00.006802+0000","last_active":"2024-05-07T14:01:07.025080+0000","last_peered":"2024-05-07T14:01:07.025080+0000","last_clean":"2024-05-07T14:01:07.025080+0000","last_became_active":"2024-05-07T14:01:00.006254+0000","last_became_peered":"2024-05-07T14:01:00.006254+0000","last_unstale":"2024-05-07T14:01:07.025080+0000","last_undegraded":"2024-05-07T14:01:07.025080+0000","last_fullsized":"2024-05-07T14:01:07.025080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:40.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.978085+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:01:07.978085+0000","last_peered":"2024-05-07T14:01:07.978085+0000","last_clean":"2024-05-07T14:01:07.978085+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:01:07.978085+0000","last_undegraded":"2024-05-07T14:01:07.978085+0000","last_fullsized":"2024-05-07T14:01:07.978085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.605265+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:01:07.605265+0000","last_peered":"2024-05-07T14:01:07.605265+0000","last_clean":"2024-05-07T14:01:07.605265+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:01:07.605265+0000","last_undegraded":"2024-05-07T14:01:07.605265+0000","last_fullsized":"2024-05-07T14:01:07.605265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.024360+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:01:07.024360+0000","last_peered":"2024-05-07T14:01:07.024360+0000","last_clean":"2024-05-07T14:01:07.024360+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:01:07.024360+0000","last_undegraded":"2024-05-07T14:01:07.024360+0000","last_fullsized":"2024-05-07T14:01:07.024360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015867+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:01:07.015867+0000","last_peered":"2024-05-07T14:01:07.015867+0000","last_clean":"2024-05-07T14:01:07.015867+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:01:07.015867+0000","last_undegraded":"2024-05-07T14:01:07.015867+0000","last_fullsized":"2024-05-07T14:01:07.015867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.017024+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:01:07.017024+0000","last_peered":"2024-05-07T14:01:07.017024+0000","last_clean":"2024-05-07T14:01:07.017024+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:01:07.017024+0000","last_undegraded":"2024-05-07T14:01:07.017024+0000","last_fullsized":"2024-05-07T14:01:07.017024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043523+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:01:07.043523+0000","last_peered":"2024-05-07T14:01:07.043523+0000","last_clean":"2024-05-07T14:01:07.043523+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:01:07.043523+0000","last_undegraded":"2024-05-07T14:01:07.043523+0000","last_fullsized":"2024-05-07T14:01:07.043523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.766658+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:01:07.766658+0000","last_peered":"2024-05-07T14:01:07.766658+0000","last_clean":"2024-05-07T14:01:07.766658+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:01:07.766658+0000","last_undegraded":"2024-05-07T14:01:07.766658+0000","last_fullsized":"2024-05-07T14:01:07.766658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.599506+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:01:07.599506+0000","last_peered":"2024-05-07T14:01:07.599506+0000","last_clean":"2024-05-07T14:01:07.599506+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:01:07.599506+0000","last_undegraded":"2024-05-07T14:01:07.599506+0000","last_fullsized":"2024-05-07T14:01:07.599506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015025+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:01:07.015025+0000","last_peered":"2024-05-07T14:01:07.015025+0000","last_clean":"2024-05-07T14:01:07.015025+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:01:07.015025+0000","last_undegraded":"2024-05-07T14:01:07.015025+0000","last_fullsized":"2024-05-07T14:01:07.015025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027946+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:01:07.027946+0000","last_peered":"2024-05-07T14:01:07.027946+0000","last_clean":"2024-05-07T14:01:07.027946+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:01:07.027946+0000","last_undegraded":"2024-05-07T14:01:07.027946+0000","last_fullsized":"2024-05-07T14:01:07.027946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028479+0000","last_change":"2024-05-07T14:00:55.974435+0000","last_active":"2024-05-07T14:01:07.028479+0000","last_peered":"2024-05-07T14:01:07.028479+0000","last_clean":"2024-05-07T14:01:07.028479+0000","last_became_active":"2024-05-07T14:00:55.974010+0000","last_became_peered":"2024-05-07T14:00:55.974010+0000","last_unstale":"2024-05-07T14:01:07.028479+0000","last_undegraded":"2024-05-07T14:01:07.028479+0000","last_fullsized":"2024-05-07T14:01:07.028479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015346+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:01:07.015346+0000","last_peered":"2024-05-07T14:01:07.015346+0000","last_clean":"2024-05-07T14:01:07.015346+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:01:07.015346+0000","last_undegraded":"2024-05-07T14:01:07.015346+0000","last_fullsized":"2024-05-07T14:01:07.015346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.899408+0000","last_change":"2024-05-07T14:01:02.013314+0000","last_active":"2024-05-07T14:01:07.899408+0000","last_peered":"2024-05-07T14:01:07.899408+0000","last_clean":"2024-05-07T14:01:07.899408+0000","last_became_active":"2024-05-07T14:01:02.012667+0000","last_became_peered":"2024-05-07T14:01:02.012667+0000","last_unstale":"2024-05-07T14:01:07.899408+0000","last_undegraded":"2024-05-07T14:01:07.899408+0000","last_fullsized":"2024-05-07T14:01:07.899408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046713+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:01:07.046713+0000","last_peered":"2024-05-07T14:01:07.046713+0000","last_clean":"2024-05-07T14:01:07.046713+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:01:07.046713+0000","last_undegraded":"2024-05-07T14:01:07.046713+0000","last_fullsized":"2024-05-07T14:01:07.046713+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028645+0000","last_change":"2024-05-07T14:01:06.031381+0000","last_active":"2024-05-07T14:01:07.028645+0000","last_peered":"2024-05-07T14:01:07.028645+0000","last_clean":"2024-05-07T14:01:07.028645+0000","last_became_active":"2024-05-07T14:01:06.030958+0000","last_became_peered":"2024-05-07T14:01:06.030958+0000","last_unstale":"2024-05-07T14:01:07.028645+0000","last_undegraded":"2024-05-07T14:01:07.028645+0000","last_fullsized":"2024-05-07T14:01:07.028645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:26.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047350+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:01:07.047350+0000","last_peered":"2024-05-07T14:01:07.047350+0000","last_clean":"2024-05-07T14:01:07.047350+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:01:07.047350+0000","last_undegraded":"2024-05-07T14:01:07.047350+0000","last_fullsized":"2024-05-07T14:01:07.047350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011084+0000","last_change":"2024-05-07T14:00:45.460158+0000","last_active":"2024-05-07T14:01:07.011084+0000","last_peered":"2024-05-07T14:01:07.011084+0000","last_clean":"2024-05-07T14:01:07.011084+0000","last_became_active":"2024-05-07T14:00:45.458198+0000","last_became_peered":"2024-05-07T14:00:45.458198+0000","last_unstale":"2024-05-07T14:01:07.011084+0000","last_undegraded":"2024-05-07T14:01:07.011084+0000","last_fullsized":"2024-05-07T14:01:07.011084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:18.582514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043517+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:01:07.043517+0000","last_peered":"2024-05-07T14:01:07.043517+0000","last_clean":"2024-05-07T14:01:07.043517+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:01:07.043517+0000","last_undegraded":"2024-05-07T14:01:07.043517+0000","last_fullsized":"2024-05-07T14:01:07.043517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028148+0000","last_change":"2024-05-07T14:00:56.012396+0000","last_active":"2024-05-07T14:01:07.028148+0000","last_peered":"2024-05-07T14:01:07.028148+0000","last_clean":"2024-05-07T14:01:07.028148+0000","last_became_active":"2024-05-07T14:00:56.012053+0000","last_became_peered":"2024-05-07T14:00:56.012053+0000","last_unstale":"2024-05-07T14:01:07.028148+0000","last_undegraded":"2024-05-07T14:01:07.028148+0000","last_fullsized":"2024-05-07T14:01:07.028148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011594+0000","last_change":"2024-05-07T14:00:59.988489+0000","last_active":"2024-05-07T14:01:07.011594+0000","last_peered":"2024-05-07T14:01:07.011594+0000","last_clean":"2024-05-07T14:01:07.011594+0000","last_became_active":"2024-05-07T14:00:59.987757+0000","last_became_peered":"2024-05-07T14:00:59.987757+0000","last_unstale":"2024-05-07T14:01:07.011594+0000","last_undegraded":"2024-05-07T14:01:07.011594+0000","last_fullsized":"2024-05-07T14:01:07.011594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.696329+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:01:07.696329+0000","last_peered":"2024-05-07T14:01:07.696329+0000","last_clean":"2024-05-07T14:01:07.696329+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:01:07.696329+0000","last_undegraded":"2024-05-07T14:01:07.696329+0000","last_fullsized":"2024-05-07T14:01:07.696329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011060+0000","last_change":"2024-05-07T14:01:04.007712+0000","last_active":"2024-05-07T14:01:07.011060+0000","last_peered":"2024-05-07T14:01:07.011060+0000","last_clean":"2024-05-07T14:01:07.011060+0000","last_became_active":"2024-05-07T14:01:04.006934+0000","last_became_peered":"2024-05-07T14:01:04.006934+0000","last_unstale":"2024-05-07T14:01:07.011060+0000","last_undegraded":"2024-05-07T14:01:07.011060+0000","last_fullsized":"2024-05-07T14:01:07.011060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046200+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:01:07.046200+0000","last_peered":"2024-05-07T14:01:07.046200+0000","last_clean":"2024-05-07T14:01:07.046200+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:01:07.046200+0000","last_undegraded":"2024-05-07T14:01:07.046200+0000","last_fullsized":"2024-05-07T14:01:07.046200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011461+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:01:07.011461+0000","last_peered":"2024-05-07T14:01:07.011461+0000","last_clean":"2024-05-07T14:01:07.011461+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:01:07.011461+0000","last_undegraded":"2024-05-07T14:01:07.011461+0000","last_fullsized":"2024-05-07T14:01:07.011461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010651+0000","last_change":"2024-05-07T14:00:49.930222+0000","last_active":"2024-05-07T14:01:07.010651+0000","last_peered":"2024-05-07T14:01:07.010651+0000","last_clean":"2024-05-07T14:01:07.010651+0000","last_became_active":"2024-05-07T14:00:49.929538+0000","last_became_peered":"2024-05-07T14:00:49.929538+0000","last_unstale":"2024-05-07T14:01:07.010651+0000","last_undegraded":"2024-05-07T14:01:07.010651+0000","last_fullsized":"2024-05-07T14:01:07.010651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:43.069683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010102+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:01:07.010102+0000","last_peered":"2024-05-07T14:01:07.010102+0000","last_clean":"2024-05-07T14:01:07.010102+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:01:07.010102+0000","last_undegraded":"2024-05-07T14:01:07.010102+0000","last_fullsized":"2024-05-07T14:01:07.010102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044653+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:01:07.044653+0000","last_peered":"2024-05-07T14:01:07.044653+0000","last_clean":"2024-05-07T14:01:07.044653+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:01:07.044653+0000","last_undegraded":"2024-05-07T14:01:07.044653+0000","last_fullsized":"2024-05-07T14:01:07.044653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.889465+0000","last_change":"2024-05-07T14:01:02.014645+0000","last_active":"2024-05-07T14:01:07.889465+0000","last_peered":"2024-05-07T14:01:07.889465+0000","last_clean":"2024-05-07T14:01:07.889465+0000","last_became_active":"2024-05-07T14:01:02.013904+0000","last_became_peered":"2024-05-07T14:01:02.013904+0000","last_unstale":"2024-05-07T14:01:07.889465+0000","last_undegraded":"2024-05-07T14:01:07.889465+0000","last_fullsized":"2024-05-07T14:01:07.889465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:31.441743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012459+0000","last_change":"2024-05-07T14:01:04.012527+0000","last_active":"2024-05-07T14:01:07.012459+0000","last_peered":"2024-05-07T14:01:07.012459+0000","last_clean":"2024-05-07T14:01:07.012459+0000","last_became_active":"2024-05-07T14:01:04.007658+0000","last_became_peered":"2024-05-07T14:01:04.007658+0000","last_unstale":"2024-05-07T14:01:07.012459+0000","last_undegraded":"2024-05-07T14:01:07.012459+0000","last_fullsized":"2024-05-07T14:01:07.012459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.024301+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:01:07.024301+0000","last_peered":"2024-05-07T14:01:07.024301+0000","last_clean":"2024-05-07T14:01:07.024301+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:01:07.024301+0000","last_undegraded":"2024-05-07T14:01:07.024301+0000","last_fullsized":"2024-05-07T14:01:07.024301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028167+0000","last_change":"2024-05-07T14:00:57.989314+0000","last_active":"2024-05-07T14:01:07.028167+0000","last_peered":"2024-05-07T14:01:07.028167+0000","last_clean":"2024-05-07T14:01:07.028167+0000","last_became_active":"2024-05-07T14:00:57.988994+0000","last_became_peered":"2024-05-07T14:00:57.988994+0000","last_unstale":"2024-05-07T14:01:07.028167+0000","last_undegraded":"2024-05-07T14:01:07.028167+0000","last_fullsized":"2024-05-07T14:01:07.028167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062525+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:01:07.062525+0000","last_peered":"2024-05-07T14:01:07.062525+0000","last_clean":"2024-05-07T14:01:07.062525+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:01:07.062525+0000","last_undegraded":"2024-05-07T14:01:07.062525+0000","last_fullsized":"2024-05-07T14:01:07.062525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.023960+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:01:07.023960+0000","last_peered":"2024-05-07T14:01:07.023960+0000","last_clean":"2024-05-07T14:01:07.023960+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:01:07.023960+0000","last_undegraded":"2024-05-07T14:01:07.023960+0000","last_fullsized":"2024-05-07T14:01:07.023960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.063525+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:01:07.063525+0000","last_peered":"2024-05-07T14:01:07.063525+0000","last_clean":"2024-05-07T14:01:07.063525+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:01:07.063525+0000","last_undegraded":"2024-05-07T14:01:07.063525+0000","last_fullsized":"2024-05-07T14:01:07.063525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.895494+0000","last_change":"2024-05-07T14:01:02.148182+0000","last_active":"2024-05-07T14:01:07.895494+0000","last_peered":"2024-05-07T14:01:07.895494+0000","last_clean":"2024-05-07T14:01:07.895494+0000","last_became_active":"2024-05-07T14:01:02.147442+0000","last_became_peered":"2024-05-07T14:01:02.147442+0000","last_unstale":"2024-05-07T14:01:07.895494+0000","last_undegraded":"2024-05-07T14:01:07.895494+0000","last_fullsized":"2024-05-07T14:01:07.895494+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:24.955989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010197+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:01:07.010197+0000","last_peered":"2024-05-07T14:01:07.010197+0000","last_clean":"2024-05-07T14:01:07.010197+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:01:07.010197+0000","last_undegraded":"2024-05-07T14:01:07.010197+0000","last_fullsized":"2024-05-07T14:01:07.010197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029153+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:01:07.029153+0000","last_peered":"2024-05-07T14:01:07.029153+0000","last_clean":"2024-05-07T14:01:07.029153+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:01:07.029153+0000","last_undegraded":"2024-05-07T14:01:07.029153+0000","last_fullsized":"2024-05-07T14:01:07.029153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025593+0000","last_change":"2024-05-07T14:00:57.997894+0000","last_active":"2024-05-07T14:01:07.025593+0000","last_peered":"2024-05-07T14:01:07.025593+0000","last_clean":"2024-05-07T14:01:07.025593+0000","last_became_active":"2024-05-07T14:00:57.997336+0000","last_became_peered":"2024-05-07T14:00:57.997336+0000","last_unstale":"2024-05-07T14:01:07.025593+0000","last_undegraded":"2024-05-07T14:01:07.025593+0000","last_fullsized":"2024-05-07T14:01:07.025593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044124+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:01:07.044124+0000","last_peered":"2024-05-07T14:01:07.044124+0000","last_clean":"2024-05-07T14:01:07.044124+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:01:07.044124+0000","last_undegraded":"2024-05-07T14:01:07.044124+0000","last_fullsized":"2024-05-07T14:01:07.044124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016572+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:01:07.016572+0000","last_peered":"2024-05-07T14:01:07.016572+0000","last_clean":"2024-05-07T14:01:07.016572+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:01:07.016572+0000","last_undegraded":"2024-05-07T14:01:07.016572+0000","last_fullsized":"2024-05-07T14:01:07.016572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010509+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:01:07.010509+0000","last_peered":"2024-05-07T14:01:07.010509+0000","last_clean":"2024-05-07T14:01:07.010509+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:01:07.010509+0000","last_undegraded":"2024-05-07T14:01:07.010509+0000","last_fullsized":"2024-05-07T14:01:07.010509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.731049+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:01:07.731049+0000","last_peered":"2024-05-07T14:01:07.731049+0000","last_clean":"2024-05-07T14:01:07.731049+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:01:07.731049+0000","last_undegraded":"2024-05-07T14:01:07.731049+0000","last_fullsized":"2024-05-07T14:01:07.731049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047626+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:01:07.047626+0000","last_peered":"2024-05-07T14:01:07.047626+0000","last_clean":"2024-05-07T14:01:07.047626+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:01:07.047626+0000","last_undegraded":"2024-05-07T14:01:07.047626+0000","last_fullsized":"2024-05-07T14:01:07.047626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.041987+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:01:07.041987+0000","last_peered":"2024-05-07T14:01:07.041987+0000","last_clean":"2024-05-07T14:01:07.041987+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:01:07.041987+0000","last_undegraded":"2024-05-07T14:01:07.041987+0000","last_fullsized":"2024-05-07T14:01:07.041987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025204+0000","last_change":"2024-05-07T14:00:57.989747+0000","last_active":"2024-05-07T14:01:07.025204+0000","last_peered":"2024-05-07T14:01:07.025204+0000","last_clean":"2024-05-07T14:01:07.025204+0000","last_became_active":"2024-05-07T14:00:57.989252+0000","last_became_peered":"2024-05-07T14:00:57.989252+0000","last_unstale":"2024-05-07T14:01:07.025204+0000","last_undegraded":"2024-05-07T14:01:07.025204+0000","last_fullsized":"2024-05-07T14:01:07.025204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:44.815601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044687+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:01:07.044687+0000","last_peered":"2024-05-07T14:01:07.044687+0000","last_clean":"2024-05-07T14:01:07.044687+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:01:07.044687+0000","last_undegraded":"2024-05-07T14:01:07.044687+0000","last_fullsized":"2024-05-07T14:01:07.044687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025917+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:01:07.025917+0000","last_peered":"2024-05-07T14:01:07.025917+0000","last_clean":"2024-05-07T14:01:07.025917+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:01:07.025917+0000","last_undegraded":"2024-05-07T14:01:07.025917+0000","last_fullsized":"2024-05-07T14:01:07.025917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011317+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:01:07.011317+0000","last_peered":"2024-05-07T14:01:07.011317+0000","last_clean":"2024-05-07T14:01:07.011317+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:01:07.011317+0000","last_undegraded":"2024-05-07T14:01:07.011317+0000","last_fullsized":"2024-05-07T14:01:07.011317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.824750+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:01:07.824750+0000","last_peered":"2024-05-07T14:01:07.824750+0000","last_clean":"2024-05-07T14:01:07.824750+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:01:07.824750+0000","last_undegraded":"2024-05-07T14:01:07.824750+0000","last_fullsized":"2024-05-07T14:01:07.824750+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015390+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:01:07.015390+0000","last_peered":"2024-05-07T14:01:07.015390+0000","last_clean":"2024-05-07T14:01:07.015390+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:01:07.015390+0000","last_undegraded":"2024-05-07T14:01:07.015390+0000","last_fullsized":"2024-05-07T14:01:07.015390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010327+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:01:07.010327+0000","last_peered":"2024-05-07T14:01:07.010327+0000","last_clean":"2024-05-07T14:01:07.010327+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:01:07.010327+0000","last_undegraded":"2024-05-07T14:01:07.010327+0000","last_fullsized":"2024-05-07T14:01:07.010327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012686+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:01:07.012686+0000","last_peered":"2024-05-07T14:01:07.012686+0000","last_clean":"2024-05-07T14:01:07.012686+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:01:07.012686+0000","last_undegraded":"2024-05-07T14:01:07.012686+0000","last_fullsized":"2024-05-07T14:01:07.012686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025694+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:01:07.025694+0000","last_peered":"2024-05-07T14:01:07.025694+0000","last_clean":"2024-05-07T14:01:07.025694+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:01:07.025694+0000","last_undegraded":"2024-05-07T14:01:07.025694+0000","last_fullsized":"2024-05-07T14:01:07.025694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.013737+0000","last_change":"2024-05-07T14:00:49.928907+0000","last_active":"2024-05-07T14:01:07.013737+0000","last_peered":"2024-05-07T14:01:07.013737+0000","last_clean":"2024-05-07T14:01:07.013737+0000","last_became_active":"2024-05-07T14:00:49.928146+0000","last_became_peered":"2024-05-07T14:00:49.928146+0000","last_unstale":"2024-05-07T14:01:07.013737+0000","last_undegraded":"2024-05-07T14:01:07.013737+0000","last_fullsized":"2024-05-07T14:01:07.013737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:07.032835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046678+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:01:07.046678+0000","last_peered":"2024-05-07T14:01:07.046678+0000","last_clean":"2024-05-07T14:01:07.046678+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:01:07.046678+0000","last_undegraded":"2024-05-07T14:01:07.046678+0000","last_fullsized":"2024-05-07T14:01:07.046678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.922042+0000","last_change":"2024-05-07T14:01:02.148499+0000","last_active":"2024-05-07T14:01:07.922042+0000","last_peered":"2024-05-07T14:01:07.922042+0000","last_clean":"2024-05-07T14:01:07.922042+0000","last_became_active":"2024-05-07T14:01:02.147567+0000","last_became_peered":"2024-05-07T14:01:02.147567+0000","last_unstale":"2024-05-07T14:01:07.922042+0000","last_undegraded":"2024-05-07T14:01:07.922042+0000","last_fullsized":"2024-05-07T14:01:07.922042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:30.162886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.596630+0000","last_change":"2024-05-07T14:01:04.015930+0000","last_active":"2024-05-07T14:01:07.596630+0000","last_peered":"2024-05-07T14:01:07.596630+0000","last_clean":"2024-05-07T14:01:07.596630+0000","last_became_active":"2024-05-07T14:01:04.011643+0000","last_became_peered":"2024-05-07T14:01:04.011643+0000","last_unstale":"2024-05-07T14:01:07.596630+0000","last_undegraded":"2024-05-07T14:01:07.596630+0000","last_fullsized":"2024-05-07T14:01:07.596630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.032232+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:01:07.032232+0000","last_peered":"2024-05-07T14:01:07.032232+0000","last_clean":"2024-05-07T14:01:07.032232+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:01:07.032232+0000","last_undegraded":"2024-05-07T14:01:07.032232+0000","last_fullsized":"2024-05-07T14:01:07.032232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027842+0000","last_change":"2024-05-07T14:00:57.998539+0000","last_active":"2024-05-07T14:01:07.027842+0000","last_peered":"2024-05-07T14:01:07.027842+0000","last_clean":"2024-05-07T14:01:07.027842+0000","last_became_active":"2024-05-07T14:00:57.998025+0000","last_became_peered":"2024-05-07T14:00:57.998025+0000","last_unstale":"2024-05-07T14:01:07.027842+0000","last_undegraded":"2024-05-07T14:01:07.027842+0000","last_fullsized":"2024-05-07T14:01:07.027842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.031493+0000","last_change":"2024-05-07T14:00:55.988508+0000","last_active":"2024-05-07T14:01:07.031493+0000","last_peered":"2024-05-07T14:01:07.031493+0000","last_clean":"2024-05-07T14:01:07.031493+0000","last_became_active":"2024-05-07T14:00:55.988230+0000","last_became_peered":"2024-05-07T14:00:55.988230+0000","last_unstale":"2024-05-07T14:01:07.031493+0000","last_undegraded":"2024-05-07T14:01:07.031493+0000","last_fullsized":"2024-05-07T14:01:07.031493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.026724+0000","last_change":"2024-05-07T14:00:49.936072+0000","last_active":"2024-05-07T14:01:07.026724+0000","last_peered":"2024-05-07T14:01:07.026724+0000","last_clean":"2024-05-07T14:01:07.026724+0000","last_became_active":"2024-05-07T14:00:49.935768+0000","last_became_peered":"2024-05-07T14:00:49.935768+0000","last_unstale":"2024-05-07T14:01:07.026724+0000","last_undegraded":"2024-05-07T14:01:07.026724+0000","last_fullsized":"2024-05-07T14:01:07.026724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015170+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:01:07.015170+0000","last_peered":"2024-05-07T14:01:07.015170+0000","last_clean":"2024-05-07T14:01:07.015170+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:01:07.015170+0000","last_undegraded":"2024-05-07T14:01:07.015170+0000","last_fullsized":"2024-05-07T14:01:07.015170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.878366+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:01:07.878366+0000","last_peered":"2024-05-07T14:01:07.878366+0000","last_clean":"2024-05-07T14:01:07.878366+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:01:07.878366+0000","last_undegraded":"2024-05-07T14:01:07.878366+0000","last_fullsized":"2024-05-07T14:01:07.878366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.603991+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:01:07.603991+0000","last_peered":"2024-05-07T14:01:07.603991+0000","last_clean":"2024-05-07T14:01:07.603991+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:01:07.603991+0000","last_undegraded":"2024-05-07T14:01:07.603991+0000","last_fullsized":"2024-05-07T14:01:07.603991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010600+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:01:07.010600+0000","last_peered":"2024-05-07T14:01:07.010600+0000","last_clean":"2024-05-07T14:01:07.010600+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:01:07.010600+0000","last_undegraded":"2024-05-07T14:01:07.010600+0000","last_fullsized":"2024-05-07T14:01:07.010600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016763+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:01:07.016763+0000","last_peered":"2024-05-07T14:01:07.016763+0000","last_clean":"2024-05-07T14:01:07.016763+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:01:07.016763+0000","last_undegraded":"2024-05-07T14:01:07.016763+0000","last_fullsized":"2024-05-07T14:01:07.016763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012426+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:01:07.012426+0000","last_peered":"2024-05-07T14:01:07.012426+0000","last_clean":"2024-05-07T14:01:07.012426+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:01:07.012426+0000","last_undegraded":"2024-05-07T14:01:07.012426+0000","last_fullsized":"2024-05-07T14:01:07.012426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.048093+0000","last_change":"2024-05-07T14:00:49.938879+0000","last_active":"2024-05-07T14:01:07.048093+0000","last_peered":"2024-05-07T14:01:07.048093+0000","last_clean":"2024-05-07T14:01:07.048093+0000","last_became_active":"2024-05-07T14:00:49.938066+0000","last_became_peered":"2024-05-07T14:00:49.938066+0000","last_unstale":"2024-05-07T14:01:07.048093+0000","last_undegraded":"2024-05-07T14:01:07.048093+0000","last_fullsized":"2024-05-07T14:01:07.048093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027538+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:01:07.027538+0000","last_peered":"2024-05-07T14:01:07.027538+0000","last_clean":"2024-05-07T14:01:07.027538+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:01:07.027538+0000","last_undegraded":"2024-05-07T14:01:07.027538+0000","last_fullsized":"2024-05-07T14:01:07.027538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.858831+0000","last_change":"2024-05-07T14:01:02.148095+0000","last_active":"2024-05-07T14:01:07.858831+0000","last_peered":"2024-05-07T14:01:07.858831+0000","last_clean":"2024-05-07T14:01:07.858831+0000","last_became_active":"2024-05-07T14:01:02.147334+0000","last_became_peered":"2024-05-07T14:01:02.147334+0000","last_unstale":"2024-05-07T14:01:07.858831+0000","last_undegraded":"2024-05-07T14:01:07.858831+0000","last_fullsized":"2024-05-07T14:01:07.858831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027574+0000","last_change":"2024-05-07T14:01:04.024279+0000","last_active":"2024-05-07T14:01:07.027574+0000","last_peered":"2024-05-07T14:01:07.027574+0000","last_clean":"2024-05-07T14:01:07.027574+0000","last_became_active":"2024-05-07T14:01:04.022870+0000","last_became_peered":"2024-05-07T14:01:04.022870+0000","last_unstale":"2024-05-07T14:01:07.027574+0000","last_undegraded":"2024-05-07T14:01:07.027574+0000","last_fullsized":"2024-05-07T14:01:07.027574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:28.158572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043139+0000","last_change":"2024-05-07T14:01:06.039788+0000","last_active":"2024-05-07T14:01:07.043139+0000","last_peered":"2024-05-07T14:01:07.043139+0000","last_clean":"2024-05-07T14:01:07.043139+0000","last_became_active":"2024-05-07T14:01:06.039050+0000","last_became_peered":"2024-05-07T14:01:06.039050+0000","last_unstale":"2024-05-07T14:01:07.043139+0000","last_undegraded":"2024-05-07T14:01:07.043139+0000","last_fullsized":"2024-05-07T14:01:07.043139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011353+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:01:07.011353+0000","last_peered":"2024-05-07T14:01:07.011353+0000","last_clean":"2024-05-07T14:01:07.011353+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:01:07.011353+0000","last_undegraded":"2024-05-07T14:01:07.011353+0000","last_fullsized":"2024-05-07T14:01:07.011353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015772+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:01:07.015772+0000","last_peered":"2024-05-07T14:01:07.015772+0000","last_clean":"2024-05-07T14:01:07.015772+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:01:07.015772+0000","last_undegraded":"2024-05-07T14:01:07.015772+0000","last_fullsized":"2024-05-07T14:01:07.015772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014291+0000","last_change":"2024-05-07T14:00:55.991934+0000","last_active":"2024-05-07T14:01:07.014291+0000","last_peered":"2024-05-07T14:01:07.014291+0000","last_clean":"2024-05-07T14:01:07.014291+0000","last_became_active":"2024-05-07T14:00:55.991303+0000","last_became_peered":"2024-05-07T14:00:55.991303+0000","last_unstale":"2024-05-07T14:01:07.014291+0000","last_undegraded":"2024-05-07T14:01:07.014291+0000","last_fullsized":"2024-05-07T14:01:07.014291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025589+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:01:07.025589+0000","last_peered":"2024-05-07T14:01:07.025589+0000","last_clean":"2024-05-07T14:01:07.025589+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:01:07.025589+0000","last_undegraded":"2024-05-07T14:01:07.025589+0000","last_fullsized":"2024-05-07T14:01:07.025589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.929409+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:01:07.929409+0000","last_peered":"2024-05-07T14:01:07.929409+0000","last_clean":"2024-05-07T14:01:07.929409+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:01:07.929409+0000","last_undegraded":"2024-05-07T14:01:07.929409+0000","last_fullsized":"2024-05-07T14:01:07.929409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027227+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:01:07.027227+0000","last_peered":"2024-05-07T14:01:07.027227+0000","last_clean":"2024-05-07T14:01:07.027227+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:01:07.027227+0000","last_undegraded":"2024-05-07T14:01:07.027227+0000","last_fullsized":"2024-05-07T14:01:07.027227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029856+0000","last_change":"2024-05-07T14:01:06.013974+0000","last_active":"2024-05-07T14:01:07.029856+0000","last_peered":"2024-05-07T14:01:07.029856+0000","last_clean":"2024-05-07T14:01:07.029856+0000","last_became_active":"2024-05-07T14:01:06.013281+0000","last_became_peered":"2024-05-07T14:01:06.013281+0000","last_unstale":"2024-05-07T14:01:07.029856+0000","last_undegraded":"2024-05-07T14:01:07.029856+0000","last_fullsized":"2024-05-07T14:01:07.029856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:46.349394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.024954+0000","last_change":"2024-05-07T14:00:58.001752+0000","last_active":"2024-05-07T14:01:07.024954+0000","last_peered":"2024-05-07T14:01:07.024954+0000","last_clean":"2024-05-07T14:01:07.024954+0000","last_became_active":"2024-05-07T14:00:57.999982+0000","last_became_peered":"2024-05-07T14:00:57.999982+0000","last_unstale":"2024-05-07T14:01:07.024954+0000","last_undegraded":"2024-05-07T14:01:07.024954+0000","last_fullsized":"2024-05-07T14:01:07.024954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.013312+0000","last_change":"2024-05-07T14:00:55.968287+0000","last_active":"2024-05-07T14:01:07.013312+0000","last_peered":"2024-05-07T14:01:07.013312+0000","last_clean":"2024-05-07T14:01:07.013312+0000","last_became_active":"2024-05-07T14:00:55.967578+0000","last_became_peered":"2024-05-07T14:00:55.967578+0000","last_unstale":"2024-05-07T14:01:07.013312+0000","last_undegraded":"2024-05-07T14:01:07.013312+0000","last_fullsized":"2024-05-07T14:01:07.013312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028727+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:01:07.028727+0000","last_peered":"2024-05-07T14:01:07.028727+0000","last_clean":"2024-05-07T14:01:07.028727+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:01:07.028727+0000","last_undegraded":"2024-05-07T14:01:07.028727+0000","last_fullsized":"2024-05-07T14:01:07.028727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'4","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.392985+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:01:07.392985+0000","last_peered":"2024-05-07T14:01:07.392985+0000","last_clean":"2024-05-07T14:01:07.392985+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:01:07.392985+0000","last_undegraded":"2024-05-07T14:01:07.392985+0000","last_fullsized":"2024-05-07T14:01:07.392985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011210+0000","last_change":"2024-05-07T14:01:04.012628+0000","last_active":"2024-05-07T14:01:07.011210+0000","last_peered":"2024-05-07T14:01:07.011210+0000","last_clean":"2024-05-07T14:01:07.011210+0000","last_became_active":"2024-05-07T14:01:04.011910+0000","last_became_peered":"2024-05-07T14:01:04.011910+0000","last_unstale":"2024-05-07T14:01:07.011210+0000","last_undegraded":"2024-05-07T14:01:07.011210+0000","last_fullsized":"2024-05-07T14:01:07.011210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010377+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:01:07.010377+0000","last_peered":"2024-05-07T14:01:07.010377+0000","last_clean":"2024-05-07T14:01:07.010377+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:01:07.010377+0000","last_undegraded":"2024-05-07T14:01:07.010377+0000","last_fullsized":"2024-05-07T14:01:07.010377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027594+0000","last_change":"2024-05-07T14:00:57.999019+0000","last_active":"2024-05-07T14:01:07.027594+0000","last_peered":"2024-05-07T14:01:07.027594+0000","last_clean":"2024-05-07T14:01:07.027594+0000","last_became_active":"2024-05-07T14:00:57.998526+0000","last_became_peered":"2024-05-07T14:00:57.998526+0000","last_unstale":"2024-05-07T14:01:07.027594+0000","last_undegraded":"2024-05-07T14:01:07.027594+0000","last_fullsized":"2024-05-07T14:01:07.027594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044521+0000","last_change":"2024-05-07T14:00:55.999548+0000","last_active":"2024-05-07T14:01:07.044521+0000","last_peered":"2024-05-07T14:01:07.044521+0000","last_clean":"2024-05-07T14:01:07.044521+0000","last_became_active":"2024-05-07T14:00:55.995284+0000","last_became_peered":"2024-05-07T14:00:55.995284+0000","last_unstale":"2024-05-07T14:01:07.044521+0000","last_undegraded":"2024-05-07T14:01:07.044521+0000","last_fullsized":"2024-05-07T14:01:07.044521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.009902+0000","last_change":"2024-05-07T14:00:59.996971+0000","last_active":"2024-05-07T14:01:07.009902+0000","last_peered":"2024-05-07T14:01:07.009902+0000","last_clean":"2024-05-07T14:01:07.009902+0000","last_became_active":"2024-05-07T14:00:59.996254+0000","last_became_peered":"2024-05-07T14:00:59.996254+0000","last_unstale":"2024-05-07T14:01:07.009902+0000","last_undegraded":"2024-05-07T14:01:07.009902+0000","last_fullsized":"2024-05-07T14:01:07.009902+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.839209+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:01:07.839209+0000","last_peered":"2024-05-07T14:01:07.839209+0000","last_clean":"2024-05-07T14:01:07.839209+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:01:07.839209+0000","last_undegraded":"2024-05-07T14:01:07.839209+0000","last_fullsized":"2024-05-07T14:01:07.839209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046685+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:01:07.046685+0000","last_peered":"2024-05-07T14:01:07.046685+0000","last_clean":"2024-05-07T14:01:07.046685+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:01:07.046685+0000","last_undegraded":"2024-05-07T14:01:07.046685+0000","last_fullsized":"2024-05-07T14:01:07.046685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042749+0000","last_change":"2024-05-07T14:01:06.038138+0000","last_active":"2024-05-07T14:01:07.042749+0000","last_peered":"2024-05-07T14:01:07.042749+0000","last_clean":"2024-05-07T14:01:07.042749+0000","last_became_active":"2024-05-07T14:01:06.030966+0000","last_became_peered":"2024-05-07T14:01:06.030966+0000","last_unstale":"2024-05-07T14:01:07.042749+0000","last_undegraded":"2024-05-07T14:01:07.042749+0000","last_fullsized":"2024-05-07T14:01:07.042749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028070+0000","last_change":"2024-05-07T14:00:57.987879+0000","last_active":"2024-05-07T14:01:07.028070+0000","last_peered":"2024-05-07T14:01:07.028070+0000","last_clean":"2024-05-07T14:01:07.028070+0000","last_became_active":"2024-05-07T14:00:57.987544+0000","last_became_peered":"2024-05-07T14:00:57.987544+0000","last_unstale":"2024-05-07T14:01:07.028070+0000","last_undegraded":"2024-05-07T14:01:07.028070+0000","last_fullsized":"2024-05-07T14:01:07.028070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012504+0000","last_change":"2024-05-07T14:00:56.007067+0000","last_active":"2024-05-07T14:01:07.012504+0000","last_peered":"2024-05-07T14:01:07.012504+0000","last_clean":"2024-05-07T14:01:07.012504+0000","last_became_active":"2024-05-07T14:00:56.006885+0000","last_became_peered":"2024-05-07T14:00:56.006885+0000","last_unstale":"2024-05-07T14:01:07.012504+0000","last_undegraded":"2024-05-07T14:01:07.012504+0000","last_fullsized":"2024-05-07T14:01:07.012504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046384+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:01:07.046384+0000","last_peered":"2024-05-07T14:01:07.046384+0000","last_clean":"2024-05-07T14:01:07.046384+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:01:07.046384+0000","last_undegraded":"2024-05-07T14:01:07.046384+0000","last_fullsized":"2024-05-07T14:01:07.046384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.614133+0000","last_change":"2024-05-07T14:01:01.995377+0000","last_active":"2024-05-07T14:01:07.614133+0000","last_peered":"2024-05-07T14:01:07.614133+0000","last_clean":"2024-05-07T14:01:07.614133+0000","last_became_active":"2024-05-07T14:01:01.994566+0000","last_became_peered":"2024-05-07T14:01:01.994566+0000","last_unstale":"2024-05-07T14:01:07.614133+0000","last_undegraded":"2024-05-07T14:01:07.614133+0000","last_fullsized":"2024-05-07T14:01:07.614133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010363+0000","last_change":"2024-05-07T14:01:03.997116+0000","last_active":"2024-05-07T14:01:07.010363+0000","last_peered":"2024-05-07T14:01:07.010363+0000","last_clean":"2024-05-07T14:01:07.010363+0000","last_became_active":"2024-05-07T14:01:03.996555+0000","last_became_peered":"2024-05-07T14:01:03.996555+0000","last_unstale":"2024-05-07T14:01:07.010363+0000","last_undegraded":"2024-05-07T14:01:07.010363+0000","last_fullsized":"2024-05-07T14:01:07.010363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047934+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:01:07.047934+0000","last_peered":"2024-05-07T14:01:07.047934+0000","last_clean":"2024-05-07T14:01:07.047934+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:01:07.047934+0000","last_undegraded":"2024-05-07T14:01:07.047934+0000","last_fullsized":"2024-05-07T14:01:07.047934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028280+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:01:07.028280+0000","last_peered":"2024-05-07T14:01:07.028280+0000","last_clean":"2024-05-07T14:01:07.028280+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:01:07.028280+0000","last_undegraded":"2024-05-07T14:01:07.028280+0000","last_fullsized":"2024-05-07T14:01:07.028280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011184+0000","last_change":"2024-05-07T14:00:59.995694+0000","last_active":"2024-05-07T14:01:07.011184+0000","last_peered":"2024-05-07T14:01:07.011184+0000","last_clean":"2024-05-07T14:01:07.011184+0000","last_became_active":"2024-05-07T14:00:59.993899+0000","last_became_peered":"2024-05-07T14:00:59.993899+0000","last_unstale":"2024-05-07T14:01:07.011184+0000","last_undegraded":"2024-05-07T14:01:07.011184+0000","last_fullsized":"2024-05-07T14:01:07.011184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:28.225348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.958152+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:01:07.958152+0000","last_peered":"2024-05-07T14:01:07.958152+0000","last_clean":"2024-05-07T14:01:07.958152+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:01:07.958152+0000","last_undegraded":"2024-05-07T14:01:07.958152+0000","last_fullsized":"2024-05-07T14:01:07.958152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043430+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:01:07.043430+0000","last_peered":"2024-05-07T14:01:07.043430+0000","last_clean":"2024-05-07T14:01:07.043430+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:01:07.043430+0000","last_undegraded":"2024-05-07T14:01:07.043430+0000","last_fullsized":"2024-05-07T14:01:07.043430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028077+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:01:07.028077+0000","last_peered":"2024-05-07T14:01:07.028077+0000","last_clean":"2024-05-07T14:01:07.028077+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:01:07.028077+0000","last_undegraded":"2024-05-07T14:01:07.028077+0000","last_fullsized":"2024-05-07T14:01:07.028077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011422+0000","last_change":"2024-05-07T14:00:57.995989+0000","last_active":"2024-05-07T14:01:07.011422+0000","last_peered":"2024-05-07T14:01:07.011422+0000","last_clean":"2024-05-07T14:01:07.011422+0000","last_became_active":"2024-05-07T14:00:57.995721+0000","last_became_peered":"2024-05-07T14:00:57.995721+0000","last_unstale":"2024-05-07T14:01:07.011422+0000","last_undegraded":"2024-05-07T14:01:07.011422+0000","last_fullsized":"2024-05-07T14:01:07.011422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.024988+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:01:07.024988+0000","last_peered":"2024-05-07T14:01:07.024988+0000","last_clean":"2024-05-07T14:01:07.024988+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:01:07.024988+0000","last_undegraded":"2024-05-07T14:01:07.024988+0000","last_fullsized":"2024-05-07T14:01:07.024988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047639+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:01:07.047639+0000","last_peered":"2024-05-07T14:01:07.047639+0000","last_clean":"2024-05-07T14:01:07.047639+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:01:07.047639+0000","last_undegraded":"2024-05-07T14:01:07.047639+0000","last_fullsized":"2024-05-07T14:01:07.047639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.737513+0000","last_change":"2024-05-07T14:01:02.002384+0000","last_active":"2024-05-07T14:01:07.737513+0000","last_peered":"2024-05-07T14:01:07.737513+0000","last_clean":"2024-05-07T14:01:07.737513+0000","last_became_active":"2024-05-07T14:01:02.001676+0000","last_became_peered":"2024-05-07T14:01:02.001676+0000","last_unstale":"2024-05-07T14:01:07.737513+0000","last_undegraded":"2024-05-07T14:01:07.737513+0000","last_fullsized":"2024-05-07T14:01:07.737513+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025235+0000","last_change":"2024-05-07T14:01:04.015893+0000","last_active":"2024-05-07T14:01:07.025235+0000","last_peered":"2024-05-07T14:01:07.025235+0000","last_clean":"2024-05-07T14:01:07.025235+0000","last_became_active":"2024-05-07T14:01:04.015329+0000","last_became_peered":"2024-05-07T14:01:04.015329+0000","last_unstale":"2024-05-07T14:01:07.025235+0000","last_undegraded":"2024-05-07T14:01:07.025235+0000","last_fullsized":"2024-05-07T14:01:07.025235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:53.413495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046511+0000","last_change":"2024-05-07T14:01:06.025917+0000","last_active":"2024-05-07T14:01:07.046511+0000","last_peered":"2024-05-07T14:01:07.046511+0000","last_clean":"2024-05-07T14:01:07.046511+0000","last_became_active":"2024-05-07T14:01:06.025044+0000","last_became_peered":"2024-05-07T14:01:06.025044+0000","last_unstale":"2024-05-07T14:01:07.046511+0000","last_undegraded":"2024-05-07T14:01:07.046511+0000","last_fullsized":"2024-05-07T14:01:07.046511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:55.419668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029256+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:01:07.029256+0000","last_peered":"2024-05-07T14:01:07.029256+0000","last_clean":"2024-05-07T14:01:07.029256+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:01:07.029256+0000","last_undegraded":"2024-05-07T14:01:07.029256+0000","last_fullsized":"2024-05-07T14:01:07.029256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016331+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:01:07.016331+0000","last_peered":"2024-05-07T14:01:07.016331+0000","last_clean":"2024-05-07T14:01:07.016331+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:01:07.016331+0000","last_undegraded":"2024-05-07T14:01:07.016331+0000","last_fullsized":"2024-05-07T14:01:07.016331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016423+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:01:07.016423+0000","last_peered":"2024-05-07T14:01:07.016423+0000","last_clean":"2024-05-07T14:01:07.016423+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:01:07.016423+0000","last_undegraded":"2024-05-07T14:01:07.016423+0000","last_fullsized":"2024-05-07T14:01:07.016423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.936965+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:01:07.936965+0000","last_peered":"2024-05-07T14:01:07.936965+0000","last_clean":"2024-05-07T14:01:07.936965+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:01:07.936965+0000","last_undegraded":"2024-05-07T14:01:07.936965+0000","last_fullsized":"2024-05-07T14:01:07.936965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.026186+0000","last_change":"2024-05-07T14:01:04.026470+0000","last_active":"2024-05-07T14:01:07.026186+0000","last_peered":"2024-05-07T14:01:07.026186+0000","last_clean":"2024-05-07T14:01:07.026186+0000","last_became_active":"2024-05-07T14:01:04.025881+0000","last_became_peered":"2024-05-07T14:01:04.025881+0000","last_unstale":"2024-05-07T14:01:07.026186+0000","last_undegraded":"2024-05-07T14:01:07.026186+0000","last_fullsized":"2024-05-07T14:01:07.026186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:54.595283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042611+0000","last_change":"2024-05-07T14:01:06.038979+0000","last_active":"2024-05-07T14:01:07.042611+0000","last_peered":"2024-05-07T14:01:07.042611+0000","last_clean":"2024-05-07T14:01:07.042611+0000","last_became_active":"2024-05-07T14:01:06.035737+0000","last_became_peered":"2024-05-07T14:01:06.035737+0000","last_unstale":"2024-05-07T14:01:07.042611+0000","last_undegraded":"2024-05-07T14:01:07.042611+0000","last_fullsized":"2024-05-07T14:01:07.042611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.063231+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:01:07.063231+0000","last_peered":"2024-05-07T14:01:07.063231+0000","last_clean":"2024-05-07T14:01:07.063231+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:01:07.063231+0000","last_undegraded":"2024-05-07T14:01:07.063231+0000","last_fullsized":"2024-05-07T14:01:07.063231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010475+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:01:07.010475+0000","last_peered":"2024-05-07T14:01:07.010475+0000","last_clean":"2024-05-07T14:01:07.010475+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:01:07.010475+0000","last_undegraded":"2024-05-07T14:01:07.010475+0000","last_fullsized":"2024-05-07T14:01:07.010475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025389+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:01:07.025389+0000","last_peered":"2024-05-07T14:01:07.025389+0000","last_clean":"2024-05-07T14:01:07.025389+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:01:07.025389+0000","last_undegraded":"2024-05-07T14:01:07.025389+0000","last_fullsized":"2024-05-07T14:01:07.025389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.913418+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:01:07.913418+0000","last_peered":"2024-05-07T14:01:07.913418+0000","last_clean":"2024-05-07T14:01:07.913418+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:01:07.913418+0000","last_undegraded":"2024-05-07T14:01:07.913418+0000","last_fullsized":"2024-05-07T14:01:07.913418+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.599588+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:01:07.599588+0000","last_peered":"2024-05-07T14:01:07.599588+0000","last_clean":"2024-05-07T14:01:07.599588+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:01:07.599588+0000","last_undegraded":"2024-05-07T14:01:07.599588+0000","last_fullsized":"2024-05-07T14:01:07.599588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010225+0000","last_change":"2024-05-07T14:01:06.037755+0000","last_active":"2024-05-07T14:01:07.010225+0000","last_peered":"2024-05-07T14:01:07.010225+0000","last_clean":"2024-05-07T14:01:07.010225+0000","last_became_active":"2024-05-07T14:01:06.037156+0000","last_became_peered":"2024-05-07T14:01:06.037156+0000","last_unstale":"2024-05-07T14:01:07.010225+0000","last_undegraded":"2024-05-07T14:01:07.010225+0000","last_fullsized":"2024-05-07T14:01:07.010225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:30.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014513+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:01:07.014513+0000","last_peered":"2024-05-07T14:01:07.014513+0000","last_clean":"2024-05-07T14:01:07.014513+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:01:07.014513+0000","last_undegraded":"2024-05-07T14:01:07.014513+0000","last_fullsized":"2024-05-07T14:01:07.014513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044419+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:01:07.044419+0000","last_peered":"2024-05-07T14:01:07.044419+0000","last_clean":"2024-05-07T14:01:07.044419+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:01:07.044419+0000","last_undegraded":"2024-05-07T14:01:07.044419+0000","last_fullsized":"2024-05-07T14:01:07.044419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011071+0000","last_change":"2024-05-07T14:00:59.998197+0000","last_active":"2024-05-07T14:01:07.011071+0000","last_peered":"2024-05-07T14:01:07.011071+0000","last_clean":"2024-05-07T14:01:07.011071+0000","last_became_active":"2024-05-07T14:00:59.997438+0000","last_became_peered":"2024-05-07T14:00:59.997438+0000","last_unstale":"2024-05-07T14:01:07.011071+0000","last_undegraded":"2024-05-07T14:01:07.011071+0000","last_fullsized":"2024-05-07T14:01:07.011071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:29.430229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.950369+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:01:07.950369+0000","last_peered":"2024-05-07T14:01:07.950369+0000","last_clean":"2024-05-07T14:01:07.950369+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:01:07.950369+0000","last_undegraded":"2024-05-07T14:01:07.950369+0000","last_fullsized":"2024-05-07T14:01:07.950369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.009004+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:01:07.009004+0000","last_peered":"2024-05-07T14:01:07.009004+0000","last_clean":"2024-05-07T14:01:07.009004+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:01:07.009004+0000","last_undegraded":"2024-05-07T14:01:07.009004+0000","last_fullsized":"2024-05-07T14:01:07.009004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012754+0000","last_change":"2024-05-07T14:01:06.025913+0000","last_active":"2024-05-07T14:01:07.012754+0000","last_peered":"2024-05-07T14:01:07.012754+0000","last_clean":"2024-05-07T14:01:07.012754+0000","last_became_active":"2024-05-07T14:01:06.025220+0000","last_became_peered":"2024-05-07T14:01:06.025220+0000","last_unstale":"2024-05-07T14:01:07.012754+0000","last_undegraded":"2024-05-07T14:01:07.012754+0000","last_fullsized":"2024-05-07T14:01:07.012754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:30.164745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015690+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:01:07.015690+0000","last_peered":"2024-05-07T14:01:07.015690+0000","last_clean":"2024-05-07T14:01:07.015690+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:01:07.015690+0000","last_undegraded":"2024-05-07T14:01:07.015690+0000","last_fullsized":"2024-05-07T14:01:07.015690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044467+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:01:07.044467+0000","last_peered":"2024-05-07T14:01:07.044467+0000","last_clean":"2024-05-07T14:01:07.044467+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:01:07.044467+0000","last_undegraded":"2024-05-07T14:01:07.044467+0000","last_fullsized":"2024-05-07T14:01:07.044467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042991+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:01:07.042991+0000","last_peered":"2024-05-07T14:01:07.042991+0000","last_clean":"2024-05-07T14:01:07.042991+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:01:07.042991+0000","last_undegraded":"2024-05-07T14:01:07.042991+0000","last_fullsized":"2024-05-07T14:01:07.042991+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.333523+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:01:07.333523+0000","last_peered":"2024-05-07T14:01:07.333523+0000","last_clean":"2024-05-07T14:01:07.333523+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:01:07.333523+0000","last_undegraded":"2024-05-07T14:01:07.333523+0000","last_fullsized":"2024-05-07T14:01:07.333523+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046110+0000","last_change":"2024-05-07T14:01:04.017099+0000","last_active":"2024-05-07T14:01:07.046110+0000","last_peered":"2024-05-07T14:01:07.046110+0000","last_clean":"2024-05-07T14:01:07.046110+0000","last_became_active":"2024-05-07T14:01:04.011036+0000","last_became_peered":"2024-05-07T14:01:04.011036+0000","last_unstale":"2024-05-07T14:01:07.046110+0000","last_undegraded":"2024-05-07T14:01:07.046110+0000","last_fullsized":"2024-05-07T14:01:07.046110+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:32.242974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029774+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:01:07.029774+0000","last_peered":"2024-05-07T14:01:07.029774+0000","last_clean":"2024-05-07T14:01:07.029774+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:01:07.029774+0000","last_undegraded":"2024-05-07T14:01:07.029774+0000","last_fullsized":"2024-05-07T14:01:07.029774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027820+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:01:07.027820+0000","last_peered":"2024-05-07T14:01:07.027820+0000","last_clean":"2024-05-07T14:01:07.027820+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:01:07.027820+0000","last_undegraded":"2024-05-07T14:01:07.027820+0000","last_fullsized":"2024-05-07T14:01:07.027820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.031468+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:01:07.031468+0000","last_peered":"2024-05-07T14:01:07.031468+0000","last_clean":"2024-05-07T14:01:07.031468+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:01:07.031468+0000","last_undegraded":"2024-05-07T14:01:07.031468+0000","last_fullsized":"2024-05-07T14:01:07.031468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014000+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:01:07.014000+0000","last_peered":"2024-05-07T14:01:07.014000+0000","last_clean":"2024-05-07T14:01:07.014000+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:01:07.014000+0000","last_undegraded":"2024-05-07T14:01:07.014000+0000","last_fullsized":"2024-05-07T14:01:07.014000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.567188+0000","last_change":"2024-05-07T14:01:02.013617+0000","last_active":"2024-05-07T14:01:07.567188+0000","last_peered":"2024-05-07T14:01:07.567188+0000","last_clean":"2024-05-07T14:01:07.567188+0000","last_became_active":"2024-05-07T14:01:02.009243+0000","last_became_peered":"2024-05-07T14:01:02.009243+0000","last_unstale":"2024-05-07T14:01:07.567188+0000","last_undegraded":"2024-05-07T14:01:07.567188+0000","last_fullsized":"2024-05-07T14:01:07.567188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014148+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:01:07.014148+0000","last_peered":"2024-05-07T14:01:07.014148+0000","last_clean":"2024-05-07T14:01:07.014148+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:01:07.014148+0000","last_undegraded":"2024-05-07T14:01:07.014148+0000","last_fullsized":"2024-05-07T14:01:07.014148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012911+0000","last_change":"2024-05-07T14:01:06.023907+0000","last_active":"2024-05-07T14:01:07.012911+0000","last_peered":"2024-05-07T14:01:07.012911+0000","last_clean":"2024-05-07T14:01:07.012911+0000","last_became_active":"2024-05-07T14:01:06.023307+0000","last_became_peered":"2024-05-07T14:01:06.023307+0000","last_unstale":"2024-05-07T14:01:07.012911+0000","last_undegraded":"2024-05-07T14:01:07.012911+0000","last_fullsized":"2024-05-07T14:01:07.012911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:41.916580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014760+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:01:07.014760+0000","last_peered":"2024-05-07T14:01:07.014760+0000","last_clean":"2024-05-07T14:01:07.014760+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:01:07.014760+0000","last_undegraded":"2024-05-07T14:01:07.014760+0000","last_fullsized":"2024-05-07T14:01:07.014760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012241+0000","last_change":"2024-05-07T14:00:56.006013+0000","last_active":"2024-05-07T14:01:07.012241+0000","last_peered":"2024-05-07T14:01:07.012241+0000","last_clean":"2024-05-07T14:01:07.012241+0000","last_became_active":"2024-05-07T14:00:56.005758+0000","last_became_peered":"2024-05-07T14:00:56.005758+0000","last_unstale":"2024-05-07T14:01:07.012241+0000","last_undegraded":"2024-05-07T14:01:07.012241+0000","last_fullsized":"2024-05-07T14:01:07.012241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.023933+0000","last_change":"2024-05-07T14:00:59.998767+0000","last_active":"2024-05-07T14:01:07.023933+0000","last_peered":"2024-05-07T14:01:07.023933+0000","last_clean":"2024-05-07T14:01:07.023933+0000","last_became_active":"2024-05-07T14:00:59.998055+0000","last_became_peered":"2024-05-07T14:00:59.998055+0000","last_unstale":"2024-05-07T14:01:07.023933+0000","last_undegraded":"2024-05-07T14:01:07.023933+0000","last_fullsized":"2024-05-07T14:01:07.023933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:41.593806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.634628+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:01:07.634628+0000","last_peered":"2024-05-07T14:01:07.634628+0000","last_clean":"2024-05-07T14:01:07.634628+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:01:07.634628+0000","last_undegraded":"2024-05-07T14:01:07.634628+0000","last_fullsized":"2024-05-07T14:01:07.634628+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010130+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:01:07.010130+0000","last_peered":"2024-05-07T14:01:07.010130+0000","last_clean":"2024-05-07T14:01:07.010130+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:01:07.010130+0000","last_undegraded":"2024-05-07T14:01:07.010130+0000","last_fullsized":"2024-05-07T14:01:07.010130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016934+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:01:07.016934+0000","last_peered":"2024-05-07T14:01:07.016934+0000","last_clean":"2024-05-07T14:01:07.016934+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:01:07.016934+0000","last_undegraded":"2024-05-07T14:01:07.016934+0000","last_fullsized":"2024-05-07T14:01:07.016934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027708+0000","last_change":"2024-05-07T14:00:58.005276+0000","last_active":"2024-05-07T14:01:07.027708+0000","last_peered":"2024-05-07T14:01:07.027708+0000","last_clean":"2024-05-07T14:01:07.027708+0000","last_became_active":"2024-05-07T14:00:58.004903+0000","last_became_peered":"2024-05-07T14:00:58.004903+0000","last_unstale":"2024-05-07T14:01:07.027708+0000","last_undegraded":"2024-05-07T14:01:07.027708+0000","last_fullsized":"2024-05-07T14:01:07.027708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.045843+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:01:07.045843+0000","last_peered":"2024-05-07T14:01:07.045843+0000","last_clean":"2024-05-07T14:01:07.045843+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:01:07.045843+0000","last_undegraded":"2024-05-07T14:01:07.045843+0000","last_fullsized":"2024-05-07T14:01:07.045843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.026438+0000","last_change":"2024-05-07T14:00:57.986882+0000","last_active":"2024-05-07T14:01:07.026438+0000","last_peered":"2024-05-07T14:01:07.026438+0000","last_clean":"2024-05-07T14:01:07.026438+0000","last_became_active":"2024-05-07T14:00:57.984867+0000","last_became_peered":"2024-05-07T14:00:57.984867+0000","last_unstale":"2024-05-07T14:01:07.026438+0000","last_undegraded":"2024-05-07T14:01:07.026438+0000","last_fullsized":"2024-05-07T14:01:07.026438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062227+0000","last_change":"2024-05-07T14:00:56.001559+0000","last_active":"2024-05-07T14:01:07.062227+0000","last_peered":"2024-05-07T14:01:07.062227+0000","last_clean":"2024-05-07T14:01:07.062227+0000","last_became_active":"2024-05-07T14:00:56.001149+0000","last_became_peered":"2024-05-07T14:00:56.001149+0000","last_unstale":"2024-05-07T14:01:07.062227+0000","last_undegraded":"2024-05-07T14:01:07.062227+0000","last_fullsized":"2024-05-07T14:01:07.062227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:13.077774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043587+0000","last_change":"2024-05-07T14:00:57.985233+0000","last_active":"2024-05-07T14:01:07.043587+0000","last_peered":"2024-05-07T14:01:07.043587+0000","last_clean":"2024-05-07T14:01:07.043587+0000","last_became_active":"2024-05-07T14:00:57.984523+0000","last_became_peered":"2024-05-07T14:00:57.984523+0000","last_unstale":"2024-05-07T14:01:07.043587+0000","last_undegraded":"2024-05-07T14:01:07.043587+0000","last_fullsized":"2024-05-07T14:01:07.043587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043841+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:01:07.043841+0000","last_peered":"2024-05-07T14:01:07.043841+0000","last_clean":"2024-05-07T14:01:07.043841+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:01:07.043841+0000","last_undegraded":"2024-05-07T14:01:07.043841+0000","last_fullsized":"2024-05-07T14:01:07.043841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025921+0000","last_change":"2024-05-07T14:00:57.989787+0000","last_active":"2024-05-07T14:01:07.025921+0000","last_peered":"2024-05-07T14:01:07.025921+0000","last_clean":"2024-05-07T14:01:07.025921+0000","last_became_active":"2024-05-07T14:00:57.989498+0000","last_became_peered":"2024-05-07T14:00:57.989498+0000","last_unstale":"2024-05-07T14:01:07.025921+0000","last_undegraded":"2024-05-07T14:01:07.025921+0000","last_fullsized":"2024-05-07T14:01:07.025921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011003+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:01:07.011003+0000","last_peered":"2024-05-07T14:01:07.011003+0000","last_clean":"2024-05-07T14:01:07.011003+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:01:07.011003+0000","last_undegraded":"2024-05-07T14:01:07.011003+0000","last_fullsized":"2024-05-07T14:01:07.011003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029059+0000","last_change":"2024-05-07T14:00:57.998054+0000","last_active":"2024-05-07T14:01:07.029059+0000","last_peered":"2024-05-07T14:01:07.029059+0000","last_clean":"2024-05-07T14:01:07.029059+0000","last_became_active":"2024-05-07T14:00:57.997750+0000","last_became_peered":"2024-05-07T14:00:57.997750+0000","last_unstale":"2024-05-07T14:01:07.029059+0000","last_undegraded":"2024-05-07T14:01:07.029059+0000","last_fullsized":"2024-05-07T14:01:07.029059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029925+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:01:07.029925+0000","last_peered":"2024-05-07T14:01:07.029925+0000","last_clean":"2024-05-07T14:01:07.029925+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:01:07.029925+0000","last_undegraded":"2024-05-07T14:01:07.029925+0000","last_fullsized":"2024-05-07T14:01:07.029925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016082+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:01:07.016082+0000","last_peered":"2024-05-07T14:01:07.016082+0000","last_clean":"2024-05-07T14:01:07.016082+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:01:07.016082+0000","last_undegraded":"2024-05-07T14:01:07.016082+0000","last_fullsized":"2024-05-07T14:01:07.016082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025630+0000","last_change":"2024-05-07T14:00:55.974072+0000","last_active":"2024-05-07T14:01:07.025630+0000","last_peered":"2024-05-07T14:01:07.025630+0000","last_clean":"2024-05-07T14:01:07.025630+0000","last_became_active":"2024-05-07T14:00:55.973647+0000","last_became_peered":"2024-05-07T14:00:55.973647+0000","last_unstale":"2024-05-07T14:01:07.025630+0000","last_undegraded":"2024-05-07T14:01:07.025630+0000","last_fullsized":"2024-05-07T14:01:07.025630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027399+0000","last_change":"2024-05-07T14:00:57.988167+0000","last_active":"2024-05-07T14:01:07.027399+0000","last_peered":"2024-05-07T14:01:07.027399+0000","last_clean":"2024-05-07T14:01:07.027399+0000","last_became_active":"2024-05-07T14:00:57.987884+0000","last_became_peered":"2024-05-07T14:00:57.987884+0000","last_unstale":"2024-05-07T14:01:07.027399+0000","last_undegraded":"2024-05-07T14:01:07.027399+0000","last_fullsized":"2024-05-07T14:01:07.027399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.048340+0000","last_change":"2024-05-07T14:00:55.997287+0000","last_active":"2024-05-07T14:01:07.048340+0000","last_peered":"2024-05-07T14:01:07.048340+0000","last_clean":"2024-05-07T14:01:07.048340+0000","last_became_active":"2024-05-07T14:00:55.996467+0000","last_became_peered":"2024-05-07T14:00:55.996467+0000","last_unstale":"2024-05-07T14:01:07.048340+0000","last_undegraded":"2024-05-07T14:01:07.048340+0000","last_fullsized":"2024-05-07T14:01:07.048340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.045821+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:01:07.045821+0000","last_peered":"2024-05-07T14:01:07.045821+0000","last_clean":"2024-05-07T14:01:07.045821+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:01:07.045821+0000","last_undegraded":"2024-05-07T14:01:07.045821+0000","last_fullsized":"2024-05-07T14:01:07.045821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.031731+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:01:07.031731+0000","last_peered":"2024-05-07T14:01:07.031731+0000","last_clean":"2024-05-07T14:01:07.031731+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:01:07.031731+0000","last_undegraded":"2024-05-07T14:01:07.031731+0000","last_fullsized":"2024-05-07T14:01:07.031731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011673+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:01:07.011673+0000","last_peered":"2024-05-07T14:01:07.011673+0000","last_clean":"2024-05-07T14:01:07.011673+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:01:07.011673+0000","last_undegraded":"2024-05-07T14:01:07.011673+0000","last_fullsized":"2024-05-07T14:01:07.011673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043252+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:01:07.043252+0000","last_peered":"2024-05-07T14:01:07.043252+0000","last_clean":"2024-05-07T14:01:07.043252+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:01:07.043252+0000","last_undegraded":"2024-05-07T14:01:07.043252+0000","last_fullsized":"2024-05-07T14:01:07.043252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015618+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:01:07.015618+0000","last_peered":"2024-05-07T14:01:07.015618+0000","last_clean":"2024-05-07T14:01:07.015618+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:01:07.015618+0000","last_undegraded":"2024-05-07T14:01:07.015618+0000","last_fullsized":"2024-05-07T14:01:07.015618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027954+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:01:07.027954+0000","last_peered":"2024-05-07T14:01:07.027954+0000","last_clean":"2024-05-07T14:01:07.027954+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:01:07.027954+0000","last_undegraded":"2024-05-07T14:01:07.027954+0000","last_fullsized":"2024-05-07T14:01:07.027954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.063354+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:01:07.063354+0000","last_peered":"2024-05-07T14:01:07.063354+0000","last_clean":"2024-05-07T14:01:07.063354+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:01:07.063354+0000","last_undegraded":"2024-05-07T14:01:07.063354+0000","last_fullsized":"2024-05-07T14:01:07.063354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043542+0000","last_change":"2024-05-07T14:00:56.001135+0000","last_active":"2024-05-07T14:01:07.043542+0000","last_peered":"2024-05-07T14:01:07.043542+0000","last_clean":"2024-05-07T14:01:07.043542+0000","last_became_active":"2024-05-07T14:00:55.999884+0000","last_became_peered":"2024-05-07T14:00:55.999884+0000","last_unstale":"2024-05-07T14:01:07.043542+0000","last_undegraded":"2024-05-07T14:01:07.043542+0000","last_fullsized":"2024-05-07T14:01:07.043542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015839+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:01:07.015839+0000","last_peered":"2024-05-07T14:01:07.015839+0000","last_clean":"2024-05-07T14:01:07.015839+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:01:07.015839+0000","last_undegraded":"2024-05-07T14:01:07.015839+0000","last_fullsized":"2024-05-07T14:01:07.015839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011439+0000","last_change":"2024-05-07T14:00:55.989670+0000","last_active":"2024-05-07T14:01:07.011439+0000","last_peered":"2024-05-07T14:01:07.011439+0000","last_clean":"2024-05-07T14:01:07.011439+0000","last_became_active":"2024-05-07T14:00:55.989455+0000","last_became_peered":"2024-05-07T14:00:55.989455+0000","last_unstale":"2024-05-07T14:01:07.011439+0000","last_undegraded":"2024-05-07T14:01:07.011439+0000","last_fullsized":"2024-05-07T14:01:07.011439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010909+0000","last_change":"2024-05-07T14:00:57.979022+0000","last_active":"2024-05-07T14:01:07.010909+0000","last_peered":"2024-05-07T14:01:07.010909+0000","last_clean":"2024-05-07T14:01:07.010909+0000","last_became_active":"2024-05-07T14:00:57.977403+0000","last_became_peered":"2024-05-07T14:00:57.977403+0000","last_unstale":"2024-05-07T14:01:07.010909+0000","last_undegraded":"2024-05-07T14:01:07.010909+0000","last_fullsized":"2024-05-07T14:01:07.010909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047426+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:01:07.047426+0000","last_peered":"2024-05-07T14:01:07.047426+0000","last_clean":"2024-05-07T14:01:07.047426+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:01:07.047426+0000","last_undegraded":"2024-05-07T14:01:07.047426+0000","last_fullsized":"2024-05-07T14:01:07.047426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.009434+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:01:07.009434+0000","last_peered":"2024-05-07T14:01:07.009434+0000","last_clean":"2024-05-07T14:01:07.009434+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:01:07.009434+0000","last_undegraded":"2024-05-07T14:01:07.009434+0000","last_fullsized":"2024-05-07T14:01:07.009434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.013681+0000","last_change":"2024-05-07T14:00:55.978771+0000","last_active":"2024-05-07T14:01:07.013681+0000","last_peered":"2024-05-07T14:01:07.013681+0000","last_clean":"2024-05-07T14:01:07.013681+0000","last_became_active":"2024-05-07T14:00:55.978000+0000","last_became_peered":"2024-05-07T14:00:55.978000+0000","last_unstale":"2024-05-07T14:01:07.013681+0000","last_undegraded":"2024-05-07T14:01:07.013681+0000","last_fullsized":"2024-05-07T14:01:07.013681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027336+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:01:07.027336+0000","last_peered":"2024-05-07T14:01:07.027336+0000","last_clean":"2024-05-07T14:01:07.027336+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:01:07.027336+0000","last_undegraded":"2024-05-07T14:01:07.027336+0000","last_fullsized":"2024-05-07T14:01:07.027336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.063888+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:01:07.063888+0000","last_peered":"2024-05-07T14:01:07.063888+0000","last_clean":"2024-05-07T14:01:07.063888+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:01:07.063888+0000","last_undegraded":"2024-05-07T14:01:07.063888+0000","last_fullsized":"2024-05-07T14:01:07.063888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010363+0000","last_change":"2024-05-07T14:00:57.979073+0000","last_active":"2024-05-07T14:01:07.010363+0000","last_peered":"2024-05-07T14:01:07.010363+0000","last_clean":"2024-05-07T14:01:07.010363+0000","last_became_active":"2024-05-07T14:00:57.978215+0000","last_became_peered":"2024-05-07T14:00:57.978215+0000","last_unstale":"2024-05-07T14:01:07.010363+0000","last_undegraded":"2024-05-07T14:01:07.010363+0000","last_fullsized":"2024-05-07T14:01:07.010363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044872+0000","last_change":"2024-05-07T14:00:56.001199+0000","last_active":"2024-05-07T14:01:07.044872+0000","last_peered":"2024-05-07T14:01:07.044872+0000","last_clean":"2024-05-07T14:01:07.044872+0000","last_became_active":"2024-05-07T14:00:56.000434+0000","last_became_peered":"2024-05-07T14:00:56.000434+0000","last_unstale":"2024-05-07T14:01:07.044872+0000","last_undegraded":"2024-05-07T14:01:07.044872+0000","last_fullsized":"2024-05-07T14:01:07.044872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042782+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:01:07.042782+0000","last_peered":"2024-05-07T14:01:07.042782+0000","last_clean":"2024-05-07T14:01:07.042782+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:01:07.042782+0000","last_undegraded":"2024-05-07T14:01:07.042782+0000","last_fullsized":"2024-05-07T14:01:07.042782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011503+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:01:07.011503+0000","last_peered":"2024-05-07T14:01:07.011503+0000","last_clean":"2024-05-07T14:01:07.011503+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:01:07.011503+0000","last_undegraded":"2024-05-07T14:01:07.011503+0000","last_fullsized":"2024-05-07T14:01:07.011503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.024703+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:01:07.024703+0000","last_peered":"2024-05-07T14:01:07.024703+0000","last_clean":"2024-05-07T14:01:07.024703+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:01:07.024703+0000","last_undegraded":"2024-05-07T14:01:07.024703+0000","last_fullsized":"2024-05-07T14:01:07.024703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044072+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:01:07.044072+0000","last_peered":"2024-05-07T14:01:07.044072+0000","last_clean":"2024-05-07T14:01:07.044072+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:01:07.044072+0000","last_undegraded":"2024-05-07T14:01:07.044072+0000","last_fullsized":"2024-05-07T14:01:07.044072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1011712,"data_stored":754275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":163247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":164075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":163738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":163643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":163245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":164490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":754117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:01:13.945 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:01:14.301 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:01:14.307 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:01:14.317 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-05-07T14:01:13.221958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224656,"kb_used_data":4328,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750064,"statfs":{"total":773094113280,"available":772864065536,"internally_reserved":0,"allocated":4431872,"data_stored":2490830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003194"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011932+0000","last_change":"2024-05-07T14:00:55.983744+0000","last_active":"2024-05-07T14:01:07.011932+0000","last_peered":"2024-05-07T14:01:07.011932+0000","last_clean":"2024-05-07T14:01:07.011932+0000","last_became_active":"2024-05-07T14:00:55.982993+0000","last_became_peered":"2024-05-07T14:00:55.982993+0000","last_unstale":"2024-05-07T14:01:07.011932+0000","last_undegraded":"2024-05-07T14:01:07.011932+0000","last_fullsized":"2024-05-07T14:01:07.011932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042114+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:01:07.042114+0000","last_peered":"2024-05-07T14:01:07.042114+0000","last_clean":"2024-05-07T14:01:07.042114+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:01:07.042114+0000","last_undegraded":"2024-05-07T14:01:07.042114+0000","last_fullsized":"2024-05-07T14:01:07.042114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.026608+0000","last_change":"2024-05-07T14:00:55.973967+0000","last_active":"2024-05-07T14:01:07.026608+0000","last_peered":"2024-05-07T14:01:07.026608+0000","last_clean":"2024-05-07T14:01:07.026608+0000","last_became_active":"2024-05-07T14:00:55.973677+0000","last_became_peered":"2024-05-07T14:00:55.973677+0000","last_unstale":"2024-05-07T14:01:07.026608+0000","last_undegraded":"2024-05-07T14:01:07.026608+0000","last_fullsized":"2024-05-07T14:01:07.026608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011178+0000","last_change":"2024-05-07T14:00:57.988092+0000","last_active":"2024-05-07T14:01:07.011178+0000","last_peered":"2024-05-07T14:01:07.011178+0000","last_clean":"2024-05-07T14:01:07.011178+0000","last_became_active":"2024-05-07T14:00:57.987091+0000","last_became_peered":"2024-05-07T14:00:57.987091+0000","last_unstale":"2024-05-07T14:01:07.011178+0000","last_undegraded":"2024-05-07T14:01:07.011178+0000","last_fullsized":"2024-05-07T14:01:07.011178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010811+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:01:07.010811+0000","last_peered":"2024-05-07T14:01:07.010811+0000","last_clean":"2024-05-07T14:01:07.010811+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:01:07.010811+0000","last_undegraded":"2024-05-07T14:01:07.010811+0000","last_fullsized":"2024-05-07T14:01:07.010811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015164+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:01:07.015164+0000","last_peered":"2024-05-07T14:01:07.015164+0000","last_clean":"2024-05-07T14:01:07.015164+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:01:07.015164+0000","last_undegraded":"2024-05-07T14:01:07.015164+0000","last_fullsized":"2024-05-07T14:01:07.015164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043568+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:01:07.043568+0000","last_peered":"2024-05-07T14:01:07.043568+0000","last_clean":"2024-05-07T14:01:07.043568+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:01:07.043568+0000","last_undegraded":"2024-05-07T14:01:07.043568+0000","last_fullsized":"2024-05-07T14:01:07.043568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010709+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:01:07.010709+0000","last_peered":"2024-05-07T14:01:07.010709+0000","last_clean":"2024-05-07T14:01:07.010709+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:01:07.010709+0000","last_undegraded":"2024-05-07T14:01:07.010709+0000","last_fullsized":"2024-05-07T14:01:07.010709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011458+0000","last_change":"2024-05-07T14:00:55.973419+0000","last_active":"2024-05-07T14:01:07.011458+0000","last_peered":"2024-05-07T14:01:07.011458+0000","last_clean":"2024-05-07T14:01:07.011458+0000","last_became_active":"2024-05-07T14:00:55.963467+0000","last_became_peered":"2024-05-07T14:00:55.963467+0000","last_unstale":"2024-05-07T14:01:07.011458+0000","last_undegraded":"2024-05-07T14:01:07.011458+0000","last_fullsized":"2024-05-07T14:01:07.011458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047047+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:01:07.047047+0000","last_peered":"2024-05-07T14:01:07.047047+0000","last_clean":"2024-05-07T14:01:07.047047+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:01:07.047047+0000","last_undegraded":"2024-05-07T14:01:07.047047+0000","last_fullsized":"2024-05-07T14:01:07.047047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042809+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:01:07.042809+0000","last_peered":"2024-05-07T14:01:07.042809+0000","last_clean":"2024-05-07T14:01:07.042809+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:01:07.042809+0000","last_undegraded":"2024-05-07T14:01:07.042809+0000","last_fullsized":"2024-05-07T14:01:07.042809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014767+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:01:07.014767+0000","last_peered":"2024-05-07T14:01:07.014767+0000","last_clean":"2024-05-07T14:01:07.014767+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:01:07.014767+0000","last_undegraded":"2024-05-07T14:01:07.014767+0000","last_fullsized":"2024-05-07T14:01:07.014767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011472+0000","last_change":"2024-05-07T14:00:55.962579+0000","last_active":"2024-05-07T14:01:07.011472+0000","last_peered":"2024-05-07T14:01:07.011472+0000","last_clean":"2024-05-07T14:01:07.011472+0000","last_became_active":"2024-05-07T14:00:55.961815+0000","last_became_peered":"2024-05-07T14:00:55.961815+0000","last_unstale":"2024-05-07T14:01:07.011472+0000","last_undegraded":"2024-05-07T14:01:07.011472+0000","last_fullsized":"2024-05-07T14:01:07.011472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043533+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:01:07.043533+0000","last_peered":"2024-05-07T14:01:07.043533+0000","last_clean":"2024-05-07T14:01:07.043533+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:01:07.043533+0000","last_undegraded":"2024-05-07T14:01:07.043533+0000","last_fullsized":"2024-05-07T14:01:07.043533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028241+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:01:07.028241+0000","last_peered":"2024-05-07T14:01:07.028241+0000","last_clean":"2024-05-07T14:01:07.028241+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:01:07.028241+0000","last_undegraded":"2024-05-07T14:01:07.028241+0000","last_fullsized":"2024-05-07T14:01:07.028241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.064044+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:01:07.064044+0000","last_peered":"2024-05-07T14:01:07.064044+0000","last_clean":"2024-05-07T14:01:07.064044+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:01:07.064044+0000","last_undegraded":"2024-05-07T14:01:07.064044+0000","last_fullsized":"2024-05-07T14:01:07.064044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014523+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:01:07.014523+0000","last_peered":"2024-05-07T14:01:07.014523+0000","last_clean":"2024-05-07T14:01:07.014523+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:01:07.014523+0000","last_undegraded":"2024-05-07T14:01:07.014523+0000","last_fullsized":"2024-05-07T14:01:07.014523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012206+0000","last_change":"2024-05-07T14:00:56.003776+0000","last_active":"2024-05-07T14:01:07.012206+0000","last_peered":"2024-05-07T14:01:07.012206+0000","last_clean":"2024-05-07T14:01:07.012206+0000","last_became_active":"2024-05-07T14:00:56.002996+0000","last_became_peered":"2024-05-07T14:00:56.002996+0000","last_unstale":"2024-05-07T14:01:07.012206+0000","last_undegraded":"2024-05-07T14:01:07.012206+0000","last_fullsized":"2024-05-07T14:01:07.012206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:17.583140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011336+0000","last_change":"2024-05-07T14:00:57.987026+0000","last_active":"2024-05-07T14:01:07.011336+0000","last_peered":"2024-05-07T14:01:07.011336+0000","last_clean":"2024-05-07T14:01:07.011336+0000","last_became_active":"2024-05-07T14:00:57.986048+0000","last_became_peered":"2024-05-07T14:00:57.986048+0000","last_unstale":"2024-05-07T14:01:07.011336+0000","last_undegraded":"2024-05-07T14:01:07.011336+0000","last_fullsized":"2024-05-07T14:01:07.011336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.048099+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:01:07.048099+0000","last_peered":"2024-05-07T14:01:07.048099+0000","last_clean":"2024-05-07T14:01:07.048099+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:01:07.048099+0000","last_undegraded":"2024-05-07T14:01:07.048099+0000","last_fullsized":"2024-05-07T14:01:07.048099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043347+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:01:07.043347+0000","last_peered":"2024-05-07T14:01:07.043347+0000","last_clean":"2024-05-07T14:01:07.043347+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:01:07.043347+0000","last_undegraded":"2024-05-07T14:01:07.043347+0000","last_fullsized":"2024-05-07T14:01:07.043347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047840+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:01:07.047840+0000","last_peered":"2024-05-07T14:01:07.047840+0000","last_clean":"2024-05-07T14:01:07.047840+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:01:07.047840+0000","last_undegraded":"2024-05-07T14:01:07.047840+0000","last_fullsized":"2024-05-07T14:01:07.047840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062799+0000","last_change":"2024-05-07T14:00:57.995304+0000","last_active":"2024-05-07T14:01:07.062799+0000","last_peered":"2024-05-07T14:01:07.062799+0000","last_clean":"2024-05-07T14:01:07.062799+0000","last_became_active":"2024-05-07T14:00:57.977809+0000","last_became_peered":"2024-05-07T14:00:57.977809+0000","last_unstale":"2024-05-07T14:01:07.062799+0000","last_undegraded":"2024-05-07T14:01:07.062799+0000","last_fullsized":"2024-05-07T14:01:07.062799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:42.772959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014571+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:01:07.014571+0000","last_peered":"2024-05-07T14:01:07.014571+0000","last_clean":"2024-05-07T14:01:07.014571+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:01:07.014571+0000","last_undegraded":"2024-05-07T14:01:07.014571+0000","last_fullsized":"2024-05-07T14:01:07.014571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.063763+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:01:07.063763+0000","last_peered":"2024-05-07T14:01:07.063763+0000","last_clean":"2024-05-07T14:01:07.063763+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:01:07.063763+0000","last_undegraded":"2024-05-07T14:01:07.063763+0000","last_fullsized":"2024-05-07T14:01:07.063763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028533+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:01:07.028533+0000","last_peered":"2024-05-07T14:01:07.028533+0000","last_clean":"2024-05-07T14:01:07.028533+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:01:07.028533+0000","last_undegraded":"2024-05-07T14:01:07.028533+0000","last_fullsized":"2024-05-07T14:01:07.028533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014927+0000","last_change":"2024-05-07T14:00:58.008214+0000","last_active":"2024-05-07T14:01:07.014927+0000","last_peered":"2024-05-07T14:01:07.014927+0000","last_clean":"2024-05-07T14:01:07.014927+0000","last_became_active":"2024-05-07T14:00:58.005516+0000","last_became_peered":"2024-05-07T14:00:58.005516+0000","last_unstale":"2024-05-07T14:01:07.014927+0000","last_undegraded":"2024-05-07T14:01:07.014927+0000","last_fullsized":"2024-05-07T14:01:07.014927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010119+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:01:07.010119+0000","last_peered":"2024-05-07T14:01:07.010119+0000","last_clean":"2024-05-07T14:01:07.010119+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:01:07.010119+0000","last_undegraded":"2024-05-07T14:01:07.010119+0000","last_fullsized":"2024-05-07T14:01:07.010119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.013823+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:01:07.013823+0000","last_peered":"2024-05-07T14:01:07.013823+0000","last_clean":"2024-05-07T14:01:07.013823+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:01:07.013823+0000","last_undegraded":"2024-05-07T14:01:07.013823+0000","last_fullsized":"2024-05-07T14:01:07.013823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029690+0000","last_change":"2024-05-07T14:00:57.988107+0000","last_active":"2024-05-07T14:01:07.029690+0000","last_peered":"2024-05-07T14:01:07.029690+0000","last_clean":"2024-05-07T14:01:07.029690+0000","last_became_active":"2024-05-07T14:00:57.987604+0000","last_became_peered":"2024-05-07T14:00:57.987604+0000","last_unstale":"2024-05-07T14:01:07.029690+0000","last_undegraded":"2024-05-07T14:01:07.029690+0000","last_fullsized":"2024-05-07T14:01:07.029690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011838+0000","last_change":"2024-05-07T14:00:55.975648+0000","last_active":"2024-05-07T14:01:07.011838+0000","last_peered":"2024-05-07T14:01:07.011838+0000","last_clean":"2024-05-07T14:01:07.011838+0000","last_became_active":"2024-05-07T14:00:55.974335+0000","last_became_peered":"2024-05-07T14:00:55.974335+0000","last_unstale":"2024-05-07T14:01:07.011838+0000","last_undegraded":"2024-05-07T14:01:07.011838+0000","last_fullsized":"2024-05-07T14:01:07.011838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043299+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:01:07.043299+0000","last_peered":"2024-05-07T14:01:07.043299+0000","last_clean":"2024-05-07T14:01:07.043299+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:01:07.043299+0000","last_undegraded":"2024-05-07T14:01:07.043299+0000","last_fullsized":"2024-05-07T14:01:07.043299+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.429425+0000","last_change":"2024-05-07T14:01:01.993679+0000","last_active":"2024-05-07T14:01:07.429425+0000","last_peered":"2024-05-07T14:01:07.429425+0000","last_clean":"2024-05-07T14:01:07.429425+0000","last_became_active":"2024-05-07T14:01:01.993241+0000","last_became_peered":"2024-05-07T14:01:01.993241+0000","last_unstale":"2024-05-07T14:01:07.429425+0000","last_undegraded":"2024-05-07T14:01:07.429425+0000","last_fullsized":"2024-05-07T14:01:07.429425+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011515+0000","last_change":"2024-05-07T14:01:04.017472+0000","last_active":"2024-05-07T14:01:07.011515+0000","last_peered":"2024-05-07T14:01:07.011515+0000","last_clean":"2024-05-07T14:01:07.011515+0000","last_became_active":"2024-05-07T14:01:04.016757+0000","last_became_peered":"2024-05-07T14:01:04.016757+0000","last_unstale":"2024-05-07T14:01:07.011515+0000","last_undegraded":"2024-05-07T14:01:07.011515+0000","last_fullsized":"2024-05-07T14:01:07.011515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042729+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:01:07.042729+0000","last_peered":"2024-05-07T14:01:07.042729+0000","last_clean":"2024-05-07T14:01:07.042729+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:01:07.042729+0000","last_undegraded":"2024-05-07T14:01:07.042729+0000","last_fullsized":"2024-05-07T14:01:07.042729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044362+0000","last_change":"2024-05-07T14:00:57.984789+0000","last_active":"2024-05-07T14:01:07.044362+0000","last_peered":"2024-05-07T14:01:07.044362+0000","last_clean":"2024-05-07T14:01:07.044362+0000","last_became_active":"2024-05-07T14:00:57.983524+0000","last_became_peered":"2024-05-07T14:00:57.983524+0000","last_unstale":"2024-05-07T14:01:07.044362+0000","last_undegraded":"2024-05-07T14:01:07.044362+0000","last_fullsized":"2024-05-07T14:01:07.044362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010345+0000","last_change":"2024-05-07T14:00:55.989797+0000","last_active":"2024-05-07T14:01:07.010345+0000","last_peered":"2024-05-07T14:01:07.010345+0000","last_clean":"2024-05-07T14:01:07.010345+0000","last_became_active":"2024-05-07T14:00:55.989449+0000","last_became_peered":"2024-05-07T14:00:55.989449+0000","last_unstale":"2024-05-07T14:01:07.010345+0000","last_undegraded":"2024-05-07T14:01:07.010345+0000","last_fullsized":"2024-05-07T14:01:07.010345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029228+0000","last_change":"2024-05-07T14:00:59.983880+0000","last_active":"2024-05-07T14:01:07.029228+0000","last_peered":"2024-05-07T14:01:07.029228+0000","last_clean":"2024-05-07T14:01:07.029228+0000","last_became_active":"2024-05-07T14:00:59.983186+0000","last_became_peered":"2024-05-07T14:00:59.983186+0000","last_unstale":"2024-05-07T14:01:07.029228+0000","last_undegraded":"2024-05-07T14:01:07.029228+0000","last_fullsized":"2024-05-07T14:01:07.029228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:27.067433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.810642+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:01:07.810642+0000","last_peered":"2024-05-07T14:01:07.810642+0000","last_clean":"2024-05-07T14:01:07.810642+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:01:07.810642+0000","last_undegraded":"2024-05-07T14:01:07.810642+0000","last_fullsized":"2024-05-07T14:01:07.810642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014939+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:01:07.014939+0000","last_peered":"2024-05-07T14:01:07.014939+0000","last_clean":"2024-05-07T14:01:07.014939+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:01:07.014939+0000","last_undegraded":"2024-05-07T14:01:07.014939+0000","last_fullsized":"2024-05-07T14:01:07.014939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.009796+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:01:07.009796+0000","last_peered":"2024-05-07T14:01:07.009796+0000","last_clean":"2024-05-07T14:01:07.009796+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:01:07.009796+0000","last_undegraded":"2024-05-07T14:01:07.009796+0000","last_fullsized":"2024-05-07T14:01:07.009796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011727+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:01:07.011727+0000","last_peered":"2024-05-07T14:01:07.011727+0000","last_clean":"2024-05-07T14:01:07.011727+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:01:07.011727+0000","last_undegraded":"2024-05-07T14:01:07.011727+0000","last_fullsized":"2024-05-07T14:01:07.011727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011585+0000","last_change":"2024-05-07T14:00:55.986233+0000","last_active":"2024-05-07T14:01:07.011585+0000","last_peered":"2024-05-07T14:01:07.011585+0000","last_clean":"2024-05-07T14:01:07.011585+0000","last_became_active":"2024-05-07T14:00:55.984927+0000","last_became_peered":"2024-05-07T14:00:55.984927+0000","last_unstale":"2024-05-07T14:01:07.011585+0000","last_undegraded":"2024-05-07T14:01:07.011585+0000","last_fullsized":"2024-05-07T14:01:07.011585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.032393+0000","last_change":"2024-05-07T14:00:59.992166+0000","last_active":"2024-05-07T14:01:07.032393+0000","last_peered":"2024-05-07T14:01:07.032393+0000","last_clean":"2024-05-07T14:01:07.032393+0000","last_became_active":"2024-05-07T14:00:59.991408+0000","last_became_peered":"2024-05-07T14:00:59.991408+0000","last_unstale":"2024-05-07T14:01:07.032393+0000","last_undegraded":"2024-05-07T14:01:07.032393+0000","last_fullsized":"2024-05-07T14:01:07.032393+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.866115+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:01:07.866115+0000","last_peered":"2024-05-07T14:01:07.866115+0000","last_clean":"2024-05-07T14:01:07.866115+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:01:07.866115+0000","last_undegraded":"2024-05-07T14:01:07.866115+0000","last_fullsized":"2024-05-07T14:01:07.866115+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.600205+0000","last_change":"2024-05-07T14:01:04.007238+0000","last_active":"2024-05-07T14:01:07.600205+0000","last_peered":"2024-05-07T14:01:07.600205+0000","last_clean":"2024-05-07T14:01:07.600205+0000","last_became_active":"2024-05-07T14:01:04.006204+0000","last_became_peered":"2024-05-07T14:01:04.006204+0000","last_unstale":"2024-05-07T14:01:07.600205+0000","last_undegraded":"2024-05-07T14:01:07.600205+0000","last_fullsized":"2024-05-07T14:01:07.600205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014365+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:01:07.014365+0000","last_peered":"2024-05-07T14:01:07.014365+0000","last_clean":"2024-05-07T14:01:07.014365+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:01:07.014365+0000","last_undegraded":"2024-05-07T14:01:07.014365+0000","last_fullsized":"2024-05-07T14:01:07.014365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.031726+0000","last_change":"2024-05-07T14:00:57.998824+0000","last_active":"2024-05-07T14:01:07.031726+0000","last_peered":"2024-05-07T14:01:07.031726+0000","last_clean":"2024-05-07T14:01:07.031726+0000","last_became_active":"2024-05-07T14:00:57.998316+0000","last_became_peered":"2024-05-07T14:00:57.998316+0000","last_unstale":"2024-05-07T14:01:07.031726+0000","last_undegraded":"2024-05-07T14:01:07.031726+0000","last_fullsized":"2024-05-07T14:01:07.031726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046090+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:01:07.046090+0000","last_peered":"2024-05-07T14:01:07.046090+0000","last_clean":"2024-05-07T14:01:07.046090+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:01:07.046090+0000","last_undegraded":"2024-05-07T14:01:07.046090+0000","last_fullsized":"2024-05-07T14:01:07.046090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043527+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:01:07.043527+0000","last_peered":"2024-05-07T14:01:07.043527+0000","last_clean":"2024-05-07T14:01:07.043527+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:01:07.043527+0000","last_undegraded":"2024-05-07T14:01:07.043527+0000","last_fullsized":"2024-05-07T14:01:07.043527+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.871853+0000","last_change":"2024-05-07T14:01:02.151107+0000","last_active":"2024-05-07T14:01:07.871853+0000","last_peered":"2024-05-07T14:01:07.871853+0000","last_clean":"2024-05-07T14:01:07.871853+0000","last_became_active":"2024-05-07T14:01:02.150351+0000","last_became_peered":"2024-05-07T14:01:02.150351+0000","last_unstale":"2024-05-07T14:01:07.871853+0000","last_undegraded":"2024-05-07T14:01:07.871853+0000","last_fullsized":"2024-05-07T14:01:07.871853+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:28:13.159757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.604006+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:01:07.604006+0000","last_peered":"2024-05-07T14:01:07.604006+0000","last_clean":"2024-05-07T14:01:07.604006+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:01:07.604006+0000","last_undegraded":"2024-05-07T14:01:07.604006+0000","last_fullsized":"2024-05-07T14:01:07.604006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042520+0000","last_change":"2024-05-07T14:00:57.979757+0000","last_active":"2024-05-07T14:01:07.042520+0000","last_peered":"2024-05-07T14:01:07.042520+0000","last_clean":"2024-05-07T14:01:07.042520+0000","last_became_active":"2024-05-07T14:00:57.979030+0000","last_became_peered":"2024-05-07T14:00:57.979030+0000","last_unstale":"2024-05-07T14:01:07.042520+0000","last_undegraded":"2024-05-07T14:01:07.042520+0000","last_fullsized":"2024-05-07T14:01:07.042520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012283+0000","last_change":"2024-05-07T14:00:55.980339+0000","last_active":"2024-05-07T14:01:07.012283+0000","last_peered":"2024-05-07T14:01:07.012283+0000","last_clean":"2024-05-07T14:01:07.012283+0000","last_became_active":"2024-05-07T14:00:55.979609+0000","last_became_peered":"2024-05-07T14:00:55.979609+0000","last_unstale":"2024-05-07T14:01:07.012283+0000","last_undegraded":"2024-05-07T14:01:07.012283+0000","last_fullsized":"2024-05-07T14:01:07.012283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:52.518278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010329+0000","last_change":"2024-05-07T14:00:59.982771+0000","last_active":"2024-05-07T14:01:07.010329+0000","last_peered":"2024-05-07T14:01:07.010329+0000","last_clean":"2024-05-07T14:01:07.010329+0000","last_became_active":"2024-05-07T14:00:59.982018+0000","last_became_peered":"2024-05-07T14:00:59.982018+0000","last_unstale":"2024-05-07T14:01:07.010329+0000","last_undegraded":"2024-05-07T14:01:07.010329+0000","last_fullsized":"2024-05-07T14:01:07.010329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:47.657483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.970711+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:01:07.970711+0000","last_peered":"2024-05-07T14:01:07.970711+0000","last_clean":"2024-05-07T14:01:07.970711+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:01:07.970711+0000","last_undegraded":"2024-05-07T14:01:07.970711+0000","last_fullsized":"2024-05-07T14:01:07.970711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.024708+0000","last_change":"2024-05-07T14:01:04.021895+0000","last_active":"2024-05-07T14:01:07.024708+0000","last_peered":"2024-05-07T14:01:07.024708+0000","last_clean":"2024-05-07T14:01:07.024708+0000","last_became_active":"2024-05-07T14:01:04.021043+0000","last_became_peered":"2024-05-07T14:01:04.021043+0000","last_unstale":"2024-05-07T14:01:07.024708+0000","last_undegraded":"2024-05-07T14:01:07.024708+0000","last_fullsized":"2024-05-07T14:01:07.024708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:58.601458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043212+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:01:07.043212+0000","last_peered":"2024-05-07T14:01:07.043212+0000","last_clean":"2024-05-07T14:01:07.043212+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:01:07.043212+0000","last_undegraded":"2024-05-07T14:01:07.043212+0000","last_fullsized":"2024-05-07T14:01:07.043212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016201+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:01:07.016201+0000","last_peered":"2024-05-07T14:01:07.016201+0000","last_clean":"2024-05-07T14:01:07.016201+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:01:07.016201+0000","last_undegraded":"2024-05-07T14:01:07.016201+0000","last_fullsized":"2024-05-07T14:01:07.016201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012063+0000","last_change":"2024-05-07T14:00:55.980488+0000","last_active":"2024-05-07T14:01:07.012063+0000","last_peered":"2024-05-07T14:01:07.012063+0000","last_clean":"2024-05-07T14:01:07.012063+0000","last_became_active":"2024-05-07T14:00:55.979688+0000","last_became_peered":"2024-05-07T14:00:55.979688+0000","last_unstale":"2024-05-07T14:01:07.012063+0000","last_undegraded":"2024-05-07T14:01:07.012063+0000","last_fullsized":"2024-05-07T14:01:07.012063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:32.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062272+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:01:07.062272+0000","last_peered":"2024-05-07T14:01:07.062272+0000","last_clean":"2024-05-07T14:01:07.062272+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:01:07.062272+0000","last_undegraded":"2024-05-07T14:01:07.062272+0000","last_fullsized":"2024-05-07T14:01:07.062272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.846471+0000","last_change":"2024-05-07T14:01:02.014265+0000","last_active":"2024-05-07T14:01:07.846471+0000","last_peered":"2024-05-07T14:01:07.846471+0000","last_clean":"2024-05-07T14:01:07.846471+0000","last_became_active":"2024-05-07T14:01:02.009335+0000","last_became_peered":"2024-05-07T14:01:02.009335+0000","last_unstale":"2024-05-07T14:01:07.846471+0000","last_undegraded":"2024-05-07T14:01:07.846471+0000","last_fullsized":"2024-05-07T14:01:07.846471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027424+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:01:07.027424+0000","last_peered":"2024-05-07T14:01:07.027424+0000","last_clean":"2024-05-07T14:01:07.027424+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:01:07.027424+0000","last_undegraded":"2024-05-07T14:01:07.027424+0000","last_fullsized":"2024-05-07T14:01:07.027424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047055+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:01:07.047055+0000","last_peered":"2024-05-07T14:01:07.047055+0000","last_clean":"2024-05-07T14:01:07.047055+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:01:07.047055+0000","last_undegraded":"2024-05-07T14:01:07.047055+0000","last_fullsized":"2024-05-07T14:01:07.047055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047036+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:01:07.047036+0000","last_peered":"2024-05-07T14:01:07.047036+0000","last_clean":"2024-05-07T14:01:07.047036+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:01:07.047036+0000","last_undegraded":"2024-05-07T14:01:07.047036+0000","last_fullsized":"2024-05-07T14:01:07.047036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.013487+0000","last_change":"2024-05-07T14:00:56.008026+0000","last_active":"2024-05-07T14:01:07.013487+0000","last_peered":"2024-05-07T14:01:07.013487+0000","last_clean":"2024-05-07T14:01:07.013487+0000","last_became_active":"2024-05-07T14:00:56.007374+0000","last_became_peered":"2024-05-07T14:00:56.007374+0000","last_unstale":"2024-05-07T14:01:07.013487+0000","last_undegraded":"2024-05-07T14:01:07.013487+0000","last_fullsized":"2024-05-07T14:01:07.013487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.063155+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:01:07.063155+0000","last_peered":"2024-05-07T14:01:07.063155+0000","last_clean":"2024-05-07T14:01:07.063155+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:01:07.063155+0000","last_undegraded":"2024-05-07T14:01:07.063155+0000","last_fullsized":"2024-05-07T14:01:07.063155+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.759117+0000","last_change":"2024-05-07T14:01:01.997489+0000","last_active":"2024-05-07T14:01:07.759117+0000","last_peered":"2024-05-07T14:01:07.759117+0000","last_clean":"2024-05-07T14:01:07.759117+0000","last_became_active":"2024-05-07T14:01:01.994656+0000","last_became_peered":"2024-05-07T14:01:01.994656+0000","last_unstale":"2024-05-07T14:01:07.759117+0000","last_undegraded":"2024-05-07T14:01:07.759117+0000","last_fullsized":"2024-05-07T14:01:07.759117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:12.091721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.609523+0000","last_change":"2024-05-07T14:01:04.009157+0000","last_active":"2024-05-07T14:01:07.609523+0000","last_peered":"2024-05-07T14:01:07.609523+0000","last_clean":"2024-05-07T14:01:07.609523+0000","last_became_active":"2024-05-07T14:01:04.008594+0000","last_became_peered":"2024-05-07T14:01:04.008594+0000","last_unstale":"2024-05-07T14:01:07.609523+0000","last_undegraded":"2024-05-07T14:01:07.609523+0000","last_fullsized":"2024-05-07T14:01:07.609523+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011204+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:01:07.011204+0000","last_peered":"2024-05-07T14:01:07.011204+0000","last_clean":"2024-05-07T14:01:07.011204+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:01:07.011204+0000","last_undegraded":"2024-05-07T14:01:07.011204+0000","last_fullsized":"2024-05-07T14:01:07.011204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012761+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:01:07.012761+0000","last_peered":"2024-05-07T14:01:07.012761+0000","last_clean":"2024-05-07T14:01:07.012761+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:01:07.012761+0000","last_undegraded":"2024-05-07T14:01:07.012761+0000","last_fullsized":"2024-05-07T14:01:07.012761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044345+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:01:07.044345+0000","last_peered":"2024-05-07T14:01:07.044345+0000","last_clean":"2024-05-07T14:01:07.044345+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:01:07.044345+0000","last_undegraded":"2024-05-07T14:01:07.044345+0000","last_fullsized":"2024-05-07T14:01:07.044345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062667+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:01:07.062667+0000","last_peered":"2024-05-07T14:01:07.062667+0000","last_clean":"2024-05-07T14:01:07.062667+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:01:07.062667+0000","last_undegraded":"2024-05-07T14:01:07.062667+0000","last_fullsized":"2024-05-07T14:01:07.062667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.384403+0000","last_change":"2024-05-07T14:01:01.995144+0000","last_active":"2024-05-07T14:01:07.384403+0000","last_peered":"2024-05-07T14:01:07.384403+0000","last_clean":"2024-05-07T14:01:07.384403+0000","last_became_active":"2024-05-07T14:01:01.993073+0000","last_became_peered":"2024-05-07T14:01:01.993073+0000","last_unstale":"2024-05-07T14:01:07.384403+0000","last_undegraded":"2024-05-07T14:01:07.384403+0000","last_fullsized":"2024-05-07T14:01:07.384403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:54.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062104+0000","last_change":"2024-05-07T14:01:04.012216+0000","last_active":"2024-05-07T14:01:07.062104+0000","last_peered":"2024-05-07T14:01:07.062104+0000","last_clean":"2024-05-07T14:01:07.062104+0000","last_became_active":"2024-05-07T14:01:04.011476+0000","last_became_peered":"2024-05-07T14:01:04.011476+0000","last_unstale":"2024-05-07T14:01:07.062104+0000","last_undegraded":"2024-05-07T14:01:07.062104+0000","last_fullsized":"2024-05-07T14:01:07.062104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:46.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027274+0000","last_change":"2024-05-07T14:01:06.024311+0000","last_active":"2024-05-07T14:01:07.027274+0000","last_peered":"2024-05-07T14:01:07.027274+0000","last_clean":"2024-05-07T14:01:07.027274+0000","last_became_active":"2024-05-07T14:01:06.023404+0000","last_became_peered":"2024-05-07T14:01:06.023404+0000","last_unstale":"2024-05-07T14:01:07.027274+0000","last_undegraded":"2024-05-07T14:01:07.027274+0000","last_fullsized":"2024-05-07T14:01:07.027274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:26.544302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015168+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:01:07.015168+0000","last_peered":"2024-05-07T14:01:07.015168+0000","last_clean":"2024-05-07T14:01:07.015168+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:01:07.015168+0000","last_undegraded":"2024-05-07T14:01:07.015168+0000","last_fullsized":"2024-05-07T14:01:07.015168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027553+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:01:07.027553+0000","last_peered":"2024-05-07T14:01:07.027553+0000","last_clean":"2024-05-07T14:01:07.027553+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:01:07.027553+0000","last_undegraded":"2024-05-07T14:01:07.027553+0000","last_fullsized":"2024-05-07T14:01:07.027553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062994+0000","last_change":"2024-05-07T14:00:59.992897+0000","last_active":"2024-05-07T14:01:07.062994+0000","last_peered":"2024-05-07T14:01:07.062994+0000","last_clean":"2024-05-07T14:01:07.062994+0000","last_became_active":"2024-05-07T14:00:59.992067+0000","last_became_peered":"2024-05-07T14:00:59.992067+0000","last_unstale":"2024-05-07T14:01:07.062994+0000","last_undegraded":"2024-05-07T14:01:07.062994+0000","last_fullsized":"2024-05-07T14:01:07.062994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:19.526884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.906371+0000","last_change":"2024-05-07T14:01:02.012335+0000","last_active":"2024-05-07T14:01:07.906371+0000","last_peered":"2024-05-07T14:01:07.906371+0000","last_clean":"2024-05-07T14:01:07.906371+0000","last_became_active":"2024-05-07T14:01:02.011651+0000","last_became_peered":"2024-05-07T14:01:02.011651+0000","last_unstale":"2024-05-07T14:01:07.906371+0000","last_undegraded":"2024-05-07T14:01:07.906371+0000","last_fullsized":"2024-05-07T14:01:07.906371+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011489+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:01:07.011489+0000","last_peered":"2024-05-07T14:01:07.011489+0000","last_clean":"2024-05-07T14:01:07.011489+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:01:07.011489+0000","last_undegraded":"2024-05-07T14:01:07.011489+0000","last_fullsized":"2024-05-07T14:01:07.011489+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027519+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:01:07.027519+0000","last_peered":"2024-05-07T14:01:07.027519+0000","last_clean":"2024-05-07T14:01:07.027519+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:01:07.027519+0000","last_undegraded":"2024-05-07T14:01:07.027519+0000","last_fullsized":"2024-05-07T14:01:07.027519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015273+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:01:07.015273+0000","last_peered":"2024-05-07T14:01:07.015273+0000","last_clean":"2024-05-07T14:01:07.015273+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:01:07.015273+0000","last_undegraded":"2024-05-07T14:01:07.015273+0000","last_fullsized":"2024-05-07T14:01:07.015273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047206+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:01:07.047206+0000","last_peered":"2024-05-07T14:01:07.047206+0000","last_clean":"2024-05-07T14:01:07.047206+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:01:07.047206+0000","last_undegraded":"2024-05-07T14:01:07.047206+0000","last_fullsized":"2024-05-07T14:01:07.047206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025080+0000","last_change":"2024-05-07T14:01:00.006802+0000","last_active":"2024-05-07T14:01:07.025080+0000","last_peered":"2024-05-07T14:01:07.025080+0000","last_clean":"2024-05-07T14:01:07.025080+0000","last_became_active":"2024-05-07T14:01:00.006254+0000","last_became_peered":"2024-05-07T14:01:00.006254+0000","last_unstale":"2024-05-07T14:01:07.025080+0000","last_undegraded":"2024-05-07T14:01:07.025080+0000","last_fullsized":"2024-05-07T14:01:07.025080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:40.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.978085+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:01:07.978085+0000","last_peered":"2024-05-07T14:01:07.978085+0000","last_clean":"2024-05-07T14:01:07.978085+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:01:07.978085+0000","last_undegraded":"2024-05-07T14:01:07.978085+0000","last_fullsized":"2024-05-07T14:01:07.978085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.605265+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:01:07.605265+0000","last_peered":"2024-05-07T14:01:07.605265+0000","last_clean":"2024-05-07T14:01:07.605265+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:01:07.605265+0000","last_undegraded":"2024-05-07T14:01:07.605265+0000","last_fullsized":"2024-05-07T14:01:07.605265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.024360+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:01:07.024360+0000","last_peered":"2024-05-07T14:01:07.024360+0000","last_clean":"2024-05-07T14:01:07.024360+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:01:07.024360+0000","last_undegraded":"2024-05-07T14:01:07.024360+0000","last_fullsized":"2024-05-07T14:01:07.024360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015867+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:01:07.015867+0000","last_peered":"2024-05-07T14:01:07.015867+0000","last_clean":"2024-05-07T14:01:07.015867+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:01:07.015867+0000","last_undegraded":"2024-05-07T14:01:07.015867+0000","last_fullsized":"2024-05-07T14:01:07.015867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.017024+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:01:07.017024+0000","last_peered":"2024-05-07T14:01:07.017024+0000","last_clean":"2024-05-07T14:01:07.017024+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:01:07.017024+0000","last_undegraded":"2024-05-07T14:01:07.017024+0000","last_fullsized":"2024-05-07T14:01:07.017024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043523+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:01:07.043523+0000","last_peered":"2024-05-07T14:01:07.043523+0000","last_clean":"2024-05-07T14:01:07.043523+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:01:07.043523+0000","last_undegraded":"2024-05-07T14:01:07.043523+0000","last_fullsized":"2024-05-07T14:01:07.043523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.766658+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:01:07.766658+0000","last_peered":"2024-05-07T14:01:07.766658+0000","last_clean":"2024-05-07T14:01:07.766658+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:01:07.766658+0000","last_undegraded":"2024-05-07T14:01:07.766658+0000","last_fullsized":"2024-05-07T14:01:07.766658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.599506+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:01:07.599506+0000","last_peered":"2024-05-07T14:01:07.599506+0000","last_clean":"2024-05-07T14:01:07.599506+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:01:07.599506+0000","last_undegraded":"2024-05-07T14:01:07.599506+0000","last_fullsized":"2024-05-07T14:01:07.599506+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015025+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:01:07.015025+0000","last_peered":"2024-05-07T14:01:07.015025+0000","last_clean":"2024-05-07T14:01:07.015025+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:01:07.015025+0000","last_undegraded":"2024-05-07T14:01:07.015025+0000","last_fullsized":"2024-05-07T14:01:07.015025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027946+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:01:07.027946+0000","last_peered":"2024-05-07T14:01:07.027946+0000","last_clean":"2024-05-07T14:01:07.027946+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:01:07.027946+0000","last_undegraded":"2024-05-07T14:01:07.027946+0000","last_fullsized":"2024-05-07T14:01:07.027946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028479+0000","last_change":"2024-05-07T14:00:55.974435+0000","last_active":"2024-05-07T14:01:07.028479+0000","last_peered":"2024-05-07T14:01:07.028479+0000","last_clean":"2024-05-07T14:01:07.028479+0000","last_became_active":"2024-05-07T14:00:55.974010+0000","last_became_peered":"2024-05-07T14:00:55.974010+0000","last_unstale":"2024-05-07T14:01:07.028479+0000","last_undegraded":"2024-05-07T14:01:07.028479+0000","last_fullsized":"2024-05-07T14:01:07.028479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015346+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:01:07.015346+0000","last_peered":"2024-05-07T14:01:07.015346+0000","last_clean":"2024-05-07T14:01:07.015346+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:01:07.015346+0000","last_undegraded":"2024-05-07T14:01:07.015346+0000","last_fullsized":"2024-05-07T14:01:07.015346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.899408+0000","last_change":"2024-05-07T14:01:02.013314+0000","last_active":"2024-05-07T14:01:07.899408+0000","last_peered":"2024-05-07T14:01:07.899408+0000","last_clean":"2024-05-07T14:01:07.899408+0000","last_became_active":"2024-05-07T14:01:02.012667+0000","last_became_peered":"2024-05-07T14:01:02.012667+0000","last_unstale":"2024-05-07T14:01:07.899408+0000","last_undegraded":"2024-05-07T14:01:07.899408+0000","last_fullsized":"2024-05-07T14:01:07.899408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046713+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:01:07.046713+0000","last_peered":"2024-05-07T14:01:07.046713+0000","last_clean":"2024-05-07T14:01:07.046713+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:01:07.046713+0000","last_undegraded":"2024-05-07T14:01:07.046713+0000","last_fullsized":"2024-05-07T14:01:07.046713+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028645+0000","last_change":"2024-05-07T14:01:06.031381+0000","last_active":"2024-05-07T14:01:07.028645+0000","last_peered":"2024-05-07T14:01:07.028645+0000","last_clean":"2024-05-07T14:01:07.028645+0000","last_became_active":"2024-05-07T14:01:06.030958+0000","last_became_peered":"2024-05-07T14:01:06.030958+0000","last_unstale":"2024-05-07T14:01:07.028645+0000","last_undegraded":"2024-05-07T14:01:07.028645+0000","last_fullsized":"2024-05-07T14:01:07.028645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:26.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047350+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:01:07.047350+0000","last_peered":"2024-05-07T14:01:07.047350+0000","last_clean":"2024-05-07T14:01:07.047350+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:01:07.047350+0000","last_undegraded":"2024-05-07T14:01:07.047350+0000","last_fullsized":"2024-05-07T14:01:07.047350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011084+0000","last_change":"2024-05-07T14:00:45.460158+0000","last_active":"2024-05-07T14:01:07.011084+0000","last_peered":"2024-05-07T14:01:07.011084+0000","last_clean":"2024-05-07T14:01:07.011084+0000","last_became_active":"2024-05-07T14:00:45.458198+0000","last_became_peered":"2024-05-07T14:00:45.458198+0000","last_unstale":"2024-05-07T14:01:07.011084+0000","last_undegraded":"2024-05-07T14:01:07.011084+0000","last_fullsized":"2024-05-07T14:01:07.011084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:18.582514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043517+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:01:07.043517+0000","last_peered":"2024-05-07T14:01:07.043517+0000","last_clean":"2024-05-07T14:01:07.043517+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:01:07.043517+0000","last_undegraded":"2024-05-07T14:01:07.043517+0000","last_fullsized":"2024-05-07T14:01:07.043517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028148+0000","last_change":"2024-05-07T14:00:56.012396+0000","last_active":"2024-05-07T14:01:07.028148+0000","last_peered":"2024-05-07T14:01:07.028148+0000","last_clean":"2024-05-07T14:01:07.028148+0000","last_became_active":"2024-05-07T14:00:56.012053+0000","last_became_peered":"2024-05-07T14:00:56.012053+0000","last_unstale":"2024-05-07T14:01:07.028148+0000","last_undegraded":"2024-05-07T14:01:07.028148+0000","last_fullsized":"2024-05-07T14:01:07.028148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011594+0000","last_change":"2024-05-07T14:00:59.988489+0000","last_active":"2024-05-07T14:01:07.011594+0000","last_peered":"2024-05-07T14:01:07.011594+0000","last_clean":"2024-05-07T14:01:07.011594+0000","last_became_active":"2024-05-07T14:00:59.987757+0000","last_became_peered":"2024-05-07T14:00:59.987757+0000","last_unstale":"2024-05-07T14:01:07.011594+0000","last_undegraded":"2024-05-07T14:01:07.011594+0000","last_fullsized":"2024-05-07T14:01:07.011594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.696329+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:01:07.696329+0000","last_peered":"2024-05-07T14:01:07.696329+0000","last_clean":"2024-05-07T14:01:07.696329+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:01:07.696329+0000","last_undegraded":"2024-05-07T14:01:07.696329+0000","last_fullsized":"2024-05-07T14:01:07.696329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011060+0000","last_change":"2024-05-07T14:01:04.007712+0000","last_active":"2024-05-07T14:01:07.011060+0000","last_peered":"2024-05-07T14:01:07.011060+0000","last_clean":"2024-05-07T14:01:07.011060+0000","last_became_active":"2024-05-07T14:01:04.006934+0000","last_became_peered":"2024-05-07T14:01:04.006934+0000","last_unstale":"2024-05-07T14:01:07.011060+0000","last_undegraded":"2024-05-07T14:01:07.011060+0000","last_fullsized":"2024-05-07T14:01:07.011060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046200+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:01:07.046200+0000","last_peered":"2024-05-07T14:01:07.046200+0000","last_clean":"2024-05-07T14:01:07.046200+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:01:07.046200+0000","last_undegraded":"2024-05-07T14:01:07.046200+0000","last_fullsized":"2024-05-07T14:01:07.046200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011461+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:01:07.011461+0000","last_peered":"2024-05-07T14:01:07.011461+0000","last_clean":"2024-05-07T14:01:07.011461+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:01:07.011461+0000","last_undegraded":"2024-05-07T14:01:07.011461+0000","last_fullsized":"2024-05-07T14:01:07.011461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010651+0000","last_change":"2024-05-07T14:00:49.930222+0000","last_active":"2024-05-07T14:01:07.010651+0000","last_peered":"2024-05-07T14:01:07.010651+0000","last_clean":"2024-05-07T14:01:07.010651+0000","last_became_active":"2024-05-07T14:00:49.929538+0000","last_became_peered":"2024-05-07T14:00:49.929538+0000","last_unstale":"2024-05-07T14:01:07.010651+0000","last_undegraded":"2024-05-07T14:01:07.010651+0000","last_fullsized":"2024-05-07T14:01:07.010651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:43.069683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010102+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:01:07.010102+0000","last_peered":"2024-05-07T14:01:07.010102+0000","last_clean":"2024-05-07T14:01:07.010102+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:01:07.010102+0000","last_undegraded":"2024-05-07T14:01:07.010102+0000","last_fullsized":"2024-05-07T14:01:07.010102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044653+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:01:07.044653+0000","last_peered":"2024-05-07T14:01:07.044653+0000","last_clean":"2024-05-07T14:01:07.044653+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:01:07.044653+0000","last_undegraded":"2024-05-07T14:01:07.044653+0000","last_fullsized":"2024-05-07T14:01:07.044653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.889465+0000","last_change":"2024-05-07T14:01:02.014645+0000","last_active":"2024-05-07T14:01:07.889465+0000","last_peered":"2024-05-07T14:01:07.889465+0000","last_clean":"2024-05-07T14:01:07.889465+0000","last_became_active":"2024-05-07T14:01:02.013904+0000","last_became_peered":"2024-05-07T14:01:02.013904+0000","last_unstale":"2024-05-07T14:01:07.889465+0000","last_undegraded":"2024-05-07T14:01:07.889465+0000","last_fullsized":"2024-05-07T14:01:07.889465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:31.441743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012459+0000","last_change":"2024-05-07T14:01:04.012527+0000","last_active":"2024-05-07T14:01:07.012459+0000","last_peered":"2024-05-07T14:01:07.012459+0000","last_clean":"2024-05-07T14:01:07.012459+0000","last_became_active":"2024-05-07T14:01:04.007658+0000","last_became_peered":"2024-05-07T14:01:04.007658+0000","last_unstale":"2024-05-07T14:01:07.012459+0000","last_undegraded":"2024-05-07T14:01:07.012459+0000","last_fullsized":"2024-05-07T14:01:07.012459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.024301+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:01:07.024301+0000","last_peered":"2024-05-07T14:01:07.024301+0000","last_clean":"2024-05-07T14:01:07.024301+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:01:07.024301+0000","last_undegraded":"2024-05-07T14:01:07.024301+0000","last_fullsized":"2024-05-07T14:01:07.024301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028167+0000","last_change":"2024-05-07T14:00:57.989314+0000","last_active":"2024-05-07T14:01:07.028167+0000","last_peered":"2024-05-07T14:01:07.028167+0000","last_clean":"2024-05-07T14:01:07.028167+0000","last_became_active":"2024-05-07T14:00:57.988994+0000","last_became_peered":"2024-05-07T14:00:57.988994+0000","last_unstale":"2024-05-07T14:01:07.028167+0000","last_undegraded":"2024-05-07T14:01:07.028167+0000","last_fullsized":"2024-05-07T14:01:07.028167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062525+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:01:07.062525+0000","last_peered":"2024-05-07T14:01:07.062525+0000","last_clean":"2024-05-07T14:01:07.062525+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:01:07.062525+0000","last_undegraded":"2024-05-07T14:01:07.062525+0000","last_fullsized":"2024-05-07T14:01:07.062525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.023960+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:01:07.023960+0000","last_peered":"2024-05-07T14:01:07.023960+0000","last_clean":"2024-05-07T14:01:07.023960+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:01:07.023960+0000","last_undegraded":"2024-05-07T14:01:07.023960+0000","last_fullsized":"2024-05-07T14:01:07.023960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.063525+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:01:07.063525+0000","last_peered":"2024-05-07T14:01:07.063525+0000","last_clean":"2024-05-07T14:01:07.063525+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:01:07.063525+0000","last_undegraded":"2024-05-07T14:01:07.063525+0000","last_fullsized":"2024-05-07T14:01:07.063525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.895494+0000","last_change":"2024-05-07T14:01:02.148182+0000","last_active":"2024-05-07T14:01:07.895494+0000","last_peered":"2024-05-07T14:01:07.895494+0000","last_clean":"2024-05-07T14:01:07.895494+0000","last_became_active":"2024-05-07T14:01:02.147442+0000","last_became_peered":"2024-05-07T14:01:02.147442+0000","last_unstale":"2024-05-07T14:01:07.895494+0000","last_undegraded":"2024-05-07T14:01:07.895494+0000","last_fullsized":"2024-05-07T14:01:07.895494+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:24.955989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010197+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:01:07.010197+0000","last_peered":"2024-05-07T14:01:07.010197+0000","last_clean":"2024-05-07T14:01:07.010197+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:01:07.010197+0000","last_undegraded":"2024-05-07T14:01:07.010197+0000","last_fullsized":"2024-05-07T14:01:07.010197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029153+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:01:07.029153+0000","last_peered":"2024-05-07T14:01:07.029153+0000","last_clean":"2024-05-07T14:01:07.029153+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:01:07.029153+0000","last_undegraded":"2024-05-07T14:01:07.029153+0000","last_fullsized":"2024-05-07T14:01:07.029153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025593+0000","last_change":"2024-05-07T14:00:57.997894+0000","last_active":"2024-05-07T14:01:07.025593+0000","last_peered":"2024-05-07T14:01:07.025593+0000","last_clean":"2024-05-07T14:01:07.025593+0000","last_became_active":"2024-05-07T14:00:57.997336+0000","last_became_peered":"2024-05-07T14:00:57.997336+0000","last_unstale":"2024-05-07T14:01:07.025593+0000","last_undegraded":"2024-05-07T14:01:07.025593+0000","last_fullsized":"2024-05-07T14:01:07.025593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044124+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:01:07.044124+0000","last_peered":"2024-05-07T14:01:07.044124+0000","last_clean":"2024-05-07T14:01:07.044124+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:01:07.044124+0000","last_undegraded":"2024-05-07T14:01:07.044124+0000","last_fullsized":"2024-05-07T14:01:07.044124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016572+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:01:07.016572+0000","last_peered":"2024-05-07T14:01:07.016572+0000","last_clean":"2024-05-07T14:01:07.016572+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:01:07.016572+0000","last_undegraded":"2024-05-07T14:01:07.016572+0000","last_fullsized":"2024-05-07T14:01:07.016572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010509+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:01:07.010509+0000","last_peered":"2024-05-07T14:01:07.010509+0000","last_clean":"2024-05-07T14:01:07.010509+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:01:07.010509+0000","last_undegraded":"2024-05-07T14:01:07.010509+0000","last_fullsized":"2024-05-07T14:01:07.010509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.731049+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:01:07.731049+0000","last_peered":"2024-05-07T14:01:07.731049+0000","last_clean":"2024-05-07T14:01:07.731049+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:01:07.731049+0000","last_undegraded":"2024-05-07T14:01:07.731049+0000","last_fullsized":"2024-05-07T14:01:07.731049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047626+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:01:07.047626+0000","last_peered":"2024-05-07T14:01:07.047626+0000","last_clean":"2024-05-07T14:01:07.047626+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:01:07.047626+0000","last_undegraded":"2024-05-07T14:01:07.047626+0000","last_fullsized":"2024-05-07T14:01:07.047626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.041987+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:01:07.041987+0000","last_peered":"2024-05-07T14:01:07.041987+0000","last_clean":"2024-05-07T14:01:07.041987+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:01:07.041987+0000","last_undegraded":"2024-05-07T14:01:07.041987+0000","last_fullsized":"2024-05-07T14:01:07.041987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025204+0000","last_change":"2024-05-07T14:00:57.989747+0000","last_active":"2024-05-07T14:01:07.025204+0000","last_peered":"2024-05-07T14:01:07.025204+0000","last_clean":"2024-05-07T14:01:07.025204+0000","last_became_active":"2024-05-07T14:00:57.989252+0000","last_became_peered":"2024-05-07T14:00:57.989252+0000","last_unstale":"2024-05-07T14:01:07.025204+0000","last_undegraded":"2024-05-07T14:01:07.025204+0000","last_fullsized":"2024-05-07T14:01:07.025204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:44.815601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044687+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:01:07.044687+0000","last_peered":"2024-05-07T14:01:07.044687+0000","last_clean":"2024-05-07T14:01:07.044687+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:01:07.044687+0000","last_undegraded":"2024-05-07T14:01:07.044687+0000","last_fullsized":"2024-05-07T14:01:07.044687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025917+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:01:07.025917+0000","last_peered":"2024-05-07T14:01:07.025917+0000","last_clean":"2024-05-07T14:01:07.025917+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:01:07.025917+0000","last_undegraded":"2024-05-07T14:01:07.025917+0000","last_fullsized":"2024-05-07T14:01:07.025917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011317+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:01:07.011317+0000","last_peered":"2024-05-07T14:01:07.011317+0000","last_clean":"2024-05-07T14:01:07.011317+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:01:07.011317+0000","last_undegraded":"2024-05-07T14:01:07.011317+0000","last_fullsized":"2024-05-07T14:01:07.011317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.824750+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:01:07.824750+0000","last_peered":"2024-05-07T14:01:07.824750+0000","last_clean":"2024-05-07T14:01:07.824750+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:01:07.824750+0000","last_undegraded":"2024-05-07T14:01:07.824750+0000","last_fullsized":"2024-05-07T14:01:07.824750+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015390+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:01:07.015390+0000","last_peered":"2024-05-07T14:01:07.015390+0000","last_clean":"2024-05-07T14:01:07.015390+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:01:07.015390+0000","last_undegraded":"2024-05-07T14:01:07.015390+0000","last_fullsized":"2024-05-07T14:01:07.015390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010327+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:01:07.010327+0000","last_peered":"2024-05-07T14:01:07.010327+0000","last_clean":"2024-05-07T14:01:07.010327+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:01:07.010327+0000","last_undegraded":"2024-05-07T14:01:07.010327+0000","last_fullsized":"2024-05-07T14:01:07.010327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012686+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:01:07.012686+0000","last_peered":"2024-05-07T14:01:07.012686+0000","last_clean":"2024-05-07T14:01:07.012686+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:01:07.012686+0000","last_undegraded":"2024-05-07T14:01:07.012686+0000","last_fullsized":"2024-05-07T14:01:07.012686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025694+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:01:07.025694+0000","last_peered":"2024-05-07T14:01:07.025694+0000","last_clean":"2024-05-07T14:01:07.025694+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:01:07.025694+0000","last_undegraded":"2024-05-07T14:01:07.025694+0000","last_fullsized":"2024-05-07T14:01:07.025694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.013737+0000","last_change":"2024-05-07T14:00:49.928907+0000","last_active":"2024-05-07T14:01:07.013737+0000","last_peered":"2024-05-07T14:01:07.013737+0000","last_clean":"2024-05-07T14:01:07.013737+0000","last_became_active":"2024-05-07T14:00:49.928146+0000","last_became_peered":"2024-05-07T14:00:49.928146+0000","last_unstale":"2024-05-07T14:01:07.013737+0000","last_undegraded":"2024-05-07T14:01:07.013737+0000","last_fullsized":"2024-05-07T14:01:07.013737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:07.032835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046678+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:01:07.046678+0000","last_peered":"2024-05-07T14:01:07.046678+0000","last_clean":"2024-05-07T14:01:07.046678+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:01:07.046678+0000","last_undegraded":"2024-05-07T14:01:07.046678+0000","last_fullsized":"2024-05-07T14:01:07.046678+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.922042+0000","last_change":"2024-05-07T14:01:02.148499+0000","last_active":"2024-05-07T14:01:07.922042+0000","last_peered":"2024-05-07T14:01:07.922042+0000","last_clean":"2024-05-07T14:01:07.922042+0000","last_became_active":"2024-05-07T14:01:02.147567+0000","last_became_peered":"2024-05-07T14:01:02.147567+0000","last_unstale":"2024-05-07T14:01:07.922042+0000","last_undegraded":"2024-05-07T14:01:07.922042+0000","last_fullsized":"2024-05-07T14:01:07.922042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:30.162886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.596630+0000","last_change":"2024-05-07T14:01:04.015930+0000","last_active":"2024-05-07T14:01:07.596630+0000","last_peered":"2024-05-07T14:01:07.596630+0000","last_clean":"2024-05-07T14:01:07.596630+0000","last_became_active":"2024-05-07T14:01:04.011643+0000","last_became_peered":"2024-05-07T14:01:04.011643+0000","last_unstale":"2024-05-07T14:01:07.596630+0000","last_undegraded":"2024-05-07T14:01:07.596630+0000","last_fullsized":"2024-05-07T14:01:07.596630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.032232+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:01:07.032232+0000","last_peered":"2024-05-07T14:01:07.032232+0000","last_clean":"2024-05-07T14:01:07.032232+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:01:07.032232+0000","last_undegraded":"2024-05-07T14:01:07.032232+0000","last_fullsized":"2024-05-07T14:01:07.032232+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027842+0000","last_change":"2024-05-07T14:00:57.998539+0000","last_active":"2024-05-07T14:01:07.027842+0000","last_peered":"2024-05-07T14:01:07.027842+0000","last_clean":"2024-05-07T14:01:07.027842+0000","last_became_active":"2024-05-07T14:00:57.998025+0000","last_became_peered":"2024-05-07T14:00:57.998025+0000","last_unstale":"2024-05-07T14:01:07.027842+0000","last_undegraded":"2024-05-07T14:01:07.027842+0000","last_fullsized":"2024-05-07T14:01:07.027842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.031493+0000","last_change":"2024-05-07T14:00:55.988508+0000","last_active":"2024-05-07T14:01:07.031493+0000","last_peered":"2024-05-07T14:01:07.031493+0000","last_clean":"2024-05-07T14:01:07.031493+0000","last_became_active":"2024-05-07T14:00:55.988230+0000","last_became_peered":"2024-05-07T14:00:55.988230+0000","last_unstale":"2024-05-07T14:01:07.031493+0000","last_undegraded":"2024-05-07T14:01:07.031493+0000","last_fullsized":"2024-05-07T14:01:07.031493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.026724+0000","last_change":"2024-05-07T14:00:49.936072+0000","last_active":"2024-05-07T14:01:07.026724+0000","last_peered":"2024-05-07T14:01:07.026724+0000","last_clean":"2024-05-07T14:01:07.026724+0000","last_became_active":"2024-05-07T14:00:49.935768+0000","last_became_peered":"2024-05-07T14:00:49.935768+0000","last_unstale":"2024-05-07T14:01:07.026724+0000","last_undegraded":"2024-05-07T14:01:07.026724+0000","last_fullsized":"2024-05-07T14:01:07.026724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015170+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:01:07.015170+0000","last_peered":"2024-05-07T14:01:07.015170+0000","last_clean":"2024-05-07T14:01:07.015170+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:01:07.015170+0000","last_undegraded":"2024-05-07T14:01:07.015170+0000","last_fullsized":"2024-05-07T14:01:07.015170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.878366+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:01:07.878366+0000","last_peered":"2024-05-07T14:01:07.878366+0000","last_clean":"2024-05-07T14:01:07.878366+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:01:07.878366+0000","last_undegraded":"2024-05-07T14:01:07.878366+0000","last_fullsized":"2024-05-07T14:01:07.878366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.603991+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:01:07.603991+0000","last_peered":"2024-05-07T14:01:07.603991+0000","last_clean":"2024-05-07T14:01:07.603991+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:01:07.603991+0000","last_undegraded":"2024-05-07T14:01:07.603991+0000","last_fullsized":"2024-05-07T14:01:07.603991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010600+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:01:07.010600+0000","last_peered":"2024-05-07T14:01:07.010600+0000","last_clean":"2024-05-07T14:01:07.010600+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:01:07.010600+0000","last_undegraded":"2024-05-07T14:01:07.010600+0000","last_fullsized":"2024-05-07T14:01:07.010600+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016763+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:01:07.016763+0000","last_peered":"2024-05-07T14:01:07.016763+0000","last_clean":"2024-05-07T14:01:07.016763+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:01:07.016763+0000","last_undegraded":"2024-05-07T14:01:07.016763+0000","last_fullsized":"2024-05-07T14:01:07.016763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012426+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:01:07.012426+0000","last_peered":"2024-05-07T14:01:07.012426+0000","last_clean":"2024-05-07T14:01:07.012426+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:01:07.012426+0000","last_undegraded":"2024-05-07T14:01:07.012426+0000","last_fullsized":"2024-05-07T14:01:07.012426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.048093+0000","last_change":"2024-05-07T14:00:49.938879+0000","last_active":"2024-05-07T14:01:07.048093+0000","last_peered":"2024-05-07T14:01:07.048093+0000","last_clean":"2024-05-07T14:01:07.048093+0000","last_became_active":"2024-05-07T14:00:49.938066+0000","last_became_peered":"2024-05-07T14:00:49.938066+0000","last_unstale":"2024-05-07T14:01:07.048093+0000","last_undegraded":"2024-05-07T14:01:07.048093+0000","last_fullsized":"2024-05-07T14:01:07.048093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027538+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:01:07.027538+0000","last_peered":"2024-05-07T14:01:07.027538+0000","last_clean":"2024-05-07T14:01:07.027538+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:01:07.027538+0000","last_undegraded":"2024-05-07T14:01:07.027538+0000","last_fullsized":"2024-05-07T14:01:07.027538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.858831+0000","last_change":"2024-05-07T14:01:02.148095+0000","last_active":"2024-05-07T14:01:07.858831+0000","last_peered":"2024-05-07T14:01:07.858831+0000","last_clean":"2024-05-07T14:01:07.858831+0000","last_became_active":"2024-05-07T14:01:02.147334+0000","last_became_peered":"2024-05-07T14:01:02.147334+0000","last_unstale":"2024-05-07T14:01:07.858831+0000","last_undegraded":"2024-05-07T14:01:07.858831+0000","last_fullsized":"2024-05-07T14:01:07.858831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027574+0000","last_change":"2024-05-07T14:01:04.024279+0000","last_active":"2024-05-07T14:01:07.027574+0000","last_peered":"2024-05-07T14:01:07.027574+0000","last_clean":"2024-05-07T14:01:07.027574+0000","last_became_active":"2024-05-07T14:01:04.022870+0000","last_became_peered":"2024-05-07T14:01:04.022870+0000","last_unstale":"2024-05-07T14:01:07.027574+0000","last_undegraded":"2024-05-07T14:01:07.027574+0000","last_fullsized":"2024-05-07T14:01:07.027574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:28.158572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043139+0000","last_change":"2024-05-07T14:01:06.039788+0000","last_active":"2024-05-07T14:01:07.043139+0000","last_peered":"2024-05-07T14:01:07.043139+0000","last_clean":"2024-05-07T14:01:07.043139+0000","last_became_active":"2024-05-07T14:01:06.039050+0000","last_became_peered":"2024-05-07T14:01:06.039050+0000","last_unstale":"2024-05-07T14:01:07.043139+0000","last_undegraded":"2024-05-07T14:01:07.043139+0000","last_fullsized":"2024-05-07T14:01:07.043139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011353+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:01:07.011353+0000","last_peered":"2024-05-07T14:01:07.011353+0000","last_clean":"2024-05-07T14:01:07.011353+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:01:07.011353+0000","last_undegraded":"2024-05-07T14:01:07.011353+0000","last_fullsized":"2024-05-07T14:01:07.011353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015772+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:01:07.015772+0000","last_peered":"2024-05-07T14:01:07.015772+0000","last_clean":"2024-05-07T14:01:07.015772+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:01:07.015772+0000","last_undegraded":"2024-05-07T14:01:07.015772+0000","last_fullsized":"2024-05-07T14:01:07.015772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014291+0000","last_change":"2024-05-07T14:00:55.991934+0000","last_active":"2024-05-07T14:01:07.014291+0000","last_peered":"2024-05-07T14:01:07.014291+0000","last_clean":"2024-05-07T14:01:07.014291+0000","last_became_active":"2024-05-07T14:00:55.991303+0000","last_became_peered":"2024-05-07T14:00:55.991303+0000","last_unstale":"2024-05-07T14:01:07.014291+0000","last_undegraded":"2024-05-07T14:01:07.014291+0000","last_fullsized":"2024-05-07T14:01:07.014291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025589+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:01:07.025589+0000","last_peered":"2024-05-07T14:01:07.025589+0000","last_clean":"2024-05-07T14:01:07.025589+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:01:07.025589+0000","last_undegraded":"2024-05-07T14:01:07.025589+0000","last_fullsized":"2024-05-07T14:01:07.025589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.929409+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:01:07.929409+0000","last_peered":"2024-05-07T14:01:07.929409+0000","last_clean":"2024-05-07T14:01:07.929409+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:01:07.929409+0000","last_undegraded":"2024-05-07T14:01:07.929409+0000","last_fullsized":"2024-05-07T14:01:07.929409+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027227+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:01:07.027227+0000","last_peered":"2024-05-07T14:01:07.027227+0000","last_clean":"2024-05-07T14:01:07.027227+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:01:07.027227+0000","last_undegraded":"2024-05-07T14:01:07.027227+0000","last_fullsized":"2024-05-07T14:01:07.027227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029856+0000","last_change":"2024-05-07T14:01:06.013974+0000","last_active":"2024-05-07T14:01:07.029856+0000","last_peered":"2024-05-07T14:01:07.029856+0000","last_clean":"2024-05-07T14:01:07.029856+0000","last_became_active":"2024-05-07T14:01:06.013281+0000","last_became_peered":"2024-05-07T14:01:06.013281+0000","last_unstale":"2024-05-07T14:01:07.029856+0000","last_undegraded":"2024-05-07T14:01:07.029856+0000","last_fullsized":"2024-05-07T14:01:07.029856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:46.349394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.024954+0000","last_change":"2024-05-07T14:00:58.001752+0000","last_active":"2024-05-07T14:01:07.024954+0000","last_peered":"2024-05-07T14:01:07.024954+0000","last_clean":"2024-05-07T14:01:07.024954+0000","last_became_active":"2024-05-07T14:00:57.999982+0000","last_became_peered":"2024-05-07T14:00:57.999982+0000","last_unstale":"2024-05-07T14:01:07.024954+0000","last_undegraded":"2024-05-07T14:01:07.024954+0000","last_fullsized":"2024-05-07T14:01:07.024954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.013312+0000","last_change":"2024-05-07T14:00:55.968287+0000","last_active":"2024-05-07T14:01:07.013312+0000","last_peered":"2024-05-07T14:01:07.013312+0000","last_clean":"2024-05-07T14:01:07.013312+0000","last_became_active":"2024-05-07T14:00:55.967578+0000","last_became_peered":"2024-05-07T14:00:55.967578+0000","last_unstale":"2024-05-07T14:01:07.013312+0000","last_undegraded":"2024-05-07T14:01:07.013312+0000","last_fullsized":"2024-05-07T14:01:07.013312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028727+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:01:07.028727+0000","last_peered":"2024-05-07T14:01:07.028727+0000","last_clean":"2024-05-07T14:01:07.028727+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:01:07.028727+0000","last_undegraded":"2024-05-07T14:01:07.028727+0000","last_fullsized":"2024-05-07T14:01:07.028727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'4","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.392985+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:01:07.392985+0000","last_peered":"2024-05-07T14:01:07.392985+0000","last_clean":"2024-05-07T14:01:07.392985+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:01:07.392985+0000","last_undegraded":"2024-05-07T14:01:07.392985+0000","last_fullsized":"2024-05-07T14:01:07.392985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011210+0000","last_change":"2024-05-07T14:01:04.012628+0000","last_active":"2024-05-07T14:01:07.011210+0000","last_peered":"2024-05-07T14:01:07.011210+0000","last_clean":"2024-05-07T14:01:07.011210+0000","last_became_active":"2024-05-07T14:01:04.011910+0000","last_became_peered":"2024-05-07T14:01:04.011910+0000","last_unstale":"2024-05-07T14:01:07.011210+0000","last_undegraded":"2024-05-07T14:01:07.011210+0000","last_fullsized":"2024-05-07T14:01:07.011210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010377+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:01:07.010377+0000","last_peered":"2024-05-07T14:01:07.010377+0000","last_clean":"2024-05-07T14:01:07.010377+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:01:07.010377+0000","last_undegraded":"2024-05-07T14:01:07.010377+0000","last_fullsized":"2024-05-07T14:01:07.010377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027594+0000","last_change":"2024-05-07T14:00:57.999019+0000","last_active":"2024-05-07T14:01:07.027594+0000","last_peered":"2024-05-07T14:01:07.027594+0000","last_clean":"2024-05-07T14:01:07.027594+0000","last_became_active":"2024-05-07T14:00:57.998526+0000","last_became_peered":"2024-05-07T14:00:57.998526+0000","last_unstale":"2024-05-07T14:01:07.027594+0000","last_undegraded":"2024-05-07T14:01:07.027594+0000","last_fullsized":"2024-05-07T14:01:07.027594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044521+0000","last_change":"2024-05-07T14:00:55.999548+0000","last_active":"2024-05-07T14:01:07.044521+0000","last_peered":"2024-05-07T14:01:07.044521+0000","last_clean":"2024-05-07T14:01:07.044521+0000","last_became_active":"2024-05-07T14:00:55.995284+0000","last_became_peered":"2024-05-07T14:00:55.995284+0000","last_unstale":"2024-05-07T14:01:07.044521+0000","last_undegraded":"2024-05-07T14:01:07.044521+0000","last_fullsized":"2024-05-07T14:01:07.044521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.009902+0000","last_change":"2024-05-07T14:00:59.996971+0000","last_active":"2024-05-07T14:01:07.009902+0000","last_peered":"2024-05-07T14:01:07.009902+0000","last_clean":"2024-05-07T14:01:07.009902+0000","last_became_active":"2024-05-07T14:00:59.996254+0000","last_became_peered":"2024-05-07T14:00:59.996254+0000","last_unstale":"2024-05-07T14:01:07.009902+0000","last_undegraded":"2024-05-07T14:01:07.009902+0000","last_fullsized":"2024-05-07T14:01:07.009902+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.839209+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:01:07.839209+0000","last_peered":"2024-05-07T14:01:07.839209+0000","last_clean":"2024-05-07T14:01:07.839209+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:01:07.839209+0000","last_undegraded":"2024-05-07T14:01:07.839209+0000","last_fullsized":"2024-05-07T14:01:07.839209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046685+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:01:07.046685+0000","last_peered":"2024-05-07T14:01:07.046685+0000","last_clean":"2024-05-07T14:01:07.046685+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:01:07.046685+0000","last_undegraded":"2024-05-07T14:01:07.046685+0000","last_fullsized":"2024-05-07T14:01:07.046685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042749+0000","last_change":"2024-05-07T14:01:06.038138+0000","last_active":"2024-05-07T14:01:07.042749+0000","last_peered":"2024-05-07T14:01:07.042749+0000","last_clean":"2024-05-07T14:01:07.042749+0000","last_became_active":"2024-05-07T14:01:06.030966+0000","last_became_peered":"2024-05-07T14:01:06.030966+0000","last_unstale":"2024-05-07T14:01:07.042749+0000","last_undegraded":"2024-05-07T14:01:07.042749+0000","last_fullsized":"2024-05-07T14:01:07.042749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028070+0000","last_change":"2024-05-07T14:00:57.987879+0000","last_active":"2024-05-07T14:01:07.028070+0000","last_peered":"2024-05-07T14:01:07.028070+0000","last_clean":"2024-05-07T14:01:07.028070+0000","last_became_active":"2024-05-07T14:00:57.987544+0000","last_became_peered":"2024-05-07T14:00:57.987544+0000","last_unstale":"2024-05-07T14:01:07.028070+0000","last_undegraded":"2024-05-07T14:01:07.028070+0000","last_fullsized":"2024-05-07T14:01:07.028070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012504+0000","last_change":"2024-05-07T14:00:56.007067+0000","last_active":"2024-05-07T14:01:07.012504+0000","last_peered":"2024-05-07T14:01:07.012504+0000","last_clean":"2024-05-07T14:01:07.012504+0000","last_became_active":"2024-05-07T14:00:56.006885+0000","last_became_peered":"2024-05-07T14:00:56.006885+0000","last_unstale":"2024-05-07T14:01:07.012504+0000","last_undegraded":"2024-05-07T14:01:07.012504+0000","last_fullsized":"2024-05-07T14:01:07.012504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046384+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:01:07.046384+0000","last_peered":"2024-05-07T14:01:07.046384+0000","last_clean":"2024-05-07T14:01:07.046384+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:01:07.046384+0000","last_undegraded":"2024-05-07T14:01:07.046384+0000","last_fullsized":"2024-05-07T14:01:07.046384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.614133+0000","last_change":"2024-05-07T14:01:01.995377+0000","last_active":"2024-05-07T14:01:07.614133+0000","last_peered":"2024-05-07T14:01:07.614133+0000","last_clean":"2024-05-07T14:01:07.614133+0000","last_became_active":"2024-05-07T14:01:01.994566+0000","last_became_peered":"2024-05-07T14:01:01.994566+0000","last_unstale":"2024-05-07T14:01:07.614133+0000","last_undegraded":"2024-05-07T14:01:07.614133+0000","last_fullsized":"2024-05-07T14:01:07.614133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010363+0000","last_change":"2024-05-07T14:01:03.997116+0000","last_active":"2024-05-07T14:01:07.010363+0000","last_peered":"2024-05-07T14:01:07.010363+0000","last_clean":"2024-05-07T14:01:07.010363+0000","last_became_active":"2024-05-07T14:01:03.996555+0000","last_became_peered":"2024-05-07T14:01:03.996555+0000","last_unstale":"2024-05-07T14:01:07.010363+0000","last_undegraded":"2024-05-07T14:01:07.010363+0000","last_fullsized":"2024-05-07T14:01:07.010363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047934+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:01:07.047934+0000","last_peered":"2024-05-07T14:01:07.047934+0000","last_clean":"2024-05-07T14:01:07.047934+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:01:07.047934+0000","last_undegraded":"2024-05-07T14:01:07.047934+0000","last_fullsized":"2024-05-07T14:01:07.047934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028280+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:01:07.028280+0000","last_peered":"2024-05-07T14:01:07.028280+0000","last_clean":"2024-05-07T14:01:07.028280+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:01:07.028280+0000","last_undegraded":"2024-05-07T14:01:07.028280+0000","last_fullsized":"2024-05-07T14:01:07.028280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011184+0000","last_change":"2024-05-07T14:00:59.995694+0000","last_active":"2024-05-07T14:01:07.011184+0000","last_peered":"2024-05-07T14:01:07.011184+0000","last_clean":"2024-05-07T14:01:07.011184+0000","last_became_active":"2024-05-07T14:00:59.993899+0000","last_became_peered":"2024-05-07T14:00:59.993899+0000","last_unstale":"2024-05-07T14:01:07.011184+0000","last_undegraded":"2024-05-07T14:01:07.011184+0000","last_fullsized":"2024-05-07T14:01:07.011184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:28.225348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.958152+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:01:07.958152+0000","last_peered":"2024-05-07T14:01:07.958152+0000","last_clean":"2024-05-07T14:01:07.958152+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:01:07.958152+0000","last_undegraded":"2024-05-07T14:01:07.958152+0000","last_fullsized":"2024-05-07T14:01:07.958152+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043430+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:01:07.043430+0000","last_peered":"2024-05-07T14:01:07.043430+0000","last_clean":"2024-05-07T14:01:07.043430+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:01:07.043430+0000","last_undegraded":"2024-05-07T14:01:07.043430+0000","last_fullsized":"2024-05-07T14:01:07.043430+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.028077+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:01:07.028077+0000","last_peered":"2024-05-07T14:01:07.028077+0000","last_clean":"2024-05-07T14:01:07.028077+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:01:07.028077+0000","last_undegraded":"2024-05-07T14:01:07.028077+0000","last_fullsized":"2024-05-07T14:01:07.028077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011422+0000","last_change":"2024-05-07T14:00:57.995989+0000","last_active":"2024-05-07T14:01:07.011422+0000","last_peered":"2024-05-07T14:01:07.011422+0000","last_clean":"2024-05-07T14:01:07.011422+0000","last_became_active":"2024-05-07T14:00:57.995721+0000","last_became_peered":"2024-05-07T14:00:57.995721+0000","last_unstale":"2024-05-07T14:01:07.011422+0000","last_undegraded":"2024-05-07T14:01:07.011422+0000","last_fullsized":"2024-05-07T14:01:07.011422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.024988+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:01:07.024988+0000","last_peered":"2024-05-07T14:01:07.024988+0000","last_clean":"2024-05-07T14:01:07.024988+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:01:07.024988+0000","last_undegraded":"2024-05-07T14:01:07.024988+0000","last_fullsized":"2024-05-07T14:01:07.024988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047639+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:01:07.047639+0000","last_peered":"2024-05-07T14:01:07.047639+0000","last_clean":"2024-05-07T14:01:07.047639+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:01:07.047639+0000","last_undegraded":"2024-05-07T14:01:07.047639+0000","last_fullsized":"2024-05-07T14:01:07.047639+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.737513+0000","last_change":"2024-05-07T14:01:02.002384+0000","last_active":"2024-05-07T14:01:07.737513+0000","last_peered":"2024-05-07T14:01:07.737513+0000","last_clean":"2024-05-07T14:01:07.737513+0000","last_became_active":"2024-05-07T14:01:02.001676+0000","last_became_peered":"2024-05-07T14:01:02.001676+0000","last_unstale":"2024-05-07T14:01:07.737513+0000","last_undegraded":"2024-05-07T14:01:07.737513+0000","last_fullsized":"2024-05-07T14:01:07.737513+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025235+0000","last_change":"2024-05-07T14:01:04.015893+0000","last_active":"2024-05-07T14:01:07.025235+0000","last_peered":"2024-05-07T14:01:07.025235+0000","last_clean":"2024-05-07T14:01:07.025235+0000","last_became_active":"2024-05-07T14:01:04.015329+0000","last_became_peered":"2024-05-07T14:01:04.015329+0000","last_unstale":"2024-05-07T14:01:07.025235+0000","last_undegraded":"2024-05-07T14:01:07.025235+0000","last_fullsized":"2024-05-07T14:01:07.025235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:53.413495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046511+0000","last_change":"2024-05-07T14:01:06.025917+0000","last_active":"2024-05-07T14:01:07.046511+0000","last_peered":"2024-05-07T14:01:07.046511+0000","last_clean":"2024-05-07T14:01:07.046511+0000","last_became_active":"2024-05-07T14:01:06.025044+0000","last_became_peered":"2024-05-07T14:01:06.025044+0000","last_unstale":"2024-05-07T14:01:07.046511+0000","last_undegraded":"2024-05-07T14:01:07.046511+0000","last_fullsized":"2024-05-07T14:01:07.046511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:55.419668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029256+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:01:07.029256+0000","last_peered":"2024-05-07T14:01:07.029256+0000","last_clean":"2024-05-07T14:01:07.029256+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:01:07.029256+0000","last_undegraded":"2024-05-07T14:01:07.029256+0000","last_fullsized":"2024-05-07T14:01:07.029256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016331+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:01:07.016331+0000","last_peered":"2024-05-07T14:01:07.016331+0000","last_clean":"2024-05-07T14:01:07.016331+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:01:07.016331+0000","last_undegraded":"2024-05-07T14:01:07.016331+0000","last_fullsized":"2024-05-07T14:01:07.016331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016423+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:01:07.016423+0000","last_peered":"2024-05-07T14:01:07.016423+0000","last_clean":"2024-05-07T14:01:07.016423+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:01:07.016423+0000","last_undegraded":"2024-05-07T14:01:07.016423+0000","last_fullsized":"2024-05-07T14:01:07.016423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.936965+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:01:07.936965+0000","last_peered":"2024-05-07T14:01:07.936965+0000","last_clean":"2024-05-07T14:01:07.936965+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:01:07.936965+0000","last_undegraded":"2024-05-07T14:01:07.936965+0000","last_fullsized":"2024-05-07T14:01:07.936965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.026186+0000","last_change":"2024-05-07T14:01:04.026470+0000","last_active":"2024-05-07T14:01:07.026186+0000","last_peered":"2024-05-07T14:01:07.026186+0000","last_clean":"2024-05-07T14:01:07.026186+0000","last_became_active":"2024-05-07T14:01:04.025881+0000","last_became_peered":"2024-05-07T14:01:04.025881+0000","last_unstale":"2024-05-07T14:01:07.026186+0000","last_undegraded":"2024-05-07T14:01:07.026186+0000","last_fullsized":"2024-05-07T14:01:07.026186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:54.595283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042611+0000","last_change":"2024-05-07T14:01:06.038979+0000","last_active":"2024-05-07T14:01:07.042611+0000","last_peered":"2024-05-07T14:01:07.042611+0000","last_clean":"2024-05-07T14:01:07.042611+0000","last_became_active":"2024-05-07T14:01:06.035737+0000","last_became_peered":"2024-05-07T14:01:06.035737+0000","last_unstale":"2024-05-07T14:01:07.042611+0000","last_undegraded":"2024-05-07T14:01:07.042611+0000","last_fullsized":"2024-05-07T14:01:07.042611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.063231+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:01:07.063231+0000","last_peered":"2024-05-07T14:01:07.063231+0000","last_clean":"2024-05-07T14:01:07.063231+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:01:07.063231+0000","last_undegraded":"2024-05-07T14:01:07.063231+0000","last_fullsized":"2024-05-07T14:01:07.063231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010475+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:01:07.010475+0000","last_peered":"2024-05-07T14:01:07.010475+0000","last_clean":"2024-05-07T14:01:07.010475+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:01:07.010475+0000","last_undegraded":"2024-05-07T14:01:07.010475+0000","last_fullsized":"2024-05-07T14:01:07.010475+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025389+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:01:07.025389+0000","last_peered":"2024-05-07T14:01:07.025389+0000","last_clean":"2024-05-07T14:01:07.025389+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:01:07.025389+0000","last_undegraded":"2024-05-07T14:01:07.025389+0000","last_fullsized":"2024-05-07T14:01:07.025389+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.913418+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:01:07.913418+0000","last_peered":"2024-05-07T14:01:07.913418+0000","last_clean":"2024-05-07T14:01:07.913418+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:01:07.913418+0000","last_undegraded":"2024-05-07T14:01:07.913418+0000","last_fullsized":"2024-05-07T14:01:07.913418+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.599588+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:01:07.599588+0000","last_peered":"2024-05-07T14:01:07.599588+0000","last_clean":"2024-05-07T14:01:07.599588+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:01:07.599588+0000","last_undegraded":"2024-05-07T14:01:07.599588+0000","last_fullsized":"2024-05-07T14:01:07.599588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010225+0000","last_change":"2024-05-07T14:01:06.037755+0000","last_active":"2024-05-07T14:01:07.010225+0000","last_peered":"2024-05-07T14:01:07.010225+0000","last_clean":"2024-05-07T14:01:07.010225+0000","last_became_active":"2024-05-07T14:01:06.037156+0000","last_became_peered":"2024-05-07T14:01:06.037156+0000","last_unstale":"2024-05-07T14:01:07.010225+0000","last_undegraded":"2024-05-07T14:01:07.010225+0000","last_fullsized":"2024-05-07T14:01:07.010225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:30.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014513+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:01:07.014513+0000","last_peered":"2024-05-07T14:01:07.014513+0000","last_clean":"2024-05-07T14:01:07.014513+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:01:07.014513+0000","last_undegraded":"2024-05-07T14:01:07.014513+0000","last_fullsized":"2024-05-07T14:01:07.014513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044419+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:01:07.044419+0000","last_peered":"2024-05-07T14:01:07.044419+0000","last_clean":"2024-05-07T14:01:07.044419+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:01:07.044419+0000","last_undegraded":"2024-05-07T14:01:07.044419+0000","last_fullsized":"2024-05-07T14:01:07.044419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011071+0000","last_change":"2024-05-07T14:00:59.998197+0000","last_active":"2024-05-07T14:01:07.011071+0000","last_peered":"2024-05-07T14:01:07.011071+0000","last_clean":"2024-05-07T14:01:07.011071+0000","last_became_active":"2024-05-07T14:00:59.997438+0000","last_became_peered":"2024-05-07T14:00:59.997438+0000","last_unstale":"2024-05-07T14:01:07.011071+0000","last_undegraded":"2024-05-07T14:01:07.011071+0000","last_fullsized":"2024-05-07T14:01:07.011071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:29.430229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.950369+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:01:07.950369+0000","last_peered":"2024-05-07T14:01:07.950369+0000","last_clean":"2024-05-07T14:01:07.950369+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:01:07.950369+0000","last_undegraded":"2024-05-07T14:01:07.950369+0000","last_fullsized":"2024-05-07T14:01:07.950369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.009004+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:01:07.009004+0000","last_peered":"2024-05-07T14:01:07.009004+0000","last_clean":"2024-05-07T14:01:07.009004+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:01:07.009004+0000","last_undegraded":"2024-05-07T14:01:07.009004+0000","last_fullsized":"2024-05-07T14:01:07.009004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012754+0000","last_change":"2024-05-07T14:01:06.025913+0000","last_active":"2024-05-07T14:01:07.012754+0000","last_peered":"2024-05-07T14:01:07.012754+0000","last_clean":"2024-05-07T14:01:07.012754+0000","last_became_active":"2024-05-07T14:01:06.025220+0000","last_became_peered":"2024-05-07T14:01:06.025220+0000","last_unstale":"2024-05-07T14:01:07.012754+0000","last_undegraded":"2024-05-07T14:01:07.012754+0000","last_fullsized":"2024-05-07T14:01:07.012754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:30.164745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015690+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:01:07.015690+0000","last_peered":"2024-05-07T14:01:07.015690+0000","last_clean":"2024-05-07T14:01:07.015690+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:01:07.015690+0000","last_undegraded":"2024-05-07T14:01:07.015690+0000","last_fullsized":"2024-05-07T14:01:07.015690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044467+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:01:07.044467+0000","last_peered":"2024-05-07T14:01:07.044467+0000","last_clean":"2024-05-07T14:01:07.044467+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:01:07.044467+0000","last_undegraded":"2024-05-07T14:01:07.044467+0000","last_fullsized":"2024-05-07T14:01:07.044467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042991+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:01:07.042991+0000","last_peered":"2024-05-07T14:01:07.042991+0000","last_clean":"2024-05-07T14:01:07.042991+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:01:07.042991+0000","last_undegraded":"2024-05-07T14:01:07.042991+0000","last_fullsized":"2024-05-07T14:01:07.042991+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.333523+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:01:07.333523+0000","last_peered":"2024-05-07T14:01:07.333523+0000","last_clean":"2024-05-07T14:01:07.333523+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:01:07.333523+0000","last_undegraded":"2024-05-07T14:01:07.333523+0000","last_fullsized":"2024-05-07T14:01:07.333523+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.046110+0000","last_change":"2024-05-07T14:01:04.017099+0000","last_active":"2024-05-07T14:01:07.046110+0000","last_peered":"2024-05-07T14:01:07.046110+0000","last_clean":"2024-05-07T14:01:07.046110+0000","last_became_active":"2024-05-07T14:01:04.011036+0000","last_became_peered":"2024-05-07T14:01:04.011036+0000","last_unstale":"2024-05-07T14:01:07.046110+0000","last_undegraded":"2024-05-07T14:01:07.046110+0000","last_fullsized":"2024-05-07T14:01:07.046110+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:32.242974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029774+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:01:07.029774+0000","last_peered":"2024-05-07T14:01:07.029774+0000","last_clean":"2024-05-07T14:01:07.029774+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:01:07.029774+0000","last_undegraded":"2024-05-07T14:01:07.029774+0000","last_fullsized":"2024-05-07T14:01:07.029774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027820+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:01:07.027820+0000","last_peered":"2024-05-07T14:01:07.027820+0000","last_clean":"2024-05-07T14:01:07.027820+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:01:07.027820+0000","last_undegraded":"2024-05-07T14:01:07.027820+0000","last_fullsized":"2024-05-07T14:01:07.027820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.031468+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:01:07.031468+0000","last_peered":"2024-05-07T14:01:07.031468+0000","last_clean":"2024-05-07T14:01:07.031468+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:01:07.031468+0000","last_undegraded":"2024-05-07T14:01:07.031468+0000","last_fullsized":"2024-05-07T14:01:07.031468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014000+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:01:07.014000+0000","last_peered":"2024-05-07T14:01:07.014000+0000","last_clean":"2024-05-07T14:01:07.014000+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:01:07.014000+0000","last_undegraded":"2024-05-07T14:01:07.014000+0000","last_fullsized":"2024-05-07T14:01:07.014000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.567188+0000","last_change":"2024-05-07T14:01:02.013617+0000","last_active":"2024-05-07T14:01:07.567188+0000","last_peered":"2024-05-07T14:01:07.567188+0000","last_clean":"2024-05-07T14:01:07.567188+0000","last_became_active":"2024-05-07T14:01:02.009243+0000","last_became_peered":"2024-05-07T14:01:02.009243+0000","last_unstale":"2024-05-07T14:01:07.567188+0000","last_undegraded":"2024-05-07T14:01:07.567188+0000","last_fullsized":"2024-05-07T14:01:07.567188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014148+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:01:07.014148+0000","last_peered":"2024-05-07T14:01:07.014148+0000","last_clean":"2024-05-07T14:01:07.014148+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:01:07.014148+0000","last_undegraded":"2024-05-07T14:01:07.014148+0000","last_fullsized":"2024-05-07T14:01:07.014148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012911+0000","last_change":"2024-05-07T14:01:06.023907+0000","last_active":"2024-05-07T14:01:07.012911+0000","last_peered":"2024-05-07T14:01:07.012911+0000","last_clean":"2024-05-07T14:01:07.012911+0000","last_became_active":"2024-05-07T14:01:06.023307+0000","last_became_peered":"2024-05-07T14:01:06.023307+0000","last_unstale":"2024-05-07T14:01:07.012911+0000","last_undegraded":"2024-05-07T14:01:07.012911+0000","last_fullsized":"2024-05-07T14:01:07.012911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:41.916580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.014760+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:01:07.014760+0000","last_peered":"2024-05-07T14:01:07.014760+0000","last_clean":"2024-05-07T14:01:07.014760+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:01:07.014760+0000","last_undegraded":"2024-05-07T14:01:07.014760+0000","last_fullsized":"2024-05-07T14:01:07.014760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.012241+0000","last_change":"2024-05-07T14:00:56.006013+0000","last_active":"2024-05-07T14:01:07.012241+0000","last_peered":"2024-05-07T14:01:07.012241+0000","last_clean":"2024-05-07T14:01:07.012241+0000","last_became_active":"2024-05-07T14:00:56.005758+0000","last_became_peered":"2024-05-07T14:00:56.005758+0000","last_unstale":"2024-05-07T14:01:07.012241+0000","last_undegraded":"2024-05-07T14:01:07.012241+0000","last_fullsized":"2024-05-07T14:01:07.012241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.023933+0000","last_change":"2024-05-07T14:00:59.998767+0000","last_active":"2024-05-07T14:01:07.023933+0000","last_peered":"2024-05-07T14:01:07.023933+0000","last_clean":"2024-05-07T14:01:07.023933+0000","last_became_active":"2024-05-07T14:00:59.998055+0000","last_became_peered":"2024-05-07T14:00:59.998055+0000","last_unstale":"2024-05-07T14:01:07.023933+0000","last_undegraded":"2024-05-07T14:01:07.023933+0000","last_fullsized":"2024-05-07T14:01:07.023933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:41.593806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.634628+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:01:07.634628+0000","last_peered":"2024-05-07T14:01:07.634628+0000","last_clean":"2024-05-07T14:01:07.634628+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:01:07.634628+0000","last_undegraded":"2024-05-07T14:01:07.634628+0000","last_fullsized":"2024-05-07T14:01:07.634628+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010130+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:01:07.010130+0000","last_peered":"2024-05-07T14:01:07.010130+0000","last_clean":"2024-05-07T14:01:07.010130+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:01:07.010130+0000","last_undegraded":"2024-05-07T14:01:07.010130+0000","last_fullsized":"2024-05-07T14:01:07.010130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016934+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:01:07.016934+0000","last_peered":"2024-05-07T14:01:07.016934+0000","last_clean":"2024-05-07T14:01:07.016934+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:01:07.016934+0000","last_undegraded":"2024-05-07T14:01:07.016934+0000","last_fullsized":"2024-05-07T14:01:07.016934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027708+0000","last_change":"2024-05-07T14:00:58.005276+0000","last_active":"2024-05-07T14:01:07.027708+0000","last_peered":"2024-05-07T14:01:07.027708+0000","last_clean":"2024-05-07T14:01:07.027708+0000","last_became_active":"2024-05-07T14:00:58.004903+0000","last_became_peered":"2024-05-07T14:00:58.004903+0000","last_unstale":"2024-05-07T14:01:07.027708+0000","last_undegraded":"2024-05-07T14:01:07.027708+0000","last_fullsized":"2024-05-07T14:01:07.027708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.045843+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:01:07.045843+0000","last_peered":"2024-05-07T14:01:07.045843+0000","last_clean":"2024-05-07T14:01:07.045843+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:01:07.045843+0000","last_undegraded":"2024-05-07T14:01:07.045843+0000","last_fullsized":"2024-05-07T14:01:07.045843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.026438+0000","last_change":"2024-05-07T14:00:57.986882+0000","last_active":"2024-05-07T14:01:07.026438+0000","last_peered":"2024-05-07T14:01:07.026438+0000","last_clean":"2024-05-07T14:01:07.026438+0000","last_became_active":"2024-05-07T14:00:57.984867+0000","last_became_peered":"2024-05-07T14:00:57.984867+0000","last_unstale":"2024-05-07T14:01:07.026438+0000","last_undegraded":"2024-05-07T14:01:07.026438+0000","last_fullsized":"2024-05-07T14:01:07.026438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.062227+0000","last_change":"2024-05-07T14:00:56.001559+0000","last_active":"2024-05-07T14:01:07.062227+0000","last_peered":"2024-05-07T14:01:07.062227+0000","last_clean":"2024-05-07T14:01:07.062227+0000","last_became_active":"2024-05-07T14:00:56.001149+0000","last_became_peered":"2024-05-07T14:00:56.001149+0000","last_unstale":"2024-05-07T14:01:07.062227+0000","last_undegraded":"2024-05-07T14:01:07.062227+0000","last_fullsized":"2024-05-07T14:01:07.062227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:13.077774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043587+0000","last_change":"2024-05-07T14:00:57.985233+0000","last_active":"2024-05-07T14:01:07.043587+0000","last_peered":"2024-05-07T14:01:07.043587+0000","last_clean":"2024-05-07T14:01:07.043587+0000","last_became_active":"2024-05-07T14:00:57.984523+0000","last_became_peered":"2024-05-07T14:00:57.984523+0000","last_unstale":"2024-05-07T14:01:07.043587+0000","last_undegraded":"2024-05-07T14:01:07.043587+0000","last_fullsized":"2024-05-07T14:01:07.043587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043841+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:01:07.043841+0000","last_peered":"2024-05-07T14:01:07.043841+0000","last_clean":"2024-05-07T14:01:07.043841+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:01:07.043841+0000","last_undegraded":"2024-05-07T14:01:07.043841+0000","last_fullsized":"2024-05-07T14:01:07.043841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025921+0000","last_change":"2024-05-07T14:00:57.989787+0000","last_active":"2024-05-07T14:01:07.025921+0000","last_peered":"2024-05-07T14:01:07.025921+0000","last_clean":"2024-05-07T14:01:07.025921+0000","last_became_active":"2024-05-07T14:00:57.989498+0000","last_became_peered":"2024-05-07T14:00:57.989498+0000","last_unstale":"2024-05-07T14:01:07.025921+0000","last_undegraded":"2024-05-07T14:01:07.025921+0000","last_fullsized":"2024-05-07T14:01:07.025921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011003+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:01:07.011003+0000","last_peered":"2024-05-07T14:01:07.011003+0000","last_clean":"2024-05-07T14:01:07.011003+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:01:07.011003+0000","last_undegraded":"2024-05-07T14:01:07.011003+0000","last_fullsized":"2024-05-07T14:01:07.011003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029059+0000","last_change":"2024-05-07T14:00:57.998054+0000","last_active":"2024-05-07T14:01:07.029059+0000","last_peered":"2024-05-07T14:01:07.029059+0000","last_clean":"2024-05-07T14:01:07.029059+0000","last_became_active":"2024-05-07T14:00:57.997750+0000","last_became_peered":"2024-05-07T14:00:57.997750+0000","last_unstale":"2024-05-07T14:01:07.029059+0000","last_undegraded":"2024-05-07T14:01:07.029059+0000","last_fullsized":"2024-05-07T14:01:07.029059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.029925+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:01:07.029925+0000","last_peered":"2024-05-07T14:01:07.029925+0000","last_clean":"2024-05-07T14:01:07.029925+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:01:07.029925+0000","last_undegraded":"2024-05-07T14:01:07.029925+0000","last_fullsized":"2024-05-07T14:01:07.029925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.016082+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:01:07.016082+0000","last_peered":"2024-05-07T14:01:07.016082+0000","last_clean":"2024-05-07T14:01:07.016082+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:01:07.016082+0000","last_undegraded":"2024-05-07T14:01:07.016082+0000","last_fullsized":"2024-05-07T14:01:07.016082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.025630+0000","last_change":"2024-05-07T14:00:55.974072+0000","last_active":"2024-05-07T14:01:07.025630+0000","last_peered":"2024-05-07T14:01:07.025630+0000","last_clean":"2024-05-07T14:01:07.025630+0000","last_became_active":"2024-05-07T14:00:55.973647+0000","last_became_peered":"2024-05-07T14:00:55.973647+0000","last_unstale":"2024-05-07T14:01:07.025630+0000","last_undegraded":"2024-05-07T14:01:07.025630+0000","last_fullsized":"2024-05-07T14:01:07.025630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027399+0000","last_change":"2024-05-07T14:00:57.988167+0000","last_active":"2024-05-07T14:01:07.027399+0000","last_peered":"2024-05-07T14:01:07.027399+0000","last_clean":"2024-05-07T14:01:07.027399+0000","last_became_active":"2024-05-07T14:00:57.987884+0000","last_became_peered":"2024-05-07T14:00:57.987884+0000","last_unstale":"2024-05-07T14:01:07.027399+0000","last_undegraded":"2024-05-07T14:01:07.027399+0000","last_fullsized":"2024-05-07T14:01:07.027399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.048340+0000","last_change":"2024-05-07T14:00:55.997287+0000","last_active":"2024-05-07T14:01:07.048340+0000","last_peered":"2024-05-07T14:01:07.048340+0000","last_clean":"2024-05-07T14:01:07.048340+0000","last_became_active":"2024-05-07T14:00:55.996467+0000","last_became_peered":"2024-05-07T14:00:55.996467+0000","last_unstale":"2024-05-07T14:01:07.048340+0000","last_undegraded":"2024-05-07T14:01:07.048340+0000","last_fullsized":"2024-05-07T14:01:07.048340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.045821+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:01:07.045821+0000","last_peered":"2024-05-07T14:01:07.045821+0000","last_clean":"2024-05-07T14:01:07.045821+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:01:07.045821+0000","last_undegraded":"2024-05-07T14:01:07.045821+0000","last_fullsized":"2024-05-07T14:01:07.045821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.031731+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:01:07.031731+0000","last_peered":"2024-05-07T14:01:07.031731+0000","last_clean":"2024-05-07T14:01:07.031731+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:01:07.031731+0000","last_undegraded":"2024-05-07T14:01:07.031731+0000","last_fullsized":"2024-05-07T14:01:07.031731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011673+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:01:07.011673+0000","last_peered":"2024-05-07T14:01:07.011673+0000","last_clean":"2024-05-07T14:01:07.011673+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:01:07.011673+0000","last_undegraded":"2024-05-07T14:01:07.011673+0000","last_fullsized":"2024-05-07T14:01:07.011673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043252+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:01:07.043252+0000","last_peered":"2024-05-07T14:01:07.043252+0000","last_clean":"2024-05-07T14:01:07.043252+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:01:07.043252+0000","last_undegraded":"2024-05-07T14:01:07.043252+0000","last_fullsized":"2024-05-07T14:01:07.043252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015618+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:01:07.015618+0000","last_peered":"2024-05-07T14:01:07.015618+0000","last_clean":"2024-05-07T14:01:07.015618+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:01:07.015618+0000","last_undegraded":"2024-05-07T14:01:07.015618+0000","last_fullsized":"2024-05-07T14:01:07.015618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027954+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:01:07.027954+0000","last_peered":"2024-05-07T14:01:07.027954+0000","last_clean":"2024-05-07T14:01:07.027954+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:01:07.027954+0000","last_undegraded":"2024-05-07T14:01:07.027954+0000","last_fullsized":"2024-05-07T14:01:07.027954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.063354+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:01:07.063354+0000","last_peered":"2024-05-07T14:01:07.063354+0000","last_clean":"2024-05-07T14:01:07.063354+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:01:07.063354+0000","last_undegraded":"2024-05-07T14:01:07.063354+0000","last_fullsized":"2024-05-07T14:01:07.063354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.043542+0000","last_change":"2024-05-07T14:00:56.001135+0000","last_active":"2024-05-07T14:01:07.043542+0000","last_peered":"2024-05-07T14:01:07.043542+0000","last_clean":"2024-05-07T14:01:07.043542+0000","last_became_active":"2024-05-07T14:00:55.999884+0000","last_became_peered":"2024-05-07T14:00:55.999884+0000","last_unstale":"2024-05-07T14:01:07.043542+0000","last_undegraded":"2024-05-07T14:01:07.043542+0000","last_fullsized":"2024-05-07T14:01:07.043542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.015839+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:01:07.015839+0000","last_peered":"2024-05-07T14:01:07.015839+0000","last_clean":"2024-05-07T14:01:07.015839+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:01:07.015839+0000","last_undegraded":"2024-05-07T14:01:07.015839+0000","last_fullsized":"2024-05-07T14:01:07.015839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011439+0000","last_change":"2024-05-07T14:00:55.989670+0000","last_active":"2024-05-07T14:01:07.011439+0000","last_peered":"2024-05-07T14:01:07.011439+0000","last_clean":"2024-05-07T14:01:07.011439+0000","last_became_active":"2024-05-07T14:00:55.989455+0000","last_became_peered":"2024-05-07T14:00:55.989455+0000","last_unstale":"2024-05-07T14:01:07.011439+0000","last_undegraded":"2024-05-07T14:01:07.011439+0000","last_fullsized":"2024-05-07T14:01:07.011439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010909+0000","last_change":"2024-05-07T14:00:57.979022+0000","last_active":"2024-05-07T14:01:07.010909+0000","last_peered":"2024-05-07T14:01:07.010909+0000","last_clean":"2024-05-07T14:01:07.010909+0000","last_became_active":"2024-05-07T14:00:57.977403+0000","last_became_peered":"2024-05-07T14:00:57.977403+0000","last_unstale":"2024-05-07T14:01:07.010909+0000","last_undegraded":"2024-05-07T14:01:07.010909+0000","last_fullsized":"2024-05-07T14:01:07.010909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.047426+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:01:07.047426+0000","last_peered":"2024-05-07T14:01:07.047426+0000","last_clean":"2024-05-07T14:01:07.047426+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:01:07.047426+0000","last_undegraded":"2024-05-07T14:01:07.047426+0000","last_fullsized":"2024-05-07T14:01:07.047426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.009434+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:01:07.009434+0000","last_peered":"2024-05-07T14:01:07.009434+0000","last_clean":"2024-05-07T14:01:07.009434+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:01:07.009434+0000","last_undegraded":"2024-05-07T14:01:07.009434+0000","last_fullsized":"2024-05-07T14:01:07.009434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.013681+0000","last_change":"2024-05-07T14:00:55.978771+0000","last_active":"2024-05-07T14:01:07.013681+0000","last_peered":"2024-05-07T14:01:07.013681+0000","last_clean":"2024-05-07T14:01:07.013681+0000","last_became_active":"2024-05-07T14:00:55.978000+0000","last_became_peered":"2024-05-07T14:00:55.978000+0000","last_unstale":"2024-05-07T14:01:07.013681+0000","last_undegraded":"2024-05-07T14:01:07.013681+0000","last_fullsized":"2024-05-07T14:01:07.013681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.027336+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:01:07.027336+0000","last_peered":"2024-05-07T14:01:07.027336+0000","last_clean":"2024-05-07T14:01:07.027336+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:01:07.027336+0000","last_undegraded":"2024-05-07T14:01:07.027336+0000","last_fullsized":"2024-05-07T14:01:07.027336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.063888+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:01:07.063888+0000","last_peered":"2024-05-07T14:01:07.063888+0000","last_clean":"2024-05-07T14:01:07.063888+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:01:07.063888+0000","last_undegraded":"2024-05-07T14:01:07.063888+0000","last_fullsized":"2024-05-07T14:01:07.063888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.010363+0000","last_change":"2024-05-07T14:00:57.979073+0000","last_active":"2024-05-07T14:01:07.010363+0000","last_peered":"2024-05-07T14:01:07.010363+0000","last_clean":"2024-05-07T14:01:07.010363+0000","last_became_active":"2024-05-07T14:00:57.978215+0000","last_became_peered":"2024-05-07T14:00:57.978215+0000","last_unstale":"2024-05-07T14:01:07.010363+0000","last_undegraded":"2024-05-07T14:01:07.010363+0000","last_fullsized":"2024-05-07T14:01:07.010363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044872+0000","last_change":"2024-05-07T14:00:56.001199+0000","last_active":"2024-05-07T14:01:07.044872+0000","last_peered":"2024-05-07T14:01:07.044872+0000","last_clean":"2024-05-07T14:01:07.044872+0000","last_became_active":"2024-05-07T14:00:56.000434+0000","last_became_peered":"2024-05-07T14:00:56.000434+0000","last_unstale":"2024-05-07T14:01:07.044872+0000","last_undegraded":"2024-05-07T14:01:07.044872+0000","last_fullsized":"2024-05-07T14:01:07.044872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.042782+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:01:07.042782+0000","last_peered":"2024-05-07T14:01:07.042782+0000","last_clean":"2024-05-07T14:01:07.042782+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:01:07.042782+0000","last_undegraded":"2024-05-07T14:01:07.042782+0000","last_fullsized":"2024-05-07T14:01:07.042782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.011503+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:01:07.011503+0000","last_peered":"2024-05-07T14:01:07.011503+0000","last_clean":"2024-05-07T14:01:07.011503+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:01:07.011503+0000","last_undegraded":"2024-05-07T14:01:07.011503+0000","last_fullsized":"2024-05-07T14:01:07.011503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.024703+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:01:07.024703+0000","last_peered":"2024-05-07T14:01:07.024703+0000","last_clean":"2024-05-07T14:01:07.024703+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:01:07.024703+0000","last_undegraded":"2024-05-07T14:01:07.024703+0000","last_fullsized":"2024-05-07T14:01:07.024703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-07T14:01:07.044072+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:01:07.044072+0000","last_peered":"2024-05-07T14:01:07.044072+0000","last_clean":"2024-05-07T14:01:07.044072+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:01:07.044072+0000","last_undegraded":"2024-05-07T14:01:07.044072+0000","last_fullsized":"2024-05-07T14:01:07.044072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1011712,"data_stored":754275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":163247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":438272,"data_stored":164075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":163738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":163643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":385024,"data_stored":163245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":164490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":754117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:01:14.327 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-07T14:01:14.327 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-05-07T14:01:14.653 INFO:teuthology.orchestra.run.smithi106.stdout:epoch 33 2024-05-07T14:01:14.653 INFO:teuthology.orchestra.run.smithi106.stdout:fsid 0d349e2f-0c2b-4aab-8a22-181c69b40dbb 2024-05-07T14:01:14.653 INFO:teuthology.orchestra.run.smithi106.stdout:created 2024-05-07T14:00:30.482506+0000 2024-05-07T14:01:14.654 INFO:teuthology.orchestra.run.smithi106.stdout:modified 2024-05-07T14:01:06.995214+0000 2024-05-07T14:01:14.654 INFO:teuthology.orchestra.run.smithi106.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-07T14:01:14.654 INFO:teuthology.orchestra.run.smithi106.stdout:crush_version 4 2024-05-07T14:01:14.654 INFO:teuthology.orchestra.run.smithi106.stdout:full_ratio 0.95 2024-05-07T14:01:14.654 INFO:teuthology.orchestra.run.smithi106.stdout:backfillfull_ratio 0.9 2024-05-07T14:01:14.654 INFO:teuthology.orchestra.run.smithi106.stdout:nearfull_ratio 0.85 2024-05-07T14:01:14.654 INFO:teuthology.orchestra.run.smithi106.stdout:require_min_compat_client luminous 2024-05-07T14:01:14.654 INFO:teuthology.orchestra.run.smithi106.stdout:min_compat_client jewel 2024-05-07T14:01:14.654 INFO:teuthology.orchestra.run.smithi106.stdout:require_osd_release squid 2024-05-07T14:01:14.654 INFO:teuthology.orchestra.run.smithi106.stdout:stretch_mode_enabled false 2024-05-07T14:01:14.654 INFO:teuthology.orchestra.run.smithi106.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-05-07T14:01:14.654 INFO:teuthology.orchestra.run.smithi106.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2024-05-07T14:01:14.654 INFO:teuthology.orchestra.run.smithi106.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-05-07T14:01:14.655 INFO:teuthology.orchestra.run.smithi106.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 25 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-05-07T14:01:14.655 INFO:teuthology.orchestra.run.smithi106.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 27 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-05-07T14:01:14.655 INFO:teuthology.orchestra.run.smithi106.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 29 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-05-07T14:01:14.655 INFO:teuthology.orchestra.run.smithi106.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 31 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-05-07T14:01:14.655 INFO:teuthology.orchestra.run.smithi106.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 33 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-05-07T14:01:14.655 INFO:teuthology.orchestra.run.smithi106.stdout:max_osd 8 2024-05-07T14:01:14.655 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6800/3743893730,v1:172.21.15.106:6801/3743893730] [v2:172.21.15.106:6802/3743893730,v1:172.21.15.106:6803/3743893730] exists,up e76f5d56-1400-488e-b58f-7af657fa63ab 2024-05-07T14:01:14.655 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6816/3901521345,v1:172.21.15.106:6817/3901521345] [v2:172.21.15.106:6818/3901521345,v1:172.21.15.106:6819/3901521345] exists,up aad5864b-9a5f-426f-a8fd-15d02590106e 2024-05-07T14:01:14.655 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2 up in weight 1 up_from 13 up_thru 29 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6824/1784825450,v1:172.21.15.106:6825/1784825450] [v2:172.21.15.106:6826/1784825450,v1:172.21.15.106:6827/1784825450] exists,up eea131cd-e4ca-4360-a8a0-5005a2d827d1 2024-05-07T14:01:14.655 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6806/123863977,v1:172.21.15.106:6808/123863977] [v2:172.21.15.106:6810/123863977,v1:172.21.15.106:6811/123863977] exists,up bdcb438c-1d40-45a2-8e8a-f29ba9c98909 2024-05-07T14:01:14.655 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6816/3575310712,v1:172.21.15.107:6817/3575310712] [v2:172.21.15.107:6818/3575310712,v1:172.21.15.107:6819/3575310712] exists,up 703f4a52-4283-4395-bc29-4de194d4a4ef 2024-05-07T14:01:14.655 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6800/2178038050,v1:172.21.15.107:6801/2178038050] [v2:172.21.15.107:6802/2178038050,v1:172.21.15.107:6803/2178038050] exists,up 8b70f365-8b0d-429e-b3f8-601a37cfb6ac 2024-05-07T14:01:14.656 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6823/3168866293,v1:172.21.15.107:6825/3168866293] [v2:172.21.15.107:6826/3168866293,v1:172.21.15.107:6827/3168866293] exists,up b65085d6-47af-4dfc-91a8-cdc7a6fa937c 2024-05-07T14:01:14.656 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6808/1073700008,v1:172.21.15.107:6809/1073700008] [v2:172.21.15.107:6810/1073700008,v1:172.21.15.107:6811/1073700008] exists,up 9a808e41-afba-400f-886a-8f17689bebda 2024-05-07T14:01:14.670 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6800/3743893730,v1:172.21.15.106:6801/3743893730] [v2:172.21.15.106:6802/3743893730,v1:172.21.15.106:6803/3743893730] exists,up e76f5d56-1400-488e-b58f-7af657fa63ab', 'osd.1 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6816/3901521345,v1:172.21.15.106:6817/3901521345] [v2:172.21.15.106:6818/3901521345,v1:172.21.15.106:6819/3901521345] exists,up aad5864b-9a5f-426f-a8fd-15d02590106e', 'osd.2 up in weight 1 up_from 13 up_thru 29 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6824/1784825450,v1:172.21.15.106:6825/1784825450] [v2:172.21.15.106:6826/1784825450,v1:172.21.15.106:6827/1784825450] exists,up eea131cd-e4ca-4360-a8a0-5005a2d827d1', 'osd.3 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6806/123863977,v1:172.21.15.106:6808/123863977] [v2:172.21.15.106:6810/123863977,v1:172.21.15.106:6811/123863977] exists,up bdcb438c-1d40-45a2-8e8a-f29ba9c98909', 'osd.4 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6816/3575310712,v1:172.21.15.107:6817/3575310712] [v2:172.21.15.107:6818/3575310712,v1:172.21.15.107:6819/3575310712] exists,up 703f4a52-4283-4395-bc29-4de194d4a4ef', 'osd.5 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6800/2178038050,v1:172.21.15.107:6801/2178038050] [v2:172.21.15.107:6802/2178038050,v1:172.21.15.107:6803/2178038050] exists,up 8b70f365-8b0d-429e-b3f8-601a37cfb6ac', 'osd.6 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6823/3168866293,v1:172.21.15.107:6825/3168866293] [v2:172.21.15.107:6826/3168866293,v1:172.21.15.107:6827/3168866293] exists,up b65085d6-47af-4dfc-91a8-cdc7a6fa937c', 'osd.7 up in weight 1 up_from 13 up_thru 31 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6808/1073700008,v1:172.21.15.107:6809/1073700008] [v2:172.21.15.107:6810/1073700008,v1:172.21.15.107:6811/1073700008] exists,up 9a808e41-afba-400f-886a-8f17689bebda'] 2024-05-07T14:01:14.670 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-05-07T14:01:14.786 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:14.787 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "mon.a", 2024-05-07T14:01:14.787 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster": "ceph", 2024-05-07T14:01:14.787 INFO:teuthology.orchestra.run.smithi106.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-05-07T14:01:14.787 INFO:teuthology.orchestra.run.smithi106.stdout: "admin_socket_mode": "", 2024-05-07T14:01:14.787 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-05-07T14:01:14.787 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_client_required": "cephx, none", 2024-05-07T14:01:14.787 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_cluster_required": "cephx", 2024-05-07T14:01:14.788 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_debug": "true", 2024-05-07T14:01:14.788 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-05-07T14:01:14.788 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-05-07T14:01:14.788 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_service_required": "cephx", 2024-05-07T14:01:14.788 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_service_ticket_ttl": "240.000000", 2024-05-07T14:01:14.788 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_supported": "cephx", 2024-05-07T14:01:14.788 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_aio": "true", 2024-05-07T14:01:14.788 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_aio_max_queue_depth": "1024", 2024-05-07T14:01:14.788 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_aio_poll_ms": "250", 2024-05-07T14:01:14.788 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_aio_reap_max": "16", 2024-05-07T14:01:14.789 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_async_discard": "false", 2024-05-07T14:01:14.789 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_block_size": "4096", 2024-05-07T14:01:14.789 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_debug_aio": "false", 2024-05-07T14:01:14.789 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-05-07T14:01:14.789 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-05-07T14:01:14.789 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_debug_inflight_ios": "false", 2024-05-07T14:01:14.789 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_enable_discard": "false", 2024-05-07T14:01:14.789 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_flock_retry": "3", 2024-05-07T14:01:14.789 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_flock_retry_interval": "0.100000", 2024-05-07T14:01:14.789 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_inject_crash": "0", 2024-05-07T14:01:14.789 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_inject_crash_flush_delay": "2", 2024-05-07T14:01:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_ioring": "false", 2024-05-07T14:01:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_ioring_hipri": "false", 2024-05-07T14:01:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_ioring_sqthread_poll": "false", 2024-05-07T14:01:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-05-07T14:01:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_read_buffer_alignment": "4096", 2024-05-07T14:01:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-05-07T14:01:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: "bdev_type": "", 2024-05-07T14:01:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_alloc_size": "1048576", 2024-05-07T14:01:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_allocator": "hybrid", 2024-05-07T14:01:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_buffered_io": "true", 2024-05-07T14:01:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_check_for_zeros": "false", 2024-05-07T14:01:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_check_volume_selector_often": "false", 2024-05-07T14:01:14.790 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_compact_log_sync": "false", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_log_compact_min_size": "16777216", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_log_replay_check_allocations": "true", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_max_log_runway": "4194304", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_max_prefetch": "1048576", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_min_flush_size": "524288", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_min_log_runway": "1048576", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_replay_recovery": "false", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_shared_alloc_size": "65536", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_sync_write": "false", 2024-05-07T14:01:14.791 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-05-07T14:01:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-05-07T14:01:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-05-07T14:01:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_allocation_from_file": "true", 2024-05-07T14:01:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_allocator": "hybrid", 2024-05-07T14:01:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-05-07T14:01:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-05-07T14:01:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-05-07T14:01:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-05-07T14:01:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-05-07T14:01:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-05-07T14:01:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blobid_prealloc": "10240", 2024-05-07T14:01:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_block_create": "true", 2024-05-07T14:01:14.792 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_block_db_create": "false", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_block_db_path": "", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_block_db_size": "0", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_block_path": "", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_block_preallocate_file": "false", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_block_size": "107374182400", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_block_wal_create": "false", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_block_wal_path": "", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_block_wal_size": "100663296", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_bluefs": "true", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_bluefs_env_mirror": "false", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-05-07T14:01:14.793 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-05-07T14:01:14.794 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-05-07T14:01:14.794 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-05-07T14:01:14.794 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-05-07T14:01:14.794 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_autotune": "true", 2024-05-07T14:01:14.794 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-05-07T14:01:14.794 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-05-07T14:01:14.794 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-05-07T14:01:14.794 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-05-07T14:01:14.794 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_size": "0", 2024-05-07T14:01:14.794 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-05-07T14:01:14.794 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-05-07T14:01:14.794 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-05-07T14:01:14.794 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-05-07T14:01:14.795 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_type": "2q", 2024-05-07T14:01:14.795 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-05-07T14:01:14.795 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_clone_cow": "true", 2024-05-07T14:01:14.795 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_compression_algorithm": "snappy", 2024-05-07T14:01:14.795 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_compression_max_blob_size": "0", 2024-05-07T14:01:14.795 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-05-07T14:01:14.795 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-05-07T14:01:14.795 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_compression_min_blob_size": "0", 2024-05-07T14:01:14.795 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-05-07T14:01:14.795 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-05-07T14:01:14.796 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_compression_mode": "none", 2024-05-07T14:01:14.796 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-05-07T14:01:14.796 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_csum_type": "crc32c", 2024-05-07T14:01:14.796 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_enforce_settings": "default", 2024-05-07T14:01:14.796 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_freelist": "false", 2024-05-07T14:01:14.796 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_fsck_abort": "false", 2024-05-07T14:01:14.797 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-05-07T14:01:14.797 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-05-07T14:01:14.797 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_inject_read_err": "false", 2024-05-07T14:01:14.797 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_legacy_omap": "false", 2024-05-07T14:01:14.797 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-05-07T14:01:14.797 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-05-07T14:01:14.798 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-05-07T14:01:14.798 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-05-07T14:01:14.798 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_prefill": "0.000000", 2024-05-07T14:01:14.798 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-05-07T14:01:14.798 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-05-07T14:01:14.798 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_small_allocations": "0", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_default_buffered_read": "true", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_default_buffered_write": "false", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_deferred_batch_ops": "0", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_elastic_shared_blobs": "true", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-05-07T14:01:14.799 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fail_eio": "false", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_on_mkfs": "true", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_on_mount": "false", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_on_umount": "false", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-05-07T14:01:14.800 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-05-07T14:01:14.801 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-05-07T14:01:14.801 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-05-07T14:01:14.801 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-05-07T14:01:14.801 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_ignore_data_csum": "false", 2024-05-07T14:01:14.801 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-05-07T14:01:14.801 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_kvbackend": "rocksdb", 2024-05-07T14:01:14.801 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-05-07T14:01:14.801 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-05-07T14:01:14.801 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_log_op_age": "5.000000", 2024-05-07T14:01:14.801 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_max_alloc_size": "0", 2024-05-07T14:01:14.801 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_max_blob_size": "0", 2024-05-07T14:01:14.801 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-05-07T14:01:14.801 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-05-07T14:01:14.802 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_max_defer_interval": "3.000000", 2024-05-07T14:01:14.802 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_max_deferred_txc": "32", 2024-05-07T14:01:14.802 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_min_alloc_size": "0", 2024-05-07T14:01:14.802 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-05-07T14:01:14.802 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-05-07T14:01:14.802 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_nid_prealloc": "1024", 2024-05-07T14:01:14.802 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_prefer_deferred_size": "0", 2024-05-07T14:01:14.802 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-05-07T14:01:14.802 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-05-07T14:01:14.802 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_qfsck_on_mount": "true", 2024-05-07T14:01:14.802 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_retry_disk_reads": "3", 2024-05-07T14:01:14.802 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_rocksdb_cf": "true", 2024-05-07T14:01:14.802 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-05-07T14:01:14.803 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-05-07T14:01:14.803 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_rocksdb_options_annex": "", 2024-05-07T14:01:14.803 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_spdk_coremask": "0x1", 2024-05-07T14:01:14.803 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_spdk_io_sleep": "5", 2024-05-07T14:01:14.803 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_spdk_max_io_completion": "0", 2024-05-07T14:01:14.803 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_spdk_mem": "512", 2024-05-07T14:01:14.803 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_sync_submit_transaction": "false", 2024-05-07T14:01:14.803 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_throttle_bytes": "67108864", 2024-05-07T14:01:14.803 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_throttle_cost_per_io": "0", 2024-05-07T14:01:14.803 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-05-07T14:01:14.803 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-05-07T14:01:14.803 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-05-07T14:01:14.803 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_tracing": "false", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_volume_selection_reserved": "0", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_zero_block_detection": "false", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "cephfs_mirror_action_update_interval": "2", 2024-05-07T14:01:14.804 INFO:teuthology.orchestra.run.smithi106.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephfs_mirror_mount_timeout": "10", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephx_cluster_require_signatures": "false", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephx_cluster_require_version": "2", 2024-05-07T14:01:14.805 INFO:teuthology.orchestra.run.smithi106.stdout: "cephx_require_signatures": "false", 2024-05-07T14:01:14.806 INFO:teuthology.orchestra.run.smithi106.stdout: "cephx_require_version": "2", 2024-05-07T14:01:14.806 INFO:teuthology.orchestra.run.smithi106.stdout: "cephx_service_require_signatures": "false", 2024-05-07T14:01:14.806 INFO:teuthology.orchestra.run.smithi106.stdout: "cephx_service_require_version": "2", 2024-05-07T14:01:14.806 INFO:teuthology.orchestra.run.smithi106.stdout: "cephx_sign_messages": "true", 2024-05-07T14:01:14.806 INFO:teuthology.orchestra.run.smithi106.stdout: "chdir": "", 2024-05-07T14:01:14.806 INFO:teuthology.orchestra.run.smithi106.stdout: "client_acl_type": "", 2024-05-07T14:01:14.806 INFO:teuthology.orchestra.run.smithi106.stdout: "client_asio_thread_count": "2", 2024-05-07T14:01:14.806 INFO:teuthology.orchestra.run.smithi106.stdout: "client_cache_mid": "0.750000", 2024-05-07T14:01:14.806 INFO:teuthology.orchestra.run.smithi106.stdout: "client_cache_size": "16384", 2024-05-07T14:01:14.806 INFO:teuthology.orchestra.run.smithi106.stdout: "client_caps_release_delay": "5", 2024-05-07T14:01:14.806 INFO:teuthology.orchestra.run.smithi106.stdout: "client_check_pool_perm": "true", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_collect_and_send_global_metrics": "false", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_debug_force_sync_read": "false", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_debug_getattr_caps": "false", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_debug_inject_tick_delay": "0", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_die_on_failed_remount": "false", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_dirsize_rbytes": "true", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_force_lazyio": "false", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_fs": "", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_inject_fixed_oldest_tid": "false", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_inject_release_failure": "false", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_max_inline_size": "4096", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_max_retries_on_remount_failure": "5", 2024-05-07T14:01:14.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_mds_namespace": "", 2024-05-07T14:01:14.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_metadata": "", 2024-05-07T14:01:14.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_mount_gid": "-1", 2024-05-07T14:01:14.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_mount_timeout": "300", 2024-05-07T14:01:14.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_mount_uid": "-1", 2024-05-07T14:01:14.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_mountpoint": "/", 2024-05-07T14:01:14.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_notify_timeout": "10", 2024-05-07T14:01:14.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_oc": "true", 2024-05-07T14:01:14.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_oc_max_dirty": "104857600", 2024-05-07T14:01:14.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_oc_max_dirty_age": "5.000000", 2024-05-07T14:01:14.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_oc_max_objects": "1000", 2024-05-07T14:01:14.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_oc_size": "209715200", 2024-05-07T14:01:14.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_oc_target_dirty": "8388608", 2024-05-07T14:01:14.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_permissions": "true", 2024-05-07T14:01:14.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_quota": "true", 2024-05-07T14:01:14.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_quota_df": "true", 2024-05-07T14:01:14.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_readahead_max_bytes": "0", 2024-05-07T14:01:14.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_readahead_max_periods": "4", 2024-05-07T14:01:14.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_readahead_min": "131072", 2024-05-07T14:01:14.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_reconnect_stale": "false", 2024-05-07T14:01:14.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_shutdown_timeout": "30", 2024-05-07T14:01:14.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_snapdir": ".snap", 2024-05-07T14:01:14.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_tick_interval": "1", 2024-05-07T14:01:14.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_trace": "", 2024-05-07T14:01:14.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_try_dentry_invalidate": "false", 2024-05-07T14:01:14.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_use_faked_inos": "false", 2024-05-07T14:01:14.810 INFO:teuthology.orchestra.run.smithi106.stdout: "client_use_random_mds": "false", 2024-05-07T14:01:14.810 INFO:teuthology.orchestra.run.smithi106.stdout: "clog_to_graylog": "false", 2024-05-07T14:01:14.810 INFO:teuthology.orchestra.run.smithi106.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-05-07T14:01:14.810 INFO:teuthology.orchestra.run.smithi106.stdout: "clog_to_graylog_port": "12201", 2024-05-07T14:01:14.810 INFO:teuthology.orchestra.run.smithi106.stdout: "clog_to_monitors": "default=true", 2024-05-07T14:01:14.810 INFO:teuthology.orchestra.run.smithi106.stdout: "clog_to_syslog": "false", 2024-05-07T14:01:14.810 INFO:teuthology.orchestra.run.smithi106.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-05-07T14:01:14.810 INFO:teuthology.orchestra.run.smithi106.stdout: "clog_to_syslog_level": "info", 2024-05-07T14:01:14.810 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "-", 2024-05-07T14:01:14.811 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_network": "", 2024-05-07T14:01:14.811 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_network_interface": "", 2024-05-07T14:01:14.811 INFO:teuthology.orchestra.run.smithi106.stdout: "compressor_zlib_isal": "false", 2024-05-07T14:01:14.811 INFO:teuthology.orchestra.run.smithi106.stdout: "compressor_zlib_level": "5", 2024-05-07T14:01:14.811 INFO:teuthology.orchestra.run.smithi106.stdout: "compressor_zlib_winsize": "-15", 2024-05-07T14:01:14.811 INFO:teuthology.orchestra.run.smithi106.stdout: "compressor_zstd_level": "1", 2024-05-07T14:01:14.812 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-05-07T14:01:14.812 INFO:teuthology.orchestra.run.smithi106.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-05-07T14:01:14.812 INFO:teuthology.orchestra.run.smithi106.stdout: "crimson_alien_op_num_threads": "6", 2024-05-07T14:01:14.812 INFO:teuthology.orchestra.run.smithi106.stdout: "crimson_alien_thread_cpu_cores": "", 2024-05-07T14:01:14.812 INFO:teuthology.orchestra.run.smithi106.stdout: "crimson_osd_obc_lru_size": "512", 2024-05-07T14:01:14.812 INFO:teuthology.orchestra.run.smithi106.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-05-07T14:01:14.813 INFO:teuthology.orchestra.run.smithi106.stdout: "crimson_seastar_cpu_cores": "", 2024-05-07T14:01:14.813 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "", 2024-05-07T14:01:14.813 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location_hook": "", 2024-05-07T14:01:14.813 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location_hook_timeout": "10", 2024-05-07T14:01:14.813 INFO:teuthology.orchestra.run.smithi106.stdout: "daemonize": "false", 2024-05-07T14:01:14.813 INFO:teuthology.orchestra.run.smithi106.stdout: "daos_pool": "tank", 2024-05-07T14:01:14.814 INFO:teuthology.orchestra.run.smithi106.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-05-07T14:01:14.814 INFO:teuthology.orchestra.run.smithi106.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-05-07T14:01:14.814 INFO:teuthology.orchestra.run.smithi106.stdout: "dbstore_db_name_prefix": "dbstore", 2024-05-07T14:01:14.814 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_alienstore": "0/5", 2024-05-07T14:01:14.814 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_allow_any_pool_priority": "false", 2024-05-07T14:01:14.814 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_asok": "1/5", 2024-05-07T14:01:14.815 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_asok_assert_abort": "false", 2024-05-07T14:01:14.815 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_asserts_on_shutdown": "true", 2024-05-07T14:01:14.815 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_auth": "20/20", 2024-05-07T14:01:14.815 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_bdev": "1/3", 2024-05-07T14:01:14.815 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_bluefs": "1/5", 2024-05-07T14:01:14.815 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_bluestore": "1/5", 2024-05-07T14:01:14.816 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_buffer": "0/1", 2024-05-07T14:01:14.816 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_ceph_exporter": "1/5", 2024-05-07T14:01:14.816 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_cephfs_mirror": "0/5", 2024-05-07T14:01:14.816 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_cephsqlite": "0/5", 2024-05-07T14:01:14.816 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_client": "0/5", 2024-05-07T14:01:14.816 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_compressor": "1/5", 2024-05-07T14:01:14.816 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_context": "0/1", 2024-05-07T14:01:14.817 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_crimson_interrupt": "0/5", 2024-05-07T14:01:14.817 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_crush": "1/1", 2024-05-07T14:01:14.817 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_crypto": "1/5", 2024-05-07T14:01:14.817 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_cyanstore": "0/5", 2024-05-07T14:01:14.817 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_deliberately_leak_memory": "false", 2024-05-07T14:01:14.817 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_disable_randomized_ping": "false", 2024-05-07T14:01:14.818 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_dpdk": "1/5", 2024-05-07T14:01:14.818 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_eventtrace": "1/5", 2024-05-07T14:01:14.818 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_filer": "0/1", 2024-05-07T14:01:14.818 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_filestore": "1/3", 2024-05-07T14:01:14.818 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_finisher": "1/1", 2024-05-07T14:01:14.818 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_fuse": "1/5", 2024-05-07T14:01:14.819 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_heartbeat_testing_span": "0", 2024-05-07T14:01:14.819 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_heartbeatmap": "1/5", 2024-05-07T14:01:14.819 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_immutable_obj_cache": "0/5", 2024-05-07T14:01:14.819 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_javaclient": "1/5", 2024-05-07T14:01:14.819 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_journal": "1/3", 2024-05-07T14:01:14.819 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_journaler": "0/5", 2024-05-07T14:01:14.820 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_kstore": "1/5", 2024-05-07T14:01:14.820 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_lockdep": "0/1", 2024-05-07T14:01:14.820 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_mclock": "1/5", 2024-05-07T14:01:14.820 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_mds": "1/5", 2024-05-07T14:01:14.820 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_mds_balancer": "1/5", 2024-05-07T14:01:14.820 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_mds_locker": "1/5", 2024-05-07T14:01:14.821 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_mds_log": "1/5", 2024-05-07T14:01:14.821 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_mds_log_expire": "1/5", 2024-05-07T14:01:14.821 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_mds_migrator": "1/5", 2024-05-07T14:01:14.821 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_mds_quiesce": "3/5", 2024-05-07T14:01:14.821 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_memstore": "1/5", 2024-05-07T14:01:14.821 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_mgr": "2/5", 2024-05-07T14:01:14.822 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_mgrc": "1/5", 2024-05-07T14:01:14.822 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_mon": "20/20", 2024-05-07T14:01:14.822 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_monc": "0/10", 2024-05-07T14:01:14.822 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_ms": "1/1", 2024-05-07T14:01:14.822 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_none": "0/5", 2024-05-07T14:01:14.822 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_objclass": "0/5", 2024-05-07T14:01:14.823 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_objectcacher": "0/5", 2024-05-07T14:01:14.823 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_objecter": "0/1", 2024-05-07T14:01:14.823 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_optracker": "0/5", 2024-05-07T14:01:14.823 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_osd": "1/5", 2024-05-07T14:01:14.823 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_paxos": "20/20", 2024-05-07T14:01:14.823 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_perfcounter": "1/5", 2024-05-07T14:01:14.824 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_prioritycache": "1/5", 2024-05-07T14:01:14.824 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_rados": "0/5", 2024-05-07T14:01:14.824 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_rbd": "0/5", 2024-05-07T14:01:14.824 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_rbd_mirror": "0/5", 2024-05-07T14:01:14.824 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_rbd_pwl": "0/5", 2024-05-07T14:01:14.824 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_rbd_replay": "0/5", 2024-05-07T14:01:14.824 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_refs": "0/0", 2024-05-07T14:01:14.825 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_reserver": "1/1", 2024-05-07T14:01:14.825 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_rgw": "1/5", 2024-05-07T14:01:14.825 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_rgw_access": "1/5", 2024-05-07T14:01:14.825 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_rgw_datacache": "1/5", 2024-05-07T14:01:14.825 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_rgw_dbstore": "1/5", 2024-05-07T14:01:14.825 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_rgw_flight": "1/5", 2024-05-07T14:01:14.826 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_rgw_lifecycle": "1/5", 2024-05-07T14:01:14.826 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_rgw_sync": "1/5", 2024-05-07T14:01:14.826 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_rocksdb": "4/5", 2024-05-07T14:01:14.826 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore": "0/5", 2024-05-07T14:01:14.826 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore_backref": "0/5", 2024-05-07T14:01:14.826 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore_cache": "0/5", 2024-05-07T14:01:14.827 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore_cleaner": "0/5", 2024-05-07T14:01:14.827 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore_device": "0/5", 2024-05-07T14:01:14.827 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore_epm": "0/5", 2024-05-07T14:01:14.827 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-05-07T14:01:14.827 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore_journal": "0/5", 2024-05-07T14:01:14.827 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore_lba": "0/5", 2024-05-07T14:01:14.827 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore_odata": "0/5", 2024-05-07T14:01:14.828 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore_omap": "0/5", 2024-05-07T14:01:14.828 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore_onode": "0/5", 2024-05-07T14:01:14.828 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore_t": "0/5", 2024-05-07T14:01:14.828 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_seastore_tm": "0/5", 2024-05-07T14:01:14.828 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_striper": "0/1", 2024-05-07T14:01:14.828 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_test": "0/5", 2024-05-07T14:01:14.829 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_throttle": "1/1", 2024-05-07T14:01:14.829 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_timer": "0/1", 2024-05-07T14:01:14.829 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_tp": "0/5", 2024-05-07T14:01:14.829 INFO:teuthology.orchestra.run.smithi106.stdout: "debug_trace": "1/5", 2024-05-07T14:01:14.829 INFO:teuthology.orchestra.run.smithi106.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-05-07T14:01:14.829 INFO:teuthology.orchestra.run.smithi106.stdout: "device_failure_prediction_mode": "none", 2024-05-07T14:01:14.830 INFO:teuthology.orchestra.run.smithi106.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-05-07T14:01:14.830 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-05-07T14:01:14.830 INFO:teuthology.orchestra.run.smithi106.stdout: "err_to_graylog": "false", 2024-05-07T14:01:14.830 INFO:teuthology.orchestra.run.smithi106.stdout: "err_to_journald": "false", 2024-05-07T14:01:14.830 INFO:teuthology.orchestra.run.smithi106.stdout: "err_to_stderr": "true", 2024-05-07T14:01:14.830 INFO:teuthology.orchestra.run.smithi106.stdout: "err_to_syslog": "false", 2024-05-07T14:01:14.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event_tracing": "false", 2024-05-07T14:01:14.831 INFO:teuthology.orchestra.run.smithi106.stdout: "exporter_addr": "0.0.0.0", 2024-05-07T14:01:14.831 INFO:teuthology.orchestra.run.smithi106.stdout: "exporter_http_port": "9926", 2024-05-07T14:01:14.831 INFO:teuthology.orchestra.run.smithi106.stdout: "exporter_prio_limit": "5", 2024-05-07T14:01:14.831 INFO:teuthology.orchestra.run.smithi106.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-05-07T14:01:14.831 INFO:teuthology.orchestra.run.smithi106.stdout: "exporter_sort_metrics": "true", 2024-05-07T14:01:14.831 INFO:teuthology.orchestra.run.smithi106.stdout: "exporter_stats_period": "5", 2024-05-07T14:01:14.832 INFO:teuthology.orchestra.run.smithi106.stdout: "fake_statfs_for_testing": "0", 2024-05-07T14:01:14.832 INFO:teuthology.orchestra.run.smithi106.stdout: "fatal_signal_handlers": "true", 2024-05-07T14:01:14.832 INFO:teuthology.orchestra.run.smithi106.stdout: "filer_max_purge_ops": "10", 2024-05-07T14:01:14.832 INFO:teuthology.orchestra.run.smithi106.stdout: "filer_max_truncate_ops": "128", 2024-05-07T14:01:14.832 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_apply_finisher_threads": "1", 2024-05-07T14:01:14.832 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_blackhole": "false", 2024-05-07T14:01:14.833 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_btrfs_clone_range": "true", 2024-05-07T14:01:14.833 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_btrfs_snap": "true", 2024-05-07T14:01:14.833 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_caller_concurrency": "10", 2024-05-07T14:01:14.833 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_collect_device_partition_information": "true", 2024-05-07T14:01:14.833 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_commit_timeout": "600.000000", 2024-05-07T14:01:14.833 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_debug_inject_read_err": "false", 2024-05-07T14:01:14.833 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_debug_omap_check": "false", 2024-05-07T14:01:14.834 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_debug_random_read_err": "0.000000", 2024-05-07T14:01:14.834 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_debug_verify_split": "false", 2024-05-07T14:01:14.834 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_dump_file": "", 2024-05-07T14:01:14.834 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-05-07T14:01:14.834 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-05-07T14:01:14.834 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_fadvise": "true", 2024-05-07T14:01:14.835 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_fail_eio": "true", 2024-05-07T14:01:14.835 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_fd_cache_shards": "16", 2024-05-07T14:01:14.835 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_fd_cache_size": "128", 2024-05-07T14:01:14.835 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_fiemap": "false", 2024-05-07T14:01:14.835 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_fiemap_threshold": "4096", 2024-05-07T14:01:14.835 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-05-07T14:01:14.836 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_index_retry_probability": "0.000000", 2024-05-07T14:01:14.836 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_inject_stall": "0", 2024-05-07T14:01:14.836 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_journal_parallel": "false", 2024-05-07T14:01:14.836 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_journal_trailing": "false", 2024-05-07T14:01:14.836 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_journal_writeahead": "false", 2024-05-07T14:01:14.836 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_kill_at": "0", 2024-05-07T14:01:14.837 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-05-07T14:01:14.837 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_inline_xattr_size": "0", 2024-05-07T14:01:14.837 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-05-07T14:01:14.837 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-05-07T14:01:14.837 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-05-07T14:01:14.837 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_inline_xattrs": "0", 2024-05-07T14:01:14.837 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-05-07T14:01:14.838 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_inline_xattrs_other": "2", 2024-05-07T14:01:14.838 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-05-07T14:01:14.838 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_sync_interval": "5.000000", 2024-05-07T14:01:14.838 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_xattr_value_size": "0", 2024-05-07T14:01:14.838 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-05-07T14:01:14.838 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-05-07T14:01:14.839 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-05-07T14:01:14.839 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_merge_threshold": "-10", 2024-05-07T14:01:14.839 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_min_sync_interval": "0.010000", 2024-05-07T14:01:14.839 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_odsync_write": "false", 2024-05-07T14:01:14.839 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_omap_backend": "rocksdb", 2024-05-07T14:01:14.839 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_omap_backend_path": "", 2024-05-07T14:01:14.839 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_omap_header_cache_size": "1024", 2024-05-07T14:01:14.840 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_ondisk_finisher_threads": "1", 2024-05-07T14:01:14.840 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-05-07T14:01:14.840 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_op_thread_timeout": "60", 2024-05-07T14:01:14.840 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_op_threads": "2", 2024-05-07T14:01:14.840 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_punch_hole": "false", 2024-05-07T14:01:14.840 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-05-07T14:01:14.840 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-05-07T14:01:14.841 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-05-07T14:01:14.841 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-05-07T14:01:14.841 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-05-07T14:01:14.841 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_queue_max_bytes": "104857600", 2024-05-07T14:01:14.841 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-05-07T14:01:14.841 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-05-07T14:01:14.842 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-05-07T14:01:14.842 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_queue_max_ops": "50", 2024-05-07T14:01:14.842 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-05-07T14:01:14.842 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_seek_data_hole": "false", 2024-05-07T14:01:14.842 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_sloppy_crc": "false", 2024-05-07T14:01:14.842 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-05-07T14:01:14.843 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_splice": "false", 2024-05-07T14:01:14.843 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_split_multiple": "2", 2024-05-07T14:01:14.843 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_split_rand_factor": "20", 2024-05-07T14:01:14.843 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_update_to": "1000", 2024-05-07T14:01:14.843 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-05-07T14:01:14.843 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-05-07T14:01:14.843 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-05-07T14:01:14.844 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-05-07T14:01:14.844 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-05-07T14:01:14.844 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-05-07T14:01:14.844 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_wbthrottle_enable": "true", 2024-05-07T14:01:14.845 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-05-07T14:01:14.845 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-05-07T14:01:14.845 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-05-07T14:01:14.845 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-05-07T14:01:14.845 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-05-07T14:01:14.846 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-05-07T14:01:14.846 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_xfs_extsize": "false", 2024-05-07T14:01:14.846 INFO:teuthology.orchestra.run.smithi106.stdout: "filestore_zfs_snap": "false", 2024-05-07T14:01:14.846 INFO:teuthology.orchestra.run.smithi106.stdout: "fio_dir": "/tmp/fio", 2024-05-07T14:01:14.847 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "0d349e2f-0c2b-4aab-8a22-181c69b40dbb", 2024-05-07T14:01:14.847 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_allow_other": "true", 2024-05-07T14:01:14.847 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_atomic_o_trunc": "true", 2024-05-07T14:01:14.847 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_big_writes": "true", 2024-05-07T14:01:14.847 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_debug": "false", 2024-05-07T14:01:14.848 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_default_permissions": "false", 2024-05-07T14:01:14.848 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_disable_pagecache": "false", 2024-05-07T14:01:14.848 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_max_write": "0", 2024-05-07T14:01:14.848 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_multithreaded": "true", 2024-05-07T14:01:14.848 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_require_active_mds": "true", 2024-05-07T14:01:14.849 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_set_user_groups": "true", 2024-05-07T14:01:14.849 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_splice_move": "true", 2024-05-07T14:01:14.849 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_splice_read": "true", 2024-05-07T14:01:14.849 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_splice_write": "true", 2024-05-07T14:01:14.850 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_syncfs_on_mksnap": "true", 2024-05-07T14:01:14.850 INFO:teuthology.orchestra.run.smithi106.stdout: "fuse_use_invalidate_cb": "true", 2024-05-07T14:01:14.850 INFO:teuthology.orchestra.run.smithi106.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-05-07T14:01:14.850 INFO:teuthology.orchestra.run.smithi106.stdout: "gss_target_name": "ceph", 2024-05-07T14:01:14.850 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_file": "", 2024-05-07T14:01:14.851 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_inject_failure": "0", 2024-05-07T14:01:14.851 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_interval": "5", 2024-05-07T14:01:14.851 INFO:teuthology.orchestra.run.smithi106.stdout: "host": "smithi106", 2024-05-07T14:01:14.851 INFO:teuthology.orchestra.run.smithi106.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-05-07T14:01:14.852 INFO:teuthology.orchestra.run.smithi106.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-05-07T14:01:14.852 INFO:teuthology.orchestra.run.smithi106.stdout: "immutable_object_cache_max_size": "1073741824", 2024-05-07T14:01:14.852 INFO:teuthology.orchestra.run.smithi106.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-05-07T14:01:14.852 INFO:teuthology.orchestra.run.smithi106.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-05-07T14:01:14.852 INFO:teuthology.orchestra.run.smithi106.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-05-07T14:01:14.853 INFO:teuthology.orchestra.run.smithi106.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-05-07T14:01:14.853 INFO:teuthology.orchestra.run.smithi106.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-05-07T14:01:14.853 INFO:teuthology.orchestra.run.smithi106.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-05-07T14:01:14.853 INFO:teuthology.orchestra.run.smithi106.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-05-07T14:01:14.854 INFO:teuthology.orchestra.run.smithi106.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-05-07T14:01:14.854 INFO:teuthology.orchestra.run.smithi106.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-05-07T14:01:14.854 INFO:teuthology.orchestra.run.smithi106.stdout: "immutable_object_cache_watermark": "0.900000", 2024-05-07T14:01:14.854 INFO:teuthology.orchestra.run.smithi106.stdout: "inject_early_sigterm": "false", 2024-05-07T14:01:14.854 INFO:teuthology.orchestra.run.smithi106.stdout: "jaeger_agent_port": "6799", 2024-05-07T14:01:14.855 INFO:teuthology.orchestra.run.smithi106.stdout: "jaeger_tracing_enable": "false", 2024-05-07T14:01:14.855 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_aio": "true", 2024-05-07T14:01:14.855 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_align_min_size": "65536", 2024-05-07T14:01:14.855 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_block_align": "true", 2024-05-07T14:01:14.856 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_block_size": "4096", 2024-05-07T14:01:14.856 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_dio": "true", 2024-05-07T14:01:14.856 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_discard": "false", 2024-05-07T14:01:14.856 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_force_aio": "false", 2024-05-07T14:01:14.856 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_ignore_corruption": "false", 2024-05-07T14:01:14.857 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_max_write_bytes": "10485760", 2024-05-07T14:01:14.857 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_max_write_entries": "100", 2024-05-07T14:01:14.857 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_replay_from": "0", 2024-05-07T14:01:14.857 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_throttle_high_multiple": "0.000000", 2024-05-07T14:01:14.857 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-05-07T14:01:14.858 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-05-07T14:01:14.858 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_throttle_max_multiple": "0.000000", 2024-05-07T14:01:14.858 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_write_header_frequency": "0", 2024-05-07T14:01:14.858 INFO:teuthology.orchestra.run.smithi106.stdout: "journal_zero_on_create": "false", 2024-05-07T14:01:14.859 INFO:teuthology.orchestra.run.smithi106.stdout: "journaler_prefetch_periods": "10", 2024-05-07T14:01:14.859 INFO:teuthology.orchestra.run.smithi106.stdout: "journaler_prezero_periods": "5", 2024-05-07T14:01:14.859 INFO:teuthology.orchestra.run.smithi106.stdout: "journaler_write_head_interval": "15", 2024-05-07T14:01:14.859 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "", 2024-05-07T14:01:14.859 INFO:teuthology.orchestra.run.smithi106.stdout: "keyfile": "", 2024-05-07T14:01:14.860 INFO:teuthology.orchestra.run.smithi106.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-05-07T14:01:14.860 INFO:teuthology.orchestra.run.smithi106.stdout: "kstore_backend": "rocksdb", 2024-05-07T14:01:14.860 INFO:teuthology.orchestra.run.smithi106.stdout: "kstore_default_stripe_size": "65536", 2024-05-07T14:01:14.860 INFO:teuthology.orchestra.run.smithi106.stdout: "kstore_fsck_on_mount": "false", 2024-05-07T14:01:14.860 INFO:teuthology.orchestra.run.smithi106.stdout: "kstore_fsck_on_mount_deep": "true", 2024-05-07T14:01:14.860 INFO:teuthology.orchestra.run.smithi106.stdout: "kstore_max_bytes": "67108864", 2024-05-07T14:01:14.861 INFO:teuthology.orchestra.run.smithi106.stdout: "kstore_max_ops": "512", 2024-05-07T14:01:14.861 INFO:teuthology.orchestra.run.smithi106.stdout: "kstore_nid_prealloc": "1024", 2024-05-07T14:01:14.861 INFO:teuthology.orchestra.run.smithi106.stdout: "kstore_onode_map_size": "1024", 2024-05-07T14:01:14.861 INFO:teuthology.orchestra.run.smithi106.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-05-07T14:01:14.861 INFO:teuthology.orchestra.run.smithi106.stdout: "kstore_sync_submit_transaction": "false", 2024-05-07T14:01:14.861 INFO:teuthology.orchestra.run.smithi106.stdout: "kstore_sync_transaction": "false", 2024-05-07T14:01:14.861 INFO:teuthology.orchestra.run.smithi106.stdout: "librados_thread_count": "2", 2024-05-07T14:01:14.862 INFO:teuthology.orchestra.run.smithi106.stdout: "lockdep": "false", 2024-05-07T14:01:14.862 INFO:teuthology.orchestra.run.smithi106.stdout: "lockdep_force_backtrace": "false", 2024-05-07T14:01:14.862 INFO:teuthology.orchestra.run.smithi106.stdout: "log_coarse_timestamps": "true", 2024-05-07T14:01:14.862 INFO:teuthology.orchestra.run.smithi106.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-05-07T14:01:14.862 INFO:teuthology.orchestra.run.smithi106.stdout: "log_flush_on_exit": "false", 2024-05-07T14:01:14.862 INFO:teuthology.orchestra.run.smithi106.stdout: "log_graylog_host": "127.0.0.1", 2024-05-07T14:01:14.863 INFO:teuthology.orchestra.run.smithi106.stdout: "log_graylog_port": "12201", 2024-05-07T14:01:14.863 INFO:teuthology.orchestra.run.smithi106.stdout: "log_max_new": "1000", 2024-05-07T14:01:14.863 INFO:teuthology.orchestra.run.smithi106.stdout: "log_max_recent": "10000", 2024-05-07T14:01:14.863 INFO:teuthology.orchestra.run.smithi106.stdout: "log_stderr_prefix": "", 2024-05-07T14:01:14.863 INFO:teuthology.orchestra.run.smithi106.stdout: "log_stop_at_utilization": "0.970000", 2024-05-07T14:01:14.863 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": "true", 2024-05-07T14:01:14.864 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_graylog": "false", 2024-05-07T14:01:14.864 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_journald": "false", 2024-05-07T14:01:14.864 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_stderr": "false", 2024-05-07T14:01:14.864 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_syslog": "false", 2024-05-07T14:01:14.864 INFO:teuthology.orchestra.run.smithi106.stdout: "max_rotating_auth_attempts": "10", 2024-05-07T14:01:14.865 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-05-07T14:01:14.865 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_action_on_write_error": "1", 2024-05-07T14:01:14.865 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_alternate_name_max": "8192", 2024-05-07T14:01:14.865 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_asio_thread_count": "2", 2024-05-07T14:01:14.865 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_export_pin": "true", 2024-05-07T14:01:14.866 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_fragment_dirs": "true", 2024-05-07T14:01:14.866 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-05-07T14:01:14.866 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_fragment_interval": "5", 2024-05-07T14:01:14.866 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_fragment_size_max": "100000", 2024-05-07T14:01:14.867 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_idle_threshold": "0.000000", 2024-05-07T14:01:14.867 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_interval": "10", 2024-05-07T14:01:14.867 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_max": "-1", 2024-05-07T14:01:14.867 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_max_until": "-1", 2024-05-07T14:01:14.867 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_merge_size": "50", 2024-05-07T14:01:14.868 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_midchunk": "0.300000", 2024-05-07T14:01:14.868 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_min_rebalance": "0.100000", 2024-05-07T14:01:14.868 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_min_start": "0.200000", 2024-05-07T14:01:14.868 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_minchunk": "0.001000", 2024-05-07T14:01:14.868 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_mode": "0", 2024-05-07T14:01:14.869 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_need_max": "1.200000", 2024-05-07T14:01:14.869 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_need_min": "0.800000", 2024-05-07T14:01:14.869 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_overload_epochs": "2", 2024-05-07T14:01:14.869 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-05-07T14:01:14.869 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_sample_interval": "3.000000", 2024-05-07T14:01:14.870 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_split_bits": "3", 2024-05-07T14:01:14.870 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_split_rd": "25000.000000", 2024-05-07T14:01:14.870 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_split_size": "10000", 2024-05-07T14:01:14.870 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_split_wr": "10000.000000", 2024-05-07T14:01:14.870 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_target_decay": "10.000000", 2024-05-07T14:01:14.871 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-05-07T14:01:14.871 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_beacon_grace": "15.000000", 2024-05-07T14:01:14.871 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_beacon_interval": "4.000000", 2024-05-07T14:01:14.871 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_beacon_mon_down_grace": "60", 2024-05-07T14:01:14.871 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache_memory_limit": "4294967296", 2024-05-07T14:01:14.871 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache_mid": "0.700000", 2024-05-07T14:01:14.872 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-05-07T14:01:14.872 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache_quiesce_delay": "0", 2024-05-07T14:01:14.872 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache_quiesce_sleep": "200", 2024-05-07T14:01:14.872 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache_quiesce_splitauth": "true", 2024-05-07T14:01:14.872 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache_quiesce_threshold": "524288", 2024-05-07T14:01:14.872 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache_release_free_interval": "10", 2024-05-07T14:01:14.872 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache_reservation": "0.050000", 2024-05-07T14:01:14.873 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-05-07T14:01:14.873 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache_trim_interval": "1", 2024-05-07T14:01:14.873 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache_trim_threshold": "262144", 2024-05-07T14:01:14.873 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-05-07T14:01:14.873 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-05-07T14:01:14.873 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_client_delegate_inos_pct": "50", 2024-05-07T14:01:14.874 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_client_prealloc_inos": "1000", 2024-05-07T14:01:14.874 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-05-07T14:01:14.874 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_connect_bootstrapping": "false", 2024-05-07T14:01:14.874 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_damage_table_max_entries": "10000", 2024-05-07T14:01:14.874 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-05-07T14:01:14.874 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_debug_auth_pins": "false", 2024-05-07T14:01:14.874 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_debug_frag": "false", 2024-05-07T14:01:14.875 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_debug_scatterstat": "false", 2024-05-07T14:01:14.875 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_debug_subtrees": "false", 2024-05-07T14:01:14.875 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_decay_halflife": "5.000000", 2024-05-07T14:01:14.875 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_default_dir_hash": "2", 2024-05-07T14:01:14.875 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_defer_session_stale": "true", 2024-05-07T14:01:14.875 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_deny_all_reconnect": "false", 2024-05-07T14:01:14.875 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_dir_keys_per_op": "16384", 2024-05-07T14:01:14.876 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_dir_max_commit_size": "10", 2024-05-07T14:01:14.876 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_dir_max_entries": "0", 2024-05-07T14:01:14.876 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_dir_prefetch": "true", 2024-05-07T14:01:14.876 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_dirstat_min_interval": "1.000000", 2024-05-07T14:01:14.876 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_dump_cache_after_rejoin": "false", 2024-05-07T14:01:14.876 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_dump_cache_on_map": "false", 2024-05-07T14:01:14.877 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_dump_cache_threshold_file": "0", 2024-05-07T14:01:14.877 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-05-07T14:01:14.877 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_early_reply": "true", 2024-05-07T14:01:14.877 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_enable_op_tracker": "true", 2024-05-07T14:01:14.877 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_enforce_unique_name": "true", 2024-05-07T14:01:14.877 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_export_ephemeral_distributed": "true", 2024-05-07T14:01:14.877 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-05-07T14:01:14.878 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_export_ephemeral_random": "true", 2024-05-07T14:01:14.878 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-05-07T14:01:14.878 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-05-07T14:01:14.878 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_forward_all_requests_to_auth": "false", 2024-05-07T14:01:14.878 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-05-07T14:01:14.878 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-05-07T14:01:14.878 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-05-07T14:01:14.879 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-05-07T14:01:14.879 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_health_cache_threshold": "1.500000", 2024-05-07T14:01:14.879 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_health_summarize_threshold": "10", 2024-05-07T14:01:14.879 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_heartbeat_grace": "15.000000", 2024-05-07T14:01:14.879 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_heartbeat_reset_grace": "1000", 2024-05-07T14:01:14.879 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_inject_health_dummy": "false", 2024-05-07T14:01:14.880 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-05-07T14:01:14.880 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_inject_migrator_session_race": "false", 2024-05-07T14:01:14.880 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-05-07T14:01:14.880 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-05-07T14:01:14.880 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-05-07T14:01:14.880 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_join_fs": "", 2024-05-07T14:01:14.880 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_journal_format": "1", 2024-05-07T14:01:14.881 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_kill_create_at": "0", 2024-05-07T14:01:14.881 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_kill_export_at": "0", 2024-05-07T14:01:14.881 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_kill_import_at": "0", 2024-05-07T14:01:14.881 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_kill_journal_at": "0", 2024-05-07T14:01:14.881 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_kill_journal_expire_at": "0", 2024-05-07T14:01:14.881 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_kill_journal_replay_at": "0", 2024-05-07T14:01:14.881 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_kill_link_at": "0", 2024-05-07T14:01:14.882 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_kill_mdstable_at": "0", 2024-05-07T14:01:14.882 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_kill_openc_at": "0", 2024-05-07T14:01:14.882 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_kill_rename_at": "0", 2024-05-07T14:01:14.882 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_kill_shutdown_at": "0", 2024-05-07T14:01:14.882 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-05-07T14:01:14.882 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log_event_large_threshold": "524288", 2024-05-07T14:01:14.883 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log_events_per_segment": "1024", 2024-05-07T14:01:14.883 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log_major_segment_event_ratio": "12", 2024-05-07T14:01:14.883 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log_max_events": "-1", 2024-05-07T14:01:14.883 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log_max_segments": "128", 2024-05-07T14:01:14.883 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log_pause": "false", 2024-05-07T14:01:14.883 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log_segment_size": "0", 2024-05-07T14:01:14.883 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log_skip_corrupt_events": "false", 2024-05-07T14:01:14.883 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log_skip_unbounded_events": "false", 2024-05-07T14:01:14.883 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-05-07T14:01:14.883 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log_trim_threshold": "128", 2024-05-07T14:01:14.883 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-05-07T14:01:14.883 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log_warn_factor": "2.000000", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_max_caps_per_client": "1048576", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_max_completed_flushes": "100000", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_max_completed_requests": "100000", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_max_export_size": "20971520", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_max_file_recover": "32", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_max_purge_files": "64", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_max_purge_ops": "8192", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_max_snaps_per_dir": "100", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_metrics_update_interval": "2", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_min_caps_per_client": "100", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_min_caps_working_set": "10000", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-05-07T14:01:14.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_numa_node": "-1", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_op_complaint_time": "30.000000", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_op_history_duration": "600", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_op_history_size": "20", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_op_history_slow_op_size": "20", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_op_history_slow_op_threshold": "10", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_op_log_threshold": "5", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_ping_grace": "15", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_ping_interval": "5", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_recall_max_caps": "30000", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-05-07T14:01:14.885 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_recall_max_decay_threshold": "131072", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_recall_warning_threshold": "262144", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_reconnect_timeout": "45.000000", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_replay_interval": "1.000000", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_root_ino_gid": "0", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_root_ino_uid": "0", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_session_blocklist_on_evict": "true", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_session_blocklist_on_timeout": "true", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-05-07T14:01:14.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_session_metadata_threshold": "16777216", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_shutdown_check": "0", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_skip_ino": "0", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_sleep_rank_change": "0.000000", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_snap_max_uid": "4294967294", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_snap_min_uid": "0", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_snap_rstat": "false", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_standby_replay_damaged": "false", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_symlink_recovery": "true", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_task_status_update_interval": "2.000000", 2024-05-07T14:01:14.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_thrash_exports": "0", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_thrash_fragments": "0", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_tick_interval": "5.000000", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_valgrind_exit": "false", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_verify_backtrace": "1", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_verify_scatter": "false", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_wipe_ino_prealloc": "false", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_wipe_sessions": "false", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "mempool_debug": "false", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "memstore_debug_omit_block_device_write": "false", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "memstore_device_bytes": "1073741824", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "memstore_page_set": "false", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "memstore_page_size": "65536", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_client_bytes": "134217728", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_client_messages": "512", 2024-05-07T14:01:14.888 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-05-07T14:01:14.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_connect_retry_interval": "1.000000", 2024-05-07T14:01:14.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-05-07T14:01:14.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-05-07T14:01:14.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_disabled_modules": "", 2024-05-07T14:01:14.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-05-07T14:01:14.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_max_pg_num_change": "128", 2024-05-07T14:01:14.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_mds_bytes": "134217728", 2024-05-07T14:01:14.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_mds_messages": "128", 2024-05-07T14:01:14.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-05-07T14:01:14.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_mon_bytes": "134217728", 2024-05-07T14:01:14.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_mon_messages": "128", 2024-05-07T14:01:14.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_osd_bytes": "536870912", 2024-05-07T14:01:14.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_osd_messages": "8192", 2024-05-07T14:01:14.890 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_pool": "true", 2024-05-07T14:01:14.890 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_service_beacon_grace": "60.000000", 2024-05-07T14:01:14.890 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_standby_modules": "true", 2024-05-07T14:01:14.890 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_stats_period": "5", 2024-05-07T14:01:14.890 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_stats_threshold": "5", 2024-05-07T14:01:14.890 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_tick_period": "2", 2024-05-07T14:01:14.890 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-05-07T14:01:14.890 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_accept_timeout_factor": "2.000000", 2024-05-07T14:01:14.890 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_allow_pool_delete": "true", 2024-05-07T14:01:14.890 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_allow_pool_size_one": "true", 2024-05-07T14:01:14.890 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_auth_validate_all_caps": "true", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_client_bytes": "104857600", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_client_directed_command_retry": "2", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_client_hunt_interval": "3.000000", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_client_hunt_parallel": "3", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_client_log_interval": "1.000000", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_client_ping_interval": "10.000000", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_client_ping_timeout": "30.000000", 2024-05-07T14:01:14.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_client_target_rank": "-1", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_clock_drift_allowed": "1.000000", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_cluster_log_file_level": "debug", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_cluster_log_to_file": "true", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_cluster_log_to_graylog": "false", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_cluster_log_to_journald": "false", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_cluster_log_to_stderr": "false", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-05-07T14:01:14.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_compact_on_bootstrap": "false", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_compact_on_start": "false", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_compact_on_trim": "true", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_con_tracker_persist_interval": "10", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_con_tracker_score_halflife": "43200", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_config_key_max_entry_size": "65536", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_cpu_threads": "4", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_crush_min_required_version": "hammer", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_daemon_bytes": "419430400", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_data_avail_crit": "5", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_data_avail_warn": "5", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_data_size_warn": "16106127360", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_debug_block_osdmap_trim": "false", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-05-07T14:01:14.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_debug_dump_json": "false", 2024-05-07T14:01:14.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-05-07T14:01:14.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_debug_dump_transactions": "false", 2024-05-07T14:01:14.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_debug_extra_checks": "false", 2024-05-07T14:01:14.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-05-07T14:01:14.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-05-07T14:01:14.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_debug_no_require_reef": "false", 2024-05-07T14:01:14.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_debug_no_require_squid": "false", 2024-05-07T14:01:14.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-05-07T14:01:14.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_delta_reset_interval": "10.000000", 2024-05-07T14:01:14.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_dns_srv_name": "ceph-mon", 2024-05-07T14:01:14.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_down_mkfs_grace": "120", 2024-05-07T14:01:14.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_down_uptime_grace": "60", 2024-05-07T14:01:14.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_election_default_strategy": "1", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_election_timeout": "5.000000", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_elector_ping_divisor": "2", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_elector_ping_timeout": "2.000000", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_enable_op_tracker": "true", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_fake_pool_delete": "false", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_force_quorum_join": "false", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_globalid_prealloc": "10000", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_health_detail_to_clog": "false", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_health_log_update_period": "5", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_health_max_detail": "50", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_health_to_clog": "true", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_health_to_clog_interval": "600", 2024-05-07T14:01:14.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_host": "172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790],172.21.15.107", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_host_override": "", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_initial_members": "", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_keyvaluedb": "rocksdb", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_lease": "5.000000", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_log_full_interval": "50", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_log_max": "10000", 2024-05-07T14:01:14.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_log_max_summary": "50", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_max_log_entries_per_event": "4096", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_max_log_epochs": "500", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_max_mdsmap_epochs": "500", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_max_mgrmap_epochs": "500", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_max_osd": "10000", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_max_pg_per_osd": "10000", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_max_pool_pg_num": "65536", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_mds_force_trim_to": "0", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_mds_skip_sanity": "false", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_memory_autotune": "true", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_memory_target": "2147483648", 2024-05-07T14:01:14.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_mgr_beacon_grace": "30", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_mgr_digest_period": "5", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_mgr_inactive_grace": "60", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_mgr_mkfs_grace": "240", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_min_osdmap_epochs": "500", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_op_complaint_time": "30", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_op_history_duration": "600", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_op_history_size": "20", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_op_history_slow_op_size": "20", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_op_history_slow_op_threshold": "10", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_op_log_threshold": "5", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-05-07T14:01:14.898 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_auto_mark_in": "false", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_auto_mark_new_in": "true", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_cache_size": "500", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_cache_size_min": "134217728", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_crush_smoke_test": "true", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_destroyed_out_interval": "600", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_down_out_interval": "600", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_force_trim_to": "0", 2024-05-07T14:01:14.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_full_ratio": "0.950000", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_laggy_halflife": "3600", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_laggy_max_interval": "300", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_laggy_weight": "0.300000", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_max_creating_pgs": "1024", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_max_initial_pgs": "1024", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_min_down_reporters": "2", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_prime_pg_temp": "true", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-05-07T14:01:14.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_report_timeout": "900", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_warn_num_repaired": "10", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osd_warn_op_age": "32.000000", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osdmap_full_prune_interval": "10", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osdmap_full_prune_min": "10000", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_pg_stuck_threshold": "60", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_pg_warn_min_objects": "10000", 2024-05-07T14:01:14.901 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_pg_warn_min_per_osd": "0", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_pool_quota_crit_threshold": "0", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_pool_quota_warn_threshold": "0", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_probe_timeout": "2.000000", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_reweight_max_change": "0.050000", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_reweight_max_osds": "4", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_scrub_interval": "86400", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_scrub_max_keys": "100", 2024-05-07T14:01:14.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_scrub_timeout": "300", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_session_timeout": "300", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_smart_report_timeout": "5", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_stat_smooth_intervals": "6", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_stretch_pool_min_size": "2", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_stretch_pool_size": "4", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_subscribe_interval": "86400.000000", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_sync_debug": "false", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_sync_max_payload_keys": "2000", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_sync_max_payload_size": "1048576", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_sync_provider_kill_at": "0", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_sync_requester_kill_at": "0", 2024-05-07T14:01:14.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_sync_timeout": "60.000000", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_target_pg_per_osd": "100", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_tick_interval": "5", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_timecheck_interval": "300.000000", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_use_min_delay_socket": "false", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_older_version_delay": "604800", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_filestore_osds": "false", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-05-07T14:01:14.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_misplaced": "false", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_older_version": "true", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_pool_no_app": "true", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_on_too_few_osds": "false", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": "", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-07T14:01:14.905 INFO:teuthology.orchestra.run.smithi106.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "motr_tracing_enabled": "false", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_op_threads": "3", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_buffer_size": "131072", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_cm": "false", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_device_name": "", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_dscp": "96", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_gid_idx": "0", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_local_gid": "", 2024-05-07T14:01:14.906 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_polling_us": "1000", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_port_num": "1", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_roce_ver": "1", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_send_buffers": "1024", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_sl": "3", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_support_srq": "true", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_rdma_type": "ib", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_async_reap_threshold": "5", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_bind_before_connect": "false", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_bind_ipv4": "true", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_bind_ipv6": "false", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_bind_msgr1": "true", 2024-05-07T14:01:14.907 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_bind_msgr2": "true", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_bind_port_max": "7568", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_bind_port_min": "6800", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_bind_prefer_ipv4": "false", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_bind_retry_count": "3", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_bind_retry_delay": "5", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_blackhole_client": "false", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_blackhole_mds": "false", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_blackhole_mgr": "false", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_blackhole_mon": "false", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_blackhole_osd": "false", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_client_mode": "crc secure", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_cluster_mode": "crc secure", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_cluster_type": "", 2024-05-07T14:01:14.908 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_compress_secure": "false", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_connection_idle_timeout": "900", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_connection_ready_timeout": "10", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_crc_data": "true", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_crc_header": "true", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_die_on_bad_msg": "false", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_die_on_bug": "true", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_die_on_old_message": "true", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_die_on_skipped_message": "false", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_die_on_unhandled_msg": "false", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_coremask": "0xF", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_devs_allowlist": "", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_enable_tso": "true", 2024-05-07T14:01:14.909 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_hugepages": "", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_hw_flow_control": "true", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_lro": "true", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_memory_channel": "4", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_pmd": "", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_port_id": "0", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dump_corrupt_message_level": "1", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_dump_on_send": "false", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_initial_backoff": "0.200000", 2024-05-07T14:01:14.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_inject_delay_max": "1.000000", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_inject_delay_probability": "0.000000", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_inject_delay_type": "", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_inject_internal_delays": "0.000000", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_inject_network_congestion": "0", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_inject_socket_failures": "0", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_learn_addr_from_peer": "true", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_max_accept_failures": "4", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_max_backoff": "15.000000", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_mon_client_mode": "secure crc", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_mon_cluster_mode": "secure crc", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_mon_service_mode": "secure crc", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_osd_compress_min_size": "1024", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_osd_compress_mode": "none", 2024-05-07T14:01:14.911 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_osd_compression_algorithm": "snappy", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_pq_min_cost": "65536", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_public_type": "", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_service_mode": "crc secure", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_tcp_listen_backlog": "512", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_tcp_nodelay": "true", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_tcp_rcvbuf": "0", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "ms_type": "async+posix", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "no_config_file": "false", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter_completion_locks_per_session": "32", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter_debug_inject_relock_delay": "false", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter_inflight_op_bytes": "104857600", 2024-05-07T14:01:14.912 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter_inflight_ops": "1024", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter_inject_no_watch_ping": "false", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter_tick_interval": "5.000000", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter_timeout": "10.000000", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "objectstore_blackhole": "false", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "openssl_engine_opts": "", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_agent_delay_time": "5.000000", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_agent_hist_halflife": "1000", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_agent_max_low_ops": "2", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_agent_max_ops": "4", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_agent_quantize_effort": "0.100000", 2024-05-07T14:01:14.913 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_agent_slop": "0.020000", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_allow_recovery_below_min_size": "true", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_asio_thread_count": "2", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_async_recovery_min_cost": "100", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_auto_mark_unfound_lost": "false", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_backfill_retry_interval": "30.000000", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_backfill_scan_max": "512", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_backfill_scan_min": "64", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_backoff_on_degraded": "false", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_backoff_on_peering": "false", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_backoff_on_unfound": "true", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_beacon_report_interval": "300", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_bench_duration": "30", 2024-05-07T14:01:14.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_bench_max_block_size": "67108864", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_bench_small_size_max_iops": "100", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_blkin_trace_all": "false", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_blocked_scrub_grace_period": "120", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_check_for_log_corruption": "false", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_class_update_on_start": "true", 2024-05-07T14:01:14.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_client_message_cap": "256", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_client_message_size_cap": "524288000", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_client_op_priority": "63", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_client_watch_timeout": "30", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_command_max_records": "256", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_compact_on_start": "false", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_crush_chooseleaf_type": "0", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_crush_initial_weight": "-1.000000", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_crush_update_on_start": "true", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_crush_update_weight_set": "true", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-05-07T14:01:14.916 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_drop_ping_duration": "0", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_feed_pullee": "-1", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_misdirected_ops": "false", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_no_acting_change": "false", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_no_purge_strays": "false", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_op_order": "false", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_pg_log_writeout": "false", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_pretend_recovery_active": "false", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-05-07T14:01:14.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_shutdown": "false", 2024-05-07T14:01:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-05-07T14:01:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-05-07T14:01:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_trim_objects": "false", 2024-05-07T14:01:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_verify_cached_snaps": "false", 2024-05-07T14:01:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_verify_missing_on_start": "false", 2024-05-07T14:01:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_verify_snaps": "false", 2024-05-07T14:01:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-05-07T14:01:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-05-07T14:01:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_deep_scrub_keys": "1024", 2024-05-07T14:01:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-05-07T14:01:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-05-07T14:01:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-05-07T14:01:14.918 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_deep_scrub_stride": "524288", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_default_data_pool_replay_window": "5", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_default_notify_timeout": "30", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_delete_sleep": "0.000000", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_discard_disconnected_ops": "true", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_enable_op_tracker": "true", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_extblkdev_plugins": "vdo", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-05-07T14:01:14.919 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_fast_info": "true", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_fast_shutdown": "true", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_fast_shutdown_timeout": "15", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_function_tracing": "false", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_heartbeat_grace": "20", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_heartbeat_interval": "6", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_heartbeat_min_peers": "10", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_heartbeat_min_size": "2000", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_heartbeat_stale": "600", 2024-05-07T14:01:14.920 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_hit_set_max_size": "100000", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_hit_set_min_size": "1000", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_journal_flush_on_shutdown": "true", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_journal_size": "5120", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_kill_backfill_at": "0", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_loop_before_reset_tphandle": "64", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_map_cache_size": "50", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_map_dedup": "true", 2024-05-07T14:01:14.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_map_message_max": "40", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_map_message_max_bytes": "10485760", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_map_share_max_epochs": "40", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_attr_name_len": "100", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_attr_size": "0", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_backfills": "1", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_markdown_count": "5", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_markdown_period": "600", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_object_name_len": "2048", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_object_namespace_len": "256", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_object_size": "134217728", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_omap_entries_per_request": "1024", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_pg_blocked_by": "16", 2024-05-07T14:01:14.922 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_pg_log_entries": "10000", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_pgls": "1024", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_push_cost": "8388608", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_push_objects": "10", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_scrubs": "3", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_trimming_pgs": "2", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_write_op_reply_len": "64", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_max_write_size": "90", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-05-07T14:01:14.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_override_recovery_settings": "false", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_profile": "balanced", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-05-07T14:01:14.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mclock_skip_benchmark": "false", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_memory_base": "805306368", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_memory_cache_min": "134217728", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_memory_target": "4294967296", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_memory_target_autotune": "false", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_min_pg_log_entries": "250", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_min_recovery_priority": "0", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mon_heartbeat_interval": "30", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mon_report_interval": "5", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mon_report_max_in_flight": "2", 2024-05-07T14:01:14.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-05-07T14:01:14.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_num_cache_shards": "32", 2024-05-07T14:01:14.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_num_op_tracker_shard": "32", 2024-05-07T14:01:14.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_numa_auto_affinity": "true", 2024-05-07T14:01:14.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_numa_node": "-1", 2024-05-07T14:01:14.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_numa_prefer_iface": "true", 2024-05-07T14:01:14.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-05-07T14:01:14.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_objecter_finishers": "1", 2024-05-07T14:01:14.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_objectstore": "bluestore", 2024-05-07T14:01:14.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_objectstore_fuse": "false", 2024-05-07T14:01:14.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_objectstore_tracing": "false", 2024-05-07T14:01:14.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_complaint_time": "30.000000", 2024-05-07T14:01:14.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_history_duration": "600", 2024-05-07T14:01:14.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_history_size": "20", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_history_slow_op_size": "20", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_log_threshold": "5", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_num_shards": "0", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_num_shards_hdd": "5", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_num_shards_ssd": "8", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_num_threads_per_shard": "0", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_pq_min_cost": "65536", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_queue": "mclock_scheduler", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_queue_cut_off": "high", 2024-05-07T14:01:14.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_thread_suicide_timeout": "150", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_op_thread_timeout": "15", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_open_classes_on_start": "true", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_os_flags": "0", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_peering_op_priority": "255", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pg_delete_cost": "1048576", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pg_delete_priority": "5", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pg_log_dups_tracked": "3000", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pg_log_trim_max": "10000", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pg_log_trim_min": "100", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pg_object_context_cache_count": "64", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-05-07T14:01:14.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-05-07T14:01:14.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-05-07T14:01:14.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-05-07T14:01:14.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-05-07T14:01:14.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-05-07T14:01:14.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-05-07T14:01:14.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-05-07T14:01:14.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_crimson": "false", 2024-05-07T14:01:14.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_crush_rule": "-1", 2024-05-07T14:01:14.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_ec_fast_read": "false", 2024-05-07T14:01:14.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-05-07T14:01:14.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_flag_bulk": "false", 2024-05-07T14:01:14.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-05-07T14:01:14.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_flag_nodelete": "false", 2024-05-07T14:01:14.930 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-05-07T14:01:14.930 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-05-07T14:01:14.930 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_flags": "0", 2024-05-07T14:01:14.930 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-05-07T14:01:14.930 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_min_size": "0", 2024-05-07T14:01:14.930 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-05-07T14:01:14.930 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_pg_num": "32", 2024-05-07T14:01:14.930 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_pgp_num": "0", 2024-05-07T14:01:14.930 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-05-07T14:01:14.930 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_read_ratio": "70", 2024-05-07T14:01:14.930 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_size": "2", 2024-05-07T14:01:14.930 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_default_type": "replicated", 2024-05-07T14:01:14.930 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pool_use_gmt_hitset": "true", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_push_per_object_cost": "1000", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_read_ec_check_for_errors": "false", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recover_clone_overlap": "true", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recover_clone_overlap_limit": "10", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_cost": "20971520", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_delay_start": "0.000000", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_max_active": "0", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_max_active_hdd": "3", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_max_active_ssd": "10", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_max_chunk": "8388608", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_max_single_start": "1", 2024-05-07T14:01:14.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_op_priority": "3", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_op_warn_multiple": "16", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_priority": "5", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_retry_interval": "30.000000", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_sleep": "0.000000", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_repair_during_recovery": "false", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_requested_scrub_priority": "120", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_rollback_to_cluster_snap": "", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_auto_repair": "false", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-05-07T14:01:14.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_begin_hour": "0", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_begin_week_day": "0", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_chunk_max": "25", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_chunk_min": "5", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_cost": "52428800", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_disable_reservation_queuing": "true", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_during_recovery": "false", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_end_hour": "0", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_end_week_day": "0", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_event_cost": "4096", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_invalid_stats": "true", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_load_threshold": "0.500000", 2024-05-07T14:01:14.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_max_interval": "604800.000000", 2024-05-07T14:01:14.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_max_preemptions": "5", 2024-05-07T14:01:14.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_min_interval": "86400.000000", 2024-05-07T14:01:14.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_priority": "5", 2024-05-07T14:01:14.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_scrub_sleep": "0.000000", 2024-05-07T14:01:14.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-05-07T14:01:14.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-05-07T14:01:14.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_shutdown_pgref_assert": "false", 2024-05-07T14:01:14.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_skip_data_digest": "false", 2024-05-07T14:01:14.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_smart_report_timeout": "5", 2024-05-07T14:01:14.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_snap_trim_cost": "1048576", 2024-05-07T14:01:14.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_snap_trim_priority": "5", 2024-05-07T14:01:14.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_snap_trim_sleep": "0.000000", 2024-05-07T14:01:14.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_stats_update_period_scrubbing": "15", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_target_transaction_size": "30", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-05-07T14:01:14.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_tier_default_cache_mode": "writeback", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_tracing": "false", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_use_stale_snap": "false", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "osdc_blkin_trace_all": "false", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "paxos_kill_at": "0", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "paxos_max_join_drift": "10", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "paxos_min": "500", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "paxos_min_wait": "0.050000", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "paxos_propose_interval": "1.000000", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "paxos_service_trim_max": "500", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "paxos_service_trim_max_multiplier": "20", 2024-05-07T14:01:14.936 INFO:teuthology.orchestra.run.smithi106.stdout: "paxos_service_trim_min": "250", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "paxos_stash_full_interval": "25", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "paxos_trim_max": "500", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "paxos_trim_min": "250", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "perf": "true", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "plugin_dir": "/usr/lib/ceph", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "-", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrv": "", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_bind_addr": "-", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_network": "", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_network_interface": "", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "qat_compressor_enabled": "false", 2024-05-07T14:01:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: "qat_compressor_session_max_number": "256", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rados_mon_op_timeout": "0", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rados_osd_op_timeout": "0", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rados_tracing": "false", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_atime_update_interval": "60", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_balance_parent_reads": "false", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_balance_snap_reads": "false", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_blkin_trace_all": "false", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_blocklist_expire_seconds": "0", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_blocklist_on_break_lock": "true", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_cache": "true", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_cache_block_writes_upfront": "false", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_cache_max_dirty": "25165824", 2024-05-07T14:01:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_cache_max_dirty_object": "0", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_cache_policy": "writearound", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_cache_size": "33554432", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_cache_target_dirty": "16777216", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_clone_copy_on_read": "false", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_compression_hint": "none", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_concurrent_management_ops": "10", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_default_clone_format": "auto", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_default_data_pool": "", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_default_features": "61", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_default_format": "2", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_default_map_options": "", 2024-05-07T14:01:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_default_order": "22", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_default_pool": "rbd", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_default_stripe_count": "0", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_default_stripe_unit": "0", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_disable_zero_copy_writes": "true", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_discard_granularity_bytes": "65536", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_enable_alloc_hint": "true", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_io_scheduler": "simple", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_journal_commit_age": "5.000000", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-05-07T14:01:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_journal_object_flush_interval": "0", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_journal_order": "24", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_journal_pool": "", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_journal_splay_width": "4", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_localize_parent_reads": "false", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_localize_snap_reads": "false", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-05-07T14:01:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_image_policy_type": "simple", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_memory_autotune": "true", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_memory_base": "805306368", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-05-07T14:01:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_memory_target": "4294967296", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirroring_delete_delay": "0", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirroring_replay_delay": "0", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_move_to_trash_on_remove": "false", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-05-07T14:01:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_mtime_update_interval": "60", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_non_blocking_aio": "true", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_op_thread_timeout": "60", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_op_threads": "1", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_parent_cache_enabled": "false", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_persistent_cache_mode": "disabled", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_persistent_cache_path": "/tmp", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_persistent_cache_size": "1073741824", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_plugins": "", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_bps_burst": "0", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_bps_limit": "0", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_exclude_ops": "0", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_iops_burst": "0", 2024-05-07T14:01:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-05-07T14:01:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_iops_limit": "0", 2024-05-07T14:01:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_read_bps_burst": "0", 2024-05-07T14:01:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-05-07T14:01:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_read_bps_limit": "0", 2024-05-07T14:01:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_read_iops_burst": "0", 2024-05-07T14:01:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-05-07T14:01:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_read_iops_limit": "0", 2024-05-07T14:01:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_schedule_tick_min": "50", 2024-05-07T14:01:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_write_bps_burst": "0", 2024-05-07T14:01:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-05-07T14:01:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_write_bps_limit": "0", 2024-05-07T14:01:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_write_iops_burst": "0", 2024-05-07T14:01:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_qos_write_iops_limit": "0", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_quiesce_notification_attempts": "10", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_read_from_replica_policy": "default", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_readahead_max_bytes": "524288", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_readahead_trigger_requests": "10", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_request_timed_out_seconds": "30", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_skip_partial_discard": "true", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_tracing": "false", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_validate_names": "true", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_validate_pool": "true", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "restapi_base_url": "", 2024-05-07T14:01:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: "restapi_log_level": "", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_account_default_quota_max_size": "-1", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_acl_grants_max_num": "100", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_admin_entry": "admin", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_backend_store": "rados", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_barbican_url": "", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_beast_enable_async": "true", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_bucket_counters_cache": "false", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_bucket_index_max_aio": "128", 2024-05-07T14:01:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_bucket_quota_ttl": "600", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_cache_enabled": "true", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_cache_expiry_interval": "900", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_cache_lru_size": "25000", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_config_store": "rados", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_content_length_compat": "false", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_copy_obj_progress": "true", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_cors_rules_max_num": "100", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_cross_domain_policy": "", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_default_encryption_key": "", 2024-05-07T14:01:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_kmip_addr": "", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_kmip_ca_path": "", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_kmip_client_cert": "", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_kmip_client_key": "", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_kmip_password": "", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_kmip_username": "", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_require_ssl": "true", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-05-07T14:01:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-05-07T14:01:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-05-07T14:01:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-05-07T14:01:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-05-07T14:01:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-05-07T14:01:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-05-07T14:01:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-05-07T14:01:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-05-07T14:01:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-05-07T14:01:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_suppress_logs": "true", 2024-05-07T14:01:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_vault_addr": "", 2024-05-07T14:01:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_vault_auth": "token", 2024-05-07T14:01:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_vault_namespace": "", 2024-05-07T14:01:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_vault_prefix": "", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_vault_token_file": "", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_curl_buffersize": "524288", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_curl_low_speed_limit": "1024", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_curl_low_speed_time": "300", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_curl_tcp_keepalive": "0", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-05-07T14:01:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_d3n_l1_fadvise": "4", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_d4n_host": "127.0.0.1", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_d4n_port": "6379", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_data_log_changes_size": "1000", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_data_log_num_shards": "128", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_data_log_window": "30", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_data_notify_interval_msec": "0", 2024-05-07T14:01:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_data_sync_poll_interval": "20", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_data_sync_spawn_window": "20", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_default_data_log_backing": "fifo", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_default_region_info_oid": "default.region", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_defer_to_bucket_acls": "", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-05-07T14:01:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-05-07T14:01:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-05-07T14:01:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-05-07T14:01:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-05-07T14:01:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dmclock_data_res": "500.000000", 2024-05-07T14:01:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-05-07T14:01:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-05-07T14:01:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-05-07T14:01:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-05-07T14:01:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dns_name": "", 2024-05-07T14:01:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dns_s3website_name": "", 2024-05-07T14:01:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_dynamic_resharding": "true", 2024-05-07T14:01:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-05-07T14:01:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_enable_gc_threads": "true", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_enable_lc_threads": "true", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_enable_ops_log": "false", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_enable_quota_threads": "true", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_enable_static_website": "false", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_enable_usage_log": "false", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_enforce_swift_acls": "true", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_exit_timeout_secs": "120", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_expose_bucket": "false", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_extended_http_attrs": "", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_filter": "none", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_frontends": "beast port=7480", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_gc_max_concurrent_io": "10", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_gc_max_deferred": "50", 2024-05-07T14:01:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-05-07T14:01:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_gc_max_objs": "32", 2024-05-07T14:01:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_gc_max_queue_size": "134213632", 2024-05-07T14:01:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_gc_max_trim_chunk": "16", 2024-05-07T14:01:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_gc_obj_min_wait": "7200", 2024-05-07T14:01:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_gc_processor_max_time": "3600", 2024-05-07T14:01:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_gc_processor_period": "3600", 2024-05-07T14:01:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-05-07T14:01:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_get_obj_window_size": "16777216", 2024-05-07T14:01:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_healthcheck_disabling_path": "", 2024-05-07T14:01:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_ignore_get_invalid_range": "false", 2024-05-07T14:01:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_init_timeout": "300", 2024-05-07T14:01:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-05-07T14:01:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_kafka_connection_idle": "300", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_kafka_message_timeout": "5000", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_kafka_sleep_timeout": "10", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_admin_domain": "", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_admin_password": "", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_admin_password_path": "", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_admin_project": "", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_admin_tenant": "", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_admin_token": "", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_admin_token_path": "", 2024-05-07T14:01:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_admin_user": "", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_api_version": "2", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_barbican_domain": "", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_barbican_password": "", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_barbican_project": "", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_barbican_tenant": "", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_barbican_user": "", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_implicit_tenants": "false", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_service_token_enabled": "false", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_token_cache_size": "10000", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_url": "", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_keystone_verify_ssl": "true", 2024-05-07T14:01:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_lc_debug_interval": "-1", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_lc_lock_max_time": "90", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_lc_max_objs": "32", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_lc_max_rules": "1000", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_lc_max_worker": "3", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_lc_max_wp_worker": "3", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_lc_thread_delay": "0", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_ldap_dnattr": "uid", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_ldap_searchfilter": "", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_ldap_uri": "", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-05-07T14:01:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_log_http_headers": "", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_log_nonexistent_bucket": "false", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_log_object_name_utc": "false", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_max_attr_name_len": "0", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_max_attr_size": "0", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_max_attrs_num_in_req": "0", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_max_chunk_size": "4194304", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_max_concurrent_requests": "1024", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_max_dynamic_shards": "1999", 2024-05-07T14:01:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_max_listing_results": "1000", 2024-05-07T14:01:14.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_max_notify_retries": "10", 2024-05-07T14:01:14.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_max_objs_per_shard": "100000", 2024-05-07T14:01:14.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_max_put_param_size": "1048576", 2024-05-07T14:01:14.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_max_put_size": "5368709120", 2024-05-07T14:01:14.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_max_slo_entries": "1000", 2024-05-07T14:01:14.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_md_log_max_shards": "64", 2024-05-07T14:01:14.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_md_notify_interval_msec": "200", 2024-05-07T14:01:14.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_meta_sync_poll_interval": "20", 2024-05-07T14:01:14.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_meta_sync_spawn_window": "20", 2024-05-07T14:01:14.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-05-07T14:01:14.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_mp_lock_max_time": "600", 2024-05-07T14:01:14.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-05-07T14:01:14.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_multipart_min_part_size": "5242880", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_nfs_fhcache_size": "2017", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_nfs_lru_lanes": "5", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_nfs_max_gc": "300", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_nfs_run_gc_threads": "false", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_nfs_run_lc_threads": "false", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_nfs_run_quota_threads": "false", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_nfs_run_sync_thread": "false", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-05-07T14:01:14.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_num_async_rados_threads": "32", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_num_control_oids": "8", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_numa_node": "-1", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_obj_stripe_size": "4194304", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_objexp_chunk_size": "100", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_objexp_gc_interval": "600", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_objexp_hints_num_shards": "127", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_op_thread_timeout": "600", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_op_tracing": "false", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_opa_token": "", 2024-05-07T14:01:14.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_opa_url": "", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_opa_verify_ssl": "true", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_ops_log_rados": "false", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_ops_log_socket_path": "", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_period_push_interval": "2.000000", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_period_push_interval_max": "30.000000", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_period_root_pool": ".rgw.root", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-05-07T14:01:14.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_posix_cache_lanes": "3", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_posix_cache_max_buckets": "100", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_posix_cache_partitions": "3", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_print_continue": "true", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_print_prohibited_content_length": "false", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_rados_tracing": "false", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_realm": "", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_realm_id": "", 2024-05-07T14:01:14.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-05-07T14:01:14.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_region": "", 2024-05-07T14:01:14.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_region_root_pool": ".rgw.root", 2024-05-07T14:01:14.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_relaxed_region_enforcement": "false", 2024-05-07T14:01:14.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-05-07T14:01:14.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-05-07T14:01:14.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_request_uri": "", 2024-05-07T14:01:14.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_reshard_batch_size": "64", 2024-05-07T14:01:14.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-05-07T14:01:14.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_reshard_max_aio": "128", 2024-05-07T14:01:14.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_reshard_num_logs": "16", 2024-05-07T14:01:14.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_reshard_thread_interval": "600", 2024-05-07T14:01:14.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_resolve_cname": "false", 2024-05-07T14:01:14.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_rest_getusage_op_compat": "false", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_run_sync_thread": "true", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_s3_auth_use_keystone": "false", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_s3_auth_use_ldap": "false", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_s3_auth_use_rados": "true", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_s3_auth_use_sts": "false", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_s3_success_create_obj_status": "0", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_scheduler_type": "throttler", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_script_uri": "", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_service_provider_name": "", 2024-05-07T14:01:14.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sts_client_id": "", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sts_client_secret": "", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sts_entry": "sts", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sts_key": "sts", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sts_max_session_duration": "43200", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sts_min_session_duration": "900", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sts_token_introspection_url": "", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_swift_account_in_url": "false", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_swift_auth_entry": "auth", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_swift_auth_url": "", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_swift_custom_header": "", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_swift_enforce_content_length": "false", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_swift_need_stats": "true", 2024-05-07T14:01:14.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_swift_tenant_name": "", 2024-05-07T14:01:14.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_swift_token_expiration": "86400", 2024-05-07T14:01:14.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_swift_url": "", 2024-05-07T14:01:14.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_swift_url_prefix": "swift", 2024-05-07T14:01:14.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_swift_versioning_enabled": "false", 2024-05-07T14:01:14.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-05-07T14:01:14.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-05-07T14:01:14.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sync_lease_period": "120", 2024-05-07T14:01:14.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-05-07T14:01:14.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sync_log_trim_interval": "1200", 2024-05-07T14:01:14.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-05-07T14:01:14.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-05-07T14:01:14.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-05-07T14:01:14.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sync_obj_etag_verify": "false", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sync_trace_history_size": "4096", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_thread_pool_size": "512", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_topic_persistency_max_retries": "0", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_topic_require_publish_policy": "false", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_torrent_comment": "", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_torrent_createby": "", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_torrent_encoding": "", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_torrent_flag": "false", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_torrent_max_size": "5368709120", 2024-05-07T14:01:14.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_torrent_origin": "", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_torrent_sha_unit": "524288", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_torrent_tracker": "", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_trust_forwarded_https": "false", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_usage_log_tick_interval": "30", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_usage_max_shards": "32", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_usage_max_user_shards": "1", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_use_opa_authz": "false", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_user_counters_cache": "false", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_user_counters_cache_size": "10000", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_user_default_quota_max_size": "-1", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_user_max_buckets": "1000", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_user_policies_max_num": "100", 2024-05-07T14:01:14.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_user_quota_sync_interval": "86400", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_user_unique_email": "true", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_verify_ssl": "true", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_website_routing_rules_max_num": "50", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_zone": "", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_zone_id": "", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_zonegroup": "", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_zonegroup_id": "", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgwlc_auto_session_clear": "true", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rgwlc_skip_bucket_step": "false", 2024-05-07T14:01:14.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_block_size": "4096", 2024-05-07T14:01:14.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-05-07T14:01:14.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-05-07T14:01:14.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-05-07T14:01:14.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-05-07T14:01:14.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_cache_shard_bits": "4", 2024-05-07T14:01:14.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_cache_size": "536870912", 2024-05-07T14:01:14.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_cache_type": "binned_lru", 2024-05-07T14:01:14.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-05-07T14:01:14.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-05-07T14:01:14.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-05-07T14:01:14.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_collect_compaction_stats": "false", 2024-05-07T14:01:14.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_collect_extended_stats": "false", 2024-05-07T14:01:14.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_collect_memory_stats": "false", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_index_type": "binary_search", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_log_to_ceph_log": "true", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_metadata_block_size": "4096", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_partition_filters": "false", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_perf": "false", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "rotating_keys_renewal_timeout": "10", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "run_dir": "/var/run/ceph", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_block_create": "true", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_cache_lru_size": "67108864", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_cbjournal_size": "5368709120", 2024-05-07T14:01:14.974 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_data_delta_based_overwrite": "0", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_default_max_object_size": "16777216", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_device_size": "53687091200", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_journal_batch_capacity": "16", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_journal_iodepth_limit": "5", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_main_device_type": "SSD", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_max_concurrent_transactions": "8", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "seastore_segment_size": "67108864", 2024-05-07T14:01:14.975 INFO:teuthology.orchestra.run.smithi106.stdout: "set_keepcaps": "false", 2024-05-07T14:01:14.976 INFO:teuthology.orchestra.run.smithi106.stdout: "setgroup": "", 2024-05-07T14:01:14.976 INFO:teuthology.orchestra.run.smithi106.stdout: "setuser": "", 2024-05-07T14:01:14.976 INFO:teuthology.orchestra.run.smithi106.stdout: "setuser_match_path": "", 2024-05-07T14:01:14.976 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_misplaced_ratio": "0.050000", 2024-05-07T14:01:14.976 INFO:teuthology.orchestra.run.smithi106.stdout: "thp": "false", 2024-05-07T14:01:14.976 INFO:teuthology.orchestra.run.smithi106.stdout: "threadpool_default_timeout": "60", 2024-05-07T14:01:14.976 INFO:teuthology.orchestra.run.smithi106.stdout: "threadpool_empty_queue_max_wait": "2", 2024-05-07T14:01:14.976 INFO:teuthology.orchestra.run.smithi106.stdout: "throttler_perf_counter": "true" 2024-05-07T14:01:14.976 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:14.978 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-05-07T14:01:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:mon.a: {} 2024-05-07T14:01:15.123 INFO:teuthology.orchestra.run.smithi106.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-07T14:01:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:mon.b: {} 2024-05-07T14:01:15.136 INFO:teuthology.orchestra.run.smithi106.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-07T14:01:15.145 INFO:teuthology.orchestra.run.smithi106.stdout:mon.c: {} 2024-05-07T14:01:15.146 INFO:teuthology.orchestra.run.smithi106.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-07T14:01:15.162 DEBUG:teuthology.orchestra.run.smithi106:> type ceph-objectstore-tool 2024-05-07T14:01:15.167 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-05-07T14:01:15.167 DEBUG:teuthology.orchestra.run.smithi107:> type ceph-objectstore-tool 2024-05-07T14:01:15.174 INFO:teuthology.orchestra.run.smithi107.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-05-07T14:01:15.174 INFO:teuthology.run_tasks:Running task workunit... 2024-05-07T14:01:15.191 INFO:tasks.workunit:Pulling workunits from ref 1dfb479e40144c07778a01ea762def8ca56f6eee 2024-05-07T14:01:15.191 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-07T14:01:15.193 DEBUG:teuthology.orchestra.run.smithi106:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-07T14:01:15.194 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-05-07T14:01:15.194 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-07T14:01:15.194 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-07T14:01:15.194 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-05-07T14:01:15.195 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-05-07T14:01:15.195 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:01:15.195 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-05-07T14:01:15.195 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:01:15.196 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-05-07T14:01:15.196 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:01:15.210 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:15.226+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:15.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T14:01:15.214 INFO:teuthology.orchestra.run.smithi106.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-07T14:01:15.215 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-05-07T14:01:15.261 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-05-07T14:01:15.262 DEBUG:teuthology.orchestra.run.smithi106:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-05-07T14:01:15.305 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:15.322+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:15.309 INFO:tasks.workunit:timeout=3h 2024-05-07T14:01:15.309 INFO:tasks.workunit:cleanup=True 2024-05-07T14:01:15.310 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1dfb479e40144c07778a01ea762def8ca56f6eee 2024-05-07T14:01:15.325 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:15.326 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:15.326 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:15.326 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:15.331 INFO:tasks.workunit.client.0.smithi106.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-07T14:01:15.346 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:01:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:15.348 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:15.366 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:15.382 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:15.382 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:15.397 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:15.414+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:15.400 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:15.401 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:15.422 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:15.422 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:15.442 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:15.442 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:15.461 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:15.461 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:15.462 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:15.463 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:15.474 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:01:15.484 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:15.484 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:15.501 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:15.518+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:15.561 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:01:15.561 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.0 to 1 (10000) 2024-05-07T14:01:15.584 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-07T14:01:15.603 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:15.604 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:15.604 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:15.618+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:15.617 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:01:15.709 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:15.726+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:15.773 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:15.773 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:15.786 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:01:15.833 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:15.850+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:15.908 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:15.922+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:15.938 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:15.938 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:15.950 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:01:16.041 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:16.058+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:16.110 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:16.126+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:16.111 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:16.111 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:16.123 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:01:16.214 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:16.226+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:16.281 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:16.281 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:16.294 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:01:16.312 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:16.326+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:16.405 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:16.405 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:16.414 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:16.430+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:16.418 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:01:16.515 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:16.529+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:16.563 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.1 to 1 (10000) 2024-05-07T14:01:16.580 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:16.580 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:16.585 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-07T14:01:16.594 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:01:16.637 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:16.654+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:16.715 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:16.729+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:16.748 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:16.748 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:16.760 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:01:16.816 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:16.830+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:16.866 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:16.866 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:16.880 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:01:16.921 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:16.938+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:17.018 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:17.033+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:17.030 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:17.030 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:17.041 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:01:17.119 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:17.134+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:17.172 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:17.172 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:17.186 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:01:17.220 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:17.234+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:17.310 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:17.310 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:17.321 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:17.337+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:17.323 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:01:17.422 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:17.437+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:17.488 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:17.488 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:17.501 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:01:17.502 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:01:17.545 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:17.561+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:17.577 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.2 to 1 (10000) 2024-05-07T14:01:17.592 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:01:17.604 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-07T14:01:17.623 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:17.637+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:17.673 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:17.673 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:17.674 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:17.675 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:17.687 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:01:17.705 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:17.705 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:17.722 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:17.723 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:17.723 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:17.738+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:17.741 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:17.741 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:17.761 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:17.761 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:17.780 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:17.781 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:17.798 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:17.798 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:17.817 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:17.817 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:17.825 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:17.837+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:17.847 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:17.848 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:17.861 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:01:17.949 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:17.965+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:18.027 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:18.042+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:18.036 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:18.036 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:18.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:18.036 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.022438210000001, 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033108180000000001, 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 48 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:01:18.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:01:18.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026898+0000", 2024-05-07T14:01:18.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2369999999999999e-06 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026908+0000", 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8109999999999997e-06 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026934+0000", 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6746000000000001e-05 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026949+0000", 2024-05-07T14:01:18.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4517e-05 2024-05-07T14:01:18.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027084+0000", 2024-05-07T14:01:18.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013501499999999999 2024-05-07T14:01:18.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027360+0000", 2024-05-07T14:01:18.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027639199999999998 2024-05-07T14:01:18.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:18.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027616+0000", 2024-05-07T14:01:18.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025541799999999999 2024-05-07T14:01:18.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.028902+0000", 2024-05-07T14:01:18.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012859989999999999 2024-05-07T14:01:18.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030044+0000", 2024-05-07T14:01:18.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001142295 2024-05-07T14:01:18.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030136+0000", 2024-05-07T14:01:18.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1794999999999998e-05 2024-05-07T14:01:18.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030206+0000", 2024-05-07T14:01:18.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0593000000000007e-05 2024-05-07T14:01:18.043 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.043 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.043 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.043 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:01:18.043 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:01:18.043 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.036964300999999, 2024-05-07T14:01:18.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058205720000000004, 2024-05-07T14:01:18.043 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.044 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.044 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.044 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.044 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.044 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.044 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 205 2024-05-07T14:01:18.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.044 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:01:18.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:01:18.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012373+0000", 2024-05-07T14:01:18.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.07e-06 2024-05-07T14:01:18.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012397+0000", 2024-05-07T14:01:18.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3697e-05 2024-05-07T14:01:18.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012450+0000", 2024-05-07T14:01:18.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2539e-05 2024-05-07T14:01:18.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012477+0000", 2024-05-07T14:01:18.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7457000000000002e-05 2024-05-07T14:01:18.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012735+0000", 2024-05-07T14:01:18.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025820800000000001 2024-05-07T14:01:18.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013057+0000", 2024-05-07T14:01:18.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000321727 2024-05-07T14:01:18.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:18.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013752+0000", 2024-05-07T14:01:18.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069509499999999996 2024-05-07T14:01:18.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.017093+0000", 2024-05-07T14:01:18.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033404340000000002 2024-05-07T14:01:18.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018024+0000", 2024-05-07T14:01:18.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00093108600000000002 2024-05-07T14:01:18.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018113+0000", 2024-05-07T14:01:18.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9752000000000004e-05 2024-05-07T14:01:18.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018190+0000", 2024-05-07T14:01:18.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6507000000000005e-05 2024-05-07T14:01:18.052 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.052 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.052 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.053 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.053 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:01:18.053 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.966713313, 2024-05-07T14:01:18.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052341489999999996, 2024-05-07T14:01:18.053 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.053 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.053 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.053 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.053 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.053 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.053 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 220 2024-05-07T14:01:18.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.054 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:01:18.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:01:18.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082623+0000", 2024-05-07T14:01:18.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8370000000000001e-06 2024-05-07T14:01:18.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082636+0000", 2024-05-07T14:01:18.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2316e-05 2024-05-07T14:01:18.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082667+0000", 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1139999999999997e-05 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082681+0000", 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4816e-05 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082825+0000", 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014377899999999999 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083051+0000", 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022549500000000001 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083453+0000", 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000401944 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.085929+0000", 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024763369999999999 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087649+0000", 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001719747 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087735+0000", 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6415999999999994e-05 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087855+0000", 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011932199999999999 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.058 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.059 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.059 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:01:18.059 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.954293582, 2024-05-07T14:01:18.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00342407, 2024-05-07T14:01:18.059 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.059 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.059 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.059 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.059 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.059 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.059 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 223 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095042+0000", 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1799999999999999e-06 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095054+0000", 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1817000000000001e-05 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095084+0000", 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0018999999999998e-05 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095099+0000", 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.537e-05 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095209+0000", 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010943299999999999 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095457+0000", 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247941 2024-05-07T14:01:18.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095879+0000", 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042171299999999999 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.097290+0000", 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014118519999999999 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098196+0000", 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00090603700000000005 2024-05-07T14:01:18.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098348+0000", 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151879 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098464+0000", 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011582900000000001 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.064 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.946753381000001, 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031839889999999999, 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 225 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:01:18.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:01:18.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102582+0000", 2024-05-07T14:01:18.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:01:18.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102594+0000", 2024-05-07T14:01:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1382999999999999e-05 2024-05-07T14:01:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102625+0000", 2024-05-07T14:01:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0880000000000002e-05 2024-05-07T14:01:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102640+0000", 2024-05-07T14:01:18.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4949999999999999e-05 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102756+0000", 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116072 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102998+0000", 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024203199999999999 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:18.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.103438+0000", 2024-05-07T14:01:18.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044011700000000001 2024-05-07T14:01:18.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105252+0000", 2024-05-07T14:01:18.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018136490000000001 2024-05-07T14:01:18.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105608+0000", 2024-05-07T14:01:18.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035604000000000001 2024-05-07T14:01:18.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105699+0000", 2024-05-07T14:01:18.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1316999999999993e-05 2024-05-07T14:01:18.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105764+0000", 2024-05-07T14:01:18.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5371999999999997e-05 2024-05-07T14:01:18.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.070 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.943277033999999, 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003090256, 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 226 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106059+0000", 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3e-06 2024-05-07T14:01:18.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106070+0000", 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1257000000000001e-05 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106101+0000", 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0783e-05 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106116+0000", 2024-05-07T14:01:18.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5136e-05 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106217+0000", 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101183 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106433+0000", 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021523199999999999 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:18.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106826+0000", 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039372000000000002 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.108406+0000", 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001579815 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.108987+0000", 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058058100000000004 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.109073+0000", 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6650000000000006e-05 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.109147+0000", 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3598999999999998e-05 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:01:18.076 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.913824631000001, 2024-05-07T14:01:18.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030980790000000001, 2024-05-07T14:01:18.077 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.077 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.077 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.077 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.077 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.077 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.077 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 234 2024-05-07T14:01:18.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.077 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:01:18.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:01:18.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135511+0000", 2024-05-07T14:01:18.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4030000000000001e-06 2024-05-07T14:01:18.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135523+0000", 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1559999999999999e-05 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135557+0000", 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4372999999999998e-05 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135572+0000", 2024-05-07T14:01:18.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4647000000000001e-05 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135674+0000", 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101932 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135888+0000", 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000213995 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.136311+0000", 2024-05-07T14:01:18.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042278999999999998 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.137726+0000", 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001415319 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138450+0000", 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00072404800000000003 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138543+0000", 2024-05-07T14:01:18.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2559000000000006e-05 2024-05-07T14:01:18.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138607+0000", 2024-05-07T14:01:18.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4453000000000001e-05 2024-05-07T14:01:18.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.082 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.082 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.082 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:01:18.082 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.894774609000001, 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035934819999999998, 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 271 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154562+0000", 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154578+0000", 2024-05-07T14:01:18.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6667000000000002e-05 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154612+0000", 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3120000000000001e-05 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154632+0000", 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0769999999999999e-05 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154774+0000", 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141805 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155004+0000", 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022938200000000001 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155372+0000", 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036889300000000002 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156948+0000", 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015755750000000001 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.157903+0000", 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095453499999999995 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158050+0000", 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147279 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158153+0000", 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102729 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:402 6.4 e33/27 6:24c8e1ae:gc::gc.19:head v 33'8, mlcod=33'6)", 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.856702475000001, 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032167609999999998, 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.088 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:01:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:01:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192633+0000", 2024-05-07T14:01:18.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6759999999999999e-06 2024-05-07T14:01:18.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192645+0000", 2024-05-07T14:01:18.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2037e-05 2024-05-07T14:01:18.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192669+0000", 2024-05-07T14:01:18.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3723e-05 2024-05-07T14:01:18.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192683+0000", 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4416000000000001e-05 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192792+0000", 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109029 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192848+0000", 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5674000000000003e-05 2024-05-07T14:01:18.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.195758+0000", 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029099199999999999 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.195848+0000", 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0285999999999996e-05 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.092 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:415 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.848996248000001, 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065364059999999998, 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 415 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200339+0000", 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.826e-06 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200348+0000", 2024-05-07T14:01:18.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0669999999999998e-06 2024-05-07T14:01:18.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200378+0000", 2024-05-07T14:01:18.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.968e-05 2024-05-07T14:01:18.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200393+0000", 2024-05-07T14:01:18.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5109999999999999e-05 2024-05-07T14:01:18.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200515+0000", 2024-05-07T14:01:18.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121449 2024-05-07T14:01:18.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200658+0000", 2024-05-07T14:01:18.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014362199999999999 2024-05-07T14:01:18.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200958+0000", 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030029699999999999 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202106+0000", 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011475050000000001 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206707+0000", 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046009980000000002 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206791+0000", 2024-05-07T14:01:18.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4118999999999999e-05 2024-05-07T14:01:18.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206874+0000", 2024-05-07T14:01:18.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2732999999999995e-05 2024-05-07T14:01:18.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.098 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:417 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.846498156999999, 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034776160000000002, 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 417 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:01:18.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:01:18.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202838+0000", 2024-05-07T14:01:18.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3760000000000002e-06 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202872+0000", 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4379999999999999e-05 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202900+0000", 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8180000000000001e-05 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202915+0000", 2024-05-07T14:01:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.486e-05 2024-05-07T14:01:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203063+0000", 2024-05-07T14:01:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014788799999999999 2024-05-07T14:01:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203423+0000", 2024-05-07T14:01:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035942400000000001 2024-05-07T14:01:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.204005+0000", 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058227599999999995 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205280+0000", 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012753 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206135+0000", 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00085444999999999998 2024-05-07T14:01:18.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206234+0000", 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9088999999999999e-05 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206313+0000", 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9393000000000004e-05 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.104 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:420 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.844161739, 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042372210000000002, 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 420 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:01:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:01:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205174+0000", 2024-05-07T14:01:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1100000000000001e-06 2024-05-07T14:01:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205186+0000", 2024-05-07T14:01:18.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.169e-05 2024-05-07T14:01:18.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205218+0000", 2024-05-07T14:01:18.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2617000000000003e-05 2024-05-07T14:01:18.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205240+0000", 2024-05-07T14:01:18.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1331999999999998e-05 2024-05-07T14:01:18.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205356+0000", 2024-05-07T14:01:18.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011655 2024-05-07T14:01:18.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205623+0000", 2024-05-07T14:01:18.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026669399999999999 2024-05-07T14:01:18.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:18.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206029+0000", 2024-05-07T14:01:18.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040652 2024-05-07T14:01:18.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.208187+0000", 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021578439999999999 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209226+0000", 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001039058 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209305+0000", 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8650000000000001e-05 2024-05-07T14:01:18.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209409+0000", 2024-05-07T14:01:18.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104156 2024-05-07T14:01:18.113 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.113 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.113 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.113 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:429 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.113 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:01:18.114 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.839130698, 2024-05-07T14:01:18.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040139620000000003, 2024-05-07T14:01:18.114 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.114 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.114 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.114 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.114 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.115 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.115 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 429 2024-05-07T14:01:18.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.115 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:01:18.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:01:18.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210205+0000", 2024-05-07T14:01:18.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.66e-06 2024-05-07T14:01:18.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210228+0000", 2024-05-07T14:01:18.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-05-07T14:01:18.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210244+0000", 2024-05-07T14:01:18.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6339999999999999e-05 2024-05-07T14:01:18.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210256+0000", 2024-05-07T14:01:18.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1949e-05 2024-05-07T14:01:18.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210472+0000", 2024-05-07T14:01:18.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215529 2024-05-07T14:01:18.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210681+0000", 2024-05-07T14:01:18.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000208982 2024-05-07T14:01:18.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:18.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211154+0000", 2024-05-07T14:01:18.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047321599999999999 2024-05-07T14:01:18.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212660+0000", 2024-05-07T14:01:18.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001506098 2024-05-07T14:01:18.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214071+0000", 2024-05-07T14:01:18.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014107429999999999 2024-05-07T14:01:18.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214153+0000", 2024-05-07T14:01:18.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1889000000000002e-05 2024-05-07T14:01:18.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214217+0000", 2024-05-07T14:01:18.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4336000000000002e-05 2024-05-07T14:01:18.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.122 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.123 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:430 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.123 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:01:18.123 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.838784934, 2024-05-07T14:01:18.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066752119999999998, 2024-05-07T14:01:18.123 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.123 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.123 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 430 2024-05-07T14:01:18.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.124 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:01:18.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:01:18.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210551+0000", 2024-05-07T14:01:18.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:01:18.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210562+0000", 2024-05-07T14:01:18.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0237e-05 2024-05-07T14:01:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210586+0000", 2024-05-07T14:01:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4066e-05 2024-05-07T14:01:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210603+0000", 2024-05-07T14:01:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.713e-05 2024-05-07T14:01:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211799+0000", 2024-05-07T14:01:18.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001196127 2024-05-07T14:01:18.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211931+0000", 2024-05-07T14:01:18.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131629 2024-05-07T14:01:18.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212211+0000", 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028005100000000002 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.213288+0000", 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010772760000000001 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217047+0000", 2024-05-07T14:01:18.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037586569999999999 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217127+0000", 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0270000000000002e-05 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217224+0000", 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7139000000000006e-05 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.832007659, 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003780107, 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 436 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:01:18.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:01:18.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217328+0000", 2024-05-07T14:01:18.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:01:18.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217356+0000", 2024-05-07T14:01:18.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8158999999999999e-05 2024-05-07T14:01:18.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217377+0000", 2024-05-07T14:01:18.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1356999999999999e-05 2024-05-07T14:01:18.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217393+0000", 2024-05-07T14:01:18.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5569e-05 2024-05-07T14:01:18.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217882+0000", 2024-05-07T14:01:18.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00048937000000000004 2024-05-07T14:01:18.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218099+0000", 2024-05-07T14:01:18.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021691899999999999 2024-05-07T14:01:18.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:18.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218390+0000", 2024-05-07T14:01:18.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029041800000000002 2024-05-07T14:01:18.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220013+0000", 2024-05-07T14:01:18.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016236169999999999 2024-05-07T14:01:18.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220889+0000", 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087619599999999998 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221005+0000", 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011569 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221106+0000", 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101122 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.138 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:442 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.138 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:01:18.138 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.828385794000001, 2024-05-07T14:01:18.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003357184, 2024-05-07T14:01:18.138 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.138 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.138 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.138 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.138 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.138 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.138 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 442 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220950+0000", 2024-05-07T14:01:18.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:01:18.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220958+0000", 2024-05-07T14:01:18.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8429999999999999e-06 2024-05-07T14:01:18.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220979+0000", 2024-05-07T14:01:18.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0387e-05 2024-05-07T14:01:18.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220991+0000", 2024-05-07T14:01:18.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.181e-05 2024-05-07T14:01:18.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221218+0000", 2024-05-07T14:01:18.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022694100000000001 2024-05-07T14:01:18.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221362+0000", 2024-05-07T14:01:18.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014482899999999999 2024-05-07T14:01:18.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:18.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221628+0000", 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026559799999999997 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.223915+0000", 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022864819999999998 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224031+0000", 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116759 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224173+0000", 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014127599999999999 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224305+0000", 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000132519 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:482 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.144 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:01:18.145 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.806155346000001, 2024-05-07T14:01:18.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035275459999999999, 2024-05-07T14:01:18.145 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.145 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.145 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.145 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.145 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.145 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.145 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 482 2024-05-07T14:01:18.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.145 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:01:18.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:01:18.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243181+0000", 2024-05-07T14:01:18.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:01:18.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243194+0000", 2024-05-07T14:01:18.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3087e-05 2024-05-07T14:01:18.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243224+0000", 2024-05-07T14:01:18.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0546000000000002e-05 2024-05-07T14:01:18.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243240+0000", 2024-05-07T14:01:18.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5339999999999999e-05 2024-05-07T14:01:18.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243379+0000", 2024-05-07T14:01:18.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139646 2024-05-07T14:01:18.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243576+0000", 2024-05-07T14:01:18.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019638300000000001 2024-05-07T14:01:18.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:18.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243838+0000", 2024-05-07T14:01:18.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026234300000000001 2024-05-07T14:01:18.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.244908+0000", 2024-05-07T14:01:18.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010696289999999999 2024-05-07T14:01:18.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246477+0000", 2024-05-07T14:01:18.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001569471 2024-05-07T14:01:18.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246596+0000", 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118892 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246706+0000", 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109899 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:563 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.151 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:01:18.152 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.747164915000001, 2024-05-07T14:01:18.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00310239, 2024-05-07T14:01:18.152 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.152 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.152 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.152 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.152 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.152 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.152 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 563 2024-05-07T14:01:18.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.153 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:01:18.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:01:18.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302171+0000", 2024-05-07T14:01:18.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1169999999999998e-06 2024-05-07T14:01:18.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302182+0000", 2024-05-07T14:01:18.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0679999999999999e-05 2024-05-07T14:01:18.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302202+0000", 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0505000000000001e-05 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302218+0000", 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5990000000000001e-05 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302337+0000", 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119071 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302481+0000", 2024-05-07T14:01:18.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014358200000000001 2024-05-07T14:01:18.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:18.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302775+0000", 2024-05-07T14:01:18.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029423399999999999 2024-05-07T14:01:18.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.303826+0000", 2024-05-07T14:01:18.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001051485 2024-05-07T14:01:18.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305118+0000", 2024-05-07T14:01:18.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001291234 2024-05-07T14:01:18.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305205+0000", 2024-05-07T14:01:18.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7672999999999999e-05 2024-05-07T14:01:18.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305271+0000", 2024-05-07T14:01:18.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5819000000000001e-05 2024-05-07T14:01:18.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.158 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.308406983999999, 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031794449999999999, 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 856 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.159 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740929+0000", 2024-05-07T14:01:18.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3e-06 2024-05-07T14:01:18.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740942+0000", 2024-05-07T14:01:18.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3183000000000001e-05 2024-05-07T14:01:18.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740968+0000", 2024-05-07T14:01:18.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5477e-05 2024-05-07T14:01:18.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740982+0000", 2024-05-07T14:01:18.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4273e-05 2024-05-07T14:01:18.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741169+0000", 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018701500000000001 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741382+0000", 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021331200000000001 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741696+0000", 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031337800000000001 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.742864+0000", 2024-05-07T14:01:18.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011688410000000001 2024-05-07T14:01:18.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.743952+0000", 2024-05-07T14:01:18.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001087221 2024-05-07T14:01:18.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.744037+0000", 2024-05-07T14:01:18.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5242999999999997e-05 2024-05-07T14:01:18.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.744106+0000", 2024-05-07T14:01:18.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9202000000000006e-05 2024-05-07T14:01:18.165 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.165 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.165 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.165 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:877 6.19 6:98c4c580:::obj_delete_at_hint.0000000100:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:18.166 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:01:18.166 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.257460341, 2024-05-07T14:01:18.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033601709999999999, 2024-05-07T14:01:18.166 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.166 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.166 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.166 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.166 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.166 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.166 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 877 2024-05-07T14:01:18.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.166 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:01:18.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:01:18.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791875+0000", 2024-05-07T14:01:18.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9e-06 2024-05-07T14:01:18.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791884+0000", 2024-05-07T14:01:18.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7069999999999998e-06 2024-05-07T14:01:18.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791907+0000", 2024-05-07T14:01:18.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2682999999999999e-05 2024-05-07T14:01:18.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791919+0000", 2024-05-07T14:01:18.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2763e-05 2024-05-07T14:01:18.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792073+0000", 2024-05-07T14:01:18.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153509 2024-05-07T14:01:18.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792439+0000", 2024-05-07T14:01:18.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000366141 2024-05-07T14:01:18.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:18.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792989+0000", 2024-05-07T14:01:18.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055016899999999998 2024-05-07T14:01:18.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.794288+0000", 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00129885 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795070+0000", 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000781557 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795155+0000", 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5723000000000006e-05 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795234+0000", 2024-05-07T14:01:18.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8169000000000003e-05 2024-05-07T14:01:18.172 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.172 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.172 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.172 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.172 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.172 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:18.174 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:01:18.174 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:18.189+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:18.274 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:18.289+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:18.347 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:18.348 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:18.348 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:18.348 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:18.361 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:01:18.405 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:18.421+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:18.476 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:18.490+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:18.530 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:18.530 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:18.530 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:18.530 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:18.530 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:18.544 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:01:18.577 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:18.590+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:18.598 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.3 to 1 (10000) 2024-05-07T14:01:18.607 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:01:18.627 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-07T14:01:18.672 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:01:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.668331602, 2024-05-07T14:01:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089647730000000005, 2024-05-07T14:01:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.673 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 46 2024-05-07T14:01:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:01:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017451+0000", 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9349999999999999e-06 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017460+0000", 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017481+0000", 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0984000000000001e-05 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017499+0000", 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018689+0000", 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001190303 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018945+0000", 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025626799999999998 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022176+0000", 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032308720000000001 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026078+0000", 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039018289999999999 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026189+0000", 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110775 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026310+0000", 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121023 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026413+0000", 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103346 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.678 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94397682172928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.658908946, 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032214489999999999, 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 47 2024-05-07T14:01:18.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:01:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:01:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026873+0000", 2024-05-07T14:01:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4200000000000001e-06 2024-05-07T14:01:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026883+0000", 2024-05-07T14:01:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0017000000000001e-05 2024-05-07T14:01:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026904+0000", 2024-05-07T14:01:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0228999999999999e-05 2024-05-07T14:01:18.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026917+0000", 2024-05-07T14:01:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3594000000000001e-05 2024-05-07T14:01:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027029+0000", 2024-05-07T14:01:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011171900000000001 2024-05-07T14:01:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027247+0000", 2024-05-07T14:01:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021786099999999999 2024-05-07T14:01:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027599+0000", 2024-05-07T14:01:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035225700000000003 2024-05-07T14:01:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029240+0000", 2024-05-07T14:01:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016408620000000001 2024-05-07T14:01:18.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029864+0000", 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00062414399999999998 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029939+0000", 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4931999999999993e-05 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030092+0000", 2024-05-07T14:01:18.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015341399999999999 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.646865400999999, 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021710919999999999, 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 54 2024-05-07T14:01:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:01:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038917+0000", 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8720000000000002e-06 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038929+0000", 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1294999999999999e-05 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038964+0000", 2024-05-07T14:01:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5516999999999999e-05 2024-05-07T14:01:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038983+0000", 2024-05-07T14:01:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:01:18.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039074+0000", 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1106999999999994e-05 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039201+0000", 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012714700000000001 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039320+0000", 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011861100000000001 2024-05-07T14:01:18.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040439+0000", 2024-05-07T14:01:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011193450000000001 2024-05-07T14:01:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040971+0000", 2024-05-07T14:01:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053181599999999995 2024-05-07T14:01:18.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041040+0000", 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8706000000000003e-05 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041086+0000", 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5883000000000001e-05 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94397682168320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.64449299, 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001933333, 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 55 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041288+0000", 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5200000000000001e-06 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041295+0000", 2024-05-07T14:01:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3679999999999998e-06 2024-05-07T14:01:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041315+0000", 2024-05-07T14:01:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9826999999999998e-05 2024-05-07T14:01:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041325+0000", 2024-05-07T14:01:18.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0402e-05 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041403+0000", 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8404000000000004e-05 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041479+0000", 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5846999999999994e-05 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:18.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041637+0000", 2024-05-07T14:01:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157699 2024-05-07T14:01:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.042503+0000", 2024-05-07T14:01:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086578899999999995 2024-05-07T14:01:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043108+0000", 2024-05-07T14:01:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060548999999999998 2024-05-07T14:01:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043158+0000", 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9359e-05 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043220+0000", 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2627999999999997e-05 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.697 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:191 6.5 e30/27 6:a2ace8b3:::data_log.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:01:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.558069044, 2024-05-07T14:01:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00168714, 2024-05-07T14:01:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:01:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:01:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127713+0000", 2024-05-07T14:01:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2290000000000002e-06 2024-05-07T14:01:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127727+0000", 2024-05-07T14:01:18.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4236999999999999e-05 2024-05-07T14:01:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127759+0000", 2024-05-07T14:01:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1402999999999997e-05 2024-05-07T14:01:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127772+0000", 2024-05-07T14:01:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3227000000000001e-05 2024-05-07T14:01:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127895+0000", 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012357500000000001 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127929+0000", 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3599999999999997e-05 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129322+0000", 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001392936 2024-05-07T14:01:18.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129398+0000", 2024-05-07T14:01:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5933000000000006e-05 2024-05-07T14:01:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-07T14:01:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:01:18.702 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.645886673, 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386840000000002, 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:01:18.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039894+0000", 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9999999999999996e-07 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039906+0000", 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-05 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039948+0000", 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1983000000000001e-05 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039975+0000", 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7120000000000001e-05 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040144+0000", 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016912200000000001 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040195+0000", 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1023000000000003e-05 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043654+0000", 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034590089999999999 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043732+0000", 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7557000000000003e-05 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.706 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:215 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:01:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.620349507, 2024-05-07T14:01:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017783440000000001, 2024-05-07T14:01:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065432+0000", 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8300000000000001e-06 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065444+0000", 2024-05-07T14:01:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2227e-05 2024-05-07T14:01:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065472+0000", 2024-05-07T14:01:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7983e-05 2024-05-07T14:01:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065487+0000", 2024-05-07T14:01:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.45e-05 2024-05-07T14:01:18.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065628+0000", 2024-05-07T14:01:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014118900000000001 2024-05-07T14:01:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065700+0000", 2024-05-07T14:01:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1521999999999997e-05 2024-05-07T14:01:18.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067097+0000", 2024-05-07T14:01:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00139784 2024-05-07T14:01:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067209+0000", 2024-05-07T14:01:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111253 2024-05-07T14:01:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.711 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:221 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'3, mlcod=33'1)", 2024-05-07T14:01:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:01:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.596549208000001, 2024-05-07T14:01:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016799510000000001, 2024-05-07T14:01:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:01:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:01:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089233+0000", 2024-05-07T14:01:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.877e-06 2024-05-07T14:01:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089244+0000", 2024-05-07T14:01:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1323e-05 2024-05-07T14:01:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089272+0000", 2024-05-07T14:01:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8204e-05 2024-05-07T14:01:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089285+0000", 2024-05-07T14:01:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3223e-05 2024-05-07T14:01:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089425+0000", 2024-05-07T14:01:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013934900000000001 2024-05-07T14:01:18.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089487+0000", 2024-05-07T14:01:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2459000000000006e-05 2024-05-07T14:01:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090785+0000", 2024-05-07T14:01:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012974900000000001 2024-05-07T14:01:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090911+0000", 2024-05-07T14:01:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126026 2024-05-07T14:01:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-07T14:01:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.560272264, 2024-05-07T14:01:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020505779999999999, 2024-05-07T14:01:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:01:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125517+0000", 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.833e-06 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125569+0000", 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1619999999999997e-05 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125589+0000", 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0803000000000001e-05 2024-05-07T14:01:18.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125733+0000", 2024-05-07T14:01:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014308600000000001 2024-05-07T14:01:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125786+0000", 2024-05-07T14:01:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3158999999999997e-05 2024-05-07T14:01:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127460+0000", 2024-05-07T14:01:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001674493 2024-05-07T14:01:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127558+0000", 2024-05-07T14:01:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7967000000000006e-05 2024-05-07T14:01:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:337 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'5, mlcod=33'3)", 2024-05-07T14:01:18.723 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.518874553, 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004459658, 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:01:18.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166908+0000", 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2259999999999999e-06 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166922+0000", 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4780000000000001e-05 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166960+0000", 2024-05-07T14:01:18.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8173000000000002e-05 2024-05-07T14:01:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166981+0000", 2024-05-07T14:01:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0440000000000001e-05 2024-05-07T14:01:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167154+0000", 2024-05-07T14:01:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017287199999999999 2024-05-07T14:01:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167207+0000", 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000001e-05 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171283+0000", 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004076278 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171365+0000", 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1588999999999994e-05 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.727 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:349 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:01:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.517999757, 2024-05-07T14:01:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042886440000000003, 2024-05-07T14:01:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167782+0000", 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:01:18.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167797+0000", 2024-05-07T14:01:18.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4533e-05 2024-05-07T14:01:18.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167828+0000", 2024-05-07T14:01:18.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1239999999999999e-05 2024-05-07T14:01:18.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167859+0000", 2024-05-07T14:01:18.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1007000000000003e-05 2024-05-07T14:01:18.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168041+0000", 2024-05-07T14:01:18.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181788 2024-05-07T14:01:18.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168095+0000", 2024-05-07T14:01:18.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3857000000000003e-05 2024-05-07T14:01:18.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171961+0000", 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038664160000000001 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172069+0000", 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107793 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.732 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:357 6.5 e33/27 6:a60f9269:lc::lua_package_allowlist:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.515831027000001, 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002145817, 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:01:18.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169950+0000", 2024-05-07T14:01:18.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.626e-06 2024-05-07T14:01:18.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169963+0000", 2024-05-07T14:01:18.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2619999999999999e-05 2024-05-07T14:01:18.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169990+0000", 2024-05-07T14:01:18.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7084e-05 2024-05-07T14:01:18.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170003+0000", 2024-05-07T14:01:18.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3312999999999999e-05 2024-05-07T14:01:18.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170144+0000", 2024-05-07T14:01:18.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140376 2024-05-07T14:01:18.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170203+0000", 2024-05-07T14:01:18.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9586000000000002e-05 2024-05-07T14:01:18.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172022+0000", 2024-05-07T14:01:18.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018187419999999999 2024-05-07T14:01:18.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172095+0000", 2024-05-07T14:01:18.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2470000000000002e-05 2024-05-07T14:01:18.737 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.737 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.737 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.737 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:386 6.c e33/27 6:3677c228:::obj_delete_at_hint.0000000006:head v 33'1, mlcod=0'0)", 2024-05-07T14:01:18.737 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.502300691, 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016811230000000001, 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183481+0000", 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.756e-06 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183493+0000", 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.254e-05 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183520+0000", 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6809999999999999e-05 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183539+0000", 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8233e-05 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183686+0000", 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147045 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183741+0000", 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5380000000000002e-05 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185039+0000", 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012981500000000001 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185160+0000", 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121209 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:604 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'10, mlcod=33'8)", 2024-05-07T14:01:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:01:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.356439843, 2024-05-07T14:01:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003281431, 2024-05-07T14:01:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:01:18.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:01:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329341+0000", 2024-05-07T14:01:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.42e-06 2024-05-07T14:01:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329351+0000", 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0002e-05 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329373+0000", 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1209e-05 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329384+0000", 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1161999999999999e-05 2024-05-07T14:01:18.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329495+0000", 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111302 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329522+0000", 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7291999999999999e-05 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332531+0000", 2024-05-07T14:01:18.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003008405 2024-05-07T14:01:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332621+0000", 2024-05-07T14:01:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0638999999999997e-05 2024-05-07T14:01:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:656 6.1 e33/27 6:84d19476:::obj_delete_at_hint.0000000038:head v 33'5, mlcod=33'3)", 2024-05-07T14:01:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:01:18.746 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.310035725000001, 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020273800000000001, 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:01:18.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375746+0000", 2024-05-07T14:01:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0499999999999999e-06 2024-05-07T14:01:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375759+0000", 2024-05-07T14:01:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2952999999999999e-05 2024-05-07T14:01:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375789+0000", 2024-05-07T14:01:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9612999999999999e-05 2024-05-07T14:01:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375804+0000", 2024-05-07T14:01:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5449999999999999e-05 2024-05-07T14:01:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375931+0000", 2024-05-07T14:01:18.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126883 2024-05-07T14:01:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375972+0000", 2024-05-07T14:01:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0581999999999999e-05 2024-05-07T14:01:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377685+0000", 2024-05-07T14:01:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017136740000000001 2024-05-07T14:01:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377772+0000", 2024-05-07T14:01:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6174999999999994e-05 2024-05-07T14:01:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:665 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-07T14:01:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:01:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.301531467, 2024-05-07T14:01:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001677357, 2024-05-07T14:01:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.751 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:01:18.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:01:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384250+0000", 2024-05-07T14:01:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7099999999999999e-06 2024-05-07T14:01:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384261+0000", 2024-05-07T14:01:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.113e-05 2024-05-07T14:01:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384287+0000", 2024-05-07T14:01:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6256000000000001e-05 2024-05-07T14:01:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384301+0000", 2024-05-07T14:01:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3443e-05 2024-05-07T14:01:18.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384443+0000", 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142192 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384509+0000", 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6124000000000006e-05 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385819+0000", 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013092889999999999 2024-05-07T14:01:18.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385926+0000", 2024-05-07T14:01:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010721300000000001 2024-05-07T14:01:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:685 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.284839272999999, 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025309769999999998, 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:01:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400943+0000", 2024-05-07T14:01:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0899999999999999e-06 2024-05-07T14:01:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400960+0000", 2024-05-07T14:01:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6917000000000001e-05 2024-05-07T14:01:18.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400995+0000", 2024-05-07T14:01:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5626000000000001e-05 2024-05-07T14:01:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401014+0000", 2024-05-07T14:01:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9126e-05 2024-05-07T14:01:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401164+0000", 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149989 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401218+0000", 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3550000000000001e-05 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403375+0000", 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00215737 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403472+0000", 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6309000000000002e-05 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:686 6.1f e33/27 6:f93251ce:::obj_delete_at_hint.0000000042:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.283389418000001, 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037357750000000002, 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:01:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:01:18.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402392+0000", 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9870000000000002e-06 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402405+0000", 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.222e-05 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402429+0000", 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4729999999999999e-05 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402448+0000", 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8493000000000001e-05 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402604+0000", 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155876 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402647+0000", 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2793000000000002e-05 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406039+0000", 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033922760000000001 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406126+0000", 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7399999999999997e-05 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.765 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:693 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'5, mlcod=33'3)", 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.277662989, 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037287790000000002, 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408119+0000", 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0040000000000002e-06 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408135+0000", 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6155999999999999e-05 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408193+0000", 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8023999999999999e-05 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408248+0000", 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4664999999999999e-05 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408410+0000", 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016263599999999999 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408462+0000", 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1913000000000003e-05 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411739+0000", 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032768350000000001 2024-05-07T14:01:18.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411846+0000", 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010654600000000001 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:694 6.5 e33/27 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 33'8, mlcod=33'6)", 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.275046655000001, 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038331400000000001, 2024-05-07T14:01:18.770 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410735+0000", 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.793e-06 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410746+0000", 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1377e-05 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410775+0000", 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8336000000000001e-05 2024-05-07T14:01:18.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410788+0000", 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3074000000000001e-05 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410945+0000", 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015738199999999999 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411009+0000", 2024-05-07T14:01:18.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4276000000000006e-05 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414499+0000", 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034896060000000001 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414566+0000", 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7296000000000001e-05 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.774 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:18.775 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:18.775 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:18.777 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:01:18.777 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:18.790+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:18.877 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:18.890+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:18.901 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:18.901 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:18.901 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:18.902 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:18.915 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:01:18.978 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:18.993+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:19.032 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:19.032 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:19.033 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:19.033 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:19.033 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:19.046 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:01:19.093 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:19.109+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:19.180 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:19.193+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:19.224 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:19.224 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:19.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:19.224 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:19.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.224 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:19.224 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:01:19.224 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.409179807000001, 2024-05-07T14:01:19.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63420480000000001, 2024-05-07T14:01:19.224 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.224 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.224 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827477+0000", 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827491+0000", 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3923999999999999e-05 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827514+0000", 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2796e-05 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827531+0000", 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7520000000000002e-05 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827677+0000", 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145408 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827703+0000", 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6704e-05 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.458662+0000", 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63095893199999997 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459006+0000", 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034329 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459320+0000", 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031472100000000001 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.460665+0000", 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001344633 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461508+0000", 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084310400000000001 2024-05-07T14:01:19.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461608+0000", 2024-05-07T14:01:19.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9481999999999994e-05 2024-05-07T14:01:19.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461680+0000", 2024-05-07T14:01:19.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1976000000000003e-05 2024-05-07T14:01:19.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.230 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.712119475000002, 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015167432999999999, 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.231 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 37 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524536+0000", 2024-05-07T14:01:19.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:01:19.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524542+0000", 2024-05-07T14:01:19.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7699999999999998e-06 2024-05-07T14:01:19.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524551+0000", 2024-05-07T14:01:19.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4199999999999996e-06 2024-05-07T14:01:19.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524558+0000", 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.379e-06 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534146+0000", 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095872700000000002 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534387+0000", 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024181499999999999 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534752+0000", 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036441400000000002 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.536608+0000", 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001856239 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539547+0000", 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00293859 2024-05-07T14:01:19.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539639+0000", 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2548999999999998e-05 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539703+0000", 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3330000000000005e-05 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.592591171000002, 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013763364, 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 88 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:01:19.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:01:19.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644064+0000", 2024-05-07T14:01:19.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644070+0000", 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5500000000000002e-06 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644079+0000", 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.55e-06 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644086+0000", 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.934e-06 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655168+0000", 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011081967 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655307+0000", 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013893600000000001 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655515+0000", 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020742499999999999 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657174+0000", 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016592340000000001 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657576+0000", 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040245400000000001 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657723+0000", 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014719200000000001 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657827+0000", 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103319 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:19.242 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.426055986000001, 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014874368000000001, 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 108 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0699999999999996e-07 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810608+0000", 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6330000000000002e-06 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810618+0000", 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0366999999999999e-05 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810626+0000", 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7430000000000002e-06 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818597+0000", 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079710549999999995 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818873+0000", 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027635099999999998 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.819288+0000", 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041430599999999997 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822081+0000", 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002793032 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825193+0000", 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003112606 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825361+0000", 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167703 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825473+0000", 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111865 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.425906664000003, 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015242152, 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.248 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 109 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:01:19.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810749+0000", 2024-05-07T14:01:19.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-06 2024-05-07T14:01:19.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810943+0000", 2024-05-07T14:01:19.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019437499999999999 2024-05-07T14:01:19.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810959+0000", 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5440000000000001e-05 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810971+0000", 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2023e-05 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820386+0000", 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094148570000000004 2024-05-07T14:01:19.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820569+0000", 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018298199999999999 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820827+0000", 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025869400000000001 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825585+0000", 2024-05-07T14:01:19.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004757051 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825752+0000", 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167479 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825881+0000", 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128629 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825990+0000", 2024-05-07T14:01:19.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109415 2024-05-07T14:01:19.254 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.254 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.254 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.254 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:19.254 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:01:19.254 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.425664312000002, 2024-05-07T14:01:19.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015251472, 2024-05-07T14:01:19.254 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.254 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.254 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.255 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.255 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.255 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.255 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 110 2024-05-07T14:01:19.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.255 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:01:19.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810991+0000", 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7600000000000006e-07 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810998+0000", 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3899999999999998e-06 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811007+0000", 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5869999999999999e-06 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811014+0000", 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822508+0000", 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01149416 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822698+0000", 2024-05-07T14:01:19.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018972600000000001 2024-05-07T14:01:19.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823009+0000", 2024-05-07T14:01:19.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031125100000000002 2024-05-07T14:01:19.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825710+0000", 2024-05-07T14:01:19.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002700619 2024-05-07T14:01:19.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826014+0000", 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030398799999999999 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826137+0000", 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123416 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826242+0000", 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104279 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.259 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.425629411999999, 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017650448999999999, 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.260 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 111 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811026+0000", 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5300000000000004e-07 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811031+0000", 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0329999999999999e-06 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811043+0000", 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2543e-05 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811050+0000", 2024-05-07T14:01:19.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8000000000000001e-06 2024-05-07T14:01:19.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823676+0000", 2024-05-07T14:01:19.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012626052 2024-05-07T14:01:19.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823904+0000", 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227562 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.824349+0000", 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044484 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826371+0000", 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020221380000000001 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828408+0000", 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020372369999999999 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828540+0000", 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013213600000000001 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828676+0000", 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013545500000000001 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.265 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.425567997000002, 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021330954999999999, 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.266 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 112 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-07 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811224+0000", 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653499999999999 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811237+0000", 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.271e-05 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811245+0000", 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6400000000000003e-06 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826483+0000", 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015237456 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826705+0000", 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022216799999999999 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.827081+0000", 2024-05-07T14:01:19.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037659800000000002 2024-05-07T14:01:19.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.831960+0000", 2024-05-07T14:01:19.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048788779999999997 2024-05-07T14:01:19.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832167+0000", 2024-05-07T14:01:19.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020690500000000001 2024-05-07T14:01:19.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832305+0000", 2024-05-07T14:01:19.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013801899999999999 2024-05-07T14:01:19.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832418+0000", 2024-05-07T14:01:19.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112212 2024-05-07T14:01:19.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.276 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.425394488000002, 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021403628000000001, 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 113 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811261+0000", 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0400000000000005e-07 2024-05-07T14:01:19.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811267+0000", 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6099999999999997e-06 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811276+0000", 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4029999999999996e-06 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811283+0000", 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:01:19.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828825+0000", 2024-05-07T14:01:19.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017541853999999999 2024-05-07T14:01:19.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829061+0000", 2024-05-07T14:01:19.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235861 2024-05-07T14:01:19.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829418+0000", 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035766800000000001 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832130+0000", 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027118120000000001 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832442+0000", 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000311611 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832565+0000", 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012284199999999999 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832664+0000", 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8982999999999997e-05 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.282 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.425360498000003, 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023518260999999999, 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 114 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:01:19.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:01:19.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811295+0000", 2024-05-07T14:01:19.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:01:19.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811301+0000", 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8599999999999998e-06 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811310+0000", 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0299999999999999e-06 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811320+0000", 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023e-05 2024-05-07T14:01:19.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830314+0000", 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018994385999999999 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830552+0000", 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023815500000000001 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830971+0000", 2024-05-07T14:01:19.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041934300000000003 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834620+0000", 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036481389999999999 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834666+0000", 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6266000000000001e-05 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834742+0000", 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6069000000000006e-05 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834812+0000", 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0372999999999999e-05 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.425319938999998, 2024-05-07T14:01:19.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027863941999999999, 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 115 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2699999999999999e-07 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811469+0000", 2024-05-07T14:01:19.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133332 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811502+0000", 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3027000000000001e-05 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811511+0000", 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.713e-06 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832759+0000", 2024-05-07T14:01:19.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021248185999999999 2024-05-07T14:01:19.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832917+0000", 2024-05-07T14:01:19.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157825 2024-05-07T14:01:19.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.833269+0000", 2024-05-07T14:01:19.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035184099999999998 2024-05-07T14:01:19.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838250+0000", 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004980712 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838941+0000", 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069081399999999999 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839091+0000", 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149903 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839199+0000", 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010796199999999999 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.425126075999998, 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028128562999999999, 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.294 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 116 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811529+0000", 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811546+0000", 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7113e-05 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811570+0000", 2024-05-07T14:01:19.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.406e-05 2024-05-07T14:01:19.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811578+0000", 2024-05-07T14:01:19.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8660000000000006e-06 2024-05-07T14:01:19.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834997+0000", 2024-05-07T14:01:19.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023418799000000001 2024-05-07T14:01:19.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835317+0000", 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031991799999999998 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835662+0000", 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034544399999999998 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839220+0000", 2024-05-07T14:01:19.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035576959999999999 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839374+0000", 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015427600000000001 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839540+0000", 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016534500000000001 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839657+0000", 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117243 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.425063064, 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02858051, 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.300 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 117 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811592+0000", 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811601+0000", 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1269999999999992e-06 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811611+0000", 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6900000000000004e-06 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811618+0000", 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0770000000000002e-06 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836766+0000", 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025147966000000001 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836982+0000", 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021640400000000001 2024-05-07T14:01:19.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.837283+0000", 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030005800000000002 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839885+0000", 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002602937 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839925+0000", 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9446000000000001e-05 2024-05-07T14:01:19.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840061+0000", 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136043 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840172+0000", 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111019 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.305 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.937495065999997, 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014903938, 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 137 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299160+0000", 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4400000000000001e-07 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299232+0000", 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2348000000000006e-05 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299251+0000", 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9086e-05 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299258+0000", 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0659999999999998e-06 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306394+0000", 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071357629999999998 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306491+0000", 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6526000000000004e-05 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306652+0000", 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000161674 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312756+0000", 2024-05-07T14:01:19.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061035860000000003 2024-05-07T14:01:19.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313919+0000", 2024-05-07T14:01:19.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011630919999999999 2024-05-07T14:01:19.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314000+0000", 2024-05-07T14:01:19.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1037000000000004e-05 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314063+0000", 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3316000000000002e-05 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.937383107999999, 2024-05-07T14:01:19.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01524198, 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 138 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299272+0000", 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8599999999999998e-07 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299282+0000", 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0051000000000001e-05 2024-05-07T14:01:19.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299297+0000", 2024-05-07T14:01:19.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5125e-05 2024-05-07T14:01:19.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299302+0000", 2024-05-07T14:01:19.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2119999999999997e-06 2024-05-07T14:01:19.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309582+0000", 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010280163 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309722+0000", 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140715 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309941+0000", 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000218249 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313900+0000", 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039598080000000004 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314411+0000", 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051060400000000001 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314466+0000", 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4861000000000002e-05 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314513+0000", 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7506000000000002e-05 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.937344807000002, 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01724038, 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.317 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 139 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3099999999999998e-07 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299313+0000", 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9390000000000002e-06 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299318+0000", 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5909999999999998e-06 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299321+0000", 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3890000000000001e-06 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310603+0000", 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011281753 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310704+0000", 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010111900000000001 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310888+0000", 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183666 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314523+0000", 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036354999999999998 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316436+0000", 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001913238 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316501+0000", 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4261e-05 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316550+0000", 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9493000000000002e-05 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.322 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.937324476999997, 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019781539000000001, 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 140 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-07 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299398+0000", 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7822000000000002e-05 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299404+0000", 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2369999999999997e-06 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299409+0000", 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2069999999999997e-06 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311355+0000", 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011946082 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311493+0000", 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013830900000000001 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311709+0000", 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021606899999999999 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314528+0000", 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028193839999999999 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319001+0000", 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004472218 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319063+0000", 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1940000000000007e-05 2024-05-07T14:01:19.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319112+0000", 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8964000000000001e-05 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.937238112000003, 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019944718, 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.328 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 141 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299417+0000", 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7099999999999997e-07 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299420+0000", 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8629999999999999e-06 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299424+0000", 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4830000000000001e-06 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299429+0000", 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6609999999999999e-06 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312813+0000", 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013384330999999999 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312948+0000", 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000135239 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313163+0000", 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000214718 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314534+0000", 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013704430000000001 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319185+0000", 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046516839999999997 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319281+0000", 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5645999999999999e-05 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319361+0000", 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0278999999999995e-05 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.333 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.224985613999998, 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013780794000000001, 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 158 2024-05-07T14:01:19.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011670+0000", 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:01:19.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011817+0000", 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014761200000000001 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011830+0000", 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2653999999999999e-05 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011844+0000", 2024-05-07T14:01:19.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4039999999999999e-05 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020200+0000", 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083561409999999992 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020433+0000", 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000233088 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020662+0000", 2024-05-07T14:01:19.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000229015 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023097+0000", 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024346480000000002 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025218+0000", 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021216669999999998 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025350+0000", 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013124600000000001 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025450+0000", 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010002599999999999 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.224795098000001, 2024-05-07T14:01:19.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013831896, 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 159 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011860+0000", 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8999999999999995e-07 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011874+0000", 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3806e-05 2024-05-07T14:01:19.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011884+0000", 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5629999999999998e-06 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011894+0000", 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0353999999999999e-05 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023169+0000", 2024-05-07T14:01:19.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011274872 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023305+0000", 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653299999999999 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023505+0000", 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000199254 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.024966+0000", 2024-05-07T14:01:19.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014616830000000001 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025472+0000", 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00050618899999999999 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025593+0000", 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120019 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025691+0000", 2024-05-07T14:01:19.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8832999999999994e-05 2024-05-07T14:01:19.345 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.345 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.345 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.345 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:19.345 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:19.345 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:19.346 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:01:19.347 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:19.362+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:19.448 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:19.461+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:19.478 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:19.479 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:19.489 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:01:19.549 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:19.565+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:19.597 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:19.598 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:19.609 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.4 to 1 (10000) 2024-05-07T14:01:19.613 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:01:19.630 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-07T14:01:19.650 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:19.665+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:19.734 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:19.735 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:19.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:19.735 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:19.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.735 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:129 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'87, mlcod=17'85)", 2024-05-07T14:01:19.735 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:01:19.735 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.451149073000003, 2024-05-07T14:01:19.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034674469999999998, 2024-05-07T14:01:19.735 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.735 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.735 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.735 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:01:19.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:01:19.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299075+0000", 2024-05-07T14:01:19.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.736e-06 2024-05-07T14:01:19.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299087+0000", 2024-05-07T14:01:19.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2067e-05 2024-05-07T14:01:19.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299122+0000", 2024-05-07T14:01:19.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4643e-05 2024-05-07T14:01:19.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299141+0000", 2024-05-07T14:01:19.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9224000000000001e-05 2024-05-07T14:01:19.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299323+0000", 2024-05-07T14:01:19.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018190400000000001 2024-05-07T14:01:19.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299385+0000", 2024-05-07T14:01:19.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2126999999999997e-05 2024-05-07T14:01:19.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302462+0000", 2024-05-07T14:01:19.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030768330000000002 2024-05-07T14:01:19.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302541+0000", 2024-05-07T14:01:19.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8912999999999995e-05 2024-05-07T14:01:19.739 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.739 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.740 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.740 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:131 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'89, mlcod=17'85)", 2024-05-07T14:01:19.740 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:01:19.740 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.449816400000003, 2024-05-07T14:01:19.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038759010000000002, 2024-05-07T14:01:19.740 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.740 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.740 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.740 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300407+0000", 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0299999999999998e-07 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300577+0000", 2024-05-07T14:01:19.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000170259 2024-05-07T14:01:19.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300592+0000", 2024-05-07T14:01:19.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4707e-05 2024-05-07T14:01:19.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300601+0000", 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999995e-06 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301133+0000", 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053150199999999999 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301186+0000", 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.342e-05 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304217+0000", 2024-05-07T14:01:19.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030307429999999998 2024-05-07T14:01:19.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304282+0000", 2024-05-07T14:01:19.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5316999999999998e-05 2024-05-07T14:01:19.744 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.744 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.744 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.744 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:132 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'90, mlcod=17'85)", 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.448764304999997, 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041397580000000003, 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:01:19.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301459+0000", 2024-05-07T14:01:19.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.47e-07 2024-05-07T14:01:19.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301470+0000", 2024-05-07T14:01:19.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0933e-05 2024-05-07T14:01:19.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301483+0000", 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2427e-05 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301491+0000", 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6130000000000004e-06 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302683+0000", 2024-05-07T14:01:19.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011919980000000001 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302741+0000", 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7963000000000001e-05 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305494+0000", 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027531420000000001 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305598+0000", 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103835 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:134 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'92, mlcod=17'85)", 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.446478407999997, 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037081470000000002, 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.749 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:01:19.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:01:19.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303747+0000", 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303805+0000", 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8554999999999998e-05 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303829+0000", 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3799999999999999e-05 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303871+0000", 2024-05-07T14:01:19.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2079999999999997e-05 2024-05-07T14:01:19.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304359+0000", 2024-05-07T14:01:19.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048822999999999998 2024-05-07T14:01:19.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304415+0000", 2024-05-07T14:01:19.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5405999999999998e-05 2024-05-07T14:01:19.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307388+0000", 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029728070000000001 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307452+0000", 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4789000000000006e-05 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:137 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'95, mlcod=17'88)", 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.442854507, 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004097552, 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307370+0000", 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3939999999999999e-06 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307454+0000", 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4639000000000001e-05 2024-05-07T14:01:19.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307474+0000", 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0242999999999999e-05 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307485+0000", 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0710000000000001e-05 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307538+0000", 2024-05-07T14:01:19.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2623000000000001e-05 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307566+0000", 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.781e-05 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311405+0000", 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038392299999999999 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311466+0000", 2024-05-07T14:01:19.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0903000000000003e-05 2024-05-07T14:01:19.758 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.758 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.758 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.758 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:138 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'96, mlcod=17'93)", 2024-05-07T14:01:19.758 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:01:19.758 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.439558368999997, 2024-05-07T14:01:19.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034036700000000001, 2024-05-07T14:01:19.758 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.758 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.758 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.758 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310666+0000", 2024-05-07T14:01:19.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310680+0000", 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4047e-05 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310715+0000", 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4826000000000002e-05 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310739+0000", 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3796000000000001e-05 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310862+0000", 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123132 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310896+0000", 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.43e-05 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313965+0000", 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030685959999999998 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314068+0000", 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102963 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:01:19.762 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:01:19.763 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.438652685999998, 2024-05-07T14:01:19.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:01:19.763 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.763 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.763 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.763 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:01:19.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:01:19.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:01:19.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:01:19.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:01:19.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:01:19.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:01:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.43774629, 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.767 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:01:19.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:01:19.771 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.436333671, 2024-05-07T14:01:19.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:01:19.772 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.772 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.772 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.772 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:01:19.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:01:19.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:01:19.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:01:19.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:01:19.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:01:19.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:01:19.776 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.776 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.776 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.776 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:143 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'101, mlcod=17'98)", 2024-05-07T14:01:19.776 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:01:19.776 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.428440901999998, 2024-05-07T14:01:19.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036609120000000001, 2024-05-07T14:01:19.776 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.776 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.776 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.776 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321783+0000", 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3599999999999999e-06 2024-05-07T14:01:19.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321905+0000", 2024-05-07T14:01:19.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121923 2024-05-07T14:01:19.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321929+0000", 2024-05-07T14:01:19.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4295999999999999e-05 2024-05-07T14:01:19.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321945+0000", 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5773999999999998e-05 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322070+0000", 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012457899999999999 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322101+0000", 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1213000000000001e-05 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325342+0000", 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032410579999999998 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325443+0000", 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100709 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.780 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:144 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-05-07T14:01:19.781 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:01:19.781 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.427372159999997, 2024-05-07T14:01:19.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003406484, 2024-05-07T14:01:19.781 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.781 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.781 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.781 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:01:19.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322852+0000", 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8369999999999999e-06 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323022+0000", 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016984199999999999 2024-05-07T14:01:19.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323048+0000", 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5752999999999999e-05 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323071+0000", 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.266e-05 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323188+0000", 2024-05-07T14:01:19.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011728200000000001 2024-05-07T14:01:19.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323224+0000", 2024-05-07T14:01:19.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6380000000000001e-05 2024-05-07T14:01:19.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326163+0000", 2024-05-07T14:01:19.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029386170000000001 2024-05-07T14:01:19.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326257+0000", 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4112999999999998e-05 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.731041247, 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034691510000000002, 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.785 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.786 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:19.786 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:19.786 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:19.786 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 206 2024-05-07T14:01:19.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.786 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:01:19.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019184+0000", 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6170000000000001e-06 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019198+0000", 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4113e-05 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019229+0000", 2024-05-07T14:01:19.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0423e-05 2024-05-07T14:01:19.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019244+0000", 2024-05-07T14:01:19.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5047e-05 2024-05-07T14:01:19.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019478+0000", 2024-05-07T14:01:19.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000234398 2024-05-07T14:01:19.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019723+0000", 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024469500000000001 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.020149+0000", 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042592999999999998 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.021776+0000", 2024-05-07T14:01:19.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001627688 2024-05-07T14:01:19.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022453+0000", 2024-05-07T14:01:19.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00067671500000000004 2024-05-07T14:01:19.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022551+0000", 2024-05-07T14:01:19.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8312000000000003e-05 2024-05-07T14:01:19.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022651+0000", 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9213e-05 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.703752067, 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038721300000000001, 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.791 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 210 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046474+0000", 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.517e-06 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046487+0000", 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3113e-05 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046521+0000", 2024-05-07T14:01:19.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3556000000000002e-05 2024-05-07T14:01:19.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046537+0000", 2024-05-07T14:01:19.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.643e-05 2024-05-07T14:01:19.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046651+0000", 2024-05-07T14:01:19.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011368500000000001 2024-05-07T14:01:19.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046873+0000", 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221802 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.047335+0000", 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046227300000000002 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.048993+0000", 2024-05-07T14:01:19.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016576679999999999 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050186+0000", 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001193284 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050273+0000", 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7189999999999997e-05 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050343+0000", 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9611999999999997e-05 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.674245321000001, 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034712530000000001, 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.797 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 218 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:01:19.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075980+0000", 2024-05-07T14:01:19.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.774e-06 2024-05-07T14:01:19.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075992+0000", 2024-05-07T14:01:19.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2283000000000001e-05 2024-05-07T14:01:19.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076024+0000", 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1242999999999999e-05 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076038+0000", 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4663e-05 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076199+0000", 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160865 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076539+0000", 2024-05-07T14:01:19.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033995800000000001 2024-05-07T14:01:19.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:19.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.077234+0000", 2024-05-07T14:01:19.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000694581 2024-05-07T14:01:19.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:19.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.078996+0000", 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001762633 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079276+0000", 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027998399999999999 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079380+0000", 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103266 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079449+0000", 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9003000000000003e-05 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.610663189, 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.803 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:01:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:01:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:01:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:01:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:01:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:01:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:01:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:01:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:01:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:01:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.577552531, 2024-05-07T14:01:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:01:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:01:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:01:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:01:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:01:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:01:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:01:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:01:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:01:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:01:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:01:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.570642612, 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041680119999999996, 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 382 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179581+0000", 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179585+0000", 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4800000000000003e-06 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179598+0000", 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2322e-05 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179604+0000", 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.823e-06 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179657+0000", 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3937000000000002e-05 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179714+0000", 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6165000000000002e-05 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179830+0000", 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011632 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.180515+0000", 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00068531400000000002 2024-05-07T14:01:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183667+0000", 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031522009999999999 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183704+0000", 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6925999999999998e-05 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183748+0000", 2024-05-07T14:01:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3618999999999997e-05 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:499 6.13 e33/27 6:cedbb205:::obj_delete_at_hint.0000000017:head v 33'4, mlcod=33'1)", 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.497269958, 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043323679999999996, 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252954+0000", 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.71e-07 2024-05-07T14:01:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252960+0000", 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.46e-06 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252974+0000", 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4249e-05 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252982+0000", 2024-05-07T14:01:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253055+0000", 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3162000000000002e-05 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253075+0000", 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9451999999999999e-05 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257253+0000", 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041781179999999998 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257285+0000", 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2075e-05 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:550 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:01:19.825 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.461615776, 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035552140000000001, 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 550 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:01:19.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288608+0000", 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0529999999999999e-06 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288613+0000", 2024-05-07T14:01:19.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7060000000000003e-06 2024-05-07T14:01:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288624+0000", 2024-05-07T14:01:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1547e-05 2024-05-07T14:01:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288630+0000", 2024-05-07T14:01:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:01:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288734+0000", 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103872 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288884+0000", 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014987400000000001 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289167+0000", 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028341999999999999 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:19.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289813+0000", 2024-05-07T14:01:19.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064550199999999995 2024-05-07T14:01:19.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292082+0000", 2024-05-07T14:01:19.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022696000000000001 2024-05-07T14:01:19.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292120+0000", 2024-05-07T14:01:19.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7367999999999999e-05 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292162+0000", 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2568000000000003e-05 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:667 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.365673742, 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050309150000000004, 2024-05-07T14:01:19.831 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 667 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384550+0000", 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7000000000000003e-07 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384555+0000", 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.135e-06 2024-05-07T14:01:19.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:19.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384565+0000", 2024-05-07T14:01:19.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0541e-05 2024-05-07T14:01:19.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:19.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384571+0000", 2024-05-07T14:01:19.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.857e-06 2024-05-07T14:01:19.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:19.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384670+0000", 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8461999999999993e-05 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384822+0000", 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152039 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.385123+0000", 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030070699999999999 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:19.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.386099+0000", 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097677300000000001 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389495+0000", 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033959139999999999 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389530+0000", 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.472e-05 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:19.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:19.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389580+0000", 2024-05-07T14:01:19.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9897e-05 2024-05-07T14:01:19.837 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.837 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.837 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.837 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:19.837 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:19.837 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:19.838 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:01:19.839 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:01:19.839 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:19.854+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:19.939 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:19.953+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:20.000 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:20.000 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:20.000 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:20.000 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:20.013 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:01:20.017 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:20.017 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:20.033 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:20.034 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:20.040 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:20.053+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:20.050 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:20.050 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:20.068 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:20.068 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:20.087 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:20.087 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:20.108 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:20.108 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:20.124 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:20.124 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:20.129 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:20.129 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:20.137 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:01:20.141 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:20.157+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:20.149 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:20.150 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:20.242 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:20.258+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:20.257 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:20.257 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:20.270 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:01:20.343 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:20.357+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:20.437 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:20.437 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:20.444 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:20.457+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:20.451 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:01:20.544 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:20.557+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:20.576 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:20.577 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:20.591 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:01:20.614 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.5 to 1 (10000) 2024-05-07T14:01:20.633 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:01:20.637 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-07T14:01:20.682 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:20.697+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:20.711 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:20.711 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:20.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:01:20.774 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:20.789+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:20.848 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:20.861+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:20.888 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:20.888 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:20.902 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:01:20.948 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:20.961+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:21.013 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:21.014 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:21.026 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:01:21.070 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:21.085+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:21.150 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:21.165+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:21.187 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:21.187 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:21.201 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:01:21.251 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:21.265+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:21.333 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:21.334 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:21.348 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:01:21.390 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:21.405+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:21.454 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:21.469+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:21.508 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:21.508 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:21.522 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:01:21.555 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:21.569+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:21.634 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:21.634 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:21.635 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.6 to 1 (10000) 2024-05-07T14:01:21.635 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:01:21.650 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:01:21.655 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:21.669+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:21.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-07T14:01:21.756 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:21.769+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:21.759 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:21.760 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:21.772 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:01:21.857 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:21.869+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:21.882 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:21.882 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:21.895 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:01:21.985 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:22.001+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:22.059 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:22.073+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:22.060 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:22.061 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:22.074 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:01:22.160 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:22.173+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:22.167 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:01:22.235 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:22.235 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:22.249 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:01:22.294 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:22.309+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:22.318 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:22.318 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:22.334 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:22.350 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:22.350 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:22.361 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:22.377+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:22.366 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:22.367 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:22.367 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:22.367 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:22.380 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:01:22.387 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:22.387 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:22.406 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:22.406 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:22.426 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:22.426 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:22.445 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:22.446 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:22.463 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:22.477+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:22.532 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:22.532 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:22.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:22.532 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:22.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.532 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.528598674000001, 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089647730000000005, 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 46 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017451+0000", 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9349999999999999e-06 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017460+0000", 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017481+0000", 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0984000000000001e-05 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017499+0000", 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:01:22.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018689+0000", 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001190303 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018945+0000", 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025626799999999998 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022176+0000", 2024-05-07T14:01:22.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032308720000000001 2024-05-07T14:01:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026078+0000", 2024-05-07T14:01:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039018289999999999 2024-05-07T14:01:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026189+0000", 2024-05-07T14:01:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110775 2024-05-07T14:01:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026310+0000", 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121023 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026413+0000", 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103346 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.538 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94397682172928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.519176018, 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032214489999999999, 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 47 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026873+0000", 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4200000000000001e-06 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026883+0000", 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0017000000000001e-05 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026904+0000", 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0228999999999999e-05 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026917+0000", 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3594000000000001e-05 2024-05-07T14:01:22.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027029+0000", 2024-05-07T14:01:22.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011171900000000001 2024-05-07T14:01:22.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027247+0000", 2024-05-07T14:01:22.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021786099999999999 2024-05-07T14:01:22.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:22.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027599+0000", 2024-05-07T14:01:22.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035225700000000003 2024-05-07T14:01:22.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:22.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029240+0000", 2024-05-07T14:01:22.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016408620000000001 2024-05-07T14:01:22.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:22.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029864+0000", 2024-05-07T14:01:22.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00062414399999999998 2024-05-07T14:01:22.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029939+0000", 2024-05-07T14:01:22.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4931999999999993e-05 2024-05-07T14:01:22.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030092+0000", 2024-05-07T14:01:22.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015341399999999999 2024-05-07T14:01:22.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.544 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.545 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:22.545 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:01:22.545 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.507132472999999, 2024-05-07T14:01:22.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021710919999999999, 2024-05-07T14:01:22.545 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.545 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.545 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.545 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:22.545 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 54 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038917+0000", 2024-05-07T14:01:22.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8720000000000002e-06 2024-05-07T14:01:22.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038929+0000", 2024-05-07T14:01:22.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1294999999999999e-05 2024-05-07T14:01:22.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038964+0000", 2024-05-07T14:01:22.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5516999999999999e-05 2024-05-07T14:01:22.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038983+0000", 2024-05-07T14:01:22.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:01:22.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039074+0000", 2024-05-07T14:01:22.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1106999999999994e-05 2024-05-07T14:01:22.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039201+0000", 2024-05-07T14:01:22.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012714700000000001 2024-05-07T14:01:22.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:22.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039320+0000", 2024-05-07T14:01:22.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011861100000000001 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040439+0000", 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011193450000000001 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040971+0000", 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053181599999999995 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041040+0000", 2024-05-07T14:01:22.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8706000000000003e-05 2024-05-07T14:01:22.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041086+0000", 2024-05-07T14:01:22.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5883000000000001e-05 2024-05-07T14:01:22.551 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.551 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.551 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94397682168320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.504760061999999, 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001933333, 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 55 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041288+0000", 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5200000000000001e-06 2024-05-07T14:01:22.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041295+0000", 2024-05-07T14:01:22.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3679999999999998e-06 2024-05-07T14:01:22.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041315+0000", 2024-05-07T14:01:22.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9826999999999998e-05 2024-05-07T14:01:22.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041325+0000", 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0402e-05 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041403+0000", 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8404000000000004e-05 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041479+0000", 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5846999999999994e-05 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041637+0000", 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157699 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.042503+0000", 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086578899999999995 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043108+0000", 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060548999999999998 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043158+0000", 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9359e-05 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043220+0000", 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2627999999999997e-05 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:191 6.5 e30/27 6:a2ace8b3:::data_log.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:01:22.557 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.418336115999999, 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00168714, 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:01:22.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127713+0000", 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2290000000000002e-06 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127727+0000", 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4236999999999999e-05 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127759+0000", 2024-05-07T14:01:22.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1402999999999997e-05 2024-05-07T14:01:22.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127772+0000", 2024-05-07T14:01:22.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3227000000000001e-05 2024-05-07T14:01:22.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127895+0000", 2024-05-07T14:01:22.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012357500000000001 2024-05-07T14:01:22.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127929+0000", 2024-05-07T14:01:22.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3599999999999997e-05 2024-05-07T14:01:22.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129322+0000", 2024-05-07T14:01:22.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001392936 2024-05-07T14:01:22.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129398+0000", 2024-05-07T14:01:22.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5933000000000006e-05 2024-05-07T14:01:22.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.562 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.562 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-07T14:01:22.562 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:01:22.562 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.506153745000001, 2024-05-07T14:01:22.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386840000000002, 2024-05-07T14:01:22.562 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:01:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:01:22.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039894+0000", 2024-05-07T14:01:22.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9999999999999996e-07 2024-05-07T14:01:22.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039906+0000", 2024-05-07T14:01:22.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-05 2024-05-07T14:01:22.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039948+0000", 2024-05-07T14:01:22.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1983000000000001e-05 2024-05-07T14:01:22.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039975+0000", 2024-05-07T14:01:22.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7120000000000001e-05 2024-05-07T14:01:22.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040144+0000", 2024-05-07T14:01:22.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016912200000000001 2024-05-07T14:01:22.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040195+0000", 2024-05-07T14:01:22.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1023000000000003e-05 2024-05-07T14:01:22.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043654+0000", 2024-05-07T14:01:22.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034590089999999999 2024-05-07T14:01:22.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043732+0000", 2024-05-07T14:01:22.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7557000000000003e-05 2024-05-07T14:01:22.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.567 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.567 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:215 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:22.567 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:01:22.567 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.480616578999999, 2024-05-07T14:01:22.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017783440000000001, 2024-05-07T14:01:22.567 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.568 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.568 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.568 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:01:22.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:01:22.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065432+0000", 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8300000000000001e-06 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065444+0000", 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2227e-05 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065472+0000", 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7983e-05 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065487+0000", 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.45e-05 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065628+0000", 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014118900000000001 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065700+0000", 2024-05-07T14:01:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1521999999999997e-05 2024-05-07T14:01:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067097+0000", 2024-05-07T14:01:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00139784 2024-05-07T14:01:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067209+0000", 2024-05-07T14:01:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111253 2024-05-07T14:01:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.572 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.572 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.572 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:221 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'3, mlcod=33'1)", 2024-05-07T14:01:22.572 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:01:22.572 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.45681628, 2024-05-07T14:01:22.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016799510000000001, 2024-05-07T14:01:22.572 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.572 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.572 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.572 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:01:22.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:01:22.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089233+0000", 2024-05-07T14:01:22.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.877e-06 2024-05-07T14:01:22.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089244+0000", 2024-05-07T14:01:22.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1323e-05 2024-05-07T14:01:22.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089272+0000", 2024-05-07T14:01:22.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8204e-05 2024-05-07T14:01:22.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089285+0000", 2024-05-07T14:01:22.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3223e-05 2024-05-07T14:01:22.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089425+0000", 2024-05-07T14:01:22.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013934900000000001 2024-05-07T14:01:22.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089487+0000", 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2459000000000006e-05 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090785+0000", 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012974900000000001 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090911+0000", 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126026 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.576 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.577 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-07T14:01:22.577 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:22.577 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.420539335999999, 2024-05-07T14:01:22.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020505779999999999, 2024-05-07T14:01:22.577 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.577 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.577 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.577 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:22.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:22.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:22.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:01:22.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125517+0000", 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.833e-06 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125569+0000", 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1619999999999997e-05 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125589+0000", 2024-05-07T14:01:22.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0803000000000001e-05 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125733+0000", 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014308600000000001 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125786+0000", 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3158999999999997e-05 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127460+0000", 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001674493 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127558+0000", 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7967000000000006e-05 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:337 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'5, mlcod=33'3)", 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:01:22.581 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.379141625000001, 2024-05-07T14:01:22.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004459658, 2024-05-07T14:01:22.582 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.582 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.582 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.582 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:01:22.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:01:22.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166908+0000", 2024-05-07T14:01:22.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2259999999999999e-06 2024-05-07T14:01:22.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166922+0000", 2024-05-07T14:01:22.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4780000000000001e-05 2024-05-07T14:01:22.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166960+0000", 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8173000000000002e-05 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166981+0000", 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0440000000000001e-05 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167154+0000", 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017287199999999999 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167207+0000", 2024-05-07T14:01:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000001e-05 2024-05-07T14:01:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171283+0000", 2024-05-07T14:01:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004076278 2024-05-07T14:01:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171365+0000", 2024-05-07T14:01:22.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1588999999999994e-05 2024-05-07T14:01:22.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.586 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.586 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:349 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:22.586 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:01:22.586 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.378266828999999, 2024-05-07T14:01:22.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042886440000000003, 2024-05-07T14:01:22.586 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.586 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.586 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.587 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:01:22.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:01:22.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167782+0000", 2024-05-07T14:01:22.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:01:22.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167797+0000", 2024-05-07T14:01:22.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4533e-05 2024-05-07T14:01:22.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167828+0000", 2024-05-07T14:01:22.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1239999999999999e-05 2024-05-07T14:01:22.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167859+0000", 2024-05-07T14:01:22.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1007000000000003e-05 2024-05-07T14:01:22.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168041+0000", 2024-05-07T14:01:22.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181788 2024-05-07T14:01:22.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168095+0000", 2024-05-07T14:01:22.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3857000000000003e-05 2024-05-07T14:01:22.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171961+0000", 2024-05-07T14:01:22.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038664160000000001 2024-05-07T14:01:22.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172069+0000", 2024-05-07T14:01:22.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107793 2024-05-07T14:01:22.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.591 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.591 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:357 6.5 e33/27 6:a60f9269:lc::lua_package_allowlist:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:22.591 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:01:22.591 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.376098099, 2024-05-07T14:01:22.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002145817, 2024-05-07T14:01:22.591 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.591 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.591 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.592 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:01:22.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:01:22.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169950+0000", 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.626e-06 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169963+0000", 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2619999999999999e-05 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169990+0000", 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7084e-05 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170003+0000", 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3312999999999999e-05 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170144+0000", 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140376 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170203+0000", 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9586000000000002e-05 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172022+0000", 2024-05-07T14:01:22.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018187419999999999 2024-05-07T14:01:22.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172095+0000", 2024-05-07T14:01:22.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2470000000000002e-05 2024-05-07T14:01:22.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.595 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.596 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:386 6.c e33/27 6:3677c228:::obj_delete_at_hint.0000000006:head v 33'1, mlcod=0'0)", 2024-05-07T14:01:22.596 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:01:22.596 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.362567762999999, 2024-05-07T14:01:22.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016811230000000001, 2024-05-07T14:01:22.596 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.596 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.596 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.596 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:01:22.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:01:22.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183481+0000", 2024-05-07T14:01:22.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.756e-06 2024-05-07T14:01:22.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183493+0000", 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.254e-05 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183520+0000", 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6809999999999999e-05 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183539+0000", 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8233e-05 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183686+0000", 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147045 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183741+0000", 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5380000000000002e-05 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185039+0000", 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012981500000000001 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185160+0000", 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121209 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:604 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'10, mlcod=33'8)", 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.216706915, 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003281431, 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.600 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.601 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.601 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:01:22.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:01:22.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329341+0000", 2024-05-07T14:01:22.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.42e-06 2024-05-07T14:01:22.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329351+0000", 2024-05-07T14:01:22.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0002e-05 2024-05-07T14:01:22.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329373+0000", 2024-05-07T14:01:22.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1209e-05 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329384+0000", 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1161999999999999e-05 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329495+0000", 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111302 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329522+0000", 2024-05-07T14:01:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7291999999999999e-05 2024-05-07T14:01:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332531+0000", 2024-05-07T14:01:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003008405 2024-05-07T14:01:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332621+0000", 2024-05-07T14:01:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0638999999999997e-05 2024-05-07T14:01:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.604 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:656 6.1 e33/27 6:84d19476:::obj_delete_at_hint.0000000038:head v 33'5, mlcod=33'3)", 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.170302797, 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020273800000000001, 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:01:22.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:01:22.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375746+0000", 2024-05-07T14:01:22.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0499999999999999e-06 2024-05-07T14:01:22.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375759+0000", 2024-05-07T14:01:22.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2952999999999999e-05 2024-05-07T14:01:22.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375789+0000", 2024-05-07T14:01:22.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9612999999999999e-05 2024-05-07T14:01:22.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375804+0000", 2024-05-07T14:01:22.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5449999999999999e-05 2024-05-07T14:01:22.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375931+0000", 2024-05-07T14:01:22.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126883 2024-05-07T14:01:22.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375972+0000", 2024-05-07T14:01:22.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0581999999999999e-05 2024-05-07T14:01:22.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377685+0000", 2024-05-07T14:01:22.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017136740000000001 2024-05-07T14:01:22.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377772+0000", 2024-05-07T14:01:22.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6174999999999994e-05 2024-05-07T14:01:22.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.609 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.609 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:665 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-07T14:01:22.610 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:01:22.610 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.161798538999999, 2024-05-07T14:01:22.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001677357, 2024-05-07T14:01:22.610 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.610 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.610 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.610 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:01:22.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:01:22.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384250+0000", 2024-05-07T14:01:22.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7099999999999999e-06 2024-05-07T14:01:22.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384261+0000", 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.113e-05 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384287+0000", 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6256000000000001e-05 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384301+0000", 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3443e-05 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384443+0000", 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142192 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384509+0000", 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6124000000000006e-05 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385819+0000", 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013092889999999999 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385926+0000", 2024-05-07T14:01:22.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010721300000000001 2024-05-07T14:01:22.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.614 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.614 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:685 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:22.614 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:01:22.614 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.145106345, 2024-05-07T14:01:22.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025309769999999998, 2024-05-07T14:01:22.614 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400943+0000", 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0899999999999999e-06 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400960+0000", 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6917000000000001e-05 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400995+0000", 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5626000000000001e-05 2024-05-07T14:01:22.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401014+0000", 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9126e-05 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401164+0000", 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149989 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401218+0000", 2024-05-07T14:01:22.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3550000000000001e-05 2024-05-07T14:01:22.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403375+0000", 2024-05-07T14:01:22.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00215737 2024-05-07T14:01:22.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403472+0000", 2024-05-07T14:01:22.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6309000000000002e-05 2024-05-07T14:01:22.618 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.618 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.618 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:686 6.1f e33/27 6:f93251ce:::obj_delete_at_hint.0000000042:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:01:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.14365649, 2024-05-07T14:01:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037357750000000002, 2024-05-07T14:01:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402392+0000", 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9870000000000002e-06 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402405+0000", 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.222e-05 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402429+0000", 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4729999999999999e-05 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402448+0000", 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8493000000000001e-05 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402604+0000", 2024-05-07T14:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155876 2024-05-07T14:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402647+0000", 2024-05-07T14:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2793000000000002e-05 2024-05-07T14:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406039+0000", 2024-05-07T14:01:22.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033922760000000001 2024-05-07T14:01:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406126+0000", 2024-05-07T14:01:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7399999999999997e-05 2024-05-07T14:01:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:693 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'5, mlcod=33'3)", 2024-05-07T14:01:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:01:22.623 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.137930061, 2024-05-07T14:01:22.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037287790000000002, 2024-05-07T14:01:22.624 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.624 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.624 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.624 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:01:22.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:01:22.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408119+0000", 2024-05-07T14:01:22.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0040000000000002e-06 2024-05-07T14:01:22.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408135+0000", 2024-05-07T14:01:22.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6155999999999999e-05 2024-05-07T14:01:22.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408193+0000", 2024-05-07T14:01:22.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8023999999999999e-05 2024-05-07T14:01:22.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408248+0000", 2024-05-07T14:01:22.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4664999999999999e-05 2024-05-07T14:01:22.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408410+0000", 2024-05-07T14:01:22.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016263599999999999 2024-05-07T14:01:22.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408462+0000", 2024-05-07T14:01:22.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1913000000000003e-05 2024-05-07T14:01:22.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411739+0000", 2024-05-07T14:01:22.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032768350000000001 2024-05-07T14:01:22.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411846+0000", 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010654600000000001 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:694 6.5 e33/27 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 33'8, mlcod=33'6)", 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.135313727, 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038331400000000001, 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:22.628 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:22.629 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:22.629 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:22.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:22.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:01:22.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:22.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:01:22.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:22.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:22.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410735+0000", 2024-05-07T14:01:22.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.793e-06 2024-05-07T14:01:22.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:22.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410746+0000", 2024-05-07T14:01:22.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1377e-05 2024-05-07T14:01:22.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410775+0000", 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8336000000000001e-05 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410788+0000", 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3074000000000001e-05 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410945+0000", 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015738199999999999 2024-05-07T14:01:22.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411009+0000", 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4276000000000006e-05 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414499+0000", 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034896060000000001 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414566+0000", 2024-05-07T14:01:22.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7296000000000001e-05 2024-05-07T14:01:22.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.633 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:22.633 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:22.633 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:22.634 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:01:22.635 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:22.649+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.7 to 1 (10000) 2024-05-07T14:01:22.665 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-07T14:01:22.666 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:01:22.758 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:22.773+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:22.761 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:22.761 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:22.776 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:01:22.836 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:22.849+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:22.897 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:22.897 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:22.897 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:22.897 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:22.897 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:22.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:01:22.954 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:22.969+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:23.039 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:01:23.045 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:01:23.047 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:23.061+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:23.059 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-05-07T14:01:22.655561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225332,"kb_used_data":4988,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749388,"statfs":{"total":773094113280,"available":772863373312,"internally_reserved":0,"allocated":5107712,"data_stored":2911140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.037090"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.663192+0000","last_change":"2024-05-07T14:00:55.983744+0000","last_active":"2024-05-07T14:01:21.663192+0000","last_peered":"2024-05-07T14:01:21.663192+0000","last_clean":"2024-05-07T14:01:21.663192+0000","last_became_active":"2024-05-07T14:00:55.982993+0000","last_became_peered":"2024-05-07T14:00:55.982993+0000","last_unstale":"2024-05-07T14:01:21.663192+0000","last_undegraded":"2024-05-07T14:01:21.663192+0000","last_fullsized":"2024-05-07T14:01:21.663192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.149812+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:01:22.149812+0000","last_peered":"2024-05-07T14:01:22.149812+0000","last_clean":"2024-05-07T14:01:22.149812+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:01:22.149812+0000","last_undegraded":"2024-05-07T14:01:22.149812+0000","last_fullsized":"2024-05-07T14:01:22.149812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159397+0000","last_change":"2024-05-07T14:00:55.973967+0000","last_active":"2024-05-07T14:01:22.159397+0000","last_peered":"2024-05-07T14:01:22.159397+0000","last_clean":"2024-05-07T14:01:22.159397+0000","last_became_active":"2024-05-07T14:00:55.973677+0000","last_became_peered":"2024-05-07T14:00:55.973677+0000","last_unstale":"2024-05-07T14:01:22.159397+0000","last_undegraded":"2024-05-07T14:01:22.159397+0000","last_fullsized":"2024-05-07T14:01:22.159397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659355+0000","last_change":"2024-05-07T14:00:57.988092+0000","last_active":"2024-05-07T14:01:21.659355+0000","last_peered":"2024-05-07T14:01:21.659355+0000","last_clean":"2024-05-07T14:01:21.659355+0000","last_became_active":"2024-05-07T14:00:57.987091+0000","last_became_peered":"2024-05-07T14:00:57.987091+0000","last_unstale":"2024-05-07T14:01:21.659355+0000","last_undegraded":"2024-05-07T14:01:21.659355+0000","last_fullsized":"2024-05-07T14:01:21.659355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162495+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:01:22.162495+0000","last_peered":"2024-05-07T14:01:22.162495+0000","last_clean":"2024-05-07T14:01:22.162495+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:01:22.162495+0000","last_undegraded":"2024-05-07T14:01:22.162495+0000","last_fullsized":"2024-05-07T14:01:22.162495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656998+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:01:21.656998+0000","last_peered":"2024-05-07T14:01:21.656998+0000","last_clean":"2024-05-07T14:01:21.656998+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:01:21.656998+0000","last_undegraded":"2024-05-07T14:01:21.656998+0000","last_fullsized":"2024-05-07T14:01:21.656998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151914+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:01:22.151914+0000","last_peered":"2024-05-07T14:01:22.151914+0000","last_clean":"2024-05-07T14:01:22.151914+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:01:22.151914+0000","last_undegraded":"2024-05-07T14:01:22.151914+0000","last_fullsized":"2024-05-07T14:01:22.151914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156718+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:01:22.156718+0000","last_peered":"2024-05-07T14:01:22.156718+0000","last_clean":"2024-05-07T14:01:22.156718+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:01:22.156718+0000","last_undegraded":"2024-05-07T14:01:22.156718+0000","last_fullsized":"2024-05-07T14:01:22.156718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660574+0000","last_change":"2024-05-07T14:00:55.973419+0000","last_active":"2024-05-07T14:01:21.660574+0000","last_peered":"2024-05-07T14:01:21.660574+0000","last_clean":"2024-05-07T14:01:21.660574+0000","last_became_active":"2024-05-07T14:00:55.963467+0000","last_became_peered":"2024-05-07T14:00:55.963467+0000","last_unstale":"2024-05-07T14:01:21.660574+0000","last_undegraded":"2024-05-07T14:01:21.660574+0000","last_fullsized":"2024-05-07T14:01:21.660574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151722+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:01:22.151722+0000","last_peered":"2024-05-07T14:01:22.151722+0000","last_clean":"2024-05-07T14:01:22.151722+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:01:22.151722+0000","last_undegraded":"2024-05-07T14:01:22.151722+0000","last_fullsized":"2024-05-07T14:01:22.151722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150408+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:01:22.150408+0000","last_peered":"2024-05-07T14:01:22.150408+0000","last_clean":"2024-05-07T14:01:22.150408+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:01:22.150408+0000","last_undegraded":"2024-05-07T14:01:22.150408+0000","last_fullsized":"2024-05-07T14:01:22.150408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660585+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:01:21.660585+0000","last_peered":"2024-05-07T14:01:21.660585+0000","last_clean":"2024-05-07T14:01:21.660585+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:01:21.660585+0000","last_undegraded":"2024-05-07T14:01:21.660585+0000","last_fullsized":"2024-05-07T14:01:21.660585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659506+0000","last_change":"2024-05-07T14:00:55.962579+0000","last_active":"2024-05-07T14:01:21.659506+0000","last_peered":"2024-05-07T14:01:21.659506+0000","last_clean":"2024-05-07T14:01:21.659506+0000","last_became_active":"2024-05-07T14:00:55.961815+0000","last_became_peered":"2024-05-07T14:00:55.961815+0000","last_unstale":"2024-05-07T14:01:21.659506+0000","last_undegraded":"2024-05-07T14:01:21.659506+0000","last_fullsized":"2024-05-07T14:01:21.659506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152062+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:01:22.152062+0000","last_peered":"2024-05-07T14:01:22.152062+0000","last_clean":"2024-05-07T14:01:22.152062+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:01:22.152062+0000","last_undegraded":"2024-05-07T14:01:22.152062+0000","last_fullsized":"2024-05-07T14:01:22.152062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656484+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:01:21.656484+0000","last_peered":"2024-05-07T14:01:21.656484+0000","last_clean":"2024-05-07T14:01:21.656484+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:01:21.656484+0000","last_undegraded":"2024-05-07T14:01:21.656484+0000","last_fullsized":"2024-05-07T14:01:21.656484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151870+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:01:22.151870+0000","last_peered":"2024-05-07T14:01:22.151870+0000","last_clean":"2024-05-07T14:01:22.151870+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:01:22.151870+0000","last_undegraded":"2024-05-07T14:01:22.151870+0000","last_fullsized":"2024-05-07T14:01:22.151870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656488+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:01:21.656488+0000","last_peered":"2024-05-07T14:01:21.656488+0000","last_clean":"2024-05-07T14:01:21.656488+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:01:21.656488+0000","last_undegraded":"2024-05-07T14:01:21.656488+0000","last_fullsized":"2024-05-07T14:01:21.656488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.663296+0000","last_change":"2024-05-07T14:00:56.003776+0000","last_active":"2024-05-07T14:01:21.663296+0000","last_peered":"2024-05-07T14:01:21.663296+0000","last_clean":"2024-05-07T14:01:21.663296+0000","last_became_active":"2024-05-07T14:00:56.002996+0000","last_became_peered":"2024-05-07T14:00:56.002996+0000","last_unstale":"2024-05-07T14:01:21.663296+0000","last_undegraded":"2024-05-07T14:01:21.663296+0000","last_fullsized":"2024-05-07T14:01:21.663296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:17.583140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659430+0000","last_change":"2024-05-07T14:00:57.987026+0000","last_active":"2024-05-07T14:01:21.659430+0000","last_peered":"2024-05-07T14:01:21.659430+0000","last_clean":"2024-05-07T14:01:21.659430+0000","last_became_active":"2024-05-07T14:00:57.986048+0000","last_became_peered":"2024-05-07T14:00:57.986048+0000","last_unstale":"2024-05-07T14:01:21.659430+0000","last_undegraded":"2024-05-07T14:01:21.659430+0000","last_fullsized":"2024-05-07T14:01:21.659430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150989+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:01:22.150989+0000","last_peered":"2024-05-07T14:01:22.150989+0000","last_clean":"2024-05-07T14:01:22.150989+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:01:22.150989+0000","last_undegraded":"2024-05-07T14:01:22.150989+0000","last_fullsized":"2024-05-07T14:01:22.150989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150579+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:01:22.150579+0000","last_peered":"2024-05-07T14:01:22.150579+0000","last_clean":"2024-05-07T14:01:22.150579+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:01:22.150579+0000","last_undegraded":"2024-05-07T14:01:22.150579+0000","last_fullsized":"2024-05-07T14:01:22.150579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152828+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:01:22.152828+0000","last_peered":"2024-05-07T14:01:22.152828+0000","last_clean":"2024-05-07T14:01:22.152828+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:01:22.152828+0000","last_undegraded":"2024-05-07T14:01:22.152828+0000","last_fullsized":"2024-05-07T14:01:22.152828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151791+0000","last_change":"2024-05-07T14:00:57.995304+0000","last_active":"2024-05-07T14:01:22.151791+0000","last_peered":"2024-05-07T14:01:22.151791+0000","last_clean":"2024-05-07T14:01:22.151791+0000","last_became_active":"2024-05-07T14:00:57.977809+0000","last_became_peered":"2024-05-07T14:00:57.977809+0000","last_unstale":"2024-05-07T14:01:22.151791+0000","last_undegraded":"2024-05-07T14:01:22.151791+0000","last_fullsized":"2024-05-07T14:01:22.151791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:42.772959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658249+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:01:21.658249+0000","last_peered":"2024-05-07T14:01:21.658249+0000","last_clean":"2024-05-07T14:01:21.658249+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:01:21.658249+0000","last_undegraded":"2024-05-07T14:01:21.658249+0000","last_fullsized":"2024-05-07T14:01:21.658249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153685+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:01:22.153685+0000","last_peered":"2024-05-07T14:01:22.153685+0000","last_clean":"2024-05-07T14:01:22.153685+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:01:22.153685+0000","last_undegraded":"2024-05-07T14:01:22.153685+0000","last_fullsized":"2024-05-07T14:01:22.153685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657046+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:01:21.657046+0000","last_peered":"2024-05-07T14:01:21.657046+0000","last_clean":"2024-05-07T14:01:21.657046+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:01:21.657046+0000","last_undegraded":"2024-05-07T14:01:21.657046+0000","last_fullsized":"2024-05-07T14:01:21.657046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660797+0000","last_change":"2024-05-07T14:00:58.008214+0000","last_active":"2024-05-07T14:01:21.660797+0000","last_peered":"2024-05-07T14:01:21.660797+0000","last_clean":"2024-05-07T14:01:21.660797+0000","last_became_active":"2024-05-07T14:00:58.005516+0000","last_became_peered":"2024-05-07T14:00:58.005516+0000","last_unstale":"2024-05-07T14:01:21.660797+0000","last_undegraded":"2024-05-07T14:01:21.660797+0000","last_fullsized":"2024-05-07T14:01:21.660797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158327+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:01:22.158327+0000","last_peered":"2024-05-07T14:01:22.158327+0000","last_clean":"2024-05-07T14:01:22.158327+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:01:22.158327+0000","last_undegraded":"2024-05-07T14:01:22.158327+0000","last_fullsized":"2024-05-07T14:01:22.158327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656163+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:01:21.656163+0000","last_peered":"2024-05-07T14:01:21.656163+0000","last_clean":"2024-05-07T14:01:21.656163+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:01:21.656163+0000","last_undegraded":"2024-05-07T14:01:21.656163+0000","last_fullsized":"2024-05-07T14:01:21.656163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658102+0000","last_change":"2024-05-07T14:00:57.988107+0000","last_active":"2024-05-07T14:01:21.658102+0000","last_peered":"2024-05-07T14:01:21.658102+0000","last_clean":"2024-05-07T14:01:21.658102+0000","last_became_active":"2024-05-07T14:00:57.987604+0000","last_became_peered":"2024-05-07T14:00:57.987604+0000","last_unstale":"2024-05-07T14:01:21.658102+0000","last_undegraded":"2024-05-07T14:01:21.658102+0000","last_fullsized":"2024-05-07T14:01:21.658102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660726+0000","last_change":"2024-05-07T14:00:55.975648+0000","last_active":"2024-05-07T14:01:21.660726+0000","last_peered":"2024-05-07T14:01:21.660726+0000","last_clean":"2024-05-07T14:01:21.660726+0000","last_became_active":"2024-05-07T14:00:55.974335+0000","last_became_peered":"2024-05-07T14:00:55.974335+0000","last_unstale":"2024-05-07T14:01:21.660726+0000","last_undegraded":"2024-05-07T14:01:21.660726+0000","last_fullsized":"2024-05-07T14:01:21.660726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152841+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:01:22.152841+0000","last_peered":"2024-05-07T14:01:22.152841+0000","last_clean":"2024-05-07T14:01:22.152841+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:01:22.152841+0000","last_undegraded":"2024-05-07T14:01:22.152841+0000","last_fullsized":"2024-05-07T14:01:22.152841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154625+0000","last_change":"2024-05-07T14:01:01.993679+0000","last_active":"2024-05-07T14:01:22.154625+0000","last_peered":"2024-05-07T14:01:22.154625+0000","last_clean":"2024-05-07T14:01:22.154625+0000","last_became_active":"2024-05-07T14:01:01.993241+0000","last_became_peered":"2024-05-07T14:01:01.993241+0000","last_unstale":"2024-05-07T14:01:22.154625+0000","last_undegraded":"2024-05-07T14:01:22.154625+0000","last_fullsized":"2024-05-07T14:01:22.154625+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.662948+0000","last_change":"2024-05-07T14:01:04.017472+0000","last_active":"2024-05-07T14:01:21.662948+0000","last_peered":"2024-05-07T14:01:21.662948+0000","last_clean":"2024-05-07T14:01:21.662948+0000","last_became_active":"2024-05-07T14:01:04.016757+0000","last_became_peered":"2024-05-07T14:01:04.016757+0000","last_unstale":"2024-05-07T14:01:21.662948+0000","last_undegraded":"2024-05-07T14:01:21.662948+0000","last_fullsized":"2024-05-07T14:01:21.662948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150021+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:01:22.150021+0000","last_peered":"2024-05-07T14:01:22.150021+0000","last_clean":"2024-05-07T14:01:22.150021+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:01:22.150021+0000","last_undegraded":"2024-05-07T14:01:22.150021+0000","last_fullsized":"2024-05-07T14:01:22.150021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152331+0000","last_change":"2024-05-07T14:00:57.984789+0000","last_active":"2024-05-07T14:01:22.152331+0000","last_peered":"2024-05-07T14:01:22.152331+0000","last_clean":"2024-05-07T14:01:22.152331+0000","last_became_active":"2024-05-07T14:00:57.983524+0000","last_became_peered":"2024-05-07T14:00:57.983524+0000","last_unstale":"2024-05-07T14:01:22.152331+0000","last_undegraded":"2024-05-07T14:01:22.152331+0000","last_fullsized":"2024-05-07T14:01:22.152331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158625+0000","last_change":"2024-05-07T14:00:55.989797+0000","last_active":"2024-05-07T14:01:22.158625+0000","last_peered":"2024-05-07T14:01:22.158625+0000","last_clean":"2024-05-07T14:01:22.158625+0000","last_became_active":"2024-05-07T14:00:55.989449+0000","last_became_peered":"2024-05-07T14:00:55.989449+0000","last_unstale":"2024-05-07T14:01:22.158625+0000","last_undegraded":"2024-05-07T14:01:22.158625+0000","last_fullsized":"2024-05-07T14:01:22.158625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657985+0000","last_change":"2024-05-07T14:00:59.983880+0000","last_active":"2024-05-07T14:01:21.657985+0000","last_peered":"2024-05-07T14:01:21.657985+0000","last_clean":"2024-05-07T14:01:21.657985+0000","last_became_active":"2024-05-07T14:00:59.983186+0000","last_became_peered":"2024-05-07T14:00:59.983186+0000","last_unstale":"2024-05-07T14:01:21.657985+0000","last_undegraded":"2024-05-07T14:01:21.657985+0000","last_fullsized":"2024-05-07T14:01:21.657985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:27.067433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658250+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:01:21.658250+0000","last_peered":"2024-05-07T14:01:21.658250+0000","last_clean":"2024-05-07T14:01:21.658250+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:01:21.658250+0000","last_undegraded":"2024-05-07T14:01:21.658250+0000","last_fullsized":"2024-05-07T14:01:21.658250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660422+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:01:21.660422+0000","last_peered":"2024-05-07T14:01:21.660422+0000","last_clean":"2024-05-07T14:01:21.660422+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:01:21.660422+0000","last_undegraded":"2024-05-07T14:01:21.660422+0000","last_fullsized":"2024-05-07T14:01:21.660422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156973+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:01:22.156973+0000","last_peered":"2024-05-07T14:01:22.156973+0000","last_clean":"2024-05-07T14:01:22.156973+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:01:22.156973+0000","last_undegraded":"2024-05-07T14:01:22.156973+0000","last_fullsized":"2024-05-07T14:01:22.156973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152356+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:01:22.152356+0000","last_peered":"2024-05-07T14:01:22.152356+0000","last_clean":"2024-05-07T14:01:22.152356+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:01:22.152356+0000","last_undegraded":"2024-05-07T14:01:22.152356+0000","last_fullsized":"2024-05-07T14:01:22.152356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659583+0000","last_change":"2024-05-07T14:00:55.986233+0000","last_active":"2024-05-07T14:01:21.659583+0000","last_peered":"2024-05-07T14:01:21.659583+0000","last_clean":"2024-05-07T14:01:21.659583+0000","last_became_active":"2024-05-07T14:00:55.984927+0000","last_became_peered":"2024-05-07T14:00:55.984927+0000","last_unstale":"2024-05-07T14:01:21.659583+0000","last_undegraded":"2024-05-07T14:01:21.659583+0000","last_fullsized":"2024-05-07T14:01:21.659583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658521+0000","last_change":"2024-05-07T14:00:59.992166+0000","last_active":"2024-05-07T14:01:21.658521+0000","last_peered":"2024-05-07T14:01:21.658521+0000","last_clean":"2024-05-07T14:01:21.658521+0000","last_became_active":"2024-05-07T14:00:59.991408+0000","last_became_peered":"2024-05-07T14:00:59.991408+0000","last_unstale":"2024-05-07T14:01:21.658521+0000","last_undegraded":"2024-05-07T14:01:21.658521+0000","last_fullsized":"2024-05-07T14:01:21.658521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156809+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:01:22.156809+0000","last_peered":"2024-05-07T14:01:22.156809+0000","last_clean":"2024-05-07T14:01:22.156809+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:01:22.156809+0000","last_undegraded":"2024-05-07T14:01:22.156809+0000","last_fullsized":"2024-05-07T14:01:22.156809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661139+0000","last_change":"2024-05-07T14:01:04.007238+0000","last_active":"2024-05-07T14:01:21.661139+0000","last_peered":"2024-05-07T14:01:21.661139+0000","last_clean":"2024-05-07T14:01:21.661139+0000","last_became_active":"2024-05-07T14:01:04.006204+0000","last_became_peered":"2024-05-07T14:01:04.006204+0000","last_unstale":"2024-05-07T14:01:21.661139+0000","last_undegraded":"2024-05-07T14:01:21.661139+0000","last_fullsized":"2024-05-07T14:01:21.661139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657404+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:01:21.657404+0000","last_peered":"2024-05-07T14:01:21.657404+0000","last_clean":"2024-05-07T14:01:21.657404+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:01:21.657404+0000","last_undegraded":"2024-05-07T14:01:21.657404+0000","last_fullsized":"2024-05-07T14:01:21.657404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658257+0000","last_change":"2024-05-07T14:00:57.998824+0000","last_active":"2024-05-07T14:01:21.658257+0000","last_peered":"2024-05-07T14:01:21.658257+0000","last_clean":"2024-05-07T14:01:21.658257+0000","last_became_active":"2024-05-07T14:00:57.998316+0000","last_became_peered":"2024-05-07T14:00:57.998316+0000","last_unstale":"2024-05-07T14:01:21.658257+0000","last_undegraded":"2024-05-07T14:01:21.658257+0000","last_fullsized":"2024-05-07T14:01:21.658257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151594+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:01:22.151594+0000","last_peered":"2024-05-07T14:01:22.151594+0000","last_clean":"2024-05-07T14:01:22.151594+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:01:22.151594+0000","last_undegraded":"2024-05-07T14:01:22.151594+0000","last_fullsized":"2024-05-07T14:01:22.151594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152057+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:01:22.152057+0000","last_peered":"2024-05-07T14:01:22.152057+0000","last_clean":"2024-05-07T14:01:22.152057+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:01:22.152057+0000","last_undegraded":"2024-05-07T14:01:22.152057+0000","last_fullsized":"2024-05-07T14:01:22.152057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661401+0000","last_change":"2024-05-07T14:01:02.151107+0000","last_active":"2024-05-07T14:01:21.661401+0000","last_peered":"2024-05-07T14:01:21.661401+0000","last_clean":"2024-05-07T14:01:21.661401+0000","last_became_active":"2024-05-07T14:01:02.150351+0000","last_became_peered":"2024-05-07T14:01:02.150351+0000","last_unstale":"2024-05-07T14:01:21.661401+0000","last_undegraded":"2024-05-07T14:01:21.661401+0000","last_fullsized":"2024-05-07T14:01:21.661401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:28:13.159757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657803+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:01:21.657803+0000","last_peered":"2024-05-07T14:01:21.657803+0000","last_clean":"2024-05-07T14:01:21.657803+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:01:21.657803+0000","last_undegraded":"2024-05-07T14:01:21.657803+0000","last_fullsized":"2024-05-07T14:01:21.657803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.149686+0000","last_change":"2024-05-07T14:00:57.979757+0000","last_active":"2024-05-07T14:01:22.149686+0000","last_peered":"2024-05-07T14:01:22.149686+0000","last_clean":"2024-05-07T14:01:22.149686+0000","last_became_active":"2024-05-07T14:00:57.979030+0000","last_became_peered":"2024-05-07T14:00:57.979030+0000","last_unstale":"2024-05-07T14:01:22.149686+0000","last_undegraded":"2024-05-07T14:01:22.149686+0000","last_fullsized":"2024-05-07T14:01:22.149686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.663399+0000","last_change":"2024-05-07T14:00:55.980339+0000","last_active":"2024-05-07T14:01:21.663399+0000","last_peered":"2024-05-07T14:01:21.663399+0000","last_clean":"2024-05-07T14:01:21.663399+0000","last_became_active":"2024-05-07T14:00:55.979609+0000","last_became_peered":"2024-05-07T14:00:55.979609+0000","last_unstale":"2024-05-07T14:01:21.663399+0000","last_undegraded":"2024-05-07T14:01:21.663399+0000","last_fullsized":"2024-05-07T14:01:21.663399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:52.518278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659139+0000","last_change":"2024-05-07T14:00:59.982771+0000","last_active":"2024-05-07T14:01:21.659139+0000","last_peered":"2024-05-07T14:01:21.659139+0000","last_clean":"2024-05-07T14:01:21.659139+0000","last_became_active":"2024-05-07T14:00:59.982018+0000","last_became_peered":"2024-05-07T14:00:59.982018+0000","last_unstale":"2024-05-07T14:01:21.659139+0000","last_undegraded":"2024-05-07T14:01:21.659139+0000","last_fullsized":"2024-05-07T14:01:21.659139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:47.657483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150103+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:01:22.150103+0000","last_peered":"2024-05-07T14:01:22.150103+0000","last_clean":"2024-05-07T14:01:22.150103+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:01:22.150103+0000","last_undegraded":"2024-05-07T14:01:22.150103+0000","last_fullsized":"2024-05-07T14:01:22.150103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156994+0000","last_change":"2024-05-07T14:01:04.021895+0000","last_active":"2024-05-07T14:01:22.156994+0000","last_peered":"2024-05-07T14:01:22.156994+0000","last_clean":"2024-05-07T14:01:22.156994+0000","last_became_active":"2024-05-07T14:01:04.021043+0000","last_became_peered":"2024-05-07T14:01:04.021043+0000","last_unstale":"2024-05-07T14:01:22.156994+0000","last_undegraded":"2024-05-07T14:01:22.156994+0000","last_fullsized":"2024-05-07T14:01:22.156994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:58.601458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.149826+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:01:22.149826+0000","last_peered":"2024-05-07T14:01:22.149826+0000","last_clean":"2024-05-07T14:01:22.149826+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:01:22.149826+0000","last_undegraded":"2024-05-07T14:01:22.149826+0000","last_fullsized":"2024-05-07T14:01:22.149826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657349+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:01:21.657349+0000","last_peered":"2024-05-07T14:01:21.657349+0000","last_clean":"2024-05-07T14:01:21.657349+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:01:21.657349+0000","last_undegraded":"2024-05-07T14:01:21.657349+0000","last_fullsized":"2024-05-07T14:01:21.657349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.662691+0000","last_change":"2024-05-07T14:00:55.980488+0000","last_active":"2024-05-07T14:01:21.662691+0000","last_peered":"2024-05-07T14:01:21.662691+0000","last_clean":"2024-05-07T14:01:21.662691+0000","last_became_active":"2024-05-07T14:00:55.979688+0000","last_became_peered":"2024-05-07T14:00:55.979688+0000","last_unstale":"2024-05-07T14:01:21.662691+0000","last_undegraded":"2024-05-07T14:01:21.662691+0000","last_fullsized":"2024-05-07T14:01:21.662691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:32.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152520+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:01:22.152520+0000","last_peered":"2024-05-07T14:01:22.152520+0000","last_clean":"2024-05-07T14:01:22.152520+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:01:22.152520+0000","last_undegraded":"2024-05-07T14:01:22.152520+0000","last_fullsized":"2024-05-07T14:01:22.152520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657262+0000","last_change":"2024-05-07T14:01:02.014265+0000","last_active":"2024-05-07T14:01:21.657262+0000","last_peered":"2024-05-07T14:01:21.657262+0000","last_clean":"2024-05-07T14:01:21.657262+0000","last_became_active":"2024-05-07T14:01:02.009335+0000","last_became_peered":"2024-05-07T14:01:02.009335+0000","last_unstale":"2024-05-07T14:01:21.657262+0000","last_undegraded":"2024-05-07T14:01:21.657262+0000","last_fullsized":"2024-05-07T14:01:21.657262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.655986+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:01:21.655986+0000","last_peered":"2024-05-07T14:01:21.655986+0000","last_clean":"2024-05-07T14:01:21.655986+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:01:21.655986+0000","last_undegraded":"2024-05-07T14:01:21.655986+0000","last_fullsized":"2024-05-07T14:01:21.655986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152385+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:01:22.152385+0000","last_peered":"2024-05-07T14:01:22.152385+0000","last_clean":"2024-05-07T14:01:22.152385+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:01:22.152385+0000","last_undegraded":"2024-05-07T14:01:22.152385+0000","last_fullsized":"2024-05-07T14:01:22.152385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151184+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:01:22.151184+0000","last_peered":"2024-05-07T14:01:22.151184+0000","last_clean":"2024-05-07T14:01:22.151184+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:01:22.151184+0000","last_undegraded":"2024-05-07T14:01:22.151184+0000","last_fullsized":"2024-05-07T14:01:22.151184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661807+0000","last_change":"2024-05-07T14:00:56.008026+0000","last_active":"2024-05-07T14:01:21.661807+0000","last_peered":"2024-05-07T14:01:21.661807+0000","last_clean":"2024-05-07T14:01:21.661807+0000","last_became_active":"2024-05-07T14:00:56.007374+0000","last_became_peered":"2024-05-07T14:00:56.007374+0000","last_unstale":"2024-05-07T14:01:21.661807+0000","last_undegraded":"2024-05-07T14:01:21.661807+0000","last_fullsized":"2024-05-07T14:01:21.661807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156062+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:01:22.156062+0000","last_peered":"2024-05-07T14:01:22.156062+0000","last_clean":"2024-05-07T14:01:22.156062+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:01:22.156062+0000","last_undegraded":"2024-05-07T14:01:22.156062+0000","last_fullsized":"2024-05-07T14:01:22.156062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659424+0000","last_change":"2024-05-07T14:01:01.997489+0000","last_active":"2024-05-07T14:01:21.659424+0000","last_peered":"2024-05-07T14:01:21.659424+0000","last_clean":"2024-05-07T14:01:21.659424+0000","last_became_active":"2024-05-07T14:01:01.994656+0000","last_became_peered":"2024-05-07T14:01:01.994656+0000","last_unstale":"2024-05-07T14:01:21.659424+0000","last_undegraded":"2024-05-07T14:01:21.659424+0000","last_fullsized":"2024-05-07T14:01:21.659424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:12.091721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154100+0000","last_change":"2024-05-07T14:01:04.009157+0000","last_active":"2024-05-07T14:01:22.154100+0000","last_peered":"2024-05-07T14:01:22.154100+0000","last_clean":"2024-05-07T14:01:22.154100+0000","last_became_active":"2024-05-07T14:01:04.008594+0000","last_became_peered":"2024-05-07T14:01:04.008594+0000","last_unstale":"2024-05-07T14:01:22.154100+0000","last_undegraded":"2024-05-07T14:01:22.154100+0000","last_fullsized":"2024-05-07T14:01:22.154100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153778+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:01:22.153778+0000","last_peered":"2024-05-07T14:01:22.153778+0000","last_clean":"2024-05-07T14:01:22.153778+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:01:22.153778+0000","last_undegraded":"2024-05-07T14:01:22.153778+0000","last_fullsized":"2024-05-07T14:01:22.153778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.155966+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:01:22.155966+0000","last_peered":"2024-05-07T14:01:22.155966+0000","last_clean":"2024-05-07T14:01:22.155966+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:01:22.155966+0000","last_undegraded":"2024-05-07T14:01:22.155966+0000","last_fullsized":"2024-05-07T14:01:22.155966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152157+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:01:22.152157+0000","last_peered":"2024-05-07T14:01:22.152157+0000","last_clean":"2024-05-07T14:01:22.152157+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:01:22.152157+0000","last_undegraded":"2024-05-07T14:01:22.152157+0000","last_fullsized":"2024-05-07T14:01:22.152157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152557+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:01:22.152557+0000","last_peered":"2024-05-07T14:01:22.152557+0000","last_clean":"2024-05-07T14:01:22.152557+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:01:22.152557+0000","last_undegraded":"2024-05-07T14:01:22.152557+0000","last_fullsized":"2024-05-07T14:01:22.152557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154635+0000","last_change":"2024-05-07T14:01:01.995144+0000","last_active":"2024-05-07T14:01:22.154635+0000","last_peered":"2024-05-07T14:01:22.154635+0000","last_clean":"2024-05-07T14:01:22.154635+0000","last_became_active":"2024-05-07T14:01:01.993073+0000","last_became_peered":"2024-05-07T14:01:01.993073+0000","last_unstale":"2024-05-07T14:01:22.154635+0000","last_undegraded":"2024-05-07T14:01:22.154635+0000","last_fullsized":"2024-05-07T14:01:22.154635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:54.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152124+0000","last_change":"2024-05-07T14:01:04.012216+0000","last_active":"2024-05-07T14:01:22.152124+0000","last_peered":"2024-05-07T14:01:22.152124+0000","last_clean":"2024-05-07T14:01:22.152124+0000","last_became_active":"2024-05-07T14:01:04.011476+0000","last_became_peered":"2024-05-07T14:01:04.011476+0000","last_unstale":"2024-05-07T14:01:22.152124+0000","last_undegraded":"2024-05-07T14:01:22.152124+0000","last_fullsized":"2024-05-07T14:01:22.152124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:46.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152623+0000","last_change":"2024-05-07T14:01:06.024311+0000","last_active":"2024-05-07T14:01:22.152623+0000","last_peered":"2024-05-07T14:01:22.152623+0000","last_clean":"2024-05-07T14:01:22.152623+0000","last_became_active":"2024-05-07T14:01:06.023404+0000","last_became_peered":"2024-05-07T14:01:06.023404+0000","last_unstale":"2024-05-07T14:01:22.152623+0000","last_undegraded":"2024-05-07T14:01:22.152623+0000","last_fullsized":"2024-05-07T14:01:22.152623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:26.544302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658720+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:01:21.658720+0000","last_peered":"2024-05-07T14:01:21.658720+0000","last_clean":"2024-05-07T14:01:21.658720+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:01:21.658720+0000","last_undegraded":"2024-05-07T14:01:21.658720+0000","last_fullsized":"2024-05-07T14:01:21.658720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656107+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:01:21.656107+0000","last_peered":"2024-05-07T14:01:21.656107+0000","last_clean":"2024-05-07T14:01:21.656107+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:01:21.656107+0000","last_undegraded":"2024-05-07T14:01:21.656107+0000","last_fullsized":"2024-05-07T14:01:21.656107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157867+0000","last_change":"2024-05-07T14:00:59.992897+0000","last_active":"2024-05-07T14:01:22.157867+0000","last_peered":"2024-05-07T14:01:22.157867+0000","last_clean":"2024-05-07T14:01:22.157867+0000","last_became_active":"2024-05-07T14:00:59.992067+0000","last_became_peered":"2024-05-07T14:00:59.992067+0000","last_unstale":"2024-05-07T14:01:22.157867+0000","last_undegraded":"2024-05-07T14:01:22.157867+0000","last_fullsized":"2024-05-07T14:01:22.157867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:19.526884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659025+0000","last_change":"2024-05-07T14:01:02.012335+0000","last_active":"2024-05-07T14:01:21.659025+0000","last_peered":"2024-05-07T14:01:21.659025+0000","last_clean":"2024-05-07T14:01:21.659025+0000","last_became_active":"2024-05-07T14:01:02.011651+0000","last_became_peered":"2024-05-07T14:01:02.011651+0000","last_unstale":"2024-05-07T14:01:21.659025+0000","last_undegraded":"2024-05-07T14:01:21.659025+0000","last_fullsized":"2024-05-07T14:01:21.659025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162609+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:01:22.162609+0000","last_peered":"2024-05-07T14:01:22.162609+0000","last_clean":"2024-05-07T14:01:22.162609+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:01:22.162609+0000","last_undegraded":"2024-05-07T14:01:22.162609+0000","last_fullsized":"2024-05-07T14:01:22.162609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656914+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:01:21.656914+0000","last_peered":"2024-05-07T14:01:21.656914+0000","last_clean":"2024-05-07T14:01:21.656914+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:01:21.656914+0000","last_undegraded":"2024-05-07T14:01:21.656914+0000","last_fullsized":"2024-05-07T14:01:21.656914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661005+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:01:21.661005+0000","last_peered":"2024-05-07T14:01:21.661005+0000","last_clean":"2024-05-07T14:01:21.661005+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:01:21.661005+0000","last_undegraded":"2024-05-07T14:01:21.661005+0000","last_fullsized":"2024-05-07T14:01:21.661005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151376+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:01:22.151376+0000","last_peered":"2024-05-07T14:01:22.151376+0000","last_clean":"2024-05-07T14:01:22.151376+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:01:22.151376+0000","last_undegraded":"2024-05-07T14:01:22.151376+0000","last_fullsized":"2024-05-07T14:01:22.151376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157558+0000","last_change":"2024-05-07T14:01:00.006802+0000","last_active":"2024-05-07T14:01:22.157558+0000","last_peered":"2024-05-07T14:01:22.157558+0000","last_clean":"2024-05-07T14:01:22.157558+0000","last_became_active":"2024-05-07T14:01:00.006254+0000","last_became_peered":"2024-05-07T14:01:00.006254+0000","last_unstale":"2024-05-07T14:01:22.157558+0000","last_undegraded":"2024-05-07T14:01:22.157558+0000","last_fullsized":"2024-05-07T14:01:22.157558+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:40.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159760+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:01:22.159760+0000","last_peered":"2024-05-07T14:01:22.159760+0000","last_clean":"2024-05-07T14:01:22.159760+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:01:22.159760+0000","last_undegraded":"2024-05-07T14:01:22.159760+0000","last_fullsized":"2024-05-07T14:01:22.159760+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159051+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:01:22.159051+0000","last_peered":"2024-05-07T14:01:22.159051+0000","last_clean":"2024-05-07T14:01:22.159051+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:01:22.159051+0000","last_undegraded":"2024-05-07T14:01:22.159051+0000","last_fullsized":"2024-05-07T14:01:22.159051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.155516+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:01:22.155516+0000","last_peered":"2024-05-07T14:01:22.155516+0000","last_clean":"2024-05-07T14:01:22.155516+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:01:22.155516+0000","last_undegraded":"2024-05-07T14:01:22.155516+0000","last_fullsized":"2024-05-07T14:01:22.155516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659958+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:01:21.659958+0000","last_peered":"2024-05-07T14:01:21.659958+0000","last_clean":"2024-05-07T14:01:21.659958+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:01:21.659958+0000","last_undegraded":"2024-05-07T14:01:21.659958+0000","last_fullsized":"2024-05-07T14:01:21.659958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657813+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:01:21.657813+0000","last_peered":"2024-05-07T14:01:21.657813+0000","last_clean":"2024-05-07T14:01:21.657813+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:01:21.657813+0000","last_undegraded":"2024-05-07T14:01:21.657813+0000","last_fullsized":"2024-05-07T14:01:21.657813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152627+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:01:22.152627+0000","last_peered":"2024-05-07T14:01:22.152627+0000","last_clean":"2024-05-07T14:01:22.152627+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:01:22.152627+0000","last_undegraded":"2024-05-07T14:01:22.152627+0000","last_fullsized":"2024-05-07T14:01:22.152627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657844+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:01:21.657844+0000","last_peered":"2024-05-07T14:01:21.657844+0000","last_clean":"2024-05-07T14:01:21.657844+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:01:21.657844+0000","last_undegraded":"2024-05-07T14:01:21.657844+0000","last_fullsized":"2024-05-07T14:01:21.657844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152563+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:01:22.152563+0000","last_peered":"2024-05-07T14:01:22.152563+0000","last_clean":"2024-05-07T14:01:22.152563+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:01:22.152563+0000","last_undegraded":"2024-05-07T14:01:22.152563+0000","last_fullsized":"2024-05-07T14:01:22.152563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656902+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:01:21.656902+0000","last_peered":"2024-05-07T14:01:21.656902+0000","last_clean":"2024-05-07T14:01:21.656902+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:01:21.656902+0000","last_undegraded":"2024-05-07T14:01:21.656902+0000","last_fullsized":"2024-05-07T14:01:21.656902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151419+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:01:22.151419+0000","last_peered":"2024-05-07T14:01:22.151419+0000","last_clean":"2024-05-07T14:01:22.151419+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:01:22.151419+0000","last_undegraded":"2024-05-07T14:01:22.151419+0000","last_fullsized":"2024-05-07T14:01:22.151419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656761+0000","last_change":"2024-05-07T14:00:55.974435+0000","last_active":"2024-05-07T14:01:21.656761+0000","last_peered":"2024-05-07T14:01:21.656761+0000","last_clean":"2024-05-07T14:01:21.656761+0000","last_became_active":"2024-05-07T14:00:55.974010+0000","last_became_peered":"2024-05-07T14:00:55.974010+0000","last_unstale":"2024-05-07T14:01:21.656761+0000","last_undegraded":"2024-05-07T14:01:21.656761+0000","last_fullsized":"2024-05-07T14:01:21.656761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659535+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:01:21.659535+0000","last_peered":"2024-05-07T14:01:21.659535+0000","last_clean":"2024-05-07T14:01:21.659535+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:01:21.659535+0000","last_undegraded":"2024-05-07T14:01:21.659535+0000","last_fullsized":"2024-05-07T14:01:21.659535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152730+0000","last_change":"2024-05-07T14:01:02.013314+0000","last_active":"2024-05-07T14:01:22.152730+0000","last_peered":"2024-05-07T14:01:22.152730+0000","last_clean":"2024-05-07T14:01:22.152730+0000","last_became_active":"2024-05-07T14:01:02.012667+0000","last_became_peered":"2024-05-07T14:01:02.012667+0000","last_unstale":"2024-05-07T14:01:22.152730+0000","last_undegraded":"2024-05-07T14:01:22.152730+0000","last_fullsized":"2024-05-07T14:01:22.152730+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151522+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:01:22.151522+0000","last_peered":"2024-05-07T14:01:22.151522+0000","last_clean":"2024-05-07T14:01:22.151522+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:01:22.151522+0000","last_undegraded":"2024-05-07T14:01:22.151522+0000","last_fullsized":"2024-05-07T14:01:22.151522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156746+0000","last_change":"2024-05-07T14:01:06.031381+0000","last_active":"2024-05-07T14:01:22.156746+0000","last_peered":"2024-05-07T14:01:22.156746+0000","last_clean":"2024-05-07T14:01:22.156746+0000","last_became_active":"2024-05-07T14:01:06.030958+0000","last_became_peered":"2024-05-07T14:01:06.030958+0000","last_unstale":"2024-05-07T14:01:22.156746+0000","last_undegraded":"2024-05-07T14:01:22.156746+0000","last_fullsized":"2024-05-07T14:01:22.156746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:26.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152273+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:01:22.152273+0000","last_peered":"2024-05-07T14:01:22.152273+0000","last_clean":"2024-05-07T14:01:22.152273+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:01:22.152273+0000","last_undegraded":"2024-05-07T14:01:22.152273+0000","last_fullsized":"2024-05-07T14:01:22.152273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":208,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659671+0000","last_change":"2024-05-07T14:00:45.460158+0000","last_active":"2024-05-07T14:01:21.659671+0000","last_peered":"2024-05-07T14:01:21.659671+0000","last_clean":"2024-05-07T14:01:21.659671+0000","last_became_active":"2024-05-07T14:00:45.458198+0000","last_became_peered":"2024-05-07T14:00:45.458198+0000","last_unstale":"2024-05-07T14:01:21.659671+0000","last_undegraded":"2024-05-07T14:01:21.659671+0000","last_fullsized":"2024-05-07T14:01:21.659671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:18.582514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151030+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:01:22.151030+0000","last_peered":"2024-05-07T14:01:22.151030+0000","last_clean":"2024-05-07T14:01:22.151030+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:01:22.151030+0000","last_undegraded":"2024-05-07T14:01:22.151030+0000","last_fullsized":"2024-05-07T14:01:22.151030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656596+0000","last_change":"2024-05-07T14:00:56.012396+0000","last_active":"2024-05-07T14:01:21.656596+0000","last_peered":"2024-05-07T14:01:21.656596+0000","last_clean":"2024-05-07T14:01:21.656596+0000","last_became_active":"2024-05-07T14:00:56.012053+0000","last_became_peered":"2024-05-07T14:00:56.012053+0000","last_unstale":"2024-05-07T14:01:21.656596+0000","last_undegraded":"2024-05-07T14:01:21.656596+0000","last_fullsized":"2024-05-07T14:01:21.656596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661303+0000","last_change":"2024-05-07T14:00:59.988489+0000","last_active":"2024-05-07T14:01:21.661303+0000","last_peered":"2024-05-07T14:01:21.661303+0000","last_clean":"2024-05-07T14:01:21.661303+0000","last_became_active":"2024-05-07T14:00:59.987757+0000","last_became_peered":"2024-05-07T14:00:59.987757+0000","last_unstale":"2024-05-07T14:01:21.661303+0000","last_undegraded":"2024-05-07T14:01:21.661303+0000","last_fullsized":"2024-05-07T14:01:21.661303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":61,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152867+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:01:22.152867+0000","last_peered":"2024-05-07T14:01:22.152867+0000","last_clean":"2024-05-07T14:01:22.152867+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:01:22.152867+0000","last_undegraded":"2024-05-07T14:01:22.152867+0000","last_fullsized":"2024-05-07T14:01:22.152867+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154990+0000","last_change":"2024-05-07T14:01:04.007712+0000","last_active":"2024-05-07T14:01:22.154990+0000","last_peered":"2024-05-07T14:01:22.154990+0000","last_clean":"2024-05-07T14:01:22.154990+0000","last_became_active":"2024-05-07T14:01:04.006934+0000","last_became_peered":"2024-05-07T14:01:04.006934+0000","last_unstale":"2024-05-07T14:01:22.154990+0000","last_undegraded":"2024-05-07T14:01:22.154990+0000","last_fullsized":"2024-05-07T14:01:22.154990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151057+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:01:22.151057+0000","last_peered":"2024-05-07T14:01:22.151057+0000","last_clean":"2024-05-07T14:01:22.151057+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:01:22.151057+0000","last_undegraded":"2024-05-07T14:01:22.151057+0000","last_fullsized":"2024-05-07T14:01:22.151057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152742+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:01:22.152742+0000","last_peered":"2024-05-07T14:01:22.152742+0000","last_clean":"2024-05-07T14:01:22.152742+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:01:22.152742+0000","last_undegraded":"2024-05-07T14:01:22.152742+0000","last_fullsized":"2024-05-07T14:01:22.152742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659197+0000","last_change":"2024-05-07T14:00:49.930222+0000","last_active":"2024-05-07T14:01:21.659197+0000","last_peered":"2024-05-07T14:01:21.659197+0000","last_clean":"2024-05-07T14:01:21.659197+0000","last_became_active":"2024-05-07T14:00:49.929538+0000","last_became_peered":"2024-05-07T14:00:49.929538+0000","last_unstale":"2024-05-07T14:01:21.659197+0000","last_undegraded":"2024-05-07T14:01:21.659197+0000","last_fullsized":"2024-05-07T14:01:21.659197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:43.069683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154649+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:01:22.154649+0000","last_peered":"2024-05-07T14:01:22.154649+0000","last_clean":"2024-05-07T14:01:22.154649+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:01:22.154649+0000","last_undegraded":"2024-05-07T14:01:22.154649+0000","last_fullsized":"2024-05-07T14:01:22.154649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153091+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:01:22.153091+0000","last_peered":"2024-05-07T14:01:22.153091+0000","last_clean":"2024-05-07T14:01:22.153091+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:01:22.153091+0000","last_undegraded":"2024-05-07T14:01:22.153091+0000","last_fullsized":"2024-05-07T14:01:22.153091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":79,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156801+0000","last_change":"2024-05-07T14:01:02.014645+0000","last_active":"2024-05-07T14:01:22.156801+0000","last_peered":"2024-05-07T14:01:22.156801+0000","last_clean":"2024-05-07T14:01:22.156801+0000","last_became_active":"2024-05-07T14:01:02.013904+0000","last_became_peered":"2024-05-07T14:01:02.013904+0000","last_unstale":"2024-05-07T14:01:22.156801+0000","last_undegraded":"2024-05-07T14:01:22.156801+0000","last_fullsized":"2024-05-07T14:01:22.156801+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:31.441743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661318+0000","last_change":"2024-05-07T14:01:04.012527+0000","last_active":"2024-05-07T14:01:21.661318+0000","last_peered":"2024-05-07T14:01:21.661318+0000","last_clean":"2024-05-07T14:01:21.661318+0000","last_became_active":"2024-05-07T14:01:04.007658+0000","last_became_peered":"2024-05-07T14:01:04.007658+0000","last_unstale":"2024-05-07T14:01:21.661318+0000","last_undegraded":"2024-05-07T14:01:21.661318+0000","last_fullsized":"2024-05-07T14:01:21.661318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156509+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:01:22.156509+0000","last_peered":"2024-05-07T14:01:22.156509+0000","last_clean":"2024-05-07T14:01:22.156509+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:01:22.156509+0000","last_undegraded":"2024-05-07T14:01:22.156509+0000","last_fullsized":"2024-05-07T14:01:22.156509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.160061+0000","last_change":"2024-05-07T14:00:57.989314+0000","last_active":"2024-05-07T14:01:22.160061+0000","last_peered":"2024-05-07T14:01:22.160061+0000","last_clean":"2024-05-07T14:01:22.160061+0000","last_became_active":"2024-05-07T14:00:57.988994+0000","last_became_peered":"2024-05-07T14:00:57.988994+0000","last_unstale":"2024-05-07T14:01:22.160061+0000","last_undegraded":"2024-05-07T14:01:22.160061+0000","last_fullsized":"2024-05-07T14:01:22.160061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153909+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:01:22.153909+0000","last_peered":"2024-05-07T14:01:22.153909+0000","last_clean":"2024-05-07T14:01:22.153909+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:01:22.153909+0000","last_undegraded":"2024-05-07T14:01:22.153909+0000","last_fullsized":"2024-05-07T14:01:22.153909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.155673+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:01:22.155673+0000","last_peered":"2024-05-07T14:01:22.155673+0000","last_clean":"2024-05-07T14:01:22.155673+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:01:22.155673+0000","last_undegraded":"2024-05-07T14:01:22.155673+0000","last_fullsized":"2024-05-07T14:01:22.155673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159194+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:01:22.159194+0000","last_peered":"2024-05-07T14:01:22.159194+0000","last_clean":"2024-05-07T14:01:22.159194+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:01:22.159194+0000","last_undegraded":"2024-05-07T14:01:22.159194+0000","last_fullsized":"2024-05-07T14:01:22.159194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661581+0000","last_change":"2024-05-07T14:01:02.148182+0000","last_active":"2024-05-07T14:01:21.661581+0000","last_peered":"2024-05-07T14:01:21.661581+0000","last_clean":"2024-05-07T14:01:21.661581+0000","last_became_active":"2024-05-07T14:01:02.147442+0000","last_became_peered":"2024-05-07T14:01:02.147442+0000","last_unstale":"2024-05-07T14:01:21.661581+0000","last_undegraded":"2024-05-07T14:01:21.661581+0000","last_fullsized":"2024-05-07T14:01:21.661581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:24.955989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154644+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:01:22.154644+0000","last_peered":"2024-05-07T14:01:22.154644+0000","last_clean":"2024-05-07T14:01:22.154644+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:01:22.154644+0000","last_undegraded":"2024-05-07T14:01:22.154644+0000","last_fullsized":"2024-05-07T14:01:22.154644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657140+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:01:21.657140+0000","last_peered":"2024-05-07T14:01:21.657140+0000","last_clean":"2024-05-07T14:01:21.657140+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:01:21.657140+0000","last_undegraded":"2024-05-07T14:01:21.657140+0000","last_fullsized":"2024-05-07T14:01:21.657140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159533+0000","last_change":"2024-05-07T14:00:57.997894+0000","last_active":"2024-05-07T14:01:22.159533+0000","last_peered":"2024-05-07T14:01:22.159533+0000","last_clean":"2024-05-07T14:01:22.159533+0000","last_became_active":"2024-05-07T14:00:57.997336+0000","last_became_peered":"2024-05-07T14:00:57.997336+0000","last_unstale":"2024-05-07T14:01:22.159533+0000","last_undegraded":"2024-05-07T14:01:22.159533+0000","last_fullsized":"2024-05-07T14:01:22.159533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150782+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:01:22.150782+0000","last_peered":"2024-05-07T14:01:22.150782+0000","last_clean":"2024-05-07T14:01:22.150782+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:01:22.150782+0000","last_undegraded":"2024-05-07T14:01:22.150782+0000","last_fullsized":"2024-05-07T14:01:22.150782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658106+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:01:21.658106+0000","last_peered":"2024-05-07T14:01:21.658106+0000","last_clean":"2024-05-07T14:01:21.658106+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:01:21.658106+0000","last_undegraded":"2024-05-07T14:01:21.658106+0000","last_fullsized":"2024-05-07T14:01:21.658106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162338+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:01:22.162338+0000","last_peered":"2024-05-07T14:01:22.162338+0000","last_clean":"2024-05-07T14:01:22.162338+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:01:22.162338+0000","last_undegraded":"2024-05-07T14:01:22.162338+0000","last_fullsized":"2024-05-07T14:01:22.162338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658370+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:01:21.658370+0000","last_peered":"2024-05-07T14:01:21.658370+0000","last_clean":"2024-05-07T14:01:21.658370+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:01:21.658370+0000","last_undegraded":"2024-05-07T14:01:21.658370+0000","last_fullsized":"2024-05-07T14:01:21.658370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152180+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:01:22.152180+0000","last_peered":"2024-05-07T14:01:22.152180+0000","last_clean":"2024-05-07T14:01:22.152180+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:01:22.152180+0000","last_undegraded":"2024-05-07T14:01:22.152180+0000","last_fullsized":"2024-05-07T14:01:22.152180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150079+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:01:22.150079+0000","last_peered":"2024-05-07T14:01:22.150079+0000","last_clean":"2024-05-07T14:01:22.150079+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:01:22.150079+0000","last_undegraded":"2024-05-07T14:01:22.150079+0000","last_fullsized":"2024-05-07T14:01:22.150079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157804+0000","last_change":"2024-05-07T14:00:57.989747+0000","last_active":"2024-05-07T14:01:22.157804+0000","last_peered":"2024-05-07T14:01:22.157804+0000","last_clean":"2024-05-07T14:01:22.157804+0000","last_became_active":"2024-05-07T14:00:57.989252+0000","last_became_peered":"2024-05-07T14:00:57.989252+0000","last_unstale":"2024-05-07T14:01:22.157804+0000","last_undegraded":"2024-05-07T14:01:22.157804+0000","last_fullsized":"2024-05-07T14:01:22.157804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:44.815601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153174+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:01:22.153174+0000","last_peered":"2024-05-07T14:01:22.153174+0000","last_clean":"2024-05-07T14:01:22.153174+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:01:22.153174+0000","last_undegraded":"2024-05-07T14:01:22.153174+0000","last_fullsized":"2024-05-07T14:01:22.153174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156239+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:01:22.156239+0000","last_peered":"2024-05-07T14:01:22.156239+0000","last_clean":"2024-05-07T14:01:22.156239+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:01:22.156239+0000","last_undegraded":"2024-05-07T14:01:22.156239+0000","last_fullsized":"2024-05-07T14:01:22.156239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158411+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:01:22.158411+0000","last_peered":"2024-05-07T14:01:22.158411+0000","last_clean":"2024-05-07T14:01:22.158411+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:01:22.158411+0000","last_undegraded":"2024-05-07T14:01:22.158411+0000","last_fullsized":"2024-05-07T14:01:22.158411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162355+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:01:22.162355+0000","last_peered":"2024-05-07T14:01:22.162355+0000","last_clean":"2024-05-07T14:01:22.162355+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:01:22.162355+0000","last_undegraded":"2024-05-07T14:01:22.162355+0000","last_fullsized":"2024-05-07T14:01:22.162355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656822+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:01:21.656822+0000","last_peered":"2024-05-07T14:01:21.656822+0000","last_clean":"2024-05-07T14:01:21.656822+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:01:21.656822+0000","last_undegraded":"2024-05-07T14:01:21.656822+0000","last_fullsized":"2024-05-07T14:01:21.656822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154117+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:01:22.154117+0000","last_peered":"2024-05-07T14:01:22.154117+0000","last_clean":"2024-05-07T14:01:22.154117+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:01:22.154117+0000","last_undegraded":"2024-05-07T14:01:22.154117+0000","last_fullsized":"2024-05-07T14:01:22.154117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156359+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:01:22.156359+0000","last_peered":"2024-05-07T14:01:22.156359+0000","last_clean":"2024-05-07T14:01:22.156359+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:01:22.156359+0000","last_undegraded":"2024-05-07T14:01:22.156359+0000","last_fullsized":"2024-05-07T14:01:22.156359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159629+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:01:22.159629+0000","last_peered":"2024-05-07T14:01:22.159629+0000","last_clean":"2024-05-07T14:01:22.159629+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:01:22.159629+0000","last_undegraded":"2024-05-07T14:01:22.159629+0000","last_fullsized":"2024-05-07T14:01:22.159629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.662035+0000","last_change":"2024-05-07T14:00:49.928907+0000","last_active":"2024-05-07T14:01:21.662035+0000","last_peered":"2024-05-07T14:01:21.662035+0000","last_clean":"2024-05-07T14:01:21.662035+0000","last_became_active":"2024-05-07T14:00:49.928146+0000","last_became_peered":"2024-05-07T14:00:49.928146+0000","last_unstale":"2024-05-07T14:01:21.662035+0000","last_undegraded":"2024-05-07T14:01:21.662035+0000","last_fullsized":"2024-05-07T14:01:21.662035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:07.032835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150977+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:01:22.150977+0000","last_peered":"2024-05-07T14:01:22.150977+0000","last_clean":"2024-05-07T14:01:22.150977+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:01:22.150977+0000","last_undegraded":"2024-05-07T14:01:22.150977+0000","last_fullsized":"2024-05-07T14:01:22.150977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.155802+0000","last_change":"2024-05-07T14:01:02.148499+0000","last_active":"2024-05-07T14:01:22.155802+0000","last_peered":"2024-05-07T14:01:22.155802+0000","last_clean":"2024-05-07T14:01:22.155802+0000","last_became_active":"2024-05-07T14:01:02.147567+0000","last_became_peered":"2024-05-07T14:01:02.147567+0000","last_unstale":"2024-05-07T14:01:22.155802+0000","last_undegraded":"2024-05-07T14:01:22.155802+0000","last_fullsized":"2024-05-07T14:01:22.155802+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:30.162886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150483+0000","last_change":"2024-05-07T14:01:04.015930+0000","last_active":"2024-05-07T14:01:22.150483+0000","last_peered":"2024-05-07T14:01:22.150483+0000","last_clean":"2024-05-07T14:01:22.150483+0000","last_became_active":"2024-05-07T14:01:04.011643+0000","last_became_peered":"2024-05-07T14:01:04.011643+0000","last_unstale":"2024-05-07T14:01:22.150483+0000","last_undegraded":"2024-05-07T14:01:22.150483+0000","last_fullsized":"2024-05-07T14:01:22.150483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658362+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:01:21.658362+0000","last_peered":"2024-05-07T14:01:21.658362+0000","last_clean":"2024-05-07T14:01:21.658362+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:01:21.658362+0000","last_undegraded":"2024-05-07T14:01:21.658362+0000","last_fullsized":"2024-05-07T14:01:21.658362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656079+0000","last_change":"2024-05-07T14:00:57.998539+0000","last_active":"2024-05-07T14:01:21.656079+0000","last_peered":"2024-05-07T14:01:21.656079+0000","last_clean":"2024-05-07T14:01:21.656079+0000","last_became_active":"2024-05-07T14:00:57.998025+0000","last_became_peered":"2024-05-07T14:00:57.998025+0000","last_unstale":"2024-05-07T14:01:21.656079+0000","last_undegraded":"2024-05-07T14:01:21.656079+0000","last_fullsized":"2024-05-07T14:01:21.656079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658306+0000","last_change":"2024-05-07T14:00:55.988508+0000","last_active":"2024-05-07T14:01:21.658306+0000","last_peered":"2024-05-07T14:01:21.658306+0000","last_clean":"2024-05-07T14:01:21.658306+0000","last_became_active":"2024-05-07T14:00:55.988230+0000","last_became_peered":"2024-05-07T14:00:55.988230+0000","last_unstale":"2024-05-07T14:01:21.658306+0000","last_undegraded":"2024-05-07T14:01:21.658306+0000","last_fullsized":"2024-05-07T14:01:21.658306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159607+0000","last_change":"2024-05-07T14:00:49.936072+0000","last_active":"2024-05-07T14:01:22.159607+0000","last_peered":"2024-05-07T14:01:22.159607+0000","last_clean":"2024-05-07T14:01:22.159607+0000","last_became_active":"2024-05-07T14:00:49.935768+0000","last_became_peered":"2024-05-07T14:00:49.935768+0000","last_unstale":"2024-05-07T14:01:22.159607+0000","last_undegraded":"2024-05-07T14:01:22.159607+0000","last_fullsized":"2024-05-07T14:01:22.159607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657173+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:01:21.657173+0000","last_peered":"2024-05-07T14:01:21.657173+0000","last_clean":"2024-05-07T14:01:21.657173+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:01:21.657173+0000","last_undegraded":"2024-05-07T14:01:21.657173+0000","last_fullsized":"2024-05-07T14:01:21.657173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657088+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:01:21.657088+0000","last_peered":"2024-05-07T14:01:21.657088+0000","last_clean":"2024-05-07T14:01:21.657088+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:01:21.657088+0000","last_undegraded":"2024-05-07T14:01:21.657088+0000","last_fullsized":"2024-05-07T14:01:21.657088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657553+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:01:21.657553+0000","last_peered":"2024-05-07T14:01:21.657553+0000","last_clean":"2024-05-07T14:01:21.657553+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:01:21.657553+0000","last_undegraded":"2024-05-07T14:01:21.657553+0000","last_fullsized":"2024-05-07T14:01:21.657553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153933+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:01:22.153933+0000","last_peered":"2024-05-07T14:01:22.153933+0000","last_clean":"2024-05-07T14:01:22.153933+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:01:22.153933+0000","last_undegraded":"2024-05-07T14:01:22.153933+0000","last_fullsized":"2024-05-07T14:01:22.153933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657591+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:01:21.657591+0000","last_peered":"2024-05-07T14:01:21.657591+0000","last_clean":"2024-05-07T14:01:21.657591+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:01:21.657591+0000","last_undegraded":"2024-05-07T14:01:21.657591+0000","last_fullsized":"2024-05-07T14:01:21.657591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162778+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:01:22.162778+0000","last_peered":"2024-05-07T14:01:22.162778+0000","last_clean":"2024-05-07T14:01:22.162778+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:01:22.162778+0000","last_undegraded":"2024-05-07T14:01:22.162778+0000","last_fullsized":"2024-05-07T14:01:22.162778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150110+0000","last_change":"2024-05-07T14:00:49.938879+0000","last_active":"2024-05-07T14:01:22.150110+0000","last_peered":"2024-05-07T14:01:22.150110+0000","last_clean":"2024-05-07T14:01:22.150110+0000","last_became_active":"2024-05-07T14:00:49.938066+0000","last_became_peered":"2024-05-07T14:00:49.938066+0000","last_unstale":"2024-05-07T14:01:22.150110+0000","last_undegraded":"2024-05-07T14:01:22.150110+0000","last_fullsized":"2024-05-07T14:01:22.150110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.655805+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:01:21.655805+0000","last_peered":"2024-05-07T14:01:21.655805+0000","last_clean":"2024-05-07T14:01:21.655805+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:01:21.655805+0000","last_undegraded":"2024-05-07T14:01:21.655805+0000","last_fullsized":"2024-05-07T14:01:21.655805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":70,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660283+0000","last_change":"2024-05-07T14:01:02.148095+0000","last_active":"2024-05-07T14:01:21.660283+0000","last_peered":"2024-05-07T14:01:21.660283+0000","last_clean":"2024-05-07T14:01:21.660283+0000","last_became_active":"2024-05-07T14:01:02.147334+0000","last_became_peered":"2024-05-07T14:01:02.147334+0000","last_unstale":"2024-05-07T14:01:21.660283+0000","last_undegraded":"2024-05-07T14:01:21.660283+0000","last_fullsized":"2024-05-07T14:01:21.660283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656164+0000","last_change":"2024-05-07T14:01:04.024279+0000","last_active":"2024-05-07T14:01:21.656164+0000","last_peered":"2024-05-07T14:01:21.656164+0000","last_clean":"2024-05-07T14:01:21.656164+0000","last_became_active":"2024-05-07T14:01:04.022870+0000","last_became_peered":"2024-05-07T14:01:04.022870+0000","last_unstale":"2024-05-07T14:01:21.656164+0000","last_undegraded":"2024-05-07T14:01:21.656164+0000","last_fullsized":"2024-05-07T14:01:21.656164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:28.158572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152588+0000","last_change":"2024-05-07T14:01:06.039788+0000","last_active":"2024-05-07T14:01:22.152588+0000","last_peered":"2024-05-07T14:01:22.152588+0000","last_clean":"2024-05-07T14:01:22.152588+0000","last_became_active":"2024-05-07T14:01:06.039050+0000","last_became_peered":"2024-05-07T14:01:06.039050+0000","last_unstale":"2024-05-07T14:01:22.152588+0000","last_undegraded":"2024-05-07T14:01:22.152588+0000","last_fullsized":"2024-05-07T14:01:22.152588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157219+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:01:22.157219+0000","last_peered":"2024-05-07T14:01:22.157219+0000","last_clean":"2024-05-07T14:01:22.157219+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:01:22.157219+0000","last_undegraded":"2024-05-07T14:01:22.157219+0000","last_fullsized":"2024-05-07T14:01:22.157219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657822+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:01:21.657822+0000","last_peered":"2024-05-07T14:01:21.657822+0000","last_clean":"2024-05-07T14:01:21.657822+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:01:21.657822+0000","last_undegraded":"2024-05-07T14:01:21.657822+0000","last_fullsized":"2024-05-07T14:01:21.657822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658013+0000","last_change":"2024-05-07T14:00:55.991934+0000","last_active":"2024-05-07T14:01:21.658013+0000","last_peered":"2024-05-07T14:01:21.658013+0000","last_clean":"2024-05-07T14:01:21.658013+0000","last_became_active":"2024-05-07T14:00:55.991303+0000","last_became_peered":"2024-05-07T14:00:55.991303+0000","last_unstale":"2024-05-07T14:01:21.658013+0000","last_undegraded":"2024-05-07T14:01:21.658013+0000","last_fullsized":"2024-05-07T14:01:21.658013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158142+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:01:22.158142+0000","last_peered":"2024-05-07T14:01:22.158142+0000","last_clean":"2024-05-07T14:01:22.158142+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:01:22.158142+0000","last_undegraded":"2024-05-07T14:01:22.158142+0000","last_fullsized":"2024-05-07T14:01:22.158142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.655639+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:01:21.655639+0000","last_peered":"2024-05-07T14:01:21.655639+0000","last_clean":"2024-05-07T14:01:21.655639+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:01:21.655639+0000","last_undegraded":"2024-05-07T14:01:21.655639+0000","last_fullsized":"2024-05-07T14:01:21.655639+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.655522+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:01:21.655522+0000","last_peered":"2024-05-07T14:01:21.655522+0000","last_clean":"2024-05-07T14:01:21.655522+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:01:21.655522+0000","last_undegraded":"2024-05-07T14:01:21.655522+0000","last_fullsized":"2024-05-07T14:01:21.655522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658049+0000","last_change":"2024-05-07T14:01:06.013974+0000","last_active":"2024-05-07T14:01:21.658049+0000","last_peered":"2024-05-07T14:01:21.658049+0000","last_clean":"2024-05-07T14:01:21.658049+0000","last_became_active":"2024-05-07T14:01:06.013281+0000","last_became_peered":"2024-05-07T14:01:06.013281+0000","last_unstale":"2024-05-07T14:01:21.658049+0000","last_undegraded":"2024-05-07T14:01:21.658049+0000","last_fullsized":"2024-05-07T14:01:21.658049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:46.349394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157590+0000","last_change":"2024-05-07T14:00:58.001752+0000","last_active":"2024-05-07T14:01:22.157590+0000","last_peered":"2024-05-07T14:01:22.157590+0000","last_clean":"2024-05-07T14:01:22.157590+0000","last_became_active":"2024-05-07T14:00:57.999982+0000","last_became_peered":"2024-05-07T14:00:57.999982+0000","last_unstale":"2024-05-07T14:01:22.157590+0000","last_undegraded":"2024-05-07T14:01:22.157590+0000","last_fullsized":"2024-05-07T14:01:22.157590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661805+0000","last_change":"2024-05-07T14:00:55.968287+0000","last_active":"2024-05-07T14:01:21.661805+0000","last_peered":"2024-05-07T14:01:21.661805+0000","last_clean":"2024-05-07T14:01:21.661805+0000","last_became_active":"2024-05-07T14:00:55.967578+0000","last_became_peered":"2024-05-07T14:00:55.967578+0000","last_unstale":"2024-05-07T14:01:21.661805+0000","last_undegraded":"2024-05-07T14:01:21.661805+0000","last_fullsized":"2024-05-07T14:01:21.661805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657117+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:01:21.657117+0000","last_peered":"2024-05-07T14:01:21.657117+0000","last_clean":"2024-05-07T14:01:21.657117+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:01:21.657117+0000","last_undegraded":"2024-05-07T14:01:21.657117+0000","last_fullsized":"2024-05-07T14:01:21.657117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'4","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158813+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:01:22.158813+0000","last_peered":"2024-05-07T14:01:22.158813+0000","last_clean":"2024-05-07T14:01:22.158813+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:01:22.158813+0000","last_undegraded":"2024-05-07T14:01:22.158813+0000","last_fullsized":"2024-05-07T14:01:22.158813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659273+0000","last_change":"2024-05-07T14:01:04.012628+0000","last_active":"2024-05-07T14:01:21.659273+0000","last_peered":"2024-05-07T14:01:21.659273+0000","last_clean":"2024-05-07T14:01:21.659273+0000","last_became_active":"2024-05-07T14:01:04.011910+0000","last_became_peered":"2024-05-07T14:01:04.011910+0000","last_unstale":"2024-05-07T14:01:21.659273+0000","last_undegraded":"2024-05-07T14:01:21.659273+0000","last_fullsized":"2024-05-07T14:01:21.659273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158941+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:01:22.158941+0000","last_peered":"2024-05-07T14:01:22.158941+0000","last_clean":"2024-05-07T14:01:22.158941+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:01:22.158941+0000","last_undegraded":"2024-05-07T14:01:22.158941+0000","last_fullsized":"2024-05-07T14:01:22.158941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656089+0000","last_change":"2024-05-07T14:00:57.999019+0000","last_active":"2024-05-07T14:01:21.656089+0000","last_peered":"2024-05-07T14:01:21.656089+0000","last_clean":"2024-05-07T14:01:21.656089+0000","last_became_active":"2024-05-07T14:00:57.998526+0000","last_became_peered":"2024-05-07T14:00:57.998526+0000","last_unstale":"2024-05-07T14:01:21.656089+0000","last_undegraded":"2024-05-07T14:01:21.656089+0000","last_fullsized":"2024-05-07T14:01:21.656089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152310+0000","last_change":"2024-05-07T14:00:55.999548+0000","last_active":"2024-05-07T14:01:22.152310+0000","last_peered":"2024-05-07T14:01:22.152310+0000","last_clean":"2024-05-07T14:01:22.152310+0000","last_became_active":"2024-05-07T14:00:55.995284+0000","last_became_peered":"2024-05-07T14:00:55.995284+0000","last_unstale":"2024-05-07T14:01:22.152310+0000","last_undegraded":"2024-05-07T14:01:22.152310+0000","last_fullsized":"2024-05-07T14:01:22.152310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658346+0000","last_change":"2024-05-07T14:00:59.996971+0000","last_active":"2024-05-07T14:01:21.658346+0000","last_peered":"2024-05-07T14:01:21.658346+0000","last_clean":"2024-05-07T14:01:21.658346+0000","last_became_active":"2024-05-07T14:00:59.996254+0000","last_became_peered":"2024-05-07T14:00:59.996254+0000","last_unstale":"2024-05-07T14:01:21.658346+0000","last_undegraded":"2024-05-07T14:01:21.658346+0000","last_fullsized":"2024-05-07T14:01:21.658346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656951+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:01:21.656951+0000","last_peered":"2024-05-07T14:01:21.656951+0000","last_clean":"2024-05-07T14:01:21.656951+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:01:21.656951+0000","last_undegraded":"2024-05-07T14:01:21.656951+0000","last_fullsized":"2024-05-07T14:01:21.656951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150866+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:01:22.150866+0000","last_peered":"2024-05-07T14:01:22.150866+0000","last_clean":"2024-05-07T14:01:22.150866+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:01:22.150866+0000","last_undegraded":"2024-05-07T14:01:22.150866+0000","last_fullsized":"2024-05-07T14:01:22.150866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.149957+0000","last_change":"2024-05-07T14:01:06.038138+0000","last_active":"2024-05-07T14:01:22.149957+0000","last_peered":"2024-05-07T14:01:22.149957+0000","last_clean":"2024-05-07T14:01:22.149957+0000","last_became_active":"2024-05-07T14:01:06.030966+0000","last_became_peered":"2024-05-07T14:01:06.030966+0000","last_unstale":"2024-05-07T14:01:22.149957+0000","last_undegraded":"2024-05-07T14:01:22.149957+0000","last_fullsized":"2024-05-07T14:01:22.149957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656327+0000","last_change":"2024-05-07T14:00:57.987879+0000","last_active":"2024-05-07T14:01:21.656327+0000","last_peered":"2024-05-07T14:01:21.656327+0000","last_clean":"2024-05-07T14:01:21.656327+0000","last_became_active":"2024-05-07T14:00:57.987544+0000","last_became_peered":"2024-05-07T14:00:57.987544+0000","last_unstale":"2024-05-07T14:01:21.656327+0000","last_undegraded":"2024-05-07T14:01:21.656327+0000","last_fullsized":"2024-05-07T14:01:21.656327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162875+0000","last_change":"2024-05-07T14:00:56.007067+0000","last_active":"2024-05-07T14:01:22.162875+0000","last_peered":"2024-05-07T14:01:22.162875+0000","last_clean":"2024-05-07T14:01:22.162875+0000","last_became_active":"2024-05-07T14:00:56.006885+0000","last_became_peered":"2024-05-07T14:00:56.006885+0000","last_unstale":"2024-05-07T14:01:22.162875+0000","last_undegraded":"2024-05-07T14:01:22.162875+0000","last_fullsized":"2024-05-07T14:01:22.162875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151421+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:01:22.151421+0000","last_peered":"2024-05-07T14:01:22.151421+0000","last_clean":"2024-05-07T14:01:22.151421+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:01:22.151421+0000","last_undegraded":"2024-05-07T14:01:22.151421+0000","last_fullsized":"2024-05-07T14:01:22.151421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657296+0000","last_change":"2024-05-07T14:01:01.995377+0000","last_active":"2024-05-07T14:01:21.657296+0000","last_peered":"2024-05-07T14:01:21.657296+0000","last_clean":"2024-05-07T14:01:21.657296+0000","last_became_active":"2024-05-07T14:01:01.994566+0000","last_became_peered":"2024-05-07T14:01:01.994566+0000","last_unstale":"2024-05-07T14:01:21.657296+0000","last_undegraded":"2024-05-07T14:01:21.657296+0000","last_fullsized":"2024-05-07T14:01:21.657296+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157381+0000","last_change":"2024-05-07T14:01:03.997116+0000","last_active":"2024-05-07T14:01:22.157381+0000","last_peered":"2024-05-07T14:01:22.157381+0000","last_clean":"2024-05-07T14:01:22.157381+0000","last_became_active":"2024-05-07T14:01:03.996555+0000","last_became_peered":"2024-05-07T14:01:03.996555+0000","last_unstale":"2024-05-07T14:01:22.157381+0000","last_undegraded":"2024-05-07T14:01:22.157381+0000","last_fullsized":"2024-05-07T14:01:22.157381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152421+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:01:22.152421+0000","last_peered":"2024-05-07T14:01:22.152421+0000","last_clean":"2024-05-07T14:01:22.152421+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:01:22.152421+0000","last_undegraded":"2024-05-07T14:01:22.152421+0000","last_fullsized":"2024-05-07T14:01:22.152421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656622+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:01:21.656622+0000","last_peered":"2024-05-07T14:01:21.656622+0000","last_clean":"2024-05-07T14:01:21.656622+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:01:21.656622+0000","last_undegraded":"2024-05-07T14:01:21.656622+0000","last_fullsized":"2024-05-07T14:01:21.656622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156078+0000","last_change":"2024-05-07T14:00:59.995694+0000","last_active":"2024-05-07T14:01:22.156078+0000","last_peered":"2024-05-07T14:01:22.156078+0000","last_clean":"2024-05-07T14:01:22.156078+0000","last_became_active":"2024-05-07T14:00:59.993899+0000","last_became_peered":"2024-05-07T14:00:59.993899+0000","last_unstale":"2024-05-07T14:01:22.156078+0000","last_undegraded":"2024-05-07T14:01:22.156078+0000","last_fullsized":"2024-05-07T14:01:22.156078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:28.225348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":57,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157830+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:01:22.157830+0000","last_peered":"2024-05-07T14:01:22.157830+0000","last_clean":"2024-05-07T14:01:22.157830+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:01:22.157830+0000","last_undegraded":"2024-05-07T14:01:22.157830+0000","last_fullsized":"2024-05-07T14:01:22.157830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151757+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:01:22.151757+0000","last_peered":"2024-05-07T14:01:22.151757+0000","last_clean":"2024-05-07T14:01:22.151757+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:01:22.151757+0000","last_undegraded":"2024-05-07T14:01:22.151757+0000","last_fullsized":"2024-05-07T14:01:22.151757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656002+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:01:21.656002+0000","last_peered":"2024-05-07T14:01:21.656002+0000","last_clean":"2024-05-07T14:01:21.656002+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:01:21.656002+0000","last_undegraded":"2024-05-07T14:01:21.656002+0000","last_fullsized":"2024-05-07T14:01:21.656002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153097+0000","last_change":"2024-05-07T14:00:57.995989+0000","last_active":"2024-05-07T14:01:22.153097+0000","last_peered":"2024-05-07T14:01:22.153097+0000","last_clean":"2024-05-07T14:01:22.153097+0000","last_became_active":"2024-05-07T14:00:57.995721+0000","last_became_peered":"2024-05-07T14:00:57.995721+0000","last_unstale":"2024-05-07T14:01:22.153097+0000","last_undegraded":"2024-05-07T14:01:22.153097+0000","last_fullsized":"2024-05-07T14:01:22.153097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156812+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:01:22.156812+0000","last_peered":"2024-05-07T14:01:22.156812+0000","last_clean":"2024-05-07T14:01:22.156812+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:01:22.156812+0000","last_undegraded":"2024-05-07T14:01:22.156812+0000","last_fullsized":"2024-05-07T14:01:22.156812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152280+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:01:22.152280+0000","last_peered":"2024-05-07T14:01:22.152280+0000","last_clean":"2024-05-07T14:01:22.152280+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:01:22.152280+0000","last_undegraded":"2024-05-07T14:01:22.152280+0000","last_fullsized":"2024-05-07T14:01:22.152280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661039+0000","last_change":"2024-05-07T14:01:02.002384+0000","last_active":"2024-05-07T14:01:21.661039+0000","last_peered":"2024-05-07T14:01:21.661039+0000","last_clean":"2024-05-07T14:01:21.661039+0000","last_became_active":"2024-05-07T14:01:02.001676+0000","last_became_peered":"2024-05-07T14:01:02.001676+0000","last_unstale":"2024-05-07T14:01:21.661039+0000","last_undegraded":"2024-05-07T14:01:21.661039+0000","last_fullsized":"2024-05-07T14:01:21.661039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158218+0000","last_change":"2024-05-07T14:01:04.015893+0000","last_active":"2024-05-07T14:01:22.158218+0000","last_peered":"2024-05-07T14:01:22.158218+0000","last_clean":"2024-05-07T14:01:22.158218+0000","last_became_active":"2024-05-07T14:01:04.015329+0000","last_became_peered":"2024-05-07T14:01:04.015329+0000","last_unstale":"2024-05-07T14:01:22.158218+0000","last_undegraded":"2024-05-07T14:01:22.158218+0000","last_fullsized":"2024-05-07T14:01:22.158218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:53.413495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150560+0000","last_change":"2024-05-07T14:01:06.025917+0000","last_active":"2024-05-07T14:01:22.150560+0000","last_peered":"2024-05-07T14:01:22.150560+0000","last_clean":"2024-05-07T14:01:22.150560+0000","last_became_active":"2024-05-07T14:01:06.025044+0000","last_became_peered":"2024-05-07T14:01:06.025044+0000","last_unstale":"2024-05-07T14:01:22.150560+0000","last_undegraded":"2024-05-07T14:01:22.150560+0000","last_fullsized":"2024-05-07T14:01:22.150560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:55.419668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657974+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:01:21.657974+0000","last_peered":"2024-05-07T14:01:21.657974+0000","last_clean":"2024-05-07T14:01:21.657974+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:01:21.657974+0000","last_undegraded":"2024-05-07T14:01:21.657974+0000","last_fullsized":"2024-05-07T14:01:21.657974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657437+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:01:21.657437+0000","last_peered":"2024-05-07T14:01:21.657437+0000","last_clean":"2024-05-07T14:01:21.657437+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:01:21.657437+0000","last_undegraded":"2024-05-07T14:01:21.657437+0000","last_fullsized":"2024-05-07T14:01:21.657437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659871+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:01:21.659871+0000","last_peered":"2024-05-07T14:01:21.659871+0000","last_clean":"2024-05-07T14:01:21.659871+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:01:21.659871+0000","last_undegraded":"2024-05-07T14:01:21.659871+0000","last_fullsized":"2024-05-07T14:01:21.659871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658470+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:01:21.658470+0000","last_peered":"2024-05-07T14:01:21.658470+0000","last_clean":"2024-05-07T14:01:21.658470+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:01:21.658470+0000","last_undegraded":"2024-05-07T14:01:21.658470+0000","last_fullsized":"2024-05-07T14:01:21.658470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157433+0000","last_change":"2024-05-07T14:01:04.026470+0000","last_active":"2024-05-07T14:01:22.157433+0000","last_peered":"2024-05-07T14:01:22.157433+0000","last_clean":"2024-05-07T14:01:22.157433+0000","last_became_active":"2024-05-07T14:01:04.025881+0000","last_became_peered":"2024-05-07T14:01:04.025881+0000","last_unstale":"2024-05-07T14:01:22.157433+0000","last_undegraded":"2024-05-07T14:01:22.157433+0000","last_fullsized":"2024-05-07T14:01:22.157433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:54.595283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.149872+0000","last_change":"2024-05-07T14:01:06.038979+0000","last_active":"2024-05-07T14:01:22.149872+0000","last_peered":"2024-05-07T14:01:22.149872+0000","last_clean":"2024-05-07T14:01:22.149872+0000","last_became_active":"2024-05-07T14:01:06.035737+0000","last_became_peered":"2024-05-07T14:01:06.035737+0000","last_unstale":"2024-05-07T14:01:22.149872+0000","last_undegraded":"2024-05-07T14:01:22.149872+0000","last_fullsized":"2024-05-07T14:01:22.149872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157352+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:01:22.157352+0000","last_peered":"2024-05-07T14:01:22.157352+0000","last_clean":"2024-05-07T14:01:22.157352+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:01:22.157352+0000","last_undegraded":"2024-05-07T14:01:22.157352+0000","last_fullsized":"2024-05-07T14:01:22.157352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157719+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:01:22.157719+0000","last_peered":"2024-05-07T14:01:22.157719+0000","last_clean":"2024-05-07T14:01:22.157719+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:01:22.157719+0000","last_undegraded":"2024-05-07T14:01:22.157719+0000","last_fullsized":"2024-05-07T14:01:22.157719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158709+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:01:22.158709+0000","last_peered":"2024-05-07T14:01:22.158709+0000","last_clean":"2024-05-07T14:01:22.158709+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:01:22.158709+0000","last_undegraded":"2024-05-07T14:01:22.158709+0000","last_fullsized":"2024-05-07T14:01:22.158709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659297+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:01:21.659297+0000","last_peered":"2024-05-07T14:01:21.659297+0000","last_clean":"2024-05-07T14:01:21.659297+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:01:21.659297+0000","last_undegraded":"2024-05-07T14:01:21.659297+0000","last_fullsized":"2024-05-07T14:01:21.659297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151996+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:01:22.151996+0000","last_peered":"2024-05-07T14:01:22.151996+0000","last_clean":"2024-05-07T14:01:22.151996+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:01:22.151996+0000","last_undegraded":"2024-05-07T14:01:22.151996+0000","last_fullsized":"2024-05-07T14:01:22.151996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658088+0000","last_change":"2024-05-07T14:01:06.037755+0000","last_active":"2024-05-07T14:01:21.658088+0000","last_peered":"2024-05-07T14:01:21.658088+0000","last_clean":"2024-05-07T14:01:21.658088+0000","last_became_active":"2024-05-07T14:01:06.037156+0000","last_became_peered":"2024-05-07T14:01:06.037156+0000","last_unstale":"2024-05-07T14:01:21.658088+0000","last_undegraded":"2024-05-07T14:01:21.658088+0000","last_fullsized":"2024-05-07T14:01:21.658088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:30.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657641+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:01:21.657641+0000","last_peered":"2024-05-07T14:01:21.657641+0000","last_clean":"2024-05-07T14:01:21.657641+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:01:21.657641+0000","last_undegraded":"2024-05-07T14:01:21.657641+0000","last_fullsized":"2024-05-07T14:01:21.657641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152003+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:01:22.152003+0000","last_peered":"2024-05-07T14:01:22.152003+0000","last_clean":"2024-05-07T14:01:22.152003+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:01:22.152003+0000","last_undegraded":"2024-05-07T14:01:22.152003+0000","last_fullsized":"2024-05-07T14:01:22.152003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659789+0000","last_change":"2024-05-07T14:00:59.998197+0000","last_active":"2024-05-07T14:01:21.659789+0000","last_peered":"2024-05-07T14:01:21.659789+0000","last_clean":"2024-05-07T14:01:21.659789+0000","last_became_active":"2024-05-07T14:00:59.997438+0000","last_became_peered":"2024-05-07T14:00:59.997438+0000","last_unstale":"2024-05-07T14:01:21.659789+0000","last_undegraded":"2024-05-07T14:01:21.659789+0000","last_fullsized":"2024-05-07T14:01:21.659789+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:29.430229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150349+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:01:22.150349+0000","last_peered":"2024-05-07T14:01:22.150349+0000","last_clean":"2024-05-07T14:01:22.150349+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:01:22.150349+0000","last_undegraded":"2024-05-07T14:01:22.150349+0000","last_fullsized":"2024-05-07T14:01:22.150349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.155067+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:01:22.155067+0000","last_peered":"2024-05-07T14:01:22.155067+0000","last_clean":"2024-05-07T14:01:22.155067+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:01:22.155067+0000","last_undegraded":"2024-05-07T14:01:22.155067+0000","last_fullsized":"2024-05-07T14:01:22.155067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.663502+0000","last_change":"2024-05-07T14:01:06.025913+0000","last_active":"2024-05-07T14:01:21.663502+0000","last_peered":"2024-05-07T14:01:21.663502+0000","last_clean":"2024-05-07T14:01:21.663502+0000","last_became_active":"2024-05-07T14:01:06.025220+0000","last_became_peered":"2024-05-07T14:01:06.025220+0000","last_unstale":"2024-05-07T14:01:21.663502+0000","last_undegraded":"2024-05-07T14:01:21.663502+0000","last_fullsized":"2024-05-07T14:01:21.663502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:30.164745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657185+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:01:21.657185+0000","last_peered":"2024-05-07T14:01:21.657185+0000","last_clean":"2024-05-07T14:01:21.657185+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:01:21.657185+0000","last_undegraded":"2024-05-07T14:01:21.657185+0000","last_fullsized":"2024-05-07T14:01:21.657185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153175+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:01:22.153175+0000","last_peered":"2024-05-07T14:01:22.153175+0000","last_clean":"2024-05-07T14:01:22.153175+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:01:22.153175+0000","last_undegraded":"2024-05-07T14:01:22.153175+0000","last_fullsized":"2024-05-07T14:01:22.153175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150924+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:01:22.150924+0000","last_peered":"2024-05-07T14:01:22.150924+0000","last_clean":"2024-05-07T14:01:22.150924+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:01:22.150924+0000","last_undegraded":"2024-05-07T14:01:22.150924+0000","last_fullsized":"2024-05-07T14:01:22.150924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158034+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:01:22.158034+0000","last_peered":"2024-05-07T14:01:22.158034+0000","last_clean":"2024-05-07T14:01:22.158034+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:01:22.158034+0000","last_undegraded":"2024-05-07T14:01:22.158034+0000","last_fullsized":"2024-05-07T14:01:22.158034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151270+0000","last_change":"2024-05-07T14:01:04.017099+0000","last_active":"2024-05-07T14:01:22.151270+0000","last_peered":"2024-05-07T14:01:22.151270+0000","last_clean":"2024-05-07T14:01:22.151270+0000","last_became_active":"2024-05-07T14:01:04.011036+0000","last_became_peered":"2024-05-07T14:01:04.011036+0000","last_unstale":"2024-05-07T14:01:22.151270+0000","last_undegraded":"2024-05-07T14:01:22.151270+0000","last_fullsized":"2024-05-07T14:01:22.151270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:32.242974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658054+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:01:21.658054+0000","last_peered":"2024-05-07T14:01:21.658054+0000","last_clean":"2024-05-07T14:01:21.658054+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:01:21.658054+0000","last_undegraded":"2024-05-07T14:01:21.658054+0000","last_fullsized":"2024-05-07T14:01:21.658054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656179+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:01:21.656179+0000","last_peered":"2024-05-07T14:01:21.656179+0000","last_clean":"2024-05-07T14:01:21.656179+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:01:21.656179+0000","last_undegraded":"2024-05-07T14:01:21.656179+0000","last_fullsized":"2024-05-07T14:01:21.656179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658561+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:01:21.658561+0000","last_peered":"2024-05-07T14:01:21.658561+0000","last_clean":"2024-05-07T14:01:21.658561+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:01:21.658561+0000","last_undegraded":"2024-05-07T14:01:21.658561+0000","last_fullsized":"2024-05-07T14:01:21.658561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656205+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:01:21.656205+0000","last_peered":"2024-05-07T14:01:21.656205+0000","last_clean":"2024-05-07T14:01:21.656205+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:01:21.656205+0000","last_undegraded":"2024-05-07T14:01:21.656205+0000","last_fullsized":"2024-05-07T14:01:21.656205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":44,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657394+0000","last_change":"2024-05-07T14:01:02.013617+0000","last_active":"2024-05-07T14:01:21.657394+0000","last_peered":"2024-05-07T14:01:21.657394+0000","last_clean":"2024-05-07T14:01:21.657394+0000","last_became_active":"2024-05-07T14:01:02.009243+0000","last_became_peered":"2024-05-07T14:01:02.009243+0000","last_unstale":"2024-05-07T14:01:21.657394+0000","last_undegraded":"2024-05-07T14:01:21.657394+0000","last_fullsized":"2024-05-07T14:01:21.657394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656617+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:01:21.656617+0000","last_peered":"2024-05-07T14:01:21.656617+0000","last_clean":"2024-05-07T14:01:21.656617+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:01:21.656617+0000","last_undegraded":"2024-05-07T14:01:21.656617+0000","last_fullsized":"2024-05-07T14:01:21.656617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661455+0000","last_change":"2024-05-07T14:01:06.023907+0000","last_active":"2024-05-07T14:01:21.661455+0000","last_peered":"2024-05-07T14:01:21.661455+0000","last_clean":"2024-05-07T14:01:21.661455+0000","last_became_active":"2024-05-07T14:01:06.023307+0000","last_became_peered":"2024-05-07T14:01:06.023307+0000","last_unstale":"2024-05-07T14:01:21.661455+0000","last_undegraded":"2024-05-07T14:01:21.661455+0000","last_fullsized":"2024-05-07T14:01:21.661455+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:41.916580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656570+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:01:21.656570+0000","last_peered":"2024-05-07T14:01:21.656570+0000","last_clean":"2024-05-07T14:01:21.656570+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:01:21.656570+0000","last_undegraded":"2024-05-07T14:01:21.656570+0000","last_fullsized":"2024-05-07T14:01:21.656570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162817+0000","last_change":"2024-05-07T14:00:56.006013+0000","last_active":"2024-05-07T14:01:22.162817+0000","last_peered":"2024-05-07T14:01:22.162817+0000","last_clean":"2024-05-07T14:01:22.162817+0000","last_became_active":"2024-05-07T14:00:56.005758+0000","last_became_peered":"2024-05-07T14:00:56.005758+0000","last_unstale":"2024-05-07T14:01:22.162817+0000","last_undegraded":"2024-05-07T14:01:22.162817+0000","last_fullsized":"2024-05-07T14:01:22.162817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.155867+0000","last_change":"2024-05-07T14:00:59.998767+0000","last_active":"2024-05-07T14:01:22.155867+0000","last_peered":"2024-05-07T14:01:22.155867+0000","last_clean":"2024-05-07T14:01:22.155867+0000","last_became_active":"2024-05-07T14:00:59.998055+0000","last_became_peered":"2024-05-07T14:00:59.998055+0000","last_unstale":"2024-05-07T14:01:22.155867+0000","last_undegraded":"2024-05-07T14:01:22.155867+0000","last_fullsized":"2024-05-07T14:01:22.155867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:41.593806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656705+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:01:21.656705+0000","last_peered":"2024-05-07T14:01:21.656705+0000","last_clean":"2024-05-07T14:01:21.656705+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:01:21.656705+0000","last_undegraded":"2024-05-07T14:01:21.656705+0000","last_fullsized":"2024-05-07T14:01:21.656705+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157058+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:01:22.157058+0000","last_peered":"2024-05-07T14:01:22.157058+0000","last_clean":"2024-05-07T14:01:22.157058+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:01:22.157058+0000","last_undegraded":"2024-05-07T14:01:22.157058+0000","last_fullsized":"2024-05-07T14:01:22.157058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660009+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:01:21.660009+0000","last_peered":"2024-05-07T14:01:21.660009+0000","last_clean":"2024-05-07T14:01:21.660009+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:01:21.660009+0000","last_undegraded":"2024-05-07T14:01:21.660009+0000","last_fullsized":"2024-05-07T14:01:21.660009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159926+0000","last_change":"2024-05-07T14:00:58.005276+0000","last_active":"2024-05-07T14:01:22.159926+0000","last_peered":"2024-05-07T14:01:22.159926+0000","last_clean":"2024-05-07T14:01:22.159926+0000","last_became_active":"2024-05-07T14:00:58.004903+0000","last_became_peered":"2024-05-07T14:00:58.004903+0000","last_unstale":"2024-05-07T14:01:22.159926+0000","last_undegraded":"2024-05-07T14:01:22.159926+0000","last_fullsized":"2024-05-07T14:01:22.159926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151501+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:01:22.151501+0000","last_peered":"2024-05-07T14:01:22.151501+0000","last_clean":"2024-05-07T14:01:22.151501+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:01:22.151501+0000","last_undegraded":"2024-05-07T14:01:22.151501+0000","last_fullsized":"2024-05-07T14:01:22.151501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159055+0000","last_change":"2024-05-07T14:00:57.986882+0000","last_active":"2024-05-07T14:01:22.159055+0000","last_peered":"2024-05-07T14:01:22.159055+0000","last_clean":"2024-05-07T14:01:22.159055+0000","last_became_active":"2024-05-07T14:00:57.984867+0000","last_became_peered":"2024-05-07T14:00:57.984867+0000","last_unstale":"2024-05-07T14:01:22.159055+0000","last_undegraded":"2024-05-07T14:01:22.159055+0000","last_fullsized":"2024-05-07T14:01:22.159055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153651+0000","last_change":"2024-05-07T14:00:56.001559+0000","last_active":"2024-05-07T14:01:22.153651+0000","last_peered":"2024-05-07T14:01:22.153651+0000","last_clean":"2024-05-07T14:01:22.153651+0000","last_became_active":"2024-05-07T14:00:56.001149+0000","last_became_peered":"2024-05-07T14:00:56.001149+0000","last_unstale":"2024-05-07T14:01:22.153651+0000","last_undegraded":"2024-05-07T14:01:22.153651+0000","last_fullsized":"2024-05-07T14:01:22.153651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:13.077774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152472+0000","last_change":"2024-05-07T14:00:57.985233+0000","last_active":"2024-05-07T14:01:22.152472+0000","last_peered":"2024-05-07T14:01:22.152472+0000","last_clean":"2024-05-07T14:01:22.152472+0000","last_became_active":"2024-05-07T14:00:57.984523+0000","last_became_peered":"2024-05-07T14:00:57.984523+0000","last_unstale":"2024-05-07T14:01:22.152472+0000","last_undegraded":"2024-05-07T14:01:22.152472+0000","last_fullsized":"2024-05-07T14:01:22.152472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150731+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:01:22.150731+0000","last_peered":"2024-05-07T14:01:22.150731+0000","last_clean":"2024-05-07T14:01:22.150731+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:01:22.150731+0000","last_undegraded":"2024-05-07T14:01:22.150731+0000","last_fullsized":"2024-05-07T14:01:22.150731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151412+0000","last_change":"2024-05-07T14:00:57.989787+0000","last_active":"2024-05-07T14:01:22.151412+0000","last_peered":"2024-05-07T14:01:22.151412+0000","last_clean":"2024-05-07T14:01:22.151412+0000","last_became_active":"2024-05-07T14:00:57.989498+0000","last_became_peered":"2024-05-07T14:00:57.989498+0000","last_unstale":"2024-05-07T14:01:22.151412+0000","last_undegraded":"2024-05-07T14:01:22.151412+0000","last_fullsized":"2024-05-07T14:01:22.151412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158080+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:01:22.158080+0000","last_peered":"2024-05-07T14:01:22.158080+0000","last_clean":"2024-05-07T14:01:22.158080+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:01:22.158080+0000","last_undegraded":"2024-05-07T14:01:22.158080+0000","last_fullsized":"2024-05-07T14:01:22.158080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657263+0000","last_change":"2024-05-07T14:00:57.998054+0000","last_active":"2024-05-07T14:01:21.657263+0000","last_peered":"2024-05-07T14:01:21.657263+0000","last_clean":"2024-05-07T14:01:21.657263+0000","last_became_active":"2024-05-07T14:00:57.997750+0000","last_became_peered":"2024-05-07T14:00:57.997750+0000","last_unstale":"2024-05-07T14:01:21.657263+0000","last_undegraded":"2024-05-07T14:01:21.657263+0000","last_fullsized":"2024-05-07T14:01:21.657263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658230+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:01:21.658230+0000","last_peered":"2024-05-07T14:01:21.658230+0000","last_clean":"2024-05-07T14:01:21.658230+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:01:21.658230+0000","last_undegraded":"2024-05-07T14:01:21.658230+0000","last_fullsized":"2024-05-07T14:01:21.658230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657339+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:01:21.657339+0000","last_peered":"2024-05-07T14:01:21.657339+0000","last_clean":"2024-05-07T14:01:21.657339+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:01:21.657339+0000","last_undegraded":"2024-05-07T14:01:21.657339+0000","last_fullsized":"2024-05-07T14:01:21.657339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159118+0000","last_change":"2024-05-07T14:00:55.974072+0000","last_active":"2024-05-07T14:01:22.159118+0000","last_peered":"2024-05-07T14:01:22.159118+0000","last_clean":"2024-05-07T14:01:22.159118+0000","last_became_active":"2024-05-07T14:00:55.973647+0000","last_became_peered":"2024-05-07T14:00:55.973647+0000","last_unstale":"2024-05-07T14:01:22.159118+0000","last_undegraded":"2024-05-07T14:01:22.159118+0000","last_fullsized":"2024-05-07T14:01:22.159118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.655996+0000","last_change":"2024-05-07T14:00:57.988167+0000","last_active":"2024-05-07T14:01:21.655996+0000","last_peered":"2024-05-07T14:01:21.655996+0000","last_clean":"2024-05-07T14:01:21.655996+0000","last_became_active":"2024-05-07T14:00:57.987884+0000","last_became_peered":"2024-05-07T14:00:57.987884+0000","last_unstale":"2024-05-07T14:01:21.655996+0000","last_undegraded":"2024-05-07T14:01:21.655996+0000","last_fullsized":"2024-05-07T14:01:21.655996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151192+0000","last_change":"2024-05-07T14:00:55.997287+0000","last_active":"2024-05-07T14:01:22.151192+0000","last_peered":"2024-05-07T14:01:22.151192+0000","last_clean":"2024-05-07T14:01:22.151192+0000","last_became_active":"2024-05-07T14:00:55.996467+0000","last_became_peered":"2024-05-07T14:00:55.996467+0000","last_unstale":"2024-05-07T14:01:22.151192+0000","last_undegraded":"2024-05-07T14:01:22.151192+0000","last_fullsized":"2024-05-07T14:01:22.151192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151401+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:01:22.151401+0000","last_peered":"2024-05-07T14:01:22.151401+0000","last_clean":"2024-05-07T14:01:22.151401+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:01:22.151401+0000","last_undegraded":"2024-05-07T14:01:22.151401+0000","last_fullsized":"2024-05-07T14:01:22.151401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658338+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:01:21.658338+0000","last_peered":"2024-05-07T14:01:21.658338+0000","last_clean":"2024-05-07T14:01:21.658338+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:01:21.658338+0000","last_undegraded":"2024-05-07T14:01:21.658338+0000","last_fullsized":"2024-05-07T14:01:21.658338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156547+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:01:22.156547+0000","last_peered":"2024-05-07T14:01:22.156547+0000","last_clean":"2024-05-07T14:01:22.156547+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:01:22.156547+0000","last_undegraded":"2024-05-07T14:01:22.156547+0000","last_fullsized":"2024-05-07T14:01:22.156547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150661+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:01:22.150661+0000","last_peered":"2024-05-07T14:01:22.150661+0000","last_clean":"2024-05-07T14:01:22.150661+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:01:22.150661+0000","last_undegraded":"2024-05-07T14:01:22.150661+0000","last_fullsized":"2024-05-07T14:01:22.150661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659745+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:01:21.659745+0000","last_peered":"2024-05-07T14:01:21.659745+0000","last_clean":"2024-05-07T14:01:21.659745+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:01:21.659745+0000","last_undegraded":"2024-05-07T14:01:21.659745+0000","last_fullsized":"2024-05-07T14:01:21.659745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656264+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:01:21.656264+0000","last_peered":"2024-05-07T14:01:21.656264+0000","last_clean":"2024-05-07T14:01:21.656264+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:01:21.656264+0000","last_undegraded":"2024-05-07T14:01:21.656264+0000","last_fullsized":"2024-05-07T14:01:21.656264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158267+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:01:22.158267+0000","last_peered":"2024-05-07T14:01:22.158267+0000","last_clean":"2024-05-07T14:01:22.158267+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:01:22.158267+0000","last_undegraded":"2024-05-07T14:01:22.158267+0000","last_fullsized":"2024-05-07T14:01:22.158267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150672+0000","last_change":"2024-05-07T14:00:56.001135+0000","last_active":"2024-05-07T14:01:22.150672+0000","last_peered":"2024-05-07T14:01:22.150672+0000","last_clean":"2024-05-07T14:01:22.150672+0000","last_became_active":"2024-05-07T14:00:55.999884+0000","last_became_peered":"2024-05-07T14:00:55.999884+0000","last_unstale":"2024-05-07T14:01:22.150672+0000","last_undegraded":"2024-05-07T14:01:22.150672+0000","last_fullsized":"2024-05-07T14:01:22.150672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659387+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:01:21.659387+0000","last_peered":"2024-05-07T14:01:21.659387+0000","last_clean":"2024-05-07T14:01:21.659387+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:01:21.659387+0000","last_undegraded":"2024-05-07T14:01:21.659387+0000","last_fullsized":"2024-05-07T14:01:21.659387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158726+0000","last_change":"2024-05-07T14:00:55.989670+0000","last_active":"2024-05-07T14:01:22.158726+0000","last_peered":"2024-05-07T14:01:22.158726+0000","last_clean":"2024-05-07T14:01:22.158726+0000","last_became_active":"2024-05-07T14:00:55.989455+0000","last_became_peered":"2024-05-07T14:00:55.989455+0000","last_unstale":"2024-05-07T14:01:22.158726+0000","last_undegraded":"2024-05-07T14:01:22.158726+0000","last_fullsized":"2024-05-07T14:01:22.158726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660474+0000","last_change":"2024-05-07T14:00:57.979022+0000","last_active":"2024-05-07T14:01:21.660474+0000","last_peered":"2024-05-07T14:01:21.660474+0000","last_clean":"2024-05-07T14:01:21.660474+0000","last_became_active":"2024-05-07T14:00:57.977403+0000","last_became_peered":"2024-05-07T14:00:57.977403+0000","last_unstale":"2024-05-07T14:01:21.660474+0000","last_undegraded":"2024-05-07T14:01:21.660474+0000","last_fullsized":"2024-05-07T14:01:21.660474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151885+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:01:22.151885+0000","last_peered":"2024-05-07T14:01:22.151885+0000","last_clean":"2024-05-07T14:01:22.151885+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:01:22.151885+0000","last_undegraded":"2024-05-07T14:01:22.151885+0000","last_fullsized":"2024-05-07T14:01:22.151885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157304+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:01:22.157304+0000","last_peered":"2024-05-07T14:01:22.157304+0000","last_clean":"2024-05-07T14:01:22.157304+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:01:22.157304+0000","last_undegraded":"2024-05-07T14:01:22.157304+0000","last_fullsized":"2024-05-07T14:01:22.157304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.662037+0000","last_change":"2024-05-07T14:00:55.978771+0000","last_active":"2024-05-07T14:01:21.662037+0000","last_peered":"2024-05-07T14:01:21.662037+0000","last_clean":"2024-05-07T14:01:21.662037+0000","last_became_active":"2024-05-07T14:00:55.978000+0000","last_became_peered":"2024-05-07T14:00:55.978000+0000","last_unstale":"2024-05-07T14:01:21.662037+0000","last_undegraded":"2024-05-07T14:01:21.662037+0000","last_fullsized":"2024-05-07T14:01:21.662037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.655840+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:01:21.655840+0000","last_peered":"2024-05-07T14:01:21.655840+0000","last_clean":"2024-05-07T14:01:21.655840+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:01:21.655840+0000","last_undegraded":"2024-05-07T14:01:21.655840+0000","last_fullsized":"2024-05-07T14:01:21.655840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159570+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:01:22.159570+0000","last_peered":"2024-05-07T14:01:22.159570+0000","last_clean":"2024-05-07T14:01:22.159570+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:01:22.159570+0000","last_undegraded":"2024-05-07T14:01:22.159570+0000","last_fullsized":"2024-05-07T14:01:22.159570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658828+0000","last_change":"2024-05-07T14:00:57.979073+0000","last_active":"2024-05-07T14:01:21.658828+0000","last_peered":"2024-05-07T14:01:21.658828+0000","last_clean":"2024-05-07T14:01:21.658828+0000","last_became_active":"2024-05-07T14:00:57.978215+0000","last_became_peered":"2024-05-07T14:00:57.978215+0000","last_unstale":"2024-05-07T14:01:21.658828+0000","last_undegraded":"2024-05-07T14:01:21.658828+0000","last_fullsized":"2024-05-07T14:01:21.658828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153207+0000","last_change":"2024-05-07T14:00:56.001199+0000","last_active":"2024-05-07T14:01:22.153207+0000","last_peered":"2024-05-07T14:01:22.153207+0000","last_clean":"2024-05-07T14:01:22.153207+0000","last_became_active":"2024-05-07T14:00:56.000434+0000","last_became_peered":"2024-05-07T14:00:56.000434+0000","last_unstale":"2024-05-07T14:01:22.153207+0000","last_undegraded":"2024-05-07T14:01:22.153207+0000","last_fullsized":"2024-05-07T14:01:22.153207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150613+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:01:22.150613+0000","last_peered":"2024-05-07T14:01:22.150613+0000","last_clean":"2024-05-07T14:01:22.150613+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:01:22.150613+0000","last_undegraded":"2024-05-07T14:01:22.150613+0000","last_fullsized":"2024-05-07T14:01:22.150613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156884+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:01:22.156884+0000","last_peered":"2024-05-07T14:01:22.156884+0000","last_clean":"2024-05-07T14:01:22.156884+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:01:22.156884+0000","last_undegraded":"2024-05-07T14:01:22.156884+0000","last_fullsized":"2024-05-07T14:01:22.156884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156532+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:01:22.156532+0000","last_peered":"2024-05-07T14:01:22.156532+0000","last_clean":"2024-05-07T14:01:22.156532+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:01:22.156532+0000","last_undegraded":"2024-05-07T14:01:22.156532+0000","last_fullsized":"2024-05-07T14:01:22.156532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152212+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:01:22.152212+0000","last_peered":"2024-05-07T14:01:22.152212+0000","last_clean":"2024-05-07T14:01:22.152212+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:01:22.152212+0000","last_undegraded":"2024-05-07T14:01:22.152212+0000","last_fullsized":"2024-05-07T14:01:22.152212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1097728,"data_stored":807769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":209099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":217569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":217232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":217137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":216739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":217984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1081344,"data_stored":807611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:01:23.070 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:01:23.081 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:23.081 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:23.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:01:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.266684523999999, 2024-05-07T14:01:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63420480000000001, 2024-05-07T14:01:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.082 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827477+0000", 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827491+0000", 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3923999999999999e-05 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827514+0000", 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2796e-05 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827531+0000", 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7520000000000002e-05 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827677+0000", 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145408 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827703+0000", 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6704e-05 2024-05-07T14:01:23.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.458662+0000", 2024-05-07T14:01:23.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63095893199999997 2024-05-07T14:01:23.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459006+0000", 2024-05-07T14:01:23.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034329 2024-05-07T14:01:23.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459320+0000", 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031472100000000001 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.460665+0000", 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001344633 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461508+0000", 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084310400000000001 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461608+0000", 2024-05-07T14:01:23.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9481999999999994e-05 2024-05-07T14:01:23.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461680+0000", 2024-05-07T14:01:23.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1976000000000003e-05 2024-05-07T14:01:23.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.088 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.088 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.569624191999999, 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015167432999999999, 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 37 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:01:23.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:01:23.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524536+0000", 2024-05-07T14:01:23.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:01:23.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524542+0000", 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7699999999999998e-06 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524551+0000", 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4199999999999996e-06 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524558+0000", 2024-05-07T14:01:23.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.379e-06 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534146+0000", 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095872700000000002 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534387+0000", 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024181499999999999 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534752+0000", 2024-05-07T14:01:23.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036441400000000002 2024-05-07T14:01:23.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.536608+0000", 2024-05-07T14:01:23.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001856239 2024-05-07T14:01:23.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539547+0000", 2024-05-07T14:01:23.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00293859 2024-05-07T14:01:23.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539639+0000", 2024-05-07T14:01:23.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2548999999999998e-05 2024-05-07T14:01:23.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539703+0000", 2024-05-07T14:01:23.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3330000000000005e-05 2024-05-07T14:01:23.094 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.094 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.095 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.095 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:23.095 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:01:23.095 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.450095888, 2024-05-07T14:01:23.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013763364, 2024-05-07T14:01:23.095 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.095 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.095 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.095 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.095 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.095 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 88 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644064+0000", 2024-05-07T14:01:23.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:01:23.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644070+0000", 2024-05-07T14:01:23.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5500000000000002e-06 2024-05-07T14:01:23.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644079+0000", 2024-05-07T14:01:23.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.55e-06 2024-05-07T14:01:23.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644086+0000", 2024-05-07T14:01:23.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.934e-06 2024-05-07T14:01:23.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655168+0000", 2024-05-07T14:01:23.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011081967 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655307+0000", 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013893600000000001 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655515+0000", 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020742499999999999 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657174+0000", 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016592340000000001 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657576+0000", 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040245400000000001 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657723+0000", 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014719200000000001 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657827+0000", 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103319 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.283560702999999, 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014874368000000001, 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.101 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 108 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:01:23.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:01:23.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0699999999999996e-07 2024-05-07T14:01:23.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810608+0000", 2024-05-07T14:01:23.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6330000000000002e-06 2024-05-07T14:01:23.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810618+0000", 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0366999999999999e-05 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810626+0000", 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7430000000000002e-06 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818597+0000", 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079710549999999995 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818873+0000", 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027635099999999998 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.819288+0000", 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041430599999999997 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822081+0000", 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002793032 2024-05-07T14:01:23.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825193+0000", 2024-05-07T14:01:23.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003112606 2024-05-07T14:01:23.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825361+0000", 2024-05-07T14:01:23.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167703 2024-05-07T14:01:23.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825473+0000", 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111865 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.283411381000001, 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015242152, 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.107 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 109 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810749+0000", 2024-05-07T14:01:23.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-06 2024-05-07T14:01:23.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810943+0000", 2024-05-07T14:01:23.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019437499999999999 2024-05-07T14:01:23.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810959+0000", 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5440000000000001e-05 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810971+0000", 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2023e-05 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820386+0000", 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094148570000000004 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820569+0000", 2024-05-07T14:01:23.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018298199999999999 2024-05-07T14:01:23.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820827+0000", 2024-05-07T14:01:23.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025869400000000001 2024-05-07T14:01:23.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825585+0000", 2024-05-07T14:01:23.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004757051 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825752+0000", 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167479 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825881+0000", 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128629 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825990+0000", 2024-05-07T14:01:23.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109415 2024-05-07T14:01:23.113 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.113 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.113 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.113 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:23.113 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:01:23.113 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.283169029, 2024-05-07T14:01:23.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015251472, 2024-05-07T14:01:23.113 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.113 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.113 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 110 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810991+0000", 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7600000000000006e-07 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810998+0000", 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3899999999999998e-06 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811007+0000", 2024-05-07T14:01:23.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5869999999999999e-06 2024-05-07T14:01:23.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811014+0000", 2024-05-07T14:01:23.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:01:23.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822508+0000", 2024-05-07T14:01:23.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01149416 2024-05-07T14:01:23.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822698+0000", 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018972600000000001 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823009+0000", 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031125100000000002 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825710+0000", 2024-05-07T14:01:23.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002700619 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826014+0000", 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030398799999999999 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826137+0000", 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123416 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826242+0000", 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104279 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.283134128999997, 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017650448999999999, 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.119 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 111 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:01:23.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811026+0000", 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5300000000000004e-07 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811031+0000", 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0329999999999999e-06 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811043+0000", 2024-05-07T14:01:23.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2543e-05 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811050+0000", 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8000000000000001e-06 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823676+0000", 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012626052 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823904+0000", 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227562 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.824349+0000", 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044484 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826371+0000", 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020221380000000001 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828408+0000", 2024-05-07T14:01:23.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020372369999999999 2024-05-07T14:01:23.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828540+0000", 2024-05-07T14:01:23.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013213600000000001 2024-05-07T14:01:23.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828676+0000", 2024-05-07T14:01:23.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013545500000000001 2024-05-07T14:01:23.124 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.283072713999999, 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021330954999999999, 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.125 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.126 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 112 2024-05-07T14:01:23.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.126 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:01:23.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:01:23.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-07 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811224+0000", 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653499999999999 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811237+0000", 2024-05-07T14:01:23.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.271e-05 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811245+0000", 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6400000000000003e-06 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826483+0000", 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015237456 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826705+0000", 2024-05-07T14:01:23.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022216799999999999 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.827081+0000", 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037659800000000002 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.831960+0000", 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048788779999999997 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832167+0000", 2024-05-07T14:01:23.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020690500000000001 2024-05-07T14:01:23.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832305+0000", 2024-05-07T14:01:23.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013801899999999999 2024-05-07T14:01:23.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832418+0000", 2024-05-07T14:01:23.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112212 2024-05-07T14:01:23.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.130 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.282899205, 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021403628000000001, 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.131 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 113 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811261+0000", 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0400000000000005e-07 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811267+0000", 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6099999999999997e-06 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811276+0000", 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4029999999999996e-06 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811283+0000", 2024-05-07T14:01:23.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:01:23.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828825+0000", 2024-05-07T14:01:23.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017541853999999999 2024-05-07T14:01:23.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829061+0000", 2024-05-07T14:01:23.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235861 2024-05-07T14:01:23.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829418+0000", 2024-05-07T14:01:23.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035766800000000001 2024-05-07T14:01:23.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832130+0000", 2024-05-07T14:01:23.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027118120000000001 2024-05-07T14:01:23.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832442+0000", 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000311611 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832565+0000", 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012284199999999999 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832664+0000", 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8982999999999997e-05 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.137 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:23.137 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:01:23.137 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.282865215000001, 2024-05-07T14:01:23.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023518260999999999, 2024-05-07T14:01:23.137 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.137 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.137 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.137 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.137 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.137 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.137 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 114 2024-05-07T14:01:23.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.138 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:01:23.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:01:23.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811295+0000", 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811301+0000", 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8599999999999998e-06 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811310+0000", 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0299999999999999e-06 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811320+0000", 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023e-05 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830314+0000", 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018994385999999999 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830552+0000", 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023815500000000001 2024-05-07T14:01:23.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830971+0000", 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041934300000000003 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834620+0000", 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036481389999999999 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834666+0000", 2024-05-07T14:01:23.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6266000000000001e-05 2024-05-07T14:01:23.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834742+0000", 2024-05-07T14:01:23.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6069000000000006e-05 2024-05-07T14:01:23.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834812+0000", 2024-05-07T14:01:23.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0372999999999999e-05 2024-05-07T14:01:23.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.142 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.282824656000003, 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027863941999999999, 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 115 2024-05-07T14:01:23.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:01:23.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2699999999999999e-07 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811469+0000", 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133332 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811502+0000", 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3027000000000001e-05 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811511+0000", 2024-05-07T14:01:23.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.713e-06 2024-05-07T14:01:23.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832759+0000", 2024-05-07T14:01:23.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021248185999999999 2024-05-07T14:01:23.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832917+0000", 2024-05-07T14:01:23.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157825 2024-05-07T14:01:23.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.833269+0000", 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035184099999999998 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838250+0000", 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004980712 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838941+0000", 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069081399999999999 2024-05-07T14:01:23.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839091+0000", 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149903 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839199+0000", 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010796199999999999 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.282630793000003, 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028128562999999999, 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 116 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:01:23.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:01:23.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811529+0000", 2024-05-07T14:01:23.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:01:23.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811546+0000", 2024-05-07T14:01:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7113e-05 2024-05-07T14:01:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811570+0000", 2024-05-07T14:01:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.406e-05 2024-05-07T14:01:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811578+0000", 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8660000000000006e-06 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834997+0000", 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023418799000000001 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835317+0000", 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031991799999999998 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835662+0000", 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034544399999999998 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839220+0000", 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035576959999999999 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839374+0000", 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015427600000000001 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839540+0000", 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016534500000000001 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839657+0000", 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117243 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.154 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.282567780999997, 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02858051, 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 117 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:01:23.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:01:23.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811592+0000", 2024-05-07T14:01:23.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:01:23.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811601+0000", 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1269999999999992e-06 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811611+0000", 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6900000000000004e-06 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811618+0000", 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0770000000000002e-06 2024-05-07T14:01:23.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836766+0000", 2024-05-07T14:01:23.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025147966000000001 2024-05-07T14:01:23.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836982+0000", 2024-05-07T14:01:23.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021640400000000001 2024-05-07T14:01:23.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.837283+0000", 2024-05-07T14:01:23.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030005800000000002 2024-05-07T14:01:23.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839885+0000", 2024-05-07T14:01:23.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002602937 2024-05-07T14:01:23.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839925+0000", 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9446000000000001e-05 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840061+0000", 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136043 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840172+0000", 2024-05-07T14:01:23.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111019 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.794999783000002, 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014903938, 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.164 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 137 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299160+0000", 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4400000000000001e-07 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299232+0000", 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2348000000000006e-05 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299251+0000", 2024-05-07T14:01:23.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9086e-05 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299258+0000", 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0659999999999998e-06 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306394+0000", 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071357629999999998 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306491+0000", 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6526000000000004e-05 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306652+0000", 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000161674 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312756+0000", 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061035860000000003 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313919+0000", 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011630919999999999 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314000+0000", 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1037000000000004e-05 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314063+0000", 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3316000000000002e-05 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.169 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.794887825000004, 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01524198, 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.170 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 138 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299272+0000", 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8599999999999998e-07 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299282+0000", 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0051000000000001e-05 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299297+0000", 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5125e-05 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299302+0000", 2024-05-07T14:01:23.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2119999999999997e-06 2024-05-07T14:01:23.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309582+0000", 2024-05-07T14:01:23.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010280163 2024-05-07T14:01:23.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309722+0000", 2024-05-07T14:01:23.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140715 2024-05-07T14:01:23.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309941+0000", 2024-05-07T14:01:23.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000218249 2024-05-07T14:01:23.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313900+0000", 2024-05-07T14:01:23.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039598080000000004 2024-05-07T14:01:23.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314411+0000", 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051060400000000001 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314466+0000", 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4861000000000002e-05 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314513+0000", 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7506000000000002e-05 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.175 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.794849524, 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01724038, 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 139 2024-05-07T14:01:23.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3099999999999998e-07 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299313+0000", 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9390000000000002e-06 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299318+0000", 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5909999999999998e-06 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299321+0000", 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3890000000000001e-06 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310603+0000", 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011281753 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310704+0000", 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010111900000000001 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310888+0000", 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183666 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314523+0000", 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036354999999999998 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316436+0000", 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001913238 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316501+0000", 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4261e-05 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316550+0000", 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9493000000000002e-05 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.181 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:23.182 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:01:23.182 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.794829194000002, 2024-05-07T14:01:23.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019781539000000001, 2024-05-07T14:01:23.182 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.182 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.182 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.182 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.182 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.182 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.182 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 140 2024-05-07T14:01:23.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.182 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-07 2024-05-07T14:01:23.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299398+0000", 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7822000000000002e-05 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299404+0000", 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2369999999999997e-06 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299409+0000", 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2069999999999997e-06 2024-05-07T14:01:23.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311355+0000", 2024-05-07T14:01:23.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011946082 2024-05-07T14:01:23.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311493+0000", 2024-05-07T14:01:23.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013830900000000001 2024-05-07T14:01:23.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311709+0000", 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021606899999999999 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314528+0000", 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028193839999999999 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319001+0000", 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004472218 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319063+0000", 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1940000000000007e-05 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319112+0000", 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8964000000000001e-05 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:23.187 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.794742829, 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019944718, 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 141 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299417+0000", 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7099999999999997e-07 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299420+0000", 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8629999999999999e-06 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299424+0000", 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4830000000000001e-06 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299429+0000", 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6609999999999999e-06 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312813+0000", 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013384330999999999 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312948+0000", 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000135239 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313163+0000", 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000214718 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314534+0000", 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013704430000000001 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319185+0000", 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046516839999999997 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319281+0000", 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5645999999999999e-05 2024-05-07T14:01:23.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319361+0000", 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0278999999999995e-05 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.082490331000002, 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013780794000000001, 2024-05-07T14:01:23.193 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 158 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011670+0000", 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011817+0000", 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014761200000000001 2024-05-07T14:01:23.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011830+0000", 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2653999999999999e-05 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011844+0000", 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4039999999999999e-05 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020200+0000", 2024-05-07T14:01:23.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083561409999999992 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020433+0000", 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000233088 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020662+0000", 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000229015 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023097+0000", 2024-05-07T14:01:23.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024346480000000002 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025218+0000", 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021216669999999998 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025350+0000", 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013124600000000001 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025450+0000", 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010002599999999999 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.082299814999999, 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013831896, 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.199 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 159 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:01:23.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011860+0000", 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8999999999999995e-07 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011874+0000", 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3806e-05 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:23.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011884+0000", 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5629999999999998e-06 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011894+0000", 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0353999999999999e-05 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023169+0000", 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011274872 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023305+0000", 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653299999999999 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023505+0000", 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000199254 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.024966+0000", 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014616830000000001 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025472+0000", 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00050618899999999999 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025593+0000", 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120019 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025691+0000", 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8832999999999994e-05 2024-05-07T14:01:23.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:23.205 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:23.205 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:23.207 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:01:23.207 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:23.221+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:23.307 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:23.321+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:23.333 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:23.333 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:23.350 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:01:23.408 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:23.421+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:23.463 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:23.463 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:23.464 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:23.464 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:23.464 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:23.478 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:01:23.509 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:23.521+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:23.543 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:01:23.549 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:01:23.561 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-05-07T14:01:23.225987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225332,"kb_used_data":4988,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749388,"statfs":{"total":773094113280,"available":772863373312,"internally_reserved":0,"allocated":5107712,"data_stored":2911140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001188"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.663192+0000","last_change":"2024-05-07T14:00:55.983744+0000","last_active":"2024-05-07T14:01:21.663192+0000","last_peered":"2024-05-07T14:01:21.663192+0000","last_clean":"2024-05-07T14:01:21.663192+0000","last_became_active":"2024-05-07T14:00:55.982993+0000","last_became_peered":"2024-05-07T14:00:55.982993+0000","last_unstale":"2024-05-07T14:01:21.663192+0000","last_undegraded":"2024-05-07T14:01:21.663192+0000","last_fullsized":"2024-05-07T14:01:21.663192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.149812+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:01:22.149812+0000","last_peered":"2024-05-07T14:01:22.149812+0000","last_clean":"2024-05-07T14:01:22.149812+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:01:22.149812+0000","last_undegraded":"2024-05-07T14:01:22.149812+0000","last_fullsized":"2024-05-07T14:01:22.149812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159397+0000","last_change":"2024-05-07T14:00:55.973967+0000","last_active":"2024-05-07T14:01:22.159397+0000","last_peered":"2024-05-07T14:01:22.159397+0000","last_clean":"2024-05-07T14:01:22.159397+0000","last_became_active":"2024-05-07T14:00:55.973677+0000","last_became_peered":"2024-05-07T14:00:55.973677+0000","last_unstale":"2024-05-07T14:01:22.159397+0000","last_undegraded":"2024-05-07T14:01:22.159397+0000","last_fullsized":"2024-05-07T14:01:22.159397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659355+0000","last_change":"2024-05-07T14:00:57.988092+0000","last_active":"2024-05-07T14:01:21.659355+0000","last_peered":"2024-05-07T14:01:21.659355+0000","last_clean":"2024-05-07T14:01:21.659355+0000","last_became_active":"2024-05-07T14:00:57.987091+0000","last_became_peered":"2024-05-07T14:00:57.987091+0000","last_unstale":"2024-05-07T14:01:21.659355+0000","last_undegraded":"2024-05-07T14:01:21.659355+0000","last_fullsized":"2024-05-07T14:01:21.659355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162495+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:01:22.162495+0000","last_peered":"2024-05-07T14:01:22.162495+0000","last_clean":"2024-05-07T14:01:22.162495+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:01:22.162495+0000","last_undegraded":"2024-05-07T14:01:22.162495+0000","last_fullsized":"2024-05-07T14:01:22.162495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656998+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:01:21.656998+0000","last_peered":"2024-05-07T14:01:21.656998+0000","last_clean":"2024-05-07T14:01:21.656998+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:01:21.656998+0000","last_undegraded":"2024-05-07T14:01:21.656998+0000","last_fullsized":"2024-05-07T14:01:21.656998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151914+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:01:22.151914+0000","last_peered":"2024-05-07T14:01:22.151914+0000","last_clean":"2024-05-07T14:01:22.151914+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:01:22.151914+0000","last_undegraded":"2024-05-07T14:01:22.151914+0000","last_fullsized":"2024-05-07T14:01:22.151914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156718+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:01:22.156718+0000","last_peered":"2024-05-07T14:01:22.156718+0000","last_clean":"2024-05-07T14:01:22.156718+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:01:22.156718+0000","last_undegraded":"2024-05-07T14:01:22.156718+0000","last_fullsized":"2024-05-07T14:01:22.156718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660574+0000","last_change":"2024-05-07T14:00:55.973419+0000","last_active":"2024-05-07T14:01:21.660574+0000","last_peered":"2024-05-07T14:01:21.660574+0000","last_clean":"2024-05-07T14:01:21.660574+0000","last_became_active":"2024-05-07T14:00:55.963467+0000","last_became_peered":"2024-05-07T14:00:55.963467+0000","last_unstale":"2024-05-07T14:01:21.660574+0000","last_undegraded":"2024-05-07T14:01:21.660574+0000","last_fullsized":"2024-05-07T14:01:21.660574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151722+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:01:22.151722+0000","last_peered":"2024-05-07T14:01:22.151722+0000","last_clean":"2024-05-07T14:01:22.151722+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:01:22.151722+0000","last_undegraded":"2024-05-07T14:01:22.151722+0000","last_fullsized":"2024-05-07T14:01:22.151722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150408+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:01:22.150408+0000","last_peered":"2024-05-07T14:01:22.150408+0000","last_clean":"2024-05-07T14:01:22.150408+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:01:22.150408+0000","last_undegraded":"2024-05-07T14:01:22.150408+0000","last_fullsized":"2024-05-07T14:01:22.150408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660585+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:01:21.660585+0000","last_peered":"2024-05-07T14:01:21.660585+0000","last_clean":"2024-05-07T14:01:21.660585+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:01:21.660585+0000","last_undegraded":"2024-05-07T14:01:21.660585+0000","last_fullsized":"2024-05-07T14:01:21.660585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659506+0000","last_change":"2024-05-07T14:00:55.962579+0000","last_active":"2024-05-07T14:01:21.659506+0000","last_peered":"2024-05-07T14:01:21.659506+0000","last_clean":"2024-05-07T14:01:21.659506+0000","last_became_active":"2024-05-07T14:00:55.961815+0000","last_became_peered":"2024-05-07T14:00:55.961815+0000","last_unstale":"2024-05-07T14:01:21.659506+0000","last_undegraded":"2024-05-07T14:01:21.659506+0000","last_fullsized":"2024-05-07T14:01:21.659506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152062+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:01:22.152062+0000","last_peered":"2024-05-07T14:01:22.152062+0000","last_clean":"2024-05-07T14:01:22.152062+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:01:22.152062+0000","last_undegraded":"2024-05-07T14:01:22.152062+0000","last_fullsized":"2024-05-07T14:01:22.152062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656484+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:01:21.656484+0000","last_peered":"2024-05-07T14:01:21.656484+0000","last_clean":"2024-05-07T14:01:21.656484+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:01:21.656484+0000","last_undegraded":"2024-05-07T14:01:21.656484+0000","last_fullsized":"2024-05-07T14:01:21.656484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151870+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:01:22.151870+0000","last_peered":"2024-05-07T14:01:22.151870+0000","last_clean":"2024-05-07T14:01:22.151870+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:01:22.151870+0000","last_undegraded":"2024-05-07T14:01:22.151870+0000","last_fullsized":"2024-05-07T14:01:22.151870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656488+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:01:21.656488+0000","last_peered":"2024-05-07T14:01:21.656488+0000","last_clean":"2024-05-07T14:01:21.656488+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:01:21.656488+0000","last_undegraded":"2024-05-07T14:01:21.656488+0000","last_fullsized":"2024-05-07T14:01:21.656488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.663296+0000","last_change":"2024-05-07T14:00:56.003776+0000","last_active":"2024-05-07T14:01:21.663296+0000","last_peered":"2024-05-07T14:01:21.663296+0000","last_clean":"2024-05-07T14:01:21.663296+0000","last_became_active":"2024-05-07T14:00:56.002996+0000","last_became_peered":"2024-05-07T14:00:56.002996+0000","last_unstale":"2024-05-07T14:01:21.663296+0000","last_undegraded":"2024-05-07T14:01:21.663296+0000","last_fullsized":"2024-05-07T14:01:21.663296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:17.583140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659430+0000","last_change":"2024-05-07T14:00:57.987026+0000","last_active":"2024-05-07T14:01:21.659430+0000","last_peered":"2024-05-07T14:01:21.659430+0000","last_clean":"2024-05-07T14:01:21.659430+0000","last_became_active":"2024-05-07T14:00:57.986048+0000","last_became_peered":"2024-05-07T14:00:57.986048+0000","last_unstale":"2024-05-07T14:01:21.659430+0000","last_undegraded":"2024-05-07T14:01:21.659430+0000","last_fullsized":"2024-05-07T14:01:21.659430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150989+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:01:22.150989+0000","last_peered":"2024-05-07T14:01:22.150989+0000","last_clean":"2024-05-07T14:01:22.150989+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:01:22.150989+0000","last_undegraded":"2024-05-07T14:01:22.150989+0000","last_fullsized":"2024-05-07T14:01:22.150989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150579+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:01:22.150579+0000","last_peered":"2024-05-07T14:01:22.150579+0000","last_clean":"2024-05-07T14:01:22.150579+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:01:22.150579+0000","last_undegraded":"2024-05-07T14:01:22.150579+0000","last_fullsized":"2024-05-07T14:01:22.150579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152828+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:01:22.152828+0000","last_peered":"2024-05-07T14:01:22.152828+0000","last_clean":"2024-05-07T14:01:22.152828+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:01:22.152828+0000","last_undegraded":"2024-05-07T14:01:22.152828+0000","last_fullsized":"2024-05-07T14:01:22.152828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151791+0000","last_change":"2024-05-07T14:00:57.995304+0000","last_active":"2024-05-07T14:01:22.151791+0000","last_peered":"2024-05-07T14:01:22.151791+0000","last_clean":"2024-05-07T14:01:22.151791+0000","last_became_active":"2024-05-07T14:00:57.977809+0000","last_became_peered":"2024-05-07T14:00:57.977809+0000","last_unstale":"2024-05-07T14:01:22.151791+0000","last_undegraded":"2024-05-07T14:01:22.151791+0000","last_fullsized":"2024-05-07T14:01:22.151791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:42.772959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658249+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:01:21.658249+0000","last_peered":"2024-05-07T14:01:21.658249+0000","last_clean":"2024-05-07T14:01:21.658249+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:01:21.658249+0000","last_undegraded":"2024-05-07T14:01:21.658249+0000","last_fullsized":"2024-05-07T14:01:21.658249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153685+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:01:22.153685+0000","last_peered":"2024-05-07T14:01:22.153685+0000","last_clean":"2024-05-07T14:01:22.153685+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:01:22.153685+0000","last_undegraded":"2024-05-07T14:01:22.153685+0000","last_fullsized":"2024-05-07T14:01:22.153685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657046+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:01:21.657046+0000","last_peered":"2024-05-07T14:01:21.657046+0000","last_clean":"2024-05-07T14:01:21.657046+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:01:21.657046+0000","last_undegraded":"2024-05-07T14:01:21.657046+0000","last_fullsized":"2024-05-07T14:01:21.657046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660797+0000","last_change":"2024-05-07T14:00:58.008214+0000","last_active":"2024-05-07T14:01:21.660797+0000","last_peered":"2024-05-07T14:01:21.660797+0000","last_clean":"2024-05-07T14:01:21.660797+0000","last_became_active":"2024-05-07T14:00:58.005516+0000","last_became_peered":"2024-05-07T14:00:58.005516+0000","last_unstale":"2024-05-07T14:01:21.660797+0000","last_undegraded":"2024-05-07T14:01:21.660797+0000","last_fullsized":"2024-05-07T14:01:21.660797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158327+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:01:22.158327+0000","last_peered":"2024-05-07T14:01:22.158327+0000","last_clean":"2024-05-07T14:01:22.158327+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:01:22.158327+0000","last_undegraded":"2024-05-07T14:01:22.158327+0000","last_fullsized":"2024-05-07T14:01:22.158327+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656163+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:01:21.656163+0000","last_peered":"2024-05-07T14:01:21.656163+0000","last_clean":"2024-05-07T14:01:21.656163+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:01:21.656163+0000","last_undegraded":"2024-05-07T14:01:21.656163+0000","last_fullsized":"2024-05-07T14:01:21.656163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658102+0000","last_change":"2024-05-07T14:00:57.988107+0000","last_active":"2024-05-07T14:01:21.658102+0000","last_peered":"2024-05-07T14:01:21.658102+0000","last_clean":"2024-05-07T14:01:21.658102+0000","last_became_active":"2024-05-07T14:00:57.987604+0000","last_became_peered":"2024-05-07T14:00:57.987604+0000","last_unstale":"2024-05-07T14:01:21.658102+0000","last_undegraded":"2024-05-07T14:01:21.658102+0000","last_fullsized":"2024-05-07T14:01:21.658102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660726+0000","last_change":"2024-05-07T14:00:55.975648+0000","last_active":"2024-05-07T14:01:21.660726+0000","last_peered":"2024-05-07T14:01:21.660726+0000","last_clean":"2024-05-07T14:01:21.660726+0000","last_became_active":"2024-05-07T14:00:55.974335+0000","last_became_peered":"2024-05-07T14:00:55.974335+0000","last_unstale":"2024-05-07T14:01:21.660726+0000","last_undegraded":"2024-05-07T14:01:21.660726+0000","last_fullsized":"2024-05-07T14:01:21.660726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152841+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:01:22.152841+0000","last_peered":"2024-05-07T14:01:22.152841+0000","last_clean":"2024-05-07T14:01:22.152841+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:01:22.152841+0000","last_undegraded":"2024-05-07T14:01:22.152841+0000","last_fullsized":"2024-05-07T14:01:22.152841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154625+0000","last_change":"2024-05-07T14:01:01.993679+0000","last_active":"2024-05-07T14:01:22.154625+0000","last_peered":"2024-05-07T14:01:22.154625+0000","last_clean":"2024-05-07T14:01:22.154625+0000","last_became_active":"2024-05-07T14:01:01.993241+0000","last_became_peered":"2024-05-07T14:01:01.993241+0000","last_unstale":"2024-05-07T14:01:22.154625+0000","last_undegraded":"2024-05-07T14:01:22.154625+0000","last_fullsized":"2024-05-07T14:01:22.154625+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.662948+0000","last_change":"2024-05-07T14:01:04.017472+0000","last_active":"2024-05-07T14:01:21.662948+0000","last_peered":"2024-05-07T14:01:21.662948+0000","last_clean":"2024-05-07T14:01:21.662948+0000","last_became_active":"2024-05-07T14:01:04.016757+0000","last_became_peered":"2024-05-07T14:01:04.016757+0000","last_unstale":"2024-05-07T14:01:21.662948+0000","last_undegraded":"2024-05-07T14:01:21.662948+0000","last_fullsized":"2024-05-07T14:01:21.662948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150021+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:01:22.150021+0000","last_peered":"2024-05-07T14:01:22.150021+0000","last_clean":"2024-05-07T14:01:22.150021+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:01:22.150021+0000","last_undegraded":"2024-05-07T14:01:22.150021+0000","last_fullsized":"2024-05-07T14:01:22.150021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152331+0000","last_change":"2024-05-07T14:00:57.984789+0000","last_active":"2024-05-07T14:01:22.152331+0000","last_peered":"2024-05-07T14:01:22.152331+0000","last_clean":"2024-05-07T14:01:22.152331+0000","last_became_active":"2024-05-07T14:00:57.983524+0000","last_became_peered":"2024-05-07T14:00:57.983524+0000","last_unstale":"2024-05-07T14:01:22.152331+0000","last_undegraded":"2024-05-07T14:01:22.152331+0000","last_fullsized":"2024-05-07T14:01:22.152331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158625+0000","last_change":"2024-05-07T14:00:55.989797+0000","last_active":"2024-05-07T14:01:22.158625+0000","last_peered":"2024-05-07T14:01:22.158625+0000","last_clean":"2024-05-07T14:01:22.158625+0000","last_became_active":"2024-05-07T14:00:55.989449+0000","last_became_peered":"2024-05-07T14:00:55.989449+0000","last_unstale":"2024-05-07T14:01:22.158625+0000","last_undegraded":"2024-05-07T14:01:22.158625+0000","last_fullsized":"2024-05-07T14:01:22.158625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657985+0000","last_change":"2024-05-07T14:00:59.983880+0000","last_active":"2024-05-07T14:01:21.657985+0000","last_peered":"2024-05-07T14:01:21.657985+0000","last_clean":"2024-05-07T14:01:21.657985+0000","last_became_active":"2024-05-07T14:00:59.983186+0000","last_became_peered":"2024-05-07T14:00:59.983186+0000","last_unstale":"2024-05-07T14:01:21.657985+0000","last_undegraded":"2024-05-07T14:01:21.657985+0000","last_fullsized":"2024-05-07T14:01:21.657985+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:27.067433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658250+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:01:21.658250+0000","last_peered":"2024-05-07T14:01:21.658250+0000","last_clean":"2024-05-07T14:01:21.658250+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:01:21.658250+0000","last_undegraded":"2024-05-07T14:01:21.658250+0000","last_fullsized":"2024-05-07T14:01:21.658250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660422+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:01:21.660422+0000","last_peered":"2024-05-07T14:01:21.660422+0000","last_clean":"2024-05-07T14:01:21.660422+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:01:21.660422+0000","last_undegraded":"2024-05-07T14:01:21.660422+0000","last_fullsized":"2024-05-07T14:01:21.660422+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156973+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:01:22.156973+0000","last_peered":"2024-05-07T14:01:22.156973+0000","last_clean":"2024-05-07T14:01:22.156973+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:01:22.156973+0000","last_undegraded":"2024-05-07T14:01:22.156973+0000","last_fullsized":"2024-05-07T14:01:22.156973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152356+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:01:22.152356+0000","last_peered":"2024-05-07T14:01:22.152356+0000","last_clean":"2024-05-07T14:01:22.152356+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:01:22.152356+0000","last_undegraded":"2024-05-07T14:01:22.152356+0000","last_fullsized":"2024-05-07T14:01:22.152356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659583+0000","last_change":"2024-05-07T14:00:55.986233+0000","last_active":"2024-05-07T14:01:21.659583+0000","last_peered":"2024-05-07T14:01:21.659583+0000","last_clean":"2024-05-07T14:01:21.659583+0000","last_became_active":"2024-05-07T14:00:55.984927+0000","last_became_peered":"2024-05-07T14:00:55.984927+0000","last_unstale":"2024-05-07T14:01:21.659583+0000","last_undegraded":"2024-05-07T14:01:21.659583+0000","last_fullsized":"2024-05-07T14:01:21.659583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658521+0000","last_change":"2024-05-07T14:00:59.992166+0000","last_active":"2024-05-07T14:01:21.658521+0000","last_peered":"2024-05-07T14:01:21.658521+0000","last_clean":"2024-05-07T14:01:21.658521+0000","last_became_active":"2024-05-07T14:00:59.991408+0000","last_became_peered":"2024-05-07T14:00:59.991408+0000","last_unstale":"2024-05-07T14:01:21.658521+0000","last_undegraded":"2024-05-07T14:01:21.658521+0000","last_fullsized":"2024-05-07T14:01:21.658521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156809+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:01:22.156809+0000","last_peered":"2024-05-07T14:01:22.156809+0000","last_clean":"2024-05-07T14:01:22.156809+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:01:22.156809+0000","last_undegraded":"2024-05-07T14:01:22.156809+0000","last_fullsized":"2024-05-07T14:01:22.156809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661139+0000","last_change":"2024-05-07T14:01:04.007238+0000","last_active":"2024-05-07T14:01:21.661139+0000","last_peered":"2024-05-07T14:01:21.661139+0000","last_clean":"2024-05-07T14:01:21.661139+0000","last_became_active":"2024-05-07T14:01:04.006204+0000","last_became_peered":"2024-05-07T14:01:04.006204+0000","last_unstale":"2024-05-07T14:01:21.661139+0000","last_undegraded":"2024-05-07T14:01:21.661139+0000","last_fullsized":"2024-05-07T14:01:21.661139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657404+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:01:21.657404+0000","last_peered":"2024-05-07T14:01:21.657404+0000","last_clean":"2024-05-07T14:01:21.657404+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:01:21.657404+0000","last_undegraded":"2024-05-07T14:01:21.657404+0000","last_fullsized":"2024-05-07T14:01:21.657404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658257+0000","last_change":"2024-05-07T14:00:57.998824+0000","last_active":"2024-05-07T14:01:21.658257+0000","last_peered":"2024-05-07T14:01:21.658257+0000","last_clean":"2024-05-07T14:01:21.658257+0000","last_became_active":"2024-05-07T14:00:57.998316+0000","last_became_peered":"2024-05-07T14:00:57.998316+0000","last_unstale":"2024-05-07T14:01:21.658257+0000","last_undegraded":"2024-05-07T14:01:21.658257+0000","last_fullsized":"2024-05-07T14:01:21.658257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151594+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:01:22.151594+0000","last_peered":"2024-05-07T14:01:22.151594+0000","last_clean":"2024-05-07T14:01:22.151594+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:01:22.151594+0000","last_undegraded":"2024-05-07T14:01:22.151594+0000","last_fullsized":"2024-05-07T14:01:22.151594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152057+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:01:22.152057+0000","last_peered":"2024-05-07T14:01:22.152057+0000","last_clean":"2024-05-07T14:01:22.152057+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:01:22.152057+0000","last_undegraded":"2024-05-07T14:01:22.152057+0000","last_fullsized":"2024-05-07T14:01:22.152057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661401+0000","last_change":"2024-05-07T14:01:02.151107+0000","last_active":"2024-05-07T14:01:21.661401+0000","last_peered":"2024-05-07T14:01:21.661401+0000","last_clean":"2024-05-07T14:01:21.661401+0000","last_became_active":"2024-05-07T14:01:02.150351+0000","last_became_peered":"2024-05-07T14:01:02.150351+0000","last_unstale":"2024-05-07T14:01:21.661401+0000","last_undegraded":"2024-05-07T14:01:21.661401+0000","last_fullsized":"2024-05-07T14:01:21.661401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:28:13.159757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657803+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:01:21.657803+0000","last_peered":"2024-05-07T14:01:21.657803+0000","last_clean":"2024-05-07T14:01:21.657803+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:01:21.657803+0000","last_undegraded":"2024-05-07T14:01:21.657803+0000","last_fullsized":"2024-05-07T14:01:21.657803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.149686+0000","last_change":"2024-05-07T14:00:57.979757+0000","last_active":"2024-05-07T14:01:22.149686+0000","last_peered":"2024-05-07T14:01:22.149686+0000","last_clean":"2024-05-07T14:01:22.149686+0000","last_became_active":"2024-05-07T14:00:57.979030+0000","last_became_peered":"2024-05-07T14:00:57.979030+0000","last_unstale":"2024-05-07T14:01:22.149686+0000","last_undegraded":"2024-05-07T14:01:22.149686+0000","last_fullsized":"2024-05-07T14:01:22.149686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.663399+0000","last_change":"2024-05-07T14:00:55.980339+0000","last_active":"2024-05-07T14:01:21.663399+0000","last_peered":"2024-05-07T14:01:21.663399+0000","last_clean":"2024-05-07T14:01:21.663399+0000","last_became_active":"2024-05-07T14:00:55.979609+0000","last_became_peered":"2024-05-07T14:00:55.979609+0000","last_unstale":"2024-05-07T14:01:21.663399+0000","last_undegraded":"2024-05-07T14:01:21.663399+0000","last_fullsized":"2024-05-07T14:01:21.663399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:52.518278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659139+0000","last_change":"2024-05-07T14:00:59.982771+0000","last_active":"2024-05-07T14:01:21.659139+0000","last_peered":"2024-05-07T14:01:21.659139+0000","last_clean":"2024-05-07T14:01:21.659139+0000","last_became_active":"2024-05-07T14:00:59.982018+0000","last_became_peered":"2024-05-07T14:00:59.982018+0000","last_unstale":"2024-05-07T14:01:21.659139+0000","last_undegraded":"2024-05-07T14:01:21.659139+0000","last_fullsized":"2024-05-07T14:01:21.659139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:47.657483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150103+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:01:22.150103+0000","last_peered":"2024-05-07T14:01:22.150103+0000","last_clean":"2024-05-07T14:01:22.150103+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:01:22.150103+0000","last_undegraded":"2024-05-07T14:01:22.150103+0000","last_fullsized":"2024-05-07T14:01:22.150103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156994+0000","last_change":"2024-05-07T14:01:04.021895+0000","last_active":"2024-05-07T14:01:22.156994+0000","last_peered":"2024-05-07T14:01:22.156994+0000","last_clean":"2024-05-07T14:01:22.156994+0000","last_became_active":"2024-05-07T14:01:04.021043+0000","last_became_peered":"2024-05-07T14:01:04.021043+0000","last_unstale":"2024-05-07T14:01:22.156994+0000","last_undegraded":"2024-05-07T14:01:22.156994+0000","last_fullsized":"2024-05-07T14:01:22.156994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:58.601458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.149826+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:01:22.149826+0000","last_peered":"2024-05-07T14:01:22.149826+0000","last_clean":"2024-05-07T14:01:22.149826+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:01:22.149826+0000","last_undegraded":"2024-05-07T14:01:22.149826+0000","last_fullsized":"2024-05-07T14:01:22.149826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657349+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:01:21.657349+0000","last_peered":"2024-05-07T14:01:21.657349+0000","last_clean":"2024-05-07T14:01:21.657349+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:01:21.657349+0000","last_undegraded":"2024-05-07T14:01:21.657349+0000","last_fullsized":"2024-05-07T14:01:21.657349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.662691+0000","last_change":"2024-05-07T14:00:55.980488+0000","last_active":"2024-05-07T14:01:21.662691+0000","last_peered":"2024-05-07T14:01:21.662691+0000","last_clean":"2024-05-07T14:01:21.662691+0000","last_became_active":"2024-05-07T14:00:55.979688+0000","last_became_peered":"2024-05-07T14:00:55.979688+0000","last_unstale":"2024-05-07T14:01:21.662691+0000","last_undegraded":"2024-05-07T14:01:21.662691+0000","last_fullsized":"2024-05-07T14:01:21.662691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:32.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152520+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:01:22.152520+0000","last_peered":"2024-05-07T14:01:22.152520+0000","last_clean":"2024-05-07T14:01:22.152520+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:01:22.152520+0000","last_undegraded":"2024-05-07T14:01:22.152520+0000","last_fullsized":"2024-05-07T14:01:22.152520+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657262+0000","last_change":"2024-05-07T14:01:02.014265+0000","last_active":"2024-05-07T14:01:21.657262+0000","last_peered":"2024-05-07T14:01:21.657262+0000","last_clean":"2024-05-07T14:01:21.657262+0000","last_became_active":"2024-05-07T14:01:02.009335+0000","last_became_peered":"2024-05-07T14:01:02.009335+0000","last_unstale":"2024-05-07T14:01:21.657262+0000","last_undegraded":"2024-05-07T14:01:21.657262+0000","last_fullsized":"2024-05-07T14:01:21.657262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.655986+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:01:21.655986+0000","last_peered":"2024-05-07T14:01:21.655986+0000","last_clean":"2024-05-07T14:01:21.655986+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:01:21.655986+0000","last_undegraded":"2024-05-07T14:01:21.655986+0000","last_fullsized":"2024-05-07T14:01:21.655986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152385+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:01:22.152385+0000","last_peered":"2024-05-07T14:01:22.152385+0000","last_clean":"2024-05-07T14:01:22.152385+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:01:22.152385+0000","last_undegraded":"2024-05-07T14:01:22.152385+0000","last_fullsized":"2024-05-07T14:01:22.152385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151184+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:01:22.151184+0000","last_peered":"2024-05-07T14:01:22.151184+0000","last_clean":"2024-05-07T14:01:22.151184+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:01:22.151184+0000","last_undegraded":"2024-05-07T14:01:22.151184+0000","last_fullsized":"2024-05-07T14:01:22.151184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661807+0000","last_change":"2024-05-07T14:00:56.008026+0000","last_active":"2024-05-07T14:01:21.661807+0000","last_peered":"2024-05-07T14:01:21.661807+0000","last_clean":"2024-05-07T14:01:21.661807+0000","last_became_active":"2024-05-07T14:00:56.007374+0000","last_became_peered":"2024-05-07T14:00:56.007374+0000","last_unstale":"2024-05-07T14:01:21.661807+0000","last_undegraded":"2024-05-07T14:01:21.661807+0000","last_fullsized":"2024-05-07T14:01:21.661807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156062+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:01:22.156062+0000","last_peered":"2024-05-07T14:01:22.156062+0000","last_clean":"2024-05-07T14:01:22.156062+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:01:22.156062+0000","last_undegraded":"2024-05-07T14:01:22.156062+0000","last_fullsized":"2024-05-07T14:01:22.156062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659424+0000","last_change":"2024-05-07T14:01:01.997489+0000","last_active":"2024-05-07T14:01:21.659424+0000","last_peered":"2024-05-07T14:01:21.659424+0000","last_clean":"2024-05-07T14:01:21.659424+0000","last_became_active":"2024-05-07T14:01:01.994656+0000","last_became_peered":"2024-05-07T14:01:01.994656+0000","last_unstale":"2024-05-07T14:01:21.659424+0000","last_undegraded":"2024-05-07T14:01:21.659424+0000","last_fullsized":"2024-05-07T14:01:21.659424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:12.091721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154100+0000","last_change":"2024-05-07T14:01:04.009157+0000","last_active":"2024-05-07T14:01:22.154100+0000","last_peered":"2024-05-07T14:01:22.154100+0000","last_clean":"2024-05-07T14:01:22.154100+0000","last_became_active":"2024-05-07T14:01:04.008594+0000","last_became_peered":"2024-05-07T14:01:04.008594+0000","last_unstale":"2024-05-07T14:01:22.154100+0000","last_undegraded":"2024-05-07T14:01:22.154100+0000","last_fullsized":"2024-05-07T14:01:22.154100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153778+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:01:22.153778+0000","last_peered":"2024-05-07T14:01:22.153778+0000","last_clean":"2024-05-07T14:01:22.153778+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:01:22.153778+0000","last_undegraded":"2024-05-07T14:01:22.153778+0000","last_fullsized":"2024-05-07T14:01:22.153778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.155966+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:01:22.155966+0000","last_peered":"2024-05-07T14:01:22.155966+0000","last_clean":"2024-05-07T14:01:22.155966+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:01:22.155966+0000","last_undegraded":"2024-05-07T14:01:22.155966+0000","last_fullsized":"2024-05-07T14:01:22.155966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152157+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:01:22.152157+0000","last_peered":"2024-05-07T14:01:22.152157+0000","last_clean":"2024-05-07T14:01:22.152157+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:01:22.152157+0000","last_undegraded":"2024-05-07T14:01:22.152157+0000","last_fullsized":"2024-05-07T14:01:22.152157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152557+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:01:22.152557+0000","last_peered":"2024-05-07T14:01:22.152557+0000","last_clean":"2024-05-07T14:01:22.152557+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:01:22.152557+0000","last_undegraded":"2024-05-07T14:01:22.152557+0000","last_fullsized":"2024-05-07T14:01:22.152557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154635+0000","last_change":"2024-05-07T14:01:01.995144+0000","last_active":"2024-05-07T14:01:22.154635+0000","last_peered":"2024-05-07T14:01:22.154635+0000","last_clean":"2024-05-07T14:01:22.154635+0000","last_became_active":"2024-05-07T14:01:01.993073+0000","last_became_peered":"2024-05-07T14:01:01.993073+0000","last_unstale":"2024-05-07T14:01:22.154635+0000","last_undegraded":"2024-05-07T14:01:22.154635+0000","last_fullsized":"2024-05-07T14:01:22.154635+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:54.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152124+0000","last_change":"2024-05-07T14:01:04.012216+0000","last_active":"2024-05-07T14:01:22.152124+0000","last_peered":"2024-05-07T14:01:22.152124+0000","last_clean":"2024-05-07T14:01:22.152124+0000","last_became_active":"2024-05-07T14:01:04.011476+0000","last_became_peered":"2024-05-07T14:01:04.011476+0000","last_unstale":"2024-05-07T14:01:22.152124+0000","last_undegraded":"2024-05-07T14:01:22.152124+0000","last_fullsized":"2024-05-07T14:01:22.152124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:46.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152623+0000","last_change":"2024-05-07T14:01:06.024311+0000","last_active":"2024-05-07T14:01:22.152623+0000","last_peered":"2024-05-07T14:01:22.152623+0000","last_clean":"2024-05-07T14:01:22.152623+0000","last_became_active":"2024-05-07T14:01:06.023404+0000","last_became_peered":"2024-05-07T14:01:06.023404+0000","last_unstale":"2024-05-07T14:01:22.152623+0000","last_undegraded":"2024-05-07T14:01:22.152623+0000","last_fullsized":"2024-05-07T14:01:22.152623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:26.544302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658720+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:01:21.658720+0000","last_peered":"2024-05-07T14:01:21.658720+0000","last_clean":"2024-05-07T14:01:21.658720+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:01:21.658720+0000","last_undegraded":"2024-05-07T14:01:21.658720+0000","last_fullsized":"2024-05-07T14:01:21.658720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656107+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:01:21.656107+0000","last_peered":"2024-05-07T14:01:21.656107+0000","last_clean":"2024-05-07T14:01:21.656107+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:01:21.656107+0000","last_undegraded":"2024-05-07T14:01:21.656107+0000","last_fullsized":"2024-05-07T14:01:21.656107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157867+0000","last_change":"2024-05-07T14:00:59.992897+0000","last_active":"2024-05-07T14:01:22.157867+0000","last_peered":"2024-05-07T14:01:22.157867+0000","last_clean":"2024-05-07T14:01:22.157867+0000","last_became_active":"2024-05-07T14:00:59.992067+0000","last_became_peered":"2024-05-07T14:00:59.992067+0000","last_unstale":"2024-05-07T14:01:22.157867+0000","last_undegraded":"2024-05-07T14:01:22.157867+0000","last_fullsized":"2024-05-07T14:01:22.157867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:19.526884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659025+0000","last_change":"2024-05-07T14:01:02.012335+0000","last_active":"2024-05-07T14:01:21.659025+0000","last_peered":"2024-05-07T14:01:21.659025+0000","last_clean":"2024-05-07T14:01:21.659025+0000","last_became_active":"2024-05-07T14:01:02.011651+0000","last_became_peered":"2024-05-07T14:01:02.011651+0000","last_unstale":"2024-05-07T14:01:21.659025+0000","last_undegraded":"2024-05-07T14:01:21.659025+0000","last_fullsized":"2024-05-07T14:01:21.659025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162609+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:01:22.162609+0000","last_peered":"2024-05-07T14:01:22.162609+0000","last_clean":"2024-05-07T14:01:22.162609+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:01:22.162609+0000","last_undegraded":"2024-05-07T14:01:22.162609+0000","last_fullsized":"2024-05-07T14:01:22.162609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656914+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:01:21.656914+0000","last_peered":"2024-05-07T14:01:21.656914+0000","last_clean":"2024-05-07T14:01:21.656914+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:01:21.656914+0000","last_undegraded":"2024-05-07T14:01:21.656914+0000","last_fullsized":"2024-05-07T14:01:21.656914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661005+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:01:21.661005+0000","last_peered":"2024-05-07T14:01:21.661005+0000","last_clean":"2024-05-07T14:01:21.661005+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:01:21.661005+0000","last_undegraded":"2024-05-07T14:01:21.661005+0000","last_fullsized":"2024-05-07T14:01:21.661005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151376+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:01:22.151376+0000","last_peered":"2024-05-07T14:01:22.151376+0000","last_clean":"2024-05-07T14:01:22.151376+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:01:22.151376+0000","last_undegraded":"2024-05-07T14:01:22.151376+0000","last_fullsized":"2024-05-07T14:01:22.151376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157558+0000","last_change":"2024-05-07T14:01:00.006802+0000","last_active":"2024-05-07T14:01:22.157558+0000","last_peered":"2024-05-07T14:01:22.157558+0000","last_clean":"2024-05-07T14:01:22.157558+0000","last_became_active":"2024-05-07T14:01:00.006254+0000","last_became_peered":"2024-05-07T14:01:00.006254+0000","last_unstale":"2024-05-07T14:01:22.157558+0000","last_undegraded":"2024-05-07T14:01:22.157558+0000","last_fullsized":"2024-05-07T14:01:22.157558+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:40.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159760+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:01:22.159760+0000","last_peered":"2024-05-07T14:01:22.159760+0000","last_clean":"2024-05-07T14:01:22.159760+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:01:22.159760+0000","last_undegraded":"2024-05-07T14:01:22.159760+0000","last_fullsized":"2024-05-07T14:01:22.159760+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159051+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:01:22.159051+0000","last_peered":"2024-05-07T14:01:22.159051+0000","last_clean":"2024-05-07T14:01:22.159051+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:01:22.159051+0000","last_undegraded":"2024-05-07T14:01:22.159051+0000","last_fullsized":"2024-05-07T14:01:22.159051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.155516+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:01:22.155516+0000","last_peered":"2024-05-07T14:01:22.155516+0000","last_clean":"2024-05-07T14:01:22.155516+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:01:22.155516+0000","last_undegraded":"2024-05-07T14:01:22.155516+0000","last_fullsized":"2024-05-07T14:01:22.155516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659958+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:01:21.659958+0000","last_peered":"2024-05-07T14:01:21.659958+0000","last_clean":"2024-05-07T14:01:21.659958+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:01:21.659958+0000","last_undegraded":"2024-05-07T14:01:21.659958+0000","last_fullsized":"2024-05-07T14:01:21.659958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657813+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:01:21.657813+0000","last_peered":"2024-05-07T14:01:21.657813+0000","last_clean":"2024-05-07T14:01:21.657813+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:01:21.657813+0000","last_undegraded":"2024-05-07T14:01:21.657813+0000","last_fullsized":"2024-05-07T14:01:21.657813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152627+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:01:22.152627+0000","last_peered":"2024-05-07T14:01:22.152627+0000","last_clean":"2024-05-07T14:01:22.152627+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:01:22.152627+0000","last_undegraded":"2024-05-07T14:01:22.152627+0000","last_fullsized":"2024-05-07T14:01:22.152627+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657844+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:01:21.657844+0000","last_peered":"2024-05-07T14:01:21.657844+0000","last_clean":"2024-05-07T14:01:21.657844+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:01:21.657844+0000","last_undegraded":"2024-05-07T14:01:21.657844+0000","last_fullsized":"2024-05-07T14:01:21.657844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152563+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:01:22.152563+0000","last_peered":"2024-05-07T14:01:22.152563+0000","last_clean":"2024-05-07T14:01:22.152563+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:01:22.152563+0000","last_undegraded":"2024-05-07T14:01:22.152563+0000","last_fullsized":"2024-05-07T14:01:22.152563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656902+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:01:21.656902+0000","last_peered":"2024-05-07T14:01:21.656902+0000","last_clean":"2024-05-07T14:01:21.656902+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:01:21.656902+0000","last_undegraded":"2024-05-07T14:01:21.656902+0000","last_fullsized":"2024-05-07T14:01:21.656902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151419+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:01:22.151419+0000","last_peered":"2024-05-07T14:01:22.151419+0000","last_clean":"2024-05-07T14:01:22.151419+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:01:22.151419+0000","last_undegraded":"2024-05-07T14:01:22.151419+0000","last_fullsized":"2024-05-07T14:01:22.151419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656761+0000","last_change":"2024-05-07T14:00:55.974435+0000","last_active":"2024-05-07T14:01:21.656761+0000","last_peered":"2024-05-07T14:01:21.656761+0000","last_clean":"2024-05-07T14:01:21.656761+0000","last_became_active":"2024-05-07T14:00:55.974010+0000","last_became_peered":"2024-05-07T14:00:55.974010+0000","last_unstale":"2024-05-07T14:01:21.656761+0000","last_undegraded":"2024-05-07T14:01:21.656761+0000","last_fullsized":"2024-05-07T14:01:21.656761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659535+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:01:21.659535+0000","last_peered":"2024-05-07T14:01:21.659535+0000","last_clean":"2024-05-07T14:01:21.659535+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:01:21.659535+0000","last_undegraded":"2024-05-07T14:01:21.659535+0000","last_fullsized":"2024-05-07T14:01:21.659535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152730+0000","last_change":"2024-05-07T14:01:02.013314+0000","last_active":"2024-05-07T14:01:22.152730+0000","last_peered":"2024-05-07T14:01:22.152730+0000","last_clean":"2024-05-07T14:01:22.152730+0000","last_became_active":"2024-05-07T14:01:02.012667+0000","last_became_peered":"2024-05-07T14:01:02.012667+0000","last_unstale":"2024-05-07T14:01:22.152730+0000","last_undegraded":"2024-05-07T14:01:22.152730+0000","last_fullsized":"2024-05-07T14:01:22.152730+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151522+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:01:22.151522+0000","last_peered":"2024-05-07T14:01:22.151522+0000","last_clean":"2024-05-07T14:01:22.151522+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:01:22.151522+0000","last_undegraded":"2024-05-07T14:01:22.151522+0000","last_fullsized":"2024-05-07T14:01:22.151522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156746+0000","last_change":"2024-05-07T14:01:06.031381+0000","last_active":"2024-05-07T14:01:22.156746+0000","last_peered":"2024-05-07T14:01:22.156746+0000","last_clean":"2024-05-07T14:01:22.156746+0000","last_became_active":"2024-05-07T14:01:06.030958+0000","last_became_peered":"2024-05-07T14:01:06.030958+0000","last_unstale":"2024-05-07T14:01:22.156746+0000","last_undegraded":"2024-05-07T14:01:22.156746+0000","last_fullsized":"2024-05-07T14:01:22.156746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:26.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152273+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:01:22.152273+0000","last_peered":"2024-05-07T14:01:22.152273+0000","last_clean":"2024-05-07T14:01:22.152273+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:01:22.152273+0000","last_undegraded":"2024-05-07T14:01:22.152273+0000","last_fullsized":"2024-05-07T14:01:22.152273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":208,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659671+0000","last_change":"2024-05-07T14:00:45.460158+0000","last_active":"2024-05-07T14:01:21.659671+0000","last_peered":"2024-05-07T14:01:21.659671+0000","last_clean":"2024-05-07T14:01:21.659671+0000","last_became_active":"2024-05-07T14:00:45.458198+0000","last_became_peered":"2024-05-07T14:00:45.458198+0000","last_unstale":"2024-05-07T14:01:21.659671+0000","last_undegraded":"2024-05-07T14:01:21.659671+0000","last_fullsized":"2024-05-07T14:01:21.659671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:18.582514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151030+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:01:22.151030+0000","last_peered":"2024-05-07T14:01:22.151030+0000","last_clean":"2024-05-07T14:01:22.151030+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:01:22.151030+0000","last_undegraded":"2024-05-07T14:01:22.151030+0000","last_fullsized":"2024-05-07T14:01:22.151030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656596+0000","last_change":"2024-05-07T14:00:56.012396+0000","last_active":"2024-05-07T14:01:21.656596+0000","last_peered":"2024-05-07T14:01:21.656596+0000","last_clean":"2024-05-07T14:01:21.656596+0000","last_became_active":"2024-05-07T14:00:56.012053+0000","last_became_peered":"2024-05-07T14:00:56.012053+0000","last_unstale":"2024-05-07T14:01:21.656596+0000","last_undegraded":"2024-05-07T14:01:21.656596+0000","last_fullsized":"2024-05-07T14:01:21.656596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661303+0000","last_change":"2024-05-07T14:00:59.988489+0000","last_active":"2024-05-07T14:01:21.661303+0000","last_peered":"2024-05-07T14:01:21.661303+0000","last_clean":"2024-05-07T14:01:21.661303+0000","last_became_active":"2024-05-07T14:00:59.987757+0000","last_became_peered":"2024-05-07T14:00:59.987757+0000","last_unstale":"2024-05-07T14:01:21.661303+0000","last_undegraded":"2024-05-07T14:01:21.661303+0000","last_fullsized":"2024-05-07T14:01:21.661303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":61,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152867+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:01:22.152867+0000","last_peered":"2024-05-07T14:01:22.152867+0000","last_clean":"2024-05-07T14:01:22.152867+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:01:22.152867+0000","last_undegraded":"2024-05-07T14:01:22.152867+0000","last_fullsized":"2024-05-07T14:01:22.152867+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154990+0000","last_change":"2024-05-07T14:01:04.007712+0000","last_active":"2024-05-07T14:01:22.154990+0000","last_peered":"2024-05-07T14:01:22.154990+0000","last_clean":"2024-05-07T14:01:22.154990+0000","last_became_active":"2024-05-07T14:01:04.006934+0000","last_became_peered":"2024-05-07T14:01:04.006934+0000","last_unstale":"2024-05-07T14:01:22.154990+0000","last_undegraded":"2024-05-07T14:01:22.154990+0000","last_fullsized":"2024-05-07T14:01:22.154990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151057+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:01:22.151057+0000","last_peered":"2024-05-07T14:01:22.151057+0000","last_clean":"2024-05-07T14:01:22.151057+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:01:22.151057+0000","last_undegraded":"2024-05-07T14:01:22.151057+0000","last_fullsized":"2024-05-07T14:01:22.151057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152742+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:01:22.152742+0000","last_peered":"2024-05-07T14:01:22.152742+0000","last_clean":"2024-05-07T14:01:22.152742+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:01:22.152742+0000","last_undegraded":"2024-05-07T14:01:22.152742+0000","last_fullsized":"2024-05-07T14:01:22.152742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659197+0000","last_change":"2024-05-07T14:00:49.930222+0000","last_active":"2024-05-07T14:01:21.659197+0000","last_peered":"2024-05-07T14:01:21.659197+0000","last_clean":"2024-05-07T14:01:21.659197+0000","last_became_active":"2024-05-07T14:00:49.929538+0000","last_became_peered":"2024-05-07T14:00:49.929538+0000","last_unstale":"2024-05-07T14:01:21.659197+0000","last_undegraded":"2024-05-07T14:01:21.659197+0000","last_fullsized":"2024-05-07T14:01:21.659197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:43.069683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154649+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:01:22.154649+0000","last_peered":"2024-05-07T14:01:22.154649+0000","last_clean":"2024-05-07T14:01:22.154649+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:01:22.154649+0000","last_undegraded":"2024-05-07T14:01:22.154649+0000","last_fullsized":"2024-05-07T14:01:22.154649+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153091+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:01:22.153091+0000","last_peered":"2024-05-07T14:01:22.153091+0000","last_clean":"2024-05-07T14:01:22.153091+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:01:22.153091+0000","last_undegraded":"2024-05-07T14:01:22.153091+0000","last_fullsized":"2024-05-07T14:01:22.153091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":79,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156801+0000","last_change":"2024-05-07T14:01:02.014645+0000","last_active":"2024-05-07T14:01:22.156801+0000","last_peered":"2024-05-07T14:01:22.156801+0000","last_clean":"2024-05-07T14:01:22.156801+0000","last_became_active":"2024-05-07T14:01:02.013904+0000","last_became_peered":"2024-05-07T14:01:02.013904+0000","last_unstale":"2024-05-07T14:01:22.156801+0000","last_undegraded":"2024-05-07T14:01:22.156801+0000","last_fullsized":"2024-05-07T14:01:22.156801+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:31.441743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661318+0000","last_change":"2024-05-07T14:01:04.012527+0000","last_active":"2024-05-07T14:01:21.661318+0000","last_peered":"2024-05-07T14:01:21.661318+0000","last_clean":"2024-05-07T14:01:21.661318+0000","last_became_active":"2024-05-07T14:01:04.007658+0000","last_became_peered":"2024-05-07T14:01:04.007658+0000","last_unstale":"2024-05-07T14:01:21.661318+0000","last_undegraded":"2024-05-07T14:01:21.661318+0000","last_fullsized":"2024-05-07T14:01:21.661318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156509+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:01:22.156509+0000","last_peered":"2024-05-07T14:01:22.156509+0000","last_clean":"2024-05-07T14:01:22.156509+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:01:22.156509+0000","last_undegraded":"2024-05-07T14:01:22.156509+0000","last_fullsized":"2024-05-07T14:01:22.156509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.160061+0000","last_change":"2024-05-07T14:00:57.989314+0000","last_active":"2024-05-07T14:01:22.160061+0000","last_peered":"2024-05-07T14:01:22.160061+0000","last_clean":"2024-05-07T14:01:22.160061+0000","last_became_active":"2024-05-07T14:00:57.988994+0000","last_became_peered":"2024-05-07T14:00:57.988994+0000","last_unstale":"2024-05-07T14:01:22.160061+0000","last_undegraded":"2024-05-07T14:01:22.160061+0000","last_fullsized":"2024-05-07T14:01:22.160061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153909+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:01:22.153909+0000","last_peered":"2024-05-07T14:01:22.153909+0000","last_clean":"2024-05-07T14:01:22.153909+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:01:22.153909+0000","last_undegraded":"2024-05-07T14:01:22.153909+0000","last_fullsized":"2024-05-07T14:01:22.153909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.155673+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:01:22.155673+0000","last_peered":"2024-05-07T14:01:22.155673+0000","last_clean":"2024-05-07T14:01:22.155673+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:01:22.155673+0000","last_undegraded":"2024-05-07T14:01:22.155673+0000","last_fullsized":"2024-05-07T14:01:22.155673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159194+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:01:22.159194+0000","last_peered":"2024-05-07T14:01:22.159194+0000","last_clean":"2024-05-07T14:01:22.159194+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:01:22.159194+0000","last_undegraded":"2024-05-07T14:01:22.159194+0000","last_fullsized":"2024-05-07T14:01:22.159194+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661581+0000","last_change":"2024-05-07T14:01:02.148182+0000","last_active":"2024-05-07T14:01:21.661581+0000","last_peered":"2024-05-07T14:01:21.661581+0000","last_clean":"2024-05-07T14:01:21.661581+0000","last_became_active":"2024-05-07T14:01:02.147442+0000","last_became_peered":"2024-05-07T14:01:02.147442+0000","last_unstale":"2024-05-07T14:01:21.661581+0000","last_undegraded":"2024-05-07T14:01:21.661581+0000","last_fullsized":"2024-05-07T14:01:21.661581+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:24.955989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154644+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:01:22.154644+0000","last_peered":"2024-05-07T14:01:22.154644+0000","last_clean":"2024-05-07T14:01:22.154644+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:01:22.154644+0000","last_undegraded":"2024-05-07T14:01:22.154644+0000","last_fullsized":"2024-05-07T14:01:22.154644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657140+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:01:21.657140+0000","last_peered":"2024-05-07T14:01:21.657140+0000","last_clean":"2024-05-07T14:01:21.657140+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:01:21.657140+0000","last_undegraded":"2024-05-07T14:01:21.657140+0000","last_fullsized":"2024-05-07T14:01:21.657140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159533+0000","last_change":"2024-05-07T14:00:57.997894+0000","last_active":"2024-05-07T14:01:22.159533+0000","last_peered":"2024-05-07T14:01:22.159533+0000","last_clean":"2024-05-07T14:01:22.159533+0000","last_became_active":"2024-05-07T14:00:57.997336+0000","last_became_peered":"2024-05-07T14:00:57.997336+0000","last_unstale":"2024-05-07T14:01:22.159533+0000","last_undegraded":"2024-05-07T14:01:22.159533+0000","last_fullsized":"2024-05-07T14:01:22.159533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150782+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:01:22.150782+0000","last_peered":"2024-05-07T14:01:22.150782+0000","last_clean":"2024-05-07T14:01:22.150782+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:01:22.150782+0000","last_undegraded":"2024-05-07T14:01:22.150782+0000","last_fullsized":"2024-05-07T14:01:22.150782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658106+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:01:21.658106+0000","last_peered":"2024-05-07T14:01:21.658106+0000","last_clean":"2024-05-07T14:01:21.658106+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:01:21.658106+0000","last_undegraded":"2024-05-07T14:01:21.658106+0000","last_fullsized":"2024-05-07T14:01:21.658106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162338+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:01:22.162338+0000","last_peered":"2024-05-07T14:01:22.162338+0000","last_clean":"2024-05-07T14:01:22.162338+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:01:22.162338+0000","last_undegraded":"2024-05-07T14:01:22.162338+0000","last_fullsized":"2024-05-07T14:01:22.162338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658370+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:01:21.658370+0000","last_peered":"2024-05-07T14:01:21.658370+0000","last_clean":"2024-05-07T14:01:21.658370+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:01:21.658370+0000","last_undegraded":"2024-05-07T14:01:21.658370+0000","last_fullsized":"2024-05-07T14:01:21.658370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152180+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:01:22.152180+0000","last_peered":"2024-05-07T14:01:22.152180+0000","last_clean":"2024-05-07T14:01:22.152180+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:01:22.152180+0000","last_undegraded":"2024-05-07T14:01:22.152180+0000","last_fullsized":"2024-05-07T14:01:22.152180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150079+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:01:22.150079+0000","last_peered":"2024-05-07T14:01:22.150079+0000","last_clean":"2024-05-07T14:01:22.150079+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:01:22.150079+0000","last_undegraded":"2024-05-07T14:01:22.150079+0000","last_fullsized":"2024-05-07T14:01:22.150079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157804+0000","last_change":"2024-05-07T14:00:57.989747+0000","last_active":"2024-05-07T14:01:22.157804+0000","last_peered":"2024-05-07T14:01:22.157804+0000","last_clean":"2024-05-07T14:01:22.157804+0000","last_became_active":"2024-05-07T14:00:57.989252+0000","last_became_peered":"2024-05-07T14:00:57.989252+0000","last_unstale":"2024-05-07T14:01:22.157804+0000","last_undegraded":"2024-05-07T14:01:22.157804+0000","last_fullsized":"2024-05-07T14:01:22.157804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:44.815601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153174+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:01:22.153174+0000","last_peered":"2024-05-07T14:01:22.153174+0000","last_clean":"2024-05-07T14:01:22.153174+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:01:22.153174+0000","last_undegraded":"2024-05-07T14:01:22.153174+0000","last_fullsized":"2024-05-07T14:01:22.153174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156239+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:01:22.156239+0000","last_peered":"2024-05-07T14:01:22.156239+0000","last_clean":"2024-05-07T14:01:22.156239+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:01:22.156239+0000","last_undegraded":"2024-05-07T14:01:22.156239+0000","last_fullsized":"2024-05-07T14:01:22.156239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158411+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:01:22.158411+0000","last_peered":"2024-05-07T14:01:22.158411+0000","last_clean":"2024-05-07T14:01:22.158411+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:01:22.158411+0000","last_undegraded":"2024-05-07T14:01:22.158411+0000","last_fullsized":"2024-05-07T14:01:22.158411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162355+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:01:22.162355+0000","last_peered":"2024-05-07T14:01:22.162355+0000","last_clean":"2024-05-07T14:01:22.162355+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:01:22.162355+0000","last_undegraded":"2024-05-07T14:01:22.162355+0000","last_fullsized":"2024-05-07T14:01:22.162355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656822+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:01:21.656822+0000","last_peered":"2024-05-07T14:01:21.656822+0000","last_clean":"2024-05-07T14:01:21.656822+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:01:21.656822+0000","last_undegraded":"2024-05-07T14:01:21.656822+0000","last_fullsized":"2024-05-07T14:01:21.656822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.154117+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:01:22.154117+0000","last_peered":"2024-05-07T14:01:22.154117+0000","last_clean":"2024-05-07T14:01:22.154117+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:01:22.154117+0000","last_undegraded":"2024-05-07T14:01:22.154117+0000","last_fullsized":"2024-05-07T14:01:22.154117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156359+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:01:22.156359+0000","last_peered":"2024-05-07T14:01:22.156359+0000","last_clean":"2024-05-07T14:01:22.156359+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:01:22.156359+0000","last_undegraded":"2024-05-07T14:01:22.156359+0000","last_fullsized":"2024-05-07T14:01:22.156359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159629+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:01:22.159629+0000","last_peered":"2024-05-07T14:01:22.159629+0000","last_clean":"2024-05-07T14:01:22.159629+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:01:22.159629+0000","last_undegraded":"2024-05-07T14:01:22.159629+0000","last_fullsized":"2024-05-07T14:01:22.159629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.662035+0000","last_change":"2024-05-07T14:00:49.928907+0000","last_active":"2024-05-07T14:01:21.662035+0000","last_peered":"2024-05-07T14:01:21.662035+0000","last_clean":"2024-05-07T14:01:21.662035+0000","last_became_active":"2024-05-07T14:00:49.928146+0000","last_became_peered":"2024-05-07T14:00:49.928146+0000","last_unstale":"2024-05-07T14:01:21.662035+0000","last_undegraded":"2024-05-07T14:01:21.662035+0000","last_fullsized":"2024-05-07T14:01:21.662035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:07.032835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150977+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:01:22.150977+0000","last_peered":"2024-05-07T14:01:22.150977+0000","last_clean":"2024-05-07T14:01:22.150977+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:01:22.150977+0000","last_undegraded":"2024-05-07T14:01:22.150977+0000","last_fullsized":"2024-05-07T14:01:22.150977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":55,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.155802+0000","last_change":"2024-05-07T14:01:02.148499+0000","last_active":"2024-05-07T14:01:22.155802+0000","last_peered":"2024-05-07T14:01:22.155802+0000","last_clean":"2024-05-07T14:01:22.155802+0000","last_became_active":"2024-05-07T14:01:02.147567+0000","last_became_peered":"2024-05-07T14:01:02.147567+0000","last_unstale":"2024-05-07T14:01:22.155802+0000","last_undegraded":"2024-05-07T14:01:22.155802+0000","last_fullsized":"2024-05-07T14:01:22.155802+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:30.162886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150483+0000","last_change":"2024-05-07T14:01:04.015930+0000","last_active":"2024-05-07T14:01:22.150483+0000","last_peered":"2024-05-07T14:01:22.150483+0000","last_clean":"2024-05-07T14:01:22.150483+0000","last_became_active":"2024-05-07T14:01:04.011643+0000","last_became_peered":"2024-05-07T14:01:04.011643+0000","last_unstale":"2024-05-07T14:01:22.150483+0000","last_undegraded":"2024-05-07T14:01:22.150483+0000","last_fullsized":"2024-05-07T14:01:22.150483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658362+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:01:21.658362+0000","last_peered":"2024-05-07T14:01:21.658362+0000","last_clean":"2024-05-07T14:01:21.658362+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:01:21.658362+0000","last_undegraded":"2024-05-07T14:01:21.658362+0000","last_fullsized":"2024-05-07T14:01:21.658362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656079+0000","last_change":"2024-05-07T14:00:57.998539+0000","last_active":"2024-05-07T14:01:21.656079+0000","last_peered":"2024-05-07T14:01:21.656079+0000","last_clean":"2024-05-07T14:01:21.656079+0000","last_became_active":"2024-05-07T14:00:57.998025+0000","last_became_peered":"2024-05-07T14:00:57.998025+0000","last_unstale":"2024-05-07T14:01:21.656079+0000","last_undegraded":"2024-05-07T14:01:21.656079+0000","last_fullsized":"2024-05-07T14:01:21.656079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658306+0000","last_change":"2024-05-07T14:00:55.988508+0000","last_active":"2024-05-07T14:01:21.658306+0000","last_peered":"2024-05-07T14:01:21.658306+0000","last_clean":"2024-05-07T14:01:21.658306+0000","last_became_active":"2024-05-07T14:00:55.988230+0000","last_became_peered":"2024-05-07T14:00:55.988230+0000","last_unstale":"2024-05-07T14:01:21.658306+0000","last_undegraded":"2024-05-07T14:01:21.658306+0000","last_fullsized":"2024-05-07T14:01:21.658306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159607+0000","last_change":"2024-05-07T14:00:49.936072+0000","last_active":"2024-05-07T14:01:22.159607+0000","last_peered":"2024-05-07T14:01:22.159607+0000","last_clean":"2024-05-07T14:01:22.159607+0000","last_became_active":"2024-05-07T14:00:49.935768+0000","last_became_peered":"2024-05-07T14:00:49.935768+0000","last_unstale":"2024-05-07T14:01:22.159607+0000","last_undegraded":"2024-05-07T14:01:22.159607+0000","last_fullsized":"2024-05-07T14:01:22.159607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657173+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:01:21.657173+0000","last_peered":"2024-05-07T14:01:21.657173+0000","last_clean":"2024-05-07T14:01:21.657173+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:01:21.657173+0000","last_undegraded":"2024-05-07T14:01:21.657173+0000","last_fullsized":"2024-05-07T14:01:21.657173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657088+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:01:21.657088+0000","last_peered":"2024-05-07T14:01:21.657088+0000","last_clean":"2024-05-07T14:01:21.657088+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:01:21.657088+0000","last_undegraded":"2024-05-07T14:01:21.657088+0000","last_fullsized":"2024-05-07T14:01:21.657088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657553+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:01:21.657553+0000","last_peered":"2024-05-07T14:01:21.657553+0000","last_clean":"2024-05-07T14:01:21.657553+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:01:21.657553+0000","last_undegraded":"2024-05-07T14:01:21.657553+0000","last_fullsized":"2024-05-07T14:01:21.657553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153933+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:01:22.153933+0000","last_peered":"2024-05-07T14:01:22.153933+0000","last_clean":"2024-05-07T14:01:22.153933+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:01:22.153933+0000","last_undegraded":"2024-05-07T14:01:22.153933+0000","last_fullsized":"2024-05-07T14:01:22.153933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657591+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:01:21.657591+0000","last_peered":"2024-05-07T14:01:21.657591+0000","last_clean":"2024-05-07T14:01:21.657591+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:01:21.657591+0000","last_undegraded":"2024-05-07T14:01:21.657591+0000","last_fullsized":"2024-05-07T14:01:21.657591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162778+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:01:22.162778+0000","last_peered":"2024-05-07T14:01:22.162778+0000","last_clean":"2024-05-07T14:01:22.162778+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:01:22.162778+0000","last_undegraded":"2024-05-07T14:01:22.162778+0000","last_fullsized":"2024-05-07T14:01:22.162778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150110+0000","last_change":"2024-05-07T14:00:49.938879+0000","last_active":"2024-05-07T14:01:22.150110+0000","last_peered":"2024-05-07T14:01:22.150110+0000","last_clean":"2024-05-07T14:01:22.150110+0000","last_became_active":"2024-05-07T14:00:49.938066+0000","last_became_peered":"2024-05-07T14:00:49.938066+0000","last_unstale":"2024-05-07T14:01:22.150110+0000","last_undegraded":"2024-05-07T14:01:22.150110+0000","last_fullsized":"2024-05-07T14:01:22.150110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.655805+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:01:21.655805+0000","last_peered":"2024-05-07T14:01:21.655805+0000","last_clean":"2024-05-07T14:01:21.655805+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:01:21.655805+0000","last_undegraded":"2024-05-07T14:01:21.655805+0000","last_fullsized":"2024-05-07T14:01:21.655805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":70,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660283+0000","last_change":"2024-05-07T14:01:02.148095+0000","last_active":"2024-05-07T14:01:21.660283+0000","last_peered":"2024-05-07T14:01:21.660283+0000","last_clean":"2024-05-07T14:01:21.660283+0000","last_became_active":"2024-05-07T14:01:02.147334+0000","last_became_peered":"2024-05-07T14:01:02.147334+0000","last_unstale":"2024-05-07T14:01:21.660283+0000","last_undegraded":"2024-05-07T14:01:21.660283+0000","last_fullsized":"2024-05-07T14:01:21.660283+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656164+0000","last_change":"2024-05-07T14:01:04.024279+0000","last_active":"2024-05-07T14:01:21.656164+0000","last_peered":"2024-05-07T14:01:21.656164+0000","last_clean":"2024-05-07T14:01:21.656164+0000","last_became_active":"2024-05-07T14:01:04.022870+0000","last_became_peered":"2024-05-07T14:01:04.022870+0000","last_unstale":"2024-05-07T14:01:21.656164+0000","last_undegraded":"2024-05-07T14:01:21.656164+0000","last_fullsized":"2024-05-07T14:01:21.656164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:28.158572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152588+0000","last_change":"2024-05-07T14:01:06.039788+0000","last_active":"2024-05-07T14:01:22.152588+0000","last_peered":"2024-05-07T14:01:22.152588+0000","last_clean":"2024-05-07T14:01:22.152588+0000","last_became_active":"2024-05-07T14:01:06.039050+0000","last_became_peered":"2024-05-07T14:01:06.039050+0000","last_unstale":"2024-05-07T14:01:22.152588+0000","last_undegraded":"2024-05-07T14:01:22.152588+0000","last_fullsized":"2024-05-07T14:01:22.152588+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157219+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:01:22.157219+0000","last_peered":"2024-05-07T14:01:22.157219+0000","last_clean":"2024-05-07T14:01:22.157219+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:01:22.157219+0000","last_undegraded":"2024-05-07T14:01:22.157219+0000","last_fullsized":"2024-05-07T14:01:22.157219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657822+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:01:21.657822+0000","last_peered":"2024-05-07T14:01:21.657822+0000","last_clean":"2024-05-07T14:01:21.657822+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:01:21.657822+0000","last_undegraded":"2024-05-07T14:01:21.657822+0000","last_fullsized":"2024-05-07T14:01:21.657822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658013+0000","last_change":"2024-05-07T14:00:55.991934+0000","last_active":"2024-05-07T14:01:21.658013+0000","last_peered":"2024-05-07T14:01:21.658013+0000","last_clean":"2024-05-07T14:01:21.658013+0000","last_became_active":"2024-05-07T14:00:55.991303+0000","last_became_peered":"2024-05-07T14:00:55.991303+0000","last_unstale":"2024-05-07T14:01:21.658013+0000","last_undegraded":"2024-05-07T14:01:21.658013+0000","last_fullsized":"2024-05-07T14:01:21.658013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158142+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:01:22.158142+0000","last_peered":"2024-05-07T14:01:22.158142+0000","last_clean":"2024-05-07T14:01:22.158142+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:01:22.158142+0000","last_undegraded":"2024-05-07T14:01:22.158142+0000","last_fullsized":"2024-05-07T14:01:22.158142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.655639+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:01:21.655639+0000","last_peered":"2024-05-07T14:01:21.655639+0000","last_clean":"2024-05-07T14:01:21.655639+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:01:21.655639+0000","last_undegraded":"2024-05-07T14:01:21.655639+0000","last_fullsized":"2024-05-07T14:01:21.655639+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.655522+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:01:21.655522+0000","last_peered":"2024-05-07T14:01:21.655522+0000","last_clean":"2024-05-07T14:01:21.655522+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:01:21.655522+0000","last_undegraded":"2024-05-07T14:01:21.655522+0000","last_fullsized":"2024-05-07T14:01:21.655522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658049+0000","last_change":"2024-05-07T14:01:06.013974+0000","last_active":"2024-05-07T14:01:21.658049+0000","last_peered":"2024-05-07T14:01:21.658049+0000","last_clean":"2024-05-07T14:01:21.658049+0000","last_became_active":"2024-05-07T14:01:06.013281+0000","last_became_peered":"2024-05-07T14:01:06.013281+0000","last_unstale":"2024-05-07T14:01:21.658049+0000","last_undegraded":"2024-05-07T14:01:21.658049+0000","last_fullsized":"2024-05-07T14:01:21.658049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:46.349394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157590+0000","last_change":"2024-05-07T14:00:58.001752+0000","last_active":"2024-05-07T14:01:22.157590+0000","last_peered":"2024-05-07T14:01:22.157590+0000","last_clean":"2024-05-07T14:01:22.157590+0000","last_became_active":"2024-05-07T14:00:57.999982+0000","last_became_peered":"2024-05-07T14:00:57.999982+0000","last_unstale":"2024-05-07T14:01:22.157590+0000","last_undegraded":"2024-05-07T14:01:22.157590+0000","last_fullsized":"2024-05-07T14:01:22.157590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661805+0000","last_change":"2024-05-07T14:00:55.968287+0000","last_active":"2024-05-07T14:01:21.661805+0000","last_peered":"2024-05-07T14:01:21.661805+0000","last_clean":"2024-05-07T14:01:21.661805+0000","last_became_active":"2024-05-07T14:00:55.967578+0000","last_became_peered":"2024-05-07T14:00:55.967578+0000","last_unstale":"2024-05-07T14:01:21.661805+0000","last_undegraded":"2024-05-07T14:01:21.661805+0000","last_fullsized":"2024-05-07T14:01:21.661805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657117+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:01:21.657117+0000","last_peered":"2024-05-07T14:01:21.657117+0000","last_clean":"2024-05-07T14:01:21.657117+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:01:21.657117+0000","last_undegraded":"2024-05-07T14:01:21.657117+0000","last_fullsized":"2024-05-07T14:01:21.657117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'4","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158813+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:01:22.158813+0000","last_peered":"2024-05-07T14:01:22.158813+0000","last_clean":"2024-05-07T14:01:22.158813+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:01:22.158813+0000","last_undegraded":"2024-05-07T14:01:22.158813+0000","last_fullsized":"2024-05-07T14:01:22.158813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659273+0000","last_change":"2024-05-07T14:01:04.012628+0000","last_active":"2024-05-07T14:01:21.659273+0000","last_peered":"2024-05-07T14:01:21.659273+0000","last_clean":"2024-05-07T14:01:21.659273+0000","last_became_active":"2024-05-07T14:01:04.011910+0000","last_became_peered":"2024-05-07T14:01:04.011910+0000","last_unstale":"2024-05-07T14:01:21.659273+0000","last_undegraded":"2024-05-07T14:01:21.659273+0000","last_fullsized":"2024-05-07T14:01:21.659273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158941+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:01:22.158941+0000","last_peered":"2024-05-07T14:01:22.158941+0000","last_clean":"2024-05-07T14:01:22.158941+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:01:22.158941+0000","last_undegraded":"2024-05-07T14:01:22.158941+0000","last_fullsized":"2024-05-07T14:01:22.158941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656089+0000","last_change":"2024-05-07T14:00:57.999019+0000","last_active":"2024-05-07T14:01:21.656089+0000","last_peered":"2024-05-07T14:01:21.656089+0000","last_clean":"2024-05-07T14:01:21.656089+0000","last_became_active":"2024-05-07T14:00:57.998526+0000","last_became_peered":"2024-05-07T14:00:57.998526+0000","last_unstale":"2024-05-07T14:01:21.656089+0000","last_undegraded":"2024-05-07T14:01:21.656089+0000","last_fullsized":"2024-05-07T14:01:21.656089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152310+0000","last_change":"2024-05-07T14:00:55.999548+0000","last_active":"2024-05-07T14:01:22.152310+0000","last_peered":"2024-05-07T14:01:22.152310+0000","last_clean":"2024-05-07T14:01:22.152310+0000","last_became_active":"2024-05-07T14:00:55.995284+0000","last_became_peered":"2024-05-07T14:00:55.995284+0000","last_unstale":"2024-05-07T14:01:22.152310+0000","last_undegraded":"2024-05-07T14:01:22.152310+0000","last_fullsized":"2024-05-07T14:01:22.152310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658346+0000","last_change":"2024-05-07T14:00:59.996971+0000","last_active":"2024-05-07T14:01:21.658346+0000","last_peered":"2024-05-07T14:01:21.658346+0000","last_clean":"2024-05-07T14:01:21.658346+0000","last_became_active":"2024-05-07T14:00:59.996254+0000","last_became_peered":"2024-05-07T14:00:59.996254+0000","last_unstale":"2024-05-07T14:01:21.658346+0000","last_undegraded":"2024-05-07T14:01:21.658346+0000","last_fullsized":"2024-05-07T14:01:21.658346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656951+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:01:21.656951+0000","last_peered":"2024-05-07T14:01:21.656951+0000","last_clean":"2024-05-07T14:01:21.656951+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:01:21.656951+0000","last_undegraded":"2024-05-07T14:01:21.656951+0000","last_fullsized":"2024-05-07T14:01:21.656951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150866+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:01:22.150866+0000","last_peered":"2024-05-07T14:01:22.150866+0000","last_clean":"2024-05-07T14:01:22.150866+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:01:22.150866+0000","last_undegraded":"2024-05-07T14:01:22.150866+0000","last_fullsized":"2024-05-07T14:01:22.150866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.149957+0000","last_change":"2024-05-07T14:01:06.038138+0000","last_active":"2024-05-07T14:01:22.149957+0000","last_peered":"2024-05-07T14:01:22.149957+0000","last_clean":"2024-05-07T14:01:22.149957+0000","last_became_active":"2024-05-07T14:01:06.030966+0000","last_became_peered":"2024-05-07T14:01:06.030966+0000","last_unstale":"2024-05-07T14:01:22.149957+0000","last_undegraded":"2024-05-07T14:01:22.149957+0000","last_fullsized":"2024-05-07T14:01:22.149957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656327+0000","last_change":"2024-05-07T14:00:57.987879+0000","last_active":"2024-05-07T14:01:21.656327+0000","last_peered":"2024-05-07T14:01:21.656327+0000","last_clean":"2024-05-07T14:01:21.656327+0000","last_became_active":"2024-05-07T14:00:57.987544+0000","last_became_peered":"2024-05-07T14:00:57.987544+0000","last_unstale":"2024-05-07T14:01:21.656327+0000","last_undegraded":"2024-05-07T14:01:21.656327+0000","last_fullsized":"2024-05-07T14:01:21.656327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162875+0000","last_change":"2024-05-07T14:00:56.007067+0000","last_active":"2024-05-07T14:01:22.162875+0000","last_peered":"2024-05-07T14:01:22.162875+0000","last_clean":"2024-05-07T14:01:22.162875+0000","last_became_active":"2024-05-07T14:00:56.006885+0000","last_became_peered":"2024-05-07T14:00:56.006885+0000","last_unstale":"2024-05-07T14:01:22.162875+0000","last_undegraded":"2024-05-07T14:01:22.162875+0000","last_fullsized":"2024-05-07T14:01:22.162875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151421+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:01:22.151421+0000","last_peered":"2024-05-07T14:01:22.151421+0000","last_clean":"2024-05-07T14:01:22.151421+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:01:22.151421+0000","last_undegraded":"2024-05-07T14:01:22.151421+0000","last_fullsized":"2024-05-07T14:01:22.151421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657296+0000","last_change":"2024-05-07T14:01:01.995377+0000","last_active":"2024-05-07T14:01:21.657296+0000","last_peered":"2024-05-07T14:01:21.657296+0000","last_clean":"2024-05-07T14:01:21.657296+0000","last_became_active":"2024-05-07T14:01:01.994566+0000","last_became_peered":"2024-05-07T14:01:01.994566+0000","last_unstale":"2024-05-07T14:01:21.657296+0000","last_undegraded":"2024-05-07T14:01:21.657296+0000","last_fullsized":"2024-05-07T14:01:21.657296+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157381+0000","last_change":"2024-05-07T14:01:03.997116+0000","last_active":"2024-05-07T14:01:22.157381+0000","last_peered":"2024-05-07T14:01:22.157381+0000","last_clean":"2024-05-07T14:01:22.157381+0000","last_became_active":"2024-05-07T14:01:03.996555+0000","last_became_peered":"2024-05-07T14:01:03.996555+0000","last_unstale":"2024-05-07T14:01:22.157381+0000","last_undegraded":"2024-05-07T14:01:22.157381+0000","last_fullsized":"2024-05-07T14:01:22.157381+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152421+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:01:22.152421+0000","last_peered":"2024-05-07T14:01:22.152421+0000","last_clean":"2024-05-07T14:01:22.152421+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:01:22.152421+0000","last_undegraded":"2024-05-07T14:01:22.152421+0000","last_fullsized":"2024-05-07T14:01:22.152421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656622+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:01:21.656622+0000","last_peered":"2024-05-07T14:01:21.656622+0000","last_clean":"2024-05-07T14:01:21.656622+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:01:21.656622+0000","last_undegraded":"2024-05-07T14:01:21.656622+0000","last_fullsized":"2024-05-07T14:01:21.656622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156078+0000","last_change":"2024-05-07T14:00:59.995694+0000","last_active":"2024-05-07T14:01:22.156078+0000","last_peered":"2024-05-07T14:01:22.156078+0000","last_clean":"2024-05-07T14:01:22.156078+0000","last_became_active":"2024-05-07T14:00:59.993899+0000","last_became_peered":"2024-05-07T14:00:59.993899+0000","last_unstale":"2024-05-07T14:01:22.156078+0000","last_undegraded":"2024-05-07T14:01:22.156078+0000","last_fullsized":"2024-05-07T14:01:22.156078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:28.225348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":57,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157830+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:01:22.157830+0000","last_peered":"2024-05-07T14:01:22.157830+0000","last_clean":"2024-05-07T14:01:22.157830+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:01:22.157830+0000","last_undegraded":"2024-05-07T14:01:22.157830+0000","last_fullsized":"2024-05-07T14:01:22.157830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151757+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:01:22.151757+0000","last_peered":"2024-05-07T14:01:22.151757+0000","last_clean":"2024-05-07T14:01:22.151757+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:01:22.151757+0000","last_undegraded":"2024-05-07T14:01:22.151757+0000","last_fullsized":"2024-05-07T14:01:22.151757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656002+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:01:21.656002+0000","last_peered":"2024-05-07T14:01:21.656002+0000","last_clean":"2024-05-07T14:01:21.656002+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:01:21.656002+0000","last_undegraded":"2024-05-07T14:01:21.656002+0000","last_fullsized":"2024-05-07T14:01:21.656002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153097+0000","last_change":"2024-05-07T14:00:57.995989+0000","last_active":"2024-05-07T14:01:22.153097+0000","last_peered":"2024-05-07T14:01:22.153097+0000","last_clean":"2024-05-07T14:01:22.153097+0000","last_became_active":"2024-05-07T14:00:57.995721+0000","last_became_peered":"2024-05-07T14:00:57.995721+0000","last_unstale":"2024-05-07T14:01:22.153097+0000","last_undegraded":"2024-05-07T14:01:22.153097+0000","last_fullsized":"2024-05-07T14:01:22.153097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156812+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:01:22.156812+0000","last_peered":"2024-05-07T14:01:22.156812+0000","last_clean":"2024-05-07T14:01:22.156812+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:01:22.156812+0000","last_undegraded":"2024-05-07T14:01:22.156812+0000","last_fullsized":"2024-05-07T14:01:22.156812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152280+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:01:22.152280+0000","last_peered":"2024-05-07T14:01:22.152280+0000","last_clean":"2024-05-07T14:01:22.152280+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:01:22.152280+0000","last_undegraded":"2024-05-07T14:01:22.152280+0000","last_fullsized":"2024-05-07T14:01:22.152280+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661039+0000","last_change":"2024-05-07T14:01:02.002384+0000","last_active":"2024-05-07T14:01:21.661039+0000","last_peered":"2024-05-07T14:01:21.661039+0000","last_clean":"2024-05-07T14:01:21.661039+0000","last_became_active":"2024-05-07T14:01:02.001676+0000","last_became_peered":"2024-05-07T14:01:02.001676+0000","last_unstale":"2024-05-07T14:01:21.661039+0000","last_undegraded":"2024-05-07T14:01:21.661039+0000","last_fullsized":"2024-05-07T14:01:21.661039+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158218+0000","last_change":"2024-05-07T14:01:04.015893+0000","last_active":"2024-05-07T14:01:22.158218+0000","last_peered":"2024-05-07T14:01:22.158218+0000","last_clean":"2024-05-07T14:01:22.158218+0000","last_became_active":"2024-05-07T14:01:04.015329+0000","last_became_peered":"2024-05-07T14:01:04.015329+0000","last_unstale":"2024-05-07T14:01:22.158218+0000","last_undegraded":"2024-05-07T14:01:22.158218+0000","last_fullsized":"2024-05-07T14:01:22.158218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:53.413495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150560+0000","last_change":"2024-05-07T14:01:06.025917+0000","last_active":"2024-05-07T14:01:22.150560+0000","last_peered":"2024-05-07T14:01:22.150560+0000","last_clean":"2024-05-07T14:01:22.150560+0000","last_became_active":"2024-05-07T14:01:06.025044+0000","last_became_peered":"2024-05-07T14:01:06.025044+0000","last_unstale":"2024-05-07T14:01:22.150560+0000","last_undegraded":"2024-05-07T14:01:22.150560+0000","last_fullsized":"2024-05-07T14:01:22.150560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:55.419668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657974+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:01:21.657974+0000","last_peered":"2024-05-07T14:01:21.657974+0000","last_clean":"2024-05-07T14:01:21.657974+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:01:21.657974+0000","last_undegraded":"2024-05-07T14:01:21.657974+0000","last_fullsized":"2024-05-07T14:01:21.657974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657437+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:01:21.657437+0000","last_peered":"2024-05-07T14:01:21.657437+0000","last_clean":"2024-05-07T14:01:21.657437+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:01:21.657437+0000","last_undegraded":"2024-05-07T14:01:21.657437+0000","last_fullsized":"2024-05-07T14:01:21.657437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659871+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:01:21.659871+0000","last_peered":"2024-05-07T14:01:21.659871+0000","last_clean":"2024-05-07T14:01:21.659871+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:01:21.659871+0000","last_undegraded":"2024-05-07T14:01:21.659871+0000","last_fullsized":"2024-05-07T14:01:21.659871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":53,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658470+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:01:21.658470+0000","last_peered":"2024-05-07T14:01:21.658470+0000","last_clean":"2024-05-07T14:01:21.658470+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:01:21.658470+0000","last_undegraded":"2024-05-07T14:01:21.658470+0000","last_fullsized":"2024-05-07T14:01:21.658470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157433+0000","last_change":"2024-05-07T14:01:04.026470+0000","last_active":"2024-05-07T14:01:22.157433+0000","last_peered":"2024-05-07T14:01:22.157433+0000","last_clean":"2024-05-07T14:01:22.157433+0000","last_became_active":"2024-05-07T14:01:04.025881+0000","last_became_peered":"2024-05-07T14:01:04.025881+0000","last_unstale":"2024-05-07T14:01:22.157433+0000","last_undegraded":"2024-05-07T14:01:22.157433+0000","last_fullsized":"2024-05-07T14:01:22.157433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:54.595283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.149872+0000","last_change":"2024-05-07T14:01:06.038979+0000","last_active":"2024-05-07T14:01:22.149872+0000","last_peered":"2024-05-07T14:01:22.149872+0000","last_clean":"2024-05-07T14:01:22.149872+0000","last_became_active":"2024-05-07T14:01:06.035737+0000","last_became_peered":"2024-05-07T14:01:06.035737+0000","last_unstale":"2024-05-07T14:01:22.149872+0000","last_undegraded":"2024-05-07T14:01:22.149872+0000","last_fullsized":"2024-05-07T14:01:22.149872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157352+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:01:22.157352+0000","last_peered":"2024-05-07T14:01:22.157352+0000","last_clean":"2024-05-07T14:01:22.157352+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:01:22.157352+0000","last_undegraded":"2024-05-07T14:01:22.157352+0000","last_fullsized":"2024-05-07T14:01:22.157352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157719+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:01:22.157719+0000","last_peered":"2024-05-07T14:01:22.157719+0000","last_clean":"2024-05-07T14:01:22.157719+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:01:22.157719+0000","last_undegraded":"2024-05-07T14:01:22.157719+0000","last_fullsized":"2024-05-07T14:01:22.157719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158709+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:01:22.158709+0000","last_peered":"2024-05-07T14:01:22.158709+0000","last_clean":"2024-05-07T14:01:22.158709+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:01:22.158709+0000","last_undegraded":"2024-05-07T14:01:22.158709+0000","last_fullsized":"2024-05-07T14:01:22.158709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659297+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:01:21.659297+0000","last_peered":"2024-05-07T14:01:21.659297+0000","last_clean":"2024-05-07T14:01:21.659297+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:01:21.659297+0000","last_undegraded":"2024-05-07T14:01:21.659297+0000","last_fullsized":"2024-05-07T14:01:21.659297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":35,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151996+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:01:22.151996+0000","last_peered":"2024-05-07T14:01:22.151996+0000","last_clean":"2024-05-07T14:01:22.151996+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:01:22.151996+0000","last_undegraded":"2024-05-07T14:01:22.151996+0000","last_fullsized":"2024-05-07T14:01:22.151996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658088+0000","last_change":"2024-05-07T14:01:06.037755+0000","last_active":"2024-05-07T14:01:21.658088+0000","last_peered":"2024-05-07T14:01:21.658088+0000","last_clean":"2024-05-07T14:01:21.658088+0000","last_became_active":"2024-05-07T14:01:06.037156+0000","last_became_peered":"2024-05-07T14:01:06.037156+0000","last_unstale":"2024-05-07T14:01:21.658088+0000","last_undegraded":"2024-05-07T14:01:21.658088+0000","last_fullsized":"2024-05-07T14:01:21.658088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:30.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657641+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:01:21.657641+0000","last_peered":"2024-05-07T14:01:21.657641+0000","last_clean":"2024-05-07T14:01:21.657641+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:01:21.657641+0000","last_undegraded":"2024-05-07T14:01:21.657641+0000","last_fullsized":"2024-05-07T14:01:21.657641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152003+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:01:22.152003+0000","last_peered":"2024-05-07T14:01:22.152003+0000","last_clean":"2024-05-07T14:01:22.152003+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:01:22.152003+0000","last_undegraded":"2024-05-07T14:01:22.152003+0000","last_fullsized":"2024-05-07T14:01:22.152003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659789+0000","last_change":"2024-05-07T14:00:59.998197+0000","last_active":"2024-05-07T14:01:21.659789+0000","last_peered":"2024-05-07T14:01:21.659789+0000","last_clean":"2024-05-07T14:01:21.659789+0000","last_became_active":"2024-05-07T14:00:59.997438+0000","last_became_peered":"2024-05-07T14:00:59.997438+0000","last_unstale":"2024-05-07T14:01:21.659789+0000","last_undegraded":"2024-05-07T14:01:21.659789+0000","last_fullsized":"2024-05-07T14:01:21.659789+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:29.430229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150349+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:01:22.150349+0000","last_peered":"2024-05-07T14:01:22.150349+0000","last_clean":"2024-05-07T14:01:22.150349+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:01:22.150349+0000","last_undegraded":"2024-05-07T14:01:22.150349+0000","last_fullsized":"2024-05-07T14:01:22.150349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.155067+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:01:22.155067+0000","last_peered":"2024-05-07T14:01:22.155067+0000","last_clean":"2024-05-07T14:01:22.155067+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:01:22.155067+0000","last_undegraded":"2024-05-07T14:01:22.155067+0000","last_fullsized":"2024-05-07T14:01:22.155067+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.663502+0000","last_change":"2024-05-07T14:01:06.025913+0000","last_active":"2024-05-07T14:01:21.663502+0000","last_peered":"2024-05-07T14:01:21.663502+0000","last_clean":"2024-05-07T14:01:21.663502+0000","last_became_active":"2024-05-07T14:01:06.025220+0000","last_became_peered":"2024-05-07T14:01:06.025220+0000","last_unstale":"2024-05-07T14:01:21.663502+0000","last_undegraded":"2024-05-07T14:01:21.663502+0000","last_fullsized":"2024-05-07T14:01:21.663502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:30.164745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657185+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:01:21.657185+0000","last_peered":"2024-05-07T14:01:21.657185+0000","last_clean":"2024-05-07T14:01:21.657185+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:01:21.657185+0000","last_undegraded":"2024-05-07T14:01:21.657185+0000","last_fullsized":"2024-05-07T14:01:21.657185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153175+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:01:22.153175+0000","last_peered":"2024-05-07T14:01:22.153175+0000","last_clean":"2024-05-07T14:01:22.153175+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:01:22.153175+0000","last_undegraded":"2024-05-07T14:01:22.153175+0000","last_fullsized":"2024-05-07T14:01:22.153175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150924+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:01:22.150924+0000","last_peered":"2024-05-07T14:01:22.150924+0000","last_clean":"2024-05-07T14:01:22.150924+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:01:22.150924+0000","last_undegraded":"2024-05-07T14:01:22.150924+0000","last_fullsized":"2024-05-07T14:01:22.150924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158034+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:01:22.158034+0000","last_peered":"2024-05-07T14:01:22.158034+0000","last_clean":"2024-05-07T14:01:22.158034+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:01:22.158034+0000","last_undegraded":"2024-05-07T14:01:22.158034+0000","last_fullsized":"2024-05-07T14:01:22.158034+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151270+0000","last_change":"2024-05-07T14:01:04.017099+0000","last_active":"2024-05-07T14:01:22.151270+0000","last_peered":"2024-05-07T14:01:22.151270+0000","last_clean":"2024-05-07T14:01:22.151270+0000","last_became_active":"2024-05-07T14:01:04.011036+0000","last_became_peered":"2024-05-07T14:01:04.011036+0000","last_unstale":"2024-05-07T14:01:22.151270+0000","last_undegraded":"2024-05-07T14:01:22.151270+0000","last_fullsized":"2024-05-07T14:01:22.151270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:32.242974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658054+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:01:21.658054+0000","last_peered":"2024-05-07T14:01:21.658054+0000","last_clean":"2024-05-07T14:01:21.658054+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:01:21.658054+0000","last_undegraded":"2024-05-07T14:01:21.658054+0000","last_fullsized":"2024-05-07T14:01:21.658054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656179+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:01:21.656179+0000","last_peered":"2024-05-07T14:01:21.656179+0000","last_clean":"2024-05-07T14:01:21.656179+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:01:21.656179+0000","last_undegraded":"2024-05-07T14:01:21.656179+0000","last_fullsized":"2024-05-07T14:01:21.656179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658561+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:01:21.658561+0000","last_peered":"2024-05-07T14:01:21.658561+0000","last_clean":"2024-05-07T14:01:21.658561+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:01:21.658561+0000","last_undegraded":"2024-05-07T14:01:21.658561+0000","last_fullsized":"2024-05-07T14:01:21.658561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656205+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:01:21.656205+0000","last_peered":"2024-05-07T14:01:21.656205+0000","last_clean":"2024-05-07T14:01:21.656205+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:01:21.656205+0000","last_undegraded":"2024-05-07T14:01:21.656205+0000","last_fullsized":"2024-05-07T14:01:21.656205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":44,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657394+0000","last_change":"2024-05-07T14:01:02.013617+0000","last_active":"2024-05-07T14:01:21.657394+0000","last_peered":"2024-05-07T14:01:21.657394+0000","last_clean":"2024-05-07T14:01:21.657394+0000","last_became_active":"2024-05-07T14:01:02.009243+0000","last_became_peered":"2024-05-07T14:01:02.009243+0000","last_unstale":"2024-05-07T14:01:21.657394+0000","last_undegraded":"2024-05-07T14:01:21.657394+0000","last_fullsized":"2024-05-07T14:01:21.657394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656617+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:01:21.656617+0000","last_peered":"2024-05-07T14:01:21.656617+0000","last_clean":"2024-05-07T14:01:21.656617+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:01:21.656617+0000","last_undegraded":"2024-05-07T14:01:21.656617+0000","last_fullsized":"2024-05-07T14:01:21.656617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.661455+0000","last_change":"2024-05-07T14:01:06.023907+0000","last_active":"2024-05-07T14:01:21.661455+0000","last_peered":"2024-05-07T14:01:21.661455+0000","last_clean":"2024-05-07T14:01:21.661455+0000","last_became_active":"2024-05-07T14:01:06.023307+0000","last_became_peered":"2024-05-07T14:01:06.023307+0000","last_unstale":"2024-05-07T14:01:21.661455+0000","last_undegraded":"2024-05-07T14:01:21.661455+0000","last_fullsized":"2024-05-07T14:01:21.661455+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:41.916580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656570+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:01:21.656570+0000","last_peered":"2024-05-07T14:01:21.656570+0000","last_clean":"2024-05-07T14:01:21.656570+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:01:21.656570+0000","last_undegraded":"2024-05-07T14:01:21.656570+0000","last_fullsized":"2024-05-07T14:01:21.656570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.162817+0000","last_change":"2024-05-07T14:00:56.006013+0000","last_active":"2024-05-07T14:01:22.162817+0000","last_peered":"2024-05-07T14:01:22.162817+0000","last_clean":"2024-05-07T14:01:22.162817+0000","last_became_active":"2024-05-07T14:00:56.005758+0000","last_became_peered":"2024-05-07T14:00:56.005758+0000","last_unstale":"2024-05-07T14:01:22.162817+0000","last_undegraded":"2024-05-07T14:01:22.162817+0000","last_fullsized":"2024-05-07T14:01:22.162817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.155867+0000","last_change":"2024-05-07T14:00:59.998767+0000","last_active":"2024-05-07T14:01:22.155867+0000","last_peered":"2024-05-07T14:01:22.155867+0000","last_clean":"2024-05-07T14:01:22.155867+0000","last_became_active":"2024-05-07T14:00:59.998055+0000","last_became_peered":"2024-05-07T14:00:59.998055+0000","last_unstale":"2024-05-07T14:01:22.155867+0000","last_undegraded":"2024-05-07T14:01:22.155867+0000","last_fullsized":"2024-05-07T14:01:22.155867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:41.593806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":50,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656705+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:01:21.656705+0000","last_peered":"2024-05-07T14:01:21.656705+0000","last_clean":"2024-05-07T14:01:21.656705+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:01:21.656705+0000","last_undegraded":"2024-05-07T14:01:21.656705+0000","last_fullsized":"2024-05-07T14:01:21.656705+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157058+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:01:22.157058+0000","last_peered":"2024-05-07T14:01:22.157058+0000","last_clean":"2024-05-07T14:01:22.157058+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:01:22.157058+0000","last_undegraded":"2024-05-07T14:01:22.157058+0000","last_fullsized":"2024-05-07T14:01:22.157058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660009+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:01:21.660009+0000","last_peered":"2024-05-07T14:01:21.660009+0000","last_clean":"2024-05-07T14:01:21.660009+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:01:21.660009+0000","last_undegraded":"2024-05-07T14:01:21.660009+0000","last_fullsized":"2024-05-07T14:01:21.660009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159926+0000","last_change":"2024-05-07T14:00:58.005276+0000","last_active":"2024-05-07T14:01:22.159926+0000","last_peered":"2024-05-07T14:01:22.159926+0000","last_clean":"2024-05-07T14:01:22.159926+0000","last_became_active":"2024-05-07T14:00:58.004903+0000","last_became_peered":"2024-05-07T14:00:58.004903+0000","last_unstale":"2024-05-07T14:01:22.159926+0000","last_undegraded":"2024-05-07T14:01:22.159926+0000","last_fullsized":"2024-05-07T14:01:22.159926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151501+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:01:22.151501+0000","last_peered":"2024-05-07T14:01:22.151501+0000","last_clean":"2024-05-07T14:01:22.151501+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:01:22.151501+0000","last_undegraded":"2024-05-07T14:01:22.151501+0000","last_fullsized":"2024-05-07T14:01:22.151501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159055+0000","last_change":"2024-05-07T14:00:57.986882+0000","last_active":"2024-05-07T14:01:22.159055+0000","last_peered":"2024-05-07T14:01:22.159055+0000","last_clean":"2024-05-07T14:01:22.159055+0000","last_became_active":"2024-05-07T14:00:57.984867+0000","last_became_peered":"2024-05-07T14:00:57.984867+0000","last_unstale":"2024-05-07T14:01:22.159055+0000","last_undegraded":"2024-05-07T14:01:22.159055+0000","last_fullsized":"2024-05-07T14:01:22.159055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153651+0000","last_change":"2024-05-07T14:00:56.001559+0000","last_active":"2024-05-07T14:01:22.153651+0000","last_peered":"2024-05-07T14:01:22.153651+0000","last_clean":"2024-05-07T14:01:22.153651+0000","last_became_active":"2024-05-07T14:00:56.001149+0000","last_became_peered":"2024-05-07T14:00:56.001149+0000","last_unstale":"2024-05-07T14:01:22.153651+0000","last_undegraded":"2024-05-07T14:01:22.153651+0000","last_fullsized":"2024-05-07T14:01:22.153651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:13.077774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152472+0000","last_change":"2024-05-07T14:00:57.985233+0000","last_active":"2024-05-07T14:01:22.152472+0000","last_peered":"2024-05-07T14:01:22.152472+0000","last_clean":"2024-05-07T14:01:22.152472+0000","last_became_active":"2024-05-07T14:00:57.984523+0000","last_became_peered":"2024-05-07T14:00:57.984523+0000","last_unstale":"2024-05-07T14:01:22.152472+0000","last_undegraded":"2024-05-07T14:01:22.152472+0000","last_fullsized":"2024-05-07T14:01:22.152472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150731+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:01:22.150731+0000","last_peered":"2024-05-07T14:01:22.150731+0000","last_clean":"2024-05-07T14:01:22.150731+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:01:22.150731+0000","last_undegraded":"2024-05-07T14:01:22.150731+0000","last_fullsized":"2024-05-07T14:01:22.150731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151412+0000","last_change":"2024-05-07T14:00:57.989787+0000","last_active":"2024-05-07T14:01:22.151412+0000","last_peered":"2024-05-07T14:01:22.151412+0000","last_clean":"2024-05-07T14:01:22.151412+0000","last_became_active":"2024-05-07T14:00:57.989498+0000","last_became_peered":"2024-05-07T14:00:57.989498+0000","last_unstale":"2024-05-07T14:01:22.151412+0000","last_undegraded":"2024-05-07T14:01:22.151412+0000","last_fullsized":"2024-05-07T14:01:22.151412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158080+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:01:22.158080+0000","last_peered":"2024-05-07T14:01:22.158080+0000","last_clean":"2024-05-07T14:01:22.158080+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:01:22.158080+0000","last_undegraded":"2024-05-07T14:01:22.158080+0000","last_fullsized":"2024-05-07T14:01:22.158080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657263+0000","last_change":"2024-05-07T14:00:57.998054+0000","last_active":"2024-05-07T14:01:21.657263+0000","last_peered":"2024-05-07T14:01:21.657263+0000","last_clean":"2024-05-07T14:01:21.657263+0000","last_became_active":"2024-05-07T14:00:57.997750+0000","last_became_peered":"2024-05-07T14:00:57.997750+0000","last_unstale":"2024-05-07T14:01:21.657263+0000","last_undegraded":"2024-05-07T14:01:21.657263+0000","last_fullsized":"2024-05-07T14:01:21.657263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658230+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:01:21.658230+0000","last_peered":"2024-05-07T14:01:21.658230+0000","last_clean":"2024-05-07T14:01:21.658230+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:01:21.658230+0000","last_undegraded":"2024-05-07T14:01:21.658230+0000","last_fullsized":"2024-05-07T14:01:21.658230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.657339+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:01:21.657339+0000","last_peered":"2024-05-07T14:01:21.657339+0000","last_clean":"2024-05-07T14:01:21.657339+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:01:21.657339+0000","last_undegraded":"2024-05-07T14:01:21.657339+0000","last_fullsized":"2024-05-07T14:01:21.657339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159118+0000","last_change":"2024-05-07T14:00:55.974072+0000","last_active":"2024-05-07T14:01:22.159118+0000","last_peered":"2024-05-07T14:01:22.159118+0000","last_clean":"2024-05-07T14:01:22.159118+0000","last_became_active":"2024-05-07T14:00:55.973647+0000","last_became_peered":"2024-05-07T14:00:55.973647+0000","last_unstale":"2024-05-07T14:01:22.159118+0000","last_undegraded":"2024-05-07T14:01:22.159118+0000","last_fullsized":"2024-05-07T14:01:22.159118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.655996+0000","last_change":"2024-05-07T14:00:57.988167+0000","last_active":"2024-05-07T14:01:21.655996+0000","last_peered":"2024-05-07T14:01:21.655996+0000","last_clean":"2024-05-07T14:01:21.655996+0000","last_became_active":"2024-05-07T14:00:57.987884+0000","last_became_peered":"2024-05-07T14:00:57.987884+0000","last_unstale":"2024-05-07T14:01:21.655996+0000","last_undegraded":"2024-05-07T14:01:21.655996+0000","last_fullsized":"2024-05-07T14:01:21.655996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151192+0000","last_change":"2024-05-07T14:00:55.997287+0000","last_active":"2024-05-07T14:01:22.151192+0000","last_peered":"2024-05-07T14:01:22.151192+0000","last_clean":"2024-05-07T14:01:22.151192+0000","last_became_active":"2024-05-07T14:00:55.996467+0000","last_became_peered":"2024-05-07T14:00:55.996467+0000","last_unstale":"2024-05-07T14:01:22.151192+0000","last_undegraded":"2024-05-07T14:01:22.151192+0000","last_fullsized":"2024-05-07T14:01:22.151192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151401+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:01:22.151401+0000","last_peered":"2024-05-07T14:01:22.151401+0000","last_clean":"2024-05-07T14:01:22.151401+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:01:22.151401+0000","last_undegraded":"2024-05-07T14:01:22.151401+0000","last_fullsized":"2024-05-07T14:01:22.151401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658338+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:01:21.658338+0000","last_peered":"2024-05-07T14:01:21.658338+0000","last_clean":"2024-05-07T14:01:21.658338+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:01:21.658338+0000","last_undegraded":"2024-05-07T14:01:21.658338+0000","last_fullsized":"2024-05-07T14:01:21.658338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156547+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:01:22.156547+0000","last_peered":"2024-05-07T14:01:22.156547+0000","last_clean":"2024-05-07T14:01:22.156547+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:01:22.156547+0000","last_undegraded":"2024-05-07T14:01:22.156547+0000","last_fullsized":"2024-05-07T14:01:22.156547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150661+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:01:22.150661+0000","last_peered":"2024-05-07T14:01:22.150661+0000","last_clean":"2024-05-07T14:01:22.150661+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:01:22.150661+0000","last_undegraded":"2024-05-07T14:01:22.150661+0000","last_fullsized":"2024-05-07T14:01:22.150661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659745+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:01:21.659745+0000","last_peered":"2024-05-07T14:01:21.659745+0000","last_clean":"2024-05-07T14:01:21.659745+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:01:21.659745+0000","last_undegraded":"2024-05-07T14:01:21.659745+0000","last_fullsized":"2024-05-07T14:01:21.659745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.656264+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:01:21.656264+0000","last_peered":"2024-05-07T14:01:21.656264+0000","last_clean":"2024-05-07T14:01:21.656264+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:01:21.656264+0000","last_undegraded":"2024-05-07T14:01:21.656264+0000","last_fullsized":"2024-05-07T14:01:21.656264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158267+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:01:22.158267+0000","last_peered":"2024-05-07T14:01:22.158267+0000","last_clean":"2024-05-07T14:01:22.158267+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:01:22.158267+0000","last_undegraded":"2024-05-07T14:01:22.158267+0000","last_fullsized":"2024-05-07T14:01:22.158267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150672+0000","last_change":"2024-05-07T14:00:56.001135+0000","last_active":"2024-05-07T14:01:22.150672+0000","last_peered":"2024-05-07T14:01:22.150672+0000","last_clean":"2024-05-07T14:01:22.150672+0000","last_became_active":"2024-05-07T14:00:55.999884+0000","last_became_peered":"2024-05-07T14:00:55.999884+0000","last_unstale":"2024-05-07T14:01:22.150672+0000","last_undegraded":"2024-05-07T14:01:22.150672+0000","last_fullsized":"2024-05-07T14:01:22.150672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.659387+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:01:21.659387+0000","last_peered":"2024-05-07T14:01:21.659387+0000","last_clean":"2024-05-07T14:01:21.659387+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:01:21.659387+0000","last_undegraded":"2024-05-07T14:01:21.659387+0000","last_fullsized":"2024-05-07T14:01:21.659387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.158726+0000","last_change":"2024-05-07T14:00:55.989670+0000","last_active":"2024-05-07T14:01:22.158726+0000","last_peered":"2024-05-07T14:01:22.158726+0000","last_clean":"2024-05-07T14:01:22.158726+0000","last_became_active":"2024-05-07T14:00:55.989455+0000","last_became_peered":"2024-05-07T14:00:55.989455+0000","last_unstale":"2024-05-07T14:01:22.158726+0000","last_undegraded":"2024-05-07T14:01:22.158726+0000","last_fullsized":"2024-05-07T14:01:22.158726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.660474+0000","last_change":"2024-05-07T14:00:57.979022+0000","last_active":"2024-05-07T14:01:21.660474+0000","last_peered":"2024-05-07T14:01:21.660474+0000","last_clean":"2024-05-07T14:01:21.660474+0000","last_became_active":"2024-05-07T14:00:57.977403+0000","last_became_peered":"2024-05-07T14:00:57.977403+0000","last_unstale":"2024-05-07T14:01:21.660474+0000","last_undegraded":"2024-05-07T14:01:21.660474+0000","last_fullsized":"2024-05-07T14:01:21.660474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.151885+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:01:22.151885+0000","last_peered":"2024-05-07T14:01:22.151885+0000","last_clean":"2024-05-07T14:01:22.151885+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:01:22.151885+0000","last_undegraded":"2024-05-07T14:01:22.151885+0000","last_fullsized":"2024-05-07T14:01:22.151885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.157304+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:01:22.157304+0000","last_peered":"2024-05-07T14:01:22.157304+0000","last_clean":"2024-05-07T14:01:22.157304+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:01:22.157304+0000","last_undegraded":"2024-05-07T14:01:22.157304+0000","last_fullsized":"2024-05-07T14:01:22.157304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.662037+0000","last_change":"2024-05-07T14:00:55.978771+0000","last_active":"2024-05-07T14:01:21.662037+0000","last_peered":"2024-05-07T14:01:21.662037+0000","last_clean":"2024-05-07T14:01:21.662037+0000","last_became_active":"2024-05-07T14:00:55.978000+0000","last_became_peered":"2024-05-07T14:00:55.978000+0000","last_unstale":"2024-05-07T14:01:21.662037+0000","last_undegraded":"2024-05-07T14:01:21.662037+0000","last_fullsized":"2024-05-07T14:01:21.662037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.655840+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:01:21.655840+0000","last_peered":"2024-05-07T14:01:21.655840+0000","last_clean":"2024-05-07T14:01:21.655840+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:01:21.655840+0000","last_undegraded":"2024-05-07T14:01:21.655840+0000","last_fullsized":"2024-05-07T14:01:21.655840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.159570+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:01:22.159570+0000","last_peered":"2024-05-07T14:01:22.159570+0000","last_clean":"2024-05-07T14:01:22.159570+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:01:22.159570+0000","last_undegraded":"2024-05-07T14:01:22.159570+0000","last_fullsized":"2024-05-07T14:01:22.159570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:21.658828+0000","last_change":"2024-05-07T14:00:57.979073+0000","last_active":"2024-05-07T14:01:21.658828+0000","last_peered":"2024-05-07T14:01:21.658828+0000","last_clean":"2024-05-07T14:01:21.658828+0000","last_became_active":"2024-05-07T14:00:57.978215+0000","last_became_peered":"2024-05-07T14:00:57.978215+0000","last_unstale":"2024-05-07T14:01:21.658828+0000","last_undegraded":"2024-05-07T14:01:21.658828+0000","last_fullsized":"2024-05-07T14:01:21.658828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.153207+0000","last_change":"2024-05-07T14:00:56.001199+0000","last_active":"2024-05-07T14:01:22.153207+0000","last_peered":"2024-05-07T14:01:22.153207+0000","last_clean":"2024-05-07T14:01:22.153207+0000","last_became_active":"2024-05-07T14:00:56.000434+0000","last_became_peered":"2024-05-07T14:00:56.000434+0000","last_unstale":"2024-05-07T14:01:22.153207+0000","last_undegraded":"2024-05-07T14:01:22.153207+0000","last_fullsized":"2024-05-07T14:01:22.153207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.150613+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:01:22.150613+0000","last_peered":"2024-05-07T14:01:22.150613+0000","last_clean":"2024-05-07T14:01:22.150613+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:01:22.150613+0000","last_undegraded":"2024-05-07T14:01:22.150613+0000","last_fullsized":"2024-05-07T14:01:22.150613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156884+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:01:22.156884+0000","last_peered":"2024-05-07T14:01:22.156884+0000","last_clean":"2024-05-07T14:01:22.156884+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:01:22.156884+0000","last_undegraded":"2024-05-07T14:01:22.156884+0000","last_fullsized":"2024-05-07T14:01:22.156884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.156532+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:01:22.156532+0000","last_peered":"2024-05-07T14:01:22.156532+0000","last_clean":"2024-05-07T14:01:22.156532+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:01:22.156532+0000","last_undegraded":"2024-05-07T14:01:22.156532+0000","last_fullsized":"2024-05-07T14:01:22.156532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-05-07T14:01:22.152212+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:01:22.152212+0000","last_peered":"2024-05-07T14:01:22.152212+0000","last_clean":"2024-05-07T14:01:22.152212+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:01:22.152212+0000","last_undegraded":"2024-05-07T14:01:22.152212+0000","last_fullsized":"2024-05-07T14:01:22.152212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1097728,"data_stored":807769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":209099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":217569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":217232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":217137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":216739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":217984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1081344,"data_stored":807611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:01:23.573 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-07T14:01:23.573 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-07T14:01:23.610 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:23.625+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:23.644 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:23.645 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:23.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:23.645 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:23.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.645 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:129 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'87, mlcod=17'85)", 2024-05-07T14:01:23.645 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:01:23.645 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.360645624999997, 2024-05-07T14:01:23.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034674469999999998, 2024-05-07T14:01:23.645 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.645 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.645 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.646 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:01:23.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:01:23.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299075+0000", 2024-05-07T14:01:23.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.736e-06 2024-05-07T14:01:23.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299087+0000", 2024-05-07T14:01:23.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2067e-05 2024-05-07T14:01:23.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299122+0000", 2024-05-07T14:01:23.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4643e-05 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299141+0000", 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9224000000000001e-05 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299323+0000", 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018190400000000001 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299385+0000", 2024-05-07T14:01:23.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2126999999999997e-05 2024-05-07T14:01:23.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302462+0000", 2024-05-07T14:01:23.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030768330000000002 2024-05-07T14:01:23.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302541+0000", 2024-05-07T14:01:23.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8912999999999995e-05 2024-05-07T14:01:23.649 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.649 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.650 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.650 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:131 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'89, mlcod=17'85)", 2024-05-07T14:01:23.650 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:01:23.650 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.359312952000003, 2024-05-07T14:01:23.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038759010000000002, 2024-05-07T14:01:23.650 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.650 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.650 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.650 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:01:23.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:01:23.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300407+0000", 2024-05-07T14:01:23.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0299999999999998e-07 2024-05-07T14:01:23.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300577+0000", 2024-05-07T14:01:23.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000170259 2024-05-07T14:01:23.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300592+0000", 2024-05-07T14:01:23.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4707e-05 2024-05-07T14:01:23.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300601+0000", 2024-05-07T14:01:23.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999995e-06 2024-05-07T14:01:23.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301133+0000", 2024-05-07T14:01:23.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053150199999999999 2024-05-07T14:01:23.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301186+0000", 2024-05-07T14:01:23.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.342e-05 2024-05-07T14:01:23.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304217+0000", 2024-05-07T14:01:23.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030307429999999998 2024-05-07T14:01:23.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304282+0000", 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5316999999999998e-05 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:132 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'90, mlcod=17'85)", 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.358260856999998, 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041397580000000003, 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301459+0000", 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.47e-07 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301470+0000", 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0933e-05 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301483+0000", 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2427e-05 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301491+0000", 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6130000000000004e-06 2024-05-07T14:01:23.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302683+0000", 2024-05-07T14:01:23.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011919980000000001 2024-05-07T14:01:23.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302741+0000", 2024-05-07T14:01:23.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7963000000000001e-05 2024-05-07T14:01:23.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305494+0000", 2024-05-07T14:01:23.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027531420000000001 2024-05-07T14:01:23.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305598+0000", 2024-05-07T14:01:23.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103835 2024-05-07T14:01:23.659 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.659 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.659 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:134 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'92, mlcod=17'85)", 2024-05-07T14:01:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:01:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.355974959999998, 2024-05-07T14:01:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037081470000000002, 2024-05-07T14:01:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:01:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:01:23.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303747+0000", 2024-05-07T14:01:23.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:01:23.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303805+0000", 2024-05-07T14:01:23.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8554999999999998e-05 2024-05-07T14:01:23.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303829+0000", 2024-05-07T14:01:23.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3799999999999999e-05 2024-05-07T14:01:23.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303871+0000", 2024-05-07T14:01:23.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2079999999999997e-05 2024-05-07T14:01:23.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304359+0000", 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048822999999999998 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304415+0000", 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5405999999999998e-05 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307388+0000", 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029728070000000001 2024-05-07T14:01:23.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307452+0000", 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4789000000000006e-05 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:137 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'95, mlcod=17'88)", 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.352351059, 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004097552, 2024-05-07T14:01:23.665 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307370+0000", 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3939999999999999e-06 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307454+0000", 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4639000000000001e-05 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307474+0000", 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0242999999999999e-05 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307485+0000", 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0710000000000001e-05 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307538+0000", 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2623000000000001e-05 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307566+0000", 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.781e-05 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311405+0000", 2024-05-07T14:01:23.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038392299999999999 2024-05-07T14:01:23.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311466+0000", 2024-05-07T14:01:23.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0903000000000003e-05 2024-05-07T14:01:23.669 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.669 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.669 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.670 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:138 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'96, mlcod=17'93)", 2024-05-07T14:01:23.670 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:01:23.670 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.349054920999997, 2024-05-07T14:01:23.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034036700000000001, 2024-05-07T14:01:23.670 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.670 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.670 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.670 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:01:23.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310666+0000", 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310680+0000", 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4047e-05 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310715+0000", 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4826000000000002e-05 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310739+0000", 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3796000000000001e-05 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310862+0000", 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123132 2024-05-07T14:01:23.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310896+0000", 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.43e-05 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313965+0000", 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030685959999999998 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314068+0000", 2024-05-07T14:01:23.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102963 2024-05-07T14:01:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:01:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:01:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.348149237999998, 2024-05-07T14:01:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:01:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.674 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:01:23.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:01:23.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:01:23.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:01:23.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:01:23.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:01:23.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:01:23.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:01:23.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:01:23.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:01:23.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:01:23.678 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.678 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.678 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.347242842, 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:01:23.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:01:23.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:01:23.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:01:23.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:01:23.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:01:23.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:01:23.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:01:23.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:01:23.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:01:23.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:01:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:01:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:01:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:01:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:01:23.683 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.345830223, 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:01:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:01:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:01:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:01:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:01:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:01:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:01:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:01:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:01:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:01:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:01:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:01:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:01:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:143 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'101, mlcod=17'98)", 2024-05-07T14:01:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:01:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.337937453999999, 2024-05-07T14:01:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036609120000000001, 2024-05-07T14:01:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:01:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:01:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321783+0000", 2024-05-07T14:01:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3599999999999999e-06 2024-05-07T14:01:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321905+0000", 2024-05-07T14:01:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121923 2024-05-07T14:01:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321929+0000", 2024-05-07T14:01:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4295999999999999e-05 2024-05-07T14:01:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321945+0000", 2024-05-07T14:01:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5773999999999998e-05 2024-05-07T14:01:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322070+0000", 2024-05-07T14:01:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012457899999999999 2024-05-07T14:01:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322101+0000", 2024-05-07T14:01:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1213000000000001e-05 2024-05-07T14:01:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325342+0000", 2024-05-07T14:01:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032410579999999998 2024-05-07T14:01:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325443+0000", 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100709 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:144 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.336868711999998, 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003406484, 2024-05-07T14:01:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:01:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:01:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322852+0000", 2024-05-07T14:01:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8369999999999999e-06 2024-05-07T14:01:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323022+0000", 2024-05-07T14:01:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016984199999999999 2024-05-07T14:01:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323048+0000", 2024-05-07T14:01:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5752999999999999e-05 2024-05-07T14:01:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323071+0000", 2024-05-07T14:01:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.266e-05 2024-05-07T14:01:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323188+0000", 2024-05-07T14:01:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011728200000000001 2024-05-07T14:01:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323224+0000", 2024-05-07T14:01:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6380000000000001e-05 2024-05-07T14:01:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326163+0000", 2024-05-07T14:01:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029386170000000001 2024-05-07T14:01:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326257+0000", 2024-05-07T14:01:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4112999999999998e-05 2024-05-07T14:01:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:01:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:01:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.640537799000001, 2024-05-07T14:01:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034691510000000002, 2024-05-07T14:01:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 206 2024-05-07T14:01:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:01:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:01:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019184+0000", 2024-05-07T14:01:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6170000000000001e-06 2024-05-07T14:01:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019198+0000", 2024-05-07T14:01:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4113e-05 2024-05-07T14:01:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019229+0000", 2024-05-07T14:01:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0423e-05 2024-05-07T14:01:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019244+0000", 2024-05-07T14:01:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5047e-05 2024-05-07T14:01:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019478+0000", 2024-05-07T14:01:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000234398 2024-05-07T14:01:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019723+0000", 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024469500000000001 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.020149+0000", 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042592999999999998 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.021776+0000", 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001627688 2024-05-07T14:01:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022453+0000", 2024-05-07T14:01:23.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00067671500000000004 2024-05-07T14:01:23.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022551+0000", 2024-05-07T14:01:23.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8312000000000003e-05 2024-05-07T14:01:23.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022651+0000", 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9213e-05 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.613248619, 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038721300000000001, 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.705 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.706 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:23.706 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:23.706 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:23.706 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 210 2024-05-07T14:01:23.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.706 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:01:23.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:01:23.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046474+0000", 2024-05-07T14:01:23.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.517e-06 2024-05-07T14:01:23.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046487+0000", 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3113e-05 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046521+0000", 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3556000000000002e-05 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046537+0000", 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.643e-05 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046651+0000", 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011368500000000001 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046873+0000", 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221802 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.047335+0000", 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046227300000000002 2024-05-07T14:01:23.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:23.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.048993+0000", 2024-05-07T14:01:23.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016576679999999999 2024-05-07T14:01:23.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050186+0000", 2024-05-07T14:01:23.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001193284 2024-05-07T14:01:23.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050273+0000", 2024-05-07T14:01:23.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7189999999999997e-05 2024-05-07T14:01:23.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050343+0000", 2024-05-07T14:01:23.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9611999999999997e-05 2024-05-07T14:01:23.711 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.711 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.711 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.583741873000001, 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034712530000000001, 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 218 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:01:23.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:01:23.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075980+0000", 2024-05-07T14:01:23.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.774e-06 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075992+0000", 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2283000000000001e-05 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076024+0000", 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1242999999999999e-05 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076038+0000", 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4663e-05 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076199+0000", 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160865 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076539+0000", 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033995800000000001 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.077234+0000", 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000694581 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.078996+0000", 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001762633 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079276+0000", 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027998399999999999 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079380+0000", 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103266 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079449+0000", 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9003000000000003e-05 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.520159741000001, 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:23.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:01:23.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:01:23.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:01:23.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:01:23.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:01:23.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:01:23.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:01:23.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:01:23.723 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.723 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.723 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.723 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:23.723 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.487049082999999, 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:01:23.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.480139164000001, 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041680119999999996, 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.729 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.730 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:23.730 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:23.730 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:23.730 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 382 2024-05-07T14:01:23.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.730 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:01:23.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179581+0000", 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179585+0000", 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4800000000000003e-06 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179598+0000", 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2322e-05 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179604+0000", 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.823e-06 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179657+0000", 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3937000000000002e-05 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179714+0000", 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6165000000000002e-05 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179830+0000", 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011632 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.180515+0000", 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00068531400000000002 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183667+0000", 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031522009999999999 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183704+0000", 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6925999999999998e-05 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183748+0000", 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3618999999999997e-05 2024-05-07T14:01:23.734 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:499 6.13 e33/27 6:cedbb205:::obj_delete_at_hint.0000000017:head v 33'4, mlcod=33'1)", 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.406766510000001, 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043323679999999996, 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:01:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:01:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252954+0000", 2024-05-07T14:01:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.71e-07 2024-05-07T14:01:23.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252960+0000", 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.46e-06 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252974+0000", 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4249e-05 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252982+0000", 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:01:23.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253055+0000", 2024-05-07T14:01:23.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3162000000000002e-05 2024-05-07T14:01:23.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253075+0000", 2024-05-07T14:01:23.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9451999999999999e-05 2024-05-07T14:01:23.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257253+0000", 2024-05-07T14:01:23.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041781179999999998 2024-05-07T14:01:23.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257285+0000", 2024-05-07T14:01:23.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2075e-05 2024-05-07T14:01:23.739 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.739 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.739 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.740 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:550 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:23.740 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:01:23.740 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.371112327999999, 2024-05-07T14:01:23.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035552140000000001, 2024-05-07T14:01:23.740 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.740 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.740 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.740 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:23.740 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:23.740 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:23.740 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 550 2024-05-07T14:01:23.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.740 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288608+0000", 2024-05-07T14:01:23.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0529999999999999e-06 2024-05-07T14:01:23.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288613+0000", 2024-05-07T14:01:23.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7060000000000003e-06 2024-05-07T14:01:23.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288624+0000", 2024-05-07T14:01:23.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1547e-05 2024-05-07T14:01:23.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288630+0000", 2024-05-07T14:01:23.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:01:23.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288734+0000", 2024-05-07T14:01:23.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103872 2024-05-07T14:01:23.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288884+0000", 2024-05-07T14:01:23.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014987400000000001 2024-05-07T14:01:23.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:23.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289167+0000", 2024-05-07T14:01:23.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028341999999999999 2024-05-07T14:01:23.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:23.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289813+0000", 2024-05-07T14:01:23.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064550199999999995 2024-05-07T14:01:23.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292082+0000", 2024-05-07T14:01:23.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022696000000000001 2024-05-07T14:01:23.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292120+0000", 2024-05-07T14:01:23.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7367999999999999e-05 2024-05-07T14:01:23.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292162+0000", 2024-05-07T14:01:23.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2568000000000003e-05 2024-05-07T14:01:23.747 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.747 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.747 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.748 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:667 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:23.748 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:01:23.748 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.275170293999999, 2024-05-07T14:01:23.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050309150000000004, 2024-05-07T14:01:23.748 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:23.748 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:23.748 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:23.748 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:23.749 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:23.749 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:23.749 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 667 2024-05-07T14:01:23.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.749 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:23.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:23.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:01:23.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:23.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:01:23.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:23.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:23.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384550+0000", 2024-05-07T14:01:23.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7000000000000003e-07 2024-05-07T14:01:23.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:23.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384555+0000", 2024-05-07T14:01:23.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.135e-06 2024-05-07T14:01:23.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:23.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384565+0000", 2024-05-07T14:01:23.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0541e-05 2024-05-07T14:01:23.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384571+0000", 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.857e-06 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384670+0000", 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8461999999999993e-05 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384822+0000", 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152039 2024-05-07T14:01:23.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:23.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.385123+0000", 2024-05-07T14:01:23.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030070699999999999 2024-05-07T14:01:23.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:23.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.386099+0000", 2024-05-07T14:01:23.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097677300000000001 2024-05-07T14:01:23.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:23.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389495+0000", 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033959139999999999 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389530+0000", 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.472e-05 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389580+0000", 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9897e-05 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.754 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.755 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:23.755 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:23.755 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:23.755 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:01:23.757 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:01:23.757 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:23.769+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:23.858 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:23.873+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:23.925 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:23.926 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:23.926 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:23.926 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:23.940 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:01:23.958 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:23.973+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:24.049 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:24.049 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:24.049 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:24.049 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:24.049 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:24.060 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:24.073+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:24.061 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:01:24.161 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:24.173+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:24.173 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:24.173 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:24.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:24.173 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:01:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.200794704, 2024-05-07T14:01:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:01:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:01:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:01:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:01:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:01:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:01:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:01:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:01:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:01:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:01:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:01:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:01:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:01:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:01:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:01:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:01:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:01:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:01:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:01:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:01:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:01:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:01:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.153628832999999, 2024-05-07T14:01:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:01:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:01:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:01:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:01:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:01:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:01:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:01:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:01:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:01:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:01:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:01:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:01:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:01:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:01:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:01:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:01:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:01:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.053301113, 2024-05-07T14:01:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:01:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:01:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:01:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:01:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:01:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:01:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:01:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:01:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:01:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:01:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:01:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:01:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:01:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:01:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:01:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:01:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:01:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:01:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:01:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:01:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:01:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:01:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:01:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:01:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.150757056, 2024-05-07T14:01:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:01:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:01:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:01:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:01:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:01:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:01:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:01:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:01:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:01:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:01:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:01:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:01:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:01:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:01:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:01:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:01:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:01:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:01:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:01:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:01:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:01:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:01:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:01:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:01:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.200 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.200 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:24.200 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.131447088000002, 2024-05-07T14:01:24.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:01:24.200 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.200 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:01:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:01:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:01:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:01:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:01:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:01:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:01:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:01:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:01:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:01:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:01:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:01:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.106080177999999, 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:01:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:01:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:01:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:01:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:01:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:01:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:01:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:01:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:01:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:01:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:01:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:01:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:01:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:01:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:01:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:01:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.086290794, 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:01:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:01:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:01:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:01:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:01:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:01:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:01:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:01:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.053052433000001, 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:24.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:01:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:01:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:01:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:01:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:01:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:01:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:01:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.017691412000001, 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:01:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:01:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:01:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:01:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.992947846, 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:01:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:01:24.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:01:24.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.234 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:24.234 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:01:24.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:01:24.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.234 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.234 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:01:24.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:01:24.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.235 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.235 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:01:24.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:01:24.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.235 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.235 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:01:24.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:01:24.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.235 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.235 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.882071443000001, 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.236 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:24.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:01:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:01:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:01:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:01:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.238 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.239 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.241 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.825907493999999, 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.242 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.243 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:01:24.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:01:24.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.245 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:01:24.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:01:24.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.245 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:01:24.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:01:24.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.246 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:24.246 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:01:24.246 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:01:24.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.246 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.246 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:01:24.246 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:01:24.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.246 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.246 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:01:24.247 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:01:24.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.247 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.247 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.247 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:01:24.247 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:01:24.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.247 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.247 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.247 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:01:24.247 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:01:24.247 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.247 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.248 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.248 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.248 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:24.248 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.810022309000001, 2024-05-07T14:01:24.248 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:01:24.248 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.248 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.248 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.248 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.248 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.250 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.250 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:01:24.250 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:01:24.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.250 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.250 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:01:24.250 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:01:24.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.250 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.250 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.251 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.253 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.253 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:01:24.253 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:01:24.253 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.253 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.253 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:01:24.253 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:01:24.253 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.253 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.253 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:01:24.253 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:01:24.254 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.254 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.254 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.254 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.254 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:24.254 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.560656056999999, 2024-05-07T14:01:24.254 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:01:24.254 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.254 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.254 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:24.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.258 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:01:24.258 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:01:24.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.258 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:24.258 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:01:24.258 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:01:24.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.258 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.258 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:01:24.258 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:01:24.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.259 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.259 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:01:24.259 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:01:24.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.259 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.259 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:01:24.259 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:01:24.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.259 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.259 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.499283234, 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.260 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:24.261 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.262 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.263 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.264 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.265 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.266 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.266 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.266 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:24.266 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.303494892, 2024-05-07T14:01:24.266 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:01:24.266 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.266 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.266 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.266 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.266 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.266 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:01:24.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:01:24.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.270 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:01:24.271 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:01:24.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.271 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.271 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:01:24.271 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:01:24.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.271 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.271 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:01:24.271 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:01:24.271 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.271 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.299191442000001, 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003023937, 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.272 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 918 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.273 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886558+0000", 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1229999999999998e-06 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886569+0000", 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1497e-05 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886600+0000", 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0809999999999998e-05 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.275 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.275 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886618+0000", 2024-05-07T14:01:24.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7799e-05 2024-05-07T14:01:24.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.275 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.275 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886736+0000", 2024-05-07T14:01:24.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118276 2024-05-07T14:01:24.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.275 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.275 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886951+0000", 2024-05-07T14:01:24.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021467200000000001 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.887437+0000", 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048624900000000001 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.888687+0000", 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012498310000000001 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.276 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889318+0000", 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063122199999999997 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889463+0000", 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144769 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889580+0000", 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011668899999999999 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.278 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.278 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:24.278 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.268190718, 2024-05-07T14:01:24.278 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:01:24.278 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.278 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.278 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.278 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.278 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.278 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.278 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:01:24.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.279 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.279 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.279 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:24.279 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.279 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.279 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:24.279 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:01:24.280 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:01:24.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.281 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:01:24.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:01:24.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.281 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:01:24.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:01:24.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.283 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.284 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.284 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:24.284 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.263305826, 2024-05-07T14:01:24.284 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:01:24.284 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.284 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.284 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.284 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.284 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.284 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.284 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:01:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:01:24.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.287 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.287 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:01:24.287 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:01:24.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.287 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.287 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:01:24.287 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:01:24.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.287 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.287 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.290 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:24.290 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:24.290 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.231384455000001, 2024-05-07T14:01:24.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:01:24.290 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:24.290 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:24.290 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:24.290 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:24.290 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:24.290 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:24.290 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:01:24.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:01:24.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:24.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:01:24.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:01:24.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:24.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:24.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:24.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:01:24.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:01:24.295 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.295 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.295 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.295 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:24.295 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:24.295 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:24.297 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:01:24.297 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:24.309+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:24.398 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:24.413+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:24.419 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:24.419 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:24.419 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:24.419 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:24.432 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:01:24.464 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:01:24.522 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:24.537+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:24.554 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:24.554 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:24.554 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:24.554 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:24.554 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:24.568 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:01:24.599 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:24.613+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:24.621 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:24.622 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:24.638 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:24.639 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:24.656 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:24.656 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:24.657 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:01:24.685 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:24.686 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:24.700 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:24.712+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:24.706 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:24.706 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:24.726 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:24.727 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:24.729 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:24.729 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:24.743 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:01:24.747 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:24.767 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:24.768 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:24.801 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:24.812+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:24.861 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:24.862 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:24.875 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:01:24.922 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:24.937+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:24.991 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:24.991 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:25.003 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:25.017+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:25.005 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:01:25.103 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:25.117+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:25.158 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:25.158 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:25.170 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:01:25.218 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:25.232+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:25.303 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:25.303 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:25.306 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:25.320+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:25.317 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:01:25.407 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:25.420+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:25.481 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:25.481 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:25.497 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:01:25.538 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:25.552+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:25.609 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:25.620+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:25.662 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:25.662 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:25.676 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:01:25.710 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:25.721+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:25.811 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:25.825+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:25.841 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:25.841 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:25.855 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:01:25.912 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:25.924+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:25.975 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:25.975 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:25.990 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:01:26.013 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:26.025+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:26.114 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:26.128+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:26.154 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:26.154 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:26.169 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:01:26.254 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:26.268+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:26.315 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:26.329+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:26.332 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:26.332 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:26.346 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:01:26.434 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:26.448+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:26.507 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:26.508 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:26.517 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:26.528+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:26.521 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:01:26.618 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:26.632+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:26.685 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:01:26.694 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:26.694 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:26.708 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:01:26.750 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:26.764+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:26.786 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:01:26.830 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:26.845+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:26.870 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:26.870 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:26.884 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:01:26.920 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:26.933+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:26.932 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:26.932 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:26.948 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:26.948 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:26.965 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:26.966 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:26.982 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:26.983 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:27.001 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:27.001 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:27.003 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:27.003 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:27.017 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:01:27.020 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:27.020 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:27.020 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:27.033+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:27.038 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:27.039 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:27.056 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:27.057 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:27.120 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:27.132+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:27.138 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:27.138 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:27.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:27.138 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:27.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.323565422000001, 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63420480000000001, 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827477+0000", 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:01:27.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827491+0000", 2024-05-07T14:01:27.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3923999999999999e-05 2024-05-07T14:01:27.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827514+0000", 2024-05-07T14:01:27.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2796e-05 2024-05-07T14:01:27.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827531+0000", 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7520000000000002e-05 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827677+0000", 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145408 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827703+0000", 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6704e-05 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.458662+0000", 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63095893199999997 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459006+0000", 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034329 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459320+0000", 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031472100000000001 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.460665+0000", 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001344633 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461508+0000", 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084310400000000001 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461608+0000", 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9481999999999994e-05 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461680+0000", 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1976000000000003e-05 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.626505090000002, 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015167432999999999, 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.145 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.146 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.146 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.146 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.146 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 37 2024-05-07T14:01:27.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.146 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:01:27.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524536+0000", 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524542+0000", 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7699999999999998e-06 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524551+0000", 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4199999999999996e-06 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524558+0000", 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.379e-06 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534146+0000", 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095872700000000002 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534387+0000", 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024181499999999999 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534752+0000", 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036441400000000002 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.536608+0000", 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001856239 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539547+0000", 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00293859 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539639+0000", 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2548999999999998e-05 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539703+0000", 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3330000000000005e-05 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.150 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.506976786000003, 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013763364, 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.151 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 88 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644064+0000", 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644070+0000", 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5500000000000002e-06 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644079+0000", 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.55e-06 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644086+0000", 2024-05-07T14:01:27.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.934e-06 2024-05-07T14:01:27.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655168+0000", 2024-05-07T14:01:27.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011081967 2024-05-07T14:01:27.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655307+0000", 2024-05-07T14:01:27.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013893600000000001 2024-05-07T14:01:27.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655515+0000", 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020742499999999999 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657174+0000", 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016592340000000001 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657576+0000", 2024-05-07T14:01:27.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040245400000000001 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657723+0000", 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014719200000000001 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657827+0000", 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103319 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.340441601000002, 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014874368000000001, 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 108 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0699999999999996e-07 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810608+0000", 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6330000000000002e-06 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810618+0000", 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0366999999999999e-05 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810626+0000", 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7430000000000002e-06 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818597+0000", 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079710549999999995 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818873+0000", 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027635099999999998 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.819288+0000", 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041430599999999997 2024-05-07T14:01:27.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822081+0000", 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002793032 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825193+0000", 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003112606 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825361+0000", 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167703 2024-05-07T14:01:27.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825473+0000", 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111865 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.340292279000003, 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015242152, 2024-05-07T14:01:27.162 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 109 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810749+0000", 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-06 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810943+0000", 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019437499999999999 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810959+0000", 2024-05-07T14:01:27.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5440000000000001e-05 2024-05-07T14:01:27.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810971+0000", 2024-05-07T14:01:27.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2023e-05 2024-05-07T14:01:27.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820386+0000", 2024-05-07T14:01:27.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094148570000000004 2024-05-07T14:01:27.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820569+0000", 2024-05-07T14:01:27.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018298199999999999 2024-05-07T14:01:27.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820827+0000", 2024-05-07T14:01:27.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025869400000000001 2024-05-07T14:01:27.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825585+0000", 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004757051 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825752+0000", 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167479 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825881+0000", 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128629 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825990+0000", 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109415 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.340049927000003, 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015251472, 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.168 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 110 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810991+0000", 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7600000000000006e-07 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810998+0000", 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3899999999999998e-06 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811007+0000", 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5869999999999999e-06 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811014+0000", 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822508+0000", 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01149416 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822698+0000", 2024-05-07T14:01:27.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018972600000000001 2024-05-07T14:01:27.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823009+0000", 2024-05-07T14:01:27.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031125100000000002 2024-05-07T14:01:27.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825710+0000", 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002700619 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826014+0000", 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030398799999999999 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826137+0000", 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123416 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826242+0000", 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104279 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.340015027, 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017650448999999999, 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.174 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 111 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:01:27.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811026+0000", 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5300000000000004e-07 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811031+0000", 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0329999999999999e-06 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811043+0000", 2024-05-07T14:01:27.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2543e-05 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811050+0000", 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8000000000000001e-06 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823676+0000", 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012626052 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823904+0000", 2024-05-07T14:01:27.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227562 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.824349+0000", 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044484 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826371+0000", 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020221380000000001 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828408+0000", 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020372369999999999 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828540+0000", 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013213600000000001 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828676+0000", 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013545500000000001 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.179 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.339953612000002, 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021330954999999999, 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 112 2024-05-07T14:01:27.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:01:27.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-07 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811224+0000", 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653499999999999 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811237+0000", 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.271e-05 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811245+0000", 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6400000000000003e-06 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826483+0000", 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015237456 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826705+0000", 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022216799999999999 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.827081+0000", 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037659800000000002 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.831960+0000", 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048788779999999997 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832167+0000", 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020690500000000001 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832305+0000", 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013801899999999999 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832418+0000", 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112212 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:01:27.185 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.339780103000002, 2024-05-07T14:01:27.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021403628000000001, 2024-05-07T14:01:27.186 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.186 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.186 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.186 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.186 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.186 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.186 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 113 2024-05-07T14:01:27.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811261+0000", 2024-05-07T14:01:27.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0400000000000005e-07 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811267+0000", 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6099999999999997e-06 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811276+0000", 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4029999999999996e-06 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811283+0000", 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828825+0000", 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017541853999999999 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829061+0000", 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235861 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829418+0000", 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035766800000000001 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832130+0000", 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027118120000000001 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832442+0000", 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000311611 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832565+0000", 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012284199999999999 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832664+0000", 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8982999999999997e-05 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:27.191 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.339746112999997, 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023518260999999999, 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 114 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:01:27.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:01:27.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811295+0000", 2024-05-07T14:01:27.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:01:27.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811301+0000", 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8599999999999998e-06 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811310+0000", 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0299999999999999e-06 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811320+0000", 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023e-05 2024-05-07T14:01:27.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830314+0000", 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018994385999999999 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830552+0000", 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023815500000000001 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830971+0000", 2024-05-07T14:01:27.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041934300000000003 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834620+0000", 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036481389999999999 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834666+0000", 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6266000000000001e-05 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834742+0000", 2024-05-07T14:01:27.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6069000000000006e-05 2024-05-07T14:01:27.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834812+0000", 2024-05-07T14:01:27.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0372999999999999e-05 2024-05-07T14:01:27.197 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.197 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.197 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.197 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:27.197 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.339705553999998, 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027863941999999999, 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 115 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2699999999999999e-07 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811469+0000", 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133332 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811502+0000", 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3027000000000001e-05 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811511+0000", 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.713e-06 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832759+0000", 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021248185999999999 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832917+0000", 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157825 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.833269+0000", 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035184099999999998 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838250+0000", 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004980712 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838941+0000", 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069081399999999999 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839091+0000", 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149903 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839199+0000", 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010796199999999999 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.339511690999998, 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028128562999999999, 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 116 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811529+0000", 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811546+0000", 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7113e-05 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811570+0000", 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.406e-05 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811578+0000", 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8660000000000006e-06 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834997+0000", 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023418799000000001 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835317+0000", 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031991799999999998 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835662+0000", 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034544399999999998 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839220+0000", 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035576959999999999 2024-05-07T14:01:27.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839374+0000", 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015427600000000001 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839540+0000", 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016534500000000001 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839657+0000", 2024-05-07T14:01:27.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117243 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.339448679, 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02858051, 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.209 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 117 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811592+0000", 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811601+0000", 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1269999999999992e-06 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811611+0000", 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6900000000000004e-06 2024-05-07T14:01:27.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811618+0000", 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0770000000000002e-06 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836766+0000", 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025147966000000001 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836982+0000", 2024-05-07T14:01:27.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021640400000000001 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.837283+0000", 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030005800000000002 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839885+0000", 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002602937 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839925+0000", 2024-05-07T14:01:27.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9446000000000001e-05 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840061+0000", 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136043 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840172+0000", 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111019 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.851880680999997, 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014903938, 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 137 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299160+0000", 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4400000000000001e-07 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299232+0000", 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2348000000000006e-05 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299251+0000", 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9086e-05 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299258+0000", 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0659999999999998e-06 2024-05-07T14:01:27.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306394+0000", 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071357629999999998 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306491+0000", 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6526000000000004e-05 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306652+0000", 2024-05-07T14:01:27.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000161674 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312756+0000", 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061035860000000003 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313919+0000", 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011630919999999999 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314000+0000", 2024-05-07T14:01:27.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1037000000000004e-05 2024-05-07T14:01:27.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314063+0000", 2024-05-07T14:01:27.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3316000000000002e-05 2024-05-07T14:01:27.220 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.220 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.220 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.220 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:27.220 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.851768722999999, 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01524198, 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 138 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299272+0000", 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8599999999999998e-07 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299282+0000", 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0051000000000001e-05 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299297+0000", 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5125e-05 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299302+0000", 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2119999999999997e-06 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309582+0000", 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010280163 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309722+0000", 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140715 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309941+0000", 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000218249 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313900+0000", 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039598080000000004 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314411+0000", 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051060400000000001 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314466+0000", 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4861000000000002e-05 2024-05-07T14:01:27.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314513+0000", 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7506000000000002e-05 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.851730422000003, 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01724038, 2024-05-07T14:01:27.226 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 139 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3099999999999998e-07 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299313+0000", 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9390000000000002e-06 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299318+0000", 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5909999999999998e-06 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299321+0000", 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3890000000000001e-06 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310603+0000", 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011281753 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310704+0000", 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010111900000000001 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310888+0000", 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183666 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314523+0000", 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036354999999999998 2024-05-07T14:01:27.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316436+0000", 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001913238 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316501+0000", 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4261e-05 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316550+0000", 2024-05-07T14:01:27.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9493000000000002e-05 2024-05-07T14:01:27.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.232 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.232 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:27.232 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:01:27.232 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.851710091999998, 2024-05-07T14:01:27.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019781539000000001, 2024-05-07T14:01:27.232 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.232 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.232 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.232 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 140 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-07 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299398+0000", 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7822000000000002e-05 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299404+0000", 2024-05-07T14:01:27.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2369999999999997e-06 2024-05-07T14:01:27.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299409+0000", 2024-05-07T14:01:27.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2069999999999997e-06 2024-05-07T14:01:27.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311355+0000", 2024-05-07T14:01:27.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011946082 2024-05-07T14:01:27.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311493+0000", 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013830900000000001 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311709+0000", 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021606899999999999 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314528+0000", 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028193839999999999 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319001+0000", 2024-05-07T14:01:27.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004472218 2024-05-07T14:01:27.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319063+0000", 2024-05-07T14:01:27.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1940000000000007e-05 2024-05-07T14:01:27.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319112+0000", 2024-05-07T14:01:27.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8964000000000001e-05 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.851623727000003, 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019944718, 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.238 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 141 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299417+0000", 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7099999999999997e-07 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299420+0000", 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8629999999999999e-06 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299424+0000", 2024-05-07T14:01:27.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4830000000000001e-06 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299429+0000", 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6609999999999999e-06 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312813+0000", 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013384330999999999 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312948+0000", 2024-05-07T14:01:27.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000135239 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313163+0000", 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000214718 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314534+0000", 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013704430000000001 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319185+0000", 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046516839999999997 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319281+0000", 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5645999999999999e-05 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319361+0000", 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0278999999999995e-05 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.243 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.139371228999998, 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013780794000000001, 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 158 2024-05-07T14:01:27.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011670+0000", 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:01:27.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011817+0000", 2024-05-07T14:01:27.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014761200000000001 2024-05-07T14:01:27.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011830+0000", 2024-05-07T14:01:27.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2653999999999999e-05 2024-05-07T14:01:27.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011844+0000", 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4039999999999999e-05 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020200+0000", 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083561409999999992 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020433+0000", 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000233088 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020662+0000", 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000229015 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023097+0000", 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024346480000000002 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025218+0000", 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021216669999999998 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025350+0000", 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013124600000000001 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025450+0000", 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010002599999999999 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:01:27.249 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.139180713000002, 2024-05-07T14:01:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013831896, 2024-05-07T14:01:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:01:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:01:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 159 2024-05-07T14:01:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:27.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011860+0000", 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8999999999999995e-07 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011874+0000", 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3806e-05 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011884+0000", 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5629999999999998e-06 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011894+0000", 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0353999999999999e-05 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:27.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023169+0000", 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011274872 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023305+0000", 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653299999999999 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023505+0000", 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000199254 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.024966+0000", 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014616830000000001 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025472+0000", 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00050618899999999999 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025593+0000", 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120019 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:27.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:27.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:27.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025691+0000", 2024-05-07T14:01:27.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8832999999999994e-05 2024-05-07T14:01:27.255 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.255 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.255 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.255 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:27.255 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:27.255 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:27.256 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:01:27.257 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:27.273+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:27.357 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:27.369+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:27.385 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:27.385 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:27.385 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:27.385 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:27.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:01:27.491 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:27.505+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:27.559 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:27.572+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:27.563 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:27.563 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:27.563 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:27.564 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:27.564 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:27.577 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:01:27.660 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:27.672+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:27.739 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:27.739 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:27.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:27.739 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:27.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.739 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:129 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'87, mlcod=17'85)", 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.453359225, 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034674469999999998, 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299075+0000", 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.736e-06 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299087+0000", 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2067e-05 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299122+0000", 2024-05-07T14:01:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4643e-05 2024-05-07T14:01:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299141+0000", 2024-05-07T14:01:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9224000000000001e-05 2024-05-07T14:01:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299323+0000", 2024-05-07T14:01:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018190400000000001 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299385+0000", 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2126999999999997e-05 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302462+0000", 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030768330000000002 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302541+0000", 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8912999999999995e-05 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:131 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'89, mlcod=17'85)", 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.452026552, 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038759010000000002, 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.744 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300407+0000", 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0299999999999998e-07 2024-05-07T14:01:27.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300577+0000", 2024-05-07T14:01:27.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000170259 2024-05-07T14:01:27.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300592+0000", 2024-05-07T14:01:27.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4707e-05 2024-05-07T14:01:27.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300601+0000", 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999995e-06 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301133+0000", 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053150199999999999 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301186+0000", 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.342e-05 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304217+0000", 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030307429999999998 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304282+0000", 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5316999999999998e-05 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:132 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'90, mlcod=17'85)", 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:01:27.748 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.450974457000001, 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041397580000000003, 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:01:27.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301459+0000", 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.47e-07 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301470+0000", 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0933e-05 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301483+0000", 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2427e-05 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301491+0000", 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6130000000000004e-06 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302683+0000", 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011919980000000001 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302741+0000", 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7963000000000001e-05 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305494+0000", 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027531420000000001 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305598+0000", 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103835 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.752 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:134 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'92, mlcod=17'85)", 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.448688560000001, 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037081470000000002, 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:01:27.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303747+0000", 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303805+0000", 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8554999999999998e-05 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303829+0000", 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3799999999999999e-05 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303871+0000", 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2079999999999997e-05 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304359+0000", 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048822999999999998 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304415+0000", 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5405999999999998e-05 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307388+0000", 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029728070000000001 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307452+0000", 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4789000000000006e-05 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:137 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'95, mlcod=17'88)", 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.445064659000003, 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004097552, 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.757 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.758 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:01:27.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:01:27.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307370+0000", 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3939999999999999e-06 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307454+0000", 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4639000000000001e-05 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307474+0000", 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0242999999999999e-05 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307485+0000", 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0710000000000001e-05 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307538+0000", 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2623000000000001e-05 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307566+0000", 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.781e-05 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311405+0000", 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038392299999999999 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311466+0000", 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0903000000000003e-05 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:138 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'96, mlcod=17'93)", 2024-05-07T14:01:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:01:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.441768521, 2024-05-07T14:01:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034036700000000001, 2024-05-07T14:01:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:01:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310666+0000", 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310680+0000", 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4047e-05 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310715+0000", 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4826000000000002e-05 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310739+0000", 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3796000000000001e-05 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310862+0000", 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123132 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310896+0000", 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.43e-05 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313965+0000", 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030685959999999998 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314068+0000", 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102963 2024-05-07T14:01:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.440862838000001, 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:01:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:01:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.439956442000003, 2024-05-07T14:01:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:01:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:01:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.438543823000003, 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:01:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:01:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:01:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:01:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:01:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:01:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:01:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:143 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'101, mlcod=17'98)", 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.430651054000002, 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036609120000000001, 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.780 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:01:27.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:01:27.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321783+0000", 2024-05-07T14:01:27.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3599999999999999e-06 2024-05-07T14:01:27.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321905+0000", 2024-05-07T14:01:27.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121923 2024-05-07T14:01:27.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321929+0000", 2024-05-07T14:01:27.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4295999999999999e-05 2024-05-07T14:01:27.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321945+0000", 2024-05-07T14:01:27.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5773999999999998e-05 2024-05-07T14:01:27.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322070+0000", 2024-05-07T14:01:27.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012457899999999999 2024-05-07T14:01:27.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322101+0000", 2024-05-07T14:01:27.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1213000000000001e-05 2024-05-07T14:01:27.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325342+0000", 2024-05-07T14:01:27.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032410579999999998 2024-05-07T14:01:27.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325443+0000", 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100709 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:144 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.429582312000001, 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003406484, 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.784 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322852+0000", 2024-05-07T14:01:27.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8369999999999999e-06 2024-05-07T14:01:27.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323022+0000", 2024-05-07T14:01:27.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016984199999999999 2024-05-07T14:01:27.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323048+0000", 2024-05-07T14:01:27.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5752999999999999e-05 2024-05-07T14:01:27.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323071+0000", 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.266e-05 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323188+0000", 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011728200000000001 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323224+0000", 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6380000000000001e-05 2024-05-07T14:01:27.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326163+0000", 2024-05-07T14:01:27.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029386170000000001 2024-05-07T14:01:27.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326257+0000", 2024-05-07T14:01:27.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4112999999999998e-05 2024-05-07T14:01:27.788 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.733251399, 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034691510000000002, 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:27.789 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:27.790 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 206 2024-05-07T14:01:27.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.790 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:01:27.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:01:27.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019184+0000", 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6170000000000001e-06 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019198+0000", 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4113e-05 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019229+0000", 2024-05-07T14:01:27.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0423e-05 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019244+0000", 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5047e-05 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019478+0000", 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000234398 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019723+0000", 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024469500000000001 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.020149+0000", 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042592999999999998 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.021776+0000", 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001627688 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022453+0000", 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00067671500000000004 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022551+0000", 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8312000000000003e-05 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022651+0000", 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9213e-05 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.794 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.705962219, 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038721300000000001, 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:27.795 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 210 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046474+0000", 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.517e-06 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046487+0000", 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3113e-05 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046521+0000", 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3556000000000002e-05 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046537+0000", 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.643e-05 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046651+0000", 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011368500000000001 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046873+0000", 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221802 2024-05-07T14:01:27.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.047335+0000", 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046227300000000002 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.048993+0000", 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016576679999999999 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050186+0000", 2024-05-07T14:01:27.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001193284 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050273+0000", 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7189999999999997e-05 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050343+0000", 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9611999999999997e-05 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.676455473000001, 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034712530000000001, 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 218 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.801 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075980+0000", 2024-05-07T14:01:27.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.774e-06 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075992+0000", 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2283000000000001e-05 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076024+0000", 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1242999999999999e-05 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076038+0000", 2024-05-07T14:01:27.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4663e-05 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076199+0000", 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160865 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076539+0000", 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033995800000000001 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:27.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.077234+0000", 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000694581 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.078996+0000", 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001762633 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079276+0000", 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027998399999999999 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079380+0000", 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103266 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079449+0000", 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9003000000000003e-05 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:27.806 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.612873341, 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:01:27.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:01:27.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:01:27.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:01:27.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:01:27.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:01:27.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:01:27.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:01:27.812 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.579762682999998, 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:01:27.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:01:27.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:01:27.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:01:27.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:01:27.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:01:27.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.572852764, 2024-05-07T14:01:27.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041680119999999996, 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 382 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179581+0000", 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179585+0000", 2024-05-07T14:01:27.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4800000000000003e-06 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179598+0000", 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2322e-05 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179604+0000", 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.823e-06 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179657+0000", 2024-05-07T14:01:27.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3937000000000002e-05 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179714+0000", 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6165000000000002e-05 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179830+0000", 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011632 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:27.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.180515+0000", 2024-05-07T14:01:27.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00068531400000000002 2024-05-07T14:01:27.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183667+0000", 2024-05-07T14:01:27.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031522009999999999 2024-05-07T14:01:27.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183704+0000", 2024-05-07T14:01:27.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6925999999999998e-05 2024-05-07T14:01:27.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183748+0000", 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3618999999999997e-05 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:499 6.13 e33/27 6:cedbb205:::obj_delete_at_hint.0000000017:head v 33'4, mlcod=33'1)", 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.49948011, 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043323679999999996, 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.824 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252954+0000", 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.71e-07 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252960+0000", 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.46e-06 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252974+0000", 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4249e-05 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252982+0000", 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253055+0000", 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3162000000000002e-05 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253075+0000", 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9451999999999999e-05 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257253+0000", 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041781179999999998 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257285+0000", 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2075e-05 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.828 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:550 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.463825927999999, 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035552140000000001, 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 550 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288608+0000", 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0529999999999999e-06 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288613+0000", 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7060000000000003e-06 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288624+0000", 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1547e-05 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288630+0000", 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288734+0000", 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103872 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288884+0000", 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014987400000000001 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289167+0000", 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028341999999999999 2024-05-07T14:01:27.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289813+0000", 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064550199999999995 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292082+0000", 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022696000000000001 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292120+0000", 2024-05-07T14:01:27.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7367999999999999e-05 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292162+0000", 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2568000000000003e-05 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:667 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.367883893999998, 2024-05-07T14:01:27.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050309150000000004, 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 667 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384550+0000", 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7000000000000003e-07 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384555+0000", 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.135e-06 2024-05-07T14:01:27.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:27.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384565+0000", 2024-05-07T14:01:27.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0541e-05 2024-05-07T14:01:27.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:27.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384571+0000", 2024-05-07T14:01:27.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.857e-06 2024-05-07T14:01:27.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:27.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384670+0000", 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8461999999999993e-05 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384822+0000", 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152039 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.385123+0000", 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030070699999999999 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.386099+0000", 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097677300000000001 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389495+0000", 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033959139999999999 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389530+0000", 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.472e-05 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:27.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:27.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:27.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389580+0000", 2024-05-07T14:01:27.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9897e-05 2024-05-07T14:01:27.840 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.840 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.840 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.840 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:27.840 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:27.840 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:27.842 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:01:27.842 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:27.857+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:27.943 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:27.957+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:27.976 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:01:28.018 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:28.018 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:28.018 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:28.018 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:28.031 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:01:28.075 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:28.089+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:28.145 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:28.156+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:28.187 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:28.188 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:28.202 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:01:28.246 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:28.260+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:28.329 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:28.329 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:28.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:28.329 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:28.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.329 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:01:28.329 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:28.329 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.356636594000001, 2024-05-07T14:01:28.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:01:28.330 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.330 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.330 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:01:28.330 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.330 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:01:28.330 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:01:28.330 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:01:28.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.330 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:28.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.309470723, 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.334 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.338 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.209143003000001, 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:01:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:01:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:01:28.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:01:28.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:01:28.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:01:28.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:01:28.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:28.344 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.306598946000001, 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:28.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:01:28.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:01:28.350 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.350 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.350 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.350 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.350 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:28.350 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.287288977999999, 2024-05-07T14:01:28.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:01:28.350 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:01:28.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:01:28.355 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.261922068000001, 2024-05-07T14:01:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:01:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.356 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:01:28.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.242132684000001, 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:01:28.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.367 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.208894322999999, 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:01:28.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:01:28.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.173533301999999, 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:01:28.373 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:01:28.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:01:28.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:01:28.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.148789736000001, 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.379 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:01:28.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.037913332999999, 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:28.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:28.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:01:28.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:01:28.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:01:28.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:01:28.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:01:28.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:01:28.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:01:28.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:01:28.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:01:28.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:01:28.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:01:28.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:01:28.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:01:28.390 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.390 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.390 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.981749384, 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:01:28.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:01:28.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:01:28.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:28.396 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.965864198999999, 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:28.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.716497947000001, 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.402 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:01:28.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:01:28.407 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.655125124000001, 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.408 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:01:28.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:01:28.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:01:28.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:01:28.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:01:28.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.413 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.459336782000001, 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:01:28.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:01:28.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:01:28.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:01:28.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:01:28.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:01:28.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.455033331999999, 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003023937, 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 918 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886558+0000", 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1229999999999998e-06 2024-05-07T14:01:28.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886569+0000", 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1497e-05 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886600+0000", 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0809999999999998e-05 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886618+0000", 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7799e-05 2024-05-07T14:01:28.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886736+0000", 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118276 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886951+0000", 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021467200000000001 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.887437+0000", 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048624900000000001 2024-05-07T14:01:28.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.888687+0000", 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012498310000000001 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889318+0000", 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063122199999999997 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889463+0000", 2024-05-07T14:01:28.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144769 2024-05-07T14:01:28.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889580+0000", 2024-05-07T14:01:28.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011668899999999999 2024-05-07T14:01:28.425 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.425 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.425 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.425 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.425 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:28.425 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.424032608000001, 2024-05-07T14:01:28.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:01:28.426 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.426 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.426 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.426 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.426 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.426 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.426 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:01:28.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.426 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.419147716000001, 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.431 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:28.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:01:28.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:01:28.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:01:28.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:01:28.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:01:28.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:01:28.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.436 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.387226344999998, 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.437 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:01:28.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:01:28.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.443 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:28.444 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:01:28.445 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:28.456+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:28.545 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:28.556+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:28.571 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:28.572 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:28.572 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:28.572 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:28.587 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:01:28.647 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:28.660+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:28.710 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:28.710 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:28.710 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:28.710 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:28.710 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:28.724 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:01:28.747 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:28.760+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:28.848 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:28.849 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:28.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:28.849 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:28.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.849 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:40 5.8 5:168cc6a2:::zonegroup_info.7881bf19-2c91-49be-82bb-722579314d1c:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:01:28.849 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:28.849 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.818394901000001, 2024-05-07T14:01:28.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002658582, 2024-05-07T14:01:28.849 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.849 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.849 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 40 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042176+0000", 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7719999999999999e-06 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042186+0000", 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0020000000000001e-05 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042209+0000", 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3224e-05 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042220+0000", 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1153e-05 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042358+0000", 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137389 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042594+0000", 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023630100000000001 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042900+0000", 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030576799999999999 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044463+0000", 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015627130000000001 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044675+0000", 2024-05-07T14:01:28.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021186999999999999 2024-05-07T14:01:28.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044768+0000", 2024-05-07T14:01:28.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3046000000000003e-05 2024-05-07T14:01:28.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044833+0000", 2024-05-07T14:01:28.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5326000000000004e-05 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.823840015999998, 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025872120000000002, 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.855 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 52 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036732+0000", 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4980000000000001e-06 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036744+0000", 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2269999999999999e-05 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036772+0000", 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8002000000000001e-05 2024-05-07T14:01:28.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036817+0000", 2024-05-07T14:01:28.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4608999999999999e-05 2024-05-07T14:01:28.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036946+0000", 2024-05-07T14:01:28.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012988400000000001 2024-05-07T14:01:28.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037184+0000", 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000237178 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037405+0000", 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221418 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.038548+0000", 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011433540000000001 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039179+0000", 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063016999999999999 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039231+0000", 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2434e-05 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039316+0000", 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5395000000000005e-05 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.860 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.715257554000001, 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.861 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:01:28.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.862 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:28.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:28.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:01:28.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:01:28.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:01:28.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:01:28.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:01:28.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:01:28.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:01:28.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:01:28.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:01:28.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:01:28.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:01:28.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:01:28.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:28.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:01:28.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:01:28.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:01:28.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:01:28.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:01:28.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:01:28.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:01:28.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:01:28.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:01:28.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:01:28.870 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.870 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.871 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.871 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.871 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:28.871 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.702838613000001, 2024-05-07T14:01:28.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:01:28.871 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.871 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.871 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.872 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.872 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.872 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.872 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:01:28.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.872 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:28.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:28.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:01:28.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:01:28.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:01:28.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:01:28.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:01:28.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:01:28.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:01:28.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:01:28.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:01:28.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:01:28.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:01:28.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:01:28.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:28.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:01:28.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:01:28.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:01:28.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:01:28.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:01:28.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:01:28.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:01:28.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:01:28.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:01:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:01:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.698958891, 2024-05-07T14:01:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:01:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.880 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.880 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.880 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.880 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.880 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.880 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:01:28.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.880 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:28.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:28.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:01:28.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:01:28.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:01:28.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:01:28.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:01:28.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:01:28.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:01:28.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:01:28.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:01:28.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:01:28.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:01:28.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:01:28.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:28.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:01:28.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:01:28.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:01:28.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:01:28.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:01:28.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:01:28.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:01:28.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:01:28.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:01:28.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:01:28.886 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.886 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.886 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.886 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.886 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.568303388, 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:28.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:01:28.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:01:28.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:01:28.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:01:28.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:28.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:01:28.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:01:28.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:01:28.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:01:28.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:01:28.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:01:28.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:01:28.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:01:28.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:01:28.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:01:28.892 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.892 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.561136066, 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.893 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:01:28.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.894 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:28.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:28.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:01:28.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:01:28.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:01:28.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:01:28.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:01:28.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:01:28.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:01:28.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:01:28.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:01:28.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:01:28.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:01:28.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:01:28.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:28.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:01:28.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:01:28.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:01:28.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:01:28.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:01:28.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:01:28.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:01:28.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:01:28.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:01:28.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:01:28.899 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.899 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.899 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.900 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:28.900 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:28.900 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.270603378000001, 2024-05-07T14:01:28.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:01:28.900 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.900 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.900 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.900 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:01:28.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:01:28.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:01:28.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:01:28.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:01:28.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:01:28.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:01:28.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:01:28.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:01:28.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.205521984000001, 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025880500000000002, 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 819 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.905 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655049+0000", 2024-05-07T14:01:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6640000000000001e-06 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655057+0000", 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5639999999999997e-06 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655082+0000", 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4119999999999999e-05 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655093+0000", 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1598e-05 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655273+0000", 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017975599999999999 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655432+0000", 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000158682 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655720+0000", 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028791400000000001 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.656823+0000", 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001103435 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657483+0000", 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000659828 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657571+0000", 2024-05-07T14:01:28.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7756000000000005e-05 2024-05-07T14:01:28.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657635+0000", 2024-05-07T14:01:28.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4733000000000005e-05 2024-05-07T14:01:28.910 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.910 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.153245751, 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028535079999999998, 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.911 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 841 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707326+0000", 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707338+0000", 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2036e-05 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707367+0000", 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8816999999999999e-05 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707382+0000", 2024-05-07T14:01:28.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4912999999999999e-05 2024-05-07T14:01:28.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707523+0000", 2024-05-07T14:01:28.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014165599999999999 2024-05-07T14:01:28.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707748+0000", 2024-05-07T14:01:28.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000224315 2024-05-07T14:01:28.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.708055+0000", 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030739800000000001 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.709147+0000", 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001091788 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710030+0000", 2024-05-07T14:01:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088367000000000003 2024-05-07T14:01:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710114+0000", 2024-05-07T14:01:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3936000000000004e-05 2024-05-07T14:01:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710177+0000", 2024-05-07T14:01:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2675999999999994e-05 2024-05-07T14:01:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:28.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.993 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:28.993 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:28.993 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.149579211999999, 2024-05-07T14:01:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026153460000000002, 2024-05-07T14:01:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 843 2024-05-07T14:01:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710992+0000", 2024-05-07T14:01:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.666e-06 2024-05-07T14:01:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711000+0000", 2024-05-07T14:01:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.977e-06 2024-05-07T14:01:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711020+0000", 2024-05-07T14:01:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.033e-05 2024-05-07T14:01:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711030+0000", 2024-05-07T14:01:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9790000000000005e-06 2024-05-07T14:01:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711133+0000", 2024-05-07T14:01:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102563 2024-05-07T14:01:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711256+0000", 2024-05-07T14:01:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012337599999999999 2024-05-07T14:01:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711555+0000", 2024-05-07T14:01:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029948699999999997 2024-05-07T14:01:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.712654+0000", 2024-05-07T14:01:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001098819 2024-05-07T14:01:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713451+0000", 2024-05-07T14:01:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000796424 2024-05-07T14:01:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713541+0000", 2024-05-07T14:01:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9981999999999993e-05 2024-05-07T14:01:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713605+0000", 2024-05-07T14:01:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4743e-05 2024-05-07T14:01:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.140123096, 2024-05-07T14:01:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027995160000000002, 2024-05-07T14:01:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 847 2024-05-07T14:01:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720448+0000", 2024-05-07T14:01:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:01:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720460+0000", 2024-05-07T14:01:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1157e-05 2024-05-07T14:01:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720490+0000", 2024-05-07T14:01:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0960000000000002e-05 2024-05-07T14:01:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720507+0000", 2024-05-07T14:01:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6477000000000002e-05 2024-05-07T14:01:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720681+0000", 2024-05-07T14:01:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017396800000000001 2024-05-07T14:01:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720897+0000", 2024-05-07T14:01:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215775 2024-05-07T14:01:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.721203+0000", 2024-05-07T14:01:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030621499999999998 2024-05-07T14:01:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.722485+0000", 2024-05-07T14:01:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012818599999999999 2024-05-07T14:01:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723091+0000", 2024-05-07T14:01:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060651499999999996 2024-05-07T14:01:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723182+0000", 2024-05-07T14:01:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0692999999999994e-05 2024-05-07T14:01:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723246+0000", 2024-05-07T14:01:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3643e-05 2024-05-07T14:01:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.136355747, 2024-05-07T14:01:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:01:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:01:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:01:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:01:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:01:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:01:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:01:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:01:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:01:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:01:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:01:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:01:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:01:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:01:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:01:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:01:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:01:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:01:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:01:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:01:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:01:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:01:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:01:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:01:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.090642351, 2024-05-07T14:01:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:01:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:01:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:01:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:01:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:01:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:01:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:01:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:01:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:01:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:01:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:01:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:01:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:01:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:01:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:01:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:01:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:01:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:01:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:01:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:01:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:01:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:01:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:01:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:01:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.084365612999999, 2024-05-07T14:01:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:01:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:01:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:01:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:01:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:01:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:01:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:01:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:01:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:01:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:01:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:01:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:01:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:01:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:01:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:01:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:01:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:01:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:01:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:01:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:01:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:01:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:01:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:01:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:01:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.997852493, 2024-05-07T14:01:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028016680000000002, 2024-05-07T14:01:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 907 2024-05-07T14:01:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862719+0000", 2024-05-07T14:01:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:01:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862733+0000", 2024-05-07T14:01:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3067e-05 2024-05-07T14:01:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862763+0000", 2024-05-07T14:01:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0926000000000002e-05 2024-05-07T14:01:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862779+0000", 2024-05-07T14:01:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5787e-05 2024-05-07T14:01:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862924+0000", 2024-05-07T14:01:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014509899999999999 2024-05-07T14:01:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863160+0000", 2024-05-07T14:01:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000235701 2024-05-07T14:01:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863523+0000", 2024-05-07T14:01:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000362567 2024-05-07T14:01:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.864872+0000", 2024-05-07T14:01:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00134954 2024-05-07T14:01:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865350+0000", 2024-05-07T14:01:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000478009 2024-05-07T14:01:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865437+0000", 2024-05-07T14:01:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6712999999999995e-05 2024-05-07T14:01:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865518+0000", 2024-05-07T14:01:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1493000000000001e-05 2024-05-07T14:01:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.994123206000001, 2024-05-07T14:01:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027054290000000001, 2024-05-07T14:01:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 909 2024-05-07T14:01:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866448+0000", 2024-05-07T14:01:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:01:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866459+0000", 2024-05-07T14:01:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1207e-05 2024-05-07T14:01:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866491+0000", 2024-05-07T14:01:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362999999999998e-05 2024-05-07T14:01:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866506+0000", 2024-05-07T14:01:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4790000000000001e-05 2024-05-07T14:01:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866632+0000", 2024-05-07T14:01:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000126422 2024-05-07T14:01:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866761+0000", 2024-05-07T14:01:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128832 2024-05-07T14:01:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.867037+0000", 2024-05-07T14:01:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027612200000000001 2024-05-07T14:01:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.868118+0000", 2024-05-07T14:01:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001080941 2024-05-07T14:01:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869004+0000", 2024-05-07T14:01:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088632000000000001 2024-05-07T14:01:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:29.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869081+0000", 2024-05-07T14:01:29.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7195999999999997e-05 2024-05-07T14:01:29.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:29.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869151+0000", 2024-05-07T14:01:29.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0066000000000003e-05 2024-05-07T14:01:29.040 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.040 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:29.040 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.899274407, 2024-05-07T14:01:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:01:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:01:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:01:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:01:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:01:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:01:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:01:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:01:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:01:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:01:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:01:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:01:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:01:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:01:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:01:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:01:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:01:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:01:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:01:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:01:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:01:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:01:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:01:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:01:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.886105053000001, 2024-05-07T14:01:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027821920000000002, 2024-05-07T14:01:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 955 2024-05-07T14:01:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974466+0000", 2024-05-07T14:01:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0999999999999998e-06 2024-05-07T14:01:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974480+0000", 2024-05-07T14:01:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3876999999999999e-05 2024-05-07T14:01:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974510+0000", 2024-05-07T14:01:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0273e-05 2024-05-07T14:01:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974525+0000", 2024-05-07T14:01:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.485e-05 2024-05-07T14:01:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974618+0000", 2024-05-07T14:01:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2359000000000001e-05 2024-05-07T14:01:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974822+0000", 2024-05-07T14:01:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000204148 2024-05-07T14:01:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.975126+0000", 2024-05-07T14:01:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030382800000000002 2024-05-07T14:01:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976565+0000", 2024-05-07T14:01:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014395160000000001 2024-05-07T14:01:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976963+0000", 2024-05-07T14:01:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00039772700000000001 2024-05-07T14:01:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977128+0000", 2024-05-07T14:01:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165508 2024-05-07T14:01:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977246+0000", 2024-05-07T14:01:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011800599999999999 2024-05-07T14:01:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.882189490000002, 2024-05-07T14:01:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027683989999999999, 2024-05-07T14:01:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 957 2024-05-07T14:01:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978382+0000", 2024-05-07T14:01:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.95e-06 2024-05-07T14:01:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978393+0000", 2024-05-07T14:01:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.084e-05 2024-05-07T14:01:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978424+0000", 2024-05-07T14:01:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1022999999999998e-05 2024-05-07T14:01:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978441+0000", 2024-05-07T14:01:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7782999999999999e-05 2024-05-07T14:01:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978565+0000", 2024-05-07T14:01:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012348900000000001 2024-05-07T14:01:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978794+0000", 2024-05-07T14:01:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000229335 2024-05-07T14:01:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.979262+0000", 2024-05-07T14:01:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046826700000000002 2024-05-07T14:01:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.980470+0000", 2024-05-07T14:01:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012071899999999999 2024-05-07T14:01:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981002+0000", 2024-05-07T14:01:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053222299999999996 2024-05-07T14:01:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981086+0000", 2024-05-07T14:01:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4073000000000006e-05 2024-05-07T14:01:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981148+0000", 2024-05-07T14:01:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2225999999999997e-05 2024-05-07T14:01:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:29.061 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:29.062 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:28.860+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:29.063 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:01:29.064 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:29.076+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:29.074 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:01:29.164 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:29.176+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:29.231 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:29.231 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:29.231 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:29.231 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:29.247 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:01:29.259 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:29.260 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:29.264 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:29.276+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:29.276 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:29.277 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:29.295 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:29.295 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:29.312 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:29.312 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:29.333 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:29.333 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:29.354 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:29.354 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:29.364 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:29.364 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:29.364 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:29.376+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:29.374 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:29.374 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:29.378 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:01:29.396 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:29.397 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:29.465 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:29.476+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:29.518 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:29.518 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:29.532 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:01:29.575 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:29.588+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:29.663 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:29.664 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:29.667 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:29.680+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:29.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:01:29.768 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:29.780+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:29.840 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:29.840 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:29.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:01:29.869 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:29.880+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:29.969 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:29.980+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:30.003 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:01:30.025 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:30.025 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:30.039 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:01:30.070 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:30.080+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:30.160 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:30.160 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:30.171 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:30.184+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:30.173 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:01:30.272 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:30.284+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:30.330 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:30.331 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:30.344 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:01:30.386 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:30.400+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:30.474 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:30.488+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:30.508 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:30.509 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:30.523 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:01:30.575 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:30.588+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:30.676 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:30.688+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:30.688 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:30.688 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:30.702 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:01:30.777 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:30.788+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:30.824 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:30.824 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:30.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:01:30.886 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:30.900+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:30.959 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:30.959 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:30.973 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:01:30.993 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:01:31.014 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:31.028+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:31.079 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:31.092+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:31.137 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:31.137 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:31.151 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:01:31.180 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:31.192+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:31.268 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:31.268 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:31.281 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:31.292+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:31.282 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:01:31.382 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:31.392+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:31.416 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:01:31.447 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:31.447 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:31.461 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:01:31.511 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:31.524+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:31.571 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:31.572 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:31.583 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:31.596+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:31.588 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:31.589 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:31.591 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:31.591 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:31.591 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:31.591 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:31.606 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:01:31.606 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:31.606 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:31.622 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:31.622 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:31.642 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:31.642 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:31.662 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:31.662 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:31.683 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:31.683 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:31.684 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:31.696+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:31.703 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:31.704 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:31.737 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:31.738 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:31.738 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:31.738 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:31.738 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:31.752 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:01:31.785 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:31.796+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:31.887 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:31.900+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:31.914 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:31.914 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:31.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:31.914 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:129 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'87, mlcod=17'85)", 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.628281000999998, 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034674469999999998, 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:01:31.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299075+0000", 2024-05-07T14:01:31.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.736e-06 2024-05-07T14:01:31.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299087+0000", 2024-05-07T14:01:31.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2067e-05 2024-05-07T14:01:31.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299122+0000", 2024-05-07T14:01:31.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4643e-05 2024-05-07T14:01:31.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299141+0000", 2024-05-07T14:01:31.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9224000000000001e-05 2024-05-07T14:01:31.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299323+0000", 2024-05-07T14:01:31.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018190400000000001 2024-05-07T14:01:31.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299385+0000", 2024-05-07T14:01:31.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2126999999999997e-05 2024-05-07T14:01:31.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302462+0000", 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030768330000000002 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302541+0000", 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8912999999999995e-05 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:131 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'89, mlcod=17'85)", 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:01:31.919 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.626948327999997, 2024-05-07T14:01:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038759010000000002, 2024-05-07T14:01:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:01:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300407+0000", 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0299999999999998e-07 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300577+0000", 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000170259 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300592+0000", 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4707e-05 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300601+0000", 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999995e-06 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301133+0000", 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053150199999999999 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301186+0000", 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.342e-05 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304217+0000", 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030307429999999998 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304282+0000", 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5316999999999998e-05 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:132 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'90, mlcod=17'85)", 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.625896232999999, 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041397580000000003, 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301459+0000", 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.47e-07 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301470+0000", 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0933e-05 2024-05-07T14:01:31.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301483+0000", 2024-05-07T14:01:31.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2427e-05 2024-05-07T14:01:31.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301491+0000", 2024-05-07T14:01:31.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6130000000000004e-06 2024-05-07T14:01:31.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302683+0000", 2024-05-07T14:01:31.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011919980000000001 2024-05-07T14:01:31.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302741+0000", 2024-05-07T14:01:31.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7963000000000001e-05 2024-05-07T14:01:31.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305494+0000", 2024-05-07T14:01:31.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027531420000000001 2024-05-07T14:01:31.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305598+0000", 2024-05-07T14:01:31.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103835 2024-05-07T14:01:31.928 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.928 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.928 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.928 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:134 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'92, mlcod=17'85)", 2024-05-07T14:01:31.928 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:01:31.928 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.623610335999999, 2024-05-07T14:01:31.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037081470000000002, 2024-05-07T14:01:31.928 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.929 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.929 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.929 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:01:31.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:01:31.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303747+0000", 2024-05-07T14:01:31.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:01:31.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303805+0000", 2024-05-07T14:01:31.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8554999999999998e-05 2024-05-07T14:01:31.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303829+0000", 2024-05-07T14:01:31.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3799999999999999e-05 2024-05-07T14:01:31.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303871+0000", 2024-05-07T14:01:31.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2079999999999997e-05 2024-05-07T14:01:31.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304359+0000", 2024-05-07T14:01:31.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048822999999999998 2024-05-07T14:01:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304415+0000", 2024-05-07T14:01:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5405999999999998e-05 2024-05-07T14:01:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307388+0000", 2024-05-07T14:01:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029728070000000001 2024-05-07T14:01:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307452+0000", 2024-05-07T14:01:31.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4789000000000006e-05 2024-05-07T14:01:31.933 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.933 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.933 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.933 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:137 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'95, mlcod=17'88)", 2024-05-07T14:01:31.933 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:01:31.933 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.619986435000001, 2024-05-07T14:01:31.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004097552, 2024-05-07T14:01:31.933 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307370+0000", 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3939999999999999e-06 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307454+0000", 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4639000000000001e-05 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307474+0000", 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0242999999999999e-05 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307485+0000", 2024-05-07T14:01:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0710000000000001e-05 2024-05-07T14:01:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307538+0000", 2024-05-07T14:01:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2623000000000001e-05 2024-05-07T14:01:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307566+0000", 2024-05-07T14:01:31.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.781e-05 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311405+0000", 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038392299999999999 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311466+0000", 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0903000000000003e-05 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.938 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:138 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'96, mlcod=17'93)", 2024-05-07T14:01:31.938 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:01:31.938 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.616690296999998, 2024-05-07T14:01:31.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034036700000000001, 2024-05-07T14:01:31.938 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.938 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.938 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.938 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310666+0000", 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310680+0000", 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4047e-05 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310715+0000", 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4826000000000002e-05 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310739+0000", 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3796000000000001e-05 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310862+0000", 2024-05-07T14:01:31.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123132 2024-05-07T14:01:31.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310896+0000", 2024-05-07T14:01:31.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.43e-05 2024-05-07T14:01:31.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313965+0000", 2024-05-07T14:01:31.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030685959999999998 2024-05-07T14:01:31.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314068+0000", 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102963 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.615784613999999, 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.942 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.943 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.943 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:01:31.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:01:31.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:01:31.946 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.614878218000001, 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:01:31.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:01:31.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:01:31.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:01:31.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:01:31.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.951 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:01:31.951 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:01:31.951 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.613465599000001, 2024-05-07T14:01:31.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:01:31.951 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.951 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.951 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.951 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:01:31.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:01:31.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:01:31.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:01:31.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:01:31.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:01:31.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:01:31.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:01:31.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:143 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'101, mlcod=17'98)", 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.60557283, 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036609120000000001, 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.955 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:01:31.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:01:31.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321783+0000", 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3599999999999999e-06 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321905+0000", 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121923 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321929+0000", 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4295999999999999e-05 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321945+0000", 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5773999999999998e-05 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322070+0000", 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012457899999999999 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322101+0000", 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1213000000000001e-05 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325342+0000", 2024-05-07T14:01:31.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032410579999999998 2024-05-07T14:01:31.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325443+0000", 2024-05-07T14:01:31.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100709 2024-05-07T14:01:31.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.959 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:144 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.604504087999999, 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003406484, 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:01:31.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322852+0000", 2024-05-07T14:01:31.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8369999999999999e-06 2024-05-07T14:01:31.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323022+0000", 2024-05-07T14:01:31.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016984199999999999 2024-05-07T14:01:31.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323048+0000", 2024-05-07T14:01:31.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5752999999999999e-05 2024-05-07T14:01:31.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323071+0000", 2024-05-07T14:01:31.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.266e-05 2024-05-07T14:01:31.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323188+0000", 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011728200000000001 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323224+0000", 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6380000000000001e-05 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326163+0000", 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029386170000000001 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326257+0000", 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4112999999999998e-05 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.908173175000002, 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034691510000000002, 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.964 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 206 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:01:31.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019184+0000", 2024-05-07T14:01:31.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6170000000000001e-06 2024-05-07T14:01:31.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019198+0000", 2024-05-07T14:01:31.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4113e-05 2024-05-07T14:01:31.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019229+0000", 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0423e-05 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019244+0000", 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5047e-05 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019478+0000", 2024-05-07T14:01:31.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000234398 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019723+0000", 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024469500000000001 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.020149+0000", 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042592999999999998 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.021776+0000", 2024-05-07T14:01:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001627688 2024-05-07T14:01:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022453+0000", 2024-05-07T14:01:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00067671500000000004 2024-05-07T14:01:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022551+0000", 2024-05-07T14:01:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8312000000000003e-05 2024-05-07T14:01:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022651+0000", 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9213e-05 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.880883995000001, 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038721300000000001, 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 210 2024-05-07T14:01:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:01:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046474+0000", 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.517e-06 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046487+0000", 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3113e-05 2024-05-07T14:01:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046521+0000", 2024-05-07T14:01:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3556000000000002e-05 2024-05-07T14:01:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046537+0000", 2024-05-07T14:01:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.643e-05 2024-05-07T14:01:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046651+0000", 2024-05-07T14:01:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011368500000000001 2024-05-07T14:01:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046873+0000", 2024-05-07T14:01:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221802 2024-05-07T14:01:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.047335+0000", 2024-05-07T14:01:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046227300000000002 2024-05-07T14:01:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.048993+0000", 2024-05-07T14:01:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016576679999999999 2024-05-07T14:01:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050186+0000", 2024-05-07T14:01:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001193284 2024-05-07T14:01:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050273+0000", 2024-05-07T14:01:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7189999999999997e-05 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050343+0000", 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9611999999999997e-05 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.851377248999999, 2024-05-07T14:01:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034712530000000001, 2024-05-07T14:01:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 218 2024-05-07T14:01:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:01:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075980+0000", 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.774e-06 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075992+0000", 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2283000000000001e-05 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076024+0000", 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1242999999999999e-05 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076038+0000", 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4663e-05 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076199+0000", 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160865 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076539+0000", 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033995800000000001 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.077234+0000", 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000694581 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.078996+0000", 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001762633 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079276+0000", 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027998399999999999 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079380+0000", 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103266 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079449+0000", 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9003000000000003e-05 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.787795117000002, 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.982 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:01:31.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:01:31.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:01:31.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.988 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:31.988 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:01:31.988 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.754684459, 2024-05-07T14:01:31.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:01:31.988 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.988 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.988 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.988 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:31.988 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:31.988 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:31.988 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:01:31.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:01:31.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:31.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.747774540000002, 2024-05-07T14:01:31.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041680119999999996, 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 382 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:31.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:01:31.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:31.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:31.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179581+0000", 2024-05-07T14:01:31.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:01:31.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:31.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179585+0000", 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4800000000000003e-06 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179598+0000", 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2322e-05 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179604+0000", 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.823e-06 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179657+0000", 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3937000000000002e-05 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179714+0000", 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6165000000000002e-05 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179830+0000", 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011632 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:31.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.180515+0000", 2024-05-07T14:01:31.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00068531400000000002 2024-05-07T14:01:31.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:31.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183667+0000", 2024-05-07T14:01:31.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031522009999999999 2024-05-07T14:01:31.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:31.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183704+0000", 2024-05-07T14:01:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6925999999999998e-05 2024-05-07T14:01:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183748+0000", 2024-05-07T14:01:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3618999999999997e-05 2024-05-07T14:01:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:499 6.13 e33/27 6:cedbb205:::obj_delete_at_hint.0000000017:head v 33'4, mlcod=33'1)", 2024-05-07T14:01:31.999 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.674401885999998, 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043323679999999996, 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:01:32.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252954+0000", 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.71e-07 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252960+0000", 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.46e-06 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252974+0000", 2024-05-07T14:01:32.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4249e-05 2024-05-07T14:01:32.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252982+0000", 2024-05-07T14:01:32.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:01:32.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253055+0000", 2024-05-07T14:01:32.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3162000000000002e-05 2024-05-07T14:01:32.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253075+0000", 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9451999999999999e-05 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257253+0000", 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041781179999999998 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257285+0000", 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2075e-05 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.003 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:550 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.638747704, 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035552140000000001, 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 550 2024-05-07T14:01:32.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.005 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:01:32.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:01:32.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288608+0000", 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0529999999999999e-06 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288613+0000", 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7060000000000003e-06 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288624+0000", 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1547e-05 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288630+0000", 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288734+0000", 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103872 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288884+0000", 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014987400000000001 2024-05-07T14:01:32.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289167+0000", 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028341999999999999 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289813+0000", 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064550199999999995 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292082+0000", 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022696000000000001 2024-05-07T14:01:32.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292120+0000", 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7367999999999999e-05 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292162+0000", 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2568000000000003e-05 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.009 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:667 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.010 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:01:32.010 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.54280567, 2024-05-07T14:01:32.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050309150000000004, 2024-05-07T14:01:32.010 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.010 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.010 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.010 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.010 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.010 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.010 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 667 2024-05-07T14:01:32.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.010 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384550+0000", 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7000000000000003e-07 2024-05-07T14:01:32.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384555+0000", 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.135e-06 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384565+0000", 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0541e-05 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384571+0000", 2024-05-07T14:01:32.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.857e-06 2024-05-07T14:01:32.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384670+0000", 2024-05-07T14:01:32.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8461999999999993e-05 2024-05-07T14:01:32.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384822+0000", 2024-05-07T14:01:32.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152039 2024-05-07T14:01:32.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.385123+0000", 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030070699999999999 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.386099+0000", 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097677300000000001 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389495+0000", 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033959139999999999 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389530+0000", 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.472e-05 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389580+0000", 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9897e-05 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.015 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:32.017 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:01:32.017 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:32.028+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:32.118 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:32.128+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:32.142 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:32.142 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:32.142 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:32.142 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:32.156 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:01:32.219 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:32.232+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:32.319 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:32.319 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:32.319 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:32.320 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:32.320 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:32.320 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:32.332+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:32.333 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:01:32.420 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:32.432+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:32.456 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:32.457 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:32.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:32.457 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:32.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.457 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:01:32.457 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:32.457 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.483766320000001, 2024-05-07T14:01:32.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:01:32.457 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.457 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.457 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:01:32.457 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.457 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:01:32.458 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:01:32.458 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:01:32.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.458 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:32.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:32.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:01:32.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:01:32.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:01:32.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:01:32.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:01:32.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:01:32.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:01:32.461 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.436600449, 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:32.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:32.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:01:32.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:01:32.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:01:32.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:01:32.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:01:32.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:01:32.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:01:32.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.466 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.466 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:32.467 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:32.467 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.336272729000001, 2024-05-07T14:01:32.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:01:32.467 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.467 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.467 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.467 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.467 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.467 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.467 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:01:32.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.467 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:01:32.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:01:32.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:01:32.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:01:32.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:01:32.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:32.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:01:32.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:01:32.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:01:32.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:01:32.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:01:32.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:01:32.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.473 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.473 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:32.473 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.433728672000001, 2024-05-07T14:01:32.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:01:32.473 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.473 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.473 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.473 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.473 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.473 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.473 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:01:32.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.473 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:32.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:32.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:32.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:01:32.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:01:32.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:01:32.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:01:32.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:01:32.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:01:32.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:01:32.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:01:32.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:01:32.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:01:32.478 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.478 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.478 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.479 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.479 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:32.479 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.414418703999999, 2024-05-07T14:01:32.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:01:32.479 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.479 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.479 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.479 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.479 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.479 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:01:32.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:01:32.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:01:32.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:01:32.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:01:32.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:01:32.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.482 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.482 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:01:32.482 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:01:32.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.482 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.482 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:01:32.482 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:01:32.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.482 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:01:32.484 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.485 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.485 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.485 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.485 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:32.485 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.389051794, 2024-05-07T14:01:32.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:01:32.485 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.485 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.485 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.485 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.485 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.486 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.486 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:01:32.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.486 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:32.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:32.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:01:32.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:01:32.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:01:32.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:01:32.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:01:32.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:01:32.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:01:32.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:32.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:01:32.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:01:32.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:01:32.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:01:32.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:01:32.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:01:32.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:01:32.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:01:32.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:01:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:01:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.369262410000001, 2024-05-07T14:01:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:01:32.491 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:01:32.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:01:32.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:01:32.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:01:32.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:01:32.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:01:32.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:01:32.497 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.497 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.497 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.497 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.497 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:32.497 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.336024048999999, 2024-05-07T14:01:32.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:01:32.497 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.497 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:32.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:01:32.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:01:32.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:01:32.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:01:32.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:01:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:01:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:01:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:01:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:01:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:01:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.300663027999999, 2024-05-07T14:01:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:01:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:01:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:01:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:01:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:01:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:01:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:01:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:01:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:01:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:01:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:01:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:01:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.275919462000001, 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:01:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:01:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:01:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:01:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:01:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:01:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:01:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:01:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:01:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:01:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:01:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:01:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:01:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:01:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.165043058999998, 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:01:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:01:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:01:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:01:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:01:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:01:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:01:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:01:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.10887911, 2024-05-07T14:01:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:01:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:01:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:01:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:01:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:01:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:01:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:01:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:01:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:01:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:01:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:01:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:01:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:01:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:01:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:01:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:01:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:01:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:01:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.092993924999998, 2024-05-07T14:01:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:01:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:01:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:01:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:01:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:01:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:01:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:01:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.843627673, 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:01:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:01:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:01:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:01:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:01:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.782254850000001, 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:01:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:01:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:01:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:01:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:01:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:01:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:01:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:01:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:01:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:01:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:01:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:01:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:01:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:01:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:01:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:01:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:01:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:01:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.586466508000001, 2024-05-07T14:01:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:01:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:01:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:01:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:01:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:01:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:01:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:01:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:01:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:01:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:01:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:01:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:01:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:01:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:01:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:01:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:01:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:01:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:01:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:01:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:01:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:01:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:01:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:01:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.582163057999999, 2024-05-07T14:01:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003023937, 2024-05-07T14:01:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 918 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886558+0000", 2024-05-07T14:01:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1229999999999998e-06 2024-05-07T14:01:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886569+0000", 2024-05-07T14:01:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1497e-05 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886600+0000", 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0809999999999998e-05 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886618+0000", 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7799e-05 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886736+0000", 2024-05-07T14:01:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118276 2024-05-07T14:01:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886951+0000", 2024-05-07T14:01:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021467200000000001 2024-05-07T14:01:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.887437+0000", 2024-05-07T14:01:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048624900000000001 2024-05-07T14:01:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.888687+0000", 2024-05-07T14:01:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012498310000000001 2024-05-07T14:01:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889318+0000", 2024-05-07T14:01:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063122199999999997 2024-05-07T14:01:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889463+0000", 2024-05-07T14:01:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144769 2024-05-07T14:01:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889580+0000", 2024-05-07T14:01:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011668899999999999 2024-05-07T14:01:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.551162334000001, 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:01:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:01:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:01:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:01:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:01:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:01:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:01:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:01:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:01:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:01:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:01:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.546277442000001, 2024-05-07T14:01:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:01:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:01:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:01:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:01:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:01:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:01:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:01:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:01:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:01:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.514356071000002, 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:01:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:01:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:01:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:01:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:01:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:01:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:01:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:01:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:01:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:01:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:32.577 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:32.578 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:01:32.579 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:32.592+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:32.679 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:32.692+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:32.741 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:32.741 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:32.741 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:32.741 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:32.754 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:01:32.781 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:32.792+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:32.882 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:32.896+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:32.912 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:32.912 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:32.912 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:32.913 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:32.913 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:32.926 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:01:32.982 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:32.996+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:33.021 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:01:33.051 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:33.051 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:33.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:33.051 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:33.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.051 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:40 5.8 5:168cc6a2:::zonegroup_info.7881bf19-2c91-49be-82bb-722579314d1c:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:01:33.051 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:33.051 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.022661612, 2024-05-07T14:01:33.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002658582, 2024-05-07T14:01:33.051 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.051 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.052 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.052 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.052 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:01:33.052 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:01:33.052 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 40 2024-05-07T14:01:33.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.052 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:33.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:33.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042176+0000", 2024-05-07T14:01:33.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7719999999999999e-06 2024-05-07T14:01:33.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042186+0000", 2024-05-07T14:01:33.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0020000000000001e-05 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042209+0000", 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3224e-05 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042220+0000", 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1153e-05 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042358+0000", 2024-05-07T14:01:33.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137389 2024-05-07T14:01:33.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042594+0000", 2024-05-07T14:01:33.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023630100000000001 2024-05-07T14:01:33.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:33.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042900+0000", 2024-05-07T14:01:33.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030576799999999999 2024-05-07T14:01:33.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044463+0000", 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015627130000000001 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044675+0000", 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021186999999999999 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044768+0000", 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3046000000000003e-05 2024-05-07T14:01:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044833+0000", 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5326000000000004e-05 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.028106727000001, 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025872120000000002, 2024-05-07T14:01:33.057 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.058 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.058 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.058 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.058 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.058 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.058 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 52 2024-05-07T14:01:33.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.058 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:33.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036732+0000", 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4980000000000001e-06 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036744+0000", 2024-05-07T14:01:33.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2269999999999999e-05 2024-05-07T14:01:33.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036772+0000", 2024-05-07T14:01:33.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8002000000000001e-05 2024-05-07T14:01:33.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036817+0000", 2024-05-07T14:01:33.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4608999999999999e-05 2024-05-07T14:01:33.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036946+0000", 2024-05-07T14:01:33.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012988400000000001 2024-05-07T14:01:33.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037184+0000", 2024-05-07T14:01:33.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000237178 2024-05-07T14:01:33.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:33.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037405+0000", 2024-05-07T14:01:33.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221418 2024-05-07T14:01:33.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.038548+0000", 2024-05-07T14:01:33.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011433540000000001 2024-05-07T14:01:33.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039179+0000", 2024-05-07T14:01:33.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063016999999999999 2024-05-07T14:01:33.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039231+0000", 2024-05-07T14:01:33.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2434e-05 2024-05-07T14:01:33.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039316+0000", 2024-05-07T14:01:33.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5395000000000005e-05 2024-05-07T14:01:33.063 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.063 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.063 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.063 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.063 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.919524265, 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:01:33.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:01:33.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:01:33.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:01:33.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:01:33.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:33.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.069 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:33.070 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.907105324, 2024-05-07T14:01:33.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:01:33.070 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.070 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.070 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.070 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.070 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.070 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.070 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:01:33.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.071 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:33.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:33.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:01:33.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:01:33.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:01:33.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:01:33.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:01:33.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:01:33.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:01:33.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:01:33.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:01:33.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:01:33.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:01:33.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.903225601999999, 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:01:33.076 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.077 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.077 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.077 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.077 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.077 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.077 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:01:33.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.077 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:33.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:01:33.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:01:33.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:01:33.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:01:33.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:01:33.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:01:33.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.772570098999999, 2024-05-07T14:01:33.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:01:33.083 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.083 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.083 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.083 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.083 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.083 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.083 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:01:33.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.083 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:33.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:01:33.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:01:33.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:01:33.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:01:33.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:01:33.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:01:33.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:01:33.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:01:33.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:01:33.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:01:33.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:33.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:01:33.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:01:33.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:01:33.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:01:33.088 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.088 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.088 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.088 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.089 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:33.089 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.765402776999998, 2024-05-07T14:01:33.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:01:33.089 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.089 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.089 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.089 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.089 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.089 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.089 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:01:33.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.089 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:01:33.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:01:33.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:01:33.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:01:33.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:01:33.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:01:33.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:01:33.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:01:33.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:01:33.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:01:33.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:01:33.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:33.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:01:33.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:01:33.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:01:33.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:01:33.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:01:33.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:01:33.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:01:33.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:01:33.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:01:33.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:01:33.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.095 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.095 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:33.095 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:33.095 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.474870088999999, 2024-05-07T14:01:33.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:01:33.095 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.095 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.095 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.096 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:33.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:33.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:01:33.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:01:33.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:01:33.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:01:33.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:01:33.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:01:33.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:01:33.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:01:33.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:01:33.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:01:33.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.099 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.100 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.100 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:33.100 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.409788695, 2024-05-07T14:01:33.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025880500000000002, 2024-05-07T14:01:33.100 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.100 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.100 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.100 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.100 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.100 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.101 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 819 2024-05-07T14:01:33.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.101 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:33.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:33.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655049+0000", 2024-05-07T14:01:33.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6640000000000001e-06 2024-05-07T14:01:33.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655057+0000", 2024-05-07T14:01:33.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5639999999999997e-06 2024-05-07T14:01:33.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655082+0000", 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4119999999999999e-05 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655093+0000", 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1598e-05 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655273+0000", 2024-05-07T14:01:33.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017975599999999999 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655432+0000", 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000158682 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655720+0000", 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028791400000000001 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.656823+0000", 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001103435 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657483+0000", 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000659828 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657571+0000", 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7756000000000005e-05 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657635+0000", 2024-05-07T14:01:33.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4733000000000005e-05 2024-05-07T14:01:33.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.106 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.106 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.106 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:33.106 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.357512461999999, 2024-05-07T14:01:33.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028535079999999998, 2024-05-07T14:01:33.106 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.106 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.107 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.107 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 841 2024-05-07T14:01:33.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.107 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:33.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707326+0000", 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707338+0000", 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2036e-05 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707367+0000", 2024-05-07T14:01:33.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8816999999999999e-05 2024-05-07T14:01:33.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707382+0000", 2024-05-07T14:01:33.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4912999999999999e-05 2024-05-07T14:01:33.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707523+0000", 2024-05-07T14:01:33.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014165599999999999 2024-05-07T14:01:33.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707748+0000", 2024-05-07T14:01:33.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000224315 2024-05-07T14:01:33.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:33.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.708055+0000", 2024-05-07T14:01:33.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030739800000000001 2024-05-07T14:01:33.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.709147+0000", 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001091788 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710030+0000", 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088367000000000003 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710114+0000", 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3936000000000004e-05 2024-05-07T14:01:33.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710177+0000", 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2675999999999994e-05 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.353845923000002, 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026153460000000002, 2024-05-07T14:01:33.112 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 843 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710992+0000", 2024-05-07T14:01:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.666e-06 2024-05-07T14:01:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711000+0000", 2024-05-07T14:01:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.977e-06 2024-05-07T14:01:33.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711020+0000", 2024-05-07T14:01:33.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.033e-05 2024-05-07T14:01:33.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711030+0000", 2024-05-07T14:01:33.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9790000000000005e-06 2024-05-07T14:01:33.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711133+0000", 2024-05-07T14:01:33.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102563 2024-05-07T14:01:33.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711256+0000", 2024-05-07T14:01:33.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012337599999999999 2024-05-07T14:01:33.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:33.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711555+0000", 2024-05-07T14:01:33.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029948699999999997 2024-05-07T14:01:33.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.712654+0000", 2024-05-07T14:01:33.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001098819 2024-05-07T14:01:33.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713451+0000", 2024-05-07T14:01:33.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000796424 2024-05-07T14:01:33.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713541+0000", 2024-05-07T14:01:33.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9981999999999993e-05 2024-05-07T14:01:33.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713605+0000", 2024-05-07T14:01:33.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4743e-05 2024-05-07T14:01:33.118 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.118 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.118 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.118 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.344389806999999, 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027995160000000002, 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 847 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:33.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:33.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720448+0000", 2024-05-07T14:01:33.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:01:33.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720460+0000", 2024-05-07T14:01:33.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1157e-05 2024-05-07T14:01:33.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720490+0000", 2024-05-07T14:01:33.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0960000000000002e-05 2024-05-07T14:01:33.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720507+0000", 2024-05-07T14:01:33.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6477000000000002e-05 2024-05-07T14:01:33.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720681+0000", 2024-05-07T14:01:33.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017396800000000001 2024-05-07T14:01:33.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720897+0000", 2024-05-07T14:01:33.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215775 2024-05-07T14:01:33.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.721203+0000", 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030621499999999998 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.722485+0000", 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012818599999999999 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723091+0000", 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060651499999999996 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723182+0000", 2024-05-07T14:01:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0692999999999994e-05 2024-05-07T14:01:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723246+0000", 2024-05-07T14:01:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3643e-05 2024-05-07T14:01:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.125 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.125 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:33.125 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.340622457999999, 2024-05-07T14:01:33.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:01:33.125 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.125 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.125 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.125 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.125 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.125 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.125 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:01:33.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.125 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:33.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:33.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:01:33.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:01:33.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:01:33.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:01:33.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:01:33.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:01:33.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:01:33.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:01:33.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:01:33.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:01:33.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:01:33.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:01:33.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:01:33.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:01:33.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:01:33.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:01:33.130 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.131 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.131 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.131 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:33.131 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.294909061999999, 2024-05-07T14:01:33.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:01:33.131 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.131 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.132 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.132 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.132 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.132 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.132 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:01:33.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.132 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:33.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:33.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:01:33.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:01:33.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:01:33.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:01:33.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:01:33.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:01:33.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:01:33.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:01:33.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:01:33.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:01:33.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:01:33.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:01:33.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:01:33.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:01:33.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:01:33.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:01:33.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:01:33.137 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.138 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.138 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.138 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.138 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:33.138 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.288632324000002, 2024-05-07T14:01:33.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:01:33.138 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.138 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.138 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.138 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.138 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:01:33.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:01:33.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:01:33.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:33.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:01:33.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:01:33.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:01:33.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:01:33.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:01:33.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:01:33.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:01:33.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:01:33.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:01:33.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.202119203999999, 2024-05-07T14:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028016680000000002, 2024-05-07T14:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.145 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.145 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.145 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 907 2024-05-07T14:01:33.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.145 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:33.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862719+0000", 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862733+0000", 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3067e-05 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862763+0000", 2024-05-07T14:01:33.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0926000000000002e-05 2024-05-07T14:01:33.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862779+0000", 2024-05-07T14:01:33.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5787e-05 2024-05-07T14:01:33.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862924+0000", 2024-05-07T14:01:33.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014509899999999999 2024-05-07T14:01:33.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863160+0000", 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000235701 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863523+0000", 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000362567 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.864872+0000", 2024-05-07T14:01:33.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00134954 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865350+0000", 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000478009 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865437+0000", 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6712999999999995e-05 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865518+0000", 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1493000000000001e-05 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.198389917, 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027054290000000001, 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.150 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.151 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.151 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.151 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 909 2024-05-07T14:01:33.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.151 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:33.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:33.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866448+0000", 2024-05-07T14:01:33.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:01:33.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866459+0000", 2024-05-07T14:01:33.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1207e-05 2024-05-07T14:01:33.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866491+0000", 2024-05-07T14:01:33.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362999999999998e-05 2024-05-07T14:01:33.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866506+0000", 2024-05-07T14:01:33.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4790000000000001e-05 2024-05-07T14:01:33.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866632+0000", 2024-05-07T14:01:33.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000126422 2024-05-07T14:01:33.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866761+0000", 2024-05-07T14:01:33.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128832 2024-05-07T14:01:33.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:33.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.867037+0000", 2024-05-07T14:01:33.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027612200000000001 2024-05-07T14:01:33.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.868118+0000", 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001080941 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869004+0000", 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088632000000000001 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869081+0000", 2024-05-07T14:01:33.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7195999999999997e-05 2024-05-07T14:01:33.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869151+0000", 2024-05-07T14:01:33.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0066000000000003e-05 2024-05-07T14:01:33.156 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.156 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.156 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.156 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.156 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.103541117999999, 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:01:33.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:01:33.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:01:33.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:01:33.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:01:33.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:01:33.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:01:33.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:01:33.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:01:33.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:01:33.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:33.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:01:33.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:01:33.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:01:33.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:01:33.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:01:33.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:01:33.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.162 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.163 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:33.163 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.090371764, 2024-05-07T14:01:33.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027821920000000002, 2024-05-07T14:01:33.163 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.163 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.163 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.163 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.163 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.163 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.163 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 955 2024-05-07T14:01:33.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974466+0000", 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0999999999999998e-06 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974480+0000", 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3876999999999999e-05 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974510+0000", 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0273e-05 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974525+0000", 2024-05-07T14:01:33.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.485e-05 2024-05-07T14:01:33.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974618+0000", 2024-05-07T14:01:33.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2359000000000001e-05 2024-05-07T14:01:33.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974822+0000", 2024-05-07T14:01:33.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000204148 2024-05-07T14:01:33.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:33.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.975126+0000", 2024-05-07T14:01:33.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030382800000000002 2024-05-07T14:01:33.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976565+0000", 2024-05-07T14:01:33.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014395160000000001 2024-05-07T14:01:33.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976963+0000", 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00039772700000000001 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977128+0000", 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165508 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977246+0000", 2024-05-07T14:01:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011800599999999999 2024-05-07T14:01:33.169 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.169 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.169 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.169 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.169 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:33.169 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.086456201000001, 2024-05-07T14:01:33.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027683989999999999, 2024-05-07T14:01:33.169 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.169 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.169 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.170 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.170 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.170 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.170 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 957 2024-05-07T14:01:33.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.170 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:33.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:33.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978382+0000", 2024-05-07T14:01:33.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.95e-06 2024-05-07T14:01:33.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978393+0000", 2024-05-07T14:01:33.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.084e-05 2024-05-07T14:01:33.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978424+0000", 2024-05-07T14:01:33.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1022999999999998e-05 2024-05-07T14:01:33.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978441+0000", 2024-05-07T14:01:33.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7782999999999999e-05 2024-05-07T14:01:33.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978565+0000", 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012348900000000001 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978794+0000", 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000229335 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.979262+0000", 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046826700000000002 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.980470+0000", 2024-05-07T14:01:33.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012071899999999999 2024-05-07T14:01:33.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981002+0000", 2024-05-07T14:01:33.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053222299999999996 2024-05-07T14:01:33.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981086+0000", 2024-05-07T14:01:33.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4073000000000006e-05 2024-05-07T14:01:33.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981148+0000", 2024-05-07T14:01:33.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2225999999999997e-05 2024-05-07T14:01:33.175 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.177 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.177 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.177 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.177 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.178 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:33.179 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:01:33.180 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:33.192+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:33.280 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:33.292+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:33.346 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:33.346 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:33.346 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:33.346 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:33.360 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:01:33.381 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:33.392+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:33.482 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:33.492+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:33.530 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:33.530 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:33.530 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:33.530 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:33.530 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:33.544 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:01:33.591 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:33.604+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:33.664 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:33.665 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:33.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:33.665 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:33.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.665 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:01:33.665 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:33.665 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 31.674354762, 2024-05-07T14:01:33.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:01:33.665 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.665 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.665 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:01:33.666 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.666 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.666 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.666 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:01:33.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.666 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:01:33.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:01:33.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:01:33.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:01:33.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:01:33.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:01:33.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:01:33.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:01:33.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:01:33.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:01:33.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:01:33.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:01:33.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:01:33.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:01:33.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:01:33.670 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.670 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.670 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.671 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.671 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:33.671 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.653950942000002, 2024-05-07T14:01:33.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:01:33.671 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.671 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.671 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.671 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.671 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:01:33.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:01:33.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:01:33.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:01:33.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:01:33.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:01:33.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:01:33.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:01:33.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:01:33.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:01:33.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:01:33.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:01:33.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:01:33.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:01:33.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:01:33.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:01:33.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:01:33.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:33.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:01:33.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:01:33.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:01:33.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:01:33.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:01:33.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:01:33.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:01:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:01:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:01:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:01:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.678 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:33.679 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.551701227999999, 2024-05-07T14:01:33.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036480649999999998, 2024-05-07T14:01:33.679 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.679 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.679 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.679 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.679 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.679 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.679 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 231 2024-05-07T14:01:33.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.679 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:33.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:33.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125133+0000", 2024-05-07T14:01:33.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.063e-06 2024-05-07T14:01:33.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125143+0000", 2024-05-07T14:01:33.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9769999999999995e-06 2024-05-07T14:01:33.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125170+0000", 2024-05-07T14:01:33.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7152999999999999e-05 2024-05-07T14:01:33.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125184+0000", 2024-05-07T14:01:33.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4372999999999999e-05 2024-05-07T14:01:33.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125295+0000", 2024-05-07T14:01:33.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111036 2024-05-07T14:01:33.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125510+0000", 2024-05-07T14:01:33.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215102 2024-05-07T14:01:33.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:33.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125920+0000", 2024-05-07T14:01:33.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040954700000000001 2024-05-07T14:01:33.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.127419+0000", 2024-05-07T14:01:33.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001499261 2024-05-07T14:01:33.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128635+0000", 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001215818 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128718+0000", 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3048999999999997e-05 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128779+0000", 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0686000000000001e-05 2024-05-07T14:01:33.684 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.685 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.685 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.685 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:235 6.0 e33/27 6:013d6c33:gc::gc.30:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:33.685 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:33.685 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.536244206999999, 2024-05-07T14:01:33.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038113629999999999, 2024-05-07T14:01:33.685 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.685 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.685 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.685 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:33.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:33.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140590+0000", 2024-05-07T14:01:33.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:01:33.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140604+0000", 2024-05-07T14:01:33.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4324e-05 2024-05-07T14:01:33.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140640+0000", 2024-05-07T14:01:33.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6009e-05 2024-05-07T14:01:33.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140659+0000", 2024-05-07T14:01:33.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9340000000000001e-05 2024-05-07T14:01:33.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140815+0000", 2024-05-07T14:01:33.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155329 2024-05-07T14:01:33.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140868+0000", 2024-05-07T14:01:33.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3455999999999998e-05 2024-05-07T14:01:33.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144310+0000", 2024-05-07T14:01:33.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034414239999999998 2024-05-07T14:01:33.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144399+0000", 2024-05-07T14:01:33.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9492000000000003e-05 2024-05-07T14:01:33.690 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.690 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.690 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.690 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:400 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.690 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:33.690 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.485822810999998, 2024-05-07T14:01:33.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039416900000000003, 2024-05-07T14:01:33.690 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.691 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.691 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.691 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.691 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.691 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.691 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 400 2024-05-07T14:01:33.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.691 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:33.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:33.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191010+0000", 2024-05-07T14:01:33.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.09e-07 2024-05-07T14:01:33.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191014+0000", 2024-05-07T14:01:33.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999996e-06 2024-05-07T14:01:33.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191024+0000", 2024-05-07T14:01:33.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0274e-05 2024-05-07T14:01:33.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191030+0000", 2024-05-07T14:01:33.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.789e-06 2024-05-07T14:01:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191085+0000", 2024-05-07T14:01:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4741999999999999e-05 2024-05-07T14:01:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191169+0000", 2024-05-07T14:01:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4532999999999999e-05 2024-05-07T14:01:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:33.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191383+0000", 2024-05-07T14:01:33.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021415400000000001 2024-05-07T14:01:33.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194408+0000", 2024-05-07T14:01:33.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003024901 2024-05-07T14:01:33.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194860+0000", 2024-05-07T14:01:33.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045153599999999999 2024-05-07T14:01:33.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194915+0000", 2024-05-07T14:01:33.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4737999999999997e-05 2024-05-07T14:01:33.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194951+0000", 2024-05-07T14:01:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6183999999999998e-05 2024-05-07T14:01:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:403 6.2 e33/27 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.482725130999999, 2024-05-07T14:01:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003750841, 2024-05-07T14:01:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.697 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.698 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:33.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:33.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194108+0000", 2024-05-07T14:01:33.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.051e-06 2024-05-07T14:01:33.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194116+0000", 2024-05-07T14:01:33.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1149999999999994e-06 2024-05-07T14:01:33.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194128+0000", 2024-05-07T14:01:33.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1972e-05 2024-05-07T14:01:33.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194135+0000", 2024-05-07T14:01:33.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1130000000000003e-06 2024-05-07T14:01:33.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194191+0000", 2024-05-07T14:01:33.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:01:33.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194218+0000", 2024-05-07T14:01:33.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6242e-05 2024-05-07T14:01:33.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197807+0000", 2024-05-07T14:01:33.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003589283 2024-05-07T14:01:33.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197858+0000", 2024-05-07T14:01:33.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0572999999999998e-05 2024-05-07T14:01:33.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.702 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.702 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:415 6.7 e33/27 6:e622f76a:gc::gc.20:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:33.702 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:33.703 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.475023288999999, 2024-05-07T14:01:33.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044669840000000002, 2024-05-07T14:01:33.703 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.703 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.703 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.703 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:33.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:33.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:33.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1799999999999995e-07 2024-05-07T14:01:33.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201814+0000", 2024-05-07T14:01:33.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4170000000000002e-06 2024-05-07T14:01:33.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201824+0000", 2024-05-07T14:01:33.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0217999999999999e-05 2024-05-07T14:01:33.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201838+0000", 2024-05-07T14:01:33.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3723000000000001e-05 2024-05-07T14:01:33.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201890+0000", 2024-05-07T14:01:33.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2320000000000001e-05 2024-05-07T14:01:33.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201906+0000", 2024-05-07T14:01:33.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5894999999999999e-05 2024-05-07T14:01:33.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206242+0000", 2024-05-07T14:01:33.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043366489999999997 2024-05-07T14:01:33.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206276+0000", 2024-05-07T14:01:33.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:01:33.707 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.707 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.707 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.707 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:432 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.707 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:33.708 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.463777708999999, 2024-05-07T14:01:33.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045128019999999998, 2024-05-07T14:01:33.708 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.708 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.708 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.708 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 432 2024-05-07T14:01:33.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.708 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:33.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:33.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213055+0000", 2024-05-07T14:01:33.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7000000000000005e-07 2024-05-07T14:01:33.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213058+0000", 2024-05-07T14:01:33.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0369999999999999e-06 2024-05-07T14:01:33.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213066+0000", 2024-05-07T14:01:33.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3680000000000002e-06 2024-05-07T14:01:33.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213084+0000", 2024-05-07T14:01:33.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7946999999999999e-05 2024-05-07T14:01:33.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213127+0000", 2024-05-07T14:01:33.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2673999999999998e-05 2024-05-07T14:01:33.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213222+0000", 2024-05-07T14:01:33.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5488000000000005e-05 2024-05-07T14:01:33.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:33.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213412+0000", 2024-05-07T14:01:33.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000189307 2024-05-07T14:01:33.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.214754+0000", 2024-05-07T14:01:33.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001342069 2024-05-07T14:01:33.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217447+0000", 2024-05-07T14:01:33.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026931250000000002 2024-05-07T14:01:33.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217521+0000", 2024-05-07T14:01:33.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3997000000000003e-05 2024-05-07T14:01:33.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217567+0000", 2024-05-07T14:01:33.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6220000000000001e-05 2024-05-07T14:01:33.714 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.714 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.714 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.714 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:430 6.7 e33/27 6:e1cdb60d:reshard::reshard.0000000008:head v 33'9, mlcod=33'6)", 2024-05-07T14:01:33.714 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:33.714 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.463731226, 2024-05-07T14:01:33.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043702330000000003, 2024-05-07T14:01:33.715 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.715 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.715 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.715 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:33.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:33.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:33.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0400000000000005e-07 2024-05-07T14:01:33.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213107+0000", 2024-05-07T14:01:33.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5740000000000003e-06 2024-05-07T14:01:33.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213117+0000", 2024-05-07T14:01:33.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8349999999999999e-06 2024-05-07T14:01:33.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213122+0000", 2024-05-07T14:01:33.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5140000000000001e-06 2024-05-07T14:01:33.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213169+0000", 2024-05-07T14:01:33.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6551000000000002e-05 2024-05-07T14:01:33.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213198+0000", 2024-05-07T14:01:33.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:01:33.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217415+0000", 2024-05-07T14:01:33.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042171090000000001 2024-05-07T14:01:33.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217471+0000", 2024-05-07T14:01:33.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5766000000000001e-05 2024-05-07T14:01:33.719 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.719 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.720 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.720 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:480 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.720 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:33.720 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.435267070999998, 2024-05-07T14:01:33.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052104459999999997, 2024-05-07T14:01:33.720 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.720 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.720 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.720 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.720 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.721 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.721 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 480 2024-05-07T14:01:33.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.721 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:33.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:33.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:33.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6199999999999997e-07 2024-05-07T14:01:33.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241570+0000", 2024-05-07T14:01:33.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2479999999999998e-06 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241580+0000", 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8719999999999997e-06 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241584+0000", 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7210000000000002e-06 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241629+0000", 2024-05-07T14:01:33.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4465000000000002e-05 2024-05-07T14:01:33.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241671+0000", 2024-05-07T14:01:33.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2370999999999998e-05 2024-05-07T14:01:33.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:33.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241772+0000", 2024-05-07T14:01:33.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101048 2024-05-07T14:01:33.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.243876+0000", 2024-05-07T14:01:33.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021036789999999998 2024-05-07T14:01:33.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246710+0000", 2024-05-07T14:01:33.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028339060000000002 2024-05-07T14:01:33.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246747+0000", 2024-05-07T14:01:33.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7061000000000003e-05 2024-05-07T14:01:33.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246775+0000", 2024-05-07T14:01:33.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8413000000000001e-05 2024-05-07T14:01:33.726 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.726 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.726 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.727 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:499 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.727 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:33.727 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.424386349999999, 2024-05-07T14:01:33.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050166450000000001, 2024-05-07T14:01:33.727 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.727 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.727 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.727 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.727 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.727 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.727 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 499 2024-05-07T14:01:33.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.728 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:33.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:33.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:33.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4300000000000002e-07 2024-05-07T14:01:33.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252451+0000", 2024-05-07T14:01:33.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1290000000000004e-06 2024-05-07T14:01:33.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252463+0000", 2024-05-07T14:01:33.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1238e-05 2024-05-07T14:01:33.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252470+0000", 2024-05-07T14:01:33.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2019999999999998e-06 2024-05-07T14:01:33.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252534+0000", 2024-05-07T14:01:33.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4178999999999997e-05 2024-05-07T14:01:33.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252706+0000", 2024-05-07T14:01:33.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017197 2024-05-07T14:01:33.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:33.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252871+0000", 2024-05-07T14:01:33.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016508199999999999 2024-05-07T14:01:33.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254444+0000", 2024-05-07T14:01:33.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001573112 2024-05-07T14:01:33.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257407+0000", 2024-05-07T14:01:33.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029630989999999999 2024-05-07T14:01:33.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257437+0000", 2024-05-07T14:01:33.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0009999999999999e-05 2024-05-07T14:01:33.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257462+0000", 2024-05-07T14:01:33.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4780999999999999e-05 2024-05-07T14:01:33.733 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.733 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.733 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.733 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:500 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.733 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:33.733 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.424100246999998, 2024-05-07T14:01:33.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046354220000000002, 2024-05-07T14:01:33.734 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.734 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.734 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.734 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.734 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.734 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.734 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 500 2024-05-07T14:01:33.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.734 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:33.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:33.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252733+0000", 2024-05-07T14:01:33.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9399999999999993e-07 2024-05-07T14:01:33.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252738+0000", 2024-05-07T14:01:33.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6779999999999997e-06 2024-05-07T14:01:33.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252750+0000", 2024-05-07T14:01:33.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1882000000000001e-05 2024-05-07T14:01:33.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252758+0000", 2024-05-07T14:01:33.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0649999999999999e-06 2024-05-07T14:01:33.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252811+0000", 2024-05-07T14:01:33.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2859000000000003e-05 2024-05-07T14:01:33.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252870+0000", 2024-05-07T14:01:33.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8956000000000003e-05 2024-05-07T14:01:33.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:33.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252992+0000", 2024-05-07T14:01:33.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122275 2024-05-07T14:01:33.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254326+0000", 2024-05-07T14:01:33.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013334449999999999 2024-05-07T14:01:33.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257254+0000", 2024-05-07T14:01:33.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029284039999999999 2024-05-07T14:01:33.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257316+0000", 2024-05-07T14:01:33.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1348999999999998e-05 2024-05-07T14:01:33.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257367+0000", 2024-05-07T14:01:33.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1514999999999997e-05 2024-05-07T14:01:33.740 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.740 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.740 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.740 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:510 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.740 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:33.740 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.418017608, 2024-05-07T14:01:33.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041639090000000004, 2024-05-07T14:01:33.741 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.741 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.741 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.741 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.741 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.741 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.741 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 510 2024-05-07T14:01:33.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.741 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:33.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:33.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258815+0000", 2024-05-07T14:01:33.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:01:33.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258819+0000", 2024-05-07T14:01:33.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0090000000000001e-06 2024-05-07T14:01:33.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258828+0000", 2024-05-07T14:01:33.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2529999999999993e-06 2024-05-07T14:01:33.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258833+0000", 2024-05-07T14:01:33.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7219999999999999e-06 2024-05-07T14:01:33.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258870+0000", 2024-05-07T14:01:33.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6368000000000001e-05 2024-05-07T14:01:33.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258915+0000", 2024-05-07T14:01:33.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.528e-05 2024-05-07T14:01:33.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.259016+0000", 2024-05-07T14:01:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010074200000000001 2024-05-07T14:01:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.260655+0000", 2024-05-07T14:01:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016394999999999999 2024-05-07T14:01:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262752+0000", 2024-05-07T14:01:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002096531 2024-05-07T14:01:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262871+0000", 2024-05-07T14:01:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119645 2024-05-07T14:01:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262978+0000", 2024-05-07T14:01:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010695400000000001 2024-05-07T14:01:33.746 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:552 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.386258106, 2024-05-07T14:01:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042166790000000001, 2024-05-07T14:01:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.747 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.748 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.748 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.748 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.748 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 552 2024-05-07T14:01:33.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.748 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:33.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:33.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290575+0000", 2024-05-07T14:01:33.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.85e-07 2024-05-07T14:01:33.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290578+0000", 2024-05-07T14:01:33.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999999e-06 2024-05-07T14:01:33.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290587+0000", 2024-05-07T14:01:33.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.268e-06 2024-05-07T14:01:33.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290592+0000", 2024-05-07T14:01:33.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7029999999999997e-06 2024-05-07T14:01:33.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290694+0000", 2024-05-07T14:01:33.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101841 2024-05-07T14:01:33.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290840+0000", 2024-05-07T14:01:33.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014613899999999999 2024-05-07T14:01:33.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:33.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.291137+0000", 2024-05-07T14:01:33.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029714800000000001 2024-05-07T14:01:33.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292561+0000", 2024-05-07T14:01:33.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014235020000000001 2024-05-07T14:01:33.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294568+0000", 2024-05-07T14:01:33.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020076540000000002 2024-05-07T14:01:33.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294692+0000", 2024-05-07T14:01:33.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012394500000000001 2024-05-07T14:01:33.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294790+0000", 2024-05-07T14:01:33.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8194000000000002e-05 2024-05-07T14:01:33.753 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.754 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.754 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.754 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:553 6.f e33/27 6:f24cb4a8:gc::gc.31:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:33.754 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:33.754 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.383999247999999, 2024-05-07T14:01:33.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043350139999999999, 2024-05-07T14:01:33.754 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.754 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.754 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.755 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:33.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:33.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:33.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2900000000000004e-07 2024-05-07T14:01:33.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292838+0000", 2024-05-07T14:01:33.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5560000000000001e-06 2024-05-07T14:01:33.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292847+0000", 2024-05-07T14:01:33.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8619999999999992e-06 2024-05-07T14:01:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292851+0000", 2024-05-07T14:01:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9010000000000002e-06 2024-05-07T14:01:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292922+0000", 2024-05-07T14:01:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0827000000000005e-05 2024-05-07T14:01:33.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292973+0000", 2024-05-07T14:01:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0492999999999999e-05 2024-05-07T14:01:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297114+0000", 2024-05-07T14:01:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041408970000000002 2024-05-07T14:01:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297168+0000", 2024-05-07T14:01:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3949000000000001e-05 2024-05-07T14:01:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:686 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.759 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.274253363, 2024-05-07T14:01:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046254349999999998, 2024-05-07T14:01:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 686 2024-05-07T14:01:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.760 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402581+0000", 2024-05-07T14:01:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:01:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402592+0000", 2024-05-07T14:01:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0984e-05 2024-05-07T14:01:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402619+0000", 2024-05-07T14:01:33.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7583e-05 2024-05-07T14:01:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402633+0000", 2024-05-07T14:01:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3553000000000001e-05 2024-05-07T14:01:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402699+0000", 2024-05-07T14:01:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6013000000000006e-05 2024-05-07T14:01:33.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402792+0000", 2024-05-07T14:01:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3455999999999994e-05 2024-05-07T14:01:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402928+0000", 2024-05-07T14:01:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013596800000000001 2024-05-07T14:01:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.403918+0000", 2024-05-07T14:01:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00099017000000000007 2024-05-07T14:01:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407144+0000", 2024-05-07T14:01:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032257449999999999 2024-05-07T14:01:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407180+0000", 2024-05-07T14:01:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5462e-05 2024-05-07T14:01:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407204+0000", 2024-05-07T14:01:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4247999999999999e-05 2024-05-07T14:01:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.766 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.767 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:33.767 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.005341784999999, 2024-05-07T14:01:33.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003355448, 2024-05-07T14:01:33.767 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.767 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.767 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.767 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.767 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.767 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.767 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 826 2024-05-07T14:01:33.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.767 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:33.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:33.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671493+0000", 2024-05-07T14:01:33.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-06 2024-05-07T14:01:33.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671506+0000", 2024-05-07T14:01:33.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2746e-05 2024-05-07T14:01:33.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671542+0000", 2024-05-07T14:01:33.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6162999999999999e-05 2024-05-07T14:01:33.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671557+0000", 2024-05-07T14:01:33.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4786999999999999e-05 2024-05-07T14:01:33.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671705+0000", 2024-05-07T14:01:33.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000147792 2024-05-07T14:01:33.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671872+0000", 2024-05-07T14:01:33.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016705499999999999 2024-05-07T14:01:33.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:33.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.672101+0000", 2024-05-07T14:01:33.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022892999999999999 2024-05-07T14:01:33.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.673101+0000", 2024-05-07T14:01:33.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001000775 2024-05-07T14:01:33.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674701+0000", 2024-05-07T14:01:33.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016000599999999999 2024-05-07T14:01:33.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674795+0000", 2024-05-07T14:01:33.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3653000000000006e-05 2024-05-07T14:01:33.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674846+0000", 2024-05-07T14:01:33.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0473000000000003e-05 2024-05-07T14:01:33.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.773 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.773 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:868 6.f e33/27 6:f6792a7a:::obj_delete_at_hint.0000000097:head v 33'10, mlcod=33'8)", 2024-05-07T14:01:33.773 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:33.773 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.905937299000001, 2024-05-07T14:01:33.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033639339999999998, 2024-05-07T14:01:33.774 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.774 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.774 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.774 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:33.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:33.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770897+0000", 2024-05-07T14:01:33.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9700000000000002e-06 2024-05-07T14:01:33.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770909+0000", 2024-05-07T14:01:33.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2034e-05 2024-05-07T14:01:33.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770937+0000", 2024-05-07T14:01:33.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.796e-05 2024-05-07T14:01:33.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770954+0000", 2024-05-07T14:01:33.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7555999999999999e-05 2024-05-07T14:01:33.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771084+0000", 2024-05-07T14:01:33.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013033599999999999 2024-05-07T14:01:33.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771136+0000", 2024-05-07T14:01:33.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1925999999999997e-05 2024-05-07T14:01:33.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774168+0000", 2024-05-07T14:01:33.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030316200000000001 2024-05-07T14:01:33.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774259+0000", 2024-05-07T14:01:33.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0532000000000007e-05 2024-05-07T14:01:33.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.779 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.779 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:33.779 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.841947105999999, 2024-05-07T14:01:33.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035607859999999998, 2024-05-07T14:01:33.779 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.779 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.779 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.779 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 895 2024-05-07T14:01:33.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.780 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:33.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:33.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834888+0000", 2024-05-07T14:01:33.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.41e-06 2024-05-07T14:01:33.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834899+0000", 2024-05-07T14:01:33.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0987e-05 2024-05-07T14:01:33.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834929+0000", 2024-05-07T14:01:33.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9706e-05 2024-05-07T14:01:33.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834943+0000", 2024-05-07T14:01:33.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4354e-05 2024-05-07T14:01:33.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835100+0000", 2024-05-07T14:01:33.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156582 2024-05-07T14:01:33.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835499+0000", 2024-05-07T14:01:33.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000399214 2024-05-07T14:01:33.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:33.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.836052+0000", 2024-05-07T14:01:33.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00055334500000000001 2024-05-07T14:01:33.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.837279+0000", 2024-05-07T14:01:33.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012266270000000001 2024-05-07T14:01:33.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838177+0000", 2024-05-07T14:01:33.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089768699999999999 2024-05-07T14:01:33.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838332+0000", 2024-05-07T14:01:33.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155155 2024-05-07T14:01:33.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838446+0000", 2024-05-07T14:01:33.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113719 2024-05-07T14:01:33.785 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.785 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.785 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.785 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:33.785 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:33.785 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 25.834419576999998, 2024-05-07T14:01:33.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033546700000000001, 2024-05-07T14:01:33.786 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:33.786 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:33.786 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:33.786 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:33.786 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:33.786 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:33.786 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 898 2024-05-07T14:01:33.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.786 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:33.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:33.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:33.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:33.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:33.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:33.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:33.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842414+0000", 2024-05-07T14:01:33.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.863e-06 2024-05-07T14:01:33.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:33.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842425+0000", 2024-05-07T14:01:33.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0533000000000001e-05 2024-05-07T14:01:33.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:33.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842450+0000", 2024-05-07T14:01:33.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5259999999999999e-05 2024-05-07T14:01:33.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:33.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842463+0000", 2024-05-07T14:01:33.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3373000000000001e-05 2024-05-07T14:01:33.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:33.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842599+0000", 2024-05-07T14:01:33.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013549600000000001 2024-05-07T14:01:33.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:33.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842936+0000", 2024-05-07T14:01:33.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033763400000000001 2024-05-07T14:01:33.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:33.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.843484+0000", 2024-05-07T14:01:33.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054733899999999999 2024-05-07T14:01:33.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:33.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.844749+0000", 2024-05-07T14:01:33.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012656639999999999 2024-05-07T14:01:33.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:33.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845499+0000", 2024-05-07T14:01:33.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074904400000000003 2024-05-07T14:01:33.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:33.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845646+0000", 2024-05-07T14:01:33.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014709900000000001 2024-05-07T14:01:33.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:33.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:33.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:33.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845767+0000", 2024-05-07T14:01:33.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121365 2024-05-07T14:01:33.793 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.794 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.794 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.794 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:33.794 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:33.794 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:33.795 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:01:33.797 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:01:33.797 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:33.808+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:33.897 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:33.908+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:33.928 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:33.928 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:33.928 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:33.928 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:33.942 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:01:33.991 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:33.992 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:33.998 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:34.008+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:34.009 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:34.010 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:34.025 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:34.025 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:34.041 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:34.041 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:34.060 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:34.060 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:34.068 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:34.068 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:34.080 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:34.080 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:34.083 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:01:34.099 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:34.099 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:34.102 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:34.112+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:34.117 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:34.118 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:34.201 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:34.212+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:34.213 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:34.213 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:34.227 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:01:34.284 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:01:34.302 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:34.312+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:34.397 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:34.398 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:34.402 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:34.412+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:34.412 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:01:34.503 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:34.516+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:34.535 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:34.536 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:34.550 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:01:34.605 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:34.616+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:34.671 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:34.671 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:34.686 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:01:34.707 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:34.716+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:34.807 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:34.820+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:34.855 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:34.856 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:34.870 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:01:34.908 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:34.920+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:35.008 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:35.024+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:35.033 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:35.033 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:35.047 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:01:35.109 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:35.120+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:35.168 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:35.168 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:35.182 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:01:35.210 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:35.220+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:35.311 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:35.324+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:35.351 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:35.351 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:35.365 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:01:35.412 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:35.424+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:35.484 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:35.484 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:35.498 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:01:35.545 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:35.556+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:35.614 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:35.623+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:35.661 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:35.662 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:35.677 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:01:35.723 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:35.736+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:35.810 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:35.810 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:35.816 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:35.831+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:35.824 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:01:35.917 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:35.928+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:35.992 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:35.992 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:36.008 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:01:36.051 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:36.064+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:36.119 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:36.132+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:36.135 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:01:36.170 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:36.171 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:36.186 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:01:36.231 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:36.244+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:36.282 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:36.282 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:36.305 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:36.305 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:36.309 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:01:36.323 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:36.323 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:36.323 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:36.336+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:36.340 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:36.340 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:36.356 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:36.357 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:36.357 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:36.357 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:36.361 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:36.361 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:36.372 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:01:36.382 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:36.382 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:36.403 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:36.403 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:36.422 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:36.435+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:36.423 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:36.423 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:36.497 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:36.497 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:36.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:01:36.555 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:36.568+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:36.622 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:36.622 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:36.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:36.622 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:36.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.622 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:01:36.622 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:36.622 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.648926865, 2024-05-07T14:01:36.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:01:36.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:01:36.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.601760994000003, 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.627 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:01:36.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:01:36.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:01:36.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.501433274, 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:01:36.631 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:01:36.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:01:36.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:01:36.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:36.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:01:36.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:01:36.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:01:36.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:01:36.637 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.637 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.637 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.637 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.637 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:36.637 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.598889217, 2024-05-07T14:01:36.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:01:36.637 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.637 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:01:36.642 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.579579248999998, 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.643 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:01:36.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.648 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.554212338999999, 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:01:36.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:01:36.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:01:36.654 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.654 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.654 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.654 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.654 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:36.654 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.534422955, 2024-05-07T14:01:36.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:01:36.655 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.655 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.655 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.655 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.655 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.655 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.655 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:01:36.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.655 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:36.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:01:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.501184594000001, 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.465823573000002, 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:01:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.441080007, 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:01:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:01:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:01:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.330203604000001, 2024-05-07T14:01:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:01:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.274039654999999, 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:01:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:01:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:01:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:01:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:01:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:01:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:01:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.258154470000001, 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:01:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:01:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:01:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:01:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:01:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:01:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.008788217999999, 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:01:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:01:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:01:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:01:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.947415395, 2024-05-07T14:01:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:01:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:01:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.751627053, 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:01:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:01:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:01:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:01:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:01:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.747323603000002, 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003023937, 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 918 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886558+0000", 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1229999999999998e-06 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886569+0000", 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1497e-05 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886600+0000", 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0809999999999998e-05 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886618+0000", 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7799e-05 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886736+0000", 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118276 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886951+0000", 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021467200000000001 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.887437+0000", 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048624900000000001 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.888687+0000", 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012498310000000001 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889318+0000", 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063122199999999997 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889463+0000", 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144769 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889580+0000", 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011668899999999999 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.716322879, 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:01:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.711437987, 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:01:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.679516616000001, 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:01:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:01:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:01:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:36.735 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:36.736 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:01:36.737 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:36.747+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:36.836 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:36.848+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:36.905 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:36.905 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:36.905 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:36.905 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:36.919 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:01:36.938 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:36.947+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:37.038 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:37.048+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:37.081 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:37.081 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:37.081 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:37.082 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:37.082 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:37.095 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:01:37.139 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:37.151+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:37.240 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:37.252+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:37.266 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:37.266 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:37.266 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:37.267 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:37.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.267 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:40 5.8 5:168cc6a2:::zonegroup_info.7881bf19-2c91-49be-82bb-722579314d1c:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:01:37.267 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:37.267 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.235049556, 2024-05-07T14:01:37.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002658582, 2024-05-07T14:01:37.267 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.267 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.267 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.267 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.267 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:01:37.267 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 40 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042176+0000", 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7719999999999999e-06 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042186+0000", 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0020000000000001e-05 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042209+0000", 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3224e-05 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042220+0000", 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1153e-05 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042358+0000", 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137389 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042594+0000", 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023630100000000001 2024-05-07T14:01:37.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042900+0000", 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030576799999999999 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044463+0000", 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015627130000000001 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044675+0000", 2024-05-07T14:01:37.271 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021186999999999999 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044768+0000", 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3046000000000003e-05 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044833+0000", 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5326000000000004e-05 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.273 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:37.273 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:37.273 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.240494671, 2024-05-07T14:01:37.273 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025872120000000002, 2024-05-07T14:01:37.273 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.273 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.273 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.273 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.274 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.274 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.274 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 52 2024-05-07T14:01:37.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.274 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.274 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.274 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:37.274 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.275 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.275 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:37.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.275 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.275 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036732+0000", 2024-05-07T14:01:37.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4980000000000001e-06 2024-05-07T14:01:37.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036744+0000", 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2269999999999999e-05 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036772+0000", 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8002000000000001e-05 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036817+0000", 2024-05-07T14:01:37.276 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4608999999999999e-05 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036946+0000", 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012988400000000001 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037184+0000", 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000237178 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037405+0000", 2024-05-07T14:01:37.277 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221418 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.038548+0000", 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011433540000000001 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039179+0000", 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063016999999999999 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.278 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039231+0000", 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2434e-05 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039316+0000", 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5395000000000005e-05 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:37.279 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.131912208999999, 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.281 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:37.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.281 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:01:37.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:01:37.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.281 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:01:37.282 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:01:37.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.282 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.282 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:01:37.282 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:01:37.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.282 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.282 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:01:37.282 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:01:37.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:01:37.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.284 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.284 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:01:37.284 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:01:37.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.284 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.284 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:01:37.284 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:01:37.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.286 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.286 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:37.286 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.119493267999999, 2024-05-07T14:01:37.286 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:01:37.286 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.286 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.286 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.286 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.286 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.286 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.286 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:01:37.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.286 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:01:37.287 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:01:37.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:37.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.291 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.115613545999999, 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:01:37.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:01:37.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:01:37.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:01:37.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:37.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:01:37.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:01:37.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:01:37.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.984958042999999, 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:01:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:01:37.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:01:37.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.977790721000002, 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.303 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:37.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:01:37.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:01:37.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:01:37.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:01:37.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:01:37.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:01:37.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.687258032999999, 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:37.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:37.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:01:37.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:01:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:01:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:01:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:01:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:01:37.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:01:37.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:01:37.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:01:37.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:01:37.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.622176638999999, 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025880500000000002, 2024-05-07T14:01:37.314 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 819 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655049+0000", 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6640000000000001e-06 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655057+0000", 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5639999999999997e-06 2024-05-07T14:01:37.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655082+0000", 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4119999999999999e-05 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655093+0000", 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1598e-05 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655273+0000", 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017975599999999999 2024-05-07T14:01:37.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655432+0000", 2024-05-07T14:01:37.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000158682 2024-05-07T14:01:37.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:37.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655720+0000", 2024-05-07T14:01:37.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028791400000000001 2024-05-07T14:01:37.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.656823+0000", 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001103435 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657483+0000", 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000659828 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657571+0000", 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7756000000000005e-05 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657635+0000", 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4733000000000005e-05 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.569900405999999, 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028535079999999998, 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.320 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 841 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:37.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707326+0000", 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707338+0000", 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2036e-05 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707367+0000", 2024-05-07T14:01:37.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8816999999999999e-05 2024-05-07T14:01:37.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707382+0000", 2024-05-07T14:01:37.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4912999999999999e-05 2024-05-07T14:01:37.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707523+0000", 2024-05-07T14:01:37.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014165599999999999 2024-05-07T14:01:37.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707748+0000", 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000224315 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.708055+0000", 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030739800000000001 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.709147+0000", 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001091788 2024-05-07T14:01:37.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710030+0000", 2024-05-07T14:01:37.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088367000000000003 2024-05-07T14:01:37.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710114+0000", 2024-05-07T14:01:37.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3936000000000004e-05 2024-05-07T14:01:37.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710177+0000", 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2675999999999994e-05 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.566233867000001, 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026153460000000002, 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.326 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 843 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710992+0000", 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.666e-06 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711000+0000", 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.977e-06 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711020+0000", 2024-05-07T14:01:37.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.033e-05 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711030+0000", 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9790000000000005e-06 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711133+0000", 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102563 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711256+0000", 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012337599999999999 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711555+0000", 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029948699999999997 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.712654+0000", 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001098819 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713451+0000", 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000796424 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713541+0000", 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9981999999999993e-05 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713605+0000", 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4743e-05 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.331 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.556777750999998, 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027995160000000002, 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 847 2024-05-07T14:01:37.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720448+0000", 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720460+0000", 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1157e-05 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720490+0000", 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0960000000000002e-05 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720507+0000", 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6477000000000002e-05 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720681+0000", 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017396800000000001 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720897+0000", 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215775 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.721203+0000", 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030621499999999998 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.722485+0000", 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012818599999999999 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723091+0000", 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060651499999999996 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723182+0000", 2024-05-07T14:01:37.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0692999999999994e-05 2024-05-07T14:01:37.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723246+0000", 2024-05-07T14:01:37.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3643e-05 2024-05-07T14:01:37.337 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.337 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.337 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.338 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.338 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:37.338 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.553010401999998, 2024-05-07T14:01:37.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:01:37.338 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.338 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.338 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.338 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.338 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.338 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.338 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:01:37.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.338 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:01:37.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:01:37.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:37.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:01:37.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:01:37.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:01:37.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:01:37.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:01:37.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:01:37.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.343 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.507297006000002, 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:01:37.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:01:37.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:01:37.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:01:37.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:37.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:01:37.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:37.349 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.501020268000001, 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:37.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:01:37.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.414507147999998, 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028016680000000002, 2024-05-07T14:01:37.355 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 907 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862719+0000", 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862733+0000", 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3067e-05 2024-05-07T14:01:37.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862763+0000", 2024-05-07T14:01:37.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0926000000000002e-05 2024-05-07T14:01:37.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862779+0000", 2024-05-07T14:01:37.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5787e-05 2024-05-07T14:01:37.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862924+0000", 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014509899999999999 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863160+0000", 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000235701 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863523+0000", 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000362567 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.864872+0000", 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00134954 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865350+0000", 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000478009 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865437+0000", 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6712999999999995e-05 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865518+0000", 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1493000000000001e-05 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.410777861, 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027054290000000001, 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.362 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 909 2024-05-07T14:01:37.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.362 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:37.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:37.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866448+0000", 2024-05-07T14:01:37.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:01:37.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866459+0000", 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1207e-05 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866491+0000", 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362999999999998e-05 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866506+0000", 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4790000000000001e-05 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866632+0000", 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000126422 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866761+0000", 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128832 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.867037+0000", 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027612200000000001 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.868118+0000", 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001080941 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869004+0000", 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088632000000000001 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869081+0000", 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7195999999999997e-05 2024-05-07T14:01:37.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869151+0000", 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0066000000000003e-05 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.315929061999999, 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:01:37.367 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:01:37.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:01:37.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.302759708, 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027821920000000002, 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.373 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 955 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974466+0000", 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0999999999999998e-06 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974480+0000", 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3876999999999999e-05 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974510+0000", 2024-05-07T14:01:37.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0273e-05 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974525+0000", 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.485e-05 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974618+0000", 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2359000000000001e-05 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974822+0000", 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000204148 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.975126+0000", 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030382800000000002 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976565+0000", 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014395160000000001 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976963+0000", 2024-05-07T14:01:37.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00039772700000000001 2024-05-07T14:01:37.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977128+0000", 2024-05-07T14:01:37.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165508 2024-05-07T14:01:37.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977246+0000", 2024-05-07T14:01:37.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011800599999999999 2024-05-07T14:01:37.378 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.378 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.298844145, 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027683989999999999, 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 957 2024-05-07T14:01:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978382+0000", 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.95e-06 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978393+0000", 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.084e-05 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978424+0000", 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1022999999999998e-05 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978441+0000", 2024-05-07T14:01:37.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7782999999999999e-05 2024-05-07T14:01:37.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978565+0000", 2024-05-07T14:01:37.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012348900000000001 2024-05-07T14:01:37.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978794+0000", 2024-05-07T14:01:37.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000229335 2024-05-07T14:01:37.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.979262+0000", 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046826700000000002 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.980470+0000", 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012071899999999999 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981002+0000", 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053222299999999996 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981086+0000", 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4073000000000006e-05 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981148+0000", 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2225999999999997e-05 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.384 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:37.386 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:01:37.387 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:01:37.387 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:37.399+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:37.487 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:37.499+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:37.557 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:37.557 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:37.558 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:37.558 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:37.573 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:01:37.619 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:37.632+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:37.689 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:37.699+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:37.696 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:37.697 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:37.697 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:37.697 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:37.697 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:37.711 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:01:37.799 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:37.812+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:37.884 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:37.885 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:37.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:37.885 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:37.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.885 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:01:37.885 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:37.885 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.894200767999997, 2024-05-07T14:01:37.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:01:37.885 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.885 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.885 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:01:37.885 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:37.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:01:37.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:01:37.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:01:37.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:01:37.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:01:37.889 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.890 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.890 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.890 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.890 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:37.890 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.873796947999999, 2024-05-07T14:01:37.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:01:37.890 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.890 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.890 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.890 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.890 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.891 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.891 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:01:37.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.891 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:37.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:37.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:01:37.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:01:37.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:01:37.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:01:37.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:01:37.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:01:37.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:01:37.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:01:37.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:01:37.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:01:37.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:01:37.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:01:37.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:01:37.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:37.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:01:37.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:01:37.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:01:37.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:01:37.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.896 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.771547234, 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036480649999999998, 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.897 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 231 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125133+0000", 2024-05-07T14:01:37.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.063e-06 2024-05-07T14:01:37.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125143+0000", 2024-05-07T14:01:37.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9769999999999995e-06 2024-05-07T14:01:37.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125170+0000", 2024-05-07T14:01:37.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7152999999999999e-05 2024-05-07T14:01:37.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125184+0000", 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4372999999999999e-05 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125295+0000", 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111036 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125510+0000", 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215102 2024-05-07T14:01:37.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125920+0000", 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040954700000000001 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.127419+0000", 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001499261 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128635+0000", 2024-05-07T14:01:37.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001215818 2024-05-07T14:01:37.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128718+0000", 2024-05-07T14:01:37.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3048999999999997e-05 2024-05-07T14:01:37.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128779+0000", 2024-05-07T14:01:37.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0686000000000001e-05 2024-05-07T14:01:37.902 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.902 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.902 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.903 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:235 6.0 e33/27 6:013d6c33:gc::gc.30:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:37.903 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:37.903 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.756090213, 2024-05-07T14:01:37.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038113629999999999, 2024-05-07T14:01:37.903 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.903 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.903 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.903 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:37.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:37.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140590+0000", 2024-05-07T14:01:37.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:01:37.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140604+0000", 2024-05-07T14:01:37.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4324e-05 2024-05-07T14:01:37.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140640+0000", 2024-05-07T14:01:37.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6009e-05 2024-05-07T14:01:37.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140659+0000", 2024-05-07T14:01:37.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9340000000000001e-05 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140815+0000", 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155329 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140868+0000", 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3455999999999998e-05 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144310+0000", 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034414239999999998 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144399+0000", 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9492000000000003e-05 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:400 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:37.907 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.705668816999999, 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039416900000000003, 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 400 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:37.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191010+0000", 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.09e-07 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191014+0000", 2024-05-07T14:01:37.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999996e-06 2024-05-07T14:01:37.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191024+0000", 2024-05-07T14:01:37.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0274e-05 2024-05-07T14:01:37.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191030+0000", 2024-05-07T14:01:37.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.789e-06 2024-05-07T14:01:37.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191085+0000", 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4741999999999999e-05 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191169+0000", 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4532999999999999e-05 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191383+0000", 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021415400000000001 2024-05-07T14:01:37.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194408+0000", 2024-05-07T14:01:37.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003024901 2024-05-07T14:01:37.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194860+0000", 2024-05-07T14:01:37.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045153599999999999 2024-05-07T14:01:37.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194915+0000", 2024-05-07T14:01:37.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4737999999999997e-05 2024-05-07T14:01:37.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194951+0000", 2024-05-07T14:01:37.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6183999999999998e-05 2024-05-07T14:01:37.913 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.913 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.913 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.914 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:403 6.2 e33/27 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:37.914 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:37.914 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.702571137, 2024-05-07T14:01:37.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003750841, 2024-05-07T14:01:37.914 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.914 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.914 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.914 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:37.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194108+0000", 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.051e-06 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194116+0000", 2024-05-07T14:01:37.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1149999999999994e-06 2024-05-07T14:01:37.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194128+0000", 2024-05-07T14:01:37.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1972e-05 2024-05-07T14:01:37.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194135+0000", 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1130000000000003e-06 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194191+0000", 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194218+0000", 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6242e-05 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197807+0000", 2024-05-07T14:01:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003589283 2024-05-07T14:01:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197858+0000", 2024-05-07T14:01:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0572999999999998e-05 2024-05-07T14:01:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.918 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:415 6.7 e33/27 6:e622f76a:gc::gc.20:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.694869295, 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044669840000000002, 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1799999999999995e-07 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201814+0000", 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4170000000000002e-06 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201824+0000", 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0217999999999999e-05 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201838+0000", 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3723000000000001e-05 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201890+0000", 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2320000000000001e-05 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201906+0000", 2024-05-07T14:01:37.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5894999999999999e-05 2024-05-07T14:01:37.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206242+0000", 2024-05-07T14:01:37.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043366489999999997 2024-05-07T14:01:37.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206276+0000", 2024-05-07T14:01:37.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:432 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.683623715, 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045128019999999998, 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.923 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 432 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213055+0000", 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7000000000000005e-07 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213058+0000", 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0369999999999999e-06 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213066+0000", 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3680000000000002e-06 2024-05-07T14:01:37.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213084+0000", 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7946999999999999e-05 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213127+0000", 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2673999999999998e-05 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213222+0000", 2024-05-07T14:01:37.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5488000000000005e-05 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213412+0000", 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000189307 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.214754+0000", 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001342069 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217447+0000", 2024-05-07T14:01:37.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026931250000000002 2024-05-07T14:01:37.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217521+0000", 2024-05-07T14:01:37.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3997000000000003e-05 2024-05-07T14:01:37.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217567+0000", 2024-05-07T14:01:37.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6220000000000001e-05 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:430 6.7 e33/27 6:e1cdb60d:reshard::reshard.0000000008:head v 33'9, mlcod=33'6)", 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.683577232000001, 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043702330000000003, 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:37.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:37.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:37.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0400000000000005e-07 2024-05-07T14:01:37.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213107+0000", 2024-05-07T14:01:37.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5740000000000003e-06 2024-05-07T14:01:37.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213117+0000", 2024-05-07T14:01:37.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8349999999999999e-06 2024-05-07T14:01:37.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213122+0000", 2024-05-07T14:01:37.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5140000000000001e-06 2024-05-07T14:01:37.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213169+0000", 2024-05-07T14:01:37.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6551000000000002e-05 2024-05-07T14:01:37.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213198+0000", 2024-05-07T14:01:37.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:01:37.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217415+0000", 2024-05-07T14:01:37.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042171090000000001 2024-05-07T14:01:37.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217471+0000", 2024-05-07T14:01:37.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5766000000000001e-05 2024-05-07T14:01:37.933 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.933 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.933 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.934 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:480 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.934 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:37.934 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.655113076999999, 2024-05-07T14:01:37.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052104459999999997, 2024-05-07T14:01:37.934 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.934 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.934 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.934 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.934 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.934 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.935 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 480 2024-05-07T14:01:37.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.935 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:37.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:37.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:37.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6199999999999997e-07 2024-05-07T14:01:37.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241570+0000", 2024-05-07T14:01:37.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2479999999999998e-06 2024-05-07T14:01:37.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241580+0000", 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8719999999999997e-06 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241584+0000", 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7210000000000002e-06 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241629+0000", 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4465000000000002e-05 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241671+0000", 2024-05-07T14:01:37.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2370999999999998e-05 2024-05-07T14:01:37.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:37.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241772+0000", 2024-05-07T14:01:37.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101048 2024-05-07T14:01:37.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.243876+0000", 2024-05-07T14:01:37.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021036789999999998 2024-05-07T14:01:37.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246710+0000", 2024-05-07T14:01:37.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028339060000000002 2024-05-07T14:01:37.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246747+0000", 2024-05-07T14:01:37.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7061000000000003e-05 2024-05-07T14:01:37.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246775+0000", 2024-05-07T14:01:37.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8413000000000001e-05 2024-05-07T14:01:37.940 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.940 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.940 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.940 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:499 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.940 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:37.941 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.644232356, 2024-05-07T14:01:37.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050166450000000001, 2024-05-07T14:01:37.941 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.941 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.941 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.941 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.941 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.941 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.941 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 499 2024-05-07T14:01:37.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.941 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:37.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:37.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:37.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4300000000000002e-07 2024-05-07T14:01:37.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252451+0000", 2024-05-07T14:01:37.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1290000000000004e-06 2024-05-07T14:01:37.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252463+0000", 2024-05-07T14:01:37.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1238e-05 2024-05-07T14:01:37.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252470+0000", 2024-05-07T14:01:37.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2019999999999998e-06 2024-05-07T14:01:37.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252534+0000", 2024-05-07T14:01:37.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4178999999999997e-05 2024-05-07T14:01:37.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252706+0000", 2024-05-07T14:01:37.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017197 2024-05-07T14:01:37.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:37.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252871+0000", 2024-05-07T14:01:37.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016508199999999999 2024-05-07T14:01:37.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254444+0000", 2024-05-07T14:01:37.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001573112 2024-05-07T14:01:37.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257407+0000", 2024-05-07T14:01:37.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029630989999999999 2024-05-07T14:01:37.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257437+0000", 2024-05-07T14:01:37.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0009999999999999e-05 2024-05-07T14:01:37.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257462+0000", 2024-05-07T14:01:37.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4780999999999999e-05 2024-05-07T14:01:37.947 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.947 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.947 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.947 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:500 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.947 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:37.947 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.643946252999999, 2024-05-07T14:01:37.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046354220000000002, 2024-05-07T14:01:37.947 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.947 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.947 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.947 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 500 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:37.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252733+0000", 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9399999999999993e-07 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252738+0000", 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6779999999999997e-06 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252750+0000", 2024-05-07T14:01:37.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1882000000000001e-05 2024-05-07T14:01:37.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252758+0000", 2024-05-07T14:01:37.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0649999999999999e-06 2024-05-07T14:01:37.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252811+0000", 2024-05-07T14:01:37.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2859000000000003e-05 2024-05-07T14:01:37.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252870+0000", 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8956000000000003e-05 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252992+0000", 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122275 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254326+0000", 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013334449999999999 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257254+0000", 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029284039999999999 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257316+0000", 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1348999999999998e-05 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257367+0000", 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1514999999999997e-05 2024-05-07T14:01:37.952 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:510 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.637863614, 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041639090000000004, 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.953 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 510 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258815+0000", 2024-05-07T14:01:37.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:01:37.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258819+0000", 2024-05-07T14:01:37.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0090000000000001e-06 2024-05-07T14:01:37.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258828+0000", 2024-05-07T14:01:37.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2529999999999993e-06 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258833+0000", 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7219999999999999e-06 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258870+0000", 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6368000000000001e-05 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258915+0000", 2024-05-07T14:01:37.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.528e-05 2024-05-07T14:01:37.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:37.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.259016+0000", 2024-05-07T14:01:37.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010074200000000001 2024-05-07T14:01:37.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.260655+0000", 2024-05-07T14:01:37.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016394999999999999 2024-05-07T14:01:37.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262752+0000", 2024-05-07T14:01:37.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002096531 2024-05-07T14:01:37.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262871+0000", 2024-05-07T14:01:37.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119645 2024-05-07T14:01:37.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262978+0000", 2024-05-07T14:01:37.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010695400000000001 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:552 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.606104112000001, 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042166790000000001, 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.959 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 552 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290575+0000", 2024-05-07T14:01:37.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.85e-07 2024-05-07T14:01:37.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290578+0000", 2024-05-07T14:01:37.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999999e-06 2024-05-07T14:01:37.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290587+0000", 2024-05-07T14:01:37.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.268e-06 2024-05-07T14:01:37.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290592+0000", 2024-05-07T14:01:37.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7029999999999997e-06 2024-05-07T14:01:37.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290694+0000", 2024-05-07T14:01:37.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101841 2024-05-07T14:01:37.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290840+0000", 2024-05-07T14:01:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014613899999999999 2024-05-07T14:01:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.291137+0000", 2024-05-07T14:01:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029714800000000001 2024-05-07T14:01:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292561+0000", 2024-05-07T14:01:37.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014235020000000001 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294568+0000", 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020076540000000002 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294692+0000", 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012394500000000001 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294790+0000", 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8194000000000002e-05 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:553 6.f e33/27 6:f24cb4a8:gc::gc.31:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.603845253999999, 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043350139999999999, 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.965 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:37.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:37.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:37.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2900000000000004e-07 2024-05-07T14:01:37.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292838+0000", 2024-05-07T14:01:37.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5560000000000001e-06 2024-05-07T14:01:37.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292847+0000", 2024-05-07T14:01:37.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8619999999999992e-06 2024-05-07T14:01:37.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292851+0000", 2024-05-07T14:01:37.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9010000000000002e-06 2024-05-07T14:01:37.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292922+0000", 2024-05-07T14:01:37.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0827000000000005e-05 2024-05-07T14:01:37.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292973+0000", 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0492999999999999e-05 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297114+0000", 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041408970000000002 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297168+0000", 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3949000000000001e-05 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.969 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.970 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:686 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.970 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:37.970 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.494099369000001, 2024-05-07T14:01:37.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046254349999999998, 2024-05-07T14:01:37.970 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.970 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.970 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.970 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.970 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.970 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.970 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 686 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402581+0000", 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402592+0000", 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0984e-05 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402619+0000", 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7583e-05 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402633+0000", 2024-05-07T14:01:37.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3553000000000001e-05 2024-05-07T14:01:37.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402699+0000", 2024-05-07T14:01:37.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6013000000000006e-05 2024-05-07T14:01:37.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402792+0000", 2024-05-07T14:01:37.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3455999999999994e-05 2024-05-07T14:01:37.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:37.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402928+0000", 2024-05-07T14:01:37.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013596800000000001 2024-05-07T14:01:37.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.403918+0000", 2024-05-07T14:01:37.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00099017000000000007 2024-05-07T14:01:37.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407144+0000", 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032257449999999999 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407180+0000", 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5462e-05 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407204+0000", 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4247999999999999e-05 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.975 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.976 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.976 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:37.976 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.225187791, 2024-05-07T14:01:37.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003355448, 2024-05-07T14:01:37.976 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.976 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.976 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.976 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.976 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.976 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.976 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 826 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671493+0000", 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-06 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671506+0000", 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2746e-05 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671542+0000", 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6162999999999999e-05 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671557+0000", 2024-05-07T14:01:37.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4786999999999999e-05 2024-05-07T14:01:37.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671705+0000", 2024-05-07T14:01:37.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000147792 2024-05-07T14:01:37.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671872+0000", 2024-05-07T14:01:37.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016705499999999999 2024-05-07T14:01:37.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:37.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.672101+0000", 2024-05-07T14:01:37.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022892999999999999 2024-05-07T14:01:37.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.673101+0000", 2024-05-07T14:01:37.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001000775 2024-05-07T14:01:37.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674701+0000", 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016000599999999999 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674795+0000", 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3653000000000006e-05 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674846+0000", 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0473000000000003e-05 2024-05-07T14:01:37.981 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.982 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.982 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.982 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:868 6.f e33/27 6:f6792a7a:::obj_delete_at_hint.0000000097:head v 33'10, mlcod=33'8)", 2024-05-07T14:01:37.982 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:37.982 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.125783304999999, 2024-05-07T14:01:37.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033639339999999998, 2024-05-07T14:01:37.982 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.982 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.982 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.982 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770897+0000", 2024-05-07T14:01:37.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9700000000000002e-06 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770909+0000", 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2034e-05 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770937+0000", 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.796e-05 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770954+0000", 2024-05-07T14:01:37.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7555999999999999e-05 2024-05-07T14:01:37.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771084+0000", 2024-05-07T14:01:37.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013033599999999999 2024-05-07T14:01:37.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771136+0000", 2024-05-07T14:01:37.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1925999999999997e-05 2024-05-07T14:01:37.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774168+0000", 2024-05-07T14:01:37.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030316200000000001 2024-05-07T14:01:37.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774259+0000", 2024-05-07T14:01:37.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0532000000000007e-05 2024-05-07T14:01:37.986 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.986 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.986 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.061793112, 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035607859999999998, 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 895 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.987 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834888+0000", 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.41e-06 2024-05-07T14:01:37.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834899+0000", 2024-05-07T14:01:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0987e-05 2024-05-07T14:01:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834929+0000", 2024-05-07T14:01:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9706e-05 2024-05-07T14:01:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834943+0000", 2024-05-07T14:01:37.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4354e-05 2024-05-07T14:01:37.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835100+0000", 2024-05-07T14:01:37.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156582 2024-05-07T14:01:37.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835499+0000", 2024-05-07T14:01:37.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000399214 2024-05-07T14:01:37.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.836052+0000", 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00055334500000000001 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.837279+0000", 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012266270000000001 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838177+0000", 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089768699999999999 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838332+0000", 2024-05-07T14:01:37.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155155 2024-05-07T14:01:37.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838446+0000", 2024-05-07T14:01:37.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113719 2024-05-07T14:01:37.992 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.992 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.992 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.993 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:37.993 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:37.993 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.054265582999999, 2024-05-07T14:01:37.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033546700000000001, 2024-05-07T14:01:37.993 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:37.993 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:37.993 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:37.993 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:37.993 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:37.993 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:37.993 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 898 2024-05-07T14:01:37.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.993 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:37.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:37.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:37.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:37.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:37.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:37.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:37.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842414+0000", 2024-05-07T14:01:37.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.863e-06 2024-05-07T14:01:37.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:37.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842425+0000", 2024-05-07T14:01:37.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0533000000000001e-05 2024-05-07T14:01:37.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:37.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842450+0000", 2024-05-07T14:01:37.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5259999999999999e-05 2024-05-07T14:01:37.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:37.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842463+0000", 2024-05-07T14:01:37.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3373000000000001e-05 2024-05-07T14:01:37.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:37.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842599+0000", 2024-05-07T14:01:37.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013549600000000001 2024-05-07T14:01:37.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:37.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842936+0000", 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033763400000000001 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.843484+0000", 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054733899999999999 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.844749+0000", 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012656639999999999 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:37.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845499+0000", 2024-05-07T14:01:37.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074904400000000003 2024-05-07T14:01:37.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:37.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845646+0000", 2024-05-07T14:01:37.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014709900000000001 2024-05-07T14:01:37.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:37.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:37.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:37.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845767+0000", 2024-05-07T14:01:37.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121365 2024-05-07T14:01:37.998 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.999 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.999 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.999 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:37.999 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:37.999 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:38.000 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:01:38.001 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:38.011+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:38.102 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:38.111+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:38.131 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:38.131 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:38.131 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:38.145 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:01:38.231 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:38.243+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:38.303 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:38.316+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:38.309 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:38.309 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:38.309 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:38.309 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:38.309 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:38.323 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:01:38.405 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:38.420+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:38.447 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:01:38.495 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:38.495 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:38.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:38.495 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:38.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.495 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:01:38.495 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:38.495 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.511737967999998, 2024-05-07T14:01:38.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070064749999999999, 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 43 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:38.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994274+0000", 2024-05-07T14:01:38.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7170000000000002e-06 2024-05-07T14:01:38.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994292+0000", 2024-05-07T14:01:38.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7819999999999999e-05 2024-05-07T14:01:38.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994338+0000", 2024-05-07T14:01:38.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6625999999999997e-05 2024-05-07T14:01:38.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994362+0000", 2024-05-07T14:01:38.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4063e-05 2024-05-07T14:01:38.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994576+0000", 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021319500000000001 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994598+0000", 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2325999999999999e-05 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001023+0000", 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00642546 2024-05-07T14:01:38.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001277+0000", 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025326800000000002 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:46 7.1f e30/29 7:f95f44c2:::notify.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.483645312, 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031449519999999999, 2024-05-07T14:01:38.500 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5700000000000002e-07 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022371+0000", 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7230000000000004e-06 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022396+0000", 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4406e-05 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022415+0000", 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9264999999999999e-05 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022641+0000", 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022584100000000001 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022702+0000", 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1513999999999994e-05 2024-05-07T14:01:38.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.025418+0000", 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027162290000000001 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.025508+0000", 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9216999999999996e-05 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.456108541999999, 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033678110000000001, 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 211 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:38.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:38.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049903+0000", 2024-05-07T14:01:38.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.963e-06 2024-05-07T14:01:38.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049917+0000", 2024-05-07T14:01:38.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-05-07T14:01:38.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049950+0000", 2024-05-07T14:01:38.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3328999999999999e-05 2024-05-07T14:01:38.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049966+0000", 2024-05-07T14:01:38.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6333000000000001e-05 2024-05-07T14:01:38.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050100+0000", 2024-05-07T14:01:38.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013305599999999999 2024-05-07T14:01:38.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050363+0000", 2024-05-07T14:01:38.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026392100000000002 2024-05-07T14:01:38.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:38.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050827+0000", 2024-05-07T14:01:38.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046316 2024-05-07T14:01:38.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.052269+0000", 2024-05-07T14:01:38.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014428760000000001 2024-05-07T14:01:38.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053111+0000", 2024-05-07T14:01:38.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084168999999999997 2024-05-07T14:01:38.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053198+0000", 2024-05-07T14:01:38.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6666e-05 2024-05-07T14:01:38.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053267+0000", 2024-05-07T14:01:38.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9503000000000002e-05 2024-05-07T14:01:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.377653847000001, 2024-05-07T14:01:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032702809999999999, 2024-05-07T14:01:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.511 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.512 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.512 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.512 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 232 2024-05-07T14:01:38.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.512 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:38.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128357+0000", 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1530000000000001e-06 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128369+0000", 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1823e-05 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128401+0000", 2024-05-07T14:01:38.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:01:38.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128416+0000", 2024-05-07T14:01:38.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4997000000000001e-05 2024-05-07T14:01:38.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128538+0000", 2024-05-07T14:01:38.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121406 2024-05-07T14:01:38.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128773+0000", 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235121 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.129230+0000", 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00045679999999999999 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.130836+0000", 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001606484 2024-05-07T14:01:38.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131454+0000", 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061747199999999999 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131550+0000", 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6636000000000001e-05 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131624+0000", 2024-05-07T14:01:38.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4315999999999998e-05 2024-05-07T14:01:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:265 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.352001495, 2024-05-07T14:01:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029442299999999999, 2024-05-07T14:01:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.518 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.518 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.518 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 265 2024-05-07T14:01:38.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.518 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:38.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154009+0000", 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.413e-06 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154023+0000", 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4229999999999999e-05 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154062+0000", 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9223e-05 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154085+0000", 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2909999999999999e-05 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154269+0000", 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183232 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154422+0000", 2024-05-07T14:01:38.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015338799999999999 2024-05-07T14:01:38.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:01:38.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154693+0000", 2024-05-07T14:01:38.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000271005 2024-05-07T14:01:38.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155957+0000", 2024-05-07T14:01:38.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001263573 2024-05-07T14:01:38.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156590+0000", 2024-05-07T14:01:38.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00063392600000000004 2024-05-07T14:01:38.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156844+0000", 2024-05-07T14:01:38.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025348800000000001 2024-05-07T14:01:38.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156951+0000", 2024-05-07T14:01:38.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106842 2024-05-07T14:01:38.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.523 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.523 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:277 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.523 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:38.523 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.35010003, 2024-05-07T14:01:38.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030861830000000002, 2024-05-07T14:01:38.523 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.524 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.524 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.524 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.524 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.524 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.524 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 277 2024-05-07T14:01:38.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.524 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:38.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:38.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155910+0000", 2024-05-07T14:01:38.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:01:38.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155922+0000", 2024-05-07T14:01:38.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2082999999999999e-05 2024-05-07T14:01:38.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155967+0000", 2024-05-07T14:01:38.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4855999999999999e-05 2024-05-07T14:01:38.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155986+0000", 2024-05-07T14:01:38.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.965e-05 2024-05-07T14:01:38.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156173+0000", 2024-05-07T14:01:38.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018657299999999999 2024-05-07T14:01:38.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156479+0000", 2024-05-07T14:01:38.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030636299999999998 2024-05-07T14:01:38.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:38.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156975+0000", 2024-05-07T14:01:38.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00049533699999999999 2024-05-07T14:01:38.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158291+0000", 2024-05-07T14:01:38.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001316776 2024-05-07T14:01:38.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158712+0000", 2024-05-07T14:01:38.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042077999999999999 2024-05-07T14:01:38.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158885+0000", 2024-05-07T14:01:38.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000172786 2024-05-07T14:01:38.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158994+0000", 2024-05-07T14:01:38.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109239 2024-05-07T14:01:38.529 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.529 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:301 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.346076880999998, 2024-05-07T14:01:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037043950000000001, 2024-05-07T14:01:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.530 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 301 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159933+0000", 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6670000000000001e-06 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159943+0000", 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0176e-05 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159965+0000", 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2243e-05 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159980+0000", 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4747e-05 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160332+0000", 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000352004 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160574+0000", 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241838 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:38.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.161045+0000", 2024-05-07T14:01:38.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000471526 2024-05-07T14:01:38.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.162322+0000", 2024-05-07T14:01:38.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001276241 2024-05-07T14:01:38.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163376+0000", 2024-05-07T14:01:38.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010539449999999999 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163516+0000", 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014034599999999999 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163636+0000", 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011966199999999999 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.535 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:376 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.536 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:38.536 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.329961602000001, 2024-05-07T14:01:38.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038557209999999999, 2024-05-07T14:01:38.536 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.536 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.536 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.536 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.536 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.536 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.536 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 376 2024-05-07T14:01:38.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.536 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176049+0000", 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176064+0000", 2024-05-07T14:01:38.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.451e-05 2024-05-07T14:01:38.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176101+0000", 2024-05-07T14:01:38.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000003e-05 2024-05-07T14:01:38.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176126+0000", 2024-05-07T14:01:38.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-05-07T14:01:38.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176272+0000", 2024-05-07T14:01:38.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014592899999999999 2024-05-07T14:01:38.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176402+0000", 2024-05-07T14:01:38.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000129512 2024-05-07T14:01:38.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:38.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176725+0000", 2024-05-07T14:01:38.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032289800000000001 2024-05-07T14:01:38.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.177826+0000", 2024-05-07T14:01:38.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011017620000000001 2024-05-07T14:01:38.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179617+0000", 2024-05-07T14:01:38.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001791193 2024-05-07T14:01:38.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179781+0000", 2024-05-07T14:01:38.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016336899999999999 2024-05-07T14:01:38.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179902+0000", 2024-05-07T14:01:38.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012131899999999999 2024-05-07T14:01:38.541 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.541 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.541 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:397 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.317464512000001, 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034388040000000002, 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 397 2024-05-07T14:01:38.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188546+0000", 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2000000000000001e-06 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188556+0000", 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0557000000000001e-05 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188590+0000", 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3626e-05 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188625+0000", 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5095999999999997e-05 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188768+0000", 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014279900000000001 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189124+0000", 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035646799999999998 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189633+0000", 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000508903 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.190638+0000", 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001004465 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191712+0000", 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001074759 2024-05-07T14:01:38.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191871+0000", 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835900000000001 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191982+0000", 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011157199999999999 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:403 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:38.548 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.313321733999999, 2024-05-07T14:01:38.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004923172, 2024-05-07T14:01:38.548 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.548 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.548 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.548 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.548 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.548 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.548 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 403 2024-05-07T14:01:38.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.548 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:38.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:38.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192688+0000", 2024-05-07T14:01:38.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4640000000000001e-06 2024-05-07T14:01:38.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192696+0000", 2024-05-07T14:01:38.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9330000000000001e-06 2024-05-07T14:01:38.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192715+0000", 2024-05-07T14:01:38.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9746999999999999e-05 2024-05-07T14:01:38.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192726+0000", 2024-05-07T14:01:38.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.026e-05 2024-05-07T14:01:38.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192824+0000", 2024-05-07T14:01:38.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8139000000000003e-05 2024-05-07T14:01:38.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192971+0000", 2024-05-07T14:01:38.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014717199999999999 2024-05-07T14:01:38.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:38.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.193232+0000", 2024-05-07T14:01:38.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000260518 2024-05-07T14:01:38.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.196090+0000", 2024-05-07T14:01:38.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002858598 2024-05-07T14:01:38.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197464+0000", 2024-05-07T14:01:38.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001373399 2024-05-07T14:01:38.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197549+0000", 2024-05-07T14:01:38.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5261999999999998e-05 2024-05-07T14:01:38.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197609+0000", 2024-05-07T14:01:38.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0680000000000002e-05 2024-05-07T14:01:38.554 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.554 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.554 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.554 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:472 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.554 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:38.554 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.269019221000001, 2024-05-07T14:01:38.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044650219999999999, 2024-05-07T14:01:38.554 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.554 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 472 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236991+0000", 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8589999999999999e-06 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237001+0000", 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0465999999999999e-05 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237019+0000", 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7666999999999999e-05 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237030+0000", 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0917000000000001e-05 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237184+0000", 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015438499999999999 2024-05-07T14:01:38.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237427+0000", 2024-05-07T14:01:38.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024296499999999999 2024-05-07T14:01:38.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:38.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237900+0000", 2024-05-07T14:01:38.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047292599999999998 2024-05-07T14:01:38.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.239253+0000", 2024-05-07T14:01:38.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013527770000000001 2024-05-07T14:01:38.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241246+0000", 2024-05-07T14:01:38.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019933249999999998 2024-05-07T14:01:38.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241370+0000", 2024-05-07T14:01:38.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012385599999999999 2024-05-07T14:01:38.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241454+0000", 2024-05-07T14:01:38.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3879000000000001e-05 2024-05-07T14:01:38.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.560 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.560 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:501 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.560 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:38.560 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.251788014999999, 2024-05-07T14:01:38.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029689030000000002, 2024-05-07T14:01:38.560 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 501 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:38.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254222+0000", 2024-05-07T14:01:38.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9580000000000001e-06 2024-05-07T14:01:38.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254246+0000", 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3521999999999999e-05 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254271+0000", 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5757000000000001e-05 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254284+0000", 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254423+0000", 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013909 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254745+0000", 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032253700000000002 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.255261+0000", 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051555899999999996 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.256343+0000", 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001081867 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257042+0000", 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069873699999999995 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257128+0000", 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6478999999999997e-05 2024-05-07T14:01:38.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257189+0000", 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0810999999999998e-05 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:509 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.248131083000001, 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003433874, 2024-05-07T14:01:38.566 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.567 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.567 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.567 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.567 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.567 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.567 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 509 2024-05-07T14:01:38.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.567 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:38.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:38.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257878+0000", 2024-05-07T14:01:38.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.528e-06 2024-05-07T14:01:38.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257886+0000", 2024-05-07T14:01:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2180000000000002e-06 2024-05-07T14:01:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257903+0000", 2024-05-07T14:01:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7484999999999999e-05 2024-05-07T14:01:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257912+0000", 2024-05-07T14:01:38.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0189999999999995e-06 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258007+0000", 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4627000000000001e-05 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258124+0000", 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116836 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:38.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258381+0000", 2024-05-07T14:01:38.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025690899999999999 2024-05-07T14:01:38.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.259428+0000", 2024-05-07T14:01:38.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047177 2024-05-07T14:01:38.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261154+0000", 2024-05-07T14:01:38.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017262180000000001 2024-05-07T14:01:38.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261224+0000", 2024-05-07T14:01:38.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9913000000000006e-05 2024-05-07T14:01:38.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261311+0000", 2024-05-07T14:01:38.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6944e-05 2024-05-07T14:01:38.572 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.572 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.572 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:610 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.171576754, 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031518679999999999, 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 610 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:38.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:38.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334434+0000", 2024-05-07T14:01:38.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.34e-06 2024-05-07T14:01:38.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334447+0000", 2024-05-07T14:01:38.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2976000000000001e-05 2024-05-07T14:01:38.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334479+0000", 2024-05-07T14:01:38.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2159999999999997e-05 2024-05-07T14:01:38.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334495+0000", 2024-05-07T14:01:38.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6722999999999999e-05 2024-05-07T14:01:38.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334644+0000", 2024-05-07T14:01:38.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014812500000000001 2024-05-07T14:01:38.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.335017+0000", 2024-05-07T14:01:38.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037323400000000001 2024-05-07T14:01:38.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.335408+0000", 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039102000000000001 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.336518+0000", 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011105620000000001 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337379+0000", 2024-05-07T14:01:38.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086063700000000003 2024-05-07T14:01:38.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337473+0000", 2024-05-07T14:01:38.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4332000000000004e-05 2024-05-07T14:01:38.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337583+0000", 2024-05-07T14:01:38.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-05-07T14:01:38.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.578 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.579 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:625 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.579 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:38.579 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.160711421999999, 2024-05-07T14:01:38.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039276240000000002, 2024-05-07T14:01:38.579 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.579 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.579 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.579 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.579 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.579 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.579 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 625 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345300+0000", 2024-05-07T14:01:38.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.067e-06 2024-05-07T14:01:38.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345315+0000", 2024-05-07T14:01:38.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4857e-05 2024-05-07T14:01:38.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345344+0000", 2024-05-07T14:01:38.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9070000000000001e-05 2024-05-07T14:01:38.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345359+0000", 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5656000000000001e-05 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345512+0000", 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015229600000000001 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345764+0000", 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025252100000000002 2024-05-07T14:01:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:38.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.346269+0000", 2024-05-07T14:01:38.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000504613 2024-05-07T14:01:38.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.347487+0000", 2024-05-07T14:01:38.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001218317 2024-05-07T14:01:38.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349071+0000", 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015844279999999999 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349156+0000", 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4958999999999998e-05 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349224+0000", 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7840000000000001e-05 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.049344526999999, 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031666649999999999, 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 727 2024-05-07T14:01:38.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456665+0000", 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-06 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456675+0000", 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8500000000000006e-06 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456703+0000", 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7846000000000001e-05 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456724+0000", 2024-05-07T14:01:38.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0869999999999998e-05 2024-05-07T14:01:38.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456850+0000", 2024-05-07T14:01:38.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126069 2024-05-07T14:01:38.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.457082+0000", 2024-05-07T14:01:38.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023258099999999999 2024-05-07T14:01:38.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:01:38.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.457439+0000", 2024-05-07T14:01:38.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000356115 2024-05-07T14:01:38.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.458419+0000", 2024-05-07T14:01:38.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00098032799999999993 2024-05-07T14:01:38.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459682+0000", 2024-05-07T14:01:38.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012626339999999999 2024-05-07T14:01:38.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459769+0000", 2024-05-07T14:01:38.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7383e-05 2024-05-07T14:01:38.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459830+0000", 2024-05-07T14:01:38.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1235999999999994e-05 2024-05-07T14:01:38.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.861913174000001, 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029415270000000002, 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.591 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 814 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644097+0000", 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1500000000000002e-06 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644108+0000", 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1182999999999999e-05 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644140+0000", 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2283000000000002e-05 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644166+0000", 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5703000000000001e-05 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644360+0000", 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019352200000000001 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644571+0000", 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000210915 2024-05-07T14:01:38.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644899+0000", 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032880799999999999 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.645976+0000", 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001076458 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.646896+0000", 2024-05-07T14:01:38.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091987999999999998 2024-05-07T14:01:38.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.646975+0000", 2024-05-07T14:01:38.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9165999999999994e-05 2024-05-07T14:01:38.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.647036+0000", 2024-05-07T14:01:38.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1458999999999996e-05 2024-05-07T14:01:38.596 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.596 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.596 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.597 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.597 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:38.597 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.706744287999999, 2024-05-07T14:01:38.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031874479999999998, 2024-05-07T14:01:38.597 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.597 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.597 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.597 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.597 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.597 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.597 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 880 2024-05-07T14:01:38.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.598 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:38.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:38.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799266+0000", 2024-05-07T14:01:38.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.723e-06 2024-05-07T14:01:38.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799280+0000", 2024-05-07T14:01:38.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3159999999999999e-05 2024-05-07T14:01:38.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799311+0000", 2024-05-07T14:01:38.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1083e-05 2024-05-07T14:01:38.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799327+0000", 2024-05-07T14:01:38.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5883e-05 2024-05-07T14:01:38.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799438+0000", 2024-05-07T14:01:38.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011096599999999999 2024-05-07T14:01:38.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799670+0000", 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023280800000000001 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.800012+0000", 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034192800000000002 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.801133+0000", 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011206009999999999 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802179+0000", 2024-05-07T14:01:38.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010458080000000001 2024-05-07T14:01:38.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802341+0000", 2024-05-07T14:01:38.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162533 2024-05-07T14:01:38.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802451+0000", 2024-05-07T14:01:38.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109955 2024-05-07T14:01:38.603 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.603 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.603 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.603 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.603 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:38.603 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.702082481000001, 2024-05-07T14:01:38.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031185649999999998, 2024-05-07T14:01:38.603 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.604 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.604 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.604 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.604 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.604 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.604 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 882 2024-05-07T14:01:38.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.604 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:38.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803928+0000", 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.266e-06 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803939+0000", 2024-05-07T14:01:38.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1372999999999999e-05 2024-05-07T14:01:38.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803972+0000", 2024-05-07T14:01:38.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-05-07T14:01:38.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803987+0000", 2024-05-07T14:01:38.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5126999999999999e-05 2024-05-07T14:01:38.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804111+0000", 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012420199999999999 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804326+0000", 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215262 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804794+0000", 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046816000000000002 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806221+0000", 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014263749999999999 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806759+0000", 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053796200000000001 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806936+0000", 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017753300000000001 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.807044+0000", 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107865 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.603397546, 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029448970000000001, 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:38.609 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:38.610 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:38.610 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:38.610 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:38.610 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:38.610 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 925 2024-05-07T14:01:38.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.610 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:38.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:38.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:38.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902613+0000", 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9999999999999999e-06 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902623+0000", 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0453e-05 2024-05-07T14:01:38.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902653+0000", 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9556e-05 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902670+0000", 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7887e-05 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902785+0000", 2024-05-07T14:01:38.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114295 2024-05-07T14:01:38.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:38.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.903018+0000", 2024-05-07T14:01:38.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023349899999999999 2024-05-07T14:01:38.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:38.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.903329+0000", 2024-05-07T14:01:38.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031125100000000002 2024-05-07T14:01:38.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.904399+0000", 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001069162 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905354+0000", 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095526300000000003 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905441+0000", 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6854999999999994e-05 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:38.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:38.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:38.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905555+0000", 2024-05-07T14:01:38.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114676 2024-05-07T14:01:38.615 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.615 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.615 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.615 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:38.615 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:38.615 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:38.616 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:38.616 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:38.617 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:01:38.618 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:38.627+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:38.619 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:38.620 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:38.638 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:38.639 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:38.655 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:38.656 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:38.674 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:38.674 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:38.692 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:38.692 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:38.710 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:38.710 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:38.718 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:38.727+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:38.728 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:38.728 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:38.788 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:38.789 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:38.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:01:38.847 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:38.859+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:38.920 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:38.931+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:38.968 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:38.969 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:38.982 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:01:39.021 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:39.036+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:39.122 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:39.132+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:39.148 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:39.148 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:39.162 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:01:39.223 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:39.232+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:39.279 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:39.279 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:39.294 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:01:39.324 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:39.336+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:39.387 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:01:39.423 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:39.423 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:39.424 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:39.435+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:39.437 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:01:39.526 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:39.535+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:39.601 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:39.601 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:39.615 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:01:39.659 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:39.671+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:39.728 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:39.739+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:39.782 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:39.783 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:39.797 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:01:39.843 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:39.855+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:39.918 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:39.918 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:39.930 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:39.939+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:39.932 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:01:40.031 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:40.043+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:40.092 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:40.092 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:40.106 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:01:40.134 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:40.143+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:40.234 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:40.235 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:40.235 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:40.247+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:40.248 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:01:40.310 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:01:40.335 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:40.347+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:40.414 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:40.414 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:40.428 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:01:40.436 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:40.447+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:40.537 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:40.547+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:40.547 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:40.547 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:40.561 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:01:40.647 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:40.659+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:40.726 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:40.726 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:40.738 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:40.747+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:40.740 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:01:40.746 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:01:40.839 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:40.851+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:40.918 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:40.919 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:40.930 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:40.931 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:40.932 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:01:40.940 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:40.955+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:40.948 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:40.948 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:40.964 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:40.964 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:40.980 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:40.981 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:41.001 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:41.001 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:41.022 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:41.022 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:41.040 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:41.051+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:41.042 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:41.043 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:41.050 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:41.050 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:41.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:41.050 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:41.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.050 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:01:41.050 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:41.050 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.077565794999998, 2024-05-07T14:01:41.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:01:41.050 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.050 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:01:41.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:01:41.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:01:41.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:01:41.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:01:41.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:01:41.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:01:41.055 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.055 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.055 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.055 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:41.055 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:41.055 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.030399924000001, 2024-05-07T14:01:41.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:01:41.055 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.055 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.055 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.055 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:01:41.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:01:41.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:01:41.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:01:41.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:01:41.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:01:41.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:01:41.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:01:41.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:01:41.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:01:41.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:01:41.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:01:41.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.930072203999998, 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:01:41.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:01:41.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:01:41.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:01:41.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:01:41.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:01:41.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:01:41.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:01:41.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.065 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.066 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:41.066 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.027528146999998, 2024-05-07T14:01:41.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:01:41.066 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.066 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.066 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.066 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.066 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.066 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.066 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:01:41.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.066 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:01:41.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:01:41.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.070 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.071 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.008218179000004, 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:41.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:01:41.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:01:41.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:01:41.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:01:41.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:01:41.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:01:41.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:01:41.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:01:41.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.078 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.078 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:41.078 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.982851269000001, 2024-05-07T14:01:41.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:01:41.078 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.078 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.078 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.078 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.078 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.078 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.078 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:01:41.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.078 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:01:41.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:01:41.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:01:41.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:01:41.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:01:41.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:01:41.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:01:41.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:01:41.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:01:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:01:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:01:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:01:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.963061885000002, 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.084 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:01:41.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:01:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:01:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:01:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:01:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:01:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.089 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:41.090 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.929823524, 2024-05-07T14:01:41.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:01:41.090 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.090 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.090 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.090 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.091 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.091 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.091 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:01:41.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.091 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:41.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:01:41.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:01:41.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:01:41.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:01:41.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:01:41.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:01:41.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:01:41.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:01:41.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.894462503, 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:01:41.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:01:41.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:01:41.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:01:41.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:01:41.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:41.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:01:41.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:01:41.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:01:41.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:01:41.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:01:41.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:01:41.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.869718937000002, 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:01:41.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:01:41.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:01:41.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:01:41.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:01:41.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:01:41.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:01:41.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:01:41.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:01:41.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:01:41.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:01:41.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:01:41.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.108 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.758842534000003, 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:01:41.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:01:41.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:01:41.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:01:41.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:01:41.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:01:41.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:01:41.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:01:41.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:01:41.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:01:41.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:01:41.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:01:41.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:01:41.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:01:41.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:01:41.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:01:41.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:01:41.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:01:41.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:01:41.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:01:41.117 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.117 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.117 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.118 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.118 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:41.118 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.702678585000001, 2024-05-07T14:01:41.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:01:41.118 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.118 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.118 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.119 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.119 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.119 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.119 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:01:41.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.119 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:41.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:01:41.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:01:41.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:01:41.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:01:41.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:01:41.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:01:41.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:01:41.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:01:41.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:01:41.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:01:41.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:01:41.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.686793399999999, 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:01:41.124 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.125 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.125 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.125 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.125 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.125 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.125 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:01:41.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.125 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:41.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:01:41.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:01:41.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:01:41.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:01:41.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:01:41.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:41.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:01:41.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:01:41.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:01:41.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:01:41.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:01:41.130 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.130 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.130 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.130 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.130 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:41.130 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.437427147999998, 2024-05-07T14:01:41.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:01:41.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.376054324999998, 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.136 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.137 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.137 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.137 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.137 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:01:41.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.137 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:41.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:01:41.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:01:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:01:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.180265982999998, 2024-05-07T14:01:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:01:41.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:01:41.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.175962533000003, 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003023937, 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.148 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 918 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:01:41.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886558+0000", 2024-05-07T14:01:41.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1229999999999998e-06 2024-05-07T14:01:41.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886569+0000", 2024-05-07T14:01:41.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1497e-05 2024-05-07T14:01:41.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886600+0000", 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0809999999999998e-05 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886618+0000", 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7799e-05 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886736+0000", 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118276 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886951+0000", 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021467200000000001 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.887437+0000", 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048624900000000001 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.888687+0000", 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012498310000000001 2024-05-07T14:01:41.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889318+0000", 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063122199999999997 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889463+0000", 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144769 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889580+0000", 2024-05-07T14:01:41.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011668899999999999 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.144961809000002, 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.154 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:01:41.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:01:41.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:01:41.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:01:41.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:01:41.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:01:41.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:01:41.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:01:41.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:01:41.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:01:41.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.140076917000002, 2024-05-07T14:01:41.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:01:41.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:01:41.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:01:41.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.108155545999999, 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.167 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:01:41.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:01:41.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:01:41.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:01:41.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:01:41.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:01:41.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:01:41.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:01:41.172 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.172 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.173 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.173 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.173 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.173 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:41.175 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:01:41.175 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:41.176 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:41.176 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:41.187+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:41.275 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:41.287+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:41.343 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:41.344 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:41.358 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:01:41.400 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:41.411+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:41.478 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:41.487+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:41.525 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:41.525 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:41.526 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:41.526 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:41.526 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:41.540 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:01:41.583 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:41.595+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:41.660 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:41.660 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:41.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:41.660 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:41.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.661 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:40 5.8 5:168cc6a2:::zonegroup_info.7881bf19-2c91-49be-82bb-722579314d1c:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:01:41.661 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:41.661 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.629622693999998, 2024-05-07T14:01:41.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002658582, 2024-05-07T14:01:41.661 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.661 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.661 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:01:41.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:01:41.661 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 40 2024-05-07T14:01:41.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.661 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:41.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:41.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042176+0000", 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7719999999999999e-06 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042186+0000", 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0020000000000001e-05 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042209+0000", 2024-05-07T14:01:41.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3224e-05 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042220+0000", 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1153e-05 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042358+0000", 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137389 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042594+0000", 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023630100000000001 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042900+0000", 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030576799999999999 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044463+0000", 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015627130000000001 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044675+0000", 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021186999999999999 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044768+0000", 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3046000000000003e-05 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044833+0000", 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5326000000000004e-05 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.666 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.635067808999999, 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025872120000000002, 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.667 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 52 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036732+0000", 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4980000000000001e-06 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036744+0000", 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2269999999999999e-05 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036772+0000", 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8002000000000001e-05 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036817+0000", 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4608999999999999e-05 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036946+0000", 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012988400000000001 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037184+0000", 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000237178 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037405+0000", 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221418 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.038548+0000", 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011433540000000001 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039179+0000", 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063016999999999999 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039231+0000", 2024-05-07T14:01:41.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2434e-05 2024-05-07T14:01:41.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039316+0000", 2024-05-07T14:01:41.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5395000000000005e-05 2024-05-07T14:01:41.672 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.672 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.672 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.672 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.526485346999998, 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:01:41.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.514066405999998, 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:01:41.678 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:01:41.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:01:41.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:01:41.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.510186683999997, 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.684 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:01:41.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.689 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.379531180999997, 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:01:41.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:01:41.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:41.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:01:41.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:01:41.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:01:41.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:01:41.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:01:41.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:01:41.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.695 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.372363859000004, 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:01:41.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:01:41.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:01:41.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:01:41.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:01:41.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:01:41.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:01:41.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:01:41.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.081831170999997, 2024-05-07T14:01:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:01:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:01:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:01:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:01:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:01:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:01:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:01:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.016749777000001, 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025880500000000002, 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.706 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 819 2024-05-07T14:01:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655049+0000", 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6640000000000001e-06 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655057+0000", 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5639999999999997e-06 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655082+0000", 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4119999999999999e-05 2024-05-07T14:01:41.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655093+0000", 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1598e-05 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655273+0000", 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017975599999999999 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655432+0000", 2024-05-07T14:01:41.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000158682 2024-05-07T14:01:41.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:41.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655720+0000", 2024-05-07T14:01:41.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028791400000000001 2024-05-07T14:01:41.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.656823+0000", 2024-05-07T14:01:41.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001103435 2024-05-07T14:01:41.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657483+0000", 2024-05-07T14:01:41.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000659828 2024-05-07T14:01:41.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657571+0000", 2024-05-07T14:01:41.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7756000000000005e-05 2024-05-07T14:01:41.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657635+0000", 2024-05-07T14:01:41.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4733000000000005e-05 2024-05-07T14:01:41.712 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.712 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.712 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.712 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.712 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:41.712 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.964473544000001, 2024-05-07T14:01:41.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028535079999999998, 2024-05-07T14:01:41.712 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.712 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 841 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707326+0000", 2024-05-07T14:01:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:01:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707338+0000", 2024-05-07T14:01:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2036e-05 2024-05-07T14:01:41.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707367+0000", 2024-05-07T14:01:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8816999999999999e-05 2024-05-07T14:01:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707382+0000", 2024-05-07T14:01:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4912999999999999e-05 2024-05-07T14:01:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707523+0000", 2024-05-07T14:01:41.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014165599999999999 2024-05-07T14:01:41.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707748+0000", 2024-05-07T14:01:41.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000224315 2024-05-07T14:01:41.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:41.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.708055+0000", 2024-05-07T14:01:41.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030739800000000001 2024-05-07T14:01:41.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.709147+0000", 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001091788 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710030+0000", 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088367000000000003 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710114+0000", 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3936000000000004e-05 2024-05-07T14:01:41.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710177+0000", 2024-05-07T14:01:41.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2675999999999994e-05 2024-05-07T14:01:41.718 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.718 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.718 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.718 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.718 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:41.718 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.960807004999999, 2024-05-07T14:01:41.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026153460000000002, 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 843 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710992+0000", 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.666e-06 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711000+0000", 2024-05-07T14:01:41.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.977e-06 2024-05-07T14:01:41.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711020+0000", 2024-05-07T14:01:41.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.033e-05 2024-05-07T14:01:41.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711030+0000", 2024-05-07T14:01:41.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9790000000000005e-06 2024-05-07T14:01:41.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711133+0000", 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102563 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711256+0000", 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012337599999999999 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711555+0000", 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029948699999999997 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.712654+0000", 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001098819 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713451+0000", 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000796424 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713541+0000", 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9981999999999993e-05 2024-05-07T14:01:41.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713605+0000", 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4743e-05 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.951350888999997, 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027995160000000002, 2024-05-07T14:01:41.724 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.725 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.725 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.725 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.725 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.725 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.725 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 847 2024-05-07T14:01:41.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.725 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:41.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720448+0000", 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720460+0000", 2024-05-07T14:01:41.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1157e-05 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720490+0000", 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0960000000000002e-05 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720507+0000", 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6477000000000002e-05 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720681+0000", 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017396800000000001 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720897+0000", 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215775 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.721203+0000", 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030621499999999998 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.722485+0000", 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012818599999999999 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723091+0000", 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060651499999999996 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723182+0000", 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0692999999999994e-05 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723246+0000", 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3643e-05 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.947583539999997, 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.730 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:01:41.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.901870144, 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.736 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:01:41.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.737 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:41.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:41.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:01:41.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:01:41.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:01:41.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:01:41.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:01:41.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:01:41.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:01:41.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:01:41.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:01:41.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:01:41.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:01:41.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:01:41.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:41.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:01:41.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:01:41.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.895593406000003, 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.742 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:01:41.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:01:41.747 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.809080285999997, 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028016680000000002, 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.748 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 907 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862719+0000", 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862733+0000", 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3067e-05 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862763+0000", 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0926000000000002e-05 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862779+0000", 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5787e-05 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862924+0000", 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014509899999999999 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863160+0000", 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000235701 2024-05-07T14:01:41.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863523+0000", 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000362567 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.864872+0000", 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00134954 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865350+0000", 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000478009 2024-05-07T14:01:41.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865437+0000", 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6712999999999995e-05 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865518+0000", 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1493000000000001e-05 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.754 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.754 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:41.754 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.805350998999998, 2024-05-07T14:01:41.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027054290000000001, 2024-05-07T14:01:41.754 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.754 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.754 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.754 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.754 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.754 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.754 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 909 2024-05-07T14:01:41.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.754 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866448+0000", 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:01:41.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866459+0000", 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1207e-05 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866491+0000", 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362999999999998e-05 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866506+0000", 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4790000000000001e-05 2024-05-07T14:01:41.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866632+0000", 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000126422 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866761+0000", 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128832 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.867037+0000", 2024-05-07T14:01:41.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027612200000000001 2024-05-07T14:01:41.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.868118+0000", 2024-05-07T14:01:41.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001080941 2024-05-07T14:01:41.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869004+0000", 2024-05-07T14:01:41.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088632000000000001 2024-05-07T14:01:41.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869081+0000", 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7195999999999997e-05 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869151+0000", 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0066000000000003e-05 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.759 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.710502200000001, 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:01:41.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:01:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.697332846000002, 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027821920000000002, 2024-05-07T14:01:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 955 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974466+0000", 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0999999999999998e-06 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974480+0000", 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3876999999999999e-05 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974510+0000", 2024-05-07T14:01:41.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0273e-05 2024-05-07T14:01:41.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974525+0000", 2024-05-07T14:01:41.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.485e-05 2024-05-07T14:01:41.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974618+0000", 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2359000000000001e-05 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974822+0000", 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000204148 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.975126+0000", 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030382800000000002 2024-05-07T14:01:41.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976565+0000", 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014395160000000001 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976963+0000", 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00039772700000000001 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977128+0000", 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165508 2024-05-07T14:01:41.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977246+0000", 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011800599999999999 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.693417283000002, 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027683989999999999, 2024-05-07T14:01:41.772 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 957 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978382+0000", 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.95e-06 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978393+0000", 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.084e-05 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978424+0000", 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1022999999999998e-05 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978441+0000", 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7782999999999999e-05 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978565+0000", 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012348900000000001 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978794+0000", 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000229335 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.979262+0000", 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046826700000000002 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.980470+0000", 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012071899999999999 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981002+0000", 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053222299999999996 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981086+0000", 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4073000000000006e-05 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981148+0000", 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2225999999999997e-05 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.777 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:41.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:41.778 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:41.779 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:01:41.780 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:41.791+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:41.881 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:41.891+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:41.950 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:41.950 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:41.950 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:41.950 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:41.965 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:01:41.981 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:41.991+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:42.082 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:42.091+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:42.130 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:42.130 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:42.130 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:42.130 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:42.130 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:42.144 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:01:42.188 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:42.199+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:42.285 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:42.295+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:42.311 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:42.311 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:42.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:42.311 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:42.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 40.320939570999997, 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:01:42.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:01:42.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:42.316 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.300535750999998, 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:42.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:01:42.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:01:42.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:01:42.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:01:42.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:01:42.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:01:42.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:01:42.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:01:42.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:01:42.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:01:42.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:01:42.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:01:42.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:42.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:01:42.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:01:42.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:01:42.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:01:42.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.323 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.198286037000003, 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036480649999999998, 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 231 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:42.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:42.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125133+0000", 2024-05-07T14:01:42.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.063e-06 2024-05-07T14:01:42.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125143+0000", 2024-05-07T14:01:42.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9769999999999995e-06 2024-05-07T14:01:42.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125170+0000", 2024-05-07T14:01:42.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7152999999999999e-05 2024-05-07T14:01:42.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125184+0000", 2024-05-07T14:01:42.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4372999999999999e-05 2024-05-07T14:01:42.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125295+0000", 2024-05-07T14:01:42.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111036 2024-05-07T14:01:42.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125510+0000", 2024-05-07T14:01:42.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215102 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125920+0000", 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040954700000000001 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.127419+0000", 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001499261 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128635+0000", 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001215818 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128718+0000", 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3048999999999997e-05 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128779+0000", 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0686000000000001e-05 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.329 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:235 6.0 e33/27 6:013d6c33:gc::gc.30:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.182829015999999, 2024-05-07T14:01:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038113629999999999, 2024-05-07T14:01:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140590+0000", 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140604+0000", 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4324e-05 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140640+0000", 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6009e-05 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140659+0000", 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9340000000000001e-05 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140815+0000", 2024-05-07T14:01:42.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155329 2024-05-07T14:01:42.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140868+0000", 2024-05-07T14:01:42.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3455999999999998e-05 2024-05-07T14:01:42.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144310+0000", 2024-05-07T14:01:42.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034414239999999998 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144399+0000", 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9492000000000003e-05 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:400 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.132407620000002, 2024-05-07T14:01:42.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039416900000000003, 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 400 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:42.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191010+0000", 2024-05-07T14:01:42.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.09e-07 2024-05-07T14:01:42.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191014+0000", 2024-05-07T14:01:42.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999996e-06 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191024+0000", 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0274e-05 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191030+0000", 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.789e-06 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191085+0000", 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4741999999999999e-05 2024-05-07T14:01:42.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191169+0000", 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4532999999999999e-05 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191383+0000", 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021415400000000001 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194408+0000", 2024-05-07T14:01:42.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003024901 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194860+0000", 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045153599999999999 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194915+0000", 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4737999999999997e-05 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194951+0000", 2024-05-07T14:01:42.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6183999999999998e-05 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:403 6.2 e33/27 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.129309939999999, 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003750841, 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194108+0000", 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.051e-06 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194116+0000", 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1149999999999994e-06 2024-05-07T14:01:42.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194128+0000", 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1972e-05 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194135+0000", 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1130000000000003e-06 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194191+0000", 2024-05-07T14:01:42.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194218+0000", 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6242e-05 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197807+0000", 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003589283 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197858+0000", 2024-05-07T14:01:42.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0572999999999998e-05 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:415 6.7 e33/27 6:e622f76a:gc::gc.20:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.121608098000003, 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044669840000000002, 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1799999999999995e-07 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201814+0000", 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4170000000000002e-06 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201824+0000", 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0217999999999999e-05 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201838+0000", 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3723000000000001e-05 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201890+0000", 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2320000000000001e-05 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201906+0000", 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5894999999999999e-05 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206242+0000", 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043366489999999997 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206276+0000", 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:432 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.110362518000002, 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045128019999999998, 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.348 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 432 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213055+0000", 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7000000000000005e-07 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213058+0000", 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0369999999999999e-06 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213066+0000", 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3680000000000002e-06 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213084+0000", 2024-05-07T14:01:42.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7946999999999999e-05 2024-05-07T14:01:42.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213127+0000", 2024-05-07T14:01:42.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2673999999999998e-05 2024-05-07T14:01:42.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213222+0000", 2024-05-07T14:01:42.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5488000000000005e-05 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213412+0000", 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000189307 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.214754+0000", 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001342069 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:42.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217447+0000", 2024-05-07T14:01:42.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026931250000000002 2024-05-07T14:01:42.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217521+0000", 2024-05-07T14:01:42.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3997000000000003e-05 2024-05-07T14:01:42.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217567+0000", 2024-05-07T14:01:42.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6220000000000001e-05 2024-05-07T14:01:42.353 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.353 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:430 6.7 e33/27 6:e1cdb60d:reshard::reshard.0000000008:head v 33'9, mlcod=33'6)", 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.110316034999997, 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043702330000000003, 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:42.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:42.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:42.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0400000000000005e-07 2024-05-07T14:01:42.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213107+0000", 2024-05-07T14:01:42.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5740000000000003e-06 2024-05-07T14:01:42.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213117+0000", 2024-05-07T14:01:42.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8349999999999999e-06 2024-05-07T14:01:42.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213122+0000", 2024-05-07T14:01:42.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5140000000000001e-06 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213169+0000", 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6551000000000002e-05 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213198+0000", 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217415+0000", 2024-05-07T14:01:42.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042171090000000001 2024-05-07T14:01:42.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217471+0000", 2024-05-07T14:01:42.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5766000000000001e-05 2024-05-07T14:01:42.358 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.358 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.358 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.358 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:480 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.358 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:42.358 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.081851880000002, 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052104459999999997, 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 480 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6199999999999997e-07 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241570+0000", 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2479999999999998e-06 2024-05-07T14:01:42.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241580+0000", 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8719999999999997e-06 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241584+0000", 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7210000000000002e-06 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241629+0000", 2024-05-07T14:01:42.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4465000000000002e-05 2024-05-07T14:01:42.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241671+0000", 2024-05-07T14:01:42.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2370999999999998e-05 2024-05-07T14:01:42.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:42.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241772+0000", 2024-05-07T14:01:42.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101048 2024-05-07T14:01:42.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.243876+0000", 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021036789999999998 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246710+0000", 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028339060000000002 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246747+0000", 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7061000000000003e-05 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246775+0000", 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8413000000000001e-05 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:499 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.070971159000003, 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050166450000000001, 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.364 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 499 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4300000000000002e-07 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252451+0000", 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1290000000000004e-06 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252463+0000", 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1238e-05 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252470+0000", 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2019999999999998e-06 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252534+0000", 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4178999999999997e-05 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252706+0000", 2024-05-07T14:01:42.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017197 2024-05-07T14:01:42.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:42.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252871+0000", 2024-05-07T14:01:42.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016508199999999999 2024-05-07T14:01:42.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:42.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254444+0000", 2024-05-07T14:01:42.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001573112 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257407+0000", 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029630989999999999 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257437+0000", 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0009999999999999e-05 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257462+0000", 2024-05-07T14:01:42.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4780999999999999e-05 2024-05-07T14:01:42.370 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.370 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.370 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.370 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:500 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.370 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:42.370 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.070685056000002, 2024-05-07T14:01:42.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046354220000000002, 2024-05-07T14:01:42.370 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.370 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.370 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.370 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.371 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.371 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.371 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 500 2024-05-07T14:01:42.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.371 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:42.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252733+0000", 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9399999999999993e-07 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252738+0000", 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6779999999999997e-06 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252750+0000", 2024-05-07T14:01:42.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1882000000000001e-05 2024-05-07T14:01:42.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252758+0000", 2024-05-07T14:01:42.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0649999999999999e-06 2024-05-07T14:01:42.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252811+0000", 2024-05-07T14:01:42.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2859000000000003e-05 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252870+0000", 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8956000000000003e-05 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252992+0000", 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122275 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254326+0000", 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013334449999999999 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257254+0000", 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029284039999999999 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257316+0000", 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1348999999999998e-05 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257367+0000", 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1514999999999997e-05 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:510 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.064602417000003, 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041639090000000004, 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.376 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 510 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:42.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258815+0000", 2024-05-07T14:01:42.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:01:42.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258819+0000", 2024-05-07T14:01:42.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0090000000000001e-06 2024-05-07T14:01:42.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258828+0000", 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2529999999999993e-06 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258833+0000", 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7219999999999999e-06 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258870+0000", 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6368000000000001e-05 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258915+0000", 2024-05-07T14:01:42.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.528e-05 2024-05-07T14:01:42.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:42.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.259016+0000", 2024-05-07T14:01:42.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010074200000000001 2024-05-07T14:01:42.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.260655+0000", 2024-05-07T14:01:42.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016394999999999999 2024-05-07T14:01:42.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:42.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262752+0000", 2024-05-07T14:01:42.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002096531 2024-05-07T14:01:42.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262871+0000", 2024-05-07T14:01:42.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119645 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262978+0000", 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010695400000000001 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:552 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.032842915000003, 2024-05-07T14:01:42.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042166790000000001, 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 552 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290575+0000", 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.85e-07 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290578+0000", 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999999e-06 2024-05-07T14:01:42.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290587+0000", 2024-05-07T14:01:42.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.268e-06 2024-05-07T14:01:42.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290592+0000", 2024-05-07T14:01:42.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7029999999999997e-06 2024-05-07T14:01:42.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290694+0000", 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101841 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290840+0000", 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014613899999999999 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.291137+0000", 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029714800000000001 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292561+0000", 2024-05-07T14:01:42.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014235020000000001 2024-05-07T14:01:42.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:42.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294568+0000", 2024-05-07T14:01:42.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020076540000000002 2024-05-07T14:01:42.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294692+0000", 2024-05-07T14:01:42.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012394500000000001 2024-05-07T14:01:42.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294790+0000", 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8194000000000002e-05 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:553 6.f e33/27 6:f24cb4a8:gc::gc.31:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.030584056999999, 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043350139999999999, 2024-05-07T14:01:42.389 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.390 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.390 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.390 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:42.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:42.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:42.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2900000000000004e-07 2024-05-07T14:01:42.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292838+0000", 2024-05-07T14:01:42.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5560000000000001e-06 2024-05-07T14:01:42.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292847+0000", 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8619999999999992e-06 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292851+0000", 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9010000000000002e-06 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292922+0000", 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0827000000000005e-05 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292973+0000", 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0492999999999999e-05 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297114+0000", 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041408970000000002 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297168+0000", 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3949000000000001e-05 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.393 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:686 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.920838172000003, 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046254349999999998, 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 686 2024-05-07T14:01:42.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402581+0000", 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402592+0000", 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0984e-05 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402619+0000", 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7583e-05 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402633+0000", 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3553000000000001e-05 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402699+0000", 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6013000000000006e-05 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402792+0000", 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3455999999999994e-05 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:42.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402928+0000", 2024-05-07T14:01:42.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013596800000000001 2024-05-07T14:01:42.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:42.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.403918+0000", 2024-05-07T14:01:42.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00099017000000000007 2024-05-07T14:01:42.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407144+0000", 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032257449999999999 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407180+0000", 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5462e-05 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407204+0000", 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4247999999999999e-05 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.651926594000003, 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003355448, 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 826 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.400 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671493+0000", 2024-05-07T14:01:42.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-06 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671506+0000", 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2746e-05 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671542+0000", 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6162999999999999e-05 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671557+0000", 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4786999999999999e-05 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671705+0000", 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000147792 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671872+0000", 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016705499999999999 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.672101+0000", 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022892999999999999 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.673101+0000", 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001000775 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674701+0000", 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016000599999999999 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674795+0000", 2024-05-07T14:01:42.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3653000000000006e-05 2024-05-07T14:01:42.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674846+0000", 2024-05-07T14:01:42.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0473000000000003e-05 2024-05-07T14:01:42.405 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.405 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.405 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.405 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:868 6.f e33/27 6:f6792a7a:::obj_delete_at_hint.0000000097:head v 33'10, mlcod=33'8)", 2024-05-07T14:01:42.406 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:42.406 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.552522107999998, 2024-05-07T14:01:42.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033639339999999998, 2024-05-07T14:01:42.406 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.406 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.406 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.406 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:42.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:42.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770897+0000", 2024-05-07T14:01:42.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9700000000000002e-06 2024-05-07T14:01:42.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770909+0000", 2024-05-07T14:01:42.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2034e-05 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770937+0000", 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.796e-05 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770954+0000", 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7555999999999999e-05 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771084+0000", 2024-05-07T14:01:42.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013033599999999999 2024-05-07T14:01:42.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771136+0000", 2024-05-07T14:01:42.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1925999999999997e-05 2024-05-07T14:01:42.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774168+0000", 2024-05-07T14:01:42.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030316200000000001 2024-05-07T14:01:42.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774259+0000", 2024-05-07T14:01:42.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0532000000000007e-05 2024-05-07T14:01:42.410 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.410 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.410 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.410 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.488531915000003, 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035607859999999998, 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 895 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:42.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:42.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834888+0000", 2024-05-07T14:01:42.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.41e-06 2024-05-07T14:01:42.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834899+0000", 2024-05-07T14:01:42.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0987e-05 2024-05-07T14:01:42.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834929+0000", 2024-05-07T14:01:42.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9706e-05 2024-05-07T14:01:42.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834943+0000", 2024-05-07T14:01:42.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4354e-05 2024-05-07T14:01:42.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835100+0000", 2024-05-07T14:01:42.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156582 2024-05-07T14:01:42.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835499+0000", 2024-05-07T14:01:42.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000399214 2024-05-07T14:01:42.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.836052+0000", 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00055334500000000001 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.837279+0000", 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012266270000000001 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838177+0000", 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089768699999999999 2024-05-07T14:01:42.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838332+0000", 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155155 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838446+0000", 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113719 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.416 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.481004386000002, 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033546700000000001, 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 898 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842414+0000", 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.863e-06 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842425+0000", 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0533000000000001e-05 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842450+0000", 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5259999999999999e-05 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842463+0000", 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3373000000000001e-05 2024-05-07T14:01:42.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842599+0000", 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013549600000000001 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842936+0000", 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033763400000000001 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.843484+0000", 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054733899999999999 2024-05-07T14:01:42.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.844749+0000", 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012656639999999999 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845499+0000", 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074904400000000003 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845646+0000", 2024-05-07T14:01:42.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014709900000000001 2024-05-07T14:01:42.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:42.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:42.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:42.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845767+0000", 2024-05-07T14:01:42.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121365 2024-05-07T14:01:42.422 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.422 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.422 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.422 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:42.422 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:42.422 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:42.423 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:01:42.424 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:01:42.425 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:42.439+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:42.525 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:42.535+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:42.555 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:42.555 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:42.556 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:42.556 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:42.569 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:01:42.625 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:42.635+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:42.693 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:42.693 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:42.693 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:42.693 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:42.693 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:42.708 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:01:42.751 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:42.763+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:42.827 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:42.839+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:42.880 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:42.880 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:01:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.897582471, 2024-05-07T14:01:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070064749999999999, 2024-05-07T14:01:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:01:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.881 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 43 2024-05-07T14:01:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:42.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994274+0000", 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7170000000000002e-06 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994292+0000", 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7819999999999999e-05 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994338+0000", 2024-05-07T14:01:42.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6625999999999997e-05 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994362+0000", 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4063e-05 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994576+0000", 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021319500000000001 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:01:42.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994598+0000", 2024-05-07T14:01:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2325999999999999e-05 2024-05-07T14:01:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001023+0000", 2024-05-07T14:01:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00642546 2024-05-07T14:01:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001277+0000", 2024-05-07T14:01:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025326800000000002 2024-05-07T14:01:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.885 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:46 7.1f e30/29 7:f95f44c2:::notify.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.869489815000001, 2024-05-07T14:01:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031449519999999999, 2024-05-07T14:01:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.886 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5700000000000002e-07 2024-05-07T14:01:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022371+0000", 2024-05-07T14:01:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7230000000000004e-06 2024-05-07T14:01:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022396+0000", 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4406e-05 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022415+0000", 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9264999999999999e-05 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022641+0000", 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022584100000000001 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022702+0000", 2024-05-07T14:01:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1513999999999994e-05 2024-05-07T14:01:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.025418+0000", 2024-05-07T14:01:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027162290000000001 2024-05-07T14:01:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.025508+0000", 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9216999999999996e-05 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.841953044999997, 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033678110000000001, 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.891 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 211 2024-05-07T14:01:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049903+0000", 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.963e-06 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049917+0000", 2024-05-07T14:01:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-05-07T14:01:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049950+0000", 2024-05-07T14:01:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3328999999999999e-05 2024-05-07T14:01:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049966+0000", 2024-05-07T14:01:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6333000000000001e-05 2024-05-07T14:01:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050100+0000", 2024-05-07T14:01:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013305599999999999 2024-05-07T14:01:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050363+0000", 2024-05-07T14:01:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026392100000000002 2024-05-07T14:01:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050827+0000", 2024-05-07T14:01:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046316 2024-05-07T14:01:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.052269+0000", 2024-05-07T14:01:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014428760000000001 2024-05-07T14:01:42.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053111+0000", 2024-05-07T14:01:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084168999999999997 2024-05-07T14:01:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053198+0000", 2024-05-07T14:01:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6666e-05 2024-05-07T14:01:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053267+0000", 2024-05-07T14:01:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9503000000000002e-05 2024-05-07T14:01:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.898 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.763498349999999, 2024-05-07T14:01:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032702809999999999, 2024-05-07T14:01:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.899 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 232 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128357+0000", 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1530000000000001e-06 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128369+0000", 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1823e-05 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128401+0000", 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128416+0000", 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4997000000000001e-05 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128538+0000", 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121406 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128773+0000", 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235121 2024-05-07T14:01:42.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.129230+0000", 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00045679999999999999 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.130836+0000", 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001606484 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131454+0000", 2024-05-07T14:01:42.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061747199999999999 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131550+0000", 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6636000000000001e-05 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131624+0000", 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4315999999999998e-05 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:265 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.737845997999997, 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029442299999999999, 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 265 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154009+0000", 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.413e-06 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154023+0000", 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4229999999999999e-05 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154062+0000", 2024-05-07T14:01:42.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9223e-05 2024-05-07T14:01:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154085+0000", 2024-05-07T14:01:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2909999999999999e-05 2024-05-07T14:01:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154269+0000", 2024-05-07T14:01:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183232 2024-05-07T14:01:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154422+0000", 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015338799999999999 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154693+0000", 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000271005 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155957+0000", 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001263573 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156590+0000", 2024-05-07T14:01:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00063392600000000004 2024-05-07T14:01:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156844+0000", 2024-05-07T14:01:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025348800000000001 2024-05-07T14:01:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156951+0000", 2024-05-07T14:01:42.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106842 2024-05-07T14:01:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:277 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.735944533000001, 2024-05-07T14:01:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030861830000000002, 2024-05-07T14:01:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.911 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 277 2024-05-07T14:01:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155910+0000", 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155922+0000", 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2082999999999999e-05 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155967+0000", 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4855999999999999e-05 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155986+0000", 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.965e-05 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156173+0000", 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018657299999999999 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156479+0000", 2024-05-07T14:01:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030636299999999998 2024-05-07T14:01:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156975+0000", 2024-05-07T14:01:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00049533699999999999 2024-05-07T14:01:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158291+0000", 2024-05-07T14:01:42.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001316776 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158712+0000", 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042077999999999999 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158885+0000", 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000172786 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158994+0000", 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109239 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:301 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.731921384000003, 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037043950000000001, 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.917 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 301 2024-05-07T14:01:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159933+0000", 2024-05-07T14:01:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6670000000000001e-06 2024-05-07T14:01:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159943+0000", 2024-05-07T14:01:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0176e-05 2024-05-07T14:01:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159965+0000", 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2243e-05 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159980+0000", 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4747e-05 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160332+0000", 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000352004 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160574+0000", 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241838 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.161045+0000", 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000471526 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.162322+0000", 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001276241 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163376+0000", 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010539449999999999 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163516+0000", 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014034599999999999 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163636+0000", 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011966199999999999 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.922 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:376 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.715806104999999, 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038557209999999999, 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 376 2024-05-07T14:01:42.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176049+0000", 2024-05-07T14:01:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:01:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176064+0000", 2024-05-07T14:01:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.451e-05 2024-05-07T14:01:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176101+0000", 2024-05-07T14:01:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000003e-05 2024-05-07T14:01:42.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176126+0000", 2024-05-07T14:01:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-05-07T14:01:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176272+0000", 2024-05-07T14:01:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014592899999999999 2024-05-07T14:01:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176402+0000", 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000129512 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176725+0000", 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032289800000000001 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.177826+0000", 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011017620000000001 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179617+0000", 2024-05-07T14:01:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001791193 2024-05-07T14:01:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179781+0000", 2024-05-07T14:01:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016336899999999999 2024-05-07T14:01:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179902+0000", 2024-05-07T14:01:42.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012131899999999999 2024-05-07T14:01:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:397 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.703309015000002, 2024-05-07T14:01:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034388040000000002, 2024-05-07T14:01:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.929 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 397 2024-05-07T14:01:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188546+0000", 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2000000000000001e-06 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188556+0000", 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0557000000000001e-05 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188590+0000", 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3626e-05 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188625+0000", 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5095999999999997e-05 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188768+0000", 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014279900000000001 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189124+0000", 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035646799999999998 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189633+0000", 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000508903 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.190638+0000", 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001004465 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191712+0000", 2024-05-07T14:01:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001074759 2024-05-07T14:01:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191871+0000", 2024-05-07T14:01:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835900000000001 2024-05-07T14:01:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191982+0000", 2024-05-07T14:01:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011157199999999999 2024-05-07T14:01:42.934 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:403 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.699166237, 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004923172, 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.935 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 403 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192688+0000", 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4640000000000001e-06 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192696+0000", 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9330000000000001e-06 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192715+0000", 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9746999999999999e-05 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192726+0000", 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.026e-05 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192824+0000", 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8139000000000003e-05 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192971+0000", 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014717199999999999 2024-05-07T14:01:42.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.193232+0000", 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000260518 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.196090+0000", 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002858598 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197464+0000", 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001373399 2024-05-07T14:01:42.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197549+0000", 2024-05-07T14:01:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5261999999999998e-05 2024-05-07T14:01:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197609+0000", 2024-05-07T14:01:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0680000000000002e-05 2024-05-07T14:01:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:472 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.654863724000002, 2024-05-07T14:01:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044650219999999999, 2024-05-07T14:01:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.941 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 472 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236991+0000", 2024-05-07T14:01:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8589999999999999e-06 2024-05-07T14:01:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237001+0000", 2024-05-07T14:01:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0465999999999999e-05 2024-05-07T14:01:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237019+0000", 2024-05-07T14:01:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7666999999999999e-05 2024-05-07T14:01:42.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237030+0000", 2024-05-07T14:01:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0917000000000001e-05 2024-05-07T14:01:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237184+0000", 2024-05-07T14:01:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015438499999999999 2024-05-07T14:01:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237427+0000", 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024296499999999999 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237900+0000", 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047292599999999998 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.239253+0000", 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013527770000000001 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241246+0000", 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019933249999999998 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241370+0000", 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012385599999999999 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241454+0000", 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3879000000000001e-05 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.946 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:501 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.637632517999997, 2024-05-07T14:01:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029689030000000002, 2024-05-07T14:01:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.947 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 501 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254222+0000", 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9580000000000001e-06 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254246+0000", 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3521999999999999e-05 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254271+0000", 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5757000000000001e-05 2024-05-07T14:01:42.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254284+0000", 2024-05-07T14:01:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:01:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254423+0000", 2024-05-07T14:01:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013909 2024-05-07T14:01:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254745+0000", 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032253700000000002 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.255261+0000", 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051555899999999996 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.256343+0000", 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001081867 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257042+0000", 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069873699999999995 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257128+0000", 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6478999999999997e-05 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257189+0000", 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0810999999999998e-05 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.952 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:509 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.633975585999998, 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003433874, 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.953 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 509 2024-05-07T14:01:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257878+0000", 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.528e-06 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257886+0000", 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2180000000000002e-06 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257903+0000", 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7484999999999999e-05 2024-05-07T14:01:42.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257912+0000", 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0189999999999995e-06 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258007+0000", 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4627000000000001e-05 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258124+0000", 2024-05-07T14:01:42.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116836 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258381+0000", 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025690899999999999 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.259428+0000", 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047177 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261154+0000", 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017262180000000001 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261224+0000", 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9913000000000006e-05 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261311+0000", 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6944e-05 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.958 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:610 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.557421257000001, 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031518679999999999, 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 610 2024-05-07T14:01:42.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334434+0000", 2024-05-07T14:01:42.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.34e-06 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334447+0000", 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2976000000000001e-05 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334479+0000", 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2159999999999997e-05 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334495+0000", 2024-05-07T14:01:42.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6722999999999999e-05 2024-05-07T14:01:42.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334644+0000", 2024-05-07T14:01:42.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014812500000000001 2024-05-07T14:01:42.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.335017+0000", 2024-05-07T14:01:42.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037323400000000001 2024-05-07T14:01:42.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.335408+0000", 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039102000000000001 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.336518+0000", 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011105620000000001 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337379+0000", 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086063700000000003 2024-05-07T14:01:42.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337473+0000", 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4332000000000004e-05 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337583+0000", 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.964 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:625 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.546555925, 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039276240000000002, 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 625 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345300+0000", 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.067e-06 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345315+0000", 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4857e-05 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345344+0000", 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9070000000000001e-05 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345359+0000", 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5656000000000001e-05 2024-05-07T14:01:42.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345512+0000", 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015229600000000001 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345764+0000", 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025252100000000002 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.346269+0000", 2024-05-07T14:01:42.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000504613 2024-05-07T14:01:42.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.347487+0000", 2024-05-07T14:01:42.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001218317 2024-05-07T14:01:42.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349071+0000", 2024-05-07T14:01:42.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015844279999999999 2024-05-07T14:01:42.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349156+0000", 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4958999999999998e-05 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349224+0000", 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7840000000000001e-05 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.970 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.435189029999997, 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031666649999999999, 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 727 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:42.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:42.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456665+0000", 2024-05-07T14:01:42.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-06 2024-05-07T14:01:42.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456675+0000", 2024-05-07T14:01:42.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8500000000000006e-06 2024-05-07T14:01:42.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456703+0000", 2024-05-07T14:01:42.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7846000000000001e-05 2024-05-07T14:01:42.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456724+0000", 2024-05-07T14:01:42.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0869999999999998e-05 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456850+0000", 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126069 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.457082+0000", 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023258099999999999 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:01:42.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.457439+0000", 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000356115 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.458419+0000", 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00098032799999999993 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459682+0000", 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012626339999999999 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459769+0000", 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7383e-05 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459830+0000", 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1235999999999994e-05 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:42.976 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.247757677000003, 2024-05-07T14:01:42.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029415270000000002, 2024-05-07T14:01:42.977 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.977 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.977 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.977 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.977 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.977 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.977 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 814 2024-05-07T14:01:42.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.977 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644097+0000", 2024-05-07T14:01:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1500000000000002e-06 2024-05-07T14:01:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644108+0000", 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1182999999999999e-05 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644140+0000", 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2283000000000002e-05 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644166+0000", 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5703000000000001e-05 2024-05-07T14:01:42.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644360+0000", 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019352200000000001 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644571+0000", 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000210915 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644899+0000", 2024-05-07T14:01:42.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032880799999999999 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.645976+0000", 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001076458 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.646896+0000", 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091987999999999998 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.646975+0000", 2024-05-07T14:01:42.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9165999999999994e-05 2024-05-07T14:01:42.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.647036+0000", 2024-05-07T14:01:42.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1458999999999996e-05 2024-05-07T14:01:42.982 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.982 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.982 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.982 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.982 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.092588790999997, 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031874479999999998, 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 880 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:42.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799266+0000", 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.723e-06 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799280+0000", 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3159999999999999e-05 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799311+0000", 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1083e-05 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799327+0000", 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5883e-05 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799438+0000", 2024-05-07T14:01:42.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011096599999999999 2024-05-07T14:01:42.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799670+0000", 2024-05-07T14:01:42.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023280800000000001 2024-05-07T14:01:42.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:42.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.800012+0000", 2024-05-07T14:01:42.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034192800000000002 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.801133+0000", 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011206009999999999 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802179+0000", 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010458080000000001 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802341+0000", 2024-05-07T14:01:42.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162533 2024-05-07T14:01:42.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802451+0000", 2024-05-07T14:01:42.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109955 2024-05-07T14:01:42.988 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.988 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.988 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.988 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.988 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:42.988 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.087926983999999, 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031185649999999998, 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 882 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:42.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:42.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803928+0000", 2024-05-07T14:01:42.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.266e-06 2024-05-07T14:01:42.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803939+0000", 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1372999999999999e-05 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803972+0000", 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803987+0000", 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5126999999999999e-05 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804111+0000", 2024-05-07T14:01:42.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012420199999999999 2024-05-07T14:01:42.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804326+0000", 2024-05-07T14:01:42.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215262 2024-05-07T14:01:42.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:42.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804794+0000", 2024-05-07T14:01:42.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046816000000000002 2024-05-07T14:01:42.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:42.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806221+0000", 2024-05-07T14:01:42.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014263749999999999 2024-05-07T14:01:42.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806759+0000", 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053796200000000001 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806936+0000", 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017753300000000001 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.807044+0000", 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107865 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:42.995 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.989242048999998, 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029448970000000001, 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 925 2024-05-07T14:01:42.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.997 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:42.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:42.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:42.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:42.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:42.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:42.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902613+0000", 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9999999999999999e-06 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902623+0000", 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0453e-05 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902653+0000", 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9556e-05 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902670+0000", 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7887e-05 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902785+0000", 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114295 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.903018+0000", 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023349899999999999 2024-05-07T14:01:42.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:43.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:43.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:43.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.903329+0000", 2024-05-07T14:01:43.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031125100000000002 2024-05-07T14:01:43.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:43.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:43.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:43.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.904399+0000", 2024-05-07T14:01:43.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001069162 2024-05-07T14:01:43.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:43.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:43.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:43.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905354+0000", 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095526300000000003 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905441+0000", 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6854999999999994e-05 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905555+0000", 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114676 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:43.001 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:43.002 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:43.002 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:43.003 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:01:43.004 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:43.015+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:43.104 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:43.115+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:43.174 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:43.174 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:43.175 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:43.175 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:43.177 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:01:43.189 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:01:43.227 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:43.239+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:43.306 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:43.315+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:43.332 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:43.333 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:43.335 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:01:43.354 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:43.354 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:43.363 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:43.363 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:43.368 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:01:43.379 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:43.379 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:43.395 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:43.396 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:43.407 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:43.415+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:43.414 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:43.414 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:43.433 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:43.433 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:43.451 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:43.451 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:43.468 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:43.469 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:43.528 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:43.539+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:43.534 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:43.534 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:43.548 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:01:43.609 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:43.619+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:43.665 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:43.679 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:01:43.723 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:43.735+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:43.797 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:43.797 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:43.811 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:01:43.811 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:43.823+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:43.911 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:43.923+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:43.983 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:43.983 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:43.999 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:01:44.043 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:44.055+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:44.113 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:44.123+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:44.166 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:44.166 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:44.180 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:01:44.214 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:44.223+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:44.297 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:44.297 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:44.313 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:01:44.314 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:44.323+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:44.416 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:44.427+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:44.432 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:44.432 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:44.445 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:01:44.517 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:44.527+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:44.578 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:44.578 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:44.592 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:01:44.618 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:44.627+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:44.711 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:44.711 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:44.719 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:44.731+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:44.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:01:44.820 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:44.831+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:44.846 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:44.847 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:44.861 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:01:44.948 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:44.959+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:45.022 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:45.031+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:45.027 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:45.027 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:45.041 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:01:45.127 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:45.139+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:45.210 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:45.210 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:45.223 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:45.235+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:45.224 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:01:45.324 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:45.335+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:45.363 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:01:45.394 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:45.394 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:45.409 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:01:45.424 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:45.435+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:45.487 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:01:45.525 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:45.535+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:45.586 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:45.586 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:45.600 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:01:45.626 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:45.635+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:45.650 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:45.650 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:45.680 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:45.680 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:45.697 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:45.697 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:45.718 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:45.718 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:45.719 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:45.719 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:45.719 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:45.726 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:45.726 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:45.726 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:45.735+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:45.732 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:01:45.747 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:45.747 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:45.768 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:45.768 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:45.788 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:45.788 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:45.809 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:45.809 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:45.863 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:45.863 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:45.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:45.863 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:45.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.864 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:40 5.8 5:168cc6a2:::zonegroup_info.7881bf19-2c91-49be-82bb-722579314d1c:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:01:45.864 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:45.864 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.833865742999997, 2024-05-07T14:01:45.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002658582, 2024-05-07T14:01:45.864 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.864 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.864 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.864 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.864 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:01:45.865 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:01:45.865 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 40 2024-05-07T14:01:45.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.865 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:45.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:01:45.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042176+0000", 2024-05-07T14:01:45.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7719999999999999e-06 2024-05-07T14:01:45.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042186+0000", 2024-05-07T14:01:45.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0020000000000001e-05 2024-05-07T14:01:45.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042209+0000", 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3224e-05 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042220+0000", 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1153e-05 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042358+0000", 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137389 2024-05-07T14:01:45.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042594+0000", 2024-05-07T14:01:45.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023630100000000001 2024-05-07T14:01:45.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:45.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042900+0000", 2024-05-07T14:01:45.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030576799999999999 2024-05-07T14:01:45.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044463+0000", 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015627130000000001 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044675+0000", 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021186999999999999 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044768+0000", 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3046000000000003e-05 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044833+0000", 2024-05-07T14:01:45.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5326000000000004e-05 2024-05-07T14:01:45.870 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.870 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.870 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.870 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:45.870 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:45.870 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.839310857999997, 2024-05-07T14:01:45.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025872120000000002, 2024-05-07T14:01:45.870 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 52 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036732+0000", 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4980000000000001e-06 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036744+0000", 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2269999999999999e-05 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036772+0000", 2024-05-07T14:01:45.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8002000000000001e-05 2024-05-07T14:01:45.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036817+0000", 2024-05-07T14:01:45.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4608999999999999e-05 2024-05-07T14:01:45.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036946+0000", 2024-05-07T14:01:45.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012988400000000001 2024-05-07T14:01:45.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037184+0000", 2024-05-07T14:01:45.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000237178 2024-05-07T14:01:45.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:45.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037405+0000", 2024-05-07T14:01:45.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221418 2024-05-07T14:01:45.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.038548+0000", 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011433540000000001 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039179+0000", 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063016999999999999 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039231+0000", 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2434e-05 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039316+0000", 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5395000000000005e-05 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.730728396000003, 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.876 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:01:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:01:45.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:01:45.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:01:45.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:01:45.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:01:45.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:01:45.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:01:45.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:01:45.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:01:45.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:01:45.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:01:45.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:01:45.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:01:45.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:01:45.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:01:45.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:01:45.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:01:45.882 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.882 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.882 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.882 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.882 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:45.882 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.718309454999996, 2024-05-07T14:01:45.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:01:45.882 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:01:45.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:01:45.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:01:45.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:01:45.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:01:45.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:01:45.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:01:45.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:01:45.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:01:45.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:01:45.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:01:45.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:01:45.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:01:45.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:45.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:01:45.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:01:45.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:01:45.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:01:45.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:01:45.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:01:45.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:01:45.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:01:45.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:01:45.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:01:45.888 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.888 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.888 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.714429733000003, 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:45.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:01:45.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:01:45.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:01:45.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:01:45.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:01:45.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:01:45.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:01:45.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:01:45.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:01:45.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:01:45.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:01:45.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:01:45.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:01:45.894 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.894 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.894 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.583774230000003, 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.895 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:01:45.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:01:45.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:01:45.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:01:45.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:01:45.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:01:45.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.900 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.576606908000002, 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:45.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:01:45.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:01:45.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:01:45.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:01:45.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.286074220000003, 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.906 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:45.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:01:45.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:01:45.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:01:45.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:01:45.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:01:45.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:01:45.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:01:45.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:01:45.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:01:45.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:01:45.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:01:45.910 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.910 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.220992826, 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025880500000000002, 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.911 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 819 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655049+0000", 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6640000000000001e-06 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655057+0000", 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5639999999999997e-06 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655082+0000", 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4119999999999999e-05 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655093+0000", 2024-05-07T14:01:45.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1598e-05 2024-05-07T14:01:45.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655273+0000", 2024-05-07T14:01:45.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017975599999999999 2024-05-07T14:01:45.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655432+0000", 2024-05-07T14:01:45.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000158682 2024-05-07T14:01:45.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:45.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655720+0000", 2024-05-07T14:01:45.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028791400000000001 2024-05-07T14:01:45.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.656823+0000", 2024-05-07T14:01:45.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001103435 2024-05-07T14:01:45.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657483+0000", 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000659828 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657571+0000", 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7756000000000005e-05 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657635+0000", 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4733000000000005e-05 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.916 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.168716592999999, 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028535079999999998, 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 841 2024-05-07T14:01:45.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.918 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:45.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:01:45.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707326+0000", 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707338+0000", 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2036e-05 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707367+0000", 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8816999999999999e-05 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707382+0000", 2024-05-07T14:01:45.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4912999999999999e-05 2024-05-07T14:01:45.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707523+0000", 2024-05-07T14:01:45.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014165599999999999 2024-05-07T14:01:45.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707748+0000", 2024-05-07T14:01:45.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000224315 2024-05-07T14:01:45.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:45.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.708055+0000", 2024-05-07T14:01:45.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030739800000000001 2024-05-07T14:01:45.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.709147+0000", 2024-05-07T14:01:45.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001091788 2024-05-07T14:01:45.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710030+0000", 2024-05-07T14:01:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088367000000000003 2024-05-07T14:01:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710114+0000", 2024-05-07T14:01:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3936000000000004e-05 2024-05-07T14:01:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710177+0000", 2024-05-07T14:01:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2675999999999994e-05 2024-05-07T14:01:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.165050053999998, 2024-05-07T14:01:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026153460000000002, 2024-05-07T14:01:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 843 2024-05-07T14:01:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710992+0000", 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.666e-06 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711000+0000", 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.977e-06 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711020+0000", 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.033e-05 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711030+0000", 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9790000000000005e-06 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711133+0000", 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102563 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711256+0000", 2024-05-07T14:01:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012337599999999999 2024-05-07T14:01:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711555+0000", 2024-05-07T14:01:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029948699999999997 2024-05-07T14:01:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.712654+0000", 2024-05-07T14:01:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001098819 2024-05-07T14:01:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713451+0000", 2024-05-07T14:01:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000796424 2024-05-07T14:01:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713541+0000", 2024-05-07T14:01:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9981999999999993e-05 2024-05-07T14:01:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713605+0000", 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4743e-05 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.155593938000003, 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027995160000000002, 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 847 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720448+0000", 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720460+0000", 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1157e-05 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720490+0000", 2024-05-07T14:01:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0960000000000002e-05 2024-05-07T14:01:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720507+0000", 2024-05-07T14:01:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6477000000000002e-05 2024-05-07T14:01:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720681+0000", 2024-05-07T14:01:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017396800000000001 2024-05-07T14:01:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720897+0000", 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215775 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.721203+0000", 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030621499999999998 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.722485+0000", 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012818599999999999 2024-05-07T14:01:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723091+0000", 2024-05-07T14:01:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060651499999999996 2024-05-07T14:01:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723182+0000", 2024-05-07T14:01:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0692999999999994e-05 2024-05-07T14:01:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723246+0000", 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3643e-05 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.151826589000002, 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:01:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:01:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:01:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:01:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:01:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:01:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:01:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:01:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:01:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:01:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:01:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:01:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:01:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:01:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:01:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:01:45.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:01:45.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:01:45.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:01:45.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:01:45.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:01:45.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:01:45.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:01:45.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.941 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.941 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.941 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:45.941 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.106113192999999, 2024-05-07T14:01:45.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:01:45.942 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.942 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.942 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.942 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.942 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.942 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.942 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:01:45.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.942 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:45.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:01:45.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:01:45.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:01:45.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:01:45.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:01:45.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:01:45.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:01:45.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:01:45.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:01:45.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:45.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:01:45.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:01:45.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:01:45.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:01:45.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:01:45.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:01:45.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.947 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.099836455000002, 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:45.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:01:45.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:01:45.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:01:45.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:01:45.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:01:45.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:01:45.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:01:45.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:01:45.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:45.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.953 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:45.954 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.013323335000003, 2024-05-07T14:01:45.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028016680000000002, 2024-05-07T14:01:45.954 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.954 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.954 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.954 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.954 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.954 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.954 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 907 2024-05-07T14:01:45.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.954 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862719+0000", 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862733+0000", 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3067e-05 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862763+0000", 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0926000000000002e-05 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862779+0000", 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5787e-05 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862924+0000", 2024-05-07T14:01:45.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014509899999999999 2024-05-07T14:01:45.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863160+0000", 2024-05-07T14:01:45.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000235701 2024-05-07T14:01:45.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:45.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863523+0000", 2024-05-07T14:01:45.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000362567 2024-05-07T14:01:45.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.864872+0000", 2024-05-07T14:01:45.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00134954 2024-05-07T14:01:45.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865350+0000", 2024-05-07T14:01:45.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000478009 2024-05-07T14:01:45.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865437+0000", 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6712999999999995e-05 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865518+0000", 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1493000000000001e-05 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.959 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.960 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:45.960 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.009594047999997, 2024-05-07T14:01:45.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027054290000000001, 2024-05-07T14:01:45.960 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.960 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.960 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.960 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.960 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.960 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.960 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 909 2024-05-07T14:01:45.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.960 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:45.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:01:45.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866448+0000", 2024-05-07T14:01:45.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:01:45.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866459+0000", 2024-05-07T14:01:45.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1207e-05 2024-05-07T14:01:45.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866491+0000", 2024-05-07T14:01:45.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362999999999998e-05 2024-05-07T14:01:45.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866506+0000", 2024-05-07T14:01:45.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4790000000000001e-05 2024-05-07T14:01:45.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866632+0000", 2024-05-07T14:01:45.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000126422 2024-05-07T14:01:45.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866761+0000", 2024-05-07T14:01:45.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128832 2024-05-07T14:01:45.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.867037+0000", 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027612200000000001 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.868118+0000", 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001080941 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869004+0000", 2024-05-07T14:01:45.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088632000000000001 2024-05-07T14:01:45.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869081+0000", 2024-05-07T14:01:45.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7195999999999997e-05 2024-05-07T14:01:45.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869151+0000", 2024-05-07T14:01:45.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0066000000000003e-05 2024-05-07T14:01:45.965 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.965 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.965 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.966 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.966 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:45.966 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.914745248999999, 2024-05-07T14:01:45.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:01:45.966 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.966 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.966 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.966 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.966 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.966 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.966 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:01:45.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:45.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:01:45.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:01:45.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:01:45.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:01:45.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.971 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.901575895000001, 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027821920000000002, 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 955 2024-05-07T14:01:45.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974466+0000", 2024-05-07T14:01:45.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0999999999999998e-06 2024-05-07T14:01:45.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974480+0000", 2024-05-07T14:01:45.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3876999999999999e-05 2024-05-07T14:01:45.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974510+0000", 2024-05-07T14:01:45.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0273e-05 2024-05-07T14:01:45.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974525+0000", 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.485e-05 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974618+0000", 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2359000000000001e-05 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974822+0000", 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000204148 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.975126+0000", 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030382800000000002 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976565+0000", 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014395160000000001 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976963+0000", 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00039772700000000001 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977128+0000", 2024-05-07T14:01:45.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165508 2024-05-07T14:01:45.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977246+0000", 2024-05-07T14:01:45.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011800599999999999 2024-05-07T14:01:45.977 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.977 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.977 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.978 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:45.978 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:45.978 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.897660332000001, 2024-05-07T14:01:45.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027683989999999999, 2024-05-07T14:01:45.978 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:45.978 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:45.978 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:45.978 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:45.978 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:45.978 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:45.978 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 957 2024-05-07T14:01:45.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:45.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978382+0000", 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.95e-06 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978393+0000", 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.084e-05 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978424+0000", 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1022999999999998e-05 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:45.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978441+0000", 2024-05-07T14:01:45.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7782999999999999e-05 2024-05-07T14:01:45.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:45.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978565+0000", 2024-05-07T14:01:45.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012348900000000001 2024-05-07T14:01:45.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:45.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978794+0000", 2024-05-07T14:01:45.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000229335 2024-05-07T14:01:45.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:45.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.979262+0000", 2024-05-07T14:01:45.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046826700000000002 2024-05-07T14:01:45.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:45.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.980470+0000", 2024-05-07T14:01:45.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012071899999999999 2024-05-07T14:01:45.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:45.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981002+0000", 2024-05-07T14:01:45.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053222299999999996 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981086+0000", 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4073000000000006e-05 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981148+0000", 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2225999999999997e-05 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.983 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:45.984 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:45.984 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:45.984 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:45.871+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:45.985 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:01:46.028 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:46.039+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:46.088 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:46.099+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:46.152 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:46.152 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:46.165 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:01:46.189 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:46.203+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:46.289 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:46.299+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:46.331 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:46.331 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:46.331 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:46.331 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:46.331 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:46.342 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:01:46.348 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:01:46.391 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:46.403+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:46.493 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:46.503+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:46.525 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:46.526 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:46.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:46.526 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:46.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.526 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:01:46.526 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:46.526 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 44.535053695999999, 2024-05-07T14:01:46.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:01:46.526 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.526 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.526 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:01:46.526 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.527 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.527 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.527 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:01:46.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.527 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:46.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:46.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:01:46.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:01:46.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:01:46.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:01:46.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:01:46.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:01:46.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:01:46.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:01:46.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:01:46.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:01:46.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:01:46.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:01:46.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:01:46.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:01:46.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:01:46.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.514649876, 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.531 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.532 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:46.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:01:46.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:01:46.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:01:46.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:01:46.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.534 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.534 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:01:46.534 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:01:46.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.534 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.534 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:01:46.534 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:01:46.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.534 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.534 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:01:46.534 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:01:46.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:01:46.535 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:01:46.535 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:01:46.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.535 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:01:46.535 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:01:46.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.537 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.538 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.538 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:46.538 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:46.538 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.412400161999997, 2024-05-07T14:01:46.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036480649999999998, 2024-05-07T14:01:46.538 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.538 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.538 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.538 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.538 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.538 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 231 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.539 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125133+0000", 2024-05-07T14:01:46.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.063e-06 2024-05-07T14:01:46.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125143+0000", 2024-05-07T14:01:46.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9769999999999995e-06 2024-05-07T14:01:46.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125170+0000", 2024-05-07T14:01:46.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7152999999999999e-05 2024-05-07T14:01:46.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125184+0000", 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4372999999999999e-05 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125295+0000", 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111036 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125510+0000", 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215102 2024-05-07T14:01:46.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:46.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125920+0000", 2024-05-07T14:01:46.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040954700000000001 2024-05-07T14:01:46.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:46.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.127419+0000", 2024-05-07T14:01:46.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001499261 2024-05-07T14:01:46.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:46.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128635+0000", 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001215818 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128718+0000", 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3048999999999997e-05 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128779+0000", 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0686000000000001e-05 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.543 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.544 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:235 6.0 e33/27 6:013d6c33:gc::gc.30:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:46.544 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:46.544 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.396943141000001, 2024-05-07T14:01:46.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038113629999999999, 2024-05-07T14:01:46.544 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.544 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.544 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.544 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.544 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:46.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:46.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140590+0000", 2024-05-07T14:01:46.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:01:46.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140604+0000", 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4324e-05 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140640+0000", 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6009e-05 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140659+0000", 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9340000000000001e-05 2024-05-07T14:01:46.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140815+0000", 2024-05-07T14:01:46.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155329 2024-05-07T14:01:46.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140868+0000", 2024-05-07T14:01:46.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3455999999999998e-05 2024-05-07T14:01:46.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144310+0000", 2024-05-07T14:01:46.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034414239999999998 2024-05-07T14:01:46.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.548 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.548 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144399+0000", 2024-05-07T14:01:46.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9492000000000003e-05 2024-05-07T14:01:46.548 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.548 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.548 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.548 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:400 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:46.548 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.346521744999997, 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039416900000000003, 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 400 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:46.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:46.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191010+0000", 2024-05-07T14:01:46.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.09e-07 2024-05-07T14:01:46.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191014+0000", 2024-05-07T14:01:46.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999996e-06 2024-05-07T14:01:46.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191024+0000", 2024-05-07T14:01:46.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0274e-05 2024-05-07T14:01:46.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191030+0000", 2024-05-07T14:01:46.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.789e-06 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191085+0000", 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4741999999999999e-05 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191169+0000", 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4532999999999999e-05 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191383+0000", 2024-05-07T14:01:46.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021415400000000001 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194408+0000", 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003024901 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194860+0000", 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045153599999999999 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194915+0000", 2024-05-07T14:01:46.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4737999999999997e-05 2024-05-07T14:01:46.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.554 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.554 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194951+0000", 2024-05-07T14:01:46.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6183999999999998e-05 2024-05-07T14:01:46.554 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.554 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.554 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.554 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:403 6.2 e33/27 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:46.554 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:46.554 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.343424065000001, 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003750841, 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:46.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194108+0000", 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.051e-06 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194116+0000", 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1149999999999994e-06 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194128+0000", 2024-05-07T14:01:46.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1972e-05 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194135+0000", 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1130000000000003e-06 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194191+0000", 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194218+0000", 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6242e-05 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197807+0000", 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003589283 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197858+0000", 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0572999999999998e-05 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.558 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:415 6.7 e33/27 6:e622f76a:gc::gc.20:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.335722222999998, 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044669840000000002, 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:46.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1799999999999995e-07 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201814+0000", 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4170000000000002e-06 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201824+0000", 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0217999999999999e-05 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201838+0000", 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3723000000000001e-05 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201890+0000", 2024-05-07T14:01:46.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2320000000000001e-05 2024-05-07T14:01:46.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201906+0000", 2024-05-07T14:01:46.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5894999999999999e-05 2024-05-07T14:01:46.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206242+0000", 2024-05-07T14:01:46.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043366489999999997 2024-05-07T14:01:46.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206276+0000", 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:432 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.324476642999997, 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045128019999999998, 2024-05-07T14:01:46.563 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.564 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.564 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.564 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.564 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.564 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.564 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 432 2024-05-07T14:01:46.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.564 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:46.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213055+0000", 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7000000000000005e-07 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213058+0000", 2024-05-07T14:01:46.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0369999999999999e-06 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213066+0000", 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3680000000000002e-06 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213084+0000", 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7946999999999999e-05 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213127+0000", 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2673999999999998e-05 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213222+0000", 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5488000000000005e-05 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213412+0000", 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000189307 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:46.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.214754+0000", 2024-05-07T14:01:46.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001342069 2024-05-07T14:01:46.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:46.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217447+0000", 2024-05-07T14:01:46.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026931250000000002 2024-05-07T14:01:46.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217521+0000", 2024-05-07T14:01:46.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3997000000000003e-05 2024-05-07T14:01:46.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217567+0000", 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6220000000000001e-05 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:430 6.7 e33/27 6:e1cdb60d:reshard::reshard.0000000008:head v 33'9, mlcod=33'6)", 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.324430159999999, 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043702330000000003, 2024-05-07T14:01:46.569 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.570 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.570 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.570 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:46.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:46.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0400000000000005e-07 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213107+0000", 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5740000000000003e-06 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213117+0000", 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8349999999999999e-06 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213122+0000", 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5140000000000001e-06 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213169+0000", 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6551000000000002e-05 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213198+0000", 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217415+0000", 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042171090000000001 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217471+0000", 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5766000000000001e-05 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.573 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.574 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:480 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:46.574 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:46.574 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.295966004999997, 2024-05-07T14:01:46.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052104459999999997, 2024-05-07T14:01:46.574 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.574 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.574 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.574 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.574 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.574 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.574 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 480 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6199999999999997e-07 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241570+0000", 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2479999999999998e-06 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241580+0000", 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8719999999999997e-06 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241584+0000", 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7210000000000002e-06 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241629+0000", 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4465000000000002e-05 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241671+0000", 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2370999999999998e-05 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241772+0000", 2024-05-07T14:01:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101048 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.243876+0000", 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021036789999999998 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246710+0000", 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028339060000000002 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246747+0000", 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7061000000000003e-05 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246775+0000", 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8413000000000001e-05 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:499 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.285085283999997, 2024-05-07T14:01:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050166450000000001, 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 499 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4300000000000002e-07 2024-05-07T14:01:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252451+0000", 2024-05-07T14:01:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1290000000000004e-06 2024-05-07T14:01:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252463+0000", 2024-05-07T14:01:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1238e-05 2024-05-07T14:01:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252470+0000", 2024-05-07T14:01:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2019999999999998e-06 2024-05-07T14:01:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252534+0000", 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4178999999999997e-05 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252706+0000", 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017197 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252871+0000", 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016508199999999999 2024-05-07T14:01:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254444+0000", 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001573112 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257407+0000", 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029630989999999999 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257437+0000", 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0009999999999999e-05 2024-05-07T14:01:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257462+0000", 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4780999999999999e-05 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:500 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.284799180999997, 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046354220000000002, 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 500 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252733+0000", 2024-05-07T14:01:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9399999999999993e-07 2024-05-07T14:01:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252738+0000", 2024-05-07T14:01:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6779999999999997e-06 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252750+0000", 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1882000000000001e-05 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252758+0000", 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0649999999999999e-06 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252811+0000", 2024-05-07T14:01:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2859000000000003e-05 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252870+0000", 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8956000000000003e-05 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252992+0000", 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122275 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254326+0000", 2024-05-07T14:01:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013334449999999999 2024-05-07T14:01:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257254+0000", 2024-05-07T14:01:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029284039999999999 2024-05-07T14:01:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257316+0000", 2024-05-07T14:01:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1348999999999998e-05 2024-05-07T14:01:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257367+0000", 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1514999999999997e-05 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:510 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.278716541999998, 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041639090000000004, 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 510 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258815+0000", 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258819+0000", 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0090000000000001e-06 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258828+0000", 2024-05-07T14:01:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2529999999999993e-06 2024-05-07T14:01:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258833+0000", 2024-05-07T14:01:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7219999999999999e-06 2024-05-07T14:01:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258870+0000", 2024-05-07T14:01:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6368000000000001e-05 2024-05-07T14:01:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258915+0000", 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.528e-05 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.259016+0000", 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010074200000000001 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.260655+0000", 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016394999999999999 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262752+0000", 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002096531 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262871+0000", 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119645 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262978+0000", 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010695400000000001 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:552 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.246957039999998, 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042166790000000001, 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 552 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290575+0000", 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.85e-07 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290578+0000", 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999999e-06 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290587+0000", 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.268e-06 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290592+0000", 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7029999999999997e-06 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290694+0000", 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101841 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290840+0000", 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014613899999999999 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.291137+0000", 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029714800000000001 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292561+0000", 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014235020000000001 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294568+0000", 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020076540000000002 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294692+0000", 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012394500000000001 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294790+0000", 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8194000000000002e-05 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:553 6.f e33/27 6:f24cb4a8:gc::gc.31:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.244698182, 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043350139999999999, 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.602 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2900000000000004e-07 2024-05-07T14:01:46.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292838+0000", 2024-05-07T14:01:46.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5560000000000001e-06 2024-05-07T14:01:46.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292847+0000", 2024-05-07T14:01:46.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8619999999999992e-06 2024-05-07T14:01:46.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292851+0000", 2024-05-07T14:01:46.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9010000000000002e-06 2024-05-07T14:01:46.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292922+0000", 2024-05-07T14:01:46.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0827000000000005e-05 2024-05-07T14:01:46.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292973+0000", 2024-05-07T14:01:46.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0492999999999999e-05 2024-05-07T14:01:46.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297114+0000", 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041408970000000002 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297168+0000", 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3949000000000001e-05 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.606 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:686 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.134952296999998, 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046254349999999998, 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 686 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402581+0000", 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402592+0000", 2024-05-07T14:01:46.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0984e-05 2024-05-07T14:01:46.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402619+0000", 2024-05-07T14:01:46.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7583e-05 2024-05-07T14:01:46.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402633+0000", 2024-05-07T14:01:46.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3553000000000001e-05 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402699+0000", 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6013000000000006e-05 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402792+0000", 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3455999999999994e-05 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:46.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402928+0000", 2024-05-07T14:01:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013596800000000001 2024-05-07T14:01:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.403918+0000", 2024-05-07T14:01:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00099017000000000007 2024-05-07T14:01:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407144+0000", 2024-05-07T14:01:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032257449999999999 2024-05-07T14:01:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407180+0000", 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5462e-05 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407204+0000", 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4247999999999999e-05 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:46.612 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.866040718999997, 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003355448, 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 826 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:46.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:46.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671493+0000", 2024-05-07T14:01:46.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-06 2024-05-07T14:01:46.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671506+0000", 2024-05-07T14:01:46.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2746e-05 2024-05-07T14:01:46.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671542+0000", 2024-05-07T14:01:46.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6162999999999999e-05 2024-05-07T14:01:46.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671557+0000", 2024-05-07T14:01:46.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4786999999999999e-05 2024-05-07T14:01:46.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671705+0000", 2024-05-07T14:01:46.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000147792 2024-05-07T14:01:46.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671872+0000", 2024-05-07T14:01:46.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016705499999999999 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.672101+0000", 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022892999999999999 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.673101+0000", 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001000775 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674701+0000", 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016000599999999999 2024-05-07T14:01:46.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674795+0000", 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3653000000000006e-05 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674846+0000", 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0473000000000003e-05 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:868 6.f e33/27 6:f6792a7a:::obj_delete_at_hint.0000000097:head v 33'10, mlcod=33'8)", 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.766636233, 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033639339999999998, 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770897+0000", 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9700000000000002e-06 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770909+0000", 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2034e-05 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770937+0000", 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.796e-05 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770954+0000", 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7555999999999999e-05 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771084+0000", 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013033599999999999 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771136+0000", 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1925999999999997e-05 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774168+0000", 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030316200000000001 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774259+0000", 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0532000000000007e-05 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.622 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.702646039999998, 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035607859999999998, 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.623 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 895 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834888+0000", 2024-05-07T14:01:46.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.41e-06 2024-05-07T14:01:46.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834899+0000", 2024-05-07T14:01:46.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0987e-05 2024-05-07T14:01:46.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834929+0000", 2024-05-07T14:01:46.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9706e-05 2024-05-07T14:01:46.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834943+0000", 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4354e-05 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835100+0000", 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156582 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835499+0000", 2024-05-07T14:01:46.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000399214 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.836052+0000", 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00055334500000000001 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.837279+0000", 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012266270000000001 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838177+0000", 2024-05-07T14:01:46.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089768699999999999 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838332+0000", 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155155 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838446+0000", 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113719 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.695118510999997, 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033546700000000001, 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 898 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:46.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:46.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:46.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:46.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:46.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:46.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842414+0000", 2024-05-07T14:01:46.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.863e-06 2024-05-07T14:01:46.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842425+0000", 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0533000000000001e-05 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842450+0000", 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5259999999999999e-05 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842463+0000", 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3373000000000001e-05 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842599+0000", 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013549600000000001 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842936+0000", 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033763400000000001 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.843484+0000", 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054733899999999999 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.844749+0000", 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012656639999999999 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845499+0000", 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074904400000000003 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845646+0000", 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014709900000000001 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:46.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:46.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:46.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845767+0000", 2024-05-07T14:01:46.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121365 2024-05-07T14:01:46.634 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.634 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.634 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.634 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:46.634 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:46.634 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:46.636 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:01:46.636 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:46.651+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:46.737 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:46.747+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:46.767 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:46.767 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:46.767 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:46.767 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:46.781 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:01:46.837 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:46.847+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:46.903 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:46.904 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:46.904 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:46.904 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:46.904 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:46.918 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:01:46.939 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:46.951+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:47.040 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:47.051+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:47.045 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:47.046 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:47.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:47.046 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:47.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.046 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:01:47.046 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:47.046 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.062521474999997, 2024-05-07T14:01:47.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070064749999999999, 2024-05-07T14:01:47.046 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.046 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.046 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:01:47.046 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 43 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:47.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994274+0000", 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7170000000000002e-06 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994292+0000", 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7819999999999999e-05 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994338+0000", 2024-05-07T14:01:47.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6625999999999997e-05 2024-05-07T14:01:47.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994362+0000", 2024-05-07T14:01:47.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4063e-05 2024-05-07T14:01:47.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994576+0000", 2024-05-07T14:01:47.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021319500000000001 2024-05-07T14:01:47.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994598+0000", 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2325999999999999e-05 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001023+0000", 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00642546 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001277+0000", 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025326800000000002 2024-05-07T14:01:47.050 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:46 7.1f e30/29 7:f95f44c2:::notify.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.034428818999999, 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031449519999999999, 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5700000000000002e-07 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022371+0000", 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7230000000000004e-06 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022396+0000", 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4406e-05 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022415+0000", 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9264999999999999e-05 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022641+0000", 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022584100000000001 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022702+0000", 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1513999999999994e-05 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.025418+0000", 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027162290000000001 2024-05-07T14:01:47.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.025508+0000", 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9216999999999996e-05 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.006892049000001, 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033678110000000001, 2024-05-07T14:01:47.055 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 211 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049903+0000", 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.963e-06 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049917+0000", 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049950+0000", 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3328999999999999e-05 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049966+0000", 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6333000000000001e-05 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050100+0000", 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013305599999999999 2024-05-07T14:01:47.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050363+0000", 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026392100000000002 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050827+0000", 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046316 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.052269+0000", 2024-05-07T14:01:47.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014428760000000001 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053111+0000", 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084168999999999997 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053198+0000", 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6666e-05 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053267+0000", 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9503000000000002e-05 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.928437354000003, 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032702809999999999, 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.061 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 232 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:47.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128357+0000", 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1530000000000001e-06 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128369+0000", 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1823e-05 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128401+0000", 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128416+0000", 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4997000000000001e-05 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128538+0000", 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121406 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128773+0000", 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235121 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.129230+0000", 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00045679999999999999 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.130836+0000", 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001606484 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131454+0000", 2024-05-07T14:01:47.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061747199999999999 2024-05-07T14:01:47.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131550+0000", 2024-05-07T14:01:47.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6636000000000001e-05 2024-05-07T14:01:47.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131624+0000", 2024-05-07T14:01:47.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4315999999999998e-05 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:265 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.902785002000002, 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029442299999999999, 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.067 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.068 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 265 2024-05-07T14:01:47.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.068 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:47.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:47.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154009+0000", 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.413e-06 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154023+0000", 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4229999999999999e-05 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154062+0000", 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9223e-05 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154085+0000", 2024-05-07T14:01:47.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2909999999999999e-05 2024-05-07T14:01:47.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154269+0000", 2024-05-07T14:01:47.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183232 2024-05-07T14:01:47.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154422+0000", 2024-05-07T14:01:47.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015338799999999999 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154693+0000", 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000271005 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155957+0000", 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001263573 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156590+0000", 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00063392600000000004 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156844+0000", 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025348800000000001 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156951+0000", 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106842 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:277 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.900883536999999, 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030861830000000002, 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 277 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.073 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155910+0000", 2024-05-07T14:01:47.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155922+0000", 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2082999999999999e-05 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155967+0000", 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4855999999999999e-05 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155986+0000", 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.965e-05 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156173+0000", 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018657299999999999 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156479+0000", 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030636299999999998 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156975+0000", 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00049533699999999999 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158291+0000", 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001316776 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158712+0000", 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042077999999999999 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158885+0000", 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000172786 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158994+0000", 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109239 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:301 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:47.078 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.896860388, 2024-05-07T14:01:47.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037043950000000001, 2024-05-07T14:01:47.082 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.082 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.082 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.082 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.082 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.082 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.082 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 301 2024-05-07T14:01:47.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159933+0000", 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6670000000000001e-06 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159943+0000", 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0176e-05 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159965+0000", 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2243e-05 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159980+0000", 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4747e-05 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160332+0000", 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000352004 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160574+0000", 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241838 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.161045+0000", 2024-05-07T14:01:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000471526 2024-05-07T14:01:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.162322+0000", 2024-05-07T14:01:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001276241 2024-05-07T14:01:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163376+0000", 2024-05-07T14:01:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010539449999999999 2024-05-07T14:01:47.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163516+0000", 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014034599999999999 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163636+0000", 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011966199999999999 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:376 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.880745109000003, 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038557209999999999, 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 376 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176049+0000", 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176064+0000", 2024-05-07T14:01:47.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.451e-05 2024-05-07T14:01:47.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176101+0000", 2024-05-07T14:01:47.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000003e-05 2024-05-07T14:01:47.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176126+0000", 2024-05-07T14:01:47.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176272+0000", 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014592899999999999 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176402+0000", 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000129512 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:47.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176725+0000", 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032289800000000001 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.177826+0000", 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011017620000000001 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179617+0000", 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001791193 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179781+0000", 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016336899999999999 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179902+0000", 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012131899999999999 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:397 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:47.093 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.868248018999999, 2024-05-07T14:01:47.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034388040000000002, 2024-05-07T14:01:47.094 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.094 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.094 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.094 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.094 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.094 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.094 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 397 2024-05-07T14:01:47.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.094 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188546+0000", 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2000000000000001e-06 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188556+0000", 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0557000000000001e-05 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188590+0000", 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3626e-05 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188625+0000", 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5095999999999997e-05 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188768+0000", 2024-05-07T14:01:47.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014279900000000001 2024-05-07T14:01:47.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189124+0000", 2024-05-07T14:01:47.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035646799999999998 2024-05-07T14:01:47.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:47.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189633+0000", 2024-05-07T14:01:47.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000508903 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.190638+0000", 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001004465 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191712+0000", 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001074759 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191871+0000", 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835900000000001 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191982+0000", 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011157199999999999 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:403 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:47.099 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.864105240999997, 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004923172, 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 403 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:47.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192688+0000", 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4640000000000001e-06 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192696+0000", 2024-05-07T14:01:47.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9330000000000001e-06 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192715+0000", 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9746999999999999e-05 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192726+0000", 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.026e-05 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192824+0000", 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8139000000000003e-05 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192971+0000", 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014717199999999999 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.193232+0000", 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000260518 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.196090+0000", 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002858598 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197464+0000", 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001373399 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197549+0000", 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5261999999999998e-05 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197609+0000", 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0680000000000002e-05 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:472 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.819802727999999, 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044650219999999999, 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.105 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.106 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.106 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.106 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.106 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 472 2024-05-07T14:01:47.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.106 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:47.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236991+0000", 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8589999999999999e-06 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237001+0000", 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0465999999999999e-05 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237019+0000", 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7666999999999999e-05 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237030+0000", 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0917000000000001e-05 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237184+0000", 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015438499999999999 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237427+0000", 2024-05-07T14:01:47.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024296499999999999 2024-05-07T14:01:47.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:47.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237900+0000", 2024-05-07T14:01:47.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047292599999999998 2024-05-07T14:01:47.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.239253+0000", 2024-05-07T14:01:47.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013527770000000001 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241246+0000", 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019933249999999998 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241370+0000", 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012385599999999999 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241454+0000", 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3879000000000001e-05 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:501 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.802571522000001, 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029689030000000002, 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.111 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 501 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254222+0000", 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9580000000000001e-06 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254246+0000", 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3521999999999999e-05 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254271+0000", 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5757000000000001e-05 2024-05-07T14:01:47.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254284+0000", 2024-05-07T14:01:47.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:01:47.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254423+0000", 2024-05-07T14:01:47.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013909 2024-05-07T14:01:47.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254745+0000", 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032253700000000002 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.255261+0000", 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051555899999999996 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.256343+0000", 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001081867 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257042+0000", 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069873699999999995 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257128+0000", 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6478999999999997e-05 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257189+0000", 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0810999999999998e-05 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:509 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.798914590000003, 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003433874, 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 509 2024-05-07T14:01:47.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.118 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:47.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:47.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257878+0000", 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.528e-06 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257886+0000", 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2180000000000002e-06 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257903+0000", 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7484999999999999e-05 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257912+0000", 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0189999999999995e-06 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258007+0000", 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4627000000000001e-05 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258124+0000", 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116836 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258381+0000", 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025690899999999999 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.259428+0000", 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047177 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261154+0000", 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017262180000000001 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261224+0000", 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9913000000000006e-05 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261311+0000", 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6944e-05 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.122 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:610 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.123 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:47.123 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.722360260999999, 2024-05-07T14:01:47.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031518679999999999, 2024-05-07T14:01:47.123 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.123 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.123 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 610 2024-05-07T14:01:47.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.123 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334434+0000", 2024-05-07T14:01:47.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.34e-06 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334447+0000", 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2976000000000001e-05 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334479+0000", 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2159999999999997e-05 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334495+0000", 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6722999999999999e-05 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334644+0000", 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014812500000000001 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.335017+0000", 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037323400000000001 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.335408+0000", 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039102000000000001 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.336518+0000", 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011105620000000001 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337379+0000", 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086063700000000003 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337473+0000", 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4332000000000004e-05 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337583+0000", 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:625 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.128 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.711494928999997, 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039276240000000002, 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 625 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345300+0000", 2024-05-07T14:01:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.067e-06 2024-05-07T14:01:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345315+0000", 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4857e-05 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345344+0000", 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9070000000000001e-05 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345359+0000", 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5656000000000001e-05 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345512+0000", 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015229600000000001 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345764+0000", 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025252100000000002 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.346269+0000", 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000504613 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.347487+0000", 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001218317 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349071+0000", 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015844279999999999 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349156+0000", 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4958999999999998e-05 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349224+0000", 2024-05-07T14:01:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7840000000000001e-05 2024-05-07T14:01:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.600128034000001, 2024-05-07T14:01:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031666649999999999, 2024-05-07T14:01:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 727 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456665+0000", 2024-05-07T14:01:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-06 2024-05-07T14:01:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456675+0000", 2024-05-07T14:01:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8500000000000006e-06 2024-05-07T14:01:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456703+0000", 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7846000000000001e-05 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456724+0000", 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0869999999999998e-05 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456850+0000", 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126069 2024-05-07T14:01:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.457082+0000", 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023258099999999999 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.457439+0000", 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000356115 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.458419+0000", 2024-05-07T14:01:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00098032799999999993 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459682+0000", 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012626339999999999 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459769+0000", 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7383e-05 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459830+0000", 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1235999999999994e-05 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.412696681, 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029415270000000002, 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 814 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644097+0000", 2024-05-07T14:01:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1500000000000002e-06 2024-05-07T14:01:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644108+0000", 2024-05-07T14:01:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1182999999999999e-05 2024-05-07T14:01:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644140+0000", 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2283000000000002e-05 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644166+0000", 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5703000000000001e-05 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644360+0000", 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019352200000000001 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644571+0000", 2024-05-07T14:01:47.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000210915 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644899+0000", 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032880799999999999 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.645976+0000", 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001076458 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.646896+0000", 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091987999999999998 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.646975+0000", 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9165999999999994e-05 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.647036+0000", 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1458999999999996e-05 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.145 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.146 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.146 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:47.146 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.257527795000001, 2024-05-07T14:01:47.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031874479999999998, 2024-05-07T14:01:47.146 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.146 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.146 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.146 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.146 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.146 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.146 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 880 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799266+0000", 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.723e-06 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799280+0000", 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3159999999999999e-05 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799311+0000", 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1083e-05 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799327+0000", 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5883e-05 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799438+0000", 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011096599999999999 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799670+0000", 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023280800000000001 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.800012+0000", 2024-05-07T14:01:47.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034192800000000002 2024-05-07T14:01:47.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.801133+0000", 2024-05-07T14:01:47.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011206009999999999 2024-05-07T14:01:47.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802179+0000", 2024-05-07T14:01:47.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010458080000000001 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802341+0000", 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162533 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802451+0000", 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109955 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.252865988000003, 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031185649999999998, 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 882 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803928+0000", 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.266e-06 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803939+0000", 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1372999999999999e-05 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803972+0000", 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803987+0000", 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5126999999999999e-05 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804111+0000", 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012420199999999999 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804326+0000", 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215262 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804794+0000", 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046816000000000002 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806221+0000", 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014263749999999999 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806759+0000", 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053796200000000001 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806936+0000", 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017753300000000001 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.807044+0000", 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107865 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.154181053000002, 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029448970000000001, 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.157 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 925 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902613+0000", 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9999999999999999e-06 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902623+0000", 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0453e-05 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902653+0000", 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9556e-05 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902670+0000", 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7887e-05 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902785+0000", 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114295 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.903018+0000", 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023349899999999999 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.903329+0000", 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031125100000000002 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.904399+0000", 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001069162 2024-05-07T14:01:47.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905354+0000", 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095526300000000003 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905441+0000", 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6854999999999994e-05 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905555+0000", 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114676 2024-05-07T14:01:47.162 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.163 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.163 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.163 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.163 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.163 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:47.164 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:01:47.165 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:47.175+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:47.265 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:47.275+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:47.333 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:47.333 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:47.333 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:47.347 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:01:47.391 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:47.403+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:47.467 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:47.479+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:47.516 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:47.517 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:47.517 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:47.517 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:47.517 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:47.531 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:01:47.567 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:47.579+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:47.668 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:47.683+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:47.699 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:47.699 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:47.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:47.700 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:47.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.700 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:47.700 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:01:47.700 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.685840497000001, 2024-05-07T14:01:47.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033108180000000001, 2024-05-07T14:01:47.700 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.700 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.701 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.701 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.701 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 48 2024-05-07T14:01:47.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.701 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:01:47.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:01:47.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026898+0000", 2024-05-07T14:01:47.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2369999999999999e-06 2024-05-07T14:01:47.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026908+0000", 2024-05-07T14:01:47.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8109999999999997e-06 2024-05-07T14:01:47.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026934+0000", 2024-05-07T14:01:47.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6746000000000001e-05 2024-05-07T14:01:47.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026949+0000", 2024-05-07T14:01:47.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4517e-05 2024-05-07T14:01:47.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027084+0000", 2024-05-07T14:01:47.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013501499999999999 2024-05-07T14:01:47.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027360+0000", 2024-05-07T14:01:47.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027639199999999998 2024-05-07T14:01:47.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027616+0000", 2024-05-07T14:01:47.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025541799999999999 2024-05-07T14:01:47.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.028902+0000", 2024-05-07T14:01:47.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012859989999999999 2024-05-07T14:01:47.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030044+0000", 2024-05-07T14:01:47.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001142295 2024-05-07T14:01:47.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030136+0000", 2024-05-07T14:01:47.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1794999999999998e-05 2024-05-07T14:01:47.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030206+0000", 2024-05-07T14:01:47.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0593000000000007e-05 2024-05-07T14:01:47.708 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.708 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.708 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.708 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:01:47.708 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:01:47.708 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.700366588000001, 2024-05-07T14:01:47.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058205720000000004, 2024-05-07T14:01:47.709 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.709 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.709 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.709 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.709 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.709 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.709 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 205 2024-05-07T14:01:47.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.709 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:01:47.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:01:47.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012373+0000", 2024-05-07T14:01:47.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.07e-06 2024-05-07T14:01:47.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012397+0000", 2024-05-07T14:01:47.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3697e-05 2024-05-07T14:01:47.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012450+0000", 2024-05-07T14:01:47.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2539e-05 2024-05-07T14:01:47.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012477+0000", 2024-05-07T14:01:47.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7457000000000002e-05 2024-05-07T14:01:47.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012735+0000", 2024-05-07T14:01:47.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025820800000000001 2024-05-07T14:01:47.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013057+0000", 2024-05-07T14:01:47.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000321727 2024-05-07T14:01:47.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013752+0000", 2024-05-07T14:01:47.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069509499999999996 2024-05-07T14:01:47.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.017093+0000", 2024-05-07T14:01:47.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033404340000000002 2024-05-07T14:01:47.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018024+0000", 2024-05-07T14:01:47.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00093108600000000002 2024-05-07T14:01:47.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018113+0000", 2024-05-07T14:01:47.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9752000000000004e-05 2024-05-07T14:01:47.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018190+0000", 2024-05-07T14:01:47.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6507000000000005e-05 2024-05-07T14:01:47.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.715 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.716 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.716 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:01:47.716 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.630115600000003, 2024-05-07T14:01:47.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052341489999999996, 2024-05-07T14:01:47.716 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.716 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.716 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.716 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.716 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.716 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.716 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 220 2024-05-07T14:01:47.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.717 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:01:47.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:01:47.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082623+0000", 2024-05-07T14:01:47.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8370000000000001e-06 2024-05-07T14:01:47.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082636+0000", 2024-05-07T14:01:47.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2316e-05 2024-05-07T14:01:47.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082667+0000", 2024-05-07T14:01:47.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1139999999999997e-05 2024-05-07T14:01:47.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082681+0000", 2024-05-07T14:01:47.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4816e-05 2024-05-07T14:01:47.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082825+0000", 2024-05-07T14:01:47.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014377899999999999 2024-05-07T14:01:47.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083051+0000", 2024-05-07T14:01:47.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022549500000000001 2024-05-07T14:01:47.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:47.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083453+0000", 2024-05-07T14:01:47.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000401944 2024-05-07T14:01:47.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.085929+0000", 2024-05-07T14:01:47.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024763369999999999 2024-05-07T14:01:47.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087649+0000", 2024-05-07T14:01:47.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001719747 2024-05-07T14:01:47.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087735+0000", 2024-05-07T14:01:47.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6415999999999994e-05 2024-05-07T14:01:47.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087855+0000", 2024-05-07T14:01:47.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011932199999999999 2024-05-07T14:01:47.722 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.722 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.722 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.722 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.722 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:01:47.723 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.617695869000002, 2024-05-07T14:01:47.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00342407, 2024-05-07T14:01:47.723 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.723 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.723 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.723 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.723 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.723 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.723 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 223 2024-05-07T14:01:47.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.723 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:01:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:01:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095042+0000", 2024-05-07T14:01:47.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1799999999999999e-06 2024-05-07T14:01:47.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095054+0000", 2024-05-07T14:01:47.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1817000000000001e-05 2024-05-07T14:01:47.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095084+0000", 2024-05-07T14:01:47.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0018999999999998e-05 2024-05-07T14:01:47.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095099+0000", 2024-05-07T14:01:47.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.537e-05 2024-05-07T14:01:47.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095209+0000", 2024-05-07T14:01:47.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010943299999999999 2024-05-07T14:01:47.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095457+0000", 2024-05-07T14:01:47.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247941 2024-05-07T14:01:47.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095879+0000", 2024-05-07T14:01:47.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042171299999999999 2024-05-07T14:01:47.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.097290+0000", 2024-05-07T14:01:47.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014118519999999999 2024-05-07T14:01:47.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098196+0000", 2024-05-07T14:01:47.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00090603700000000005 2024-05-07T14:01:47.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098348+0000", 2024-05-07T14:01:47.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151879 2024-05-07T14:01:47.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098464+0000", 2024-05-07T14:01:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011582900000000001 2024-05-07T14:01:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:01:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.610155667999997, 2024-05-07T14:01:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031839889999999999, 2024-05-07T14:01:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.730 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.730 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.730 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.730 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.730 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.730 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 225 2024-05-07T14:01:47.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.730 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:01:47.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:01:47.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102582+0000", 2024-05-07T14:01:47.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:01:47.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102594+0000", 2024-05-07T14:01:47.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1382999999999999e-05 2024-05-07T14:01:47.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102625+0000", 2024-05-07T14:01:47.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0880000000000002e-05 2024-05-07T14:01:47.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102640+0000", 2024-05-07T14:01:47.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4949999999999999e-05 2024-05-07T14:01:47.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102756+0000", 2024-05-07T14:01:47.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116072 2024-05-07T14:01:47.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102998+0000", 2024-05-07T14:01:47.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024203199999999999 2024-05-07T14:01:47.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:47.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.103438+0000", 2024-05-07T14:01:47.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044011700000000001 2024-05-07T14:01:47.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105252+0000", 2024-05-07T14:01:47.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018136490000000001 2024-05-07T14:01:47.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105608+0000", 2024-05-07T14:01:47.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035604000000000001 2024-05-07T14:01:47.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105699+0000", 2024-05-07T14:01:47.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1316999999999993e-05 2024-05-07T14:01:47.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105764+0000", 2024-05-07T14:01:47.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5371999999999997e-05 2024-05-07T14:01:47.735 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.735 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.736 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.736 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.736 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:01:47.736 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.606679321000001, 2024-05-07T14:01:47.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003090256, 2024-05-07T14:01:47.736 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.736 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.736 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.736 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.736 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.736 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.737 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 226 2024-05-07T14:01:47.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.737 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:01:47.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:01:47.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106059+0000", 2024-05-07T14:01:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3e-06 2024-05-07T14:01:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106070+0000", 2024-05-07T14:01:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1257000000000001e-05 2024-05-07T14:01:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106101+0000", 2024-05-07T14:01:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0783e-05 2024-05-07T14:01:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106116+0000", 2024-05-07T14:01:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5136e-05 2024-05-07T14:01:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106217+0000", 2024-05-07T14:01:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101183 2024-05-07T14:01:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106433+0000", 2024-05-07T14:01:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021523199999999999 2024-05-07T14:01:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106826+0000", 2024-05-07T14:01:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039372000000000002 2024-05-07T14:01:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.108406+0000", 2024-05-07T14:01:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001579815 2024-05-07T14:01:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.108987+0000", 2024-05-07T14:01:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058058100000000004 2024-05-07T14:01:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.109073+0000", 2024-05-07T14:01:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6650000000000006e-05 2024-05-07T14:01:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.109147+0000", 2024-05-07T14:01:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3598999999999998e-05 2024-05-07T14:01:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:01:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.577226918000001, 2024-05-07T14:01:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030980790000000001, 2024-05-07T14:01:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 234 2024-05-07T14:01:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:01:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:01:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135511+0000", 2024-05-07T14:01:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4030000000000001e-06 2024-05-07T14:01:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135523+0000", 2024-05-07T14:01:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1559999999999999e-05 2024-05-07T14:01:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135557+0000", 2024-05-07T14:01:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4372999999999998e-05 2024-05-07T14:01:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135572+0000", 2024-05-07T14:01:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4647000000000001e-05 2024-05-07T14:01:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135674+0000", 2024-05-07T14:01:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101932 2024-05-07T14:01:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135888+0000", 2024-05-07T14:01:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000213995 2024-05-07T14:01:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.136311+0000", 2024-05-07T14:01:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042278999999999998 2024-05-07T14:01:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.137726+0000", 2024-05-07T14:01:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001415319 2024-05-07T14:01:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138450+0000", 2024-05-07T14:01:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00072404800000000003 2024-05-07T14:01:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138543+0000", 2024-05-07T14:01:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2559000000000006e-05 2024-05-07T14:01:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138607+0000", 2024-05-07T14:01:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4453000000000001e-05 2024-05-07T14:01:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:01:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.558176895999999, 2024-05-07T14:01:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035934819999999998, 2024-05-07T14:01:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.751 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.751 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.751 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.751 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.751 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.751 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 271 2024-05-07T14:01:47.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.751 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:01:47.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:01:47.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154562+0000", 2024-05-07T14:01:47.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-05-07T14:01:47.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154578+0000", 2024-05-07T14:01:47.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6667000000000002e-05 2024-05-07T14:01:47.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154612+0000", 2024-05-07T14:01:47.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3120000000000001e-05 2024-05-07T14:01:47.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154632+0000", 2024-05-07T14:01:47.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0769999999999999e-05 2024-05-07T14:01:47.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154774+0000", 2024-05-07T14:01:47.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141805 2024-05-07T14:01:47.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155004+0000", 2024-05-07T14:01:47.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022938200000000001 2024-05-07T14:01:47.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:47.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155372+0000", 2024-05-07T14:01:47.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036889300000000002 2024-05-07T14:01:47.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156948+0000", 2024-05-07T14:01:47.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015755750000000001 2024-05-07T14:01:47.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.157903+0000", 2024-05-07T14:01:47.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095453499999999995 2024-05-07T14:01:47.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158050+0000", 2024-05-07T14:01:47.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147279 2024-05-07T14:01:47.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158153+0000", 2024-05-07T14:01:47.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102729 2024-05-07T14:01:47.756 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.757 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.757 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:402 6.4 e33/27 6:24c8e1ae:gc::gc.19:head v 33'8, mlcod=33'6)", 2024-05-07T14:01:47.757 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:01:47.757 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.520104762000003, 2024-05-07T14:01:47.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032167609999999998, 2024-05-07T14:01:47.757 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.757 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.757 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.757 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:01:47.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:01:47.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192633+0000", 2024-05-07T14:01:47.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6759999999999999e-06 2024-05-07T14:01:47.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192645+0000", 2024-05-07T14:01:47.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2037e-05 2024-05-07T14:01:47.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192669+0000", 2024-05-07T14:01:47.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3723e-05 2024-05-07T14:01:47.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192683+0000", 2024-05-07T14:01:47.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4416000000000001e-05 2024-05-07T14:01:47.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192792+0000", 2024-05-07T14:01:47.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109029 2024-05-07T14:01:47.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192848+0000", 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5674000000000003e-05 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.195758+0000", 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029099199999999999 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.195848+0000", 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0285999999999996e-05 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.761 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.762 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:415 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.762 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:01:47.762 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.512398535000003, 2024-05-07T14:01:47.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065364059999999998, 2024-05-07T14:01:47.762 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.762 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.762 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.762 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.762 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.762 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 415 2024-05-07T14:01:47.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.763 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:01:47.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:01:47.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200339+0000", 2024-05-07T14:01:47.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.826e-06 2024-05-07T14:01:47.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200348+0000", 2024-05-07T14:01:47.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0669999999999998e-06 2024-05-07T14:01:47.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200378+0000", 2024-05-07T14:01:47.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.968e-05 2024-05-07T14:01:47.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200393+0000", 2024-05-07T14:01:47.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5109999999999999e-05 2024-05-07T14:01:47.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200515+0000", 2024-05-07T14:01:47.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121449 2024-05-07T14:01:47.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200658+0000", 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014362199999999999 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200958+0000", 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030029699999999999 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202106+0000", 2024-05-07T14:01:47.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011475050000000001 2024-05-07T14:01:47.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206707+0000", 2024-05-07T14:01:47.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046009980000000002 2024-05-07T14:01:47.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206791+0000", 2024-05-07T14:01:47.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4118999999999999e-05 2024-05-07T14:01:47.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206874+0000", 2024-05-07T14:01:47.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2732999999999995e-05 2024-05-07T14:01:47.768 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.768 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.768 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.768 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:417 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.768 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:01:47.768 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.509900444000003, 2024-05-07T14:01:47.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034776160000000002, 2024-05-07T14:01:47.768 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.769 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.769 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.769 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.769 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.769 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.769 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 417 2024-05-07T14:01:47.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.769 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:01:47.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:01:47.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202838+0000", 2024-05-07T14:01:47.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3760000000000002e-06 2024-05-07T14:01:47.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202872+0000", 2024-05-07T14:01:47.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4379999999999999e-05 2024-05-07T14:01:47.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202900+0000", 2024-05-07T14:01:47.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8180000000000001e-05 2024-05-07T14:01:47.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202915+0000", 2024-05-07T14:01:47.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.486e-05 2024-05-07T14:01:47.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203063+0000", 2024-05-07T14:01:47.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014788799999999999 2024-05-07T14:01:47.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203423+0000", 2024-05-07T14:01:47.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035942400000000001 2024-05-07T14:01:47.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:47.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.204005+0000", 2024-05-07T14:01:47.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058227599999999995 2024-05-07T14:01:47.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205280+0000", 2024-05-07T14:01:47.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012753 2024-05-07T14:01:47.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206135+0000", 2024-05-07T14:01:47.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00085444999999999998 2024-05-07T14:01:47.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206234+0000", 2024-05-07T14:01:47.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9088999999999999e-05 2024-05-07T14:01:47.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206313+0000", 2024-05-07T14:01:47.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9393000000000004e-05 2024-05-07T14:01:47.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.775 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.775 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:420 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.775 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:01:47.775 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.507564025999997, 2024-05-07T14:01:47.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042372210000000002, 2024-05-07T14:01:47.775 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.775 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.775 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.775 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.776 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.776 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.776 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 420 2024-05-07T14:01:47.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.776 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:01:47.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:01:47.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205174+0000", 2024-05-07T14:01:47.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1100000000000001e-06 2024-05-07T14:01:47.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205186+0000", 2024-05-07T14:01:47.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.169e-05 2024-05-07T14:01:47.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205218+0000", 2024-05-07T14:01:47.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2617000000000003e-05 2024-05-07T14:01:47.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205240+0000", 2024-05-07T14:01:47.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1331999999999998e-05 2024-05-07T14:01:47.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205356+0000", 2024-05-07T14:01:47.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011655 2024-05-07T14:01:47.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205623+0000", 2024-05-07T14:01:47.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026669399999999999 2024-05-07T14:01:47.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:47.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206029+0000", 2024-05-07T14:01:47.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040652 2024-05-07T14:01:47.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.208187+0000", 2024-05-07T14:01:47.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021578439999999999 2024-05-07T14:01:47.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209226+0000", 2024-05-07T14:01:47.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001039058 2024-05-07T14:01:47.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209305+0000", 2024-05-07T14:01:47.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8650000000000001e-05 2024-05-07T14:01:47.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209409+0000", 2024-05-07T14:01:47.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104156 2024-05-07T14:01:47.781 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.781 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.781 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.782 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:429 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.782 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:01:47.782 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.502532985000002, 2024-05-07T14:01:47.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040139620000000003, 2024-05-07T14:01:47.782 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.782 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.782 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.782 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.782 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.782 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.782 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 429 2024-05-07T14:01:47.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.783 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:01:47.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:01:47.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210205+0000", 2024-05-07T14:01:47.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.66e-06 2024-05-07T14:01:47.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210228+0000", 2024-05-07T14:01:47.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-05-07T14:01:47.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210244+0000", 2024-05-07T14:01:47.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6339999999999999e-05 2024-05-07T14:01:47.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210256+0000", 2024-05-07T14:01:47.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1949e-05 2024-05-07T14:01:47.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210472+0000", 2024-05-07T14:01:47.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215529 2024-05-07T14:01:47.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210681+0000", 2024-05-07T14:01:47.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000208982 2024-05-07T14:01:47.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:47.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211154+0000", 2024-05-07T14:01:47.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047321599999999999 2024-05-07T14:01:47.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212660+0000", 2024-05-07T14:01:47.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001506098 2024-05-07T14:01:47.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214071+0000", 2024-05-07T14:01:47.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014107429999999999 2024-05-07T14:01:47.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214153+0000", 2024-05-07T14:01:47.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1889000000000002e-05 2024-05-07T14:01:47.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214217+0000", 2024-05-07T14:01:47.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4336000000000002e-05 2024-05-07T14:01:47.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.788 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.788 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:430 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.788 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:01:47.788 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.502187221, 2024-05-07T14:01:47.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066752119999999998, 2024-05-07T14:01:47.788 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.789 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.789 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.789 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.789 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.789 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.789 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 430 2024-05-07T14:01:47.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.789 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:01:47.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:01:47.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210551+0000", 2024-05-07T14:01:47.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:01:47.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210562+0000", 2024-05-07T14:01:47.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0237e-05 2024-05-07T14:01:47.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210586+0000", 2024-05-07T14:01:47.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4066e-05 2024-05-07T14:01:47.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210603+0000", 2024-05-07T14:01:47.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.713e-05 2024-05-07T14:01:47.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211799+0000", 2024-05-07T14:01:47.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001196127 2024-05-07T14:01:47.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211931+0000", 2024-05-07T14:01:47.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131629 2024-05-07T14:01:47.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:47.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212211+0000", 2024-05-07T14:01:47.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028005100000000002 2024-05-07T14:01:47.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.213288+0000", 2024-05-07T14:01:47.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010772760000000001 2024-05-07T14:01:47.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217047+0000", 2024-05-07T14:01:47.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037586569999999999 2024-05-07T14:01:47.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217127+0000", 2024-05-07T14:01:47.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0270000000000002e-05 2024-05-07T14:01:47.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217224+0000", 2024-05-07T14:01:47.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7139000000000006e-05 2024-05-07T14:01:47.794 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.794 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.795 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.795 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:01:47.795 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.495409946000002, 2024-05-07T14:01:47.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003780107, 2024-05-07T14:01:47.795 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.795 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.795 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.795 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.795 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.795 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.796 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 436 2024-05-07T14:01:47.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.796 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:01:47.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:01:47.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217328+0000", 2024-05-07T14:01:47.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:01:47.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217356+0000", 2024-05-07T14:01:47.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8158999999999999e-05 2024-05-07T14:01:47.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217377+0000", 2024-05-07T14:01:47.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1356999999999999e-05 2024-05-07T14:01:47.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217393+0000", 2024-05-07T14:01:47.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5569e-05 2024-05-07T14:01:47.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217882+0000", 2024-05-07T14:01:47.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00048937000000000004 2024-05-07T14:01:47.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218099+0000", 2024-05-07T14:01:47.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021691899999999999 2024-05-07T14:01:47.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:47.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218390+0000", 2024-05-07T14:01:47.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029041800000000002 2024-05-07T14:01:47.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220013+0000", 2024-05-07T14:01:47.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016236169999999999 2024-05-07T14:01:47.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220889+0000", 2024-05-07T14:01:47.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087619599999999998 2024-05-07T14:01:47.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221005+0000", 2024-05-07T14:01:47.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011569 2024-05-07T14:01:47.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221106+0000", 2024-05-07T14:01:47.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101122 2024-05-07T14:01:47.801 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.801 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.801 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.802 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:442 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.802 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:01:47.802 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.491788081000003, 2024-05-07T14:01:47.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003357184, 2024-05-07T14:01:47.802 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.802 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.802 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.802 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.802 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.802 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 442 2024-05-07T14:01:47.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.803 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:01:47.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:01:47.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220950+0000", 2024-05-07T14:01:47.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:01:47.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220958+0000", 2024-05-07T14:01:47.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8429999999999999e-06 2024-05-07T14:01:47.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220979+0000", 2024-05-07T14:01:47.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0387e-05 2024-05-07T14:01:47.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220991+0000", 2024-05-07T14:01:47.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.181e-05 2024-05-07T14:01:47.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221218+0000", 2024-05-07T14:01:47.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022694100000000001 2024-05-07T14:01:47.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221362+0000", 2024-05-07T14:01:47.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014482899999999999 2024-05-07T14:01:47.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:47.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221628+0000", 2024-05-07T14:01:47.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026559799999999997 2024-05-07T14:01:47.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.223915+0000", 2024-05-07T14:01:47.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022864819999999998 2024-05-07T14:01:47.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224031+0000", 2024-05-07T14:01:47.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116759 2024-05-07T14:01:47.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224173+0000", 2024-05-07T14:01:47.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014127599999999999 2024-05-07T14:01:47.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224305+0000", 2024-05-07T14:01:47.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000132519 2024-05-07T14:01:47.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.808 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.808 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:482 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.808 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:01:47.808 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.469557633000001, 2024-05-07T14:01:47.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035275459999999999, 2024-05-07T14:01:47.809 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.809 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.809 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.809 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.809 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.809 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.809 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 482 2024-05-07T14:01:47.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.809 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:01:47.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:01:47.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243181+0000", 2024-05-07T14:01:47.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:01:47.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243194+0000", 2024-05-07T14:01:47.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3087e-05 2024-05-07T14:01:47.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243224+0000", 2024-05-07T14:01:47.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0546000000000002e-05 2024-05-07T14:01:47.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243240+0000", 2024-05-07T14:01:47.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5339999999999999e-05 2024-05-07T14:01:47.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243379+0000", 2024-05-07T14:01:47.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139646 2024-05-07T14:01:47.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243576+0000", 2024-05-07T14:01:47.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019638300000000001 2024-05-07T14:01:47.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243838+0000", 2024-05-07T14:01:47.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026234300000000001 2024-05-07T14:01:47.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.244908+0000", 2024-05-07T14:01:47.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010696289999999999 2024-05-07T14:01:47.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246477+0000", 2024-05-07T14:01:47.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001569471 2024-05-07T14:01:47.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246596+0000", 2024-05-07T14:01:47.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118892 2024-05-07T14:01:47.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246706+0000", 2024-05-07T14:01:47.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109899 2024-05-07T14:01:47.815 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.815 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.815 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.815 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:563 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.815 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:01:47.815 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.410567202000003, 2024-05-07T14:01:47.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00310239, 2024-05-07T14:01:47.816 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.816 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.816 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.816 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.816 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.816 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.816 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 563 2024-05-07T14:01:47.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.816 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:01:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:01:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302171+0000", 2024-05-07T14:01:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1169999999999998e-06 2024-05-07T14:01:47.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302182+0000", 2024-05-07T14:01:47.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0679999999999999e-05 2024-05-07T14:01:47.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302202+0000", 2024-05-07T14:01:47.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0505000000000001e-05 2024-05-07T14:01:47.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302218+0000", 2024-05-07T14:01:47.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5990000000000001e-05 2024-05-07T14:01:47.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302337+0000", 2024-05-07T14:01:47.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119071 2024-05-07T14:01:47.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302481+0000", 2024-05-07T14:01:47.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014358200000000001 2024-05-07T14:01:47.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302775+0000", 2024-05-07T14:01:47.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029423399999999999 2024-05-07T14:01:47.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.303826+0000", 2024-05-07T14:01:47.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001051485 2024-05-07T14:01:47.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305118+0000", 2024-05-07T14:01:47.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001291234 2024-05-07T14:01:47.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305205+0000", 2024-05-07T14:01:47.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7672999999999999e-05 2024-05-07T14:01:47.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305271+0000", 2024-05-07T14:01:47.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5819000000000001e-05 2024-05-07T14:01:47.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.822 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.822 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.822 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:01:47.822 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.971809270999998, 2024-05-07T14:01:47.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031794449999999999, 2024-05-07T14:01:47.822 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.822 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.822 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.823 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.823 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.823 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.823 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 856 2024-05-07T14:01:47.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.823 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:01:47.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:01:47.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740929+0000", 2024-05-07T14:01:47.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3e-06 2024-05-07T14:01:47.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740942+0000", 2024-05-07T14:01:47.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3183000000000001e-05 2024-05-07T14:01:47.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740968+0000", 2024-05-07T14:01:47.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5477e-05 2024-05-07T14:01:47.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740982+0000", 2024-05-07T14:01:47.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4273e-05 2024-05-07T14:01:47.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741169+0000", 2024-05-07T14:01:47.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018701500000000001 2024-05-07T14:01:47.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741382+0000", 2024-05-07T14:01:47.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021331200000000001 2024-05-07T14:01:47.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741696+0000", 2024-05-07T14:01:47.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031337800000000001 2024-05-07T14:01:47.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.742864+0000", 2024-05-07T14:01:47.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011688410000000001 2024-05-07T14:01:47.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.743952+0000", 2024-05-07T14:01:47.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001087221 2024-05-07T14:01:47.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.744037+0000", 2024-05-07T14:01:47.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5242999999999997e-05 2024-05-07T14:01:47.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.744106+0000", 2024-05-07T14:01:47.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9202000000000006e-05 2024-05-07T14:01:47.828 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.828 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.828 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.829 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:877 6.19 6:98c4c580:::obj_delete_at_hint.0000000100:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:47.829 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:01:47.829 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.920862628000002, 2024-05-07T14:01:47.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033601709999999999, 2024-05-07T14:01:47.829 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:47.829 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:47.829 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:47.829 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:47.829 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:47.829 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:47.829 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 877 2024-05-07T14:01:47.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.830 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:47.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:47.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:01:47.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:47.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:01:47.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:47.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:47.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791875+0000", 2024-05-07T14:01:47.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9e-06 2024-05-07T14:01:47.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:47.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791884+0000", 2024-05-07T14:01:47.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7069999999999998e-06 2024-05-07T14:01:47.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:47.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791907+0000", 2024-05-07T14:01:47.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2682999999999999e-05 2024-05-07T14:01:47.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:47.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791919+0000", 2024-05-07T14:01:47.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2763e-05 2024-05-07T14:01:47.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:47.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792073+0000", 2024-05-07T14:01:47.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153509 2024-05-07T14:01:47.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:47.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792439+0000", 2024-05-07T14:01:47.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000366141 2024-05-07T14:01:47.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:47.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792989+0000", 2024-05-07T14:01:47.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055016899999999998 2024-05-07T14:01:47.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:47.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.794288+0000", 2024-05-07T14:01:47.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00129885 2024-05-07T14:01:47.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:47.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795070+0000", 2024-05-07T14:01:47.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000781557 2024-05-07T14:01:47.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:47.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795155+0000", 2024-05-07T14:01:47.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5723000000000006e-05 2024-05-07T14:01:47.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:47.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:47.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:47.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795234+0000", 2024-05-07T14:01:47.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8169000000000003e-05 2024-05-07T14:01:47.835 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.835 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.835 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.835 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:47.835 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:47.835 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:47.836 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:01:47.837 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:47.847+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:47.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:01:47.938 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:47.947+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:47.967 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:47.967 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:47.967 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:47.967 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:47.982 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:01:47.992 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:47.993 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:48.009 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:48.009 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:48.025 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:48.025 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:48.038 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:48.047+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:48.041 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:48.041 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:48.059 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:48.059 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:48.077 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:48.077 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:48.095 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:48.106 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:48.107 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:48.115 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:48.115 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:48.122 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:01:48.180 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:48.191+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:48.240 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:48.251+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:48.285 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:48.285 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:48.299 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:01:48.343 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:48.355+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:48.367 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:01:48.442 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:48.451+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:48.461 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:48.462 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:48.476 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:01:48.543 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:48.551+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:48.599 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:48.599 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:48.613 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:01:48.663 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:48.675+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:48.738 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:48.738 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:48.745 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:48.755+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:48.752 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:01:48.848 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:48.859+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:48.881 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:48.881 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:48.896 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:01:48.984 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:48.995+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:49.050 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:49.059+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:49.056 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:49.056 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:49.071 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:01:49.156 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:49.167+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:49.236 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:49.236 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:49.250 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:01:49.252 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:49.263+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:49.352 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:49.367+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:49.371 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:01:49.420 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:49.420 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:49.434 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:01:49.454 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:49.463+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:49.555 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:49.563+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:49.601 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:49.601 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:49.615 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:01:49.660 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:49.675+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:49.757 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:49.767+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:49.784 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:49.784 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:49.798 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:01:49.858 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:49.871+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:49.924 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:49.924 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:49.938 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:01:49.980 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:49.995+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:50.060 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:50.071+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:50.101 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:50.102 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:50.116 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:01:50.133 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:01:50.164 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:50.179+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:50.239 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:50.239 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:50.255 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:01:50.262 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:50.271+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:50.306 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:50.306 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:50.322 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:50.322 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:50.339 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:50.357 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:50.362 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:50.375+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:50.378 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:50.378 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:50.378 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:01:50.379 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:50.393 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:01:50.398 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:50.398 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:50.418 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:50.419 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:50.440 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:50.440 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:50.504 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:50.519+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:50.517 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:01:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:01:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:01:50.517 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:50.531 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:01:50.566 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:50.575+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:50.667 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:50.679+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:50.695 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:50.696 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:50.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:50.696 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:50.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.696 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:01:50.696 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:50.696 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 48.70635979, 2024-05-07T14:01:50.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:01:50.696 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.696 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.696 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:50.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:01:50.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:01:50.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:01:50.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:01:50.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:01:50.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:01:50.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:01:50.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:01:50.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:01:50.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:01:50.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:01:50.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:01:50.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:01:50.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:01:50.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:01:50.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:01:50.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:01:50.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.702 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.702 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:50.702 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:50.703 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.685955970000002, 2024-05-07T14:01:50.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:01:50.703 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.703 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.703 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.703 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.703 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.703 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.703 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:01:50.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.704 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:50.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:50.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:01:50.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:01:50.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:01:50.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:01:50.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:01:50.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:01:50.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:01:50.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:01:50.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:01:50.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:01:50.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:01:50.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:01:50.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:01:50.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:01:50.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:01:50.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:01:50.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:01:50.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:50.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:01:50.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:01:50.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:50.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:01:50.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:01:50.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:50.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:01:50.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:01:50.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:01:50.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:01:50.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:01:50.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:01:50.713 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.713 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.713 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.714 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:50.714 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:50.714 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.583706255999999, 2024-05-07T14:01:50.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036480649999999998, 2024-05-07T14:01:50.714 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.714 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.715 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.715 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.715 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.715 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.715 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 231 2024-05-07T14:01:50.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.715 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:50.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:50.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125133+0000", 2024-05-07T14:01:50.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.063e-06 2024-05-07T14:01:50.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125143+0000", 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9769999999999995e-06 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125170+0000", 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7152999999999999e-05 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125184+0000", 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4372999999999999e-05 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125295+0000", 2024-05-07T14:01:50.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111036 2024-05-07T14:01:50.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125510+0000", 2024-05-07T14:01:50.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215102 2024-05-07T14:01:50.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:50.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125920+0000", 2024-05-07T14:01:50.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040954700000000001 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.127419+0000", 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001499261 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128635+0000", 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001215818 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128718+0000", 2024-05-07T14:01:50.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3048999999999997e-05 2024-05-07T14:01:50.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128779+0000", 2024-05-07T14:01:50.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0686000000000001e-05 2024-05-07T14:01:50.720 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.720 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.720 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.720 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:235 6.0 e33/27 6:013d6c33:gc::gc.30:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:50.720 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.568249235000003, 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038113629999999999, 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140590+0000", 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140604+0000", 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4324e-05 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140640+0000", 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6009e-05 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140659+0000", 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9340000000000001e-05 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140815+0000", 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155329 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140868+0000", 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3455999999999998e-05 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144310+0000", 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034414239999999998 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144399+0000", 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9492000000000003e-05 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:400 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.517827838999999, 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039416900000000003, 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 400 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191010+0000", 2024-05-07T14:01:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.09e-07 2024-05-07T14:01:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191014+0000", 2024-05-07T14:01:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999996e-06 2024-05-07T14:01:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191024+0000", 2024-05-07T14:01:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0274e-05 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191030+0000", 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.789e-06 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191085+0000", 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4741999999999999e-05 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191169+0000", 2024-05-07T14:01:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4532999999999999e-05 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191383+0000", 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021415400000000001 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194408+0000", 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003024901 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194860+0000", 2024-05-07T14:01:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045153599999999999 2024-05-07T14:01:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194915+0000", 2024-05-07T14:01:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4737999999999997e-05 2024-05-07T14:01:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194951+0000", 2024-05-07T14:01:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6183999999999998e-05 2024-05-07T14:01:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:403 6.2 e33/27 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.514730159000003, 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003750841, 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194108+0000", 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.051e-06 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194116+0000", 2024-05-07T14:01:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1149999999999994e-06 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194128+0000", 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1972e-05 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194135+0000", 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1130000000000003e-06 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194191+0000", 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:01:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194218+0000", 2024-05-07T14:01:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6242e-05 2024-05-07T14:01:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197807+0000", 2024-05-07T14:01:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003589283 2024-05-07T14:01:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197858+0000", 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0572999999999998e-05 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:415 6.7 e33/27 6:e622f76a:gc::gc.20:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.507028317, 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044669840000000002, 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1799999999999995e-07 2024-05-07T14:01:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201814+0000", 2024-05-07T14:01:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4170000000000002e-06 2024-05-07T14:01:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201824+0000", 2024-05-07T14:01:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0217999999999999e-05 2024-05-07T14:01:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201838+0000", 2024-05-07T14:01:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3723000000000001e-05 2024-05-07T14:01:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201890+0000", 2024-05-07T14:01:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2320000000000001e-05 2024-05-07T14:01:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201906+0000", 2024-05-07T14:01:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5894999999999999e-05 2024-05-07T14:01:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206242+0000", 2024-05-07T14:01:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043366489999999997 2024-05-07T14:01:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206276+0000", 2024-05-07T14:01:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:01:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:432 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.495782736999999, 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045128019999999998, 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 432 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213055+0000", 2024-05-07T14:01:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7000000000000005e-07 2024-05-07T14:01:50.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213058+0000", 2024-05-07T14:01:50.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0369999999999999e-06 2024-05-07T14:01:50.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213066+0000", 2024-05-07T14:01:50.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3680000000000002e-06 2024-05-07T14:01:50.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213084+0000", 2024-05-07T14:01:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7946999999999999e-05 2024-05-07T14:01:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213127+0000", 2024-05-07T14:01:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2673999999999998e-05 2024-05-07T14:01:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213222+0000", 2024-05-07T14:01:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5488000000000005e-05 2024-05-07T14:01:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213412+0000", 2024-05-07T14:01:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000189307 2024-05-07T14:01:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.214754+0000", 2024-05-07T14:01:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001342069 2024-05-07T14:01:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217447+0000", 2024-05-07T14:01:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026931250000000002 2024-05-07T14:01:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217521+0000", 2024-05-07T14:01:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3997000000000003e-05 2024-05-07T14:01:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217567+0000", 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6220000000000001e-05 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:430 6.7 e33/27 6:e1cdb60d:reshard::reshard.0000000008:head v 33'9, mlcod=33'6)", 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.495736254000001, 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043702330000000003, 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:50.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0400000000000005e-07 2024-05-07T14:01:50.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213107+0000", 2024-05-07T14:01:50.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5740000000000003e-06 2024-05-07T14:01:50.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213117+0000", 2024-05-07T14:01:50.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8349999999999999e-06 2024-05-07T14:01:50.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213122+0000", 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5140000000000001e-06 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213169+0000", 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6551000000000002e-05 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213198+0000", 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217415+0000", 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042171090000000001 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217471+0000", 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5766000000000001e-05 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.750 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:480 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.467272098999999, 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052104459999999997, 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 480 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:50.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:50.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:50.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6199999999999997e-07 2024-05-07T14:01:50.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241570+0000", 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2479999999999998e-06 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241580+0000", 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8719999999999997e-06 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241584+0000", 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7210000000000002e-06 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241629+0000", 2024-05-07T14:01:50.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4465000000000002e-05 2024-05-07T14:01:50.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241671+0000", 2024-05-07T14:01:50.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2370999999999998e-05 2024-05-07T14:01:50.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:50.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241772+0000", 2024-05-07T14:01:50.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101048 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.243876+0000", 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021036789999999998 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246710+0000", 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028339060000000002 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246747+0000", 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7061000000000003e-05 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246775+0000", 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8413000000000001e-05 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:499 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.456391377999999, 2024-05-07T14:01:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050166450000000001, 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 499 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4300000000000002e-07 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252451+0000", 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1290000000000004e-06 2024-05-07T14:01:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252463+0000", 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1238e-05 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252470+0000", 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2019999999999998e-06 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252534+0000", 2024-05-07T14:01:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4178999999999997e-05 2024-05-07T14:01:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252706+0000", 2024-05-07T14:01:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017197 2024-05-07T14:01:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252871+0000", 2024-05-07T14:01:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016508199999999999 2024-05-07T14:01:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254444+0000", 2024-05-07T14:01:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001573112 2024-05-07T14:01:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257407+0000", 2024-05-07T14:01:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029630989999999999 2024-05-07T14:01:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257437+0000", 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0009999999999999e-05 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257462+0000", 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4780999999999999e-05 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:500 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.456105274999999, 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046354220000000002, 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 500 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252733+0000", 2024-05-07T14:01:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9399999999999993e-07 2024-05-07T14:01:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252738+0000", 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6779999999999997e-06 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252750+0000", 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1882000000000001e-05 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252758+0000", 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0649999999999999e-06 2024-05-07T14:01:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252811+0000", 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2859000000000003e-05 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252870+0000", 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8956000000000003e-05 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252992+0000", 2024-05-07T14:01:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122275 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254326+0000", 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013334449999999999 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257254+0000", 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029284039999999999 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257316+0000", 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1348999999999998e-05 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257367+0000", 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1514999999999997e-05 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:510 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.450022636, 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041639090000000004, 2024-05-07T14:01:50.768 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.769 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.769 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.769 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.769 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.769 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.769 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 510 2024-05-07T14:01:50.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.769 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:50.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:50.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258815+0000", 2024-05-07T14:01:50.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:01:50.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258819+0000", 2024-05-07T14:01:50.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0090000000000001e-06 2024-05-07T14:01:50.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258828+0000", 2024-05-07T14:01:50.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2529999999999993e-06 2024-05-07T14:01:50.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258833+0000", 2024-05-07T14:01:50.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7219999999999999e-06 2024-05-07T14:01:50.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258870+0000", 2024-05-07T14:01:50.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6368000000000001e-05 2024-05-07T14:01:50.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258915+0000", 2024-05-07T14:01:50.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.528e-05 2024-05-07T14:01:50.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:50.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.259016+0000", 2024-05-07T14:01:50.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010074200000000001 2024-05-07T14:01:50.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:50.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.260655+0000", 2024-05-07T14:01:50.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016394999999999999 2024-05-07T14:01:50.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:50.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262752+0000", 2024-05-07T14:01:50.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002096531 2024-05-07T14:01:50.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262871+0000", 2024-05-07T14:01:50.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119645 2024-05-07T14:01:50.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262978+0000", 2024-05-07T14:01:50.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010695400000000001 2024-05-07T14:01:50.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.774 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.775 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:552 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:50.775 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:50.775 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.418263134, 2024-05-07T14:01:50.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042166790000000001, 2024-05-07T14:01:50.775 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.775 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.775 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.775 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 552 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:50.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290575+0000", 2024-05-07T14:01:50.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.85e-07 2024-05-07T14:01:50.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290578+0000", 2024-05-07T14:01:50.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999999e-06 2024-05-07T14:01:50.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290587+0000", 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.268e-06 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290592+0000", 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7029999999999997e-06 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290694+0000", 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101841 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290840+0000", 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014613899999999999 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.291137+0000", 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029714800000000001 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292561+0000", 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014235020000000001 2024-05-07T14:01:50.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294568+0000", 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020076540000000002 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294692+0000", 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012394500000000001 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294790+0000", 2024-05-07T14:01:50.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8194000000000002e-05 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:553 6.f e33/27 6:f24cb4a8:gc::gc.31:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.416004276000002, 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043350139999999999, 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2900000000000004e-07 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292838+0000", 2024-05-07T14:01:50.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5560000000000001e-06 2024-05-07T14:01:50.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292847+0000", 2024-05-07T14:01:50.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8619999999999992e-06 2024-05-07T14:01:50.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292851+0000", 2024-05-07T14:01:50.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9010000000000002e-06 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292922+0000", 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0827000000000005e-05 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292973+0000", 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0492999999999999e-05 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297114+0000", 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041408970000000002 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297168+0000", 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3949000000000001e-05 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:686 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:50.785 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.306258391, 2024-05-07T14:01:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046254349999999998, 2024-05-07T14:01:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 686 2024-05-07T14:01:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402581+0000", 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402592+0000", 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0984e-05 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402619+0000", 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7583e-05 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402633+0000", 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3553000000000001e-05 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402699+0000", 2024-05-07T14:01:50.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6013000000000006e-05 2024-05-07T14:01:50.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402792+0000", 2024-05-07T14:01:50.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3455999999999994e-05 2024-05-07T14:01:50.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:50.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402928+0000", 2024-05-07T14:01:50.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013596800000000001 2024-05-07T14:01:50.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:50.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.403918+0000", 2024-05-07T14:01:50.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00099017000000000007 2024-05-07T14:01:50.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:50.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407144+0000", 2024-05-07T14:01:50.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032257449999999999 2024-05-07T14:01:50.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407180+0000", 2024-05-07T14:01:50.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5462e-05 2024-05-07T14:01:50.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407204+0000", 2024-05-07T14:01:50.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4247999999999999e-05 2024-05-07T14:01:50.791 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.791 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.791 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.037346812999999, 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003355448, 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 826 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.792 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:50.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:50.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671493+0000", 2024-05-07T14:01:50.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-06 2024-05-07T14:01:50.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671506+0000", 2024-05-07T14:01:50.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2746e-05 2024-05-07T14:01:50.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671542+0000", 2024-05-07T14:01:50.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6162999999999999e-05 2024-05-07T14:01:50.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671557+0000", 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4786999999999999e-05 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671705+0000", 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000147792 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671872+0000", 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016705499999999999 2024-05-07T14:01:50.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.672101+0000", 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022892999999999999 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.673101+0000", 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001000775 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674701+0000", 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016000599999999999 2024-05-07T14:01:50.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674795+0000", 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3653000000000006e-05 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674846+0000", 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0473000000000003e-05 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.797 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:868 6.f e33/27 6:f6792a7a:::obj_delete_at_hint.0000000097:head v 33'10, mlcod=33'8)", 2024-05-07T14:01:50.798 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:50.798 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.937942327000002, 2024-05-07T14:01:50.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033639339999999998, 2024-05-07T14:01:50.798 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.798 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.798 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.798 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:50.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:50.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770897+0000", 2024-05-07T14:01:50.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9700000000000002e-06 2024-05-07T14:01:50.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770909+0000", 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2034e-05 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770937+0000", 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.796e-05 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770954+0000", 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7555999999999999e-05 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771084+0000", 2024-05-07T14:01:50.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013033599999999999 2024-05-07T14:01:50.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771136+0000", 2024-05-07T14:01:50.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1925999999999997e-05 2024-05-07T14:01:50.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774168+0000", 2024-05-07T14:01:50.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030316200000000001 2024-05-07T14:01:50.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774259+0000", 2024-05-07T14:01:50.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0532000000000007e-05 2024-05-07T14:01:50.802 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.802 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.802 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.802 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:50.802 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:50.802 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.873952134, 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035607859999999998, 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 895 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834888+0000", 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.41e-06 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834899+0000", 2024-05-07T14:01:50.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0987e-05 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834929+0000", 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9706e-05 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834943+0000", 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4354e-05 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835100+0000", 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156582 2024-05-07T14:01:50.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835499+0000", 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000399214 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.836052+0000", 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00055334500000000001 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.837279+0000", 2024-05-07T14:01:50.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012266270000000001 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838177+0000", 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089768699999999999 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838332+0000", 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155155 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838446+0000", 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113719 2024-05-07T14:01:50.807 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.808 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.808 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.808 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:50.808 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:50.808 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.866424604999999, 2024-05-07T14:01:50.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033546700000000001, 2024-05-07T14:01:50.808 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:50.808 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:50.808 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:50.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:50.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 898 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842414+0000", 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.863e-06 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842425+0000", 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0533000000000001e-05 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842450+0000", 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5259999999999999e-05 2024-05-07T14:01:50.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:50.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842463+0000", 2024-05-07T14:01:50.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3373000000000001e-05 2024-05-07T14:01:50.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:50.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842599+0000", 2024-05-07T14:01:50.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013549600000000001 2024-05-07T14:01:50.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:50.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842936+0000", 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033763400000000001 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.843484+0000", 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054733899999999999 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.844749+0000", 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012656639999999999 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:50.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845499+0000", 2024-05-07T14:01:50.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074904400000000003 2024-05-07T14:01:50.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:50.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845646+0000", 2024-05-07T14:01:50.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014709900000000001 2024-05-07T14:01:50.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:50.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:50.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:50.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845767+0000", 2024-05-07T14:01:50.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121365 2024-05-07T14:01:50.813 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.813 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.814 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.814 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:50.814 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:50.814 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:50.815 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:01:50.816 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:50.827+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:50.916 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:50.931+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:50.944 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:50.944 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:50.944 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:50.959 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:01:51.018 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:51.027+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:51.080 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:51.080 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:51.080 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:51.080 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:51.080 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:51.094 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:01:51.136 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:51.147+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:51.219 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:51.231+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:51.256 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:51.256 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:51.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.273621319, 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070064749999999999, 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 43 2024-05-07T14:01:51.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.258 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:51.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:51.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994274+0000", 2024-05-07T14:01:51.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7170000000000002e-06 2024-05-07T14:01:51.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994292+0000", 2024-05-07T14:01:51.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7819999999999999e-05 2024-05-07T14:01:51.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994338+0000", 2024-05-07T14:01:51.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6625999999999997e-05 2024-05-07T14:01:51.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994362+0000", 2024-05-07T14:01:51.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4063e-05 2024-05-07T14:01:51.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994576+0000", 2024-05-07T14:01:51.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021319500000000001 2024-05-07T14:01:51.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:01:51.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994598+0000", 2024-05-07T14:01:51.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2325999999999999e-05 2024-05-07T14:01:51.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001023+0000", 2024-05-07T14:01:51.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00642546 2024-05-07T14:01:51.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001277+0000", 2024-05-07T14:01:51.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025326800000000002 2024-05-07T14:01:51.262 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.262 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.262 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.262 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:46 7.1f e30/29 7:f95f44c2:::notify.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:51.262 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:51.262 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.245528663000002, 2024-05-07T14:01:51.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031449519999999999, 2024-05-07T14:01:51.262 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.262 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.262 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5700000000000002e-07 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022371+0000", 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7230000000000004e-06 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022396+0000", 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4406e-05 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022415+0000", 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9264999999999999e-05 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022641+0000", 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022584100000000001 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022702+0000", 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1513999999999994e-05 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.025418+0000", 2024-05-07T14:01:51.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027162290000000001 2024-05-07T14:01:51.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.025508+0000", 2024-05-07T14:01:51.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9216999999999996e-05 2024-05-07T14:01:51.266 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.266 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.266 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.267 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.267 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:51.267 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.217991892999997, 2024-05-07T14:01:51.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033678110000000001, 2024-05-07T14:01:51.267 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.267 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.267 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.267 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.267 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 211 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049903+0000", 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.963e-06 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049917+0000", 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049950+0000", 2024-05-07T14:01:51.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3328999999999999e-05 2024-05-07T14:01:51.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049966+0000", 2024-05-07T14:01:51.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6333000000000001e-05 2024-05-07T14:01:51.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050100+0000", 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013305599999999999 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050363+0000", 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026392100000000002 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050827+0000", 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046316 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.052269+0000", 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014428760000000001 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053111+0000", 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084168999999999997 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053198+0000", 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6666e-05 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053267+0000", 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9503000000000002e-05 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.139537197999999, 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032702809999999999, 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.273 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.274 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.274 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.274 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 232 2024-05-07T14:01:51.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.274 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:51.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128357+0000", 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1530000000000001e-06 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128369+0000", 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1823e-05 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128401+0000", 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128416+0000", 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4997000000000001e-05 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128538+0000", 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121406 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128773+0000", 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235121 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.129230+0000", 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00045679999999999999 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.130836+0000", 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001606484 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131454+0000", 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061747199999999999 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131550+0000", 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6636000000000001e-05 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131624+0000", 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4315999999999998e-05 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.278 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:265 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.113884845999998, 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029442299999999999, 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 265 2024-05-07T14:01:51.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.280 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:51.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:51.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154009+0000", 2024-05-07T14:01:51.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.413e-06 2024-05-07T14:01:51.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154023+0000", 2024-05-07T14:01:51.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4229999999999999e-05 2024-05-07T14:01:51.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154062+0000", 2024-05-07T14:01:51.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9223e-05 2024-05-07T14:01:51.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154085+0000", 2024-05-07T14:01:51.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2909999999999999e-05 2024-05-07T14:01:51.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154269+0000", 2024-05-07T14:01:51.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183232 2024-05-07T14:01:51.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154422+0000", 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015338799999999999 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154693+0000", 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000271005 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155957+0000", 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001263573 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156590+0000", 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00063392600000000004 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156844+0000", 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025348800000000001 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156951+0000", 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106842 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.284 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:277 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.111983381000002, 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030861830000000002, 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.285 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 277 2024-05-07T14:01:51.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.286 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:51.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:51.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155910+0000", 2024-05-07T14:01:51.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:01:51.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155922+0000", 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2082999999999999e-05 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155967+0000", 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4855999999999999e-05 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155986+0000", 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.965e-05 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156173+0000", 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018657299999999999 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156479+0000", 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030636299999999998 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156975+0000", 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00049533699999999999 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158291+0000", 2024-05-07T14:01:51.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001316776 2024-05-07T14:01:51.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158712+0000", 2024-05-07T14:01:51.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042077999999999999 2024-05-07T14:01:51.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158885+0000", 2024-05-07T14:01:51.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000172786 2024-05-07T14:01:51.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158994+0000", 2024-05-07T14:01:51.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109239 2024-05-07T14:01:51.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.291 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.291 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:301 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.291 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.107960232000003, 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037043950000000001, 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 301 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159933+0000", 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6670000000000001e-06 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159943+0000", 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0176e-05 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159965+0000", 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2243e-05 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159980+0000", 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4747e-05 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160332+0000", 2024-05-07T14:01:51.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000352004 2024-05-07T14:01:51.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160574+0000", 2024-05-07T14:01:51.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241838 2024-05-07T14:01:51.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:51.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.161045+0000", 2024-05-07T14:01:51.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000471526 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.162322+0000", 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001276241 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163376+0000", 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010539449999999999 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163516+0000", 2024-05-07T14:01:51.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014034599999999999 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163636+0000", 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011966199999999999 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:376 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.091844952999999, 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038557209999999999, 2024-05-07T14:01:51.297 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 376 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:51.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176049+0000", 2024-05-07T14:01:51.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:01:51.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176064+0000", 2024-05-07T14:01:51.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.451e-05 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176101+0000", 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000003e-05 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176126+0000", 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176272+0000", 2024-05-07T14:01:51.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014592899999999999 2024-05-07T14:01:51.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176402+0000", 2024-05-07T14:01:51.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000129512 2024-05-07T14:01:51.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:51.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176725+0000", 2024-05-07T14:01:51.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032289800000000001 2024-05-07T14:01:51.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.177826+0000", 2024-05-07T14:01:51.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011017620000000001 2024-05-07T14:01:51.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179617+0000", 2024-05-07T14:01:51.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001791193 2024-05-07T14:01:51.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179781+0000", 2024-05-07T14:01:51.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016336899999999999 2024-05-07T14:01:51.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179902+0000", 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012131899999999999 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:397 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.079347863000002, 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034388040000000002, 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.304 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 397 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:51.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188546+0000", 2024-05-07T14:01:51.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2000000000000001e-06 2024-05-07T14:01:51.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188556+0000", 2024-05-07T14:01:51.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0557000000000001e-05 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188590+0000", 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3626e-05 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188625+0000", 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5095999999999997e-05 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188768+0000", 2024-05-07T14:01:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014279900000000001 2024-05-07T14:01:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189124+0000", 2024-05-07T14:01:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035646799999999998 2024-05-07T14:01:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189633+0000", 2024-05-07T14:01:51.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000508903 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.190638+0000", 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001004465 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191712+0000", 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001074759 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191871+0000", 2024-05-07T14:01:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835900000000001 2024-05-07T14:01:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191982+0000", 2024-05-07T14:01:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011157199999999999 2024-05-07T14:01:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:403 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.075205085, 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004923172, 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 403 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192688+0000", 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4640000000000001e-06 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192696+0000", 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9330000000000001e-06 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192715+0000", 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9746999999999999e-05 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192726+0000", 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.026e-05 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192824+0000", 2024-05-07T14:01:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8139000000000003e-05 2024-05-07T14:01:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192971+0000", 2024-05-07T14:01:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014717199999999999 2024-05-07T14:01:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:51.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.193232+0000", 2024-05-07T14:01:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000260518 2024-05-07T14:01:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.196090+0000", 2024-05-07T14:01:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002858598 2024-05-07T14:01:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197464+0000", 2024-05-07T14:01:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001373399 2024-05-07T14:01:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197549+0000", 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5261999999999998e-05 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197609+0000", 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0680000000000002e-05 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.316 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:472 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.030902572000002, 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044650219999999999, 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 472 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236991+0000", 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8589999999999999e-06 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237001+0000", 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0465999999999999e-05 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237019+0000", 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7666999999999999e-05 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237030+0000", 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0917000000000001e-05 2024-05-07T14:01:51.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237184+0000", 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015438499999999999 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237427+0000", 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024296499999999999 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237900+0000", 2024-05-07T14:01:51.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047292599999999998 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.239253+0000", 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013527770000000001 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241246+0000", 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019933249999999998 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241370+0000", 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012385599999999999 2024-05-07T14:01:51.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241454+0000", 2024-05-07T14:01:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3879000000000001e-05 2024-05-07T14:01:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:501 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.013671365999997, 2024-05-07T14:01:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029689030000000002, 2024-05-07T14:01:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 501 2024-05-07T14:01:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.323 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254222+0000", 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9580000000000001e-06 2024-05-07T14:01:51.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254246+0000", 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3521999999999999e-05 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254271+0000", 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5757000000000001e-05 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254284+0000", 2024-05-07T14:01:51.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:01:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254423+0000", 2024-05-07T14:01:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013909 2024-05-07T14:01:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254745+0000", 2024-05-07T14:01:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032253700000000002 2024-05-07T14:01:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.255261+0000", 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051555899999999996 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.256343+0000", 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001081867 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257042+0000", 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069873699999999995 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257128+0000", 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6478999999999997e-05 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257189+0000", 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0810999999999998e-05 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:509 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.328 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.010014433999999, 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003433874, 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 509 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:51.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257878+0000", 2024-05-07T14:01:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.528e-06 2024-05-07T14:01:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257886+0000", 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2180000000000002e-06 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257903+0000", 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7484999999999999e-05 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257912+0000", 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0189999999999995e-06 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258007+0000", 2024-05-07T14:01:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4627000000000001e-05 2024-05-07T14:01:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258124+0000", 2024-05-07T14:01:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116836 2024-05-07T14:01:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258381+0000", 2024-05-07T14:01:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025690899999999999 2024-05-07T14:01:51.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.259428+0000", 2024-05-07T14:01:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047177 2024-05-07T14:01:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261154+0000", 2024-05-07T14:01:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017262180000000001 2024-05-07T14:01:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261224+0000", 2024-05-07T14:01:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9913000000000006e-05 2024-05-07T14:01:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261311+0000", 2024-05-07T14:01:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6944e-05 2024-05-07T14:01:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:610 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.933460105000002, 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031518679999999999, 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 610 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334434+0000", 2024-05-07T14:01:51.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.34e-06 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334447+0000", 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2976000000000001e-05 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334479+0000", 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2159999999999997e-05 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334495+0000", 2024-05-07T14:01:51.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6722999999999999e-05 2024-05-07T14:01:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334644+0000", 2024-05-07T14:01:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014812500000000001 2024-05-07T14:01:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.335017+0000", 2024-05-07T14:01:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037323400000000001 2024-05-07T14:01:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.335408+0000", 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039102000000000001 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.336518+0000", 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011105620000000001 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337379+0000", 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086063700000000003 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337473+0000", 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4332000000000004e-05 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337583+0000", 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:625 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.340 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.922594773, 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039276240000000002, 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 625 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:51.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345300+0000", 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.067e-06 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345315+0000", 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4857e-05 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345344+0000", 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9070000000000001e-05 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345359+0000", 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5656000000000001e-05 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345512+0000", 2024-05-07T14:01:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015229600000000001 2024-05-07T14:01:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345764+0000", 2024-05-07T14:01:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025252100000000002 2024-05-07T14:01:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.346269+0000", 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000504613 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.347487+0000", 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001218317 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349071+0000", 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015844279999999999 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349156+0000", 2024-05-07T14:01:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4958999999999998e-05 2024-05-07T14:01:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349224+0000", 2024-05-07T14:01:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7840000000000001e-05 2024-05-07T14:01:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.811227877999997, 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031666649999999999, 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 727 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.347 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456665+0000", 2024-05-07T14:01:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-06 2024-05-07T14:01:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456675+0000", 2024-05-07T14:01:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8500000000000006e-06 2024-05-07T14:01:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456703+0000", 2024-05-07T14:01:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7846000000000001e-05 2024-05-07T14:01:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456724+0000", 2024-05-07T14:01:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0869999999999998e-05 2024-05-07T14:01:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456850+0000", 2024-05-07T14:01:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126069 2024-05-07T14:01:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.457082+0000", 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023258099999999999 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.457439+0000", 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000356115 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.458419+0000", 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00098032799999999993 2024-05-07T14:01:51.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459682+0000", 2024-05-07T14:01:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012626339999999999 2024-05-07T14:01:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459769+0000", 2024-05-07T14:01:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7383e-05 2024-05-07T14:01:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459830+0000", 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1235999999999994e-05 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.623796525000003, 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029415270000000002, 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.353 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 814 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:51.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644097+0000", 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1500000000000002e-06 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644108+0000", 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1182999999999999e-05 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644140+0000", 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2283000000000002e-05 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644166+0000", 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5703000000000001e-05 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644360+0000", 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019352200000000001 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644571+0000", 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000210915 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644899+0000", 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032880799999999999 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.645976+0000", 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001076458 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.646896+0000", 2024-05-07T14:01:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091987999999999998 2024-05-07T14:01:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.646975+0000", 2024-05-07T14:01:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9165999999999994e-05 2024-05-07T14:01:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.647036+0000", 2024-05-07T14:01:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1458999999999996e-05 2024-05-07T14:01:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.358 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.359 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.359 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.359 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:51.359 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.468627638999997, 2024-05-07T14:01:51.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031874479999999998, 2024-05-07T14:01:51.359 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.359 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.359 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 880 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:51.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799266+0000", 2024-05-07T14:01:51.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.723e-06 2024-05-07T14:01:51.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799280+0000", 2024-05-07T14:01:51.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3159999999999999e-05 2024-05-07T14:01:51.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799311+0000", 2024-05-07T14:01:51.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1083e-05 2024-05-07T14:01:51.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799327+0000", 2024-05-07T14:01:51.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5883e-05 2024-05-07T14:01:51.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799438+0000", 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011096599999999999 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799670+0000", 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023280800000000001 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.800012+0000", 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034192800000000002 2024-05-07T14:01:51.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.801133+0000", 2024-05-07T14:01:51.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011206009999999999 2024-05-07T14:01:51.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802179+0000", 2024-05-07T14:01:51.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010458080000000001 2024-05-07T14:01:51.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802341+0000", 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162533 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802451+0000", 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109955 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.365 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.463965832, 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031185649999999998, 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 882 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803928+0000", 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.266e-06 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803939+0000", 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1372999999999999e-05 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803972+0000", 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803987+0000", 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5126999999999999e-05 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804111+0000", 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012420199999999999 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804326+0000", 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215262 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804794+0000", 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046816000000000002 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806221+0000", 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014263749999999999 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806759+0000", 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053796200000000001 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806936+0000", 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017753300000000001 2024-05-07T14:01:51.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.807044+0000", 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107865 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 43.365280896999998, 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029448970000000001, 2024-05-07T14:01:51.371 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 925 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902613+0000", 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9999999999999999e-06 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902623+0000", 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0453e-05 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902653+0000", 2024-05-07T14:01:51.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9556e-05 2024-05-07T14:01:51.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902670+0000", 2024-05-07T14:01:51.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7887e-05 2024-05-07T14:01:51.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902785+0000", 2024-05-07T14:01:51.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114295 2024-05-07T14:01:51.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.903018+0000", 2024-05-07T14:01:51.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023349899999999999 2024-05-07T14:01:51.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.903329+0000", 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031125100000000002 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.904399+0000", 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001069162 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905354+0000", 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095526300000000003 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905441+0000", 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6854999999999994e-05 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905555+0000", 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114676 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.377 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:51.379 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:01:51.380 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:51.391+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:51.395 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:01:51.480 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:51.490+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:51.551 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:51.551 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:51.552 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:51.552 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:51.565 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:01:51.581 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:51.595+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:51.682 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:51.690+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:51.732 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:51.732 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:51.732 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:51.732 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:51.732 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:51.746 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:01:51.783 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:51.795+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:51.884 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:51.894+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:51.908 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:51.908 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:51.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:51.908 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:51.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.908 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:51.908 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:01:51.908 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.892224030999998, 2024-05-07T14:01:51.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033108180000000001, 2024-05-07T14:01:51.908 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.909 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.909 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.909 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.909 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.909 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.909 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 48 2024-05-07T14:01:51.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.909 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:01:51.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026898+0000", 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2369999999999999e-06 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026908+0000", 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8109999999999997e-06 2024-05-07T14:01:51.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026934+0000", 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6746000000000001e-05 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026949+0000", 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4517e-05 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027084+0000", 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013501499999999999 2024-05-07T14:01:51.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027360+0000", 2024-05-07T14:01:51.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027639199999999998 2024-05-07T14:01:51.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:51.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027616+0000", 2024-05-07T14:01:51.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025541799999999999 2024-05-07T14:01:51.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.028902+0000", 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012859989999999999 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030044+0000", 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001142295 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030136+0000", 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1794999999999998e-05 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030206+0000", 2024-05-07T14:01:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0593000000000007e-05 2024-05-07T14:01:51.914 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.914 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.914 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.914 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:01:51.914 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:01:51.914 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.906750121999998, 2024-05-07T14:01:51.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058205720000000004, 2024-05-07T14:01:51.914 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.914 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.914 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.914 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 205 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012373+0000", 2024-05-07T14:01:51.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.07e-06 2024-05-07T14:01:51.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012397+0000", 2024-05-07T14:01:51.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3697e-05 2024-05-07T14:01:51.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012450+0000", 2024-05-07T14:01:51.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2539e-05 2024-05-07T14:01:51.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012477+0000", 2024-05-07T14:01:51.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7457000000000002e-05 2024-05-07T14:01:51.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012735+0000", 2024-05-07T14:01:51.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025820800000000001 2024-05-07T14:01:51.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013057+0000", 2024-05-07T14:01:51.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000321727 2024-05-07T14:01:51.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:51.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013752+0000", 2024-05-07T14:01:51.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069509499999999996 2024-05-07T14:01:51.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.017093+0000", 2024-05-07T14:01:51.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033404340000000002 2024-05-07T14:01:51.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018024+0000", 2024-05-07T14:01:51.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00093108600000000002 2024-05-07T14:01:51.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018113+0000", 2024-05-07T14:01:51.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9752000000000004e-05 2024-05-07T14:01:51.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018190+0000", 2024-05-07T14:01:51.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6507000000000005e-05 2024-05-07T14:01:51.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.920 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.920 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.920 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:01:51.920 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.836499134, 2024-05-07T14:01:51.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052341489999999996, 2024-05-07T14:01:51.921 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.921 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.921 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.921 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.921 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.921 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.921 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 220 2024-05-07T14:01:51.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.921 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:01:51.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082623+0000", 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8370000000000001e-06 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082636+0000", 2024-05-07T14:01:51.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2316e-05 2024-05-07T14:01:51.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082667+0000", 2024-05-07T14:01:51.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1139999999999997e-05 2024-05-07T14:01:51.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082681+0000", 2024-05-07T14:01:51.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4816e-05 2024-05-07T14:01:51.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082825+0000", 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014377899999999999 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083051+0000", 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022549500000000001 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083453+0000", 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000401944 2024-05-07T14:01:51.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.085929+0000", 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024763369999999999 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087649+0000", 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001719747 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087735+0000", 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6415999999999994e-05 2024-05-07T14:01:51.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087855+0000", 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011932199999999999 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.824079402999999, 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00342407, 2024-05-07T14:01:51.926 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 223 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095042+0000", 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1799999999999999e-06 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095054+0000", 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1817000000000001e-05 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095084+0000", 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0018999999999998e-05 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095099+0000", 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.537e-05 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095209+0000", 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010943299999999999 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095457+0000", 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247941 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095879+0000", 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042171299999999999 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.097290+0000", 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014118519999999999 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098196+0000", 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00090603700000000005 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098348+0000", 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151879 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098464+0000", 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011582900000000001 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.931 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.816539202000001, 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031839889999999999, 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 225 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102582+0000", 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102594+0000", 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1382999999999999e-05 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102625+0000", 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0880000000000002e-05 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102640+0000", 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4949999999999999e-05 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102756+0000", 2024-05-07T14:01:51.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116072 2024-05-07T14:01:51.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102998+0000", 2024-05-07T14:01:51.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024203199999999999 2024-05-07T14:01:51.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:51.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.103438+0000", 2024-05-07T14:01:51.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044011700000000001 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105252+0000", 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018136490000000001 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105608+0000", 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035604000000000001 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105699+0000", 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1316999999999993e-05 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105764+0000", 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5371999999999997e-05 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.813062854999998, 2024-05-07T14:01:51.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003090256, 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 226 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106059+0000", 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3e-06 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106070+0000", 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1257000000000001e-05 2024-05-07T14:01:51.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106101+0000", 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0783e-05 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106116+0000", 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5136e-05 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106217+0000", 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101183 2024-05-07T14:01:51.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106433+0000", 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021523199999999999 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106826+0000", 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039372000000000002 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.108406+0000", 2024-05-07T14:01:51.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001579815 2024-05-07T14:01:51.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.108987+0000", 2024-05-07T14:01:51.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058058100000000004 2024-05-07T14:01:51.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.109073+0000", 2024-05-07T14:01:51.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6650000000000006e-05 2024-05-07T14:01:51.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.109147+0000", 2024-05-07T14:01:51.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3598999999999998e-05 2024-05-07T14:01:51.943 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.943 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.943 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.943 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.943 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:01:51.943 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.783610451999998, 2024-05-07T14:01:51.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030980790000000001, 2024-05-07T14:01:51.943 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.943 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.944 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.944 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.944 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.944 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.944 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 234 2024-05-07T14:01:51.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.944 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:01:51.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:01:51.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135511+0000", 2024-05-07T14:01:51.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4030000000000001e-06 2024-05-07T14:01:51.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135523+0000", 2024-05-07T14:01:51.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1559999999999999e-05 2024-05-07T14:01:51.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135557+0000", 2024-05-07T14:01:51.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4372999999999998e-05 2024-05-07T14:01:51.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135572+0000", 2024-05-07T14:01:51.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4647000000000001e-05 2024-05-07T14:01:51.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135674+0000", 2024-05-07T14:01:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101932 2024-05-07T14:01:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135888+0000", 2024-05-07T14:01:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000213995 2024-05-07T14:01:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.136311+0000", 2024-05-07T14:01:51.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042278999999999998 2024-05-07T14:01:51.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.137726+0000", 2024-05-07T14:01:51.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001415319 2024-05-07T14:01:51.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138450+0000", 2024-05-07T14:01:51.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00072404800000000003 2024-05-07T14:01:51.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138543+0000", 2024-05-07T14:01:51.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2559000000000006e-05 2024-05-07T14:01:51.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138607+0000", 2024-05-07T14:01:51.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4453000000000001e-05 2024-05-07T14:01:51.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.949 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.764560430000003, 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035934819999999998, 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 271 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:01:51.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:01:51.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154562+0000", 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154578+0000", 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6667000000000002e-05 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154612+0000", 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3120000000000001e-05 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154632+0000", 2024-05-07T14:01:51.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0769999999999999e-05 2024-05-07T14:01:51.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154774+0000", 2024-05-07T14:01:51.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141805 2024-05-07T14:01:51.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155004+0000", 2024-05-07T14:01:51.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022938200000000001 2024-05-07T14:01:51.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:51.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155372+0000", 2024-05-07T14:01:51.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036889300000000002 2024-05-07T14:01:51.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156948+0000", 2024-05-07T14:01:51.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015755750000000001 2024-05-07T14:01:51.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.157903+0000", 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095453499999999995 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158050+0000", 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147279 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158153+0000", 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102729 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.955 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:402 6.4 e33/27 6:24c8e1ae:gc::gc.19:head v 33'8, mlcod=33'6)", 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.726488295999999, 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032167609999999998, 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192633+0000", 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6759999999999999e-06 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192645+0000", 2024-05-07T14:01:51.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2037e-05 2024-05-07T14:01:51.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192669+0000", 2024-05-07T14:01:51.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3723e-05 2024-05-07T14:01:51.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192683+0000", 2024-05-07T14:01:51.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4416000000000001e-05 2024-05-07T14:01:51.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192792+0000", 2024-05-07T14:01:51.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109029 2024-05-07T14:01:51.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192848+0000", 2024-05-07T14:01:51.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5674000000000003e-05 2024-05-07T14:01:51.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.195758+0000", 2024-05-07T14:01:51.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029099199999999999 2024-05-07T14:01:51.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.195848+0000", 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0285999999999996e-05 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:415 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.718782069, 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065364059999999998, 2024-05-07T14:01:51.960 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.961 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.961 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.961 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.961 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.961 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 415 2024-05-07T14:01:51.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.961 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:01:51.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:01:51.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200339+0000", 2024-05-07T14:01:51.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.826e-06 2024-05-07T14:01:51.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200348+0000", 2024-05-07T14:01:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0669999999999998e-06 2024-05-07T14:01:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200378+0000", 2024-05-07T14:01:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.968e-05 2024-05-07T14:01:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200393+0000", 2024-05-07T14:01:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5109999999999999e-05 2024-05-07T14:01:51.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200515+0000", 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121449 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200658+0000", 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014362199999999999 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200958+0000", 2024-05-07T14:01:51.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030029699999999999 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202106+0000", 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011475050000000001 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206707+0000", 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046009980000000002 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206791+0000", 2024-05-07T14:01:51.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4118999999999999e-05 2024-05-07T14:01:51.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206874+0000", 2024-05-07T14:01:51.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2732999999999995e-05 2024-05-07T14:01:51.966 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.966 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.966 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.966 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:417 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.966 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:01:51.967 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.716283978, 2024-05-07T14:01:51.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034776160000000002, 2024-05-07T14:01:51.967 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.967 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.967 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.967 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.967 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.967 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.967 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 417 2024-05-07T14:01:51.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.967 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202838+0000", 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3760000000000002e-06 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202872+0000", 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4379999999999999e-05 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202900+0000", 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8180000000000001e-05 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202915+0000", 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.486e-05 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203063+0000", 2024-05-07T14:01:51.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014788799999999999 2024-05-07T14:01:51.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203423+0000", 2024-05-07T14:01:51.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035942400000000001 2024-05-07T14:01:51.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:51.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.204005+0000", 2024-05-07T14:01:51.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058227599999999995 2024-05-07T14:01:51.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205280+0000", 2024-05-07T14:01:51.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012753 2024-05-07T14:01:51.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206135+0000", 2024-05-07T14:01:51.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00085444999999999998 2024-05-07T14:01:51.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206234+0000", 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9088999999999999e-05 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206313+0000", 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9393000000000004e-05 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:420 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.972 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.713947560000001, 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042372210000000002, 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 420 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:01:51.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:01:51.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205174+0000", 2024-05-07T14:01:51.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1100000000000001e-06 2024-05-07T14:01:51.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205186+0000", 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.169e-05 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205218+0000", 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2617000000000003e-05 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205240+0000", 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1331999999999998e-05 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205356+0000", 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011655 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205623+0000", 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026669399999999999 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206029+0000", 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040652 2024-05-07T14:01:51.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.208187+0000", 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021578439999999999 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209226+0000", 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001039058 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209305+0000", 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8650000000000001e-05 2024-05-07T14:01:51.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209409+0000", 2024-05-07T14:01:51.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104156 2024-05-07T14:01:51.978 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.978 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.978 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.978 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:429 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.978 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:01:51.978 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.708916518999999, 2024-05-07T14:01:51.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040139620000000003, 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 429 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:01:51.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210205+0000", 2024-05-07T14:01:51.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.66e-06 2024-05-07T14:01:51.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210228+0000", 2024-05-07T14:01:51.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-05-07T14:01:51.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210244+0000", 2024-05-07T14:01:51.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6339999999999999e-05 2024-05-07T14:01:51.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210256+0000", 2024-05-07T14:01:51.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1949e-05 2024-05-07T14:01:51.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210472+0000", 2024-05-07T14:01:51.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215529 2024-05-07T14:01:51.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210681+0000", 2024-05-07T14:01:51.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000208982 2024-05-07T14:01:51.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:51.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211154+0000", 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047321599999999999 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212660+0000", 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001506098 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214071+0000", 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014107429999999999 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214153+0000", 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1889000000000002e-05 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214217+0000", 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4336000000000002e-05 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:430 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.984 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.708570754999997, 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066752119999999998, 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 430 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210551+0000", 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210562+0000", 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0237e-05 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210586+0000", 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4066e-05 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210603+0000", 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.713e-05 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211799+0000", 2024-05-07T14:01:51.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001196127 2024-05-07T14:01:51.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211931+0000", 2024-05-07T14:01:51.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131629 2024-05-07T14:01:51.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:51.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212211+0000", 2024-05-07T14:01:51.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028005100000000002 2024-05-07T14:01:51.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.213288+0000", 2024-05-07T14:01:51.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010772760000000001 2024-05-07T14:01:51.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217047+0000", 2024-05-07T14:01:51.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037586569999999999 2024-05-07T14:01:51.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217127+0000", 2024-05-07T14:01:51.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0270000000000002e-05 2024-05-07T14:01:51.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217224+0000", 2024-05-07T14:01:51.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7139000000000006e-05 2024-05-07T14:01:51.990 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.990 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.990 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.990 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.990 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:01:51.991 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.701793479999999, 2024-05-07T14:01:51.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003780107, 2024-05-07T14:01:51.991 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.991 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.991 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.991 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.991 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:51.991 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:51.991 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 436 2024-05-07T14:01:51.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.991 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:51.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:51.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:01:51.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:51.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:01:51.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:51.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:51.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217328+0000", 2024-05-07T14:01:51.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:01:51.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:51.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217356+0000", 2024-05-07T14:01:51.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8158999999999999e-05 2024-05-07T14:01:51.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:51.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217377+0000", 2024-05-07T14:01:51.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1356999999999999e-05 2024-05-07T14:01:51.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:51.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217393+0000", 2024-05-07T14:01:51.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5569e-05 2024-05-07T14:01:51.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:51.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217882+0000", 2024-05-07T14:01:51.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00048937000000000004 2024-05-07T14:01:51.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:51.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218099+0000", 2024-05-07T14:01:51.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021691899999999999 2024-05-07T14:01:51.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218390+0000", 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029041800000000002 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220013+0000", 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016236169999999999 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220889+0000", 2024-05-07T14:01:51.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087619599999999998 2024-05-07T14:01:51.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:51.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221005+0000", 2024-05-07T14:01:51.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011569 2024-05-07T14:01:51.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:51.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221106+0000", 2024-05-07T14:01:51.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101122 2024-05-07T14:01:51.998 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.998 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:51.999 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:51.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:51.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:51.999 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:442 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:51.999 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:01:51.999 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.698171615, 2024-05-07T14:01:51.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003357184, 2024-05-07T14:01:51.999 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:51.999 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:51.999 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:51.999 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:51.999 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 442 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220950+0000", 2024-05-07T14:01:52.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:01:52.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220958+0000", 2024-05-07T14:01:52.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8429999999999999e-06 2024-05-07T14:01:52.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220979+0000", 2024-05-07T14:01:52.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0387e-05 2024-05-07T14:01:52.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220991+0000", 2024-05-07T14:01:52.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.181e-05 2024-05-07T14:01:52.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221218+0000", 2024-05-07T14:01:52.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022694100000000001 2024-05-07T14:01:52.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221362+0000", 2024-05-07T14:01:52.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014482899999999999 2024-05-07T14:01:52.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:52.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221628+0000", 2024-05-07T14:01:52.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026559799999999997 2024-05-07T14:01:52.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.223915+0000", 2024-05-07T14:01:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022864819999999998 2024-05-07T14:01:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224031+0000", 2024-05-07T14:01:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116759 2024-05-07T14:01:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224173+0000", 2024-05-07T14:01:52.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014127599999999999 2024-05-07T14:01:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224305+0000", 2024-05-07T14:01:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000132519 2024-05-07T14:01:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:482 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:01:52.005 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.675941166999998, 2024-05-07T14:01:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035275459999999999, 2024-05-07T14:01:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 482 2024-05-07T14:01:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243181+0000", 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243194+0000", 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3087e-05 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243224+0000", 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0546000000000002e-05 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243240+0000", 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5339999999999999e-05 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243379+0000", 2024-05-07T14:01:52.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139646 2024-05-07T14:01:52.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243576+0000", 2024-05-07T14:01:52.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019638300000000001 2024-05-07T14:01:52.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:52.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243838+0000", 2024-05-07T14:01:52.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026234300000000001 2024-05-07T14:01:52.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:52.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.244908+0000", 2024-05-07T14:01:52.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010696289999999999 2024-05-07T14:01:52.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:52.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246477+0000", 2024-05-07T14:01:52.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001569471 2024-05-07T14:01:52.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246596+0000", 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118892 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246706+0000", 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109899 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:563 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:01:52.011 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.616950736, 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00310239, 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 563 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:01:52.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:01:52.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302171+0000", 2024-05-07T14:01:52.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1169999999999998e-06 2024-05-07T14:01:52.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302182+0000", 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0679999999999999e-05 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302202+0000", 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0505000000000001e-05 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302218+0000", 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5990000000000001e-05 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302337+0000", 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119071 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302481+0000", 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014358200000000001 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302775+0000", 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029423399999999999 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.303826+0000", 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001051485 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305118+0000", 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001291234 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305205+0000", 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7672999999999999e-05 2024-05-07T14:01:52.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305271+0000", 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5819000000000001e-05 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.178192805000002, 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031794449999999999, 2024-05-07T14:01:52.017 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 856 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740929+0000", 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3e-06 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740942+0000", 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3183000000000001e-05 2024-05-07T14:01:52.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740968+0000", 2024-05-07T14:01:52.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5477e-05 2024-05-07T14:01:52.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740982+0000", 2024-05-07T14:01:52.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4273e-05 2024-05-07T14:01:52.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741169+0000", 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018701500000000001 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741382+0000", 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021331200000000001 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741696+0000", 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031337800000000001 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:52.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.742864+0000", 2024-05-07T14:01:52.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011688410000000001 2024-05-07T14:01:52.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:52.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.743952+0000", 2024-05-07T14:01:52.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001087221 2024-05-07T14:01:52.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.744037+0000", 2024-05-07T14:01:52.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5242999999999997e-05 2024-05-07T14:01:52.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.744106+0000", 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9202000000000006e-05 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:877 6.19 6:98c4c580:::obj_delete_at_hint.0000000100:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 44.127246161999999, 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033601709999999999, 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.023 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 877 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791875+0000", 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9e-06 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791884+0000", 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7069999999999998e-06 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791907+0000", 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2682999999999999e-05 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791919+0000", 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2763e-05 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792073+0000", 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153509 2024-05-07T14:01:52.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792439+0000", 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000366141 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792989+0000", 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055016899999999998 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.794288+0000", 2024-05-07T14:01:52.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00129885 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795070+0000", 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000781557 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795155+0000", 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5723000000000006e-05 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795234+0000", 2024-05-07T14:01:52.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8169000000000003e-05 2024-05-07T14:01:52.029 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.029 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.029 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.029 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.029 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.029 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:52.030 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:01:52.031 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:52.043+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:52.132 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:52.147+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:52.203 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:52.203 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:52.203 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:52.204 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:52.217 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:01:52.263 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:52.274+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:52.333 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:52.342+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:52.341 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:52.341 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:52.341 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:52.341 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:52.341 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:52.355 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:01:52.385 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:01:52.447 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:52.458+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:52.459 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:01:52.528 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:01:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.522805531000003, 2024-05-07T14:01:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089647730000000005, 2024-05-07T14:01:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 46 2024-05-07T14:01:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:01:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:01:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017451+0000", 2024-05-07T14:01:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9349999999999999e-06 2024-05-07T14:01:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017460+0000", 2024-05-07T14:01:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-05-07T14:01:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017481+0000", 2024-05-07T14:01:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0984000000000001e-05 2024-05-07T14:01:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017499+0000", 2024-05-07T14:01:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:01:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018689+0000", 2024-05-07T14:01:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001190303 2024-05-07T14:01:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018945+0000", 2024-05-07T14:01:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025626799999999998 2024-05-07T14:01:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022176+0000", 2024-05-07T14:01:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032308720000000001 2024-05-07T14:01:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026078+0000", 2024-05-07T14:01:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039018289999999999 2024-05-07T14:01:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026189+0000", 2024-05-07T14:01:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110775 2024-05-07T14:01:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026310+0000", 2024-05-07T14:01:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121023 2024-05-07T14:01:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026413+0000", 2024-05-07T14:01:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103346 2024-05-07T14:01:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94397682172928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:01:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.513382874999998, 2024-05-07T14:01:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032214489999999999, 2024-05-07T14:01:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 47 2024-05-07T14:01:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:01:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:01:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026873+0000", 2024-05-07T14:01:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4200000000000001e-06 2024-05-07T14:01:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026883+0000", 2024-05-07T14:01:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0017000000000001e-05 2024-05-07T14:01:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026904+0000", 2024-05-07T14:01:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0228999999999999e-05 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026917+0000", 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3594000000000001e-05 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027029+0000", 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011171900000000001 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027247+0000", 2024-05-07T14:01:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021786099999999999 2024-05-07T14:01:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027599+0000", 2024-05-07T14:01:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035225700000000003 2024-05-07T14:01:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029240+0000", 2024-05-07T14:01:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016408620000000001 2024-05-07T14:01:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029864+0000", 2024-05-07T14:01:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00062414399999999998 2024-05-07T14:01:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029939+0000", 2024-05-07T14:01:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4931999999999993e-05 2024-05-07T14:01:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030092+0000", 2024-05-07T14:01:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015341399999999999 2024-05-07T14:01:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:01:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.50133933, 2024-05-07T14:01:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021710919999999999, 2024-05-07T14:01:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 54 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:01:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038917+0000", 2024-05-07T14:01:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8720000000000002e-06 2024-05-07T14:01:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038929+0000", 2024-05-07T14:01:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1294999999999999e-05 2024-05-07T14:01:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038964+0000", 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5516999999999999e-05 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038983+0000", 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039074+0000", 2024-05-07T14:01:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1106999999999994e-05 2024-05-07T14:01:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039201+0000", 2024-05-07T14:01:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012714700000000001 2024-05-07T14:01:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039320+0000", 2024-05-07T14:01:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011861100000000001 2024-05-07T14:01:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040439+0000", 2024-05-07T14:01:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011193450000000001 2024-05-07T14:01:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040971+0000", 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053181599999999995 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041040+0000", 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8706000000000003e-05 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041086+0000", 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5883000000000001e-05 2024-05-07T14:01:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94397682168320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:01:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.498966918999997, 2024-05-07T14:01:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001933333, 2024-05-07T14:01:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 55 2024-05-07T14:01:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:01:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041288+0000", 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5200000000000001e-06 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041295+0000", 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3679999999999998e-06 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041315+0000", 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9826999999999998e-05 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041325+0000", 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0402e-05 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041403+0000", 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8404000000000004e-05 2024-05-07T14:01:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041479+0000", 2024-05-07T14:01:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5846999999999994e-05 2024-05-07T14:01:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041637+0000", 2024-05-07T14:01:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157699 2024-05-07T14:01:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.042503+0000", 2024-05-07T14:01:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086578899999999995 2024-05-07T14:01:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043108+0000", 2024-05-07T14:01:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060548999999999998 2024-05-07T14:01:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043158+0000", 2024-05-07T14:01:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9359e-05 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043220+0000", 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2627999999999997e-05 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:191 6.5 e30/27 6:a2ace8b3:::data_log.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.412542973000001, 2024-05-07T14:01:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00168714, 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127713+0000", 2024-05-07T14:01:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2290000000000002e-06 2024-05-07T14:01:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127727+0000", 2024-05-07T14:01:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4236999999999999e-05 2024-05-07T14:01:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127759+0000", 2024-05-07T14:01:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1402999999999997e-05 2024-05-07T14:01:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127772+0000", 2024-05-07T14:01:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3227000000000001e-05 2024-05-07T14:01:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127895+0000", 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012357500000000001 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127929+0000", 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3599999999999997e-05 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129322+0000", 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001392936 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129398+0000", 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5933000000000006e-05 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.500360602000001, 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386840000000002, 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039894+0000", 2024-05-07T14:01:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9999999999999996e-07 2024-05-07T14:01:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039906+0000", 2024-05-07T14:01:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-05 2024-05-07T14:01:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039948+0000", 2024-05-07T14:01:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1983000000000001e-05 2024-05-07T14:01:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039975+0000", 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7120000000000001e-05 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040144+0000", 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016912200000000001 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040195+0000", 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1023000000000003e-05 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043654+0000", 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034590089999999999 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043732+0000", 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7557000000000003e-05 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:215 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.474823436000001, 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017783440000000001, 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:01:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065432+0000", 2024-05-07T14:01:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8300000000000001e-06 2024-05-07T14:01:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065444+0000", 2024-05-07T14:01:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2227e-05 2024-05-07T14:01:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065472+0000", 2024-05-07T14:01:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7983e-05 2024-05-07T14:01:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065487+0000", 2024-05-07T14:01:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.45e-05 2024-05-07T14:01:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065628+0000", 2024-05-07T14:01:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014118900000000001 2024-05-07T14:01:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065700+0000", 2024-05-07T14:01:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1521999999999997e-05 2024-05-07T14:01:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067097+0000", 2024-05-07T14:01:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00139784 2024-05-07T14:01:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067209+0000", 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111253 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:221 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'3, mlcod=33'1)", 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.451023137, 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016799510000000001, 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:01:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089233+0000", 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.877e-06 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089244+0000", 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1323e-05 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089272+0000", 2024-05-07T14:01:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8204e-05 2024-05-07T14:01:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089285+0000", 2024-05-07T14:01:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3223e-05 2024-05-07T14:01:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089425+0000", 2024-05-07T14:01:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013934900000000001 2024-05-07T14:01:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089487+0000", 2024-05-07T14:01:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2459000000000006e-05 2024-05-07T14:01:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090785+0000", 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012974900000000001 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090911+0000", 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126026 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-07T14:01:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.414746192999999, 2024-05-07T14:01:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020505779999999999, 2024-05-07T14:01:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:01:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125517+0000", 2024-05-07T14:01:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.833e-06 2024-05-07T14:01:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125569+0000", 2024-05-07T14:01:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1619999999999997e-05 2024-05-07T14:01:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125589+0000", 2024-05-07T14:01:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0803000000000001e-05 2024-05-07T14:01:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125733+0000", 2024-05-07T14:01:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014308600000000001 2024-05-07T14:01:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125786+0000", 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3158999999999997e-05 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127460+0000", 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001674493 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127558+0000", 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7967000000000006e-05 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:337 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'5, mlcod=33'3)", 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.373348481999997, 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004459658, 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166908+0000", 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2259999999999999e-06 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166922+0000", 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4780000000000001e-05 2024-05-07T14:01:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166960+0000", 2024-05-07T14:01:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8173000000000002e-05 2024-05-07T14:01:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166981+0000", 2024-05-07T14:01:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0440000000000001e-05 2024-05-07T14:01:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167154+0000", 2024-05-07T14:01:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017287199999999999 2024-05-07T14:01:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167207+0000", 2024-05-07T14:01:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000001e-05 2024-05-07T14:01:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171283+0000", 2024-05-07T14:01:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004076278 2024-05-07T14:01:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171365+0000", 2024-05-07T14:01:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1588999999999994e-05 2024-05-07T14:01:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:349 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:01:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.372473685999999, 2024-05-07T14:01:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042886440000000003, 2024-05-07T14:01:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:01:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:01:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167782+0000", 2024-05-07T14:01:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:01:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167797+0000", 2024-05-07T14:01:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4533e-05 2024-05-07T14:01:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167828+0000", 2024-05-07T14:01:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1239999999999999e-05 2024-05-07T14:01:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167859+0000", 2024-05-07T14:01:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1007000000000003e-05 2024-05-07T14:01:52.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168041+0000", 2024-05-07T14:01:52.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181788 2024-05-07T14:01:52.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168095+0000", 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3857000000000003e-05 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171961+0000", 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038664160000000001 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172069+0000", 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107793 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.592 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:357 6.5 e33/27 6:a60f9269:lc::lua_package_allowlist:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.370304955999998, 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002145817, 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:01:52.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:01:52.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169950+0000", 2024-05-07T14:01:52.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.626e-06 2024-05-07T14:01:52.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169963+0000", 2024-05-07T14:01:52.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2619999999999999e-05 2024-05-07T14:01:52.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169990+0000", 2024-05-07T14:01:52.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7084e-05 2024-05-07T14:01:52.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170003+0000", 2024-05-07T14:01:52.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3312999999999999e-05 2024-05-07T14:01:52.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170144+0000", 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140376 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170203+0000", 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9586000000000002e-05 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172022+0000", 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018187419999999999 2024-05-07T14:01:52.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172095+0000", 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2470000000000002e-05 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:386 6.c e33/27 6:3677c228:::obj_delete_at_hint.0000000006:head v 33'1, mlcod=0'0)", 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.356774620000003, 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016811230000000001, 2024-05-07T14:01:52.597 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.598 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.598 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.598 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:01:52.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:01:52.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183481+0000", 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.756e-06 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183493+0000", 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.254e-05 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183520+0000", 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6809999999999999e-05 2024-05-07T14:01:52.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183539+0000", 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8233e-05 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183686+0000", 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147045 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183741+0000", 2024-05-07T14:01:52.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5380000000000002e-05 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185039+0000", 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012981500000000001 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185160+0000", 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121209 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.602 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:604 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'10, mlcod=33'8)", 2024-05-07T14:01:52.602 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:01:52.602 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.210913771999998, 2024-05-07T14:01:52.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003281431, 2024-05-07T14:01:52.602 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.602 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.602 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.602 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:01:52.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329341+0000", 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.42e-06 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329351+0000", 2024-05-07T14:01:52.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0002e-05 2024-05-07T14:01:52.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329373+0000", 2024-05-07T14:01:52.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1209e-05 2024-05-07T14:01:52.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329384+0000", 2024-05-07T14:01:52.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1161999999999999e-05 2024-05-07T14:01:52.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329495+0000", 2024-05-07T14:01:52.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111302 2024-05-07T14:01:52.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329522+0000", 2024-05-07T14:01:52.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7291999999999999e-05 2024-05-07T14:01:52.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332531+0000", 2024-05-07T14:01:52.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003008405 2024-05-07T14:01:52.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332621+0000", 2024-05-07T14:01:52.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0638999999999997e-05 2024-05-07T14:01:52.606 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.606 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.606 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.606 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:656 6.1 e33/27 6:84d19476:::obj_delete_at_hint.0000000038:head v 33'5, mlcod=33'3)", 2024-05-07T14:01:52.606 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:01:52.606 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.164509654, 2024-05-07T14:01:52.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020273800000000001, 2024-05-07T14:01:52.607 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.607 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.607 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.607 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:01:52.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:01:52.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375746+0000", 2024-05-07T14:01:52.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0499999999999999e-06 2024-05-07T14:01:52.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375759+0000", 2024-05-07T14:01:52.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2952999999999999e-05 2024-05-07T14:01:52.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375789+0000", 2024-05-07T14:01:52.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9612999999999999e-05 2024-05-07T14:01:52.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375804+0000", 2024-05-07T14:01:52.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5449999999999999e-05 2024-05-07T14:01:52.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375931+0000", 2024-05-07T14:01:52.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126883 2024-05-07T14:01:52.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375972+0000", 2024-05-07T14:01:52.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0581999999999999e-05 2024-05-07T14:01:52.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377685+0000", 2024-05-07T14:01:52.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017136740000000001 2024-05-07T14:01:52.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377772+0000", 2024-05-07T14:01:52.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6174999999999994e-05 2024-05-07T14:01:52.613 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.613 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.615 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.615 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:665 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-07T14:01:52.615 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:01:52.615 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.156005395999998, 2024-05-07T14:01:52.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001677357, 2024-05-07T14:01:52.616 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.616 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.616 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.616 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:01:52.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:01:52.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384250+0000", 2024-05-07T14:01:52.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7099999999999999e-06 2024-05-07T14:01:52.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384261+0000", 2024-05-07T14:01:52.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.113e-05 2024-05-07T14:01:52.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384287+0000", 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6256000000000001e-05 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384301+0000", 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3443e-05 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384443+0000", 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142192 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384509+0000", 2024-05-07T14:01:52.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6124000000000006e-05 2024-05-07T14:01:52.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385819+0000", 2024-05-07T14:01:52.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013092889999999999 2024-05-07T14:01:52.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385926+0000", 2024-05-07T14:01:52.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010721300000000001 2024-05-07T14:01:52.622 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.622 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.622 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.622 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:685 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:52.623 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:01:52.623 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.139313201999997, 2024-05-07T14:01:52.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025309769999999998, 2024-05-07T14:01:52.623 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.623 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.623 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.623 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:01:52.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:01:52.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400943+0000", 2024-05-07T14:01:52.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0899999999999999e-06 2024-05-07T14:01:52.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400960+0000", 2024-05-07T14:01:52.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6917000000000001e-05 2024-05-07T14:01:52.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400995+0000", 2024-05-07T14:01:52.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5626000000000001e-05 2024-05-07T14:01:52.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401014+0000", 2024-05-07T14:01:52.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9126e-05 2024-05-07T14:01:52.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401164+0000", 2024-05-07T14:01:52.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149989 2024-05-07T14:01:52.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401218+0000", 2024-05-07T14:01:52.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3550000000000001e-05 2024-05-07T14:01:52.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403375+0000", 2024-05-07T14:01:52.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00215737 2024-05-07T14:01:52.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403472+0000", 2024-05-07T14:01:52.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6309000000000002e-05 2024-05-07T14:01:52.630 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.630 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.630 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.631 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:686 6.1f e33/27 6:f93251ce:::obj_delete_at_hint.0000000042:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:52.631 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:01:52.631 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.137863347, 2024-05-07T14:01:52.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037357750000000002, 2024-05-07T14:01:52.631 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.631 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.632 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.632 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:01:52.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:01:52.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402392+0000", 2024-05-07T14:01:52.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9870000000000002e-06 2024-05-07T14:01:52.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402405+0000", 2024-05-07T14:01:52.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.222e-05 2024-05-07T14:01:52.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402429+0000", 2024-05-07T14:01:52.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4729999999999999e-05 2024-05-07T14:01:52.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402448+0000", 2024-05-07T14:01:52.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8493000000000001e-05 2024-05-07T14:01:52.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402604+0000", 2024-05-07T14:01:52.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155876 2024-05-07T14:01:52.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402647+0000", 2024-05-07T14:01:52.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2793000000000002e-05 2024-05-07T14:01:52.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406039+0000", 2024-05-07T14:01:52.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033922760000000001 2024-05-07T14:01:52.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406126+0000", 2024-05-07T14:01:52.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7399999999999997e-05 2024-05-07T14:01:52.640 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.640 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.640 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.641 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:693 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'5, mlcod=33'3)", 2024-05-07T14:01:52.641 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:01:52.641 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.132136918, 2024-05-07T14:01:52.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037287790000000002, 2024-05-07T14:01:52.641 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.641 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.642 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.642 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:01:52.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:01:52.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408119+0000", 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0040000000000002e-06 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408135+0000", 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6155999999999999e-05 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408193+0000", 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8023999999999999e-05 2024-05-07T14:01:52.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408248+0000", 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4664999999999999e-05 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408410+0000", 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016263599999999999 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408462+0000", 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1913000000000003e-05 2024-05-07T14:01:52.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411739+0000", 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032768350000000001 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411846+0000", 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010654600000000001 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.645 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:694 6.5 e33/27 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 33'8, mlcod=33'6)", 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.129520583999998, 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038331400000000001, 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:52.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:01:52.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:52.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:52.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410735+0000", 2024-05-07T14:01:52.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.793e-06 2024-05-07T14:01:52.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:52.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410746+0000", 2024-05-07T14:01:52.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1377e-05 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410775+0000", 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8336000000000001e-05 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410788+0000", 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3074000000000001e-05 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410945+0000", 2024-05-07T14:01:52.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015738199999999999 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411009+0000", 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4276000000000006e-05 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414499+0000", 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034896060000000001 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:52.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414566+0000", 2024-05-07T14:01:52.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7296000000000001e-05 2024-05-07T14:01:52.650 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.650 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.650 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.650 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:52.650 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:52.650 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:52.651 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:52.652 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:52.653 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:01:52.653 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:52.662+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:52.653 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:52.654 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:52.656 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:52.656 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:52.677 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:52.677 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:52.698 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:52.698 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:52.719 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:52.719 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:52.737 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:52.737 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:52.752 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:52.767+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:52.829 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:52.829 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:52.843 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:01:52.853 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:52.867+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:52.954 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:52.962+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:52.966 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:52.966 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:52.980 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:01:53.067 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:53.078+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:53.145 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:53.146 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:53.155 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:53.166+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:53.159 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:01:53.256 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:53.270+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:53.289 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:53.290 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:53.303 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:01:53.356 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:53.366+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:53.431 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:53.442 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:01:53.488 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:53.503+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:53.558 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:53.571+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:53.565 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:53.565 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:53.574 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-07T14:01:53.575 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-07T14:01:53.575 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-05-07T14:01:53.575 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-05-07T14:01:53.579 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:01:53.658 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:53.666+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:53.737 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-05-07T14:01:53.744 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:53.744 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:53.759 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:01:53.760 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:53.771+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:53.860 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:53.874+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:53.893 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-05-07T14:01:53.923 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:53.923 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:53.938 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:01:53.980 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:53.995+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:54.051 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-05-07T14:01:54.095 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:54.095 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:54.096 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:54.107+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:54.109 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:01:54.196 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:54.211+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:54.200 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-05-07T14:01:54.269 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:54.269 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:54.269 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:54.283+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:54.282 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:01:54.376 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:54.391+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:54.408 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:01:54.412 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-05-07T14:01:54.439 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:54.439 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:54.454 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:01:54.466 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:54.478+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:54.567 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:54.578+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:54.592 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-05-07T14:01:54.614 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:54.615 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:54.628 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:01:54.672 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:54.687+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:54.742 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-05-07T14:01:54.755 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:01:54.769 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:54.782+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:54.780 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:54.780 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:54.794 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:01:54.884 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:54.898+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:54.913 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:54.913 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:54.929 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:54.929 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:54.945 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:54.950 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:54.950 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:54.961 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:54.961 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:54.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:01:54.971 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:54.982+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:54.981 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:54.982 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:55.002 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:55.002 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:55.022 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:55.022 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:55.042 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:55.089 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:01:55.089 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:01:55.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:01:55.089 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:01:55.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.089 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:01:55.089 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:55.089 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 53.100243751999997, 2024-05-07T14:01:55.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:01:55.090 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.090 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.090 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:01:55.090 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.090 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.090 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.090 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:01:55.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.090 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:01:55.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:01:55.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:01:55.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:01:55.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:01:55.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:01:55.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:01:55.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:01:55.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:01:55.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:01:55.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:01:55.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:01:55.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:01:55.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:01:55.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:01:55.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.095 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.095 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.095 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:55.095 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 48.079839931999999, 2024-05-07T14:01:55.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:01:55.095 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.095 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.096 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.096 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.096 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.096 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.096 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:01:55.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.096 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:01:55.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:01:55.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:01:55.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:01:55.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:01:55.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:01:55.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:01:55.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:01:55.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:01:55.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:01:55.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:01:55.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:01:55.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.977590218000003, 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036480649999999998, 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.102 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 231 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:01:55.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125133+0000", 2024-05-07T14:01:55.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.063e-06 2024-05-07T14:01:55.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125143+0000", 2024-05-07T14:01:55.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9769999999999995e-06 2024-05-07T14:01:55.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125170+0000", 2024-05-07T14:01:55.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7152999999999999e-05 2024-05-07T14:01:55.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125184+0000", 2024-05-07T14:01:55.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4372999999999999e-05 2024-05-07T14:01:55.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125295+0000", 2024-05-07T14:01:55.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111036 2024-05-07T14:01:55.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125510+0000", 2024-05-07T14:01:55.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215102 2024-05-07T14:01:55.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:55.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125920+0000", 2024-05-07T14:01:55.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040954700000000001 2024-05-07T14:01:55.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.127419+0000", 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001499261 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128635+0000", 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001215818 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128718+0000", 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3048999999999997e-05 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128779+0000", 2024-05-07T14:01:55.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0686000000000001e-05 2024-05-07T14:01:55.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.108 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.108 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:235 6.0 e33/27 6:013d6c33:gc::gc.30:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:55.108 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:55.108 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.962133197, 2024-05-07T14:01:55.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038113629999999999, 2024-05-07T14:01:55.108 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.108 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.109 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.109 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:55.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:01:55.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140590+0000", 2024-05-07T14:01:55.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:01:55.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140604+0000", 2024-05-07T14:01:55.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4324e-05 2024-05-07T14:01:55.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140640+0000", 2024-05-07T14:01:55.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6009e-05 2024-05-07T14:01:55.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140659+0000", 2024-05-07T14:01:55.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9340000000000001e-05 2024-05-07T14:01:55.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140815+0000", 2024-05-07T14:01:55.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155329 2024-05-07T14:01:55.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140868+0000", 2024-05-07T14:01:55.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3455999999999998e-05 2024-05-07T14:01:55.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144310+0000", 2024-05-07T14:01:55.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034414239999999998 2024-05-07T14:01:55.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144399+0000", 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9492000000000003e-05 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:400 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.911711801000003, 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039416900000000003, 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.113 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.114 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.114 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.114 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.114 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.114 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 400 2024-05-07T14:01:55.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.114 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:55.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:01:55.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191010+0000", 2024-05-07T14:01:55.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.09e-07 2024-05-07T14:01:55.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191014+0000", 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999996e-06 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191024+0000", 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0274e-05 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191030+0000", 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.789e-06 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191085+0000", 2024-05-07T14:01:55.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4741999999999999e-05 2024-05-07T14:01:55.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191169+0000", 2024-05-07T14:01:55.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4532999999999999e-05 2024-05-07T14:01:55.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:55.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191383+0000", 2024-05-07T14:01:55.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021415400000000001 2024-05-07T14:01:55.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194408+0000", 2024-05-07T14:01:55.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003024901 2024-05-07T14:01:55.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:55.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194860+0000", 2024-05-07T14:01:55.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045153599999999999 2024-05-07T14:01:55.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194915+0000", 2024-05-07T14:01:55.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4737999999999997e-05 2024-05-07T14:01:55.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194951+0000", 2024-05-07T14:01:55.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6183999999999998e-05 2024-05-07T14:01:55.119 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.119 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.119 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.120 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:403 6.2 e33/27 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:55.120 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:55.120 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.908614120999999, 2024-05-07T14:01:55.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003750841, 2024-05-07T14:01:55.120 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.120 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.120 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.120 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:55.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:01:55.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194108+0000", 2024-05-07T14:01:55.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.051e-06 2024-05-07T14:01:55.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194116+0000", 2024-05-07T14:01:55.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1149999999999994e-06 2024-05-07T14:01:55.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194128+0000", 2024-05-07T14:01:55.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1972e-05 2024-05-07T14:01:55.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194135+0000", 2024-05-07T14:01:55.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1130000000000003e-06 2024-05-07T14:01:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194191+0000", 2024-05-07T14:01:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:01:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194218+0000", 2024-05-07T14:01:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6242e-05 2024-05-07T14:01:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197807+0000", 2024-05-07T14:01:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003589283 2024-05-07T14:01:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197858+0000", 2024-05-07T14:01:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0572999999999998e-05 2024-05-07T14:01:55.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:415 6.7 e33/27 6:e622f76a:gc::gc.20:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.900912279000003, 2024-05-07T14:01:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044669840000000002, 2024-05-07T14:01:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:55.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:55.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:01:55.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1799999999999995e-07 2024-05-07T14:01:55.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201814+0000", 2024-05-07T14:01:55.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4170000000000002e-06 2024-05-07T14:01:55.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201824+0000", 2024-05-07T14:01:55.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0217999999999999e-05 2024-05-07T14:01:55.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201838+0000", 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3723000000000001e-05 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201890+0000", 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2320000000000001e-05 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201906+0000", 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5894999999999999e-05 2024-05-07T14:01:55.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206242+0000", 2024-05-07T14:01:55.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043366489999999997 2024-05-07T14:01:55.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206276+0000", 2024-05-07T14:01:55.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:01:55.129 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.129 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.129 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.130 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:432 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.130 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:55.130 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.889666699000003, 2024-05-07T14:01:55.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045128019999999998, 2024-05-07T14:01:55.130 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.130 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.130 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.130 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.130 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.130 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.130 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 432 2024-05-07T14:01:55.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.131 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:55.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:01:55.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213055+0000", 2024-05-07T14:01:55.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7000000000000005e-07 2024-05-07T14:01:55.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213058+0000", 2024-05-07T14:01:55.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0369999999999999e-06 2024-05-07T14:01:55.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213066+0000", 2024-05-07T14:01:55.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3680000000000002e-06 2024-05-07T14:01:55.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213084+0000", 2024-05-07T14:01:55.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7946999999999999e-05 2024-05-07T14:01:55.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213127+0000", 2024-05-07T14:01:55.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2673999999999998e-05 2024-05-07T14:01:55.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213222+0000", 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5488000000000005e-05 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213412+0000", 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000189307 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.214754+0000", 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001342069 2024-05-07T14:01:55.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:55.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217447+0000", 2024-05-07T14:01:55.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026931250000000002 2024-05-07T14:01:55.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217521+0000", 2024-05-07T14:01:55.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3997000000000003e-05 2024-05-07T14:01:55.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217567+0000", 2024-05-07T14:01:55.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6220000000000001e-05 2024-05-07T14:01:55.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.136 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.136 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:430 6.7 e33/27 6:e1cdb60d:reshard::reshard.0000000008:head v 33'9, mlcod=33'6)", 2024-05-07T14:01:55.136 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:55.136 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.889620215999997, 2024-05-07T14:01:55.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043702330000000003, 2024-05-07T14:01:55.136 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.136 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.137 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.137 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:55.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:55.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:01:55.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0400000000000005e-07 2024-05-07T14:01:55.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213107+0000", 2024-05-07T14:01:55.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5740000000000003e-06 2024-05-07T14:01:55.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213117+0000", 2024-05-07T14:01:55.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8349999999999999e-06 2024-05-07T14:01:55.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213122+0000", 2024-05-07T14:01:55.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5140000000000001e-06 2024-05-07T14:01:55.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213169+0000", 2024-05-07T14:01:55.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6551000000000002e-05 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213198+0000", 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217415+0000", 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042171090000000001 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217471+0000", 2024-05-07T14:01:55.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5766000000000001e-05 2024-05-07T14:01:55.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.141 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.141 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:480 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.141 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:55.141 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.861156061000003, 2024-05-07T14:01:55.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052104459999999997, 2024-05-07T14:01:55.142 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.142 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.142 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.142 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.142 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.142 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.142 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 480 2024-05-07T14:01:55.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.142 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:01:55.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6199999999999997e-07 2024-05-07T14:01:55.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241570+0000", 2024-05-07T14:01:55.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2479999999999998e-06 2024-05-07T14:01:55.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241580+0000", 2024-05-07T14:01:55.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8719999999999997e-06 2024-05-07T14:01:55.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241584+0000", 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7210000000000002e-06 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241629+0000", 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4465000000000002e-05 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241671+0000", 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2370999999999998e-05 2024-05-07T14:01:55.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241772+0000", 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101048 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.243876+0000", 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021036789999999998 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246710+0000", 2024-05-07T14:01:55.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028339060000000002 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246747+0000", 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7061000000000003e-05 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246775+0000", 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8413000000000001e-05 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:499 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.850275340000003, 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050166450000000001, 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 499 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.148 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:01:55.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4300000000000002e-07 2024-05-07T14:01:55.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252451+0000", 2024-05-07T14:01:55.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1290000000000004e-06 2024-05-07T14:01:55.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252463+0000", 2024-05-07T14:01:55.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1238e-05 2024-05-07T14:01:55.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252470+0000", 2024-05-07T14:01:55.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2019999999999998e-06 2024-05-07T14:01:55.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252534+0000", 2024-05-07T14:01:55.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4178999999999997e-05 2024-05-07T14:01:55.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252706+0000", 2024-05-07T14:01:55.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017197 2024-05-07T14:01:55.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:55.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252871+0000", 2024-05-07T14:01:55.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016508199999999999 2024-05-07T14:01:55.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:55.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254444+0000", 2024-05-07T14:01:55.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001573112 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257407+0000", 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029630989999999999 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257437+0000", 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0009999999999999e-05 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257462+0000", 2024-05-07T14:01:55.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4780999999999999e-05 2024-05-07T14:01:55.154 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.154 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.154 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.154 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:500 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.154 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:55.154 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.849989237000003, 2024-05-07T14:01:55.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046354220000000002, 2024-05-07T14:01:55.154 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.154 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.155 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.155 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.155 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.155 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.155 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 500 2024-05-07T14:01:55.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.155 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:55.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:01:55.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252733+0000", 2024-05-07T14:01:55.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9399999999999993e-07 2024-05-07T14:01:55.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252738+0000", 2024-05-07T14:01:55.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6779999999999997e-06 2024-05-07T14:01:55.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252750+0000", 2024-05-07T14:01:55.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1882000000000001e-05 2024-05-07T14:01:55.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252758+0000", 2024-05-07T14:01:55.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0649999999999999e-06 2024-05-07T14:01:55.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252811+0000", 2024-05-07T14:01:55.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2859000000000003e-05 2024-05-07T14:01:55.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252870+0000", 2024-05-07T14:01:55.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8956000000000003e-05 2024-05-07T14:01:55.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252992+0000", 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122275 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254326+0000", 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013334449999999999 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257254+0000", 2024-05-07T14:01:55.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029284039999999999 2024-05-07T14:01:55.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257316+0000", 2024-05-07T14:01:55.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1348999999999998e-05 2024-05-07T14:01:55.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257367+0000", 2024-05-07T14:01:55.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1514999999999997e-05 2024-05-07T14:01:55.160 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.160 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.161 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.161 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:510 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.161 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:55.161 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.843906597999997, 2024-05-07T14:01:55.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041639090000000004, 2024-05-07T14:01:55.161 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.161 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.161 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.161 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.161 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.161 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.162 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 510 2024-05-07T14:01:55.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.162 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:55.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:01:55.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258815+0000", 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258819+0000", 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0090000000000001e-06 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258828+0000", 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2529999999999993e-06 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258833+0000", 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7219999999999999e-06 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258870+0000", 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6368000000000001e-05 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258915+0000", 2024-05-07T14:01:55.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.528e-05 2024-05-07T14:01:55.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:55.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.259016+0000", 2024-05-07T14:01:55.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010074200000000001 2024-05-07T14:01:55.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.260655+0000", 2024-05-07T14:01:55.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016394999999999999 2024-05-07T14:01:55.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:55.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262752+0000", 2024-05-07T14:01:55.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002096531 2024-05-07T14:01:55.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262871+0000", 2024-05-07T14:01:55.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119645 2024-05-07T14:01:55.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262978+0000", 2024-05-07T14:01:55.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010695400000000001 2024-05-07T14:01:55.167 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.167 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.167 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.167 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:552 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.167 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:55.167 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.812147095999997, 2024-05-07T14:01:55.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042166790000000001, 2024-05-07T14:01:55.167 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.167 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.167 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.168 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.168 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.168 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.168 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 552 2024-05-07T14:01:55.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.168 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:55.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:01:55.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290575+0000", 2024-05-07T14:01:55.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.85e-07 2024-05-07T14:01:55.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290578+0000", 2024-05-07T14:01:55.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999999e-06 2024-05-07T14:01:55.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290587+0000", 2024-05-07T14:01:55.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.268e-06 2024-05-07T14:01:55.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290592+0000", 2024-05-07T14:01:55.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7029999999999997e-06 2024-05-07T14:01:55.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290694+0000", 2024-05-07T14:01:55.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101841 2024-05-07T14:01:55.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290840+0000", 2024-05-07T14:01:55.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014613899999999999 2024-05-07T14:01:55.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:55.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.291137+0000", 2024-05-07T14:01:55.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029714800000000001 2024-05-07T14:01:55.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292561+0000", 2024-05-07T14:01:55.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014235020000000001 2024-05-07T14:01:55.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:55.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294568+0000", 2024-05-07T14:01:55.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020076540000000002 2024-05-07T14:01:55.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294692+0000", 2024-05-07T14:01:55.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012394500000000001 2024-05-07T14:01:55.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294790+0000", 2024-05-07T14:01:55.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8194000000000002e-05 2024-05-07T14:01:55.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.174 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.175 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:553 6.f e33/27 6:f24cb4a8:gc::gc.31:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:55.175 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:55.175 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.809888237999999, 2024-05-07T14:01:55.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043350139999999999, 2024-05-07T14:01:55.175 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.175 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.175 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.175 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:55.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:55.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:01:55.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2900000000000004e-07 2024-05-07T14:01:55.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292838+0000", 2024-05-07T14:01:55.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5560000000000001e-06 2024-05-07T14:01:55.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292847+0000", 2024-05-07T14:01:55.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8619999999999992e-06 2024-05-07T14:01:55.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292851+0000", 2024-05-07T14:01:55.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9010000000000002e-06 2024-05-07T14:01:55.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292922+0000", 2024-05-07T14:01:55.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0827000000000005e-05 2024-05-07T14:01:55.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292973+0000", 2024-05-07T14:01:55.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0492999999999999e-05 2024-05-07T14:01:55.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297114+0000", 2024-05-07T14:01:55.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041408970000000002 2024-05-07T14:01:55.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297168+0000", 2024-05-07T14:01:55.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3949000000000001e-05 2024-05-07T14:01:55.180 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.180 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.180 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.181 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:686 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.181 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:55.181 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.700142352999997, 2024-05-07T14:01:55.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046254349999999998, 2024-05-07T14:01:55.181 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.181 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.181 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.181 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.181 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.182 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.182 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 686 2024-05-07T14:01:55.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.182 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:55.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:01:55.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402581+0000", 2024-05-07T14:01:55.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:01:55.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402592+0000", 2024-05-07T14:01:55.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0984e-05 2024-05-07T14:01:55.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402619+0000", 2024-05-07T14:01:55.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7583e-05 2024-05-07T14:01:55.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402633+0000", 2024-05-07T14:01:55.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3553000000000001e-05 2024-05-07T14:01:55.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402699+0000", 2024-05-07T14:01:55.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6013000000000006e-05 2024-05-07T14:01:55.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402792+0000", 2024-05-07T14:01:55.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3455999999999994e-05 2024-05-07T14:01:55.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:55.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402928+0000", 2024-05-07T14:01:55.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013596800000000001 2024-05-07T14:01:55.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:55.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.403918+0000", 2024-05-07T14:01:55.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00099017000000000007 2024-05-07T14:01:55.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407144+0000", 2024-05-07T14:01:55.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032257449999999999 2024-05-07T14:01:55.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407180+0000", 2024-05-07T14:01:55.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5462e-05 2024-05-07T14:01:55.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407204+0000", 2024-05-07T14:01:55.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4247999999999999e-05 2024-05-07T14:01:55.189 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.189 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.189 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.189 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.189 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:55.190 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.431230775000003, 2024-05-07T14:01:55.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003355448, 2024-05-07T14:01:55.190 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.190 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.190 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.190 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.190 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.190 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.190 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 826 2024-05-07T14:01:55.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.191 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:55.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:01:55.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671493+0000", 2024-05-07T14:01:55.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-06 2024-05-07T14:01:55.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671506+0000", 2024-05-07T14:01:55.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2746e-05 2024-05-07T14:01:55.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671542+0000", 2024-05-07T14:01:55.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6162999999999999e-05 2024-05-07T14:01:55.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671557+0000", 2024-05-07T14:01:55.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4786999999999999e-05 2024-05-07T14:01:55.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671705+0000", 2024-05-07T14:01:55.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000147792 2024-05-07T14:01:55.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671872+0000", 2024-05-07T14:01:55.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016705499999999999 2024-05-07T14:01:55.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:55.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.672101+0000", 2024-05-07T14:01:55.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022892999999999999 2024-05-07T14:01:55.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:55.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.673101+0000", 2024-05-07T14:01:55.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001000775 2024-05-07T14:01:55.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674701+0000", 2024-05-07T14:01:55.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016000599999999999 2024-05-07T14:01:55.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674795+0000", 2024-05-07T14:01:55.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3653000000000006e-05 2024-05-07T14:01:55.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674846+0000", 2024-05-07T14:01:55.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0473000000000003e-05 2024-05-07T14:01:55.197 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.197 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.197 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.197 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:868 6.f e33/27 6:f6792a7a:::obj_delete_at_hint.0000000097:head v 33'10, mlcod=33'8)", 2024-05-07T14:01:55.198 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:55.198 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.331826288999999, 2024-05-07T14:01:55.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033639339999999998, 2024-05-07T14:01:55.198 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.198 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.198 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.198 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:55.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:01:55.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770897+0000", 2024-05-07T14:01:55.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9700000000000002e-06 2024-05-07T14:01:55.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770909+0000", 2024-05-07T14:01:55.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2034e-05 2024-05-07T14:01:55.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770937+0000", 2024-05-07T14:01:55.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.796e-05 2024-05-07T14:01:55.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770954+0000", 2024-05-07T14:01:55.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7555999999999999e-05 2024-05-07T14:01:55.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771084+0000", 2024-05-07T14:01:55.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013033599999999999 2024-05-07T14:01:55.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771136+0000", 2024-05-07T14:01:55.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1925999999999997e-05 2024-05-07T14:01:55.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774168+0000", 2024-05-07T14:01:55.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030316200000000001 2024-05-07T14:01:55.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774259+0000", 2024-05-07T14:01:55.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0532000000000007e-05 2024-05-07T14:01:55.203 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.203 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.203 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.203 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.204 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:55.204 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.267836096000003, 2024-05-07T14:01:55.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035607859999999998, 2024-05-07T14:01:55.204 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.204 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.204 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.204 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.204 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.204 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.204 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 895 2024-05-07T14:01:55.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.205 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:55.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:01:55.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834888+0000", 2024-05-07T14:01:55.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.41e-06 2024-05-07T14:01:55.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834899+0000", 2024-05-07T14:01:55.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0987e-05 2024-05-07T14:01:55.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834929+0000", 2024-05-07T14:01:55.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9706e-05 2024-05-07T14:01:55.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834943+0000", 2024-05-07T14:01:55.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4354e-05 2024-05-07T14:01:55.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835100+0000", 2024-05-07T14:01:55.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156582 2024-05-07T14:01:55.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835499+0000", 2024-05-07T14:01:55.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000399214 2024-05-07T14:01:55.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:01:55.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.836052+0000", 2024-05-07T14:01:55.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00055334500000000001 2024-05-07T14:01:55.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:55.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.837279+0000", 2024-05-07T14:01:55.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012266270000000001 2024-05-07T14:01:55.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838177+0000", 2024-05-07T14:01:55.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089768699999999999 2024-05-07T14:01:55.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838332+0000", 2024-05-07T14:01:55.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155155 2024-05-07T14:01:55.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838446+0000", 2024-05-07T14:01:55.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113719 2024-05-07T14:01:55.211 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.211 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.212 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.212 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.212 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:55.212 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.260308567000003, 2024-05-07T14:01:55.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033546700000000001, 2024-05-07T14:01:55.213 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:01:55.213 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:01:55.213 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.213 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:01:55.213 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:01:55.213 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.213 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 898 2024-05-07T14:01:55.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.213 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:01:55.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:01:55.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:55.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:01:55.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:01:55.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:01:55.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:01:55.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842414+0000", 2024-05-07T14:01:55.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.863e-06 2024-05-07T14:01:55.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:01:55.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842425+0000", 2024-05-07T14:01:55.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0533000000000001e-05 2024-05-07T14:01:55.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:01:55.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842450+0000", 2024-05-07T14:01:55.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5259999999999999e-05 2024-05-07T14:01:55.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842463+0000", 2024-05-07T14:01:55.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3373000000000001e-05 2024-05-07T14:01:55.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:01:55.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842599+0000", 2024-05-07T14:01:55.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013549600000000001 2024-05-07T14:01:55.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.218 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:01:55.218 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842936+0000", 2024-05-07T14:01:55.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033763400000000001 2024-05-07T14:01:55.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.218 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:01:55.218 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.843484+0000", 2024-05-07T14:01:55.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054733899999999999 2024-05-07T14:01:55.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:01:55.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.844749+0000", 2024-05-07T14:01:55.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012656639999999999 2024-05-07T14:01:55.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845499+0000", 2024-05-07T14:01:55.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074904400000000003 2024-05-07T14:01:55.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:01:55.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845646+0000", 2024-05-07T14:01:55.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014709900000000001 2024-05-07T14:01:55.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:01:55.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:01:55.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:01:55.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845767+0000", 2024-05-07T14:01:55.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121365 2024-05-07T14:01:55.220 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.220 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.220 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.221 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:01:55.221 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:01:55.221 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:01:55.221 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:55.102+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:55.222 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:01:55.224 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:55.238+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:55.325 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:55.338+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:55.353 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:55.353 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:55.353 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:55.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:01:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:01:55.425 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:55.438+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:55.495 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:55.495 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:55.495 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:55.495 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:55.495 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:55.509 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:01:55.527 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:55.538+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:55.628 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:55.642+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:55.682 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:55.682 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.696265994999997, 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070064749999999999, 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.683 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 43 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994274+0000", 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7170000000000002e-06 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994292+0000", 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7819999999999999e-05 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994338+0000", 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6625999999999997e-05 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994362+0000", 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4063e-05 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994576+0000", 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021319500000000001 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994598+0000", 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2325999999999999e-05 2024-05-07T14:01:55.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001023+0000", 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00642546 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001277+0000", 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025326800000000002 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.687 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:46 7.1f e30/29 7:f95f44c2:::notify.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.668173338999999, 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031449519999999999, 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5700000000000002e-07 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022371+0000", 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7230000000000004e-06 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022396+0000", 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4406e-05 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022415+0000", 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9264999999999999e-05 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022641+0000", 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022584100000000001 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022702+0000", 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1513999999999994e-05 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.025418+0000", 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027162290000000001 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.025508+0000", 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9216999999999996e-05 2024-05-07T14:01:55.691 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.640636569000002, 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033678110000000001, 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.692 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 211 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049903+0000", 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.963e-06 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049917+0000", 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049950+0000", 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3328999999999999e-05 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049966+0000", 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6333000000000001e-05 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050100+0000", 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013305599999999999 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050363+0000", 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026392100000000002 2024-05-07T14:01:55.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:55.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050827+0000", 2024-05-07T14:01:55.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046316 2024-05-07T14:01:55.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.052269+0000", 2024-05-07T14:01:55.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014428760000000001 2024-05-07T14:01:55.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053111+0000", 2024-05-07T14:01:55.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084168999999999997 2024-05-07T14:01:55.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053198+0000", 2024-05-07T14:01:55.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6666e-05 2024-05-07T14:01:55.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053267+0000", 2024-05-07T14:01:55.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9503000000000002e-05 2024-05-07T14:01:55.697 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.697 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.698 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.698 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.698 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:55.698 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.562181873999997, 2024-05-07T14:01:55.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032702809999999999, 2024-05-07T14:01:55.698 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.698 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.698 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.698 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.698 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.698 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.699 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 232 2024-05-07T14:01:55.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.699 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:55.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:55.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128357+0000", 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1530000000000001e-06 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128369+0000", 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1823e-05 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128401+0000", 2024-05-07T14:01:55.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128416+0000", 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4997000000000001e-05 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128538+0000", 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121406 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128773+0000", 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235121 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.129230+0000", 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00045679999999999999 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.130836+0000", 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001606484 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131454+0000", 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061747199999999999 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131550+0000", 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6636000000000001e-05 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131624+0000", 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4315999999999998e-05 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.703 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:265 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.536529522000002, 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029442299999999999, 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 265 2024-05-07T14:01:55.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154009+0000", 2024-05-07T14:01:55.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.413e-06 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154023+0000", 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4229999999999999e-05 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154062+0000", 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9223e-05 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154085+0000", 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2909999999999999e-05 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154269+0000", 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183232 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154422+0000", 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015338799999999999 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154693+0000", 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000271005 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155957+0000", 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001263573 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156590+0000", 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00063392600000000004 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156844+0000", 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025348800000000001 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156951+0000", 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106842 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:277 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:55.709 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.534628056999999, 2024-05-07T14:01:55.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030861830000000002, 2024-05-07T14:01:55.710 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.710 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.710 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.710 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.710 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.710 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.710 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 277 2024-05-07T14:01:55.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.710 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155910+0000", 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155922+0000", 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2082999999999999e-05 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155967+0000", 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4855999999999999e-05 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155986+0000", 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.965e-05 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156173+0000", 2024-05-07T14:01:55.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018657299999999999 2024-05-07T14:01:55.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156479+0000", 2024-05-07T14:01:55.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030636299999999998 2024-05-07T14:01:55.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:55.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156975+0000", 2024-05-07T14:01:55.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00049533699999999999 2024-05-07T14:01:55.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158291+0000", 2024-05-07T14:01:55.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001316776 2024-05-07T14:01:55.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158712+0000", 2024-05-07T14:01:55.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042077999999999999 2024-05-07T14:01:55.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158885+0000", 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000172786 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158994+0000", 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109239 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:301 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:55.715 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.530604908000001, 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037043950000000001, 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 301 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:55.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159933+0000", 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6670000000000001e-06 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159943+0000", 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0176e-05 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159965+0000", 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2243e-05 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159980+0000", 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4747e-05 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160332+0000", 2024-05-07T14:01:55.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000352004 2024-05-07T14:01:55.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160574+0000", 2024-05-07T14:01:55.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241838 2024-05-07T14:01:55.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:55.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.161045+0000", 2024-05-07T14:01:55.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000471526 2024-05-07T14:01:55.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.162322+0000", 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001276241 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163376+0000", 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010539449999999999 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163516+0000", 2024-05-07T14:01:55.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014034599999999999 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163636+0000", 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011966199999999999 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:376 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.514489629000003, 2024-05-07T14:01:55.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038557209999999999, 2024-05-07T14:01:55.722 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.722 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.722 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.722 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.722 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.722 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.722 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 376 2024-05-07T14:01:55.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.722 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:55.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176049+0000", 2024-05-07T14:01:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:01:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176064+0000", 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.451e-05 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176101+0000", 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000003e-05 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176126+0000", 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176272+0000", 2024-05-07T14:01:55.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014592899999999999 2024-05-07T14:01:55.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176402+0000", 2024-05-07T14:01:55.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000129512 2024-05-07T14:01:55.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:55.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176725+0000", 2024-05-07T14:01:55.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032289800000000001 2024-05-07T14:01:55.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.177826+0000", 2024-05-07T14:01:55.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011017620000000001 2024-05-07T14:01:55.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179617+0000", 2024-05-07T14:01:55.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001791193 2024-05-07T14:01:55.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179781+0000", 2024-05-07T14:01:55.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016336899999999999 2024-05-07T14:01:55.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179902+0000", 2024-05-07T14:01:55.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012131899999999999 2024-05-07T14:01:55.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.727 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.727 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:397 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.501992539, 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034388040000000002, 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 397 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:55.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:55.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188546+0000", 2024-05-07T14:01:55.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2000000000000001e-06 2024-05-07T14:01:55.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188556+0000", 2024-05-07T14:01:55.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0557000000000001e-05 2024-05-07T14:01:55.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188590+0000", 2024-05-07T14:01:55.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3626e-05 2024-05-07T14:01:55.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188625+0000", 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5095999999999997e-05 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188768+0000", 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014279900000000001 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189124+0000", 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035646799999999998 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:55.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189633+0000", 2024-05-07T14:01:55.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000508903 2024-05-07T14:01:55.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.190638+0000", 2024-05-07T14:01:55.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001004465 2024-05-07T14:01:55.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191712+0000", 2024-05-07T14:01:55.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001074759 2024-05-07T14:01:55.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191871+0000", 2024-05-07T14:01:55.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835900000000001 2024-05-07T14:01:55.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191982+0000", 2024-05-07T14:01:55.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011157199999999999 2024-05-07T14:01:55.733 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.733 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.733 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.734 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:403 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.734 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:55.734 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.497849760999998, 2024-05-07T14:01:55.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004923172, 2024-05-07T14:01:55.734 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.734 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.734 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.734 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.734 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.734 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.734 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 403 2024-05-07T14:01:55.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192688+0000", 2024-05-07T14:01:55.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4640000000000001e-06 2024-05-07T14:01:55.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192696+0000", 2024-05-07T14:01:55.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9330000000000001e-06 2024-05-07T14:01:55.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192715+0000", 2024-05-07T14:01:55.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9746999999999999e-05 2024-05-07T14:01:55.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192726+0000", 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.026e-05 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192824+0000", 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8139000000000003e-05 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192971+0000", 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014717199999999999 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:55.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.193232+0000", 2024-05-07T14:01:55.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000260518 2024-05-07T14:01:55.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.196090+0000", 2024-05-07T14:01:55.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002858598 2024-05-07T14:01:55.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197464+0000", 2024-05-07T14:01:55.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001373399 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197549+0000", 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5261999999999998e-05 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197609+0000", 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0680000000000002e-05 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.740 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:472 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.740 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:55.740 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.453547248, 2024-05-07T14:01:55.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044650219999999999, 2024-05-07T14:01:55.740 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.740 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.740 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.740 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.740 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.740 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.740 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 472 2024-05-07T14:01:55.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236991+0000", 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8589999999999999e-06 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237001+0000", 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0465999999999999e-05 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237019+0000", 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7666999999999999e-05 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237030+0000", 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0917000000000001e-05 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237184+0000", 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015438499999999999 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237427+0000", 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024296499999999999 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237900+0000", 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047292599999999998 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.239253+0000", 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013527770000000001 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241246+0000", 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019933249999999998 2024-05-07T14:01:55.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241370+0000", 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012385599999999999 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241454+0000", 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3879000000000001e-05 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:501 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.436316042000001, 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029689030000000002, 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 501 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254222+0000", 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9580000000000001e-06 2024-05-07T14:01:55.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254246+0000", 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3521999999999999e-05 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254271+0000", 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5757000000000001e-05 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254284+0000", 2024-05-07T14:01:55.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254423+0000", 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013909 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254745+0000", 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032253700000000002 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.255261+0000", 2024-05-07T14:01:55.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051555899999999996 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.256343+0000", 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001081867 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257042+0000", 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069873699999999995 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257128+0000", 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6478999999999997e-05 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257189+0000", 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0810999999999998e-05 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:509 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:55.751 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.432659110000003, 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003433874, 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 509 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:55.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257878+0000", 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.528e-06 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257886+0000", 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2180000000000002e-06 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257903+0000", 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7484999999999999e-05 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257912+0000", 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0189999999999995e-06 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258007+0000", 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4627000000000001e-05 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258124+0000", 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116836 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258381+0000", 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025690899999999999 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.259428+0000", 2024-05-07T14:01:55.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047177 2024-05-07T14:01:55.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261154+0000", 2024-05-07T14:01:55.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017262180000000001 2024-05-07T14:01:55.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261224+0000", 2024-05-07T14:01:55.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9913000000000006e-05 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261311+0000", 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6944e-05 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:610 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.356104780999999, 2024-05-07T14:01:55.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031518679999999999, 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 610 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334434+0000", 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.34e-06 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334447+0000", 2024-05-07T14:01:55.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2976000000000001e-05 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334479+0000", 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2159999999999997e-05 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334495+0000", 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6722999999999999e-05 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334644+0000", 2024-05-07T14:01:55.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014812500000000001 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.335017+0000", 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037323400000000001 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.335408+0000", 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039102000000000001 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.336518+0000", 2024-05-07T14:01:55.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011105620000000001 2024-05-07T14:01:55.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337379+0000", 2024-05-07T14:01:55.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086063700000000003 2024-05-07T14:01:55.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337473+0000", 2024-05-07T14:01:55.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4332000000000004e-05 2024-05-07T14:01:55.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337583+0000", 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:625 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.345239448999997, 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039276240000000002, 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.763 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 625 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345300+0000", 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.067e-06 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345315+0000", 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4857e-05 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345344+0000", 2024-05-07T14:01:55.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9070000000000001e-05 2024-05-07T14:01:55.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345359+0000", 2024-05-07T14:01:55.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5656000000000001e-05 2024-05-07T14:01:55.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345512+0000", 2024-05-07T14:01:55.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015229600000000001 2024-05-07T14:01:55.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345764+0000", 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025252100000000002 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.346269+0000", 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000504613 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.347487+0000", 2024-05-07T14:01:55.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001218317 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349071+0000", 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015844279999999999 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349156+0000", 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4958999999999998e-05 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349224+0000", 2024-05-07T14:01:55.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7840000000000001e-05 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.233872554000001, 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031666649999999999, 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.769 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 727 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456665+0000", 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-06 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456675+0000", 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8500000000000006e-06 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456703+0000", 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7846000000000001e-05 2024-05-07T14:01:55.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456724+0000", 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0869999999999998e-05 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456850+0000", 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126069 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.457082+0000", 2024-05-07T14:01:55.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023258099999999999 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.457439+0000", 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000356115 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.458419+0000", 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00098032799999999993 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459682+0000", 2024-05-07T14:01:55.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012626339999999999 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459769+0000", 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7383e-05 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459830+0000", 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1235999999999994e-05 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.046441201, 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029415270000000002, 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 814 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.775 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644097+0000", 2024-05-07T14:01:55.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1500000000000002e-06 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644108+0000", 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1182999999999999e-05 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644140+0000", 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2283000000000002e-05 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644166+0000", 2024-05-07T14:01:55.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5703000000000001e-05 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644360+0000", 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019352200000000001 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644571+0000", 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000210915 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:55.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644899+0000", 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032880799999999999 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.645976+0000", 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001076458 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.646896+0000", 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091987999999999998 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.646975+0000", 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9165999999999994e-05 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.647036+0000", 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1458999999999996e-05 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.780 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.891272315000002, 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031874479999999998, 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 880 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799266+0000", 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.723e-06 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799280+0000", 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3159999999999999e-05 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799311+0000", 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1083e-05 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799327+0000", 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5883e-05 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799438+0000", 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011096599999999999 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799670+0000", 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023280800000000001 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.800012+0000", 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034192800000000002 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.801133+0000", 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011206009999999999 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802179+0000", 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010458080000000001 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802341+0000", 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162533 2024-05-07T14:01:55.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802451+0000", 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109955 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.886610507999997, 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031185649999999998, 2024-05-07T14:01:55.786 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 882 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803928+0000", 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.266e-06 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803939+0000", 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1372999999999999e-05 2024-05-07T14:01:55.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803972+0000", 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803987+0000", 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5126999999999999e-05 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804111+0000", 2024-05-07T14:01:55.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012420199999999999 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804326+0000", 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215262 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804794+0000", 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046816000000000002 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806221+0000", 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014263749999999999 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806759+0000", 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053796200000000001 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806936+0000", 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017753300000000001 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.807044+0000", 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107865 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.787925573000003, 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029448970000000001, 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:55.792 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 925 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:55.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902613+0000", 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9999999999999999e-06 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902623+0000", 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0453e-05 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:55.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902653+0000", 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9556e-05 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902670+0000", 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7887e-05 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902785+0000", 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114295 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.903018+0000", 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023349899999999999 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.903329+0000", 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031125100000000002 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.904399+0000", 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001069162 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905354+0000", 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095526300000000003 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905441+0000", 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6854999999999994e-05 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905555+0000", 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114676 2024-05-07T14:01:55.797 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.798 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.798 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.798 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:55.798 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:55.798 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:55.799 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:01:55.800 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:55.814+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:55.901 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:55.914+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:55.969 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:55.970 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:55.970 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:55.970 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:55.984 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:01:56.032 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:01:56.046+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:01:56.102 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:56.114+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:56.154 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:56.155 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:56.155 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:56.155 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:56.155 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:56.169 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:01:56.203 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:56.218+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:56.299 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:56.299 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:56.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:56.299 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:56.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.299 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:56.299 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:01:56.299 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.280246681999998, 2024-05-07T14:01:56.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033108180000000001, 2024-05-07T14:01:56.299 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.299 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 48 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026898+0000", 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2369999999999999e-06 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026908+0000", 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8109999999999997e-06 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026934+0000", 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6746000000000001e-05 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026949+0000", 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4517e-05 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027084+0000", 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013501499999999999 2024-05-07T14:01:56.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027360+0000", 2024-05-07T14:01:56.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027639199999999998 2024-05-07T14:01:56.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:56.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027616+0000", 2024-05-07T14:01:56.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025541799999999999 2024-05-07T14:01:56.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.028902+0000", 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012859989999999999 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030044+0000", 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001142295 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030136+0000", 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1794999999999998e-05 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030206+0000", 2024-05-07T14:01:56.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0593000000000007e-05 2024-05-07T14:01:56.305 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.305 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.305 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.305 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:01:56.305 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:01:56.305 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.294772772999998, 2024-05-07T14:01:56.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058205720000000004, 2024-05-07T14:01:56.305 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.305 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.305 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.306 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.306 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.306 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.306 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 205 2024-05-07T14:01:56.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.306 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:01:56.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012373+0000", 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.07e-06 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012397+0000", 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3697e-05 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012450+0000", 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2539e-05 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012477+0000", 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7457000000000002e-05 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012735+0000", 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025820800000000001 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013057+0000", 2024-05-07T14:01:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000321727 2024-05-07T14:01:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013752+0000", 2024-05-07T14:01:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069509499999999996 2024-05-07T14:01:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.017093+0000", 2024-05-07T14:01:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033404340000000002 2024-05-07T14:01:56.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018024+0000", 2024-05-07T14:01:56.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00093108600000000002 2024-05-07T14:01:56.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018113+0000", 2024-05-07T14:01:56.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9752000000000004e-05 2024-05-07T14:01:56.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018190+0000", 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6507000000000005e-05 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.224521785, 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052341489999999996, 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.311 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.312 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.312 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.312 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.312 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 220 2024-05-07T14:01:56.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.312 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:01:56.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:01:56.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082623+0000", 2024-05-07T14:01:56.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8370000000000001e-06 2024-05-07T14:01:56.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082636+0000", 2024-05-07T14:01:56.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2316e-05 2024-05-07T14:01:56.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082667+0000", 2024-05-07T14:01:56.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1139999999999997e-05 2024-05-07T14:01:56.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082681+0000", 2024-05-07T14:01:56.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4816e-05 2024-05-07T14:01:56.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082825+0000", 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014377899999999999 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083051+0000", 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022549500000000001 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083453+0000", 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000401944 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.085929+0000", 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024763369999999999 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087649+0000", 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001719747 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087735+0000", 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6415999999999994e-05 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087855+0000", 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011932199999999999 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.212102053999999, 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00342407, 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.317 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 223 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095042+0000", 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1799999999999999e-06 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095054+0000", 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1817000000000001e-05 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095084+0000", 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0018999999999998e-05 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095099+0000", 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.537e-05 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095209+0000", 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010943299999999999 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095457+0000", 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247941 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095879+0000", 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042171299999999999 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.097290+0000", 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014118519999999999 2024-05-07T14:01:56.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098196+0000", 2024-05-07T14:01:56.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00090603700000000005 2024-05-07T14:01:56.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098348+0000", 2024-05-07T14:01:56.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151879 2024-05-07T14:01:56.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098464+0000", 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011582900000000001 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.204561853000001, 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031839889999999999, 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 225 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102582+0000", 2024-05-07T14:01:56.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:01:56.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102594+0000", 2024-05-07T14:01:56.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1382999999999999e-05 2024-05-07T14:01:56.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102625+0000", 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0880000000000002e-05 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102640+0000", 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4949999999999999e-05 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102756+0000", 2024-05-07T14:01:56.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116072 2024-05-07T14:01:56.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102998+0000", 2024-05-07T14:01:56.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024203199999999999 2024-05-07T14:01:56.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:56.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.103438+0000", 2024-05-07T14:01:56.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044011700000000001 2024-05-07T14:01:56.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105252+0000", 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018136490000000001 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105608+0000", 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035604000000000001 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105699+0000", 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1316999999999993e-05 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105764+0000", 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5371999999999997e-05 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.201085505999998, 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003090256, 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.329 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 226 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:01:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106059+0000", 2024-05-07T14:01:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3e-06 2024-05-07T14:01:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106070+0000", 2024-05-07T14:01:56.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1257000000000001e-05 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106101+0000", 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0783e-05 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106116+0000", 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5136e-05 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106217+0000", 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101183 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106433+0000", 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021523199999999999 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106826+0000", 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039372000000000002 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.108406+0000", 2024-05-07T14:01:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001579815 2024-05-07T14:01:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.108987+0000", 2024-05-07T14:01:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058058100000000004 2024-05-07T14:01:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.109073+0000", 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6650000000000006e-05 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.109147+0000", 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3598999999999998e-05 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:01:56.335 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.171633102999998, 2024-05-07T14:01:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030980790000000001, 2024-05-07T14:01:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 234 2024-05-07T14:01:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135511+0000", 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4030000000000001e-06 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135523+0000", 2024-05-07T14:01:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1559999999999999e-05 2024-05-07T14:01:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135557+0000", 2024-05-07T14:01:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4372999999999998e-05 2024-05-07T14:01:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135572+0000", 2024-05-07T14:01:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4647000000000001e-05 2024-05-07T14:01:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135674+0000", 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101932 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135888+0000", 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000213995 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.136311+0000", 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042278999999999998 2024-05-07T14:01:56.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.137726+0000", 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001415319 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138450+0000", 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00072404800000000003 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138543+0000", 2024-05-07T14:01:56.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2559000000000006e-05 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138607+0000", 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4453000000000001e-05 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.152583081000003, 2024-05-07T14:01:56.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035934819999999998, 2024-05-07T14:01:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 271 2024-05-07T14:01:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:01:56.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154562+0000", 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154578+0000", 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6667000000000002e-05 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154612+0000", 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3120000000000001e-05 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154632+0000", 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0769999999999999e-05 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154774+0000", 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141805 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155004+0000", 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022938200000000001 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155372+0000", 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036889300000000002 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156948+0000", 2024-05-07T14:01:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015755750000000001 2024-05-07T14:01:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.157903+0000", 2024-05-07T14:01:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095453499999999995 2024-05-07T14:01:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158050+0000", 2024-05-07T14:01:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147279 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158153+0000", 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102729 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:402 6.4 e33/27 6:24c8e1ae:gc::gc.19:head v 33'8, mlcod=33'6)", 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.114510946999999, 2024-05-07T14:01:56.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032167609999999998, 2024-05-07T14:01:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:01:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:01:56.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192633+0000", 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6759999999999999e-06 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192645+0000", 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2037e-05 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192669+0000", 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3723e-05 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192683+0000", 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4416000000000001e-05 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192792+0000", 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109029 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192848+0000", 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5674000000000003e-05 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.195758+0000", 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029099199999999999 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.195848+0000", 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0285999999999996e-05 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.351 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:415 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.10680472, 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065364059999999998, 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.352 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 415 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200339+0000", 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.826e-06 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200348+0000", 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0669999999999998e-06 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200378+0000", 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.968e-05 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200393+0000", 2024-05-07T14:01:56.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5109999999999999e-05 2024-05-07T14:01:56.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200515+0000", 2024-05-07T14:01:56.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121449 2024-05-07T14:01:56.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200658+0000", 2024-05-07T14:01:56.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014362199999999999 2024-05-07T14:01:56.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200958+0000", 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030029699999999999 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202106+0000", 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011475050000000001 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206707+0000", 2024-05-07T14:01:56.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046009980000000002 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206791+0000", 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4118999999999999e-05 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206874+0000", 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2732999999999995e-05 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.358 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:417 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.358 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:01:56.358 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.104306629, 2024-05-07T14:01:56.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034776160000000002, 2024-05-07T14:01:56.358 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.358 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.358 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.358 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.358 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.358 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.358 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 417 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202838+0000", 2024-05-07T14:01:56.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3760000000000002e-06 2024-05-07T14:01:56.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202872+0000", 2024-05-07T14:01:56.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4379999999999999e-05 2024-05-07T14:01:56.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202900+0000", 2024-05-07T14:01:56.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8180000000000001e-05 2024-05-07T14:01:56.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202915+0000", 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.486e-05 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203063+0000", 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014788799999999999 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203423+0000", 2024-05-07T14:01:56.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035942400000000001 2024-05-07T14:01:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.204005+0000", 2024-05-07T14:01:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058227599999999995 2024-05-07T14:01:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205280+0000", 2024-05-07T14:01:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012753 2024-05-07T14:01:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206135+0000", 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00085444999999999998 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206234+0000", 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9088999999999999e-05 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206313+0000", 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9393000000000004e-05 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.363 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.364 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:420 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.364 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:01:56.364 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.101970211000001, 2024-05-07T14:01:56.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042372210000000002, 2024-05-07T14:01:56.364 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.364 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.364 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.364 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.364 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.364 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.364 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 420 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205174+0000", 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1100000000000001e-06 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205186+0000", 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.169e-05 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205218+0000", 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2617000000000003e-05 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205240+0000", 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1331999999999998e-05 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205356+0000", 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011655 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205623+0000", 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026669399999999999 2024-05-07T14:01:56.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206029+0000", 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040652 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.208187+0000", 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021578439999999999 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209226+0000", 2024-05-07T14:01:56.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001039058 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209305+0000", 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8650000000000001e-05 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209409+0000", 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104156 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:429 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.096939169999999, 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040139620000000003, 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 429 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.370 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210205+0000", 2024-05-07T14:01:56.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.66e-06 2024-05-07T14:01:56.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210228+0000", 2024-05-07T14:01:56.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-05-07T14:01:56.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210244+0000", 2024-05-07T14:01:56.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6339999999999999e-05 2024-05-07T14:01:56.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210256+0000", 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1949e-05 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210472+0000", 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215529 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210681+0000", 2024-05-07T14:01:56.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000208982 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211154+0000", 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047321599999999999 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212660+0000", 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001506098 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214071+0000", 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014107429999999999 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214153+0000", 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1889000000000002e-05 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214217+0000", 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4336000000000002e-05 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.375 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:430 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.096593405999997, 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066752119999999998, 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 430 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.376 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210551+0000", 2024-05-07T14:01:56.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210562+0000", 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0237e-05 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210586+0000", 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4066e-05 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210603+0000", 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.713e-05 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211799+0000", 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001196127 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211931+0000", 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131629 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212211+0000", 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028005100000000002 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.213288+0000", 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010772760000000001 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217047+0000", 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037586569999999999 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217127+0000", 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0270000000000002e-05 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217224+0000", 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7139000000000006e-05 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.381 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.382 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:01:56.382 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.089816130999999, 2024-05-07T14:01:56.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003780107, 2024-05-07T14:01:56.382 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.382 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.382 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.382 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.382 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.382 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.382 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 436 2024-05-07T14:01:56.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.382 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:01:56.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:01:56.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217328+0000", 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217356+0000", 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8158999999999999e-05 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217377+0000", 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1356999999999999e-05 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217393+0000", 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5569e-05 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217882+0000", 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00048937000000000004 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218099+0000", 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021691899999999999 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218390+0000", 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029041800000000002 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220013+0000", 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016236169999999999 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220889+0000", 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087619599999999998 2024-05-07T14:01:56.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221005+0000", 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011569 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221106+0000", 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101122 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:442 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.086194266, 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003357184, 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 442 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220950+0000", 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220958+0000", 2024-05-07T14:01:56.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8429999999999999e-06 2024-05-07T14:01:56.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220979+0000", 2024-05-07T14:01:56.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0387e-05 2024-05-07T14:01:56.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220991+0000", 2024-05-07T14:01:56.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.181e-05 2024-05-07T14:01:56.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221218+0000", 2024-05-07T14:01:56.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022694100000000001 2024-05-07T14:01:56.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221362+0000", 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014482899999999999 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221628+0000", 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026559799999999997 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.223915+0000", 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022864819999999998 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224031+0000", 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116759 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224173+0000", 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014127599999999999 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224305+0000", 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000132519 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.393 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:482 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.063963817999998, 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035275459999999999, 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 482 2024-05-07T14:01:56.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.395 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:01:56.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:01:56.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243181+0000", 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243194+0000", 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3087e-05 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243224+0000", 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0546000000000002e-05 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243240+0000", 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5339999999999999e-05 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243379+0000", 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139646 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243576+0000", 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019638300000000001 2024-05-07T14:01:56.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:56.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243838+0000", 2024-05-07T14:01:56.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026234300000000001 2024-05-07T14:01:56.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.244908+0000", 2024-05-07T14:01:56.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010696289999999999 2024-05-07T14:01:56.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246477+0000", 2024-05-07T14:01:56.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001569471 2024-05-07T14:01:56.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246596+0000", 2024-05-07T14:01:56.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118892 2024-05-07T14:01:56.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246706+0000", 2024-05-07T14:01:56.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109899 2024-05-07T14:01:56.399 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.399 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:563 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.004973387, 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00310239, 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.400 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 563 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302171+0000", 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1169999999999998e-06 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302182+0000", 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0679999999999999e-05 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302202+0000", 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0505000000000001e-05 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302218+0000", 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5990000000000001e-05 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302337+0000", 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119071 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302481+0000", 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014358200000000001 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302775+0000", 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029423399999999999 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.303826+0000", 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001051485 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305118+0000", 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001291234 2024-05-07T14:01:56.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305205+0000", 2024-05-07T14:01:56.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7672999999999999e-05 2024-05-07T14:01:56.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305271+0000", 2024-05-07T14:01:56.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5819000000000001e-05 2024-05-07T14:01:56.405 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.405 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.405 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.406 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.406 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:01:56.406 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.566215456000002, 2024-05-07T14:01:56.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031794449999999999, 2024-05-07T14:01:56.406 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.406 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.406 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.406 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.406 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.406 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.406 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 856 2024-05-07T14:01:56.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740929+0000", 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3e-06 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740942+0000", 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3183000000000001e-05 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740968+0000", 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5477e-05 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740982+0000", 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4273e-05 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741169+0000", 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018701500000000001 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741382+0000", 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021331200000000001 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741696+0000", 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031337800000000001 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.742864+0000", 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011688410000000001 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.743952+0000", 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001087221 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.744037+0000", 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5242999999999997e-05 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.744106+0000", 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9202000000000006e-05 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.411 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:877 6.19 6:98c4c580:::obj_delete_at_hint.0000000100:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 48.515268812999999, 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033601709999999999, 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 877 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791875+0000", 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9e-06 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791884+0000", 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7069999999999998e-06 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791907+0000", 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2682999999999999e-05 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791919+0000", 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2763e-05 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792073+0000", 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153509 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792439+0000", 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000366141 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792989+0000", 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055016899999999998 2024-05-07T14:01:56.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.794288+0000", 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00129885 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795070+0000", 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000781557 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795155+0000", 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5723000000000006e-05 2024-05-07T14:01:56.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795234+0000", 2024-05-07T14:01:56.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8169000000000003e-05 2024-05-07T14:01:56.417 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.417 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.417 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.417 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.417 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.417 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:56.419 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:01:56.419 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:56.430+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:56.520 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:56.534+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:56.588 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:56.588 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:56.588 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:56.588 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:56.604 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:01:56.621 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:56.634+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:56.722 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:01:56.734+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:01:56.773 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:56.774 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:56.774 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:56.774 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:56.774 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:56.787 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:01:56.831 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:56.846+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:56.915 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:01:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.909335673999998, 2024-05-07T14:01:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089647730000000005, 2024-05-07T14:01:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 46 2024-05-07T14:01:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017451+0000", 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9349999999999999e-06 2024-05-07T14:01:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017460+0000", 2024-05-07T14:01:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-05-07T14:01:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017481+0000", 2024-05-07T14:01:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0984000000000001e-05 2024-05-07T14:01:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017499+0000", 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018689+0000", 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001190303 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018945+0000", 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025626799999999998 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022176+0000", 2024-05-07T14:01:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032308720000000001 2024-05-07T14:01:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026078+0000", 2024-05-07T14:01:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039018289999999999 2024-05-07T14:01:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026189+0000", 2024-05-07T14:01:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110775 2024-05-07T14:01:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026310+0000", 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121023 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026413+0000", 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103346 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94397682172928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.899913017999999, 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032214489999999999, 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 47 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026873+0000", 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4200000000000001e-06 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026883+0000", 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0017000000000001e-05 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026904+0000", 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0228999999999999e-05 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026917+0000", 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3594000000000001e-05 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027029+0000", 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011171900000000001 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027247+0000", 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021786099999999999 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027599+0000", 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035225700000000003 2024-05-07T14:01:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029240+0000", 2024-05-07T14:01:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016408620000000001 2024-05-07T14:01:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029864+0000", 2024-05-07T14:01:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00062414399999999998 2024-05-07T14:01:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029939+0000", 2024-05-07T14:01:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4931999999999993e-05 2024-05-07T14:01:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030092+0000", 2024-05-07T14:01:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015341399999999999 2024-05-07T14:01:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.887869473000002, 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021710919999999999, 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 54 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:01:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:01:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038917+0000", 2024-05-07T14:01:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8720000000000002e-06 2024-05-07T14:01:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038929+0000", 2024-05-07T14:01:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1294999999999999e-05 2024-05-07T14:01:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038964+0000", 2024-05-07T14:01:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5516999999999999e-05 2024-05-07T14:01:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038983+0000", 2024-05-07T14:01:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:01:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039074+0000", 2024-05-07T14:01:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1106999999999994e-05 2024-05-07T14:01:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039201+0000", 2024-05-07T14:01:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012714700000000001 2024-05-07T14:01:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039320+0000", 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011861100000000001 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040439+0000", 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011193450000000001 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040971+0000", 2024-05-07T14:01:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053181599999999995 2024-05-07T14:01:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041040+0000", 2024-05-07T14:01:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8706000000000003e-05 2024-05-07T14:01:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041086+0000", 2024-05-07T14:01:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5883000000000001e-05 2024-05-07T14:01:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94397682168320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:01:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:01:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.885497061999999, 2024-05-07T14:01:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001933333, 2024-05-07T14:01:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 55 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041288+0000", 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5200000000000001e-06 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041295+0000", 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3679999999999998e-06 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041315+0000", 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9826999999999998e-05 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041325+0000", 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0402e-05 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041403+0000", 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8404000000000004e-05 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041479+0000", 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5846999999999994e-05 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041637+0000", 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157699 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.042503+0000", 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086578899999999995 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043108+0000", 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060548999999999998 2024-05-07T14:01:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043158+0000", 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9359e-05 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043220+0000", 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2627999999999997e-05 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:191 6.5 e30/27 6:a2ace8b3:::data_log.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.799073116000002, 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00168714, 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127713+0000", 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2290000000000002e-06 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127727+0000", 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4236999999999999e-05 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127759+0000", 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1402999999999997e-05 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127772+0000", 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3227000000000001e-05 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127895+0000", 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012357500000000001 2024-05-07T14:01:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127929+0000", 2024-05-07T14:01:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3599999999999997e-05 2024-05-07T14:01:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129322+0000", 2024-05-07T14:01:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001392936 2024-05-07T14:01:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129398+0000", 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5933000000000006e-05 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.886890745000002, 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386840000000002, 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039894+0000", 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9999999999999996e-07 2024-05-07T14:01:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039906+0000", 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-05 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039948+0000", 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1983000000000001e-05 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039975+0000", 2024-05-07T14:01:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7120000000000001e-05 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040144+0000", 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016912200000000001 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040195+0000", 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1023000000000003e-05 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043654+0000", 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034590089999999999 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043732+0000", 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7557000000000003e-05 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:215 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:01:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.861353579000003, 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017783440000000001, 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065432+0000", 2024-05-07T14:01:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8300000000000001e-06 2024-05-07T14:01:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065444+0000", 2024-05-07T14:01:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2227e-05 2024-05-07T14:01:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065472+0000", 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7983e-05 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065487+0000", 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.45e-05 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065628+0000", 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014118900000000001 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065700+0000", 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1521999999999997e-05 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067097+0000", 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00139784 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067209+0000", 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111253 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:221 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'3, mlcod=33'1)", 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.837553280000002, 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016799510000000001, 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:01:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089233+0000", 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.877e-06 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089244+0000", 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1323e-05 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089272+0000", 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8204e-05 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089285+0000", 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3223e-05 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089425+0000", 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013934900000000001 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089487+0000", 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2459000000000006e-05 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090785+0000", 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012974900000000001 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090911+0000", 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126026 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.801276336000001, 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020505779999999999, 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125517+0000", 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.833e-06 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125569+0000", 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1619999999999997e-05 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125589+0000", 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0803000000000001e-05 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125733+0000", 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014308600000000001 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125786+0000", 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3158999999999997e-05 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127460+0000", 2024-05-07T14:01:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001674493 2024-05-07T14:01:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127558+0000", 2024-05-07T14:01:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7967000000000006e-05 2024-05-07T14:01:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:337 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'5, mlcod=33'3)", 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.759878624999999, 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004459658, 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166908+0000", 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2259999999999999e-06 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166922+0000", 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4780000000000001e-05 2024-05-07T14:01:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166960+0000", 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8173000000000002e-05 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166981+0000", 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0440000000000001e-05 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167154+0000", 2024-05-07T14:01:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017287199999999999 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167207+0000", 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000001e-05 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171283+0000", 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004076278 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171365+0000", 2024-05-07T14:01:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1588999999999994e-05 2024-05-07T14:01:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:349 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:01:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.759003829000001, 2024-05-07T14:01:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042886440000000003, 2024-05-07T14:01:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:01:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:01:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167782+0000", 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167797+0000", 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4533e-05 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167828+0000", 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1239999999999999e-05 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167859+0000", 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1007000000000003e-05 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168041+0000", 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181788 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168095+0000", 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3857000000000003e-05 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171961+0000", 2024-05-07T14:01:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038664160000000001 2024-05-07T14:01:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172069+0000", 2024-05-07T14:01:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107793 2024-05-07T14:01:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:357 6.5 e33/27 6:a60f9269:lc::lua_package_allowlist:head v 33'2, mlcod=0'0)", 2024-05-07T14:01:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:01:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.756835099, 2024-05-07T14:01:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002145817, 2024-05-07T14:01:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:01:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:01:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169950+0000", 2024-05-07T14:01:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.626e-06 2024-05-07T14:01:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169963+0000", 2024-05-07T14:01:56.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2619999999999999e-05 2024-05-07T14:01:56.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169990+0000", 2024-05-07T14:01:56.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7084e-05 2024-05-07T14:01:56.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170003+0000", 2024-05-07T14:01:56.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3312999999999999e-05 2024-05-07T14:01:56.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170144+0000", 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140376 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170203+0000", 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9586000000000002e-05 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172022+0000", 2024-05-07T14:01:56.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018187419999999999 2024-05-07T14:01:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172095+0000", 2024-05-07T14:01:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2470000000000002e-05 2024-05-07T14:01:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:386 6.c e33/27 6:3677c228:::obj_delete_at_hint.0000000006:head v 33'1, mlcod=0'0)", 2024-05-07T14:01:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:01:56.975 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.743304762999998, 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016811230000000001, 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:01:56.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183481+0000", 2024-05-07T14:01:56.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.756e-06 2024-05-07T14:01:56.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183493+0000", 2024-05-07T14:01:56.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.254e-05 2024-05-07T14:01:56.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183520+0000", 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6809999999999999e-05 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183539+0000", 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8233e-05 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183686+0000", 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147045 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183741+0000", 2024-05-07T14:01:56.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5380000000000002e-05 2024-05-07T14:01:56.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185039+0000", 2024-05-07T14:01:56.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012981500000000001 2024-05-07T14:01:56.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185160+0000", 2024-05-07T14:01:56.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121209 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:604 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'10, mlcod=33'8)", 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.597443914999999, 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003281431, 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:01:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:01:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329341+0000", 2024-05-07T14:01:56.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.42e-06 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329351+0000", 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0002e-05 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329373+0000", 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1209e-05 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329384+0000", 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1161999999999999e-05 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329495+0000", 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111302 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329522+0000", 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7291999999999999e-05 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332531+0000", 2024-05-07T14:01:56.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003008405 2024-05-07T14:01:56.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332621+0000", 2024-05-07T14:01:56.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0638999999999997e-05 2024-05-07T14:01:56.984 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.984 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.984 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.984 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:656 6.1 e33/27 6:84d19476:::obj_delete_at_hint.0000000038:head v 33'5, mlcod=33'3)", 2024-05-07T14:01:56.985 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:01:56.985 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.551039797000001, 2024-05-07T14:01:56.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020273800000000001, 2024-05-07T14:01:56.985 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.985 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.985 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.985 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:01:56.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:01:56.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375746+0000", 2024-05-07T14:01:56.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0499999999999999e-06 2024-05-07T14:01:56.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375759+0000", 2024-05-07T14:01:56.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2952999999999999e-05 2024-05-07T14:01:56.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375789+0000", 2024-05-07T14:01:56.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9612999999999999e-05 2024-05-07T14:01:56.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375804+0000", 2024-05-07T14:01:56.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5449999999999999e-05 2024-05-07T14:01:56.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375931+0000", 2024-05-07T14:01:56.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126883 2024-05-07T14:01:56.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375972+0000", 2024-05-07T14:01:56.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0581999999999999e-05 2024-05-07T14:01:56.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377685+0000", 2024-05-07T14:01:56.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017136740000000001 2024-05-07T14:01:56.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377772+0000", 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6174999999999994e-05 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:665 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.542535538999999, 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001677357, 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.990 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384250+0000", 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7099999999999999e-06 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384261+0000", 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.113e-05 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384287+0000", 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6256000000000001e-05 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384301+0000", 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3443e-05 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384443+0000", 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142192 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384509+0000", 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6124000000000006e-05 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385819+0000", 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013092889999999999 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385926+0000", 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010721300000000001 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.994 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:685 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'4, mlcod=33'2)", 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.525843344999998, 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025309769999999998, 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400943+0000", 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0899999999999999e-06 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400960+0000", 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6917000000000001e-05 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400995+0000", 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5626000000000001e-05 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401014+0000", 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9126e-05 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401164+0000", 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149989 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401218+0000", 2024-05-07T14:01:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3550000000000001e-05 2024-05-07T14:01:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403375+0000", 2024-05-07T14:01:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00215737 2024-05-07T14:01:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403472+0000", 2024-05-07T14:01:56.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6309000000000002e-05 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:686 6.1f e33/27 6:f93251ce:::obj_delete_at_hint.0000000042:head v 33'6, mlcod=33'4)", 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.524393490000001, 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037357750000000002, 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:56.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402392+0000", 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9870000000000002e-06 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402405+0000", 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.222e-05 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402429+0000", 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4729999999999999e-05 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402448+0000", 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8493000000000001e-05 2024-05-07T14:01:57.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402604+0000", 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155876 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402647+0000", 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2793000000000002e-05 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406039+0000", 2024-05-07T14:01:57.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033922760000000001 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406126+0000", 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7399999999999997e-05 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:693 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'5, mlcod=33'3)", 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.518667061000002, 2024-05-07T14:01:57.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037287790000000002, 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:57.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408119+0000", 2024-05-07T14:01:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0040000000000002e-06 2024-05-07T14:01:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408135+0000", 2024-05-07T14:01:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6155999999999999e-05 2024-05-07T14:01:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:57.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408193+0000", 2024-05-07T14:01:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8023999999999999e-05 2024-05-07T14:01:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408248+0000", 2024-05-07T14:01:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4664999999999999e-05 2024-05-07T14:01:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408410+0000", 2024-05-07T14:01:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016263599999999999 2024-05-07T14:01:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408462+0000", 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1913000000000003e-05 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411739+0000", 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032768350000000001 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411846+0000", 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010654600000000001 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:57.007 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:694 6.5 e33/27 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 33'8, mlcod=33'6)", 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.516050727, 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038331400000000001, 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:57.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410735+0000", 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.793e-06 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410746+0000", 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1377e-05 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410775+0000", 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8336000000000001e-05 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410788+0000", 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3074000000000001e-05 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410945+0000", 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015738199999999999 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411009+0000", 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4276000000000006e-05 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414499+0000", 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034896060000000001 2024-05-07T14:01:57.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:57.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:57.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:57.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414566+0000", 2024-05-07T14:01:57.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7296000000000001e-05 2024-05-07T14:01:57.012 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:57.012 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:57.012 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:57.012 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:57.012 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:57.012 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:57.014 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:01:57.014 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:57.026+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:57.059 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:01:57.115 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:57.126+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:57.181 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:57.182 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:01:57.182 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:57.196 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:01:57.215 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:57.226+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:57.216 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:57.216 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:57.233 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:57.233 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:57.249 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:57.249 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:57.266 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:57.267 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:57.286 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:57.286 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:57.305 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:57.305 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:57.316 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:57.316 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:57.316 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:57.316 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:57.316 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:57.317 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:57.330+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:57.326 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:57.326 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:57.330 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:01:57.347 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:57.417 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:57.430+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:57.435 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:01:57.449 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:57.449 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:57.463 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:01:57.526 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:57.538+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:57.596 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:57.596 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:57.610 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:01:57.620 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:57.634+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:57.721 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:57.734+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:57.763 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:57.763 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:57.776 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:01:57.822 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:57.834+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:57.890 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:57.890 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:57.902 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:01:57.923 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:57.938+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:58.024 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:58.038+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:58.066 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:58.066 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:58.080 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:01:58.125 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:58.138+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:58.203 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:58.203 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:58.217 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:01:58.226 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:58.238+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:58.327 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:58.338+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:58.379 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:58.379 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:58.392 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:01:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:01:58.432 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:58.446+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:58.512 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:58.512 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:58.526 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:01:58.529 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:58.542+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:58.630 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:58.642+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:58.648 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:58.648 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:58.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:01:58.731 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:58.742+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:58.785 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:58.785 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:58.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:01:58.844 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:58.858+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:58.933 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:58.946+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:58.969 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:58.969 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:58.983 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:01:59.034 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:01:59.046+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:01:59.105 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:59.105 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:59.119 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:01:59.163 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:59.174+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:59.236 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:01:59.250+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:01:59.289 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:59.290 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:59.303 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:01:59.352 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:59.366+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:59.364 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:01:59.437 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:01:59.438 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:01:59.438 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:01:59.450+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:01:59.452 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:01:59.515 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:01:59.515 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:01:59.531 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:01:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:01:59.538 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:59.550+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:01:59.550 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:01:59.551 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:01:59.570 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:01:59.570 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:01:59.585 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:01:59.585 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:01:59.605 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:01:59.605 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:01:59.619 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:01:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:01:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:01:59.619 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:59.623 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:01:59.624 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:01:59.635 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:01:59.639 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:01:59.650+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:01:59.641 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:01:59.641 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:01:59.740 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:01:59.754+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:01:59.762 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:01:59.762 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:01:59.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:01:59.762 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:01:59.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.762 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:01:59.762 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:59.762 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.778655278999999, 2024-05-07T14:01:59.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070064749999999999, 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 43 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:01:59.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994274+0000", 2024-05-07T14:01:59.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7170000000000002e-06 2024-05-07T14:01:59.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994292+0000", 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7819999999999999e-05 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994338+0000", 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6625999999999997e-05 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994362+0000", 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4063e-05 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994576+0000", 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021319500000000001 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994598+0000", 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2325999999999999e-05 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001023+0000", 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00642546 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001277+0000", 2024-05-07T14:01:59.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025326800000000002 2024-05-07T14:01:59.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.767 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.767 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:46 7.1f e30/29 7:f95f44c2:::notify.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:01:59.767 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:59.767 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.750562623, 2024-05-07T14:01:59.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031449519999999999, 2024-05-07T14:01:59.767 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022363+0000", 2024-05-07T14:01:59.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5700000000000002e-07 2024-05-07T14:01:59.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022371+0000", 2024-05-07T14:01:59.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7230000000000004e-06 2024-05-07T14:01:59.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022396+0000", 2024-05-07T14:01:59.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4406e-05 2024-05-07T14:01:59.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022415+0000", 2024-05-07T14:01:59.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9264999999999999e-05 2024-05-07T14:01:59.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022641+0000", 2024-05-07T14:01:59.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022584100000000001 2024-05-07T14:01:59.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022702+0000", 2024-05-07T14:01:59.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1513999999999994e-05 2024-05-07T14:01:59.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.025418+0000", 2024-05-07T14:01:59.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027162290000000001 2024-05-07T14:01:59.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.025508+0000", 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9216999999999996e-05 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.723025853000003, 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033678110000000001, 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.774 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 211 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:01:59.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049903+0000", 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.963e-06 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049917+0000", 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049950+0000", 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3328999999999999e-05 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049966+0000", 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6333000000000001e-05 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050100+0000", 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013305599999999999 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050363+0000", 2024-05-07T14:01:59.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026392100000000002 2024-05-07T14:01:59.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:59.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050827+0000", 2024-05-07T14:01:59.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046316 2024-05-07T14:01:59.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.052269+0000", 2024-05-07T14:01:59.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014428760000000001 2024-05-07T14:01:59.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053111+0000", 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084168999999999997 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053198+0000", 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6666e-05 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053267+0000", 2024-05-07T14:01:59.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9503000000000002e-05 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.644571157999998, 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032702809999999999, 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.780 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.781 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.781 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 232 2024-05-07T14:01:59.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.781 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:59.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:01:59.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128357+0000", 2024-05-07T14:01:59.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1530000000000001e-06 2024-05-07T14:01:59.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128369+0000", 2024-05-07T14:01:59.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1823e-05 2024-05-07T14:01:59.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128401+0000", 2024-05-07T14:01:59.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:01:59.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128416+0000", 2024-05-07T14:01:59.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4997000000000001e-05 2024-05-07T14:01:59.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128538+0000", 2024-05-07T14:01:59.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121406 2024-05-07T14:01:59.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128773+0000", 2024-05-07T14:01:59.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235121 2024-05-07T14:01:59.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.129230+0000", 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00045679999999999999 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.130836+0000", 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001606484 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131454+0000", 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061747199999999999 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131550+0000", 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6636000000000001e-05 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131624+0000", 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4315999999999998e-05 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.786 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:265 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.787 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:59.787 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.618918806000003, 2024-05-07T14:01:59.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029442299999999999, 2024-05-07T14:01:59.787 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.787 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.787 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.787 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.787 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.787 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.787 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 265 2024-05-07T14:01:59.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.787 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:59.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154007+0000", 2024-05-07T14:01:59.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154009+0000", 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.413e-06 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154023+0000", 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4229999999999999e-05 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154062+0000", 2024-05-07T14:01:59.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9223e-05 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154085+0000", 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2909999999999999e-05 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154269+0000", 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183232 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154422+0000", 2024-05-07T14:01:59.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015338799999999999 2024-05-07T14:01:59.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:01:59.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154693+0000", 2024-05-07T14:01:59.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000271005 2024-05-07T14:01:59.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155957+0000", 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001263573 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156590+0000", 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00063392600000000004 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156844+0000", 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025348800000000001 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156951+0000", 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106842 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:277 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.617017341, 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030861830000000002, 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.793 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.794 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.794 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.794 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.794 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.794 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 277 2024-05-07T14:01:59.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.794 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:59.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155908+0000", 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155910+0000", 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155922+0000", 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2082999999999999e-05 2024-05-07T14:01:59.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155967+0000", 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4855999999999999e-05 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155986+0000", 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.965e-05 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156173+0000", 2024-05-07T14:01:59.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018657299999999999 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156479+0000", 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030636299999999998 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156975+0000", 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00049533699999999999 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158291+0000", 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001316776 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158712+0000", 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042077999999999999 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158885+0000", 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000172786 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158994+0000", 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109239 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:301 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.612994192000002, 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037043950000000001, 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 301 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159933+0000", 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6670000000000001e-06 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159943+0000", 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0176e-05 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159965+0000", 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2243e-05 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159980+0000", 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4747e-05 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160332+0000", 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000352004 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160574+0000", 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241838 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.161045+0000", 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000471526 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.162322+0000", 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001276241 2024-05-07T14:01:59.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163376+0000", 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010539449999999999 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163516+0000", 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014034599999999999 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163636+0000", 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011966199999999999 2024-05-07T14:01:59.804 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:376 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.596878912999998, 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038557209999999999, 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.805 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 376 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176049+0000", 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176064+0000", 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.451e-05 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176101+0000", 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000003e-05 2024-05-07T14:01:59.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176126+0000", 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176272+0000", 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014592899999999999 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176402+0000", 2024-05-07T14:01:59.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000129512 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176725+0000", 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032289800000000001 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.177826+0000", 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011017620000000001 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179617+0000", 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001791193 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179781+0000", 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016336899999999999 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179902+0000", 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012131899999999999 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.810 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.811 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:397 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.811 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:59.811 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.584381823000001, 2024-05-07T14:01:59.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034388040000000002, 2024-05-07T14:01:59.811 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.811 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.811 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.811 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.811 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.811 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.811 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 397 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188546+0000", 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2000000000000001e-06 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188556+0000", 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0557000000000001e-05 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188590+0000", 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3626e-05 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188625+0000", 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5095999999999997e-05 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188768+0000", 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014279900000000001 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189124+0000", 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035646799999999998 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189633+0000", 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000508903 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.190638+0000", 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001004465 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191712+0000", 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001074759 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191871+0000", 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835900000000001 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191982+0000", 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011157199999999999 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.816 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:403 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.817 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:59.817 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.580239044999999, 2024-05-07T14:01:59.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004923172, 2024-05-07T14:01:59.817 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.817 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.817 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.817 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.817 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.817 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.817 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 403 2024-05-07T14:01:59.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.817 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192688+0000", 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4640000000000001e-06 2024-05-07T14:01:59.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192696+0000", 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9330000000000001e-06 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192715+0000", 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9746999999999999e-05 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192726+0000", 2024-05-07T14:01:59.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.026e-05 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192824+0000", 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8139000000000003e-05 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192971+0000", 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014717199999999999 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.193232+0000", 2024-05-07T14:01:59.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000260518 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.196090+0000", 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002858598 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197464+0000", 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001373399 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197549+0000", 2024-05-07T14:01:59.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5261999999999998e-05 2024-05-07T14:01:59.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197609+0000", 2024-05-07T14:01:59.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0680000000000002e-05 2024-05-07T14:01:59.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.822 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:472 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.535936532000001, 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044650219999999999, 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 472 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.823 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236991+0000", 2024-05-07T14:01:59.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8589999999999999e-06 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237001+0000", 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0465999999999999e-05 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237019+0000", 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7666999999999999e-05 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237030+0000", 2024-05-07T14:01:59.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0917000000000001e-05 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237184+0000", 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015438499999999999 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237427+0000", 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024296499999999999 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:01:59.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237900+0000", 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047292599999999998 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.239253+0000", 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013527770000000001 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241246+0000", 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019933249999999998 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241370+0000", 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012385599999999999 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241454+0000", 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3879000000000001e-05 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:501 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:59.828 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.518705326000003, 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029689030000000002, 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 501 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254220+0000", 2024-05-07T14:01:59.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254222+0000", 2024-05-07T14:01:59.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9580000000000001e-06 2024-05-07T14:01:59.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254246+0000", 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3521999999999999e-05 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254271+0000", 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5757000000000001e-05 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254284+0000", 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254423+0000", 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013909 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.254745+0000", 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032253700000000002 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.255261+0000", 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051555899999999996 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.256343+0000", 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001081867 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257042+0000", 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069873699999999995 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257128+0000", 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6478999999999997e-05 2024-05-07T14:01:59.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257189+0000", 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0810999999999998e-05 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:509 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.515048393999997, 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003433874, 2024-05-07T14:01:59.834 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.835 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.835 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.835 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.835 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.835 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.835 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 509 2024-05-07T14:01:59.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.835 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:59.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257878+0000", 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.528e-06 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257886+0000", 2024-05-07T14:01:59.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2180000000000002e-06 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257903+0000", 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7484999999999999e-05 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257912+0000", 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0189999999999995e-06 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258007+0000", 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4627000000000001e-05 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258124+0000", 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116836 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258381+0000", 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025690899999999999 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.259428+0000", 2024-05-07T14:01:59.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047177 2024-05-07T14:01:59.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261154+0000", 2024-05-07T14:01:59.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017262180000000001 2024-05-07T14:01:59.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261224+0000", 2024-05-07T14:01:59.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9913000000000006e-05 2024-05-07T14:01:59.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261311+0000", 2024-05-07T14:01:59.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6944e-05 2024-05-07T14:01:59.900 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.900 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.901 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:610 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.901 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:59.901 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.438494065, 2024-05-07T14:01:59.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031518679999999999, 2024-05-07T14:01:59.901 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.901 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.901 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.901 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.901 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.901 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.902 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 610 2024-05-07T14:01:59.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.902 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:59.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334431+0000", 2024-05-07T14:01:59.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334434+0000", 2024-05-07T14:01:59.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.34e-06 2024-05-07T14:01:59.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334447+0000", 2024-05-07T14:01:59.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2976000000000001e-05 2024-05-07T14:01:59.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334479+0000", 2024-05-07T14:01:59.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2159999999999997e-05 2024-05-07T14:01:59.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334495+0000", 2024-05-07T14:01:59.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6722999999999999e-05 2024-05-07T14:01:59.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.334644+0000", 2024-05-07T14:01:59.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014812500000000001 2024-05-07T14:01:59.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.335017+0000", 2024-05-07T14:01:59.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037323400000000001 2024-05-07T14:01:59.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:01:59.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.335408+0000", 2024-05-07T14:01:59.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039102000000000001 2024-05-07T14:01:59.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.336518+0000", 2024-05-07T14:01:59.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011105620000000001 2024-05-07T14:01:59.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337379+0000", 2024-05-07T14:01:59.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086063700000000003 2024-05-07T14:01:59.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337473+0000", 2024-05-07T14:01:59.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4332000000000004e-05 2024-05-07T14:01:59.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.337583+0000", 2024-05-07T14:01:59.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109759 2024-05-07T14:01:59.907 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:625 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.427628732999999, 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039276240000000002, 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.908 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 625 2024-05-07T14:01:59.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.909 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:59.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:01:59.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345300+0000", 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.067e-06 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345315+0000", 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4857e-05 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345344+0000", 2024-05-07T14:01:59.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9070000000000001e-05 2024-05-07T14:01:59.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345359+0000", 2024-05-07T14:01:59.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5656000000000001e-05 2024-05-07T14:01:59.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345512+0000", 2024-05-07T14:01:59.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015229600000000001 2024-05-07T14:01:59.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345764+0000", 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025252100000000002 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.346269+0000", 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000504613 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.347487+0000", 2024-05-07T14:01:59.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001218317 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349071+0000", 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015844279999999999 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349156+0000", 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4958999999999998e-05 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349224+0000", 2024-05-07T14:01:59.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7840000000000001e-05 2024-05-07T14:01:59.914 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.914 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.914 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.914 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.914 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:59.914 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.316261838000003, 2024-05-07T14:01:59.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031666649999999999, 2024-05-07T14:01:59.914 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.914 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.914 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.914 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 727 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456664+0000", 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456665+0000", 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-06 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456675+0000", 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8500000000000006e-06 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456703+0000", 2024-05-07T14:01:59.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7846000000000001e-05 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456724+0000", 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0869999999999998e-05 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.456850+0000", 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126069 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.457082+0000", 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023258099999999999 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.457439+0000", 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000356115 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.458419+0000", 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00098032799999999993 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459682+0000", 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012626339999999999 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459769+0000", 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7383e-05 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.459830+0000", 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1235999999999994e-05 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.919 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.128830485000002, 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029415270000000002, 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 814 2024-05-07T14:01:59.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.921 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:59.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644095+0000", 2024-05-07T14:01:59.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644097+0000", 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1500000000000002e-06 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644108+0000", 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1182999999999999e-05 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644140+0000", 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2283000000000002e-05 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644166+0000", 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5703000000000001e-05 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644360+0000", 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019352200000000001 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644571+0000", 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000210915 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.644899+0000", 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032880799999999999 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.645976+0000", 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001076458 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.646896+0000", 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091987999999999998 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.646975+0000", 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9165999999999994e-05 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.647036+0000", 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1458999999999996e-05 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.925 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.973661599000003, 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031874479999999998, 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.926 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 880 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799266+0000", 2024-05-07T14:01:59.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.723e-06 2024-05-07T14:01:59.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799280+0000", 2024-05-07T14:01:59.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3159999999999999e-05 2024-05-07T14:01:59.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799311+0000", 2024-05-07T14:01:59.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1083e-05 2024-05-07T14:01:59.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799327+0000", 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5883e-05 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799438+0000", 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011096599999999999 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799670+0000", 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023280800000000001 2024-05-07T14:01:59.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.800012+0000", 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034192800000000002 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.801133+0000", 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011206009999999999 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802179+0000", 2024-05-07T14:01:59.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010458080000000001 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802341+0000", 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162533 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802451+0000", 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109955 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.968999791999998, 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031185649999999998, 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 882 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803926+0000", 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803928+0000", 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.266e-06 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803939+0000", 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1372999999999999e-05 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803972+0000", 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.803987+0000", 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5126999999999999e-05 2024-05-07T14:01:59.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804111+0000", 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012420199999999999 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804326+0000", 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215262 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.804794+0000", 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046816000000000002 2024-05-07T14:01:59.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806221+0000", 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014263749999999999 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806759+0000", 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053796200000000001 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.806936+0000", 2024-05-07T14:01:59.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017753300000000001 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.807044+0000", 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107865 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.870314856999997, 2024-05-07T14:01:59.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029448970000000001, 2024-05-07T14:01:59.938 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:01:59.938 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:01:59.938 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:01:59.938 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:01:59.938 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:01:59.938 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:01:59.938 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 925 2024-05-07T14:01:59.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.938 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:01:59.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:01:59.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:01:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902611+0000", 2024-05-07T14:01:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:01:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:01:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902613+0000", 2024-05-07T14:01:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9999999999999999e-06 2024-05-07T14:01:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:01:59.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902623+0000", 2024-05-07T14:01:59.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0453e-05 2024-05-07T14:01:59.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:01:59.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902653+0000", 2024-05-07T14:01:59.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9556e-05 2024-05-07T14:01:59.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:01:59.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902670+0000", 2024-05-07T14:01:59.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7887e-05 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.902785+0000", 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114295 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.903018+0000", 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023349899999999999 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:01:59.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.903329+0000", 2024-05-07T14:01:59.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031125100000000002 2024-05-07T14:01:59.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:01:59.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.904399+0000", 2024-05-07T14:01:59.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001069162 2024-05-07T14:01:59.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:01:59.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905354+0000", 2024-05-07T14:01:59.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095526300000000003 2024-05-07T14:01:59.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905441+0000", 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6854999999999994e-05 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.905555+0000", 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114676 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:01:59.943 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:01:59.945 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:01:59.945 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:01:59.958+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:00.046 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:00.058+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:00.116 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:00.116 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:00.116 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:00.116 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:00.129 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:00.147 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:00.158+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:00.245 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:00.246 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:00.248 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:00.262+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:00.259 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:00.349 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:00.362+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:00.390 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:00.390 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:02:00.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:02:00.390 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:02:00.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.390 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:00.391 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:02:00.391 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.371265502999996, 2024-05-07T14:02:00.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033108180000000001, 2024-05-07T14:02:00.391 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.391 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.391 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.391 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.391 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.391 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.391 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 48 2024-05-07T14:02:00.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.391 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:02:00.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:02:00.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026898+0000", 2024-05-07T14:02:00.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2369999999999999e-06 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026908+0000", 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8109999999999997e-06 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026934+0000", 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6746000000000001e-05 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026949+0000", 2024-05-07T14:02:00.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4517e-05 2024-05-07T14:02:00.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027084+0000", 2024-05-07T14:02:00.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013501499999999999 2024-05-07T14:02:00.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027360+0000", 2024-05-07T14:02:00.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027639199999999998 2024-05-07T14:02:00.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027616+0000", 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025541799999999999 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.028902+0000", 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012859989999999999 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030044+0000", 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001142295 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030136+0000", 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1794999999999998e-05 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030206+0000", 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0593000000000007e-05 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:02:00.396 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.385791593999997, 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058205720000000004, 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 205 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012373+0000", 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.07e-06 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012397+0000", 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3697e-05 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012450+0000", 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2539e-05 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012477+0000", 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7457000000000002e-05 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012735+0000", 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025820800000000001 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013057+0000", 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000321727 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013752+0000", 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069509499999999996 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.017093+0000", 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033404340000000002 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018024+0000", 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00093108600000000002 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018113+0000", 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9752000000000004e-05 2024-05-07T14:02:00.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018190+0000", 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6507000000000005e-05 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.315540605999999, 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052341489999999996, 2024-05-07T14:02:00.402 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 220 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:02:00.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082623+0000", 2024-05-07T14:02:00.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8370000000000001e-06 2024-05-07T14:02:00.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082636+0000", 2024-05-07T14:02:00.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2316e-05 2024-05-07T14:02:00.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082667+0000", 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1139999999999997e-05 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082681+0000", 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4816e-05 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082825+0000", 2024-05-07T14:02:00.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014377899999999999 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083051+0000", 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022549500000000001 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083453+0000", 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000401944 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.085929+0000", 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024763369999999999 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087649+0000", 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001719747 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087735+0000", 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6415999999999994e-05 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087855+0000", 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011932199999999999 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.303120874999998, 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00342407, 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.408 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.409 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.409 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.409 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.409 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 223 2024-05-07T14:02:00.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.409 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:02:00.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095042+0000", 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1799999999999999e-06 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095054+0000", 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1817000000000001e-05 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095084+0000", 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0018999999999998e-05 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095099+0000", 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.537e-05 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095209+0000", 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010943299999999999 2024-05-07T14:02:00.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095457+0000", 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247941 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095879+0000", 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042171299999999999 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.097290+0000", 2024-05-07T14:02:00.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014118519999999999 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098196+0000", 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00090603700000000005 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098348+0000", 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151879 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098464+0000", 2024-05-07T14:02:00.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011582900000000001 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.295580674, 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031839889999999999, 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.414 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 225 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102582+0000", 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102594+0000", 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1382999999999999e-05 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102625+0000", 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0880000000000002e-05 2024-05-07T14:02:00.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102640+0000", 2024-05-07T14:02:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4949999999999999e-05 2024-05-07T14:02:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102756+0000", 2024-05-07T14:02:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116072 2024-05-07T14:02:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102998+0000", 2024-05-07T14:02:00.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024203199999999999 2024-05-07T14:02:00.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:00.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.103438+0000", 2024-05-07T14:02:00.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044011700000000001 2024-05-07T14:02:00.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105252+0000", 2024-05-07T14:02:00.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018136490000000001 2024-05-07T14:02:00.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105608+0000", 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035604000000000001 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105699+0000", 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1316999999999993e-05 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105764+0000", 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5371999999999997e-05 2024-05-07T14:02:00.419 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.420 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.420 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.420 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.420 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:02:00.420 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.292104326999997, 2024-05-07T14:02:00.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003090256, 2024-05-07T14:02:00.420 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.420 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.420 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.420 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.421 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.421 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.421 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 226 2024-05-07T14:02:00.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.421 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:02:00.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:02:00.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106059+0000", 2024-05-07T14:02:00.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3e-06 2024-05-07T14:02:00.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106070+0000", 2024-05-07T14:02:00.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1257000000000001e-05 2024-05-07T14:02:00.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106101+0000", 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0783e-05 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106116+0000", 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5136e-05 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106217+0000", 2024-05-07T14:02:00.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101183 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106433+0000", 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021523199999999999 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106826+0000", 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039372000000000002 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.108406+0000", 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001579815 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.108987+0000", 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058058100000000004 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.109073+0000", 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6650000000000006e-05 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.109147+0000", 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3598999999999998e-05 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.262651923999996, 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030980790000000001, 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.426 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 234 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:02:00.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135511+0000", 2024-05-07T14:02:00.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4030000000000001e-06 2024-05-07T14:02:00.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135523+0000", 2024-05-07T14:02:00.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1559999999999999e-05 2024-05-07T14:02:00.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135557+0000", 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4372999999999998e-05 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135572+0000", 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4647000000000001e-05 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135674+0000", 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101932 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135888+0000", 2024-05-07T14:02:00.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000213995 2024-05-07T14:02:00.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:00.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.136311+0000", 2024-05-07T14:02:00.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042278999999999998 2024-05-07T14:02:00.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.137726+0000", 2024-05-07T14:02:00.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001415319 2024-05-07T14:02:00.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138450+0000", 2024-05-07T14:02:00.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00072404800000000003 2024-05-07T14:02:00.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138543+0000", 2024-05-07T14:02:00.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2559000000000006e-05 2024-05-07T14:02:00.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138607+0000", 2024-05-07T14:02:00.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4453000000000001e-05 2024-05-07T14:02:00.433 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.433 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.433 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.433 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.433 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:02:00.433 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.243601902000002, 2024-05-07T14:02:00.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035934819999999998, 2024-05-07T14:02:00.433 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.433 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.434 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.434 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.434 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.434 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.434 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 271 2024-05-07T14:02:00.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.434 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:02:00.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154562+0000", 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154578+0000", 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6667000000000002e-05 2024-05-07T14:02:00.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154612+0000", 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3120000000000001e-05 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154632+0000", 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0769999999999999e-05 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154774+0000", 2024-05-07T14:02:00.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141805 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155004+0000", 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022938200000000001 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155372+0000", 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036889300000000002 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156948+0000", 2024-05-07T14:02:00.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015755750000000001 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.157903+0000", 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095453499999999995 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158050+0000", 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147279 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158153+0000", 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102729 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:402 6.4 e33/27 6:24c8e1ae:gc::gc.19:head v 33'8, mlcod=33'6)", 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.205529767999998, 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032167609999999998, 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.439 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192633+0000", 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6759999999999999e-06 2024-05-07T14:02:00.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192645+0000", 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2037e-05 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192669+0000", 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3723e-05 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192683+0000", 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4416000000000001e-05 2024-05-07T14:02:00.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192792+0000", 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109029 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192848+0000", 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5674000000000003e-05 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.195758+0000", 2024-05-07T14:02:00.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029099199999999999 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.195848+0000", 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0285999999999996e-05 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:415 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.197823540999998, 2024-05-07T14:02:00.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065364059999999998, 2024-05-07T14:02:00.444 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.444 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.444 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.444 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.444 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.444 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.444 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 415 2024-05-07T14:02:00.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.444 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:02:00.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200339+0000", 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.826e-06 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200348+0000", 2024-05-07T14:02:00.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0669999999999998e-06 2024-05-07T14:02:00.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200378+0000", 2024-05-07T14:02:00.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.968e-05 2024-05-07T14:02:00.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200393+0000", 2024-05-07T14:02:00.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5109999999999999e-05 2024-05-07T14:02:00.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200515+0000", 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121449 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200658+0000", 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014362199999999999 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200958+0000", 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030029699999999999 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202106+0000", 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011475050000000001 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206707+0000", 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046009980000000002 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206791+0000", 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4118999999999999e-05 2024-05-07T14:02:00.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206874+0000", 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2732999999999995e-05 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:417 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.195325449999999, 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034776160000000002, 2024-05-07T14:02:00.449 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 417 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202838+0000", 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3760000000000002e-06 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202872+0000", 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4379999999999999e-05 2024-05-07T14:02:00.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202900+0000", 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8180000000000001e-05 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202915+0000", 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.486e-05 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203063+0000", 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014788799999999999 2024-05-07T14:02:00.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203423+0000", 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035942400000000001 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.204005+0000", 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058227599999999995 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205280+0000", 2024-05-07T14:02:00.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012753 2024-05-07T14:02:00.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206135+0000", 2024-05-07T14:02:00.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00085444999999999998 2024-05-07T14:02:00.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206234+0000", 2024-05-07T14:02:00.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9088999999999999e-05 2024-05-07T14:02:00.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206313+0000", 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9393000000000004e-05 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:420 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.192989032, 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042372210000000002, 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.455 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 420 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205174+0000", 2024-05-07T14:02:00.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1100000000000001e-06 2024-05-07T14:02:00.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205186+0000", 2024-05-07T14:02:00.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.169e-05 2024-05-07T14:02:00.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205218+0000", 2024-05-07T14:02:00.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2617000000000003e-05 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205240+0000", 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1331999999999998e-05 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205356+0000", 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011655 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205623+0000", 2024-05-07T14:02:00.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026669399999999999 2024-05-07T14:02:00.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:00.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206029+0000", 2024-05-07T14:02:00.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040652 2024-05-07T14:02:00.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.208187+0000", 2024-05-07T14:02:00.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021578439999999999 2024-05-07T14:02:00.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209226+0000", 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001039058 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209305+0000", 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8650000000000001e-05 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209409+0000", 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104156 2024-05-07T14:02:00.460 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.461 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.461 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.461 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:429 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.461 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:02:00.461 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.187957990999998, 2024-05-07T14:02:00.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040139620000000003, 2024-05-07T14:02:00.461 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.461 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.461 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.461 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.461 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.462 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.462 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 429 2024-05-07T14:02:00.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.462 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:02:00.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:02:00.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210205+0000", 2024-05-07T14:02:00.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.66e-06 2024-05-07T14:02:00.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210228+0000", 2024-05-07T14:02:00.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-05-07T14:02:00.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210244+0000", 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6339999999999999e-05 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210256+0000", 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1949e-05 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210472+0000", 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215529 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210681+0000", 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000208982 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211154+0000", 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047321599999999999 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212660+0000", 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001506098 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214071+0000", 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014107429999999999 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214153+0000", 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1889000000000002e-05 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214217+0000", 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4336000000000002e-05 2024-05-07T14:02:00.466 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:430 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.187612227000002, 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066752119999999998, 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.467 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 430 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210551+0000", 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210562+0000", 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0237e-05 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210586+0000", 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4066e-05 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210603+0000", 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.713e-05 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211799+0000", 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001196127 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211931+0000", 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131629 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212211+0000", 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028005100000000002 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.213288+0000", 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010772760000000001 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217047+0000", 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037586569999999999 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217127+0000", 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0270000000000002e-05 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217224+0000", 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7139000000000006e-05 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.472 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.180834951999998, 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003780107, 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 436 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:02:00.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:02:00.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217328+0000", 2024-05-07T14:02:00.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:02:00.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217356+0000", 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8158999999999999e-05 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217377+0000", 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1356999999999999e-05 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217393+0000", 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5569e-05 2024-05-07T14:02:00.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217882+0000", 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00048937000000000004 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218099+0000", 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021691899999999999 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218390+0000", 2024-05-07T14:02:00.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029041800000000002 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220013+0000", 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016236169999999999 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220889+0000", 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087619599999999998 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221005+0000", 2024-05-07T14:02:00.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011569 2024-05-07T14:02:00.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221106+0000", 2024-05-07T14:02:00.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101122 2024-05-07T14:02:00.478 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.478 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.478 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.478 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:442 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.478 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.177213086999998, 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003357184, 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 442 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:02:00.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:02:00.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220950+0000", 2024-05-07T14:02:00.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:02:00.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220958+0000", 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8429999999999999e-06 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220979+0000", 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0387e-05 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220991+0000", 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.181e-05 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221218+0000", 2024-05-07T14:02:00.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022694100000000001 2024-05-07T14:02:00.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221362+0000", 2024-05-07T14:02:00.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014482899999999999 2024-05-07T14:02:00.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:00.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221628+0000", 2024-05-07T14:02:00.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026559799999999997 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.223915+0000", 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022864819999999998 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224031+0000", 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116759 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224173+0000", 2024-05-07T14:02:00.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014127599999999999 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224305+0000", 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000132519 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:482 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.154982639000004, 2024-05-07T14:02:00.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035275459999999999, 2024-05-07T14:02:00.485 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.485 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.485 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.485 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.485 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.485 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.485 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 482 2024-05-07T14:02:00.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.485 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:02:00.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:02:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243181+0000", 2024-05-07T14:02:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:02:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243194+0000", 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3087e-05 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243224+0000", 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0546000000000002e-05 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243240+0000", 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5339999999999999e-05 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243379+0000", 2024-05-07T14:02:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139646 2024-05-07T14:02:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243576+0000", 2024-05-07T14:02:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019638300000000001 2024-05-07T14:02:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243838+0000", 2024-05-07T14:02:00.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026234300000000001 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.244908+0000", 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010696289999999999 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246477+0000", 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001569471 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246596+0000", 2024-05-07T14:02:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118892 2024-05-07T14:02:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246706+0000", 2024-05-07T14:02:00.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109899 2024-05-07T14:02:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:563 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:02:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.095992207999998, 2024-05-07T14:02:00.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00310239, 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 563 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302171+0000", 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1169999999999998e-06 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302182+0000", 2024-05-07T14:02:00.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0679999999999999e-05 2024-05-07T14:02:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302202+0000", 2024-05-07T14:02:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0505000000000001e-05 2024-05-07T14:02:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302218+0000", 2024-05-07T14:02:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5990000000000001e-05 2024-05-07T14:02:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302337+0000", 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119071 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302481+0000", 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014358200000000001 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302775+0000", 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029423399999999999 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.303826+0000", 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001051485 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305118+0000", 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001291234 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305205+0000", 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7672999999999999e-05 2024-05-07T14:02:00.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305271+0000", 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5819000000000001e-05 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.657234277000001, 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031794449999999999, 2024-05-07T14:02:00.497 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 856 2024-05-07T14:02:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:02:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:02:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740929+0000", 2024-05-07T14:02:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3e-06 2024-05-07T14:02:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740942+0000", 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3183000000000001e-05 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740968+0000", 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5477e-05 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740982+0000", 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4273e-05 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741169+0000", 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018701500000000001 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741382+0000", 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021331200000000001 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741696+0000", 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031337800000000001 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.742864+0000", 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011688410000000001 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.743952+0000", 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001087221 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.744037+0000", 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5242999999999997e-05 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.744106+0000", 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9202000000000006e-05 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:877 6.19 6:98c4c580:::obj_delete_at_hint.0000000100:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.606287633999997, 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033601709999999999, 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 877 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791875+0000", 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9e-06 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791884+0000", 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7069999999999998e-06 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791907+0000", 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2682999999999999e-05 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791919+0000", 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2763e-05 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792073+0000", 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153509 2024-05-07T14:02:00.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792439+0000", 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000366141 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792989+0000", 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055016899999999998 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.794288+0000", 2024-05-07T14:02:00.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00129885 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795070+0000", 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000781557 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795155+0000", 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5723000000000006e-05 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795234+0000", 2024-05-07T14:02:00.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8169000000000003e-05 2024-05-07T14:02:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:00.509 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:00.509 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:00.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:02:00.511 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:00.512 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:00.522+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:00.612 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:00.626+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:00.687 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:00.687 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:00.687 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:00.687 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:00.701 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:00.744 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:00.758+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:00.814 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:00.826+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:00.866 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:00.867 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:00.867 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:00.867 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:00.867 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:00.881 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:00.924 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:00.938+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:01.016 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:01.026+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:01.046 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:01.047 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:02:01.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:02:01.047 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:02:01.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.047 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:01.047 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:02:01.047 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.040647591000003, 2024-05-07T14:02:01.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089647730000000005, 2024-05-07T14:02:01.047 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.047 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.047 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:01.048 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:01.048 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 46 2024-05-07T14:02:01.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.048 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:02:01.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:02:01.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017451+0000", 2024-05-07T14:02:01.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9349999999999999e-06 2024-05-07T14:02:01.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017460+0000", 2024-05-07T14:02:01.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-05-07T14:02:01.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017481+0000", 2024-05-07T14:02:01.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0984000000000001e-05 2024-05-07T14:02:01.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017499+0000", 2024-05-07T14:02:01.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:02:01.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018689+0000", 2024-05-07T14:02:01.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001190303 2024-05-07T14:02:01.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018945+0000", 2024-05-07T14:02:01.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025626799999999998 2024-05-07T14:02:01.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:01.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022176+0000", 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032308720000000001 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026078+0000", 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039018289999999999 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026189+0000", 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110775 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026310+0000", 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121023 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026413+0000", 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103346 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94397682172928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:02:01.053 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.031224934999997, 2024-05-07T14:02:01.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032214489999999999, 2024-05-07T14:02:01.054 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.054 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.054 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.054 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.054 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:01.054 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:01.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 47 2024-05-07T14:02:01.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026873+0000", 2024-05-07T14:02:01.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4200000000000001e-06 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026883+0000", 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0017000000000001e-05 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026904+0000", 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0228999999999999e-05 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026917+0000", 2024-05-07T14:02:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3594000000000001e-05 2024-05-07T14:02:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027029+0000", 2024-05-07T14:02:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011171900000000001 2024-05-07T14:02:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027247+0000", 2024-05-07T14:02:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021786099999999999 2024-05-07T14:02:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027599+0000", 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035225700000000003 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029240+0000", 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016408620000000001 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029864+0000", 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00062414399999999998 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029939+0000", 2024-05-07T14:02:01.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4931999999999993e-05 2024-05-07T14:02:01.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030092+0000", 2024-05-07T14:02:01.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015341399999999999 2024-05-07T14:02:01.059 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.059 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.059 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.060 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:01.060 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:02:01.060 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.01918139, 2024-05-07T14:02:01.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021710919999999999, 2024-05-07T14:02:01.060 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.060 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.060 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.060 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.060 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:01.061 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:01.061 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 54 2024-05-07T14:02:01.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.061 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:02:01.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:02:01.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038917+0000", 2024-05-07T14:02:01.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8720000000000002e-06 2024-05-07T14:02:01.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038929+0000", 2024-05-07T14:02:01.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1294999999999999e-05 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038964+0000", 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5516999999999999e-05 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038983+0000", 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039074+0000", 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1106999999999994e-05 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039201+0000", 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012714700000000001 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039320+0000", 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011861100000000001 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040439+0000", 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011193450000000001 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040971+0000", 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053181599999999995 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041040+0000", 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8706000000000003e-05 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041086+0000", 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5883000000000001e-05 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94397682168320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.016808978999997, 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001933333, 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.066 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 55 2024-05-07T14:02:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:02:01.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:02:01.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041288+0000", 2024-05-07T14:02:01.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5200000000000001e-06 2024-05-07T14:02:01.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041295+0000", 2024-05-07T14:02:01.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3679999999999998e-06 2024-05-07T14:02:01.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041315+0000", 2024-05-07T14:02:01.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9826999999999998e-05 2024-05-07T14:02:01.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041325+0000", 2024-05-07T14:02:01.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0402e-05 2024-05-07T14:02:01.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041403+0000", 2024-05-07T14:02:01.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8404000000000004e-05 2024-05-07T14:02:01.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041479+0000", 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5846999999999994e-05 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041637+0000", 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157699 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.042503+0000", 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086578899999999995 2024-05-07T14:02:01.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043108+0000", 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060548999999999998 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043158+0000", 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9359e-05 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043220+0000", 2024-05-07T14:02:01.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2627999999999997e-05 2024-05-07T14:02:01.073 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.073 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.073 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.073 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:191 6.5 e30/27 6:a2ace8b3:::data_log.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:01.073 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:02:01.073 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.930385033, 2024-05-07T14:02:01.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00168714, 2024-05-07T14:02:01.073 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.073 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.074 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.074 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:02:01.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:02:01.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127713+0000", 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2290000000000002e-06 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127727+0000", 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4236999999999999e-05 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127759+0000", 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1402999999999997e-05 2024-05-07T14:02:01.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127772+0000", 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3227000000000001e-05 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127895+0000", 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012357500000000001 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127929+0000", 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3599999999999997e-05 2024-05-07T14:02:01.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129322+0000", 2024-05-07T14:02:01.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001392936 2024-05-07T14:02:01.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129398+0000", 2024-05-07T14:02:01.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5933000000000006e-05 2024-05-07T14:02:01.077 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.077 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.077 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-07T14:02:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:02:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.018202662, 2024-05-07T14:02:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386840000000002, 2024-05-07T14:02:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039894+0000", 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9999999999999996e-07 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039906+0000", 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-05 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039948+0000", 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1983000000000001e-05 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039975+0000", 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7120000000000001e-05 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040144+0000", 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016912200000000001 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040195+0000", 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1023000000000003e-05 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043654+0000", 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034590089999999999 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043732+0000", 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7557000000000003e-05 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:215 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.992665496000001, 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017783440000000001, 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.082 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065432+0000", 2024-05-07T14:02:01.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8300000000000001e-06 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065444+0000", 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2227e-05 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065472+0000", 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7983e-05 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065487+0000", 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.45e-05 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065628+0000", 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014118900000000001 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065700+0000", 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1521999999999997e-05 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067097+0000", 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00139784 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067209+0000", 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111253 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:221 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'3, mlcod=33'1)", 2024-05-07T14:02:01.086 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.968865197, 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016799510000000001, 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089233+0000", 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.877e-06 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089244+0000", 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1323e-05 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089272+0000", 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8204e-05 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089285+0000", 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3223e-05 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089425+0000", 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013934900000000001 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089487+0000", 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2459000000000006e-05 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090785+0000", 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012974900000000001 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090911+0000", 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126026 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.090 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.932588252999999, 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020505779999999999, 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125517+0000", 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.833e-06 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125569+0000", 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1619999999999997e-05 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125589+0000", 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0803000000000001e-05 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125733+0000", 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014308600000000001 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125786+0000", 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3158999999999997e-05 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127460+0000", 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001674493 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127558+0000", 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7967000000000006e-05 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:337 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'5, mlcod=33'3)", 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.891190541999997, 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004459658, 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.095 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166908+0000", 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2259999999999999e-06 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166922+0000", 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4780000000000001e-05 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166960+0000", 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8173000000000002e-05 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166981+0000", 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0440000000000001e-05 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167154+0000", 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017287199999999999 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167207+0000", 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000001e-05 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171283+0000", 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004076278 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171365+0000", 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1588999999999994e-05 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:349 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:02:01.099 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.890315745999999, 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042886440000000003, 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:02:01.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167782+0000", 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167797+0000", 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4533e-05 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167828+0000", 2024-05-07T14:02:01.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1239999999999999e-05 2024-05-07T14:02:01.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167859+0000", 2024-05-07T14:02:01.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1007000000000003e-05 2024-05-07T14:02:01.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168041+0000", 2024-05-07T14:02:01.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181788 2024-05-07T14:02:01.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168095+0000", 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3857000000000003e-05 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171961+0000", 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038664160000000001 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172069+0000", 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107793 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.103 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:357 6.5 e33/27 6:a60f9269:lc::lua_package_allowlist:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.888147015999998, 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002145817, 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:02:01.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169950+0000", 2024-05-07T14:02:01.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.626e-06 2024-05-07T14:02:01.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169963+0000", 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2619999999999999e-05 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169990+0000", 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7084e-05 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170003+0000", 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3312999999999999e-05 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170144+0000", 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140376 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170203+0000", 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9586000000000002e-05 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172022+0000", 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018187419999999999 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172095+0000", 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2470000000000002e-05 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:386 6.c e33/27 6:3677c228:::obj_delete_at_hint.0000000006:head v 33'1, mlcod=0'0)", 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.874616680000003, 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016811230000000001, 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.108 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183481+0000", 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.756e-06 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183493+0000", 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.254e-05 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183520+0000", 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6809999999999999e-05 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183539+0000", 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8233e-05 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183686+0000", 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147045 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183741+0000", 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5380000000000002e-05 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185039+0000", 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012981500000000001 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185160+0000", 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121209 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:604 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'10, mlcod=33'8)", 2024-05-07T14:02:01.112 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.728755831999997, 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003281431, 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:02:01.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329341+0000", 2024-05-07T14:02:01.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.42e-06 2024-05-07T14:02:01.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329351+0000", 2024-05-07T14:02:01.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0002e-05 2024-05-07T14:02:01.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329373+0000", 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1209e-05 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329384+0000", 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1161999999999999e-05 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329495+0000", 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111302 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329522+0000", 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7291999999999999e-05 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332531+0000", 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003008405 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332621+0000", 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0638999999999997e-05 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:656 6.1 e33/27 6:84d19476:::obj_delete_at_hint.0000000038:head v 33'5, mlcod=33'3)", 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.682351713999999, 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020273800000000001, 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375746+0000", 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0499999999999999e-06 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375759+0000", 2024-05-07T14:02:01.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2952999999999999e-05 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375789+0000", 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9612999999999999e-05 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375804+0000", 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5449999999999999e-05 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375931+0000", 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126883 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375972+0000", 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0581999999999999e-05 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377685+0000", 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017136740000000001 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377772+0000", 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6174999999999994e-05 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:665 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.673847455999997, 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001677357, 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.121 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384250+0000", 2024-05-07T14:02:01.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7099999999999999e-06 2024-05-07T14:02:01.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384261+0000", 2024-05-07T14:02:01.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.113e-05 2024-05-07T14:02:01.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384287+0000", 2024-05-07T14:02:01.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6256000000000001e-05 2024-05-07T14:02:01.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384301+0000", 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3443e-05 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384443+0000", 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142192 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384509+0000", 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6124000000000006e-05 2024-05-07T14:02:01.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385819+0000", 2024-05-07T14:02:01.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013092889999999999 2024-05-07T14:02:01.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385926+0000", 2024-05-07T14:02:01.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010721300000000001 2024-05-07T14:02:01.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.125 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:685 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'4, mlcod=33'2)", 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.657155262000003, 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025309769999999998, 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400943+0000", 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0899999999999999e-06 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400960+0000", 2024-05-07T14:02:01.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6917000000000001e-05 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400995+0000", 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5626000000000001e-05 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401014+0000", 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9126e-05 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401164+0000", 2024-05-07T14:02:01.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149989 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401218+0000", 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3550000000000001e-05 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403375+0000", 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00215737 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403472+0000", 2024-05-07T14:02:01.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6309000000000002e-05 2024-05-07T14:02:01.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.130 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.130 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:686 6.1f e33/27 6:f93251ce:::obj_delete_at_hint.0000000042:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:01.130 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:02:01.130 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.655705406999999, 2024-05-07T14:02:01.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037357750000000002, 2024-05-07T14:02:01.130 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402392+0000", 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9870000000000002e-06 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402405+0000", 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.222e-05 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402429+0000", 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4729999999999999e-05 2024-05-07T14:02:01.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402448+0000", 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8493000000000001e-05 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402604+0000", 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155876 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402647+0000", 2024-05-07T14:02:01.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2793000000000002e-05 2024-05-07T14:02:01.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406039+0000", 2024-05-07T14:02:01.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033922760000000001 2024-05-07T14:02:01.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406126+0000", 2024-05-07T14:02:01.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7399999999999997e-05 2024-05-07T14:02:01.134 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.134 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.134 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:693 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'5, mlcod=33'3)", 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.649978978, 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037287790000000002, 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408119+0000", 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0040000000000002e-06 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408135+0000", 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6155999999999999e-05 2024-05-07T14:02:01.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408193+0000", 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8023999999999999e-05 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408248+0000", 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4664999999999999e-05 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408410+0000", 2024-05-07T14:02:01.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016263599999999999 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408462+0000", 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1913000000000003e-05 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411739+0000", 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032768350000000001 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411846+0000", 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010654600000000001 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:694 6.5 e33/27 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 33'8, mlcod=33'6)", 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.647362643999998, 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038331400000000001, 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410735+0000", 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.793e-06 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410746+0000", 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1377e-05 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410775+0000", 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8336000000000001e-05 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410788+0000", 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3074000000000001e-05 2024-05-07T14:02:01.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410945+0000", 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015738199999999999 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411009+0000", 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4276000000000006e-05 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414499+0000", 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034896060000000001 2024-05-07T14:02:01.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414566+0000", 2024-05-07T14:02:01.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7296000000000001e-05 2024-05-07T14:02:01.143 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.143 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.143 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.143 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.143 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.143 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:01.145 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:01.145 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:01.158+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:01.246 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:01.258+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:01.272 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:01.272 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:01.272 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:01.272 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:01.286 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:01.347 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:01.358+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:01.410 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:01.410 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:01.410 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:01.410 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:01.410 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:01.421 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:02:01.440 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:02:01.467 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:01.482+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:01.549 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:01.562+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:01.550 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:01.550 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:02:01.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:02:01.551 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:02:01.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.551 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:01.551 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:02:01.551 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.734035223000006, 2024-05-07T14:02:01.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63420480000000001, 2024-05-07T14:02:01.551 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.551 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.551 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.551 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.551 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.551 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.551 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827477+0000", 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827491+0000", 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3923999999999999e-05 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827514+0000", 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2796e-05 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827531+0000", 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7520000000000002e-05 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827677+0000", 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145408 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827703+0000", 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6704e-05 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.458662+0000", 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63095893199999997 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459006+0000", 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034329 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459320+0000", 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031472100000000001 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.460665+0000", 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001344633 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461508+0000", 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084310400000000001 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461608+0000", 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9481999999999994e-05 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461680+0000", 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1976000000000003e-05 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.036974891, 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015167432999999999, 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.557 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 37 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524536+0000", 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524542+0000", 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7699999999999998e-06 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524551+0000", 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4199999999999996e-06 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524558+0000", 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.379e-06 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534146+0000", 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095872700000000002 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534387+0000", 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024181499999999999 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534752+0000", 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036441400000000002 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.536608+0000", 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001856239 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539547+0000", 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00293859 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539639+0000", 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2548999999999998e-05 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539703+0000", 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3330000000000005e-05 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.562 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.917446587000001, 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013763364, 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.563 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 88 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644064+0000", 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644070+0000", 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5500000000000002e-06 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644079+0000", 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.55e-06 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644086+0000", 2024-05-07T14:02:01.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.934e-06 2024-05-07T14:02:01.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655168+0000", 2024-05-07T14:02:01.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011081967 2024-05-07T14:02:01.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655307+0000", 2024-05-07T14:02:01.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013893600000000001 2024-05-07T14:02:01.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655515+0000", 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020742499999999999 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657174+0000", 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016592340000000001 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657576+0000", 2024-05-07T14:02:01.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040245400000000001 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657723+0000", 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014719200000000001 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657827+0000", 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103319 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.750911402, 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014874368000000001, 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 108 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:01.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:01.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:01.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0699999999999996e-07 2024-05-07T14:02:01.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810608+0000", 2024-05-07T14:02:01.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6330000000000002e-06 2024-05-07T14:02:01.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810618+0000", 2024-05-07T14:02:01.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0366999999999999e-05 2024-05-07T14:02:01.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810626+0000", 2024-05-07T14:02:01.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7430000000000002e-06 2024-05-07T14:02:01.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818597+0000", 2024-05-07T14:02:01.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079710549999999995 2024-05-07T14:02:01.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818873+0000", 2024-05-07T14:02:01.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027635099999999998 2024-05-07T14:02:01.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.819288+0000", 2024-05-07T14:02:01.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041430599999999997 2024-05-07T14:02:01.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822081+0000", 2024-05-07T14:02:01.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002793032 2024-05-07T14:02:01.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825193+0000", 2024-05-07T14:02:01.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003112606 2024-05-07T14:02:01.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825361+0000", 2024-05-07T14:02:01.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167703 2024-05-07T14:02:01.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825473+0000", 2024-05-07T14:02:01.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111865 2024-05-07T14:02:01.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.581 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.582 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:01.582 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:02:01.582 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.750762080000001, 2024-05-07T14:02:01.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015242152, 2024-05-07T14:02:01.582 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.583 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.583 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.583 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.583 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.583 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.584 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 109 2024-05-07T14:02:01.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.584 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:02:01.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:02:01.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810749+0000", 2024-05-07T14:02:01.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-06 2024-05-07T14:02:01.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810943+0000", 2024-05-07T14:02:01.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019437499999999999 2024-05-07T14:02:01.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810959+0000", 2024-05-07T14:02:01.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5440000000000001e-05 2024-05-07T14:02:01.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810971+0000", 2024-05-07T14:02:01.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2023e-05 2024-05-07T14:02:01.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820386+0000", 2024-05-07T14:02:01.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094148570000000004 2024-05-07T14:02:01.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820569+0000", 2024-05-07T14:02:01.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018298199999999999 2024-05-07T14:02:01.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820827+0000", 2024-05-07T14:02:01.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025869400000000001 2024-05-07T14:02:01.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825585+0000", 2024-05-07T14:02:01.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004757051 2024-05-07T14:02:01.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825752+0000", 2024-05-07T14:02:01.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167479 2024-05-07T14:02:01.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825881+0000", 2024-05-07T14:02:01.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128629 2024-05-07T14:02:01.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825990+0000", 2024-05-07T14:02:01.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109415 2024-05-07T14:02:01.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.594 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.595 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:01.595 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:02:01.595 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.750519728, 2024-05-07T14:02:01.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015251472, 2024-05-07T14:02:01.596 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.596 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.596 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.596 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.596 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.596 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.597 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 110 2024-05-07T14:02:01.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.597 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:02:01.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810991+0000", 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7600000000000006e-07 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810998+0000", 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3899999999999998e-06 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811007+0000", 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5869999999999999e-06 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811014+0000", 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822508+0000", 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01149416 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822698+0000", 2024-05-07T14:02:01.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018972600000000001 2024-05-07T14:02:01.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823009+0000", 2024-05-07T14:02:01.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031125100000000002 2024-05-07T14:02:01.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825710+0000", 2024-05-07T14:02:01.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002700619 2024-05-07T14:02:01.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826014+0000", 2024-05-07T14:02:01.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030398799999999999 2024-05-07T14:02:01.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826137+0000", 2024-05-07T14:02:01.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123416 2024-05-07T14:02:01.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826242+0000", 2024-05-07T14:02:01.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104279 2024-05-07T14:02:01.605 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.606 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.606 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.606 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:01.606 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:02:01.606 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.750484827999998, 2024-05-07T14:02:01.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017650448999999999, 2024-05-07T14:02:01.607 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.607 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.607 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.607 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.607 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.607 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.607 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 111 2024-05-07T14:02:01.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.608 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:02:01.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:02:01.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811026+0000", 2024-05-07T14:02:01.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5300000000000004e-07 2024-05-07T14:02:01.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811031+0000", 2024-05-07T14:02:01.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0329999999999999e-06 2024-05-07T14:02:01.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811043+0000", 2024-05-07T14:02:01.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2543e-05 2024-05-07T14:02:01.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811050+0000", 2024-05-07T14:02:01.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8000000000000001e-06 2024-05-07T14:02:01.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823676+0000", 2024-05-07T14:02:01.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012626052 2024-05-07T14:02:01.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823904+0000", 2024-05-07T14:02:01.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227562 2024-05-07T14:02:01.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.824349+0000", 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044484 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826371+0000", 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020221380000000001 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828408+0000", 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020372369999999999 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828540+0000", 2024-05-07T14:02:01.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013213600000000001 2024-05-07T14:02:01.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828676+0000", 2024-05-07T14:02:01.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013545500000000001 2024-05-07T14:02:01.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.614 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.614 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.750423412999993, 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021330954999999999, 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 112 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-07 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811224+0000", 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653499999999999 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811237+0000", 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.271e-05 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811245+0000", 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6400000000000003e-06 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826483+0000", 2024-05-07T14:02:01.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015237456 2024-05-07T14:02:01.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826705+0000", 2024-05-07T14:02:01.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022216799999999999 2024-05-07T14:02:01.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.827081+0000", 2024-05-07T14:02:01.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037659800000000002 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.831960+0000", 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048788779999999997 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832167+0000", 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020690500000000001 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832305+0000", 2024-05-07T14:02:01.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013801899999999999 2024-05-07T14:02:01.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832418+0000", 2024-05-07T14:02:01.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112212 2024-05-07T14:02:01.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.620 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.620 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:01.620 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:02:01.620 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.750249904, 2024-05-07T14:02:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021403628000000001, 2024-05-07T14:02:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 113 2024-05-07T14:02:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:02:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:02:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811261+0000", 2024-05-07T14:02:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0400000000000005e-07 2024-05-07T14:02:01.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811267+0000", 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6099999999999997e-06 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811276+0000", 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4029999999999996e-06 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811283+0000", 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:02:01.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828825+0000", 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017541853999999999 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829061+0000", 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235861 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829418+0000", 2024-05-07T14:02:01.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035766800000000001 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832130+0000", 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027118120000000001 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832442+0000", 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000311611 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832565+0000", 2024-05-07T14:02:01.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012284199999999999 2024-05-07T14:02:01.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832664+0000", 2024-05-07T14:02:01.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8982999999999997e-05 2024-05-07T14:02:01.626 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.626 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.626 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.626 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:01.626 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:02:01.626 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.750215913999995, 2024-05-07T14:02:01.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023518260999999999, 2024-05-07T14:02:01.627 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.627 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.627 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.627 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.627 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.627 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.627 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 114 2024-05-07T14:02:01.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.627 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811295+0000", 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811301+0000", 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8599999999999998e-06 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811310+0000", 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0299999999999999e-06 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811320+0000", 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023e-05 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830314+0000", 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018994385999999999 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830552+0000", 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023815500000000001 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830971+0000", 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041934300000000003 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834620+0000", 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036481389999999999 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834666+0000", 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6266000000000001e-05 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834742+0000", 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6069000000000006e-05 2024-05-07T14:02:01.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834812+0000", 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0372999999999999e-05 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.750175354999996, 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027863941999999999, 2024-05-07T14:02:01.632 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 115 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:01.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:01.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2699999999999999e-07 2024-05-07T14:02:01.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811469+0000", 2024-05-07T14:02:01.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133332 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811502+0000", 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3027000000000001e-05 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811511+0000", 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.713e-06 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832759+0000", 2024-05-07T14:02:01.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021248185999999999 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832917+0000", 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157825 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.833269+0000", 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035184099999999998 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838250+0000", 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004980712 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838941+0000", 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069081399999999999 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839091+0000", 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149903 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839199+0000", 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010796199999999999 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.749981492000003, 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028128562999999999, 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.638 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 116 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:02:01.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811529+0000", 2024-05-07T14:02:01.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:02:01.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811546+0000", 2024-05-07T14:02:01.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7113e-05 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811570+0000", 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.406e-05 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811578+0000", 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8660000000000006e-06 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834997+0000", 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023418799000000001 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835317+0000", 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031991799999999998 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835662+0000", 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034544399999999998 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839220+0000", 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035576959999999999 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839374+0000", 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015427600000000001 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839540+0000", 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016534500000000001 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839657+0000", 2024-05-07T14:02:01.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117243 2024-05-07T14:02:01.644 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.644 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.644 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.644 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:01.644 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:02:01.644 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.749918480000005, 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02858051, 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 117 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:02:01.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:02:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811592+0000", 2024-05-07T14:02:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:02:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811601+0000", 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1269999999999992e-06 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811611+0000", 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6900000000000004e-06 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811618+0000", 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0770000000000002e-06 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836766+0000", 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025147966000000001 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836982+0000", 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021640400000000001 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.837283+0000", 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030005800000000002 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839885+0000", 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002602937 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839925+0000", 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9446000000000001e-05 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840061+0000", 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136043 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840172+0000", 2024-05-07T14:02:01.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111019 2024-05-07T14:02:01.650 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.650 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.650 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.650 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:01.650 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:02:01.650 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.262350482000002, 2024-05-07T14:02:01.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014903938, 2024-05-07T14:02:01.650 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 137 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:02:01.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299160+0000", 2024-05-07T14:02:01.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4400000000000001e-07 2024-05-07T14:02:01.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299232+0000", 2024-05-07T14:02:01.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2348000000000006e-05 2024-05-07T14:02:01.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299251+0000", 2024-05-07T14:02:01.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9086e-05 2024-05-07T14:02:01.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299258+0000", 2024-05-07T14:02:01.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0659999999999998e-06 2024-05-07T14:02:01.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306394+0000", 2024-05-07T14:02:01.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071357629999999998 2024-05-07T14:02:01.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306491+0000", 2024-05-07T14:02:01.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6526000000000004e-05 2024-05-07T14:02:01.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306652+0000", 2024-05-07T14:02:01.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000161674 2024-05-07T14:02:01.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312756+0000", 2024-05-07T14:02:01.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061035860000000003 2024-05-07T14:02:01.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313919+0000", 2024-05-07T14:02:01.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011630919999999999 2024-05-07T14:02:01.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314000+0000", 2024-05-07T14:02:01.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1037000000000004e-05 2024-05-07T14:02:01.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314063+0000", 2024-05-07T14:02:01.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3316000000000002e-05 2024-05-07T14:02:01.659 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.659 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.660 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.660 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:01.660 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:02:01.660 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.262238523999997, 2024-05-07T14:02:01.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01524198, 2024-05-07T14:02:01.661 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.661 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.661 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.661 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.661 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.661 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.661 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 138 2024-05-07T14:02:01.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.662 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:02:01.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:02:01.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299272+0000", 2024-05-07T14:02:01.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8599999999999998e-07 2024-05-07T14:02:01.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299282+0000", 2024-05-07T14:02:01.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0051000000000001e-05 2024-05-07T14:02:01.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299297+0000", 2024-05-07T14:02:01.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5125e-05 2024-05-07T14:02:01.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299302+0000", 2024-05-07T14:02:01.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2119999999999997e-06 2024-05-07T14:02:01.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309582+0000", 2024-05-07T14:02:01.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010280163 2024-05-07T14:02:01.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309722+0000", 2024-05-07T14:02:01.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140715 2024-05-07T14:02:01.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309941+0000", 2024-05-07T14:02:01.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000218249 2024-05-07T14:02:01.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313900+0000", 2024-05-07T14:02:01.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039598080000000004 2024-05-07T14:02:01.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314411+0000", 2024-05-07T14:02:01.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051060400000000001 2024-05-07T14:02:01.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314466+0000", 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4861000000000002e-05 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314513+0000", 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7506000000000002e-05 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.262200222999994, 2024-05-07T14:02:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01724038, 2024-05-07T14:02:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 139 2024-05-07T14:02:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.670 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:01.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:01.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:01.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3099999999999998e-07 2024-05-07T14:02:01.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299313+0000", 2024-05-07T14:02:01.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9390000000000002e-06 2024-05-07T14:02:01.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299318+0000", 2024-05-07T14:02:01.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5909999999999998e-06 2024-05-07T14:02:01.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299321+0000", 2024-05-07T14:02:01.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3890000000000001e-06 2024-05-07T14:02:01.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310603+0000", 2024-05-07T14:02:01.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011281753 2024-05-07T14:02:01.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310704+0000", 2024-05-07T14:02:01.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010111900000000001 2024-05-07T14:02:01.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310888+0000", 2024-05-07T14:02:01.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183666 2024-05-07T14:02:01.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314523+0000", 2024-05-07T14:02:01.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036354999999999998 2024-05-07T14:02:01.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316436+0000", 2024-05-07T14:02:01.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001913238 2024-05-07T14:02:01.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316501+0000", 2024-05-07T14:02:01.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4261e-05 2024-05-07T14:02:01.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316550+0000", 2024-05-07T14:02:01.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9493000000000002e-05 2024-05-07T14:02:01.681 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.681 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.681 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.682 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:01.682 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:01.682 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.262179892999995, 2024-05-07T14:02:01.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019781539000000001, 2024-05-07T14:02:01.682 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.682 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.683 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.683 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 140 2024-05-07T14:02:01.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.684 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:01.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:01.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:01.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-07 2024-05-07T14:02:01.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299398+0000", 2024-05-07T14:02:01.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7822000000000002e-05 2024-05-07T14:02:01.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299404+0000", 2024-05-07T14:02:01.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2369999999999997e-06 2024-05-07T14:02:01.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299409+0000", 2024-05-07T14:02:01.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2069999999999997e-06 2024-05-07T14:02:01.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311355+0000", 2024-05-07T14:02:01.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011946082 2024-05-07T14:02:01.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311493+0000", 2024-05-07T14:02:01.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013830900000000001 2024-05-07T14:02:01.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311709+0000", 2024-05-07T14:02:01.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021606899999999999 2024-05-07T14:02:01.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314528+0000", 2024-05-07T14:02:01.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028193839999999999 2024-05-07T14:02:01.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319001+0000", 2024-05-07T14:02:01.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004472218 2024-05-07T14:02:01.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319063+0000", 2024-05-07T14:02:01.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1940000000000007e-05 2024-05-07T14:02:01.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319112+0000", 2024-05-07T14:02:01.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8964000000000001e-05 2024-05-07T14:02:01.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.695 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.696 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:01.696 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:02:01.696 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.262093527999994, 2024-05-07T14:02:01.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019944718, 2024-05-07T14:02:01.696 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.696 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.697 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.697 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.697 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.697 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.697 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 141 2024-05-07T14:02:01.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.698 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:02:01.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:02:01.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299417+0000", 2024-05-07T14:02:01.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7099999999999997e-07 2024-05-07T14:02:01.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299420+0000", 2024-05-07T14:02:01.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8629999999999999e-06 2024-05-07T14:02:01.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299424+0000", 2024-05-07T14:02:01.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4830000000000001e-06 2024-05-07T14:02:01.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299429+0000", 2024-05-07T14:02:01.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6609999999999999e-06 2024-05-07T14:02:01.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312813+0000", 2024-05-07T14:02:01.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013384330999999999 2024-05-07T14:02:01.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312948+0000", 2024-05-07T14:02:01.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000135239 2024-05-07T14:02:01.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313163+0000", 2024-05-07T14:02:01.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000214718 2024-05-07T14:02:01.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314534+0000", 2024-05-07T14:02:01.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013704430000000001 2024-05-07T14:02:01.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319185+0000", 2024-05-07T14:02:01.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046516839999999997 2024-05-07T14:02:01.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319281+0000", 2024-05-07T14:02:01.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5645999999999999e-05 2024-05-07T14:02:01.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319361+0000", 2024-05-07T14:02:01.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0278999999999995e-05 2024-05-07T14:02:01.707 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.707 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.707 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.707 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:01.707 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:02:01.707 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.549841029999996, 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013780794000000001, 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 158 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:02:01.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011670+0000", 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011817+0000", 2024-05-07T14:02:01.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014761200000000001 2024-05-07T14:02:01.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011830+0000", 2024-05-07T14:02:01.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2653999999999999e-05 2024-05-07T14:02:01.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011844+0000", 2024-05-07T14:02:01.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4039999999999999e-05 2024-05-07T14:02:01.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020200+0000", 2024-05-07T14:02:01.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083561409999999992 2024-05-07T14:02:01.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020433+0000", 2024-05-07T14:02:01.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000233088 2024-05-07T14:02:01.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020662+0000", 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000229015 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023097+0000", 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024346480000000002 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025218+0000", 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021216669999999998 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025350+0000", 2024-05-07T14:02:01.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013124600000000001 2024-05-07T14:02:01.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025450+0000", 2024-05-07T14:02:01.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010002599999999999 2024-05-07T14:02:01.713 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.713 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.713 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.714 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:01.714 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:02:01.714 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 74.549650514000007, 2024-05-07T14:02:01.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013831896, 2024-05-07T14:02:01.714 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:01.714 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:01.714 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:01.714 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:01.714 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:01.714 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:01.714 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 159 2024-05-07T14:02:01.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.714 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011860+0000", 2024-05-07T14:02:01.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8999999999999995e-07 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011874+0000", 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3806e-05 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011884+0000", 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5629999999999998e-06 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:01.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011894+0000", 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0353999999999999e-05 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023169+0000", 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011274872 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023305+0000", 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653299999999999 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:01.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023505+0000", 2024-05-07T14:02:01.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000199254 2024-05-07T14:02:01.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:01.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.024966+0000", 2024-05-07T14:02:01.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014616830000000001 2024-05-07T14:02:01.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:01.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025472+0000", 2024-05-07T14:02:01.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00050618899999999999 2024-05-07T14:02:01.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025593+0000", 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120019 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025691+0000", 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8832999999999994e-05 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:01.719 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:01.720 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:02:01.721 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:01.734+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:01.722 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:02:01.822 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:01.834+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:01.848 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:01.848 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:01.848 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:01.848 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:01.866 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:02:01.879 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:01.880 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:01.896 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:01.897 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:01.913 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:01.913 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:01.923 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:01.934+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:01.931 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:01.931 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:01.951 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:01.952 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:01.974 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:01.975 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:01.983 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:01.983 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:01.997 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:01.999 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:02:02.018 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:02.019 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:02.037 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:02.050+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:02.127 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:02.138+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:02.136 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:02.137 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:02.151 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:02:02.228 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:02.242+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:02.273 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:02.273 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:02.287 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:02:02.336 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:02.350+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:02.409 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:02.409 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:02.423 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:02:02.464 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:02.478+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:02.531 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:02.542+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:02.587 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:02.587 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:02.602 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:02:02.644 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:02.658+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:02.733 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:02.746+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:02.767 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:02.768 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:02.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:02:02.868 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:02.882+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:02.936 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:02.950+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:02.950 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:02.950 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:02.965 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:02:03.037 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:03.050+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:03.138 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:03.150+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:03.146 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:03.146 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:03.161 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:02:03.239 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:03.250+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:03.321 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:03.321 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:03.335 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:02:03.339 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:03.354+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:03.440 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:03.454+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:03.454 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:03.454 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:03.467 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:02:03.470 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:02:03.541 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:03.554+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:03.636 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:03.636 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:03.642 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:03.654+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:03.653 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:02:03.743 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:03.754+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:03.788 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:03.788 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:03.802 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:02:03.844 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:03.858+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:03.944 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:03.958+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:03.968 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:03.968 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:03.982 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:02:04.038 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:02:04.045 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:04.058+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:04.104 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:04.105 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:04.120 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:02:04.146 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:04.158+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:04.189 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:04.189 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:04.206 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:04.206 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:04.222 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:04.239 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:04.239 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:04.247 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:04.258+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:04.258 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:04.279 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:04.279 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:04.285 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:04.285 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:04.285 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:04.285 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:04.299 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:04.300 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:04.316 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:04.316 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:04.387 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:04.402+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:04.450 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:04.462+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:04.452 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:02:04.471 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:04.471 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:04.485 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:04.550 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:04.562+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:04.651 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:04.662+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:04.656 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:02:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:02:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:02:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:02:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.640034796999998, 2024-05-07T14:02:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033108180000000001, 2024-05-07T14:02:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 48 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026895+0000", 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026898+0000", 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2369999999999999e-06 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026908+0000", 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8109999999999997e-06 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026934+0000", 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6746000000000001e-05 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026949+0000", 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4517e-05 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027084+0000", 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013501499999999999 2024-05-07T14:02:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027360+0000", 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027639199999999998 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027616+0000", 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025541799999999999 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.028902+0000", 2024-05-07T14:02:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012859989999999999 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030044+0000", 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001142295 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030136+0000", 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1794999999999998e-05 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030206+0000", 2024-05-07T14:02:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0593000000000007e-05 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.654560887999999, 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058205720000000004, 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 205 2024-05-07T14:02:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:02:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:02:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012373+0000", 2024-05-07T14:02:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.07e-06 2024-05-07T14:02:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012397+0000", 2024-05-07T14:02:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3697e-05 2024-05-07T14:02:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012450+0000", 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2539e-05 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012477+0000", 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7457000000000002e-05 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012735+0000", 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025820800000000001 2024-05-07T14:02:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013057+0000", 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000321727 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013752+0000", 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069509499999999996 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.017093+0000", 2024-05-07T14:02:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033404340000000002 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018024+0000", 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00093108600000000002 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018113+0000", 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9752000000000004e-05 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018190+0000", 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6507000000000005e-05 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.584309900000001, 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052341489999999996, 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 220 2024-05-07T14:02:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:02:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:02:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082623+0000", 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8370000000000001e-06 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082636+0000", 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2316e-05 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082667+0000", 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1139999999999997e-05 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082681+0000", 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4816e-05 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082825+0000", 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014377899999999999 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083051+0000", 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022549500000000001 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083453+0000", 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000401944 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.085929+0000", 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024763369999999999 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087649+0000", 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001719747 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087735+0000", 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6415999999999994e-05 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087855+0000", 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011932199999999999 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.571890169, 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00342407, 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 223 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095042+0000", 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1799999999999999e-06 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095054+0000", 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1817000000000001e-05 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095084+0000", 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0018999999999998e-05 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095099+0000", 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.537e-05 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095209+0000", 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010943299999999999 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095457+0000", 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247941 2024-05-07T14:02:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095879+0000", 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042171299999999999 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.097290+0000", 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014118519999999999 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098196+0000", 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00090603700000000005 2024-05-07T14:02:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098348+0000", 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151879 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098464+0000", 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011582900000000001 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.564349968000002, 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031839889999999999, 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 225 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:02:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102580+0000", 2024-05-07T14:02:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102582+0000", 2024-05-07T14:02:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:02:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102594+0000", 2024-05-07T14:02:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1382999999999999e-05 2024-05-07T14:02:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102625+0000", 2024-05-07T14:02:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0880000000000002e-05 2024-05-07T14:02:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102640+0000", 2024-05-07T14:02:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4949999999999999e-05 2024-05-07T14:02:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102756+0000", 2024-05-07T14:02:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116072 2024-05-07T14:02:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.102998+0000", 2024-05-07T14:02:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024203199999999999 2024-05-07T14:02:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.103438+0000", 2024-05-07T14:02:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044011700000000001 2024-05-07T14:02:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105252+0000", 2024-05-07T14:02:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018136490000000001 2024-05-07T14:02:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105608+0000", 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035604000000000001 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105699+0000", 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1316999999999993e-05 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.105764+0000", 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5371999999999997e-05 2024-05-07T14:02:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.560873620999999, 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003090256, 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 226 2024-05-07T14:02:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106057+0000", 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106059+0000", 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3e-06 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106070+0000", 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1257000000000001e-05 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106101+0000", 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0783e-05 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106116+0000", 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5136e-05 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106217+0000", 2024-05-07T14:02:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101183 2024-05-07T14:02:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106433+0000", 2024-05-07T14:02:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021523199999999999 2024-05-07T14:02:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.106826+0000", 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039372000000000002 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.108406+0000", 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001579815 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.108987+0000", 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058058100000000004 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.109073+0000", 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6650000000000006e-05 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.109147+0000", 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3598999999999998e-05 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.531421217999998, 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030980790000000001, 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 234 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135509+0000", 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135511+0000", 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4030000000000001e-06 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135523+0000", 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1559999999999999e-05 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135557+0000", 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4372999999999998e-05 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135572+0000", 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4647000000000001e-05 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135674+0000", 2024-05-07T14:02:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101932 2024-05-07T14:02:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.135888+0000", 2024-05-07T14:02:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000213995 2024-05-07T14:02:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.136311+0000", 2024-05-07T14:02:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042278999999999998 2024-05-07T14:02:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.137726+0000", 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001415319 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138450+0000", 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00072404800000000003 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138543+0000", 2024-05-07T14:02:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2559000000000006e-05 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.138607+0000", 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4453000000000001e-05 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.512371195999997, 2024-05-07T14:02:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035934819999999998, 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 271 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154562+0000", 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154578+0000", 2024-05-07T14:02:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6667000000000002e-05 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154612+0000", 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3120000000000001e-05 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154632+0000", 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0769999999999999e-05 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154774+0000", 2024-05-07T14:02:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141805 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155004+0000", 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022938200000000001 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155372+0000", 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036889300000000002 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156948+0000", 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015755750000000001 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.157903+0000", 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095453499999999995 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158050+0000", 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147279 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158153+0000", 2024-05-07T14:02:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102729 2024-05-07T14:02:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:402 6.4 e33/27 6:24c8e1ae:gc::gc.19:head v 33'8, mlcod=33'6)", 2024-05-07T14:02:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:02:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.474299062, 2024-05-07T14:02:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032167609999999998, 2024-05-07T14:02:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192631+0000", 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192633+0000", 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6759999999999999e-06 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192645+0000", 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2037e-05 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192669+0000", 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3723e-05 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192683+0000", 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4416000000000001e-05 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192792+0000", 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109029 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192848+0000", 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5674000000000003e-05 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.195758+0000", 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029099199999999999 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.195848+0000", 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0285999999999996e-05 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:415 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.466592835, 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065364059999999998, 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 415 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200339+0000", 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.826e-06 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200348+0000", 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0669999999999998e-06 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200378+0000", 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.968e-05 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200393+0000", 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5109999999999999e-05 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200515+0000", 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121449 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200658+0000", 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014362199999999999 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200958+0000", 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030029699999999999 2024-05-07T14:02:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202106+0000", 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011475050000000001 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206707+0000", 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046009980000000002 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206791+0000", 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4118999999999999e-05 2024-05-07T14:02:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206874+0000", 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2732999999999995e-05 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:417 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.464094744000001, 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034776160000000002, 2024-05-07T14:02:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 417 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:02:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202838+0000", 2024-05-07T14:02:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3760000000000002e-06 2024-05-07T14:02:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202872+0000", 2024-05-07T14:02:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4379999999999999e-05 2024-05-07T14:02:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202900+0000", 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8180000000000001e-05 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202915+0000", 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.486e-05 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203063+0000", 2024-05-07T14:02:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014788799999999999 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203423+0000", 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035942400000000001 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.204005+0000", 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058227599999999995 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205280+0000", 2024-05-07T14:02:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012753 2024-05-07T14:02:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206135+0000", 2024-05-07T14:02:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00085444999999999998 2024-05-07T14:02:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206234+0000", 2024-05-07T14:02:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9088999999999999e-05 2024-05-07T14:02:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206313+0000", 2024-05-07T14:02:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9393000000000004e-05 2024-05-07T14:02:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:420 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:02:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.461758326000002, 2024-05-07T14:02:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042372210000000002, 2024-05-07T14:02:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 420 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205174+0000", 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1100000000000001e-06 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205186+0000", 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.169e-05 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205218+0000", 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2617000000000003e-05 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205240+0000", 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1331999999999998e-05 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205356+0000", 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011655 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205623+0000", 2024-05-07T14:02:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026669399999999999 2024-05-07T14:02:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206029+0000", 2024-05-07T14:02:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040652 2024-05-07T14:02:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.208187+0000", 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021578439999999999 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209226+0000", 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001039058 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209305+0000", 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8650000000000001e-05 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209409+0000", 2024-05-07T14:02:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104156 2024-05-07T14:02:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:429 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:02:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.456727284999999, 2024-05-07T14:02:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040139620000000003, 2024-05-07T14:02:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 429 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210205+0000", 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.66e-06 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210228+0000", 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210244+0000", 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6339999999999999e-05 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210256+0000", 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1949e-05 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210472+0000", 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215529 2024-05-07T14:02:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210681+0000", 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000208982 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211154+0000", 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047321599999999999 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212660+0000", 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001506098 2024-05-07T14:02:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214071+0000", 2024-05-07T14:02:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014107429999999999 2024-05-07T14:02:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214153+0000", 2024-05-07T14:02:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1889000000000002e-05 2024-05-07T14:02:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214217+0000", 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4336000000000002e-05 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:430 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.456381520999997, 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066752119999999998, 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 430 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:02:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210551+0000", 2024-05-07T14:02:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:02:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210562+0000", 2024-05-07T14:02:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0237e-05 2024-05-07T14:02:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210586+0000", 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4066e-05 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210603+0000", 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.713e-05 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211799+0000", 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001196127 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211931+0000", 2024-05-07T14:02:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131629 2024-05-07T14:02:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212211+0000", 2024-05-07T14:02:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028005100000000002 2024-05-07T14:02:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.213288+0000", 2024-05-07T14:02:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010772760000000001 2024-05-07T14:02:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217047+0000", 2024-05-07T14:02:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037586569999999999 2024-05-07T14:02:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217127+0000", 2024-05-07T14:02:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0270000000000002e-05 2024-05-07T14:02:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217224+0000", 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7139000000000006e-05 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.449604246, 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003780107, 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 436 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:02:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217328+0000", 2024-05-07T14:02:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:02:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217356+0000", 2024-05-07T14:02:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8158999999999999e-05 2024-05-07T14:02:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217377+0000", 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1356999999999999e-05 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217393+0000", 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5569e-05 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217882+0000", 2024-05-07T14:02:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00048937000000000004 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218099+0000", 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021691899999999999 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218390+0000", 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029041800000000002 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220013+0000", 2024-05-07T14:02:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016236169999999999 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220889+0000", 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087619599999999998 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221005+0000", 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011569 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221106+0000", 2024-05-07T14:02:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101122 2024-05-07T14:02:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:442 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:02:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.445982381, 2024-05-07T14:02:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003357184, 2024-05-07T14:02:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 442 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:02:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220950+0000", 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220958+0000", 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8429999999999999e-06 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220979+0000", 2024-05-07T14:02:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0387e-05 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220991+0000", 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.181e-05 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221218+0000", 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022694100000000001 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221362+0000", 2024-05-07T14:02:04.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014482899999999999 2024-05-07T14:02:04.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:04.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221628+0000", 2024-05-07T14:02:04.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026559799999999997 2024-05-07T14:02:04.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.223915+0000", 2024-05-07T14:02:04.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022864819999999998 2024-05-07T14:02:04.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224031+0000", 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116759 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224173+0000", 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014127599999999999 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224305+0000", 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000132519 2024-05-07T14:02:04.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:482 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.423751932999998, 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035275459999999999, 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.752 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 482 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243181+0000", 2024-05-07T14:02:04.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:02:04.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243194+0000", 2024-05-07T14:02:04.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3087e-05 2024-05-07T14:02:04.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243224+0000", 2024-05-07T14:02:04.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0546000000000002e-05 2024-05-07T14:02:04.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243240+0000", 2024-05-07T14:02:04.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5339999999999999e-05 2024-05-07T14:02:04.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243379+0000", 2024-05-07T14:02:04.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139646 2024-05-07T14:02:04.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243576+0000", 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019638300000000001 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243838+0000", 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026234300000000001 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.244908+0000", 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010696289999999999 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246477+0000", 2024-05-07T14:02:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001569471 2024-05-07T14:02:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246596+0000", 2024-05-07T14:02:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118892 2024-05-07T14:02:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246706+0000", 2024-05-07T14:02:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109899 2024-05-07T14:02:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.757 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:563 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.364761502, 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00310239, 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.758 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 563 2024-05-07T14:02:04.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.759 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:02:04.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302169+0000", 2024-05-07T14:02:04.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302171+0000", 2024-05-07T14:02:04.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1169999999999998e-06 2024-05-07T14:02:04.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302182+0000", 2024-05-07T14:02:04.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0679999999999999e-05 2024-05-07T14:02:04.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302202+0000", 2024-05-07T14:02:04.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0505000000000001e-05 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302218+0000", 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5990000000000001e-05 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302337+0000", 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119071 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302481+0000", 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014358200000000001 2024-05-07T14:02:04.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:04.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.302775+0000", 2024-05-07T14:02:04.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029423399999999999 2024-05-07T14:02:04.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.303826+0000", 2024-05-07T14:02:04.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001051485 2024-05-07T14:02:04.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305118+0000", 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001291234 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305205+0000", 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7672999999999999e-05 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.305271+0000", 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5819000000000001e-05 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.926003571000003, 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031794449999999999, 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 856 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.764 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740927+0000", 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740929+0000", 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3e-06 2024-05-07T14:02:04.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740942+0000", 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3183000000000001e-05 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740968+0000", 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5477e-05 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.740982+0000", 2024-05-07T14:02:04.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4273e-05 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741169+0000", 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018701500000000001 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741382+0000", 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021331200000000001 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.741696+0000", 2024-05-07T14:02:04.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031337800000000001 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.742864+0000", 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011688410000000001 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.743952+0000", 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001087221 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.744037+0000", 2024-05-07T14:02:04.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5242999999999997e-05 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.744106+0000", 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9202000000000006e-05 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:877 6.19 6:98c4c580:::obj_delete_at_hint.0000000100:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 56.875056927999999, 2024-05-07T14:02:04.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033601709999999999, 2024-05-07T14:02:04.770 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:04.770 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:04.770 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:04.770 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:04.770 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:04.770 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:04.770 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 877 2024-05-07T14:02:04.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.770 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:04.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:04.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:02:04.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791875+0000", 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9e-06 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:04.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791884+0000", 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7069999999999998e-06 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791907+0000", 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2682999999999999e-05 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791919+0000", 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2763e-05 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792073+0000", 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153509 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792439+0000", 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000366141 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792989+0000", 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055016899999999998 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.794288+0000", 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00129885 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795070+0000", 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000781557 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795155+0000", 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5723000000000006e-05 2024-05-07T14:02:04.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:04.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:04.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:04.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795234+0000", 2024-05-07T14:02:04.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8169000000000003e-05 2024-05-07T14:02:04.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.775 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:04.775 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:04.775 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:04.777 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:04.777 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:04.790+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:04.877 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:04.890+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:04.948 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:04.948 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:04.948 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:04.948 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:04.962 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:04.978 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:04.990+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:05.080 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:05.094+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:05.128 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:05.128 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:05.128 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:05.128 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:05.128 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:05.143 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:05.194 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:05.206+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:05.282 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:05.294+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:05.321 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:05.321 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:02:05.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:02:05.322 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:02:05.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.322 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:05.322 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:02:05.322 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.315637754999997, 2024-05-07T14:02:05.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089647730000000005, 2024-05-07T14:02:05.322 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.322 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.322 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.322 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:05.322 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:05.322 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:05.322 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 46 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017451+0000", 2024-05-07T14:02:05.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9349999999999999e-06 2024-05-07T14:02:05.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017460+0000", 2024-05-07T14:02:05.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-05-07T14:02:05.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017481+0000", 2024-05-07T14:02:05.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0984000000000001e-05 2024-05-07T14:02:05.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017499+0000", 2024-05-07T14:02:05.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:02:05.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018689+0000", 2024-05-07T14:02:05.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001190303 2024-05-07T14:02:05.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018945+0000", 2024-05-07T14:02:05.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025626799999999998 2024-05-07T14:02:05.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:05.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022176+0000", 2024-05-07T14:02:05.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032308720000000001 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026078+0000", 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039018289999999999 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026189+0000", 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110775 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026310+0000", 2024-05-07T14:02:05.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121023 2024-05-07T14:02:05.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026413+0000", 2024-05-07T14:02:05.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103346 2024-05-07T14:02:05.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.328 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.330 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94397682172928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:05.330 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:02:05.330 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.306215098999999, 2024-05-07T14:02:05.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032214489999999999, 2024-05-07T14:02:05.330 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.330 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.330 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:05.330 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 47 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026873+0000", 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4200000000000001e-06 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026883+0000", 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0017000000000001e-05 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026904+0000", 2024-05-07T14:02:05.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0228999999999999e-05 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026917+0000", 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3594000000000001e-05 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027029+0000", 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011171900000000001 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027247+0000", 2024-05-07T14:02:05.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021786099999999999 2024-05-07T14:02:05.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:05.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027599+0000", 2024-05-07T14:02:05.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035225700000000003 2024-05-07T14:02:05.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:05.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029240+0000", 2024-05-07T14:02:05.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016408620000000001 2024-05-07T14:02:05.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029864+0000", 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00062414399999999998 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029939+0000", 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4931999999999993e-05 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030092+0000", 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015341399999999999 2024-05-07T14:02:05.335 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.336 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.336 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.337 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:05.337 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:02:05.337 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.294171554000002, 2024-05-07T14:02:05.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021710919999999999, 2024-05-07T14:02:05.337 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.337 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.337 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.337 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:05.337 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:05.337 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:05.337 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 54 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038917+0000", 2024-05-07T14:02:05.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8720000000000002e-06 2024-05-07T14:02:05.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038929+0000", 2024-05-07T14:02:05.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1294999999999999e-05 2024-05-07T14:02:05.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038964+0000", 2024-05-07T14:02:05.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5516999999999999e-05 2024-05-07T14:02:05.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038983+0000", 2024-05-07T14:02:05.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:02:05.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039074+0000", 2024-05-07T14:02:05.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1106999999999994e-05 2024-05-07T14:02:05.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039201+0000", 2024-05-07T14:02:05.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012714700000000001 2024-05-07T14:02:05.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:05.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039320+0000", 2024-05-07T14:02:05.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011861100000000001 2024-05-07T14:02:05.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:05.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040439+0000", 2024-05-07T14:02:05.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011193450000000001 2024-05-07T14:02:05.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:05.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040971+0000", 2024-05-07T14:02:05.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053181599999999995 2024-05-07T14:02:05.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041040+0000", 2024-05-07T14:02:05.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8706000000000003e-05 2024-05-07T14:02:05.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041086+0000", 2024-05-07T14:02:05.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5883000000000001e-05 2024-05-07T14:02:05.343 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.343 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.343 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.343 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94397682168320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:05.343 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:02:05.343 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.291799142999999, 2024-05-07T14:02:05.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001933333, 2024-05-07T14:02:05.343 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.343 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.343 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:05.344 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:05.344 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:05.344 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 55 2024-05-07T14:02:05.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.344 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:02:05.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041288+0000", 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5200000000000001e-06 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041295+0000", 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3679999999999998e-06 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041315+0000", 2024-05-07T14:02:05.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9826999999999998e-05 2024-05-07T14:02:05.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041325+0000", 2024-05-07T14:02:05.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0402e-05 2024-05-07T14:02:05.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041403+0000", 2024-05-07T14:02:05.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8404000000000004e-05 2024-05-07T14:02:05.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041479+0000", 2024-05-07T14:02:05.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5846999999999994e-05 2024-05-07T14:02:05.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:05.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041637+0000", 2024-05-07T14:02:05.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157699 2024-05-07T14:02:05.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:05.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.042503+0000", 2024-05-07T14:02:05.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086578899999999995 2024-05-07T14:02:05.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:05.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043108+0000", 2024-05-07T14:02:05.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060548999999999998 2024-05-07T14:02:05.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043158+0000", 2024-05-07T14:02:05.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9359e-05 2024-05-07T14:02:05.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043220+0000", 2024-05-07T14:02:05.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2627999999999997e-05 2024-05-07T14:02:05.350 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.351 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.351 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.351 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:191 6.5 e30/27 6:a2ace8b3:::data_log.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:05.351 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:02:05.351 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.205375197000002, 2024-05-07T14:02:05.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00168714, 2024-05-07T14:02:05.351 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.351 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.351 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.352 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:02:05.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:02:05.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127713+0000", 2024-05-07T14:02:05.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2290000000000002e-06 2024-05-07T14:02:05.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127727+0000", 2024-05-07T14:02:05.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4236999999999999e-05 2024-05-07T14:02:05.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127759+0000", 2024-05-07T14:02:05.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1402999999999997e-05 2024-05-07T14:02:05.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127772+0000", 2024-05-07T14:02:05.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3227000000000001e-05 2024-05-07T14:02:05.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127895+0000", 2024-05-07T14:02:05.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012357500000000001 2024-05-07T14:02:05.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127929+0000", 2024-05-07T14:02:05.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3599999999999997e-05 2024-05-07T14:02:05.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129322+0000", 2024-05-07T14:02:05.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001392936 2024-05-07T14:02:05.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129398+0000", 2024-05-07T14:02:05.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5933000000000006e-05 2024-05-07T14:02:05.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.356 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.357 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-07T14:02:05.357 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:02:05.357 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.293192826000002, 2024-05-07T14:02:05.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386840000000002, 2024-05-07T14:02:05.357 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.357 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.357 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.357 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:02:05.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:02:05.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039894+0000", 2024-05-07T14:02:05.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9999999999999996e-07 2024-05-07T14:02:05.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039906+0000", 2024-05-07T14:02:05.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-05 2024-05-07T14:02:05.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039948+0000", 2024-05-07T14:02:05.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1983000000000001e-05 2024-05-07T14:02:05.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039975+0000", 2024-05-07T14:02:05.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7120000000000001e-05 2024-05-07T14:02:05.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040144+0000", 2024-05-07T14:02:05.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016912200000000001 2024-05-07T14:02:05.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040195+0000", 2024-05-07T14:02:05.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1023000000000003e-05 2024-05-07T14:02:05.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043654+0000", 2024-05-07T14:02:05.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034590089999999999 2024-05-07T14:02:05.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043732+0000", 2024-05-07T14:02:05.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7557000000000003e-05 2024-05-07T14:02:05.362 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.362 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.362 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.362 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:215 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:05.362 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:02:05.362 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.267655660000003, 2024-05-07T14:02:05.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017783440000000001, 2024-05-07T14:02:05.363 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.363 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.363 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.363 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:02:05.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:02:05.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065432+0000", 2024-05-07T14:02:05.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8300000000000001e-06 2024-05-07T14:02:05.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065444+0000", 2024-05-07T14:02:05.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2227e-05 2024-05-07T14:02:05.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065472+0000", 2024-05-07T14:02:05.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7983e-05 2024-05-07T14:02:05.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065487+0000", 2024-05-07T14:02:05.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.45e-05 2024-05-07T14:02:05.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065628+0000", 2024-05-07T14:02:05.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014118900000000001 2024-05-07T14:02:05.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065700+0000", 2024-05-07T14:02:05.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1521999999999997e-05 2024-05-07T14:02:05.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067097+0000", 2024-05-07T14:02:05.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00139784 2024-05-07T14:02:05.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067209+0000", 2024-05-07T14:02:05.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111253 2024-05-07T14:02:05.368 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.368 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.368 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.369 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:221 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'3, mlcod=33'1)", 2024-05-07T14:02:05.369 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:02:05.369 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.243855361000001, 2024-05-07T14:02:05.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016799510000000001, 2024-05-07T14:02:05.369 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.369 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.369 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.369 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:02:05.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:02:05.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089233+0000", 2024-05-07T14:02:05.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.877e-06 2024-05-07T14:02:05.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089244+0000", 2024-05-07T14:02:05.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1323e-05 2024-05-07T14:02:05.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089272+0000", 2024-05-07T14:02:05.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8204e-05 2024-05-07T14:02:05.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089285+0000", 2024-05-07T14:02:05.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3223e-05 2024-05-07T14:02:05.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089425+0000", 2024-05-07T14:02:05.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013934900000000001 2024-05-07T14:02:05.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089487+0000", 2024-05-07T14:02:05.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2459000000000006e-05 2024-05-07T14:02:05.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090785+0000", 2024-05-07T14:02:05.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012974900000000001 2024-05-07T14:02:05.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090911+0000", 2024-05-07T14:02:05.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126026 2024-05-07T14:02:05.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.376 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.376 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-07T14:02:05.376 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:05.376 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.207578417000001, 2024-05-07T14:02:05.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020505779999999999, 2024-05-07T14:02:05.377 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.377 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.377 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.377 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:05.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:05.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:05.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:02:05.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125517+0000", 2024-05-07T14:02:05.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.833e-06 2024-05-07T14:02:05.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125569+0000", 2024-05-07T14:02:05.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1619999999999997e-05 2024-05-07T14:02:05.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125589+0000", 2024-05-07T14:02:05.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0803000000000001e-05 2024-05-07T14:02:05.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125733+0000", 2024-05-07T14:02:05.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014308600000000001 2024-05-07T14:02:05.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125786+0000", 2024-05-07T14:02:05.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3158999999999997e-05 2024-05-07T14:02:05.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127460+0000", 2024-05-07T14:02:05.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001674493 2024-05-07T14:02:05.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127558+0000", 2024-05-07T14:02:05.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7967000000000006e-05 2024-05-07T14:02:05.384 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.384 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.384 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.384 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:337 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'5, mlcod=33'3)", 2024-05-07T14:02:05.385 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:02:05.385 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.166180705999999, 2024-05-07T14:02:05.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004459658, 2024-05-07T14:02:05.385 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.385 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.385 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.385 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:02:05.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:02:05.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166908+0000", 2024-05-07T14:02:05.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2259999999999999e-06 2024-05-07T14:02:05.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166922+0000", 2024-05-07T14:02:05.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4780000000000001e-05 2024-05-07T14:02:05.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166960+0000", 2024-05-07T14:02:05.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8173000000000002e-05 2024-05-07T14:02:05.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166981+0000", 2024-05-07T14:02:05.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0440000000000001e-05 2024-05-07T14:02:05.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167154+0000", 2024-05-07T14:02:05.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017287199999999999 2024-05-07T14:02:05.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167207+0000", 2024-05-07T14:02:05.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000001e-05 2024-05-07T14:02:05.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171283+0000", 2024-05-07T14:02:05.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004076278 2024-05-07T14:02:05.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171365+0000", 2024-05-07T14:02:05.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1588999999999994e-05 2024-05-07T14:02:05.391 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.391 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.391 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.391 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:349 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:05.391 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:02:05.392 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.165305910000001, 2024-05-07T14:02:05.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042886440000000003, 2024-05-07T14:02:05.392 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.392 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.392 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.393 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:02:05.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:02:05.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167782+0000", 2024-05-07T14:02:05.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:02:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167797+0000", 2024-05-07T14:02:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4533e-05 2024-05-07T14:02:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167828+0000", 2024-05-07T14:02:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1239999999999999e-05 2024-05-07T14:02:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167859+0000", 2024-05-07T14:02:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1007000000000003e-05 2024-05-07T14:02:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168041+0000", 2024-05-07T14:02:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181788 2024-05-07T14:02:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168095+0000", 2024-05-07T14:02:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3857000000000003e-05 2024-05-07T14:02:05.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171961+0000", 2024-05-07T14:02:05.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038664160000000001 2024-05-07T14:02:05.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172069+0000", 2024-05-07T14:02:05.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107793 2024-05-07T14:02:05.399 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.399 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.399 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.399 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:357 6.5 e33/27 6:a60f9269:lc::lua_package_allowlist:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:05.399 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:02:05.399 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.16313718, 2024-05-07T14:02:05.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002145817, 2024-05-07T14:02:05.400 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.400 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.400 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.400 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:02:05.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:02:05.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169950+0000", 2024-05-07T14:02:05.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.626e-06 2024-05-07T14:02:05.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169963+0000", 2024-05-07T14:02:05.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2619999999999999e-05 2024-05-07T14:02:05.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169990+0000", 2024-05-07T14:02:05.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7084e-05 2024-05-07T14:02:05.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170003+0000", 2024-05-07T14:02:05.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3312999999999999e-05 2024-05-07T14:02:05.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170144+0000", 2024-05-07T14:02:05.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140376 2024-05-07T14:02:05.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170203+0000", 2024-05-07T14:02:05.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9586000000000002e-05 2024-05-07T14:02:05.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172022+0000", 2024-05-07T14:02:05.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018187419999999999 2024-05-07T14:02:05.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172095+0000", 2024-05-07T14:02:05.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2470000000000002e-05 2024-05-07T14:02:05.406 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.407 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.407 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.407 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:386 6.c e33/27 6:3677c228:::obj_delete_at_hint.0000000006:head v 33'1, mlcod=0'0)", 2024-05-07T14:02:05.407 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:02:05.408 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.149606843999997, 2024-05-07T14:02:05.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016811230000000001, 2024-05-07T14:02:05.408 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.408 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.408 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.408 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:02:05.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:02:05.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183481+0000", 2024-05-07T14:02:05.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.756e-06 2024-05-07T14:02:05.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183493+0000", 2024-05-07T14:02:05.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.254e-05 2024-05-07T14:02:05.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183520+0000", 2024-05-07T14:02:05.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6809999999999999e-05 2024-05-07T14:02:05.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183539+0000", 2024-05-07T14:02:05.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8233e-05 2024-05-07T14:02:05.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183686+0000", 2024-05-07T14:02:05.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147045 2024-05-07T14:02:05.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183741+0000", 2024-05-07T14:02:05.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5380000000000002e-05 2024-05-07T14:02:05.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185039+0000", 2024-05-07T14:02:05.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012981500000000001 2024-05-07T14:02:05.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185160+0000", 2024-05-07T14:02:05.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121209 2024-05-07T14:02:05.415 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.415 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.415 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.416 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:604 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'10, mlcod=33'8)", 2024-05-07T14:02:05.416 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:02:05.416 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.003745995999999, 2024-05-07T14:02:05.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003281431, 2024-05-07T14:02:05.416 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.417 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.417 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.417 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:02:05.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:02:05.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329341+0000", 2024-05-07T14:02:05.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.42e-06 2024-05-07T14:02:05.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329351+0000", 2024-05-07T14:02:05.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0002e-05 2024-05-07T14:02:05.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329373+0000", 2024-05-07T14:02:05.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1209e-05 2024-05-07T14:02:05.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329384+0000", 2024-05-07T14:02:05.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1161999999999999e-05 2024-05-07T14:02:05.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329495+0000", 2024-05-07T14:02:05.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111302 2024-05-07T14:02:05.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329522+0000", 2024-05-07T14:02:05.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7291999999999999e-05 2024-05-07T14:02:05.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332531+0000", 2024-05-07T14:02:05.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003008405 2024-05-07T14:02:05.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332621+0000", 2024-05-07T14:02:05.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0638999999999997e-05 2024-05-07T14:02:05.424 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.424 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.424 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.425 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:656 6.1 e33/27 6:84d19476:::obj_delete_at_hint.0000000038:head v 33'5, mlcod=33'3)", 2024-05-07T14:02:05.425 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:02:05.425 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.957341878000001, 2024-05-07T14:02:05.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020273800000000001, 2024-05-07T14:02:05.425 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.425 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.425 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.425 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:02:05.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:02:05.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375746+0000", 2024-05-07T14:02:05.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0499999999999999e-06 2024-05-07T14:02:05.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375759+0000", 2024-05-07T14:02:05.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2952999999999999e-05 2024-05-07T14:02:05.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375789+0000", 2024-05-07T14:02:05.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9612999999999999e-05 2024-05-07T14:02:05.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375804+0000", 2024-05-07T14:02:05.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5449999999999999e-05 2024-05-07T14:02:05.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375931+0000", 2024-05-07T14:02:05.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126883 2024-05-07T14:02:05.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375972+0000", 2024-05-07T14:02:05.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0581999999999999e-05 2024-05-07T14:02:05.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377685+0000", 2024-05-07T14:02:05.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017136740000000001 2024-05-07T14:02:05.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377772+0000", 2024-05-07T14:02:05.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6174999999999994e-05 2024-05-07T14:02:05.432 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.432 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.432 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.433 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:665 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-07T14:02:05.433 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:02:05.433 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.948837619999999, 2024-05-07T14:02:05.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001677357, 2024-05-07T14:02:05.433 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.433 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.434 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.434 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:02:05.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:02:05.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384250+0000", 2024-05-07T14:02:05.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7099999999999999e-06 2024-05-07T14:02:05.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384261+0000", 2024-05-07T14:02:05.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.113e-05 2024-05-07T14:02:05.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384287+0000", 2024-05-07T14:02:05.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6256000000000001e-05 2024-05-07T14:02:05.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384301+0000", 2024-05-07T14:02:05.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3443e-05 2024-05-07T14:02:05.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384443+0000", 2024-05-07T14:02:05.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142192 2024-05-07T14:02:05.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384509+0000", 2024-05-07T14:02:05.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6124000000000006e-05 2024-05-07T14:02:05.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385819+0000", 2024-05-07T14:02:05.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013092889999999999 2024-05-07T14:02:05.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385926+0000", 2024-05-07T14:02:05.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010721300000000001 2024-05-07T14:02:05.441 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.441 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.441 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.441 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:685 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'4, mlcod=33'2)", 2024-05-07T14:02:05.441 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:02:05.441 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.932145425999998, 2024-05-07T14:02:05.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025309769999999998, 2024-05-07T14:02:05.442 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.442 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.442 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.442 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:02:05.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:02:05.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400943+0000", 2024-05-07T14:02:05.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0899999999999999e-06 2024-05-07T14:02:05.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400960+0000", 2024-05-07T14:02:05.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6917000000000001e-05 2024-05-07T14:02:05.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400995+0000", 2024-05-07T14:02:05.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5626000000000001e-05 2024-05-07T14:02:05.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401014+0000", 2024-05-07T14:02:05.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9126e-05 2024-05-07T14:02:05.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401164+0000", 2024-05-07T14:02:05.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149989 2024-05-07T14:02:05.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401218+0000", 2024-05-07T14:02:05.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3550000000000001e-05 2024-05-07T14:02:05.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403375+0000", 2024-05-07T14:02:05.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00215737 2024-05-07T14:02:05.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403472+0000", 2024-05-07T14:02:05.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6309000000000002e-05 2024-05-07T14:02:05.449 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.450 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.450 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.450 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:686 6.1f e33/27 6:f93251ce:::obj_delete_at_hint.0000000042:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:05.450 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:02:05.451 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.930695571000001, 2024-05-07T14:02:05.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037357750000000002, 2024-05-07T14:02:05.451 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.451 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.451 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.451 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:02:05.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:02:05.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402392+0000", 2024-05-07T14:02:05.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9870000000000002e-06 2024-05-07T14:02:05.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402405+0000", 2024-05-07T14:02:05.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.222e-05 2024-05-07T14:02:05.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402429+0000", 2024-05-07T14:02:05.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4729999999999999e-05 2024-05-07T14:02:05.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402448+0000", 2024-05-07T14:02:05.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8493000000000001e-05 2024-05-07T14:02:05.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402604+0000", 2024-05-07T14:02:05.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155876 2024-05-07T14:02:05.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402647+0000", 2024-05-07T14:02:05.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2793000000000002e-05 2024-05-07T14:02:05.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406039+0000", 2024-05-07T14:02:05.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033922760000000001 2024-05-07T14:02:05.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406126+0000", 2024-05-07T14:02:05.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7399999999999997e-05 2024-05-07T14:02:05.458 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.458 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.459 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.459 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:693 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'5, mlcod=33'3)", 2024-05-07T14:02:05.459 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:02:05.459 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.924969142000002, 2024-05-07T14:02:05.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037287790000000002, 2024-05-07T14:02:05.460 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.460 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.460 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.460 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:02:05.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:02:05.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408119+0000", 2024-05-07T14:02:05.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0040000000000002e-06 2024-05-07T14:02:05.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408135+0000", 2024-05-07T14:02:05.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6155999999999999e-05 2024-05-07T14:02:05.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408193+0000", 2024-05-07T14:02:05.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8023999999999999e-05 2024-05-07T14:02:05.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408248+0000", 2024-05-07T14:02:05.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4664999999999999e-05 2024-05-07T14:02:05.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408410+0000", 2024-05-07T14:02:05.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016263599999999999 2024-05-07T14:02:05.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408462+0000", 2024-05-07T14:02:05.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1913000000000003e-05 2024-05-07T14:02:05.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411739+0000", 2024-05-07T14:02:05.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032768350000000001 2024-05-07T14:02:05.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411846+0000", 2024-05-07T14:02:05.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010654600000000001 2024-05-07T14:02:05.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.467 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.467 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:694 6.5 e33/27 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 33'8, mlcod=33'6)", 2024-05-07T14:02:05.468 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:02:05.468 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.922352807999999, 2024-05-07T14:02:05.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038331400000000001, 2024-05-07T14:02:05.468 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.468 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.468 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.468 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:02:05.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:02:05.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410735+0000", 2024-05-07T14:02:05.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.793e-06 2024-05-07T14:02:05.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410746+0000", 2024-05-07T14:02:05.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1377e-05 2024-05-07T14:02:05.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410775+0000", 2024-05-07T14:02:05.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8336000000000001e-05 2024-05-07T14:02:05.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410788+0000", 2024-05-07T14:02:05.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3074000000000001e-05 2024-05-07T14:02:05.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410945+0000", 2024-05-07T14:02:05.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015738199999999999 2024-05-07T14:02:05.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411009+0000", 2024-05-07T14:02:05.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4276000000000006e-05 2024-05-07T14:02:05.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414499+0000", 2024-05-07T14:02:05.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034896060000000001 2024-05-07T14:02:05.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414566+0000", 2024-05-07T14:02:05.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7296000000000001e-05 2024-05-07T14:02:05.475 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.475 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.476 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.476 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:05.478 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:05.479 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:05.490+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:05.578 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:05.590+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:05.649 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:05.649 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:05.649 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:05.649 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:05.663 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:05.679 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:05.690+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:05.780 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:05.794+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:05.829 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:05.829 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:05.829 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:05.829 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:05.829 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:05.843 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:02:05.881 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:05.894+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:05.966 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:05.966 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:02:05.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:02:05.966 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:02:05.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.966 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:05.967 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:02:05.967 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.149572594000006, 2024-05-07T14:02:05.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63420480000000001, 2024-05-07T14:02:05.967 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.967 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.967 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.967 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:05.967 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:05.967 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:05.967 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1 2024-05-07T14:02:05.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.967 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827477+0000", 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:02:05.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827491+0000", 2024-05-07T14:02:05.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3923999999999999e-05 2024-05-07T14:02:05.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827514+0000", 2024-05-07T14:02:05.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2796e-05 2024-05-07T14:02:05.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827531+0000", 2024-05-07T14:02:05.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7520000000000002e-05 2024-05-07T14:02:05.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827677+0000", 2024-05-07T14:02:05.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145408 2024-05-07T14:02:05.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:02:05.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827703+0000", 2024-05-07T14:02:05.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6704e-05 2024-05-07T14:02:05.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.458662+0000", 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63095893199999997 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459006+0000", 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034329 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459320+0000", 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031472100000000001 2024-05-07T14:02:05.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.460665+0000", 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001344633 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461508+0000", 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084310400000000001 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461608+0000", 2024-05-07T14:02:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9481999999999994e-05 2024-05-07T14:02:05.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461680+0000", 2024-05-07T14:02:05.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1976000000000003e-05 2024-05-07T14:02:05.973 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.973 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.973 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.973 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:05.973 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:02:05.973 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.452512261999999, 2024-05-07T14:02:05.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015167432999999999, 2024-05-07T14:02:05.974 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.974 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.974 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.974 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:05.974 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:05.974 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:05.974 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 37 2024-05-07T14:02:05.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.974 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524536+0000", 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524542+0000", 2024-05-07T14:02:05.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7699999999999998e-06 2024-05-07T14:02:05.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524551+0000", 2024-05-07T14:02:05.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4199999999999996e-06 2024-05-07T14:02:05.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524558+0000", 2024-05-07T14:02:05.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.379e-06 2024-05-07T14:02:05.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534146+0000", 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095872700000000002 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534387+0000", 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024181499999999999 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534752+0000", 2024-05-07T14:02:05.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036441400000000002 2024-05-07T14:02:05.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:05.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.536608+0000", 2024-05-07T14:02:05.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001856239 2024-05-07T14:02:05.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:05.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539547+0000", 2024-05-07T14:02:05.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00293859 2024-05-07T14:02:05.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539639+0000", 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2548999999999998e-05 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539703+0000", 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3330000000000005e-05 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:05.979 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:02:05.980 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.332983958, 2024-05-07T14:02:05.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013763364, 2024-05-07T14:02:05.980 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.980 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.980 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.980 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:05.980 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:05.980 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:05.980 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 88 2024-05-07T14:02:05.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.980 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644064+0000", 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644070+0000", 2024-05-07T14:02:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5500000000000002e-06 2024-05-07T14:02:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644079+0000", 2024-05-07T14:02:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.55e-06 2024-05-07T14:02:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644086+0000", 2024-05-07T14:02:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.934e-06 2024-05-07T14:02:05.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655168+0000", 2024-05-07T14:02:05.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011081967 2024-05-07T14:02:05.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655307+0000", 2024-05-07T14:02:05.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013893600000000001 2024-05-07T14:02:05.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655515+0000", 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020742499999999999 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657174+0000", 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016592340000000001 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657576+0000", 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040245400000000001 2024-05-07T14:02:05.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657723+0000", 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014719200000000001 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657827+0000", 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103319 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.986 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:05.986 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:05.986 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.166448772999999, 2024-05-07T14:02:05.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014874368000000001, 2024-05-07T14:02:05.986 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.986 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.986 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.986 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:05.986 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:05.986 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:05.986 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 108 2024-05-07T14:02:05.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.987 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:05.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:05.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:05.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0699999999999996e-07 2024-05-07T14:02:05.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810608+0000", 2024-05-07T14:02:05.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6330000000000002e-06 2024-05-07T14:02:05.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810618+0000", 2024-05-07T14:02:05.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0366999999999999e-05 2024-05-07T14:02:05.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810626+0000", 2024-05-07T14:02:05.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7430000000000002e-06 2024-05-07T14:02:05.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818597+0000", 2024-05-07T14:02:05.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079710549999999995 2024-05-07T14:02:05.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818873+0000", 2024-05-07T14:02:05.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027635099999999998 2024-05-07T14:02:05.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:05.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.819288+0000", 2024-05-07T14:02:05.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041430599999999997 2024-05-07T14:02:05.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:05.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822081+0000", 2024-05-07T14:02:05.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002793032 2024-05-07T14:02:05.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:05.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825193+0000", 2024-05-07T14:02:05.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003112606 2024-05-07T14:02:05.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825361+0000", 2024-05-07T14:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167703 2024-05-07T14:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825473+0000", 2024-05-07T14:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111865 2024-05-07T14:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:05.992 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.166299451, 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015242152, 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 109 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:05.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:02:05.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:05.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:02:05.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:05.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:05.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810749+0000", 2024-05-07T14:02:05.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-06 2024-05-07T14:02:05.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:05.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810943+0000", 2024-05-07T14:02:05.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019437499999999999 2024-05-07T14:02:05.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:05.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810959+0000", 2024-05-07T14:02:05.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5440000000000001e-05 2024-05-07T14:02:05.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:05.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810971+0000", 2024-05-07T14:02:05.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2023e-05 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820386+0000", 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094148570000000004 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820569+0000", 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018298199999999999 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:05.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820827+0000", 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025869400000000001 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825585+0000", 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004757051 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825752+0000", 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167479 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825881+0000", 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128629 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825990+0000", 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109415 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:05.998 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:02:05.999 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.166057099, 2024-05-07T14:02:05.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015251472, 2024-05-07T14:02:05.999 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:05.999 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:05.999 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:05.999 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:05.999 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:05.999 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:05.999 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 110 2024-05-07T14:02:05.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:05.999 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:05.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:02:06.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:02:06.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810991+0000", 2024-05-07T14:02:06.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7600000000000006e-07 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810998+0000", 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3899999999999998e-06 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811007+0000", 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5869999999999999e-06 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811014+0000", 2024-05-07T14:02:06.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:02:06.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822508+0000", 2024-05-07T14:02:06.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01149416 2024-05-07T14:02:06.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822698+0000", 2024-05-07T14:02:06.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018972600000000001 2024-05-07T14:02:06.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823009+0000", 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031125100000000002 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825710+0000", 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002700619 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826014+0000", 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030398799999999999 2024-05-07T14:02:06.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826137+0000", 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123416 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826242+0000", 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104279 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.005 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:06.005 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:02:06.005 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.166022198999997, 2024-05-07T14:02:06.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017650448999999999, 2024-05-07T14:02:06.005 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.005 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.005 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.005 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.005 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.005 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.005 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 111 2024-05-07T14:02:06.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.005 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:02:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:02:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811026+0000", 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5300000000000004e-07 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811031+0000", 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0329999999999999e-06 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811043+0000", 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2543e-05 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811050+0000", 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8000000000000001e-06 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823676+0000", 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012626052 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823904+0000", 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227562 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.824349+0000", 2024-05-07T14:02:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044484 2024-05-07T14:02:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826371+0000", 2024-05-07T14:02:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020221380000000001 2024-05-07T14:02:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828408+0000", 2024-05-07T14:02:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020372369999999999 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828540+0000", 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013213600000000001 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828676+0000", 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013545500000000001 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.165960784000006, 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021330954999999999, 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 112 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.011 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:06.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-07 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811224+0000", 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653499999999999 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811237+0000", 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.271e-05 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811245+0000", 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6400000000000003e-06 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826483+0000", 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015237456 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826705+0000", 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022216799999999999 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.827081+0000", 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037659800000000002 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.831960+0000", 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048788779999999997 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832167+0000", 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020690500000000001 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832305+0000", 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013801899999999999 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832418+0000", 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112212 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.016 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.165787275, 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021403628000000001, 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 113 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:02:06.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:02:06.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811261+0000", 2024-05-07T14:02:06.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0400000000000005e-07 2024-05-07T14:02:06.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811267+0000", 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6099999999999997e-06 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811276+0000", 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4029999999999996e-06 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811283+0000", 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:02:06.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828825+0000", 2024-05-07T14:02:06.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017541853999999999 2024-05-07T14:02:06.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829061+0000", 2024-05-07T14:02:06.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235861 2024-05-07T14:02:06.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829418+0000", 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035766800000000001 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832130+0000", 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027118120000000001 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832442+0000", 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000311611 2024-05-07T14:02:06.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832565+0000", 2024-05-07T14:02:06.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012284199999999999 2024-05-07T14:02:06.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832664+0000", 2024-05-07T14:02:06.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8982999999999997e-05 2024-05-07T14:02:06.022 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.022 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.022 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:02:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.165753284999994, 2024-05-07T14:02:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023518260999999999, 2024-05-07T14:02:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 114 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811295+0000", 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811301+0000", 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8599999999999998e-06 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811310+0000", 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0299999999999999e-06 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811320+0000", 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023e-05 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830314+0000", 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018994385999999999 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830552+0000", 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023815500000000001 2024-05-07T14:02:06.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830971+0000", 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041934300000000003 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834620+0000", 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036481389999999999 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834666+0000", 2024-05-07T14:02:06.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6266000000000001e-05 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834742+0000", 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6069000000000006e-05 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834812+0000", 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0372999999999999e-05 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.165712725999995, 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027863941999999999, 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 115 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2699999999999999e-07 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811469+0000", 2024-05-07T14:02:06.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133332 2024-05-07T14:02:06.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811502+0000", 2024-05-07T14:02:06.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3027000000000001e-05 2024-05-07T14:02:06.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811511+0000", 2024-05-07T14:02:06.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.713e-06 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832759+0000", 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021248185999999999 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832917+0000", 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157825 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.833269+0000", 2024-05-07T14:02:06.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035184099999999998 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838250+0000", 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004980712 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838941+0000", 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069081399999999999 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839091+0000", 2024-05-07T14:02:06.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149903 2024-05-07T14:02:06.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839199+0000", 2024-05-07T14:02:06.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010796199999999999 2024-05-07T14:02:06.034 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.034 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.034 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.034 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:06.034 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.165518863000003, 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028128562999999999, 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 116 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811529+0000", 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811546+0000", 2024-05-07T14:02:06.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7113e-05 2024-05-07T14:02:06.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811570+0000", 2024-05-07T14:02:06.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.406e-05 2024-05-07T14:02:06.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811578+0000", 2024-05-07T14:02:06.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8660000000000006e-06 2024-05-07T14:02:06.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834997+0000", 2024-05-07T14:02:06.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023418799000000001 2024-05-07T14:02:06.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835317+0000", 2024-05-07T14:02:06.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031991799999999998 2024-05-07T14:02:06.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835662+0000", 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034544399999999998 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839220+0000", 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035576959999999999 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839374+0000", 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015427600000000001 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839540+0000", 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016534500000000001 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839657+0000", 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117243 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:06.040 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:02:06.041 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.165455851000004, 2024-05-07T14:02:06.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02858051, 2024-05-07T14:02:06.041 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.041 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.041 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.041 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.041 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.041 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.041 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 117 2024-05-07T14:02:06.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.041 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811592+0000", 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811601+0000", 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1269999999999992e-06 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811611+0000", 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6900000000000004e-06 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811618+0000", 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0770000000000002e-06 2024-05-07T14:02:06.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836766+0000", 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025147966000000001 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836982+0000", 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021640400000000001 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.837283+0000", 2024-05-07T14:02:06.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030005800000000002 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839885+0000", 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002602937 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839925+0000", 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9446000000000001e-05 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840061+0000", 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136043 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840172+0000", 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111019 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:02:06.046 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.677887853000001, 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014903938, 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 137 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:02:06.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299160+0000", 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4400000000000001e-07 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299232+0000", 2024-05-07T14:02:06.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2348000000000006e-05 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299251+0000", 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9086e-05 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299258+0000", 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0659999999999998e-06 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306394+0000", 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071357629999999998 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306491+0000", 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6526000000000004e-05 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306652+0000", 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000161674 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312756+0000", 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061035860000000003 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313919+0000", 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011630919999999999 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314000+0000", 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1037000000000004e-05 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314063+0000", 2024-05-07T14:02:06.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3316000000000002e-05 2024-05-07T14:02:06.052 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.052 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.052 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.052 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:06.052 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:02:06.052 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.677775894999996, 2024-05-07T14:02:06.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01524198, 2024-05-07T14:02:06.052 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 138 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:02:06.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299272+0000", 2024-05-07T14:02:06.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8599999999999998e-07 2024-05-07T14:02:06.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299282+0000", 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0051000000000001e-05 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299297+0000", 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5125e-05 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299302+0000", 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2119999999999997e-06 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309582+0000", 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010280163 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309722+0000", 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140715 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309941+0000", 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000218249 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313900+0000", 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039598080000000004 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314411+0000", 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051060400000000001 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314466+0000", 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4861000000000002e-05 2024-05-07T14:02:06.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314513+0000", 2024-05-07T14:02:06.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7506000000000002e-05 2024-05-07T14:02:06.058 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.058 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.058 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.058 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:06.058 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:06.058 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.677737594000007, 2024-05-07T14:02:06.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01724038, 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 139 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3099999999999998e-07 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299313+0000", 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9390000000000002e-06 2024-05-07T14:02:06.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299318+0000", 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5909999999999998e-06 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299321+0000", 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3890000000000001e-06 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310603+0000", 2024-05-07T14:02:06.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011281753 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310704+0000", 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010111900000000001 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310888+0000", 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183666 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314523+0000", 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036354999999999998 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316436+0000", 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001913238 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316501+0000", 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4261e-05 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316550+0000", 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9493000000000002e-05 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.677717263999995, 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019781539000000001, 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.064 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 140 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:06.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:06.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-07 2024-05-07T14:02:06.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299398+0000", 2024-05-07T14:02:06.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7822000000000002e-05 2024-05-07T14:02:06.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299404+0000", 2024-05-07T14:02:06.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2369999999999997e-06 2024-05-07T14:02:06.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299409+0000", 2024-05-07T14:02:06.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2069999999999997e-06 2024-05-07T14:02:06.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311355+0000", 2024-05-07T14:02:06.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011946082 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311493+0000", 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013830900000000001 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311709+0000", 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021606899999999999 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314528+0000", 2024-05-07T14:02:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028193839999999999 2024-05-07T14:02:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319001+0000", 2024-05-07T14:02:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004472218 2024-05-07T14:02:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319063+0000", 2024-05-07T14:02:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1940000000000007e-05 2024-05-07T14:02:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319112+0000", 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8964000000000001e-05 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.677630898999993, 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019944718, 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.070 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 141 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299417+0000", 2024-05-07T14:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7099999999999997e-07 2024-05-07T14:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299420+0000", 2024-05-07T14:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8629999999999999e-06 2024-05-07T14:02:06.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299424+0000", 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4830000000000001e-06 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299429+0000", 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6609999999999999e-06 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312813+0000", 2024-05-07T14:02:06.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013384330999999999 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312948+0000", 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000135239 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313163+0000", 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000214718 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314534+0000", 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013704430000000001 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319185+0000", 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046516839999999997 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319281+0000", 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5645999999999999e-05 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319361+0000", 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0278999999999995e-05 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.965378400999995, 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013780794000000001, 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.076 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 158 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:02:06.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011670+0000", 2024-05-07T14:02:06.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:02:06.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011817+0000", 2024-05-07T14:02:06.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014761200000000001 2024-05-07T14:02:06.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011830+0000", 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2653999999999999e-05 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011844+0000", 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4039999999999999e-05 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020200+0000", 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083561409999999992 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020433+0000", 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000233088 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020662+0000", 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000229015 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023097+0000", 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024346480000000002 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025218+0000", 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021216669999999998 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025350+0000", 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013124600000000001 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025450+0000", 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010002599999999999 2024-05-07T14:02:06.081 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.082 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.082 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:06.082 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:02:06.082 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 78.965187885000006, 2024-05-07T14:02:06.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013831896, 2024-05-07T14:02:06.082 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:06.082 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:06.082 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:06.082 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:06.082 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:06.083 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:06.083 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 159 2024-05-07T14:02:06.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.083 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:06.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:06.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:02:06.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:06.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:02:06.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011860+0000", 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8999999999999995e-07 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011874+0000", 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3806e-05 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:06.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011884+0000", 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5629999999999998e-06 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011894+0000", 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0353999999999999e-05 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023169+0000", 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011274872 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:06.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023305+0000", 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653299999999999 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023505+0000", 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000199254 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.024966+0000", 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014616830000000001 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025472+0000", 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00050618899999999999 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025593+0000", 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120019 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025691+0000", 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8832999999999994e-05 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:06.088 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:06.088 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:06.089 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:02:06.090 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:06.102+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:06.190 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:06.202+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:06.224 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:06.224 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:06.224 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:06.224 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:06.239 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:02:06.291 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:06.302+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:06.334 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:02:06.352 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:06.352 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:06.366 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:02:06.408 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:06.422+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:06.475 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:02:06.477 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:06.478 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:06.492 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:06.506+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:06.508 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:06.509 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:06.527 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:06.540 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:06.540 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:06.544 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:06.545 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:06.556 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:02:06.566 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:06.566 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:06.587 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:06.587 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:06.593 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:06.606+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:06.610 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:06.610 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:06.644 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:06.645 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:06.686 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:06.687 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:06.694 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:06.706+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:06.701 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:02:06.795 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:06.806+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:06.858 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:06.858 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:06.872 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:02:06.916 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:06.930+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:06.982 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:06.982 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:06.996 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:02:06.996 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:07.006+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:07.097 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:07.110+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:07.161 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:07.161 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:07.173 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:02:07.220 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:07.234+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:07.283 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:07.283 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:07.295 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:02:07.336 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:07.350+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:07.398 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:07.410+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:07.452 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:07.452 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:07.465 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:02:07.471 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:02:07.536 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:07.550+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:07.585 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:07.586 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:07.599 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:02:07.600 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:07.614+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:07.701 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:07.714+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:07.768 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:07.768 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:07.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:02:07.802 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:07.814+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:07.891 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:07.891 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:07.902 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:07.914+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:07.904 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:02:08.004 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:08.018+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:08.039 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:08.039 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:08.053 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:02:08.105 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:08.118+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:08.206 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:08.218+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:08.217 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:08.217 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:08.233 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:02:08.320 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:08.334+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:08.397 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:08.397 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:08.408 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:08.422+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:08.411 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:02:08.508 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:08.522+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:08.577 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:08.577 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:08.591 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:08.609 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:08.622+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:08.669 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:02:08.710 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:08.722+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:08.715 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:08.715 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:08.729 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:08.816 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:08.830+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:08.823 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:08.824 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:08.840 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:08.840 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:08.856 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:08.856 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:08.873 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:08.873 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:08.892 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:08.892 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:08.894 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:08.894 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:08.907 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:08.912 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:08.926+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:08.914 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:08.914 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:08.934 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:08.934 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:08.953 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:08.953 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:09.013 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:09.026+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:09.070 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:09.070 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:09.070 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:09.070 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:09.084 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:09.113 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:09.126+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:09.201 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:09.201 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:09.202 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:09.202 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:09.202 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:09.214 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:09.226+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:09.216 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:09.316 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:09.326+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:09.386 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:09.386 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:02:09.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:02:09.386 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:02:09.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.386 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:09.386 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:02:09.386 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.381624080999998, 2024-05-07T14:02:09.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089647730000000005, 2024-05-07T14:02:09.386 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.387 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.390 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.390 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:09.390 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:09.390 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:09.390 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 46 2024-05-07T14:02:09.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.390 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:02:09.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:02:09.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017451+0000", 2024-05-07T14:02:09.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9349999999999999e-06 2024-05-07T14:02:09.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017460+0000", 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017481+0000", 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0984000000000001e-05 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017499+0000", 2024-05-07T14:02:09.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:02:09.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018689+0000", 2024-05-07T14:02:09.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001190303 2024-05-07T14:02:09.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018945+0000", 2024-05-07T14:02:09.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025626799999999998 2024-05-07T14:02:09.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:09.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022176+0000", 2024-05-07T14:02:09.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032308720000000001 2024-05-07T14:02:09.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:09.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026078+0000", 2024-05-07T14:02:09.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039018289999999999 2024-05-07T14:02:09.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:09.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026189+0000", 2024-05-07T14:02:09.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110775 2024-05-07T14:02:09.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026310+0000", 2024-05-07T14:02:09.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121023 2024-05-07T14:02:09.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026413+0000", 2024-05-07T14:02:09.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103346 2024-05-07T14:02:09.396 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.396 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.396 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.396 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94397682172928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:09.396 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:02:09.396 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.372201425, 2024-05-07T14:02:09.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032214489999999999, 2024-05-07T14:02:09.397 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.397 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.398 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.398 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:09.398 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:09.398 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:09.398 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 47 2024-05-07T14:02:09.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.398 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026873+0000", 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4200000000000001e-06 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026883+0000", 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0017000000000001e-05 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026904+0000", 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0228999999999999e-05 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026917+0000", 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3594000000000001e-05 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027029+0000", 2024-05-07T14:02:09.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011171900000000001 2024-05-07T14:02:09.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027247+0000", 2024-05-07T14:02:09.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021786099999999999 2024-05-07T14:02:09.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:09.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027599+0000", 2024-05-07T14:02:09.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035225700000000003 2024-05-07T14:02:09.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:09.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029240+0000", 2024-05-07T14:02:09.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016408620000000001 2024-05-07T14:02:09.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:09.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029864+0000", 2024-05-07T14:02:09.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00062414399999999998 2024-05-07T14:02:09.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029939+0000", 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4931999999999993e-05 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030092+0000", 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015341399999999999 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.403 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:09.404 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:02:09.404 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.360157880000003, 2024-05-07T14:02:09.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021710919999999999, 2024-05-07T14:02:09.404 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.404 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.404 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.404 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:09.404 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:09.404 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:09.404 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 54 2024-05-07T14:02:09.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038917+0000", 2024-05-07T14:02:09.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8720000000000002e-06 2024-05-07T14:02:09.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038929+0000", 2024-05-07T14:02:09.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1294999999999999e-05 2024-05-07T14:02:09.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038964+0000", 2024-05-07T14:02:09.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5516999999999999e-05 2024-05-07T14:02:09.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038983+0000", 2024-05-07T14:02:09.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:02:09.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039074+0000", 2024-05-07T14:02:09.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1106999999999994e-05 2024-05-07T14:02:09.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039201+0000", 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012714700000000001 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039320+0000", 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011861100000000001 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040439+0000", 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011193450000000001 2024-05-07T14:02:09.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040971+0000", 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053181599999999995 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041040+0000", 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8706000000000003e-05 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041086+0000", 2024-05-07T14:02:09.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5883000000000001e-05 2024-05-07T14:02:09.410 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.410 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.410 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.410 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94397682168320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:09.410 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:02:09.410 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.357785469000007, 2024-05-07T14:02:09.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001933333, 2024-05-07T14:02:09.410 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 55 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041288+0000", 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5200000000000001e-06 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041295+0000", 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3679999999999998e-06 2024-05-07T14:02:09.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041315+0000", 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9826999999999998e-05 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041325+0000", 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0402e-05 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041403+0000", 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8404000000000004e-05 2024-05-07T14:02:09.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041479+0000", 2024-05-07T14:02:09.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5846999999999994e-05 2024-05-07T14:02:09.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:09.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041637+0000", 2024-05-07T14:02:09.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157699 2024-05-07T14:02:09.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:09.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.042503+0000", 2024-05-07T14:02:09.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086578899999999995 2024-05-07T14:02:09.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:09.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043108+0000", 2024-05-07T14:02:09.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060548999999999998 2024-05-07T14:02:09.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043158+0000", 2024-05-07T14:02:09.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9359e-05 2024-05-07T14:02:09.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043220+0000", 2024-05-07T14:02:09.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2627999999999997e-05 2024-05-07T14:02:09.416 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.416 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.416 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.416 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:191 6.5 e30/27 6:a2ace8b3:::data_log.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.271361522999996, 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00168714, 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:02:09.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127713+0000", 2024-05-07T14:02:09.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2290000000000002e-06 2024-05-07T14:02:09.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127727+0000", 2024-05-07T14:02:09.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4236999999999999e-05 2024-05-07T14:02:09.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127759+0000", 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1402999999999997e-05 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127772+0000", 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3227000000000001e-05 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127895+0000", 2024-05-07T14:02:09.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012357500000000001 2024-05-07T14:02:09.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127929+0000", 2024-05-07T14:02:09.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3599999999999997e-05 2024-05-07T14:02:09.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129322+0000", 2024-05-07T14:02:09.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001392936 2024-05-07T14:02:09.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129398+0000", 2024-05-07T14:02:09.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5933000000000006e-05 2024-05-07T14:02:09.421 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.421 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.421 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.421 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-07T14:02:09.421 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:02:09.421 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.359179152000003, 2024-05-07T14:02:09.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386840000000002, 2024-05-07T14:02:09.422 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.422 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.422 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.422 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:02:09.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039894+0000", 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9999999999999996e-07 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039906+0000", 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-05 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039948+0000", 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1983000000000001e-05 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039975+0000", 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7120000000000001e-05 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040144+0000", 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016912200000000001 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040195+0000", 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1023000000000003e-05 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043654+0000", 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034590089999999999 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043732+0000", 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7557000000000003e-05 2024-05-07T14:02:09.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:215 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:02:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.333641986000003, 2024-05-07T14:02:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017783440000000001, 2024-05-07T14:02:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065432+0000", 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8300000000000001e-06 2024-05-07T14:02:09.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065444+0000", 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2227e-05 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065472+0000", 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7983e-05 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065487+0000", 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.45e-05 2024-05-07T14:02:09.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065628+0000", 2024-05-07T14:02:09.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014118900000000001 2024-05-07T14:02:09.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065700+0000", 2024-05-07T14:02:09.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1521999999999997e-05 2024-05-07T14:02:09.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067097+0000", 2024-05-07T14:02:09.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00139784 2024-05-07T14:02:09.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067209+0000", 2024-05-07T14:02:09.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111253 2024-05-07T14:02:09.430 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.430 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.430 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.431 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:221 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'3, mlcod=33'1)", 2024-05-07T14:02:09.431 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:02:09.431 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.309841687000002, 2024-05-07T14:02:09.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016799510000000001, 2024-05-07T14:02:09.431 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.431 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.431 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.431 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089233+0000", 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.877e-06 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089244+0000", 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1323e-05 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089272+0000", 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8204e-05 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089285+0000", 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3223e-05 2024-05-07T14:02:09.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089425+0000", 2024-05-07T14:02:09.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013934900000000001 2024-05-07T14:02:09.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089487+0000", 2024-05-07T14:02:09.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2459000000000006e-05 2024-05-07T14:02:09.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090785+0000", 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012974900000000001 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090911+0000", 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126026 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.436 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-07T14:02:09.436 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:09.436 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.273564743000001, 2024-05-07T14:02:09.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020505779999999999, 2024-05-07T14:02:09.436 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.436 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.436 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.436 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:09.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125517+0000", 2024-05-07T14:02:09.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.833e-06 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125569+0000", 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1619999999999997e-05 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125589+0000", 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0803000000000001e-05 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125733+0000", 2024-05-07T14:02:09.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014308600000000001 2024-05-07T14:02:09.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125786+0000", 2024-05-07T14:02:09.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3158999999999997e-05 2024-05-07T14:02:09.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127460+0000", 2024-05-07T14:02:09.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001674493 2024-05-07T14:02:09.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127558+0000", 2024-05-07T14:02:09.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7967000000000006e-05 2024-05-07T14:02:09.440 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.440 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.440 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.440 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:337 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'5, mlcod=33'3)", 2024-05-07T14:02:09.440 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:02:09.440 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.232167032, 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004459658, 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:02:09.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166908+0000", 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2259999999999999e-06 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166922+0000", 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4780000000000001e-05 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166960+0000", 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8173000000000002e-05 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166981+0000", 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0440000000000001e-05 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167154+0000", 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017287199999999999 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167207+0000", 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000001e-05 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171283+0000", 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004076278 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171365+0000", 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1588999999999994e-05 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.444 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.445 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.445 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:349 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:09.445 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:02:09.445 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.231292236000002, 2024-05-07T14:02:09.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042886440000000003, 2024-05-07T14:02:09.445 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.445 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.445 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.445 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:02:09.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:02:09.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167782+0000", 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167797+0000", 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4533e-05 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167828+0000", 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1239999999999999e-05 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167859+0000", 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1007000000000003e-05 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168041+0000", 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181788 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168095+0000", 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3857000000000003e-05 2024-05-07T14:02:09.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171961+0000", 2024-05-07T14:02:09.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038664160000000001 2024-05-07T14:02:09.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172069+0000", 2024-05-07T14:02:09.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107793 2024-05-07T14:02:09.449 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.449 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.449 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:357 6.5 e33/27 6:a60f9269:lc::lua_package_allowlist:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.229123506000001, 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002145817, 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:02:09.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169950+0000", 2024-05-07T14:02:09.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.626e-06 2024-05-07T14:02:09.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169963+0000", 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2619999999999999e-05 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169990+0000", 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7084e-05 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170003+0000", 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3312999999999999e-05 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170144+0000", 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140376 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170203+0000", 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9586000000000002e-05 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172022+0000", 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018187419999999999 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172095+0000", 2024-05-07T14:02:09.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2470000000000002e-05 2024-05-07T14:02:09.454 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.454 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.454 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.454 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:386 6.c e33/27 6:3677c228:::obj_delete_at_hint.0000000006:head v 33'1, mlcod=0'0)", 2024-05-07T14:02:09.454 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:02:09.454 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.215593169999998, 2024-05-07T14:02:09.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016811230000000001, 2024-05-07T14:02:09.454 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.455 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.455 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.455 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:02:09.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:02:09.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183481+0000", 2024-05-07T14:02:09.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.756e-06 2024-05-07T14:02:09.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183493+0000", 2024-05-07T14:02:09.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.254e-05 2024-05-07T14:02:09.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183520+0000", 2024-05-07T14:02:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6809999999999999e-05 2024-05-07T14:02:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183539+0000", 2024-05-07T14:02:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8233e-05 2024-05-07T14:02:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183686+0000", 2024-05-07T14:02:09.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147045 2024-05-07T14:02:09.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183741+0000", 2024-05-07T14:02:09.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5380000000000002e-05 2024-05-07T14:02:09.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185039+0000", 2024-05-07T14:02:09.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012981500000000001 2024-05-07T14:02:09.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185160+0000", 2024-05-07T14:02:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121209 2024-05-07T14:02:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:604 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'10, mlcod=33'8)", 2024-05-07T14:02:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:02:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.069732322, 2024-05-07T14:02:09.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003281431, 2024-05-07T14:02:09.460 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.460 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.460 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.460 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:02:09.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:02:09.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329341+0000", 2024-05-07T14:02:09.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.42e-06 2024-05-07T14:02:09.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329351+0000", 2024-05-07T14:02:09.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0002e-05 2024-05-07T14:02:09.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329373+0000", 2024-05-07T14:02:09.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1209e-05 2024-05-07T14:02:09.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329384+0000", 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1161999999999999e-05 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329495+0000", 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111302 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329522+0000", 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7291999999999999e-05 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332531+0000", 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003008405 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332621+0000", 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0638999999999997e-05 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.464 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:656 6.1 e33/27 6:84d19476:::obj_delete_at_hint.0000000038:head v 33'5, mlcod=33'3)", 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.023328204000002, 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020273800000000001, 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:02:09.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375746+0000", 2024-05-07T14:02:09.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0499999999999999e-06 2024-05-07T14:02:09.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375759+0000", 2024-05-07T14:02:09.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2952999999999999e-05 2024-05-07T14:02:09.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375789+0000", 2024-05-07T14:02:09.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9612999999999999e-05 2024-05-07T14:02:09.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375804+0000", 2024-05-07T14:02:09.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5449999999999999e-05 2024-05-07T14:02:09.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375931+0000", 2024-05-07T14:02:09.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126883 2024-05-07T14:02:09.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375972+0000", 2024-05-07T14:02:09.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0581999999999999e-05 2024-05-07T14:02:09.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377685+0000", 2024-05-07T14:02:09.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017136740000000001 2024-05-07T14:02:09.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377772+0000", 2024-05-07T14:02:09.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6174999999999994e-05 2024-05-07T14:02:09.469 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.469 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.469 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.469 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:665 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-07T14:02:09.469 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:02:09.469 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.014823946, 2024-05-07T14:02:09.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001677357, 2024-05-07T14:02:09.469 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.470 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.470 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.470 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:02:09.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:02:09.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384250+0000", 2024-05-07T14:02:09.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7099999999999999e-06 2024-05-07T14:02:09.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384261+0000", 2024-05-07T14:02:09.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.113e-05 2024-05-07T14:02:09.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384287+0000", 2024-05-07T14:02:09.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6256000000000001e-05 2024-05-07T14:02:09.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384301+0000", 2024-05-07T14:02:09.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3443e-05 2024-05-07T14:02:09.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384443+0000", 2024-05-07T14:02:09.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142192 2024-05-07T14:02:09.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384509+0000", 2024-05-07T14:02:09.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6124000000000006e-05 2024-05-07T14:02:09.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385819+0000", 2024-05-07T14:02:09.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013092889999999999 2024-05-07T14:02:09.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385926+0000", 2024-05-07T14:02:09.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010721300000000001 2024-05-07T14:02:09.477 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.477 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.477 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.477 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:685 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'4, mlcod=33'2)", 2024-05-07T14:02:09.478 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:02:09.478 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.998131751999999, 2024-05-07T14:02:09.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025309769999999998, 2024-05-07T14:02:09.478 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.478 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.478 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.478 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:02:09.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400943+0000", 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0899999999999999e-06 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400960+0000", 2024-05-07T14:02:09.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6917000000000001e-05 2024-05-07T14:02:09.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400995+0000", 2024-05-07T14:02:09.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5626000000000001e-05 2024-05-07T14:02:09.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401014+0000", 2024-05-07T14:02:09.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9126e-05 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401164+0000", 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149989 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401218+0000", 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3550000000000001e-05 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403375+0000", 2024-05-07T14:02:09.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00215737 2024-05-07T14:02:09.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403472+0000", 2024-05-07T14:02:09.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6309000000000002e-05 2024-05-07T14:02:09.482 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.482 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.482 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.482 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:686 6.1f e33/27 6:f93251ce:::obj_delete_at_hint.0000000042:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:09.482 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:02:09.483 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.996681897000002, 2024-05-07T14:02:09.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037357750000000002, 2024-05-07T14:02:09.483 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.483 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.483 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:02:09.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:02:09.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402392+0000", 2024-05-07T14:02:09.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9870000000000002e-06 2024-05-07T14:02:09.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402405+0000", 2024-05-07T14:02:09.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.222e-05 2024-05-07T14:02:09.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402429+0000", 2024-05-07T14:02:09.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4729999999999999e-05 2024-05-07T14:02:09.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402448+0000", 2024-05-07T14:02:09.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8493000000000001e-05 2024-05-07T14:02:09.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402604+0000", 2024-05-07T14:02:09.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155876 2024-05-07T14:02:09.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402647+0000", 2024-05-07T14:02:09.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2793000000000002e-05 2024-05-07T14:02:09.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406039+0000", 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033922760000000001 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406126+0000", 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7399999999999997e-05 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:693 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'5, mlcod=33'3)", 2024-05-07T14:02:09.489 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:02:09.490 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.990955468000003, 2024-05-07T14:02:09.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037287790000000002, 2024-05-07T14:02:09.490 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.490 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.490 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.490 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:02:09.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:02:09.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408119+0000", 2024-05-07T14:02:09.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0040000000000002e-06 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408135+0000", 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6155999999999999e-05 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408193+0000", 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8023999999999999e-05 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408248+0000", 2024-05-07T14:02:09.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4664999999999999e-05 2024-05-07T14:02:09.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408410+0000", 2024-05-07T14:02:09.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016263599999999999 2024-05-07T14:02:09.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408462+0000", 2024-05-07T14:02:09.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1913000000000003e-05 2024-05-07T14:02:09.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411739+0000", 2024-05-07T14:02:09.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032768350000000001 2024-05-07T14:02:09.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411846+0000", 2024-05-07T14:02:09.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010654600000000001 2024-05-07T14:02:09.494 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.494 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.494 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.495 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:694 6.5 e33/27 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 33'8, mlcod=33'6)", 2024-05-07T14:02:09.495 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:02:09.495 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.988339134, 2024-05-07T14:02:09.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038331400000000001, 2024-05-07T14:02:09.495 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:09.495 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:09.495 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:09.495 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:09.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410735+0000", 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.793e-06 2024-05-07T14:02:09.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410746+0000", 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1377e-05 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410775+0000", 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8336000000000001e-05 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410788+0000", 2024-05-07T14:02:09.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3074000000000001e-05 2024-05-07T14:02:09.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:09.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410945+0000", 2024-05-07T14:02:09.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015738199999999999 2024-05-07T14:02:09.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:09.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411009+0000", 2024-05-07T14:02:09.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4276000000000006e-05 2024-05-07T14:02:09.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:09.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414499+0000", 2024-05-07T14:02:09.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034896060000000001 2024-05-07T14:02:09.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:09.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:09.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:09.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414566+0000", 2024-05-07T14:02:09.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7296000000000001e-05 2024-05-07T14:02:09.499 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.499 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.499 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.499 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:09.499 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:09.499 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:09.500 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:02:09.501 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:09.502 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:09.514+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:09.602 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:09.614+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:09.673 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:09.673 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:09.673 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:09.673 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:09.687 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:09.732 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:09.746+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:09.804 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:09.818+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:09.856 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:09.856 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:09.856 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:09.871 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:02:09.916 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:09.930+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:10.007 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:10.018+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:10.044 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:02:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:02:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:02:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.045 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:02:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.229023599000001, 2024-05-07T14:02:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63420480000000001, 2024-05-07T14:02:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.046 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1 2024-05-07T14:02:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:02:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827477+0000", 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827491+0000", 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3923999999999999e-05 2024-05-07T14:02:10.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827514+0000", 2024-05-07T14:02:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2796e-05 2024-05-07T14:02:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827531+0000", 2024-05-07T14:02:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7520000000000002e-05 2024-05-07T14:02:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827677+0000", 2024-05-07T14:02:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145408 2024-05-07T14:02:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:02:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827703+0000", 2024-05-07T14:02:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6704e-05 2024-05-07T14:02:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.458662+0000", 2024-05-07T14:02:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63095893199999997 2024-05-07T14:02:10.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459006+0000", 2024-05-07T14:02:10.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034329 2024-05-07T14:02:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459320+0000", 2024-05-07T14:02:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031472100000000001 2024-05-07T14:02:10.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.460665+0000", 2024-05-07T14:02:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001344633 2024-05-07T14:02:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461508+0000", 2024-05-07T14:02:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084310400000000001 2024-05-07T14:02:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461608+0000", 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9481999999999994e-05 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461680+0000", 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1976000000000003e-05 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:10.055 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 84.531963266999995, 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015167432999999999, 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 37 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:02:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:02:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524536+0000", 2024-05-07T14:02:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:02:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524542+0000", 2024-05-07T14:02:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7699999999999998e-06 2024-05-07T14:02:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524551+0000", 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4199999999999996e-06 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524558+0000", 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.379e-06 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534146+0000", 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095872700000000002 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534387+0000", 2024-05-07T14:02:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024181499999999999 2024-05-07T14:02:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534752+0000", 2024-05-07T14:02:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036441400000000002 2024-05-07T14:02:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.536608+0000", 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001856239 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539547+0000", 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00293859 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539639+0000", 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2548999999999998e-05 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539703+0000", 2024-05-07T14:02:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3330000000000005e-05 2024-05-07T14:02:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:02:10.062 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 84.412434962999995, 2024-05-07T14:02:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013763364, 2024-05-07T14:02:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 88 2024-05-07T14:02:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:02:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:02:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644064+0000", 2024-05-07T14:02:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:02:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644070+0000", 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5500000000000002e-06 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644079+0000", 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.55e-06 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644086+0000", 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.934e-06 2024-05-07T14:02:10.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655168+0000", 2024-05-07T14:02:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011081967 2024-05-07T14:02:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655307+0000", 2024-05-07T14:02:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013893600000000001 2024-05-07T14:02:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655515+0000", 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020742499999999999 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657174+0000", 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016592340000000001 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657576+0000", 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040245400000000001 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657723+0000", 2024-05-07T14:02:10.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014719200000000001 2024-05-07T14:02:10.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657827+0000", 2024-05-07T14:02:10.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103319 2024-05-07T14:02:10.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.069 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.069 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.069 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:10.069 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:10.069 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 84.245899777999995, 2024-05-07T14:02:10.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014874368000000001, 2024-05-07T14:02:10.069 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.069 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.069 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.069 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.069 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 108 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0699999999999996e-07 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810608+0000", 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6330000000000002e-06 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810618+0000", 2024-05-07T14:02:10.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0366999999999999e-05 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810626+0000", 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7430000000000002e-06 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818597+0000", 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079710549999999995 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818873+0000", 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027635099999999998 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.819288+0000", 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041430599999999997 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822081+0000", 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002793032 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825193+0000", 2024-05-07T14:02:10.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003112606 2024-05-07T14:02:10.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825361+0000", 2024-05-07T14:02:10.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167703 2024-05-07T14:02:10.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825473+0000", 2024-05-07T14:02:10.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111865 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 84.245750455999996, 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015242152, 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.075 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.076 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 109 2024-05-07T14:02:10.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.076 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:02:10.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:02:10.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810749+0000", 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-06 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810943+0000", 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019437499999999999 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810959+0000", 2024-05-07T14:02:10.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5440000000000001e-05 2024-05-07T14:02:10.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810971+0000", 2024-05-07T14:02:10.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2023e-05 2024-05-07T14:02:10.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820386+0000", 2024-05-07T14:02:10.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094148570000000004 2024-05-07T14:02:10.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820569+0000", 2024-05-07T14:02:10.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018298199999999999 2024-05-07T14:02:10.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820827+0000", 2024-05-07T14:02:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025869400000000001 2024-05-07T14:02:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825585+0000", 2024-05-07T14:02:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004757051 2024-05-07T14:02:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825752+0000", 2024-05-07T14:02:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167479 2024-05-07T14:02:10.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825881+0000", 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128629 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825990+0000", 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109415 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.082 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:10.082 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:02:10.082 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 84.245508103999995, 2024-05-07T14:02:10.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015251472, 2024-05-07T14:02:10.082 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.082 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.082 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.082 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.082 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.082 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.082 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 110 2024-05-07T14:02:10.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810991+0000", 2024-05-07T14:02:10.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7600000000000006e-07 2024-05-07T14:02:10.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810998+0000", 2024-05-07T14:02:10.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3899999999999998e-06 2024-05-07T14:02:10.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811007+0000", 2024-05-07T14:02:10.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5869999999999999e-06 2024-05-07T14:02:10.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811014+0000", 2024-05-07T14:02:10.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:02:10.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822508+0000", 2024-05-07T14:02:10.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01149416 2024-05-07T14:02:10.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822698+0000", 2024-05-07T14:02:10.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018972600000000001 2024-05-07T14:02:10.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823009+0000", 2024-05-07T14:02:10.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031125100000000002 2024-05-07T14:02:10.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825710+0000", 2024-05-07T14:02:10.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002700619 2024-05-07T14:02:10.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826014+0000", 2024-05-07T14:02:10.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030398799999999999 2024-05-07T14:02:10.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826137+0000", 2024-05-07T14:02:10.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123416 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826242+0000", 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104279 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 84.245473204000007, 2024-05-07T14:02:10.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017650448999999999, 2024-05-07T14:02:10.089 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.089 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.089 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.089 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.089 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.089 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.089 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 111 2024-05-07T14:02:10.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.089 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:02:10.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:02:10.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811026+0000", 2024-05-07T14:02:10.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5300000000000004e-07 2024-05-07T14:02:10.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811031+0000", 2024-05-07T14:02:10.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0329999999999999e-06 2024-05-07T14:02:10.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811043+0000", 2024-05-07T14:02:10.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2543e-05 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811050+0000", 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8000000000000001e-06 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823676+0000", 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012626052 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823904+0000", 2024-05-07T14:02:10.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227562 2024-05-07T14:02:10.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.824349+0000", 2024-05-07T14:02:10.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044484 2024-05-07T14:02:10.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826371+0000", 2024-05-07T14:02:10.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020221380000000001 2024-05-07T14:02:10.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828408+0000", 2024-05-07T14:02:10.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020372369999999999 2024-05-07T14:02:10.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828540+0000", 2024-05-07T14:02:10.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013213600000000001 2024-05-07T14:02:10.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828676+0000", 2024-05-07T14:02:10.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013545500000000001 2024-05-07T14:02:10.095 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.095 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.095 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.095 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:10.095 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:10.095 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 84.245411789000002, 2024-05-07T14:02:10.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021330954999999999, 2024-05-07T14:02:10.096 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.096 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.096 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.096 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.096 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.096 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.096 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 112 2024-05-07T14:02:10.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.096 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:10.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:10.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:10.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-07 2024-05-07T14:02:10.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811224+0000", 2024-05-07T14:02:10.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653499999999999 2024-05-07T14:02:10.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811237+0000", 2024-05-07T14:02:10.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.271e-05 2024-05-07T14:02:10.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811245+0000", 2024-05-07T14:02:10.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6400000000000003e-06 2024-05-07T14:02:10.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826483+0000", 2024-05-07T14:02:10.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015237456 2024-05-07T14:02:10.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826705+0000", 2024-05-07T14:02:10.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022216799999999999 2024-05-07T14:02:10.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.827081+0000", 2024-05-07T14:02:10.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037659800000000002 2024-05-07T14:02:10.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.831960+0000", 2024-05-07T14:02:10.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048788779999999997 2024-05-07T14:02:10.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832167+0000", 2024-05-07T14:02:10.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020690500000000001 2024-05-07T14:02:10.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832305+0000", 2024-05-07T14:02:10.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013801899999999999 2024-05-07T14:02:10.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832418+0000", 2024-05-07T14:02:10.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112212 2024-05-07T14:02:10.102 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.102 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.102 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 84.245238279999995, 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021403628000000001, 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 113 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.103 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811261+0000", 2024-05-07T14:02:10.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0400000000000005e-07 2024-05-07T14:02:10.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811267+0000", 2024-05-07T14:02:10.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6099999999999997e-06 2024-05-07T14:02:10.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811276+0000", 2024-05-07T14:02:10.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4029999999999996e-06 2024-05-07T14:02:10.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811283+0000", 2024-05-07T14:02:10.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:02:10.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828825+0000", 2024-05-07T14:02:10.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017541853999999999 2024-05-07T14:02:10.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829061+0000", 2024-05-07T14:02:10.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235861 2024-05-07T14:02:10.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829418+0000", 2024-05-07T14:02:10.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035766800000000001 2024-05-07T14:02:10.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832130+0000", 2024-05-07T14:02:10.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027118120000000001 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832442+0000", 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000311611 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832565+0000", 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012284199999999999 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832664+0000", 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8982999999999997e-05 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 84.245204290000004, 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023518260999999999, 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.109 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 114 2024-05-07T14:02:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:02:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811295+0000", 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811301+0000", 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8599999999999998e-06 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811310+0000", 2024-05-07T14:02:10.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0299999999999999e-06 2024-05-07T14:02:10.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811320+0000", 2024-05-07T14:02:10.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023e-05 2024-05-07T14:02:10.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830314+0000", 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018994385999999999 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830552+0000", 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023815500000000001 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830971+0000", 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041934300000000003 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834620+0000", 2024-05-07T14:02:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036481389999999999 2024-05-07T14:02:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834666+0000", 2024-05-07T14:02:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6266000000000001e-05 2024-05-07T14:02:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834742+0000", 2024-05-07T14:02:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6069000000000006e-05 2024-05-07T14:02:10.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834812+0000", 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0372999999999999e-05 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 84.245163731000005, 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027863941999999999, 2024-05-07T14:02:10.115 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 115 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:10.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:10.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2699999999999999e-07 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811469+0000", 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133332 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811502+0000", 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3027000000000001e-05 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811511+0000", 2024-05-07T14:02:10.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.713e-06 2024-05-07T14:02:10.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832759+0000", 2024-05-07T14:02:10.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021248185999999999 2024-05-07T14:02:10.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832917+0000", 2024-05-07T14:02:10.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157825 2024-05-07T14:02:10.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.833269+0000", 2024-05-07T14:02:10.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035184099999999998 2024-05-07T14:02:10.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838250+0000", 2024-05-07T14:02:10.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004980712 2024-05-07T14:02:10.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838941+0000", 2024-05-07T14:02:10.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069081399999999999 2024-05-07T14:02:10.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839091+0000", 2024-05-07T14:02:10.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149903 2024-05-07T14:02:10.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839199+0000", 2024-05-07T14:02:10.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010796199999999999 2024-05-07T14:02:10.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.122 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.122 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:10.122 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:02:10.122 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 84.244969867999998, 2024-05-07T14:02:10.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028128562999999999, 2024-05-07T14:02:10.122 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.122 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.122 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.122 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 116 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811529+0000", 2024-05-07T14:02:10.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:02:10.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811546+0000", 2024-05-07T14:02:10.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7113e-05 2024-05-07T14:02:10.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811570+0000", 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.406e-05 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811578+0000", 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8660000000000006e-06 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834997+0000", 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023418799000000001 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835317+0000", 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031991799999999998 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835662+0000", 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034544399999999998 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839220+0000", 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035576959999999999 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839374+0000", 2024-05-07T14:02:10.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015427600000000001 2024-05-07T14:02:10.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839540+0000", 2024-05-07T14:02:10.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016534500000000001 2024-05-07T14:02:10.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839657+0000", 2024-05-07T14:02:10.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117243 2024-05-07T14:02:10.128 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.128 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.128 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.128 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:10.128 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:02:10.128 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 84.244906856, 2024-05-07T14:02:10.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02858051, 2024-05-07T14:02:10.128 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 117 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:02:10.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811592+0000", 2024-05-07T14:02:10.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:02:10.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811601+0000", 2024-05-07T14:02:10.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1269999999999992e-06 2024-05-07T14:02:10.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811611+0000", 2024-05-07T14:02:10.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6900000000000004e-06 2024-05-07T14:02:10.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811618+0000", 2024-05-07T14:02:10.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0770000000000002e-06 2024-05-07T14:02:10.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836766+0000", 2024-05-07T14:02:10.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025147966000000001 2024-05-07T14:02:10.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836982+0000", 2024-05-07T14:02:10.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021640400000000001 2024-05-07T14:02:10.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.837283+0000", 2024-05-07T14:02:10.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030005800000000002 2024-05-07T14:02:10.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839885+0000", 2024-05-07T14:02:10.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002602937 2024-05-07T14:02:10.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839925+0000", 2024-05-07T14:02:10.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9446000000000001e-05 2024-05-07T14:02:10.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840061+0000", 2024-05-07T14:02:10.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136043 2024-05-07T14:02:10.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840172+0000", 2024-05-07T14:02:10.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111019 2024-05-07T14:02:10.139 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.139 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.139 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.139 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:10.140 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:02:10.140 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 83.757338857999997, 2024-05-07T14:02:10.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014903938, 2024-05-07T14:02:10.140 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.140 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.140 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.141 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.141 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.141 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.141 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 137 2024-05-07T14:02:10.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.141 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:02:10.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:02:10.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299160+0000", 2024-05-07T14:02:10.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4400000000000001e-07 2024-05-07T14:02:10.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299232+0000", 2024-05-07T14:02:10.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2348000000000006e-05 2024-05-07T14:02:10.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299251+0000", 2024-05-07T14:02:10.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9086e-05 2024-05-07T14:02:10.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299258+0000", 2024-05-07T14:02:10.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0659999999999998e-06 2024-05-07T14:02:10.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306394+0000", 2024-05-07T14:02:10.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071357629999999998 2024-05-07T14:02:10.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306491+0000", 2024-05-07T14:02:10.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6526000000000004e-05 2024-05-07T14:02:10.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306652+0000", 2024-05-07T14:02:10.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000161674 2024-05-07T14:02:10.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312756+0000", 2024-05-07T14:02:10.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061035860000000003 2024-05-07T14:02:10.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313919+0000", 2024-05-07T14:02:10.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011630919999999999 2024-05-07T14:02:10.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314000+0000", 2024-05-07T14:02:10.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1037000000000004e-05 2024-05-07T14:02:10.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314063+0000", 2024-05-07T14:02:10.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3316000000000002e-05 2024-05-07T14:02:10.153 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.153 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.153 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.153 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:10.153 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:02:10.154 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 83.757226900000006, 2024-05-07T14:02:10.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01524198, 2024-05-07T14:02:10.154 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.154 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.154 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.154 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.155 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.155 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.155 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 138 2024-05-07T14:02:10.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.155 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299272+0000", 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8599999999999998e-07 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299282+0000", 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0051000000000001e-05 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299297+0000", 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5125e-05 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299302+0000", 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2119999999999997e-06 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309582+0000", 2024-05-07T14:02:10.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010280163 2024-05-07T14:02:10.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309722+0000", 2024-05-07T14:02:10.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140715 2024-05-07T14:02:10.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309941+0000", 2024-05-07T14:02:10.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000218249 2024-05-07T14:02:10.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313900+0000", 2024-05-07T14:02:10.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039598080000000004 2024-05-07T14:02:10.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314411+0000", 2024-05-07T14:02:10.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051060400000000001 2024-05-07T14:02:10.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314466+0000", 2024-05-07T14:02:10.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4861000000000002e-05 2024-05-07T14:02:10.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314513+0000", 2024-05-07T14:02:10.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7506000000000002e-05 2024-05-07T14:02:10.160 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.161 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.161 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:10.161 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:10.161 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 83.757188599000003, 2024-05-07T14:02:10.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01724038, 2024-05-07T14:02:10.161 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.161 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.161 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.161 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.161 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.162 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.162 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 139 2024-05-07T14:02:10.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.162 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:10.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:10.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:10.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3099999999999998e-07 2024-05-07T14:02:10.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299313+0000", 2024-05-07T14:02:10.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9390000000000002e-06 2024-05-07T14:02:10.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299318+0000", 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5909999999999998e-06 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299321+0000", 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3890000000000001e-06 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310603+0000", 2024-05-07T14:02:10.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011281753 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310704+0000", 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010111900000000001 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310888+0000", 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183666 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314523+0000", 2024-05-07T14:02:10.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036354999999999998 2024-05-07T14:02:10.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316436+0000", 2024-05-07T14:02:10.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001913238 2024-05-07T14:02:10.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316501+0000", 2024-05-07T14:02:10.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4261e-05 2024-05-07T14:02:10.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316550+0000", 2024-05-07T14:02:10.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9493000000000002e-05 2024-05-07T14:02:10.167 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.167 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.167 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.167 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:10.167 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:10.167 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 83.757168269000005, 2024-05-07T14:02:10.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019781539000000001, 2024-05-07T14:02:10.167 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.168 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.168 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.168 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.168 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.168 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.168 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 140 2024-05-07T14:02:10.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.168 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:10.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-07 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299398+0000", 2024-05-07T14:02:10.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7822000000000002e-05 2024-05-07T14:02:10.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299404+0000", 2024-05-07T14:02:10.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2369999999999997e-06 2024-05-07T14:02:10.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299409+0000", 2024-05-07T14:02:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2069999999999997e-06 2024-05-07T14:02:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311355+0000", 2024-05-07T14:02:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011946082 2024-05-07T14:02:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311493+0000", 2024-05-07T14:02:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013830900000000001 2024-05-07T14:02:10.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311709+0000", 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021606899999999999 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314528+0000", 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028193839999999999 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319001+0000", 2024-05-07T14:02:10.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004472218 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319063+0000", 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1940000000000007e-05 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319112+0000", 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8964000000000001e-05 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:02:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 83.757081904000003, 2024-05-07T14:02:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019944718, 2024-05-07T14:02:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 141 2024-05-07T14:02:10.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299417+0000", 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7099999999999997e-07 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299420+0000", 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8629999999999999e-06 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299424+0000", 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4830000000000001e-06 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299429+0000", 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6609999999999999e-06 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312813+0000", 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013384330999999999 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312948+0000", 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000135239 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313163+0000", 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000214718 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314534+0000", 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013704430000000001 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319185+0000", 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046516839999999997 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319281+0000", 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5645999999999999e-05 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319361+0000", 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0278999999999995e-05 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.179 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:02:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 83.044829406000005, 2024-05-07T14:02:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013780794000000001, 2024-05-07T14:02:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 158 2024-05-07T14:02:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.180 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:02:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:02:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011670+0000", 2024-05-07T14:02:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:02:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011817+0000", 2024-05-07T14:02:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014761200000000001 2024-05-07T14:02:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011830+0000", 2024-05-07T14:02:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2653999999999999e-05 2024-05-07T14:02:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011844+0000", 2024-05-07T14:02:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4039999999999999e-05 2024-05-07T14:02:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020200+0000", 2024-05-07T14:02:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083561409999999992 2024-05-07T14:02:10.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020433+0000", 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000233088 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020662+0000", 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000229015 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023097+0000", 2024-05-07T14:02:10.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024346480000000002 2024-05-07T14:02:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025218+0000", 2024-05-07T14:02:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021216669999999998 2024-05-07T14:02:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025350+0000", 2024-05-07T14:02:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013124600000000001 2024-05-07T14:02:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025450+0000", 2024-05-07T14:02:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010002599999999999 2024-05-07T14:02:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:10.186 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:02:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 83.044638890000002, 2024-05-07T14:02:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013831896, 2024-05-07T14:02:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 159 2024-05-07T14:02:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011860+0000", 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8999999999999995e-07 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011874+0000", 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3806e-05 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011884+0000", 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5629999999999998e-06 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011894+0000", 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0353999999999999e-05 2024-05-07T14:02:10.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023169+0000", 2024-05-07T14:02:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011274872 2024-05-07T14:02:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023305+0000", 2024-05-07T14:02:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653299999999999 2024-05-07T14:02:10.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023505+0000", 2024-05-07T14:02:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000199254 2024-05-07T14:02:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.024966+0000", 2024-05-07T14:02:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014616830000000001 2024-05-07T14:02:10.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025472+0000", 2024-05-07T14:02:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00050618899999999999 2024-05-07T14:02:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025593+0000", 2024-05-07T14:02:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120019 2024-05-07T14:02:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:10.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025691+0000", 2024-05-07T14:02:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8832999999999994e-05 2024-05-07T14:02:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:10.193 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:10.193 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:10.195 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:02:10.196 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:10.206+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:10.296 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:10.310+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:10.328 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:10.328 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:10.328 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:10.328 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:10.343 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:02:10.396 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:10.410+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:10.459 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:10.459 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:10.459 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:10.460 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:10.460 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:10.473 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:02:10.489 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:02:10.497 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:10.510+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:10.593 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:10.593 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:10.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:10.593 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:10.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.593 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:129 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'87, mlcod=17'85)", 2024-05-07T14:02:10.593 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:10.593 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.306868265000006, 2024-05-07T14:02:10.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034674469999999998, 2024-05-07T14:02:10.594 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.594 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.594 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.594 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:10.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:10.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299075+0000", 2024-05-07T14:02:10.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.736e-06 2024-05-07T14:02:10.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299087+0000", 2024-05-07T14:02:10.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2067e-05 2024-05-07T14:02:10.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299122+0000", 2024-05-07T14:02:10.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4643e-05 2024-05-07T14:02:10.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299141+0000", 2024-05-07T14:02:10.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9224000000000001e-05 2024-05-07T14:02:10.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299323+0000", 2024-05-07T14:02:10.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018190400000000001 2024-05-07T14:02:10.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299385+0000", 2024-05-07T14:02:10.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2126999999999997e-05 2024-05-07T14:02:10.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302462+0000", 2024-05-07T14:02:10.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030768330000000002 2024-05-07T14:02:10.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302541+0000", 2024-05-07T14:02:10.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8912999999999995e-05 2024-05-07T14:02:10.598 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.599 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.599 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.599 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:131 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'89, mlcod=17'85)", 2024-05-07T14:02:10.599 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:10.599 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.305535591999998, 2024-05-07T14:02:10.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038759010000000002, 2024-05-07T14:02:10.599 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.599 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.599 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.600 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:10.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:10.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300407+0000", 2024-05-07T14:02:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0299999999999998e-07 2024-05-07T14:02:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300577+0000", 2024-05-07T14:02:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000170259 2024-05-07T14:02:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300592+0000", 2024-05-07T14:02:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4707e-05 2024-05-07T14:02:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300601+0000", 2024-05-07T14:02:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999995e-06 2024-05-07T14:02:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301133+0000", 2024-05-07T14:02:10.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053150199999999999 2024-05-07T14:02:10.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301186+0000", 2024-05-07T14:02:10.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.342e-05 2024-05-07T14:02:10.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304217+0000", 2024-05-07T14:02:10.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030307429999999998 2024-05-07T14:02:10.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304282+0000", 2024-05-07T14:02:10.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5316999999999998e-05 2024-05-07T14:02:10.604 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.604 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.604 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.604 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:132 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'90, mlcod=17'85)", 2024-05-07T14:02:10.604 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:10.604 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.304483497000007, 2024-05-07T14:02:10.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041397580000000003, 2024-05-07T14:02:10.605 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.605 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.605 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.605 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:10.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:10.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301459+0000", 2024-05-07T14:02:10.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.47e-07 2024-05-07T14:02:10.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301470+0000", 2024-05-07T14:02:10.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0933e-05 2024-05-07T14:02:10.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301483+0000", 2024-05-07T14:02:10.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2427e-05 2024-05-07T14:02:10.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301491+0000", 2024-05-07T14:02:10.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6130000000000004e-06 2024-05-07T14:02:10.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302683+0000", 2024-05-07T14:02:10.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011919980000000001 2024-05-07T14:02:10.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302741+0000", 2024-05-07T14:02:10.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7963000000000001e-05 2024-05-07T14:02:10.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305494+0000", 2024-05-07T14:02:10.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027531420000000001 2024-05-07T14:02:10.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305598+0000", 2024-05-07T14:02:10.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103835 2024-05-07T14:02:10.609 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.610 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.610 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.610 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:134 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'92, mlcod=17'85)", 2024-05-07T14:02:10.610 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:10.610 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.3021976, 2024-05-07T14:02:10.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037081470000000002, 2024-05-07T14:02:10.610 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.610 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.610 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.611 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:10.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:10.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303747+0000", 2024-05-07T14:02:10.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:02:10.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303805+0000", 2024-05-07T14:02:10.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8554999999999998e-05 2024-05-07T14:02:10.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303829+0000", 2024-05-07T14:02:10.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3799999999999999e-05 2024-05-07T14:02:10.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303871+0000", 2024-05-07T14:02:10.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2079999999999997e-05 2024-05-07T14:02:10.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304359+0000", 2024-05-07T14:02:10.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048822999999999998 2024-05-07T14:02:10.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304415+0000", 2024-05-07T14:02:10.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5405999999999998e-05 2024-05-07T14:02:10.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307388+0000", 2024-05-07T14:02:10.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029728070000000001 2024-05-07T14:02:10.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307452+0000", 2024-05-07T14:02:10.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4789000000000006e-05 2024-05-07T14:02:10.615 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.615 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.615 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.615 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:137 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'95, mlcod=17'88)", 2024-05-07T14:02:10.615 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:10.615 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.298573699000002, 2024-05-07T14:02:10.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004097552, 2024-05-07T14:02:10.616 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.616 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.616 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.616 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:10.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:10.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307370+0000", 2024-05-07T14:02:10.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3939999999999999e-06 2024-05-07T14:02:10.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307454+0000", 2024-05-07T14:02:10.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4639000000000001e-05 2024-05-07T14:02:10.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307474+0000", 2024-05-07T14:02:10.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0242999999999999e-05 2024-05-07T14:02:10.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307485+0000", 2024-05-07T14:02:10.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0710000000000001e-05 2024-05-07T14:02:10.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307538+0000", 2024-05-07T14:02:10.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2623000000000001e-05 2024-05-07T14:02:10.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307566+0000", 2024-05-07T14:02:10.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.781e-05 2024-05-07T14:02:10.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311405+0000", 2024-05-07T14:02:10.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038392299999999999 2024-05-07T14:02:10.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311466+0000", 2024-05-07T14:02:10.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0903000000000003e-05 2024-05-07T14:02:10.623 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.624 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.624 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.624 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:138 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'96, mlcod=17'93)", 2024-05-07T14:02:10.624 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:10.624 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.295277561000006, 2024-05-07T14:02:10.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034036700000000001, 2024-05-07T14:02:10.624 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.625 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.625 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.625 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:10.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:10.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310666+0000", 2024-05-07T14:02:10.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:02:10.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310680+0000", 2024-05-07T14:02:10.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4047e-05 2024-05-07T14:02:10.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310715+0000", 2024-05-07T14:02:10.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4826000000000002e-05 2024-05-07T14:02:10.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310739+0000", 2024-05-07T14:02:10.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3796000000000001e-05 2024-05-07T14:02:10.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310862+0000", 2024-05-07T14:02:10.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123132 2024-05-07T14:02:10.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310896+0000", 2024-05-07T14:02:10.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.43e-05 2024-05-07T14:02:10.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313965+0000", 2024-05-07T14:02:10.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030685959999999998 2024-05-07T14:02:10.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314068+0000", 2024-05-07T14:02:10.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102963 2024-05-07T14:02:10.630 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.630 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.630 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.630 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:02:10.630 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:10.630 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.294371878000007, 2024-05-07T14:02:10.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:02:10.631 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.631 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.631 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.631 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:10.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:10.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:02:10.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:02:10.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:02:10.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:02:10.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:02:10.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:02:10.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:02:10.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:02:10.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:02:10.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:02:10.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:02:10.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:02:10.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:02:10.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:02:10.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:02:10.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:02:10.635 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.635 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.635 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.635 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:02:10.635 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:10.636 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.293465482000002, 2024-05-07T14:02:10.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:02:10.636 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.636 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.636 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.636 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:10.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:10.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:02:10.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:02:10.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:02:10.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:02:10.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:02:10.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:02:10.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:02:10.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:02:10.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:02:10.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:02:10.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:02:10.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:02:10.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:02:10.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:02:10.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:02:10.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:02:10.640 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.641 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.641 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.641 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:02:10.641 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:10.641 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.292052862999995, 2024-05-07T14:02:10.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:02:10.641 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.641 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.641 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.641 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:10.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:10.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:02:10.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:02:10.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:02:10.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:02:10.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:02:10.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:02:10.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:02:10.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:02:10.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:02:10.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:02:10.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:02:10.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:02:10.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:02:10.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:02:10.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:02:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:02:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:143 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'101, mlcod=17'98)", 2024-05-07T14:02:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.284160094000001, 2024-05-07T14:02:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036609120000000001, 2024-05-07T14:02:10.646 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:10.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321783+0000", 2024-05-07T14:02:10.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3599999999999999e-06 2024-05-07T14:02:10.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321905+0000", 2024-05-07T14:02:10.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121923 2024-05-07T14:02:10.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321929+0000", 2024-05-07T14:02:10.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4295999999999999e-05 2024-05-07T14:02:10.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321945+0000", 2024-05-07T14:02:10.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5773999999999998e-05 2024-05-07T14:02:10.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322070+0000", 2024-05-07T14:02:10.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012457899999999999 2024-05-07T14:02:10.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322101+0000", 2024-05-07T14:02:10.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1213000000000001e-05 2024-05-07T14:02:10.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325342+0000", 2024-05-07T14:02:10.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032410579999999998 2024-05-07T14:02:10.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325443+0000", 2024-05-07T14:02:10.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100709 2024-05-07T14:02:10.651 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.651 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.651 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.651 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:144 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-05-07T14:02:10.652 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:10.652 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.283091352, 2024-05-07T14:02:10.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003406484, 2024-05-07T14:02:10.652 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.652 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.652 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.652 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:10.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:10.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322852+0000", 2024-05-07T14:02:10.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8369999999999999e-06 2024-05-07T14:02:10.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323022+0000", 2024-05-07T14:02:10.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016984199999999999 2024-05-07T14:02:10.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323048+0000", 2024-05-07T14:02:10.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5752999999999999e-05 2024-05-07T14:02:10.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323071+0000", 2024-05-07T14:02:10.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.266e-05 2024-05-07T14:02:10.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323188+0000", 2024-05-07T14:02:10.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011728200000000001 2024-05-07T14:02:10.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323224+0000", 2024-05-07T14:02:10.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6380000000000001e-05 2024-05-07T14:02:10.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326163+0000", 2024-05-07T14:02:10.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029386170000000001 2024-05-07T14:02:10.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326257+0000", 2024-05-07T14:02:10.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4112999999999998e-05 2024-05-07T14:02:10.656 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.656 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.657 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.657 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:02:10.657 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:10.657 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 63.586760439000003, 2024-05-07T14:02:10.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034691510000000002, 2024-05-07T14:02:10.657 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.657 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.657 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.657 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:10.658 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:10.658 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:10.658 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 206 2024-05-07T14:02:10.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.658 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:10.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:10.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019184+0000", 2024-05-07T14:02:10.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6170000000000001e-06 2024-05-07T14:02:10.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019198+0000", 2024-05-07T14:02:10.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4113e-05 2024-05-07T14:02:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019229+0000", 2024-05-07T14:02:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0423e-05 2024-05-07T14:02:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019244+0000", 2024-05-07T14:02:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5047e-05 2024-05-07T14:02:10.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019478+0000", 2024-05-07T14:02:10.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000234398 2024-05-07T14:02:10.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019723+0000", 2024-05-07T14:02:10.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024469500000000001 2024-05-07T14:02:10.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:10.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.020149+0000", 2024-05-07T14:02:10.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042592999999999998 2024-05-07T14:02:10.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:10.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.021776+0000", 2024-05-07T14:02:10.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001627688 2024-05-07T14:02:10.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022453+0000", 2024-05-07T14:02:10.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00067671500000000004 2024-05-07T14:02:10.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022551+0000", 2024-05-07T14:02:10.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8312000000000003e-05 2024-05-07T14:02:10.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022651+0000", 2024-05-07T14:02:10.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9213e-05 2024-05-07T14:02:10.663 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.663 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.664 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.664 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:10.664 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:10.664 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 63.559471258999999, 2024-05-07T14:02:10.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038721300000000001, 2024-05-07T14:02:10.664 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.664 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.664 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.664 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:10.664 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:10.665 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:10.665 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 210 2024-05-07T14:02:10.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.665 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:10.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:10.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046474+0000", 2024-05-07T14:02:10.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.517e-06 2024-05-07T14:02:10.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046487+0000", 2024-05-07T14:02:10.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3113e-05 2024-05-07T14:02:10.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046521+0000", 2024-05-07T14:02:10.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3556000000000002e-05 2024-05-07T14:02:10.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046537+0000", 2024-05-07T14:02:10.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.643e-05 2024-05-07T14:02:10.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046651+0000", 2024-05-07T14:02:10.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011368500000000001 2024-05-07T14:02:10.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046873+0000", 2024-05-07T14:02:10.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221802 2024-05-07T14:02:10.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:10.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.047335+0000", 2024-05-07T14:02:10.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046227300000000002 2024-05-07T14:02:10.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:10.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.048993+0000", 2024-05-07T14:02:10.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016576679999999999 2024-05-07T14:02:10.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050186+0000", 2024-05-07T14:02:10.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001193284 2024-05-07T14:02:10.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050273+0000", 2024-05-07T14:02:10.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7189999999999997e-05 2024-05-07T14:02:10.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050343+0000", 2024-05-07T14:02:10.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9611999999999997e-05 2024-05-07T14:02:10.670 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.671 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.671 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.671 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:10.671 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:10.671 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 63.529964513000003, 2024-05-07T14:02:10.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034712530000000001, 2024-05-07T14:02:10.671 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.671 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.671 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.672 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:10.672 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:10.672 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:10.672 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 218 2024-05-07T14:02:10.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.672 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:10.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:10.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075980+0000", 2024-05-07T14:02:10.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.774e-06 2024-05-07T14:02:10.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075992+0000", 2024-05-07T14:02:10.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2283000000000001e-05 2024-05-07T14:02:10.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076024+0000", 2024-05-07T14:02:10.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1242999999999999e-05 2024-05-07T14:02:10.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076038+0000", 2024-05-07T14:02:10.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4663e-05 2024-05-07T14:02:10.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076199+0000", 2024-05-07T14:02:10.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160865 2024-05-07T14:02:10.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076539+0000", 2024-05-07T14:02:10.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033995800000000001 2024-05-07T14:02:10.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:10.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.077234+0000", 2024-05-07T14:02:10.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000694581 2024-05-07T14:02:10.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:10.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.078996+0000", 2024-05-07T14:02:10.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001762633 2024-05-07T14:02:10.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079276+0000", 2024-05-07T14:02:10.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027998399999999999 2024-05-07T14:02:10.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079380+0000", 2024-05-07T14:02:10.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103266 2024-05-07T14:02:10.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079449+0000", 2024-05-07T14:02:10.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9003000000000003e-05 2024-05-07T14:02:10.677 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.677 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.678 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.678 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:10.678 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:10.678 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 63.466382381000003, 2024-05-07T14:02:10.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:02:10.678 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.678 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.678 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.678 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:10.679 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:10.679 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:10.679 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:02:10.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.679 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:10.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:10.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:02:10.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:02:10.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:02:10.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:02:10.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:02:10.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:02:10.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:02:10.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:02:10.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:02:10.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:02:10.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:02:10.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:02:10.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:10.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:02:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:02:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:02:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:02:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:02:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:02:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:02:10.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:02:10.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:02:10.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:02:10.684 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.684 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.684 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.685 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:10.685 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:10.685 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 63.433271722999997, 2024-05-07T14:02:10.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:02:10.685 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.685 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.685 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.685 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:10.685 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:10.685 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:10.685 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:02:10.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.685 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:10.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:10.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:02:10.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:02:10.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:02:10.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:02:10.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:02:10.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:02:10.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:02:10.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:02:10.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:02:10.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:02:10.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:02:10.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:02:10.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:10.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:02:10.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:02:10.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:10.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:02:10.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:02:10.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:02:10.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:02:10.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:02:10.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:02:10.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:02:10.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:02:10.691 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.691 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.691 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.692 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:10.692 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:10.692 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 63.426361804000003, 2024-05-07T14:02:10.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041680119999999996, 2024-05-07T14:02:10.692 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.692 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.692 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.692 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:10.692 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:10.693 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:10.693 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 382 2024-05-07T14:02:10.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.693 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:10.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:10.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179581+0000", 2024-05-07T14:02:10.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:02:10.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179585+0000", 2024-05-07T14:02:10.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4800000000000003e-06 2024-05-07T14:02:10.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179598+0000", 2024-05-07T14:02:10.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2322e-05 2024-05-07T14:02:10.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179604+0000", 2024-05-07T14:02:10.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.823e-06 2024-05-07T14:02:10.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179657+0000", 2024-05-07T14:02:10.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3937000000000002e-05 2024-05-07T14:02:10.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179714+0000", 2024-05-07T14:02:10.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6165000000000002e-05 2024-05-07T14:02:10.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:10.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179830+0000", 2024-05-07T14:02:10.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011632 2024-05-07T14:02:10.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:10.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.180515+0000", 2024-05-07T14:02:10.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00068531400000000002 2024-05-07T14:02:10.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183667+0000", 2024-05-07T14:02:10.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031522009999999999 2024-05-07T14:02:10.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183704+0000", 2024-05-07T14:02:10.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6925999999999998e-05 2024-05-07T14:02:10.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183748+0000", 2024-05-07T14:02:10.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3618999999999997e-05 2024-05-07T14:02:10.699 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.699 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.699 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.699 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:499 6.13 e33/27 6:cedbb205:::obj_delete_at_hint.0000000017:head v 33'4, mlcod=33'1)", 2024-05-07T14:02:10.699 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:10.699 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 63.352989149999999, 2024-05-07T14:02:10.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043323679999999996, 2024-05-07T14:02:10.699 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.699 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.699 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.700 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:10.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:10.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252954+0000", 2024-05-07T14:02:10.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.71e-07 2024-05-07T14:02:10.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252960+0000", 2024-05-07T14:02:10.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.46e-06 2024-05-07T14:02:10.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252974+0000", 2024-05-07T14:02:10.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4249e-05 2024-05-07T14:02:10.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252982+0000", 2024-05-07T14:02:10.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:02:10.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253055+0000", 2024-05-07T14:02:10.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3162000000000002e-05 2024-05-07T14:02:10.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253075+0000", 2024-05-07T14:02:10.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9451999999999999e-05 2024-05-07T14:02:10.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257253+0000", 2024-05-07T14:02:10.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041781179999999998 2024-05-07T14:02:10.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257285+0000", 2024-05-07T14:02:10.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2075e-05 2024-05-07T14:02:10.704 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.704 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.704 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.704 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:550 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:10.704 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:10.704 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 63.317334967999997, 2024-05-07T14:02:10.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035552140000000001, 2024-05-07T14:02:10.704 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.704 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.705 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.705 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:10.705 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:10.705 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:10.705 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 550 2024-05-07T14:02:10.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.705 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:10.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:10.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288608+0000", 2024-05-07T14:02:10.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0529999999999999e-06 2024-05-07T14:02:10.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288613+0000", 2024-05-07T14:02:10.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7060000000000003e-06 2024-05-07T14:02:10.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288624+0000", 2024-05-07T14:02:10.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1547e-05 2024-05-07T14:02:10.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288630+0000", 2024-05-07T14:02:10.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:02:10.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288734+0000", 2024-05-07T14:02:10.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103872 2024-05-07T14:02:10.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288884+0000", 2024-05-07T14:02:10.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014987400000000001 2024-05-07T14:02:10.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:10.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289167+0000", 2024-05-07T14:02:10.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028341999999999999 2024-05-07T14:02:10.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:10.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289813+0000", 2024-05-07T14:02:10.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064550199999999995 2024-05-07T14:02:10.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292082+0000", 2024-05-07T14:02:10.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022696000000000001 2024-05-07T14:02:10.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292120+0000", 2024-05-07T14:02:10.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7367999999999999e-05 2024-05-07T14:02:10.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292162+0000", 2024-05-07T14:02:10.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2568000000000003e-05 2024-05-07T14:02:10.711 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.711 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.711 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.712 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:667 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:10.712 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:10.712 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 63.221392934000001, 2024-05-07T14:02:10.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050309150000000004, 2024-05-07T14:02:10.712 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:10.712 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:10.712 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:10.712 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:10.712 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:10.712 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:10.712 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 667 2024-05-07T14:02:10.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.713 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:10.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:10.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:10.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:10.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:10.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:10.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:10.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384550+0000", 2024-05-07T14:02:10.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7000000000000003e-07 2024-05-07T14:02:10.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:10.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384555+0000", 2024-05-07T14:02:10.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.135e-06 2024-05-07T14:02:10.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:10.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384565+0000", 2024-05-07T14:02:10.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0541e-05 2024-05-07T14:02:10.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:10.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384571+0000", 2024-05-07T14:02:10.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.857e-06 2024-05-07T14:02:10.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:10.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384670+0000", 2024-05-07T14:02:10.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8461999999999993e-05 2024-05-07T14:02:10.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:10.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384822+0000", 2024-05-07T14:02:10.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152039 2024-05-07T14:02:10.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:10.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.385123+0000", 2024-05-07T14:02:10.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030070699999999999 2024-05-07T14:02:10.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:10.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.386099+0000", 2024-05-07T14:02:10.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097677300000000001 2024-05-07T14:02:10.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:10.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389495+0000", 2024-05-07T14:02:10.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033959139999999999 2024-05-07T14:02:10.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:10.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389530+0000", 2024-05-07T14:02:10.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.472e-05 2024-05-07T14:02:10.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:10.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:10.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:10.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389580+0000", 2024-05-07T14:02:10.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9897e-05 2024-05-07T14:02:10.718 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.719 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.719 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.719 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:10.719 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:10.719 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:10.721 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:02:10.721 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:10.734+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:10.821 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:10.834+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:10.893 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:10.893 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:10.893 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:10.893 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:10.907 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:02:10.922 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:10.934+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:10.971 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:02:11.036 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:11.050+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:11.076 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:11.076 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:11.077 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:11.090 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:02:11.124 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:11.138+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:11.126 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:11.126 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:11.143 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:11.143 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:11.160 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:11.160 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:11.176 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:11.177 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:11.197 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:11.198 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:11.217 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:11.218 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:11.224 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:11.238+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:11.239 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:11.239 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:11.245 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:11.245 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:11.258 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:02:11.270 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:11.270 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:11.332 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:11.346+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:11.389 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:11.389 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:11.403 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:02:11.444 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:11.458+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:11.528 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:11.538+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:11.573 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:11.573 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:11.587 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:02:11.629 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:11.642+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:11.730 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:11.742+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:11.763 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:11.763 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:11.777 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:02:11.831 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:11.842+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:11.932 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:11.946+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:11.944 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:11.944 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:11.958 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:02:12.033 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:12.046+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:12.082 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:12.082 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:12.096 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:02:12.140 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:12.154+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:12.234 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:12.246+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:12.258 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:12.259 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:12.272 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:02:12.335 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:12.346+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:12.405 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:12.405 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:12.419 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:02:12.464 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:12.478+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:12.514 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:02:12.537 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:12.550+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:12.538 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:12.538 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:12.553 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:02:12.640 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:12.654+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:12.719 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:12.719 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:12.733 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:02:12.738 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:12.750+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:12.840 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:12.854+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:12.901 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:12.901 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:12.917 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:12.940 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:12.954+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:13.042 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:13.054+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:13.087 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:13.087 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:13.101 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:13.142 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:13.154+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:13.244 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:13.254+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:13.269 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:13.269 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:13.283 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:13.288 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:02:13.345 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:13.358+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:13.399 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:13.399 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:13.415 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:13.438 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:13.439 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:13.454 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:13.455 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:13.456 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:13.470+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:13.473 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:13.473 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:13.492 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:13.493 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:13.511 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:13.511 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:13.512 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:02:13.542 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:13.543 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:13.547 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:13.558+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:13.561 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:13.561 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:13.584 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:13.584 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:13.584 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:13.585 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:13.585 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:13.592 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:13.592 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:13.599 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:13.656 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:13.670+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:13.748 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:13.762+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:13.772 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:02:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.766377880999997, 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089647730000000005, 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 46 2024-05-07T14:02:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:02:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:02:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017451+0000", 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9349999999999999e-06 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017460+0000", 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017481+0000", 2024-05-07T14:02:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0984000000000001e-05 2024-05-07T14:02:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017499+0000", 2024-05-07T14:02:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:02:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018689+0000", 2024-05-07T14:02:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001190303 2024-05-07T14:02:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018945+0000", 2024-05-07T14:02:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025626799999999998 2024-05-07T14:02:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022176+0000", 2024-05-07T14:02:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032308720000000001 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026078+0000", 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039018289999999999 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026189+0000", 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110775 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026310+0000", 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121023 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026413+0000", 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103346 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94397682172928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:02:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.756955224999999, 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032214489999999999, 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 47 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026871+0000", 2024-05-07T14:02:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026873+0000", 2024-05-07T14:02:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4200000000000001e-06 2024-05-07T14:02:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026883+0000", 2024-05-07T14:02:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0017000000000001e-05 2024-05-07T14:02:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026904+0000", 2024-05-07T14:02:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0228999999999999e-05 2024-05-07T14:02:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026917+0000", 2024-05-07T14:02:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3594000000000001e-05 2024-05-07T14:02:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027029+0000", 2024-05-07T14:02:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011171900000000001 2024-05-07T14:02:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027247+0000", 2024-05-07T14:02:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021786099999999999 2024-05-07T14:02:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.027599+0000", 2024-05-07T14:02:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035225700000000003 2024-05-07T14:02:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029240+0000", 2024-05-07T14:02:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016408620000000001 2024-05-07T14:02:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029864+0000", 2024-05-07T14:02:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00062414399999999998 2024-05-07T14:02:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.029939+0000", 2024-05-07T14:02:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4931999999999993e-05 2024-05-07T14:02:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.030092+0000", 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015341399999999999 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.744911680000001, 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021710919999999999, 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 54 2024-05-07T14:02:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:02:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038914+0000", 2024-05-07T14:02:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038917+0000", 2024-05-07T14:02:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8720000000000002e-06 2024-05-07T14:02:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038929+0000", 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1294999999999999e-05 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038964+0000", 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5516999999999999e-05 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.038983+0000", 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039074+0000", 2024-05-07T14:02:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1106999999999994e-05 2024-05-07T14:02:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039201+0000", 2024-05-07T14:02:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012714700000000001 2024-05-07T14:02:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.039320+0000", 2024-05-07T14:02:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011861100000000001 2024-05-07T14:02:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040439+0000", 2024-05-07T14:02:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011193450000000001 2024-05-07T14:02:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.040971+0000", 2024-05-07T14:02:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053181599999999995 2024-05-07T14:02:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041040+0000", 2024-05-07T14:02:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8706000000000003e-05 2024-05-07T14:02:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041086+0000", 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5883000000000001e-05 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94397682168320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.742539269000005, 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001933333, 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 55 2024-05-07T14:02:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:02:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041287+0000", 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041288+0000", 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5200000000000001e-06 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041295+0000", 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3679999999999998e-06 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041315+0000", 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9826999999999998e-05 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041325+0000", 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0402e-05 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041403+0000", 2024-05-07T14:02:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8404000000000004e-05 2024-05-07T14:02:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041479+0000", 2024-05-07T14:02:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5846999999999994e-05 2024-05-07T14:02:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.041637+0000", 2024-05-07T14:02:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157699 2024-05-07T14:02:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.042503+0000", 2024-05-07T14:02:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00086578899999999995 2024-05-07T14:02:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043108+0000", 2024-05-07T14:02:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060548999999999998 2024-05-07T14:02:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043158+0000", 2024-05-07T14:02:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9359e-05 2024-05-07T14:02:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.043220+0000", 2024-05-07T14:02:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2627999999999997e-05 2024-05-07T14:02:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:191 6.5 e30/27 6:a2ace8b3:::data_log.0:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:02:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.656115322999995, 2024-05-07T14:02:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00168714, 2024-05-07T14:02:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127711+0000", 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127713+0000", 2024-05-07T14:02:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2290000000000002e-06 2024-05-07T14:02:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127727+0000", 2024-05-07T14:02:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4236999999999999e-05 2024-05-07T14:02:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127759+0000", 2024-05-07T14:02:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1402999999999997e-05 2024-05-07T14:02:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127772+0000", 2024-05-07T14:02:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3227000000000001e-05 2024-05-07T14:02:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127895+0000", 2024-05-07T14:02:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012357500000000001 2024-05-07T14:02:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.127929+0000", 2024-05-07T14:02:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3599999999999997e-05 2024-05-07T14:02:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129322+0000", 2024-05-07T14:02:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001392936 2024-05-07T14:02:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.129398+0000", 2024-05-07T14:02:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5933000000000006e-05 2024-05-07T14:02:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:209 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'1, mlcod=0'0)", 2024-05-07T14:02:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:02:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.743932951999994, 2024-05-07T14:02:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386840000000002, 2024-05-07T14:02:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:02:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039893+0000", 2024-05-07T14:02:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039894+0000", 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9999999999999996e-07 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039906+0000", 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-05 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039948+0000", 2024-05-07T14:02:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1983000000000001e-05 2024-05-07T14:02:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.039975+0000", 2024-05-07T14:02:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7120000000000001e-05 2024-05-07T14:02:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040144+0000", 2024-05-07T14:02:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016912200000000001 2024-05-07T14:02:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.040195+0000", 2024-05-07T14:02:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1023000000000003e-05 2024-05-07T14:02:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043654+0000", 2024-05-07T14:02:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034590089999999999 2024-05-07T14:02:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.043732+0000", 2024-05-07T14:02:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7557000000000003e-05 2024-05-07T14:02:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:215 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:02:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.718395786000002, 2024-05-07T14:02:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017783440000000001, 2024-05-07T14:02:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065430+0000", 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065432+0000", 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8300000000000001e-06 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065444+0000", 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2227e-05 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065472+0000", 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7983e-05 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065487+0000", 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.45e-05 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065628+0000", 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014118900000000001 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.065700+0000", 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1521999999999997e-05 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067097+0000", 2024-05-07T14:02:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00139784 2024-05-07T14:02:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.067209+0000", 2024-05-07T14:02:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111253 2024-05-07T14:02:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:221 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'3, mlcod=33'1)", 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.694595487000001, 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016799510000000001, 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089231+0000", 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089233+0000", 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.877e-06 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089244+0000", 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1323e-05 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089272+0000", 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8204e-05 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089285+0000", 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3223e-05 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089425+0000", 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013934900000000001 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.089487+0000", 2024-05-07T14:02:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2459000000000006e-05 2024-05-07T14:02:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090785+0000", 2024-05-07T14:02:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012974900000000001 2024-05-07T14:02:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.090911+0000", 2024-05-07T14:02:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126026 2024-05-07T14:02:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:231 6.1f e33/27 6:fde4dd55:gc::gc.26:head v 33'1, mlcod=0'0)", 2024-05-07T14:02:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.658318543000007, 2024-05-07T14:02:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020505779999999999, 2024-05-07T14:02:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125508+0000", 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125517+0000", 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.833e-06 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125569+0000", 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1619999999999997e-05 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125589+0000", 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0803000000000001e-05 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125733+0000", 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014308600000000001 2024-05-07T14:02:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.125786+0000", 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3158999999999997e-05 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127460+0000", 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001674493 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.127558+0000", 2024-05-07T14:02:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7967000000000006e-05 2024-05-07T14:02:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:337 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'5, mlcod=33'3)", 2024-05-07T14:02:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:02:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.616920832000005, 2024-05-07T14:02:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004459658, 2024-05-07T14:02:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166908+0000", 2024-05-07T14:02:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2259999999999999e-06 2024-05-07T14:02:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166922+0000", 2024-05-07T14:02:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4780000000000001e-05 2024-05-07T14:02:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166960+0000", 2024-05-07T14:02:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8173000000000002e-05 2024-05-07T14:02:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166981+0000", 2024-05-07T14:02:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0440000000000001e-05 2024-05-07T14:02:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167154+0000", 2024-05-07T14:02:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017287199999999999 2024-05-07T14:02:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167207+0000", 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000001e-05 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171283+0000", 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004076278 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171365+0000", 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1588999999999994e-05 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:349 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:02:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.616046036, 2024-05-07T14:02:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042886440000000003, 2024-05-07T14:02:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:02:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:02:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167782+0000", 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167797+0000", 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4533e-05 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167828+0000", 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1239999999999999e-05 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167859+0000", 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1007000000000003e-05 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168041+0000", 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181788 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168095+0000", 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3857000000000003e-05 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171961+0000", 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038664160000000001 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172069+0000", 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107793 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:357 6.5 e33/27 6:a60f9269:lc::lua_package_allowlist:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.613877306000006, 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002145817, 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169949+0000", 2024-05-07T14:02:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169950+0000", 2024-05-07T14:02:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.626e-06 2024-05-07T14:02:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169963+0000", 2024-05-07T14:02:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2619999999999999e-05 2024-05-07T14:02:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.169990+0000", 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7084e-05 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170003+0000", 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3312999999999999e-05 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170144+0000", 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140376 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.170203+0000", 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9586000000000002e-05 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172022+0000", 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018187419999999999 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172095+0000", 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2470000000000002e-05 2024-05-07T14:02:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:386 6.c e33/27 6:3677c228:::obj_delete_at_hint.0000000006:head v 33'1, mlcod=0'0)", 2024-05-07T14:02:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:02:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.600346970000004, 2024-05-07T14:02:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016811230000000001, 2024-05-07T14:02:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183479+0000", 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183481+0000", 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.756e-06 2024-05-07T14:02:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183493+0000", 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.254e-05 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183520+0000", 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6809999999999999e-05 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183539+0000", 2024-05-07T14:02:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8233e-05 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183686+0000", 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147045 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.183741+0000", 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5380000000000002e-05 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185039+0000", 2024-05-07T14:02:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012981500000000001 2024-05-07T14:02:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.185160+0000", 2024-05-07T14:02:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121209 2024-05-07T14:02:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:604 6.3 e33/27 6:c60da066:gc::gc.4:head v 33'10, mlcod=33'8)", 2024-05-07T14:02:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:02:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.454486122000006, 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003281431, 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329340+0000", 2024-05-07T14:02:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329341+0000", 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.42e-06 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329351+0000", 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0002e-05 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329373+0000", 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1209e-05 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329384+0000", 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1161999999999999e-05 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329495+0000", 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111302 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.329522+0000", 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7291999999999999e-05 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332531+0000", 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003008405 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.332621+0000", 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0638999999999997e-05 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:656 6.1 e33/27 6:84d19476:::obj_delete_at_hint.0000000038:head v 33'5, mlcod=33'3)", 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.408082003999994, 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020273800000000001, 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:02:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375744+0000", 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375746+0000", 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0499999999999999e-06 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375759+0000", 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2952999999999999e-05 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375789+0000", 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9612999999999999e-05 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375804+0000", 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5449999999999999e-05 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375931+0000", 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000126883 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.375972+0000", 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0581999999999999e-05 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377685+0000", 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017136740000000001 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.377772+0000", 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6174999999999994e-05 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:665 6.3 e33/27 6:c31f41d7:gc::gc.10:head v 33'12, mlcod=33'10)", 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.399577746000006, 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001677357, 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384248+0000", 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384250+0000", 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7099999999999999e-06 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384261+0000", 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.113e-05 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384287+0000", 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6256000000000001e-05 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384301+0000", 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3443e-05 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384443+0000", 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000142192 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.384509+0000", 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6124000000000006e-05 2024-05-07T14:02:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385819+0000", 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013092889999999999 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.385926+0000", 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010721300000000001 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:685 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'4, mlcod=33'2)", 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.382885552000005, 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025309769999999998, 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400941+0000", 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400943+0000", 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0899999999999999e-06 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400960+0000", 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6917000000000001e-05 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.400995+0000", 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5626000000000001e-05 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401014+0000", 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9126e-05 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401164+0000", 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149989 2024-05-07T14:02:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.401218+0000", 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3550000000000001e-05 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403375+0000", 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00215737 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.403472+0000", 2024-05-07T14:02:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6309000000000002e-05 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:686 6.1f e33/27 6:f93251ce:::obj_delete_at_hint.0000000042:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.381435697000001, 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037357750000000002, 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402390+0000", 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402392+0000", 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9870000000000002e-06 2024-05-07T14:02:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402405+0000", 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.222e-05 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402429+0000", 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4729999999999999e-05 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402448+0000", 2024-05-07T14:02:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8493000000000001e-05 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402604+0000", 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155876 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.402647+0000", 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2793000000000002e-05 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406039+0000", 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033922760000000001 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.406126+0000", 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7399999999999997e-05 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:693 6.15 e33/27 6:ab569f81:gc::gc.12:head v 33'5, mlcod=33'3)", 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:02:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.375709267999994, 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037287790000000002, 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408117+0000", 2024-05-07T14:02:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408119+0000", 2024-05-07T14:02:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0040000000000002e-06 2024-05-07T14:02:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408135+0000", 2024-05-07T14:02:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6155999999999999e-05 2024-05-07T14:02:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408193+0000", 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8023999999999999e-05 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408248+0000", 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4664999999999999e-05 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408410+0000", 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016263599999999999 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.408462+0000", 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1913000000000003e-05 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411739+0000", 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032768350000000001 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411846+0000", 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010654600000000001 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:694 6.5 e33/27 6:a77dac5b:::obj_delete_at_hint.0000000043:head v 33'8, mlcod=33'6)", 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.373092933999999, 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038331400000000001, 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:02:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410733+0000", 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410735+0000", 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.793e-06 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410746+0000", 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1377e-05 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410775+0000", 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8336000000000001e-05 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410788+0000", 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3074000000000001e-05 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.410945+0000", 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015738199999999999 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.411009+0000", 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4276000000000006e-05 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414499+0000", 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034896060000000001 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.414566+0000", 2024-05-07T14:02:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7296000000000001e-05 2024-05-07T14:02:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:13.873 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:13.875 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:13.875 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:13.886+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:13.976 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:13.990+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:14.043 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:14.043 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:14.044 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:14.044 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:14.057 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:14.077 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:14.090+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:14.178 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:14.190+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:14.225 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:14.225 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:14.225 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:14.225 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:14.226 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:14.239 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:02:14.279 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:14.290+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:14.380 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:14.394+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:14.405 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:02:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:02:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:02:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:02:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 89.589163171999999, 2024-05-07T14:02:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63420480000000001, 2024-05-07T14:02:14.406 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827477+0000", 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827491+0000", 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3923999999999999e-05 2024-05-07T14:02:14.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827514+0000", 2024-05-07T14:02:14.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2796e-05 2024-05-07T14:02:14.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827531+0000", 2024-05-07T14:02:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7520000000000002e-05 2024-05-07T14:02:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827677+0000", 2024-05-07T14:02:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145408 2024-05-07T14:02:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:02:14.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827703+0000", 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6704e-05 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.458662+0000", 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63095893199999997 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459006+0000", 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034329 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459320+0000", 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031472100000000001 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.460665+0000", 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001344633 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461508+0000", 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084310400000000001 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461608+0000", 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9481999999999994e-05 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461680+0000", 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1976000000000003e-05 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:14.413 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:02:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.892102840000007, 2024-05-07T14:02:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015167432999999999, 2024-05-07T14:02:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 37 2024-05-07T14:02:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.414 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:02:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524535+0000", 2024-05-07T14:02:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524536+0000", 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524542+0000", 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7699999999999998e-06 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524551+0000", 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4199999999999996e-06 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.524558+0000", 2024-05-07T14:02:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.379e-06 2024-05-07T14:02:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534146+0000", 2024-05-07T14:02:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095872700000000002 2024-05-07T14:02:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534387+0000", 2024-05-07T14:02:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024181499999999999 2024-05-07T14:02:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.534752+0000", 2024-05-07T14:02:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036441400000000002 2024-05-07T14:02:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.536608+0000", 2024-05-07T14:02:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001856239 2024-05-07T14:02:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539547+0000", 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00293859 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539639+0000", 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2548999999999998e-05 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.539703+0000", 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3330000000000005e-05 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.420 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:02:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.772574535999993, 2024-05-07T14:02:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013763364, 2024-05-07T14:02:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.421 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 88 2024-05-07T14:02:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:02:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644063+0000", 2024-05-07T14:02:14.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644064+0000", 2024-05-07T14:02:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:02:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644070+0000", 2024-05-07T14:02:14.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5500000000000002e-06 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644079+0000", 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.55e-06 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.644086+0000", 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.934e-06 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655168+0000", 2024-05-07T14:02:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011081967 2024-05-07T14:02:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655307+0000", 2024-05-07T14:02:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013893600000000001 2024-05-07T14:02:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.655515+0000", 2024-05-07T14:02:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020742499999999999 2024-05-07T14:02:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657174+0000", 2024-05-07T14:02:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016592340000000001 2024-05-07T14:02:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657576+0000", 2024-05-07T14:02:14.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040245400000000001 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657723+0000", 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014719200000000001 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.657827+0000", 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103319 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.606039351000007, 2024-05-07T14:02:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014874368000000001, 2024-05-07T14:02:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 108 2024-05-07T14:02:14.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810599+0000", 2024-05-07T14:02:14.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0699999999999996e-07 2024-05-07T14:02:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810608+0000", 2024-05-07T14:02:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6330000000000002e-06 2024-05-07T14:02:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810618+0000", 2024-05-07T14:02:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0366999999999999e-05 2024-05-07T14:02:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810626+0000", 2024-05-07T14:02:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7430000000000002e-06 2024-05-07T14:02:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818597+0000", 2024-05-07T14:02:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079710549999999995 2024-05-07T14:02:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.818873+0000", 2024-05-07T14:02:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027635099999999998 2024-05-07T14:02:14.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.819288+0000", 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041430599999999997 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822081+0000", 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002793032 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825193+0000", 2024-05-07T14:02:14.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003112606 2024-05-07T14:02:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825361+0000", 2024-05-07T14:02:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167703 2024-05-07T14:02:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825473+0000", 2024-05-07T14:02:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111865 2024-05-07T14:02:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.433 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.434 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:14.434 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:02:14.434 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.605890028999994, 2024-05-07T14:02:14.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015242152, 2024-05-07T14:02:14.434 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.434 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.434 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.434 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.434 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.434 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.434 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 109 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810748+0000", 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810749+0000", 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.207e-06 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810943+0000", 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019437499999999999 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810959+0000", 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5440000000000001e-05 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810971+0000", 2024-05-07T14:02:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2023e-05 2024-05-07T14:02:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820386+0000", 2024-05-07T14:02:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094148570000000004 2024-05-07T14:02:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820569+0000", 2024-05-07T14:02:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018298199999999999 2024-05-07T14:02:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.820827+0000", 2024-05-07T14:02:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025869400000000001 2024-05-07T14:02:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825585+0000", 2024-05-07T14:02:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004757051 2024-05-07T14:02:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825752+0000", 2024-05-07T14:02:14.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167479 2024-05-07T14:02:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825881+0000", 2024-05-07T14:02:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128629 2024-05-07T14:02:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825990+0000", 2024-05-07T14:02:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109415 2024-05-07T14:02:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.439 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.605647676999993, 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015251472, 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 110 2024-05-07T14:02:14.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810990+0000", 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810991+0000", 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7600000000000006e-07 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.810998+0000", 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3899999999999998e-06 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811007+0000", 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5869999999999999e-06 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811014+0000", 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822508+0000", 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01149416 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.822698+0000", 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018972600000000001 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823009+0000", 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031125100000000002 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.825710+0000", 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002700619 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826014+0000", 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030398799999999999 2024-05-07T14:02:14.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826137+0000", 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123416 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826242+0000", 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104279 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.445 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.605612777000005, 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017650448999999999, 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 111 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811026+0000", 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5300000000000004e-07 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811031+0000", 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0329999999999999e-06 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811043+0000", 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2543e-05 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811050+0000", 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8000000000000001e-06 2024-05-07T14:02:14.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823676+0000", 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012626052 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823904+0000", 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227562 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.824349+0000", 2024-05-07T14:02:14.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044484 2024-05-07T14:02:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826371+0000", 2024-05-07T14:02:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020221380000000001 2024-05-07T14:02:14.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828408+0000", 2024-05-07T14:02:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020372369999999999 2024-05-07T14:02:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828540+0000", 2024-05-07T14:02:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013213600000000001 2024-05-07T14:02:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828676+0000", 2024-05-07T14:02:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013545500000000001 2024-05-07T14:02:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:14.452 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.605551362, 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021330954999999999, 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 112 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:02:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-07 2024-05-07T14:02:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811224+0000", 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653499999999999 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811237+0000", 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.271e-05 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811245+0000", 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6400000000000003e-06 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826483+0000", 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015237456 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826705+0000", 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022216799999999999 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.827081+0000", 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037659800000000002 2024-05-07T14:02:14.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.831960+0000", 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048788779999999997 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832167+0000", 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020690500000000001 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832305+0000", 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013801899999999999 2024-05-07T14:02:14.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832418+0000", 2024-05-07T14:02:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112212 2024-05-07T14:02:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:02:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.605377852999993, 2024-05-07T14:02:14.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021403628000000001, 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 113 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:02:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811261+0000", 2024-05-07T14:02:14.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0400000000000005e-07 2024-05-07T14:02:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811267+0000", 2024-05-07T14:02:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6099999999999997e-06 2024-05-07T14:02:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811276+0000", 2024-05-07T14:02:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4029999999999996e-06 2024-05-07T14:02:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811283+0000", 2024-05-07T14:02:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:02:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828825+0000", 2024-05-07T14:02:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017541853999999999 2024-05-07T14:02:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829061+0000", 2024-05-07T14:02:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235861 2024-05-07T14:02:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829418+0000", 2024-05-07T14:02:14.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035766800000000001 2024-05-07T14:02:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832130+0000", 2024-05-07T14:02:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027118120000000001 2024-05-07T14:02:14.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832442+0000", 2024-05-07T14:02:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000311611 2024-05-07T14:02:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832565+0000", 2024-05-07T14:02:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012284199999999999 2024-05-07T14:02:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832664+0000", 2024-05-07T14:02:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8982999999999997e-05 2024-05-07T14:02:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:02:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.605343863000002, 2024-05-07T14:02:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023518260999999999, 2024-05-07T14:02:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.467 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 114 2024-05-07T14:02:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:02:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811295+0000", 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811301+0000", 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8599999999999998e-06 2024-05-07T14:02:14.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811310+0000", 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0299999999999999e-06 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811320+0000", 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023e-05 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830314+0000", 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018994385999999999 2024-05-07T14:02:14.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830552+0000", 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023815500000000001 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830971+0000", 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041934300000000003 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834620+0000", 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036481389999999999 2024-05-07T14:02:14.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834666+0000", 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6266000000000001e-05 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834742+0000", 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6069000000000006e-05 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834812+0000", 2024-05-07T14:02:14.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0372999999999999e-05 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.605303304000003, 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027863941999999999, 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.473 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 115 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:02:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2699999999999999e-07 2024-05-07T14:02:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811469+0000", 2024-05-07T14:02:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133332 2024-05-07T14:02:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811502+0000", 2024-05-07T14:02:14.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3027000000000001e-05 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811511+0000", 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.713e-06 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832759+0000", 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021248185999999999 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832917+0000", 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157825 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.833269+0000", 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035184099999999998 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838250+0000", 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004980712 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838941+0000", 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069081399999999999 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839091+0000", 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149903 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839199+0000", 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010796199999999999 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.478 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.605109440999996, 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028128562999999999, 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 116 2024-05-07T14:02:14.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811529+0000", 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811546+0000", 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7113e-05 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811570+0000", 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.406e-05 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811578+0000", 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8660000000000006e-06 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834997+0000", 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023418799000000001 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835317+0000", 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031991799999999998 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835662+0000", 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034544399999999998 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839220+0000", 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035576959999999999 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839374+0000", 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015427600000000001 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839540+0000", 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016534500000000001 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839657+0000", 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117243 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:02:14.484 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.605046428999998, 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02858051, 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 117 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:02:14.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811592+0000", 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811601+0000", 2024-05-07T14:02:14.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1269999999999992e-06 2024-05-07T14:02:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811611+0000", 2024-05-07T14:02:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6900000000000004e-06 2024-05-07T14:02:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811618+0000", 2024-05-07T14:02:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0770000000000002e-06 2024-05-07T14:02:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836766+0000", 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025147966000000001 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836982+0000", 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021640400000000001 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.837283+0000", 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030005800000000002 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839885+0000", 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002602937 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839925+0000", 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9446000000000001e-05 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840061+0000", 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136043 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840172+0000", 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111019 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.117478430999995, 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014903938, 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.490 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 137 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299159+0000", 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299160+0000", 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4400000000000001e-07 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299232+0000", 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2348000000000006e-05 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299251+0000", 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9086e-05 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299258+0000", 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0659999999999998e-06 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306394+0000", 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071357629999999998 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306491+0000", 2024-05-07T14:02:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6526000000000004e-05 2024-05-07T14:02:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.306652+0000", 2024-05-07T14:02:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000161674 2024-05-07T14:02:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312756+0000", 2024-05-07T14:02:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061035860000000003 2024-05-07T14:02:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313919+0000", 2024-05-07T14:02:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011630919999999999 2024-05-07T14:02:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314000+0000", 2024-05-07T14:02:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1037000000000004e-05 2024-05-07T14:02:14.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314063+0000", 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3316000000000002e-05 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.117366473000004, 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01524198, 2024-05-07T14:02:14.496 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 138 2024-05-07T14:02:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:02:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299271+0000", 2024-05-07T14:02:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299272+0000", 2024-05-07T14:02:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8599999999999998e-07 2024-05-07T14:02:14.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299282+0000", 2024-05-07T14:02:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0051000000000001e-05 2024-05-07T14:02:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299297+0000", 2024-05-07T14:02:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5125e-05 2024-05-07T14:02:14.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299302+0000", 2024-05-07T14:02:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2119999999999997e-06 2024-05-07T14:02:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309582+0000", 2024-05-07T14:02:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010280163 2024-05-07T14:02:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309722+0000", 2024-05-07T14:02:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000140715 2024-05-07T14:02:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.309941+0000", 2024-05-07T14:02:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000218249 2024-05-07T14:02:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313900+0000", 2024-05-07T14:02:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039598080000000004 2024-05-07T14:02:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314411+0000", 2024-05-07T14:02:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051060400000000001 2024-05-07T14:02:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314466+0000", 2024-05-07T14:02:14.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4861000000000002e-05 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314513+0000", 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7506000000000002e-05 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.117328172000001, 2024-05-07T14:02:14.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01724038, 2024-05-07T14:02:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 139 2024-05-07T14:02:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299310+0000", 2024-05-07T14:02:14.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3099999999999998e-07 2024-05-07T14:02:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299313+0000", 2024-05-07T14:02:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9390000000000002e-06 2024-05-07T14:02:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299318+0000", 2024-05-07T14:02:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5909999999999998e-06 2024-05-07T14:02:14.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299321+0000", 2024-05-07T14:02:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3890000000000001e-06 2024-05-07T14:02:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310603+0000", 2024-05-07T14:02:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011281753 2024-05-07T14:02:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310704+0000", 2024-05-07T14:02:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010111900000000001 2024-05-07T14:02:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.310888+0000", 2024-05-07T14:02:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000183666 2024-05-07T14:02:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314523+0000", 2024-05-07T14:02:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036354999999999998 2024-05-07T14:02:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316436+0000", 2024-05-07T14:02:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001913238 2024-05-07T14:02:14.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316501+0000", 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4261e-05 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.316550+0000", 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9493000000000002e-05 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.117307842000002, 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019781539000000001, 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 140 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-07 2024-05-07T14:02:14.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299398+0000", 2024-05-07T14:02:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7822000000000002e-05 2024-05-07T14:02:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299404+0000", 2024-05-07T14:02:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2369999999999997e-06 2024-05-07T14:02:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299409+0000", 2024-05-07T14:02:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2069999999999997e-06 2024-05-07T14:02:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311355+0000", 2024-05-07T14:02:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011946082 2024-05-07T14:02:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311493+0000", 2024-05-07T14:02:14.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013830900000000001 2024-05-07T14:02:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311709+0000", 2024-05-07T14:02:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021606899999999999 2024-05-07T14:02:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314528+0000", 2024-05-07T14:02:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028193839999999999 2024-05-07T14:02:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319001+0000", 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004472218 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319063+0000", 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1940000000000007e-05 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319112+0000", 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8964000000000001e-05 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.517 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:02:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 88.117221477000001, 2024-05-07T14:02:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019944718, 2024-05-07T14:02:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.518 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 141 2024-05-07T14:02:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:02:14.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299417+0000", 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7099999999999997e-07 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299420+0000", 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8629999999999999e-06 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299424+0000", 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4830000000000001e-06 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299429+0000", 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6609999999999999e-06 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312813+0000", 2024-05-07T14:02:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013384330999999999 2024-05-07T14:02:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312948+0000", 2024-05-07T14:02:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000135239 2024-05-07T14:02:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313163+0000", 2024-05-07T14:02:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000214718 2024-05-07T14:02:14.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314534+0000", 2024-05-07T14:02:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013704430000000001 2024-05-07T14:02:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319185+0000", 2024-05-07T14:02:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046516839999999997 2024-05-07T14:02:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319281+0000", 2024-05-07T14:02:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5645999999999999e-05 2024-05-07T14:02:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319361+0000", 2024-05-07T14:02:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0278999999999995e-05 2024-05-07T14:02:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.404968979000003, 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013780794000000001, 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 158 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.525 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:02:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011669+0000", 2024-05-07T14:02:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011670+0000", 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5700000000000002e-07 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011817+0000", 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014761200000000001 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011830+0000", 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2653999999999999e-05 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011844+0000", 2024-05-07T14:02:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4039999999999999e-05 2024-05-07T14:02:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020200+0000", 2024-05-07T14:02:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083561409999999992 2024-05-07T14:02:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020433+0000", 2024-05-07T14:02:14.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000233088 2024-05-07T14:02:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.020662+0000", 2024-05-07T14:02:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000229015 2024-05-07T14:02:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023097+0000", 2024-05-07T14:02:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024346480000000002 2024-05-07T14:02:14.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025218+0000", 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021216669999999998 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025350+0000", 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013124600000000001 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025450+0000", 2024-05-07T14:02:14.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010002599999999999 2024-05-07T14:02:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:02:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:02:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.404778463, 2024-05-07T14:02:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013831896, 2024-05-07T14:02:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:14.531 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 159 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011859+0000", 2024-05-07T14:02:14.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011860+0000", 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8999999999999995e-07 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011874+0000", 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3806e-05 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:14.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011884+0000", 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5629999999999998e-06 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.011894+0000", 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0353999999999999e-05 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023169+0000", 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011274872 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023305+0000", 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653299999999999 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.023505+0000", 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000199254 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.024966+0000", 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014616830000000001 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025472+0000", 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00050618899999999999 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025593+0000", 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120019 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:47.025691+0000", 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8832999999999994e-05 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.536 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:14.537 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:14.537 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:14.538 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:02:14.539 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:14.550+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:14.639 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:14.650+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:14.669 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:14.669 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:14.669 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:14.669 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:14.683 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:02:14.741 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:14.754+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:14.838 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:14.838 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:14.838 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:14.838 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:14.838 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:14.842 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:14.854+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:14.851 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:02:14.943 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:14.954+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:15.007 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:15.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:15.007 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:15.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.007 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:129 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'87, mlcod=17'85)", 2024-05-07T14:02:15.007 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:15.007 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.719843600000004, 2024-05-07T14:02:15.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034674469999999998, 2024-05-07T14:02:15.008 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.008 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.008 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.008 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:15.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299075+0000", 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.736e-06 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299087+0000", 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2067e-05 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299122+0000", 2024-05-07T14:02:15.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4643e-05 2024-05-07T14:02:15.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299141+0000", 2024-05-07T14:02:15.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9224000000000001e-05 2024-05-07T14:02:15.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299323+0000", 2024-05-07T14:02:15.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018190400000000001 2024-05-07T14:02:15.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299385+0000", 2024-05-07T14:02:15.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2126999999999997e-05 2024-05-07T14:02:15.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302462+0000", 2024-05-07T14:02:15.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030768330000000002 2024-05-07T14:02:15.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302541+0000", 2024-05-07T14:02:15.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8912999999999995e-05 2024-05-07T14:02:15.012 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.012 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.012 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.012 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:131 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'89, mlcod=17'85)", 2024-05-07T14:02:15.012 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.718510926999997, 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038759010000000002, 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:15.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300407+0000", 2024-05-07T14:02:15.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0299999999999998e-07 2024-05-07T14:02:15.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300577+0000", 2024-05-07T14:02:15.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000170259 2024-05-07T14:02:15.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300592+0000", 2024-05-07T14:02:15.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4707e-05 2024-05-07T14:02:15.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300601+0000", 2024-05-07T14:02:15.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999995e-06 2024-05-07T14:02:15.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301133+0000", 2024-05-07T14:02:15.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053150199999999999 2024-05-07T14:02:15.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301186+0000", 2024-05-07T14:02:15.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.342e-05 2024-05-07T14:02:15.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304217+0000", 2024-05-07T14:02:15.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030307429999999998 2024-05-07T14:02:15.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304282+0000", 2024-05-07T14:02:15.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5316999999999998e-05 2024-05-07T14:02:15.017 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.017 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.017 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.017 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:132 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'90, mlcod=17'85)", 2024-05-07T14:02:15.017 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:15.018 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.717458832000005, 2024-05-07T14:02:15.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041397580000000003, 2024-05-07T14:02:15.018 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.018 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.018 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.018 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:15.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:15.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301459+0000", 2024-05-07T14:02:15.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.47e-07 2024-05-07T14:02:15.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301470+0000", 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0933e-05 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301483+0000", 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2427e-05 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301491+0000", 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6130000000000004e-06 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302683+0000", 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011919980000000001 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302741+0000", 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7963000000000001e-05 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305494+0000", 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027531420000000001 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305598+0000", 2024-05-07T14:02:15.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103835 2024-05-07T14:02:15.022 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.022 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.022 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.022 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:134 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'92, mlcod=17'85)", 2024-05-07T14:02:15.022 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:15.022 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.715172934999998, 2024-05-07T14:02:15.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037081470000000002, 2024-05-07T14:02:15.022 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.022 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.023 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.023 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:15.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:15.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303747+0000", 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303805+0000", 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8554999999999998e-05 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303829+0000", 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3799999999999999e-05 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303871+0000", 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2079999999999997e-05 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304359+0000", 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048822999999999998 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304415+0000", 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5405999999999998e-05 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307388+0000", 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029728070000000001 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307452+0000", 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4789000000000006e-05 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.026 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:137 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'95, mlcod=17'88)", 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.711549034000001, 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004097552, 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:15.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:15.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307370+0000", 2024-05-07T14:02:15.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3939999999999999e-06 2024-05-07T14:02:15.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307454+0000", 2024-05-07T14:02:15.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4639000000000001e-05 2024-05-07T14:02:15.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307474+0000", 2024-05-07T14:02:15.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0242999999999999e-05 2024-05-07T14:02:15.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307485+0000", 2024-05-07T14:02:15.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0710000000000001e-05 2024-05-07T14:02:15.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307538+0000", 2024-05-07T14:02:15.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2623000000000001e-05 2024-05-07T14:02:15.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307566+0000", 2024-05-07T14:02:15.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.781e-05 2024-05-07T14:02:15.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311405+0000", 2024-05-07T14:02:15.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038392299999999999 2024-05-07T14:02:15.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311466+0000", 2024-05-07T14:02:15.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0903000000000003e-05 2024-05-07T14:02:15.033 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.034 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.034 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.034 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:138 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'96, mlcod=17'93)", 2024-05-07T14:02:15.034 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:15.034 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.708252896000005, 2024-05-07T14:02:15.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034036700000000001, 2024-05-07T14:02:15.035 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.035 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.035 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.035 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:15.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:15.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310666+0000", 2024-05-07T14:02:15.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:02:15.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310680+0000", 2024-05-07T14:02:15.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4047e-05 2024-05-07T14:02:15.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310715+0000", 2024-05-07T14:02:15.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4826000000000002e-05 2024-05-07T14:02:15.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310739+0000", 2024-05-07T14:02:15.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3796000000000001e-05 2024-05-07T14:02:15.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310862+0000", 2024-05-07T14:02:15.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123132 2024-05-07T14:02:15.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310896+0000", 2024-05-07T14:02:15.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.43e-05 2024-05-07T14:02:15.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313965+0000", 2024-05-07T14:02:15.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030685959999999998 2024-05-07T14:02:15.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314068+0000", 2024-05-07T14:02:15.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102963 2024-05-07T14:02:15.043 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.043 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.044 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.044 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:02:15.044 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:15.044 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.707347213000006, 2024-05-07T14:02:15.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:02:15.045 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.045 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.045 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.045 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:15.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:15.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:02:15.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:02:15.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:02:15.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:02:15.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:02:15.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:02:15.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:02:15.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:02:15.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:02:15.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:02:15.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:02:15.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:02:15.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:02:15.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:02:15.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:02:15.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:02:15.053 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.053 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.054 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.054 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:02:15.054 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:15.054 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.706440817000001, 2024-05-07T14:02:15.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:02:15.055 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.055 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.055 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.055 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:15.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:15.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:02:15.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:02:15.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:02:15.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:02:15.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:02:15.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:02:15.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:02:15.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:02:15.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:02:15.059 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.705028197999994, 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:02:15.063 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:143 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'101, mlcod=17'98)", 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.697135428999999, 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036609120000000001, 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321783+0000", 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3599999999999999e-06 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321905+0000", 2024-05-07T14:02:15.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121923 2024-05-07T14:02:15.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321929+0000", 2024-05-07T14:02:15.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4295999999999999e-05 2024-05-07T14:02:15.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321945+0000", 2024-05-07T14:02:15.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5773999999999998e-05 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322070+0000", 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012457899999999999 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322101+0000", 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1213000000000001e-05 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325342+0000", 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032410579999999998 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325443+0000", 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100709 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:144 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.696066686999998, 2024-05-07T14:02:15.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003406484, 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.070 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.070 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322852+0000", 2024-05-07T14:02:15.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8369999999999999e-06 2024-05-07T14:02:15.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.070 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.070 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323022+0000", 2024-05-07T14:02:15.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016984199999999999 2024-05-07T14:02:15.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323048+0000", 2024-05-07T14:02:15.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5752999999999999e-05 2024-05-07T14:02:15.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323071+0000", 2024-05-07T14:02:15.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.266e-05 2024-05-07T14:02:15.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323188+0000", 2024-05-07T14:02:15.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011728200000000001 2024-05-07T14:02:15.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323224+0000", 2024-05-07T14:02:15.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6380000000000001e-05 2024-05-07T14:02:15.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326163+0000", 2024-05-07T14:02:15.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029386170000000001 2024-05-07T14:02:15.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326257+0000", 2024-05-07T14:02:15.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4112999999999998e-05 2024-05-07T14:02:15.075 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.075 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.075 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.076 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:02:15.076 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:15.076 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.999735774000001, 2024-05-07T14:02:15.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034691510000000002, 2024-05-07T14:02:15.076 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.076 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.077 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.077 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.077 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.077 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.077 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 206 2024-05-07T14:02:15.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.077 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:15.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:15.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019184+0000", 2024-05-07T14:02:15.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6170000000000001e-06 2024-05-07T14:02:15.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019198+0000", 2024-05-07T14:02:15.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4113e-05 2024-05-07T14:02:15.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019229+0000", 2024-05-07T14:02:15.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0423e-05 2024-05-07T14:02:15.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019244+0000", 2024-05-07T14:02:15.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5047e-05 2024-05-07T14:02:15.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019478+0000", 2024-05-07T14:02:15.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000234398 2024-05-07T14:02:15.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019723+0000", 2024-05-07T14:02:15.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024469500000000001 2024-05-07T14:02:15.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:15.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.020149+0000", 2024-05-07T14:02:15.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042592999999999998 2024-05-07T14:02:15.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.021776+0000", 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001627688 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022453+0000", 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00067671500000000004 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022551+0000", 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8312000000000003e-05 2024-05-07T14:02:15.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022651+0000", 2024-05-07T14:02:15.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9213e-05 2024-05-07T14:02:15.084 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.084 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.084 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.084 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.084 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:15.084 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.972446594000004, 2024-05-07T14:02:15.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038721300000000001, 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 210 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:15.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046474+0000", 2024-05-07T14:02:15.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.517e-06 2024-05-07T14:02:15.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046487+0000", 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3113e-05 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046521+0000", 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3556000000000002e-05 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046537+0000", 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.643e-05 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046651+0000", 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011368500000000001 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046873+0000", 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221802 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.047335+0000", 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046227300000000002 2024-05-07T14:02:15.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.048993+0000", 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016576679999999999 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050186+0000", 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001193284 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050273+0000", 2024-05-07T14:02:15.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7189999999999997e-05 2024-05-07T14:02:15.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050343+0000", 2024-05-07T14:02:15.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9611999999999997e-05 2024-05-07T14:02:15.090 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.090 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.090 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.091 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.091 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:15.091 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.942939847999995, 2024-05-07T14:02:15.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034712530000000001, 2024-05-07T14:02:15.091 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.091 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.091 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.091 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.091 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.091 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.091 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 218 2024-05-07T14:02:15.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.091 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:15.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:15.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075980+0000", 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.774e-06 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075992+0000", 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2283000000000001e-05 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076024+0000", 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1242999999999999e-05 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076038+0000", 2024-05-07T14:02:15.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4663e-05 2024-05-07T14:02:15.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076199+0000", 2024-05-07T14:02:15.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160865 2024-05-07T14:02:15.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076539+0000", 2024-05-07T14:02:15.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033995800000000001 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.077234+0000", 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000694581 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.078996+0000", 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001762633 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079276+0000", 2024-05-07T14:02:15.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027998399999999999 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079380+0000", 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103266 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079449+0000", 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9003000000000003e-05 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.879357716000001, 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.097 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:15.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:15.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:02:15.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:02:15.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:02:15.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:02:15.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:02:15.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:02:15.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:02:15.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:02:15.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:02:15.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:02:15.102 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.102 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.102 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.103 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.103 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:15.103 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.846247058000003, 2024-05-07T14:02:15.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:02:15.103 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.103 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.103 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.103 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.103 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.103 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.103 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:02:15.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.103 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:15.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:15.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:02:15.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:02:15.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:02:15.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:02:15.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:02:15.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:02:15.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:15.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:02:15.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:02:15.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:02:15.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:02:15.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:02:15.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:02:15.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:02:15.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:02:15.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:02:15.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:02:15.109 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.109 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.110 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.110 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.110 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:15.110 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.839337138999994, 2024-05-07T14:02:15.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041680119999999996, 2024-05-07T14:02:15.110 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.111 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.111 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.111 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.111 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.111 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.111 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 382 2024-05-07T14:02:15.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.111 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:15.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:15.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179581+0000", 2024-05-07T14:02:15.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:02:15.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179585+0000", 2024-05-07T14:02:15.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4800000000000003e-06 2024-05-07T14:02:15.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179598+0000", 2024-05-07T14:02:15.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2322e-05 2024-05-07T14:02:15.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179604+0000", 2024-05-07T14:02:15.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.823e-06 2024-05-07T14:02:15.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179657+0000", 2024-05-07T14:02:15.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3937000000000002e-05 2024-05-07T14:02:15.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179714+0000", 2024-05-07T14:02:15.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6165000000000002e-05 2024-05-07T14:02:15.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:15.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179830+0000", 2024-05-07T14:02:15.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011632 2024-05-07T14:02:15.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.180515+0000", 2024-05-07T14:02:15.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00068531400000000002 2024-05-07T14:02:15.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183667+0000", 2024-05-07T14:02:15.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031522009999999999 2024-05-07T14:02:15.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183704+0000", 2024-05-07T14:02:15.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6925999999999998e-05 2024-05-07T14:02:15.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183748+0000", 2024-05-07T14:02:15.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3618999999999997e-05 2024-05-07T14:02:15.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.123 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.123 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:499 6.13 e33/27 6:cedbb205:::obj_delete_at_hint.0000000017:head v 33'4, mlcod=33'1)", 2024-05-07T14:02:15.123 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:15.123 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.765964484999998, 2024-05-07T14:02:15.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043323679999999996, 2024-05-07T14:02:15.123 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.123 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252954+0000", 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.71e-07 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252960+0000", 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.46e-06 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252974+0000", 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4249e-05 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252982+0000", 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253055+0000", 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3162000000000002e-05 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253075+0000", 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9451999999999999e-05 2024-05-07T14:02:15.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257253+0000", 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041781179999999998 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257285+0000", 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2075e-05 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:550 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.730310302999996, 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035552140000000001, 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 550 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:15.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:15.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288608+0000", 2024-05-07T14:02:15.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0529999999999999e-06 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288613+0000", 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7060000000000003e-06 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288624+0000", 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1547e-05 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288630+0000", 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288734+0000", 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103872 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288884+0000", 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014987400000000001 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289167+0000", 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028341999999999999 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289813+0000", 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064550199999999995 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292082+0000", 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022696000000000001 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292120+0000", 2024-05-07T14:02:15.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7367999999999999e-05 2024-05-07T14:02:15.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292162+0000", 2024-05-07T14:02:15.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2568000000000003e-05 2024-05-07T14:02:15.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.133 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.134 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:667 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.134 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:15.134 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.634368269000007, 2024-05-07T14:02:15.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050309150000000004, 2024-05-07T14:02:15.134 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.134 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.134 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.134 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.134 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.134 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.134 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 667 2024-05-07T14:02:15.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.134 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384550+0000", 2024-05-07T14:02:15.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7000000000000003e-07 2024-05-07T14:02:15.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384555+0000", 2024-05-07T14:02:15.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.135e-06 2024-05-07T14:02:15.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384565+0000", 2024-05-07T14:02:15.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0541e-05 2024-05-07T14:02:15.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384571+0000", 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.857e-06 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384670+0000", 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8461999999999993e-05 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384822+0000", 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152039 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:15.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.385123+0000", 2024-05-07T14:02:15.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030070699999999999 2024-05-07T14:02:15.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.386099+0000", 2024-05-07T14:02:15.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097677300000000001 2024-05-07T14:02:15.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389495+0000", 2024-05-07T14:02:15.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033959139999999999 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389530+0000", 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.472e-05 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389580+0000", 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9897e-05 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.139 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.140 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:15.141 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:02:15.142 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:15.154+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:15.243 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:15.254+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:15.303 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:15.304 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:15.304 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:15.304 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:15.317 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:02:15.343 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:15.354+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:15.430 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:15.430 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:15.430 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:15.430 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:15.431 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:15.443 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:02:15.445 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:15.458+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:15.532 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:02:15.569 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 75.595805753999997, 2024-05-07T14:02:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:02:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:02:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.548639883000007, 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:02:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:02:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.448312162999997, 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:02:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:02:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:02:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:02:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:02:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:02:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:02:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:02:15.584 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 68.545768105999997, 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.585 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:02:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:02:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:02:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:02:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:02:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:02:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:02:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:02:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 68.526458137999995, 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:02:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:02:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:02:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:02:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:02:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:02:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:02:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:02:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:02:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:02:15.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:02:15.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:15.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:02:15.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:02:15.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:02:15.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:02:15.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:02:15.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:02:15.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:02:15.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:02:15.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:02:15.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:02:15.597 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.597 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.597 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.597 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.598 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:15.598 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 68.501091228000007, 2024-05-07T14:02:15.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:02:15.598 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.598 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.598 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.598 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.598 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.598 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.598 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:02:15.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.598 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:02:15.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:02:15.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:02:15.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:02:15.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:02:15.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:02:15.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:02:15.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:02:15.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:02:15.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:02:15.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:02:15.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:15.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:02:15.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:02:15.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:02:15.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:02:15.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:02:15.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:02:15.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:02:15.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:02:15.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:02:15.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:02:15.604 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.604 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.604 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.604 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.604 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:15.604 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 68.481301844000001, 2024-05-07T14:02:15.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:02:15.604 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.604 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.604 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.604 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:02:15.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:02:15.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:02:15.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:02:15.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:02:15.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:02:15.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:02:15.609 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 68.448063482999999, 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.610 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:02:15.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:02:15.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:02:15.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:02:15.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:02:15.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:02:15.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:02:15.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:02:15.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:02:15.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:02:15.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:02:15.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:02:15.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:15.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:02:15.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:02:15.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:02:15.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:02:15.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:02:15.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:02:15.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:02:15.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:02:15.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 68.412702461999999, 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.616 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:15.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:02:15.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:02:15.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:15.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:02:15.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:02:15.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:02:15.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:02:15.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:02:15.621 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 68.387958896000001, 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.622 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:02:15.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:02:15.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:02:15.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:15.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:02:15.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:02:15.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:02:15.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:02:15.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.627 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.628 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.628 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.628 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:15.628 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 68.277082492999995, 2024-05-07T14:02:15.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:02:15.628 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.628 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.628 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.628 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.628 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.628 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:15.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:02:15.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:02:15.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.634 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.634 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:15.634 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 68.220918544, 2024-05-07T14:02:15.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:02:15.634 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.634 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.634 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.634 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.634 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.634 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.634 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:02:15.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:15.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:02:15.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:02:15.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:02:15.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:02:15.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.639 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.640 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.640 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:15.640 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 68.205033358999998, 2024-05-07T14:02:15.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:02:15.640 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.640 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.640 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.640 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.640 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.640 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.640 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:02:15.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.641 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:15.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:15.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:02:15.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:02:15.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:02:15.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:02:15.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:02:15.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:02:15.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:02:15.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:15.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:02:15.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:02:15.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:02:15.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:02:15.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:02:15.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:02:15.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:02:15.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:02:15.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:02:15.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:02:15.646 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.646 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.646 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.646 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.646 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:15.646 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.955667106999996, 2024-05-07T14:02:15.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:02:15.646 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.646 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.646 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:02:15.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:02:15.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:15.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:02:15.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:02:15.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.894294283999997, 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.652 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:15.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:02:15.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:15.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:02:15.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:15.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:02:15.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:02:15.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:02:15.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:02:15.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.698505941999997, 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.658 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:02:15.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:02:15.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:02:15.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:02:15.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:02:15.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:02:15.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:02:15.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:02:15.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:15.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:02:15.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:02:15.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:02:15.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.694202492000002, 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003023937, 2024-05-07T14:02:15.664 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.665 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.665 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.665 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.665 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.665 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.665 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 918 2024-05-07T14:02:15.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.665 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:15.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886558+0000", 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1229999999999998e-06 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886569+0000", 2024-05-07T14:02:15.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1497e-05 2024-05-07T14:02:15.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886600+0000", 2024-05-07T14:02:15.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0809999999999998e-05 2024-05-07T14:02:15.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886618+0000", 2024-05-07T14:02:15.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7799e-05 2024-05-07T14:02:15.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886736+0000", 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118276 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886951+0000", 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021467200000000001 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.887437+0000", 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048624900000000001 2024-05-07T14:02:15.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.888687+0000", 2024-05-07T14:02:15.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012498310000000001 2024-05-07T14:02:15.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889318+0000", 2024-05-07T14:02:15.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063122199999999997 2024-05-07T14:02:15.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889463+0000", 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144769 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889580+0000", 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011668899999999999 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:15.670 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.663201767999993, 2024-05-07T14:02:15.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:02:15.671 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.671 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.671 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.671 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.671 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.671 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.671 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:02:15.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.671 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:15.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:15.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:02:15.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:15.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:02:15.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:02:15.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:02:15.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:02:15.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:02:15.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:02:15.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.658316876000001, 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:15.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:15.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:02:15.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:02:15.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:02:15.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:15.682 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 67.626395505000005, 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:15.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:02:15.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:15.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:02:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:02:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:15.688 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:15.688 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:15.582+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:15.689 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:02:15.690 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:02:15.691 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:15.706+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:15.792 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:15.806+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:15.893 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:15.906+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:15.910 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:15.910 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:15.910 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:15.910 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:15.928 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:02:15.942 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:15.943 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:15.971 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:15.972 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:15.994 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:16.006+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:16.003 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:16.003 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:16.037 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:16.037 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:16.071 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:16.071 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:16.073 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:16.073 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:16.087 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:02:16.095 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:16.106+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:16.104 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:16.125 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:16.125 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:16.148 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:16.148 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:16.196 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:16.210+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:16.214 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:16.214 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:16.227 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:02:16.298 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:16.310+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:16.344 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:16.344 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:16.360 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:02:16.399 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:16.410+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:16.467 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:16.467 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:16.479 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:02:16.500 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:16.514+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:16.523 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:02:16.600 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:16.614+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:16.633 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:16.633 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:16.646 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:02:16.701 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:16.714+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:16.778 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:16.778 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:16.792 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:02:16.836 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:16.850+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:16.903 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:16.914+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:16.956 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:16.956 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:16.971 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:02:17.004 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:17.018+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:17.096 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:17.096 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:17.105 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:17.118+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:17.110 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:02:17.206 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:17.218+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:17.232 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:17.232 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:17.246 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:17.307 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:17.318+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:17.369 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:17.370 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:17.384 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:17.408 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:17.418+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:17.509 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:17.522+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:17.552 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:17.552 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:17.566 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:17.610 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:17.622+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:17.710 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:17.722+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:17.725 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:17.725 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:17.739 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:17.812 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:17.822+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:17.855 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:17.855 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:17.871 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:17.913 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:17.926+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:17.993 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:17.993 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:18.008 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:18.013 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:18.026+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:18.114 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:18.126+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:18.129 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:18.129 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:18.143 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:18.167 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:02:18.216 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:18.230+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:18.307 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:18.307 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:18.315 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:18.326+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:18.321 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:02:18.324 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:18.324 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:18.340 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:18.340 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:18.356 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:18.356 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:18.384 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:18.384 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:18.401 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:18.416 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:18.429+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:18.433 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:18.433 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:18.444 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:18.444 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:18.452 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:18.453 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:18.458 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:02:18.480 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:18.480 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:18.517 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:18.529+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:18.556 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:02:18.576 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:18.576 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:18.590 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:02:18.636 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:18.650+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:18.718 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:18.729+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:18.776 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:18.777 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:18.777 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:18.777 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:18.777 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:18.792 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:02:18.819 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:18.829+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:18.905 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:129 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'87, mlcod=17'85)", 2024-05-07T14:02:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.618128546999998, 2024-05-07T14:02:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034674469999999998, 2024-05-07T14:02:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299075+0000", 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.736e-06 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299087+0000", 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2067e-05 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299122+0000", 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4643e-05 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299141+0000", 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9224000000000001e-05 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299323+0000", 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018190400000000001 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299385+0000", 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2126999999999997e-05 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302462+0000", 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030768330000000002 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302541+0000", 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8912999999999995e-05 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:131 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'89, mlcod=17'85)", 2024-05-07T14:02:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.616795874000005, 2024-05-07T14:02:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038759010000000002, 2024-05-07T14:02:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300407+0000", 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0299999999999998e-07 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300577+0000", 2024-05-07T14:02:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000170259 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300592+0000", 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4707e-05 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300601+0000", 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999995e-06 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301133+0000", 2024-05-07T14:02:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053150199999999999 2024-05-07T14:02:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301186+0000", 2024-05-07T14:02:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.342e-05 2024-05-07T14:02:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304217+0000", 2024-05-07T14:02:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030307429999999998 2024-05-07T14:02:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304282+0000", 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5316999999999998e-05 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:132 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'90, mlcod=17'85)", 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.615743778999999, 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041397580000000003, 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301459+0000", 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.47e-07 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301470+0000", 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0933e-05 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301483+0000", 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2427e-05 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301491+0000", 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6130000000000004e-06 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302683+0000", 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011919980000000001 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302741+0000", 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7963000000000001e-05 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305494+0000", 2024-05-07T14:02:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027531420000000001 2024-05-07T14:02:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305598+0000", 2024-05-07T14:02:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103835 2024-05-07T14:02:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:134 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'92, mlcod=17'85)", 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.613457882000006, 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037081470000000002, 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303747+0000", 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303805+0000", 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8554999999999998e-05 2024-05-07T14:02:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303829+0000", 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3799999999999999e-05 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303871+0000", 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2079999999999997e-05 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304359+0000", 2024-05-07T14:02:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048822999999999998 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304415+0000", 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5405999999999998e-05 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307388+0000", 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029728070000000001 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307452+0000", 2024-05-07T14:02:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4789000000000006e-05 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:137 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'95, mlcod=17'88)", 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.609833980999994, 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004097552, 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307370+0000", 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3939999999999999e-06 2024-05-07T14:02:18.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307454+0000", 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4639000000000001e-05 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307474+0000", 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0242999999999999e-05 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307485+0000", 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0710000000000001e-05 2024-05-07T14:02:18.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307538+0000", 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2623000000000001e-05 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307566+0000", 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.781e-05 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311405+0000", 2024-05-07T14:02:18.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038392299999999999 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311466+0000", 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0903000000000003e-05 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:138 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'96, mlcod=17'93)", 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.606537842999998, 2024-05-07T14:02:18.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034036700000000001, 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310666+0000", 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310680+0000", 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4047e-05 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310715+0000", 2024-05-07T14:02:18.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4826000000000002e-05 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310739+0000", 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3796000000000001e-05 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310862+0000", 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123132 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310896+0000", 2024-05-07T14:02:18.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.43e-05 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313965+0000", 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030685959999999998 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314068+0000", 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102963 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.605632159999999, 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:02:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:02:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:02:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:02:18.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:02:18.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:02:18.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:02:18.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:02:18.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:02:18.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:02:18.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:02:18.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:02:18.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:18.936 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.604725763999994, 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:18.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:02:18.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:02:18.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:02:18.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:02:18.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:02:18.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:02:18.940 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:02:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.603313145000001, 2024-05-07T14:02:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:02:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.941 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:02:18.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:02:18.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:02:18.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:02:18.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:02:18.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:02:18.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:143 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'101, mlcod=17'98)", 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.595420376000007, 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036609120000000001, 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321783+0000", 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3599999999999999e-06 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321905+0000", 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121923 2024-05-07T14:02:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321929+0000", 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4295999999999999e-05 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321945+0000", 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5773999999999998e-05 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322070+0000", 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012457899999999999 2024-05-07T14:02:18.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322101+0000", 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1213000000000001e-05 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325342+0000", 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032410579999999998 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325443+0000", 2024-05-07T14:02:18.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100709 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:144 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.594351634000006, 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003406484, 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322852+0000", 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8369999999999999e-06 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323022+0000", 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016984199999999999 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323048+0000", 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5752999999999999e-05 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323071+0000", 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.266e-05 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323188+0000", 2024-05-07T14:02:18.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011728200000000001 2024-05-07T14:02:18.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323224+0000", 2024-05-07T14:02:18.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6380000000000001e-05 2024-05-07T14:02:18.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326163+0000", 2024-05-07T14:02:18.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029386170000000001 2024-05-07T14:02:18.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326257+0000", 2024-05-07T14:02:18.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4112999999999998e-05 2024-05-07T14:02:18.954 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.954 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.954 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.954 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:02:18.954 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.898020720999995, 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034691510000000002, 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 206 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019184+0000", 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6170000000000001e-06 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019198+0000", 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4113e-05 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019229+0000", 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0423e-05 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019244+0000", 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5047e-05 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019478+0000", 2024-05-07T14:02:18.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000234398 2024-05-07T14:02:18.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019723+0000", 2024-05-07T14:02:18.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024469500000000001 2024-05-07T14:02:18.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:18.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.020149+0000", 2024-05-07T14:02:18.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042592999999999998 2024-05-07T14:02:18.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:18.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.021776+0000", 2024-05-07T14:02:18.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001627688 2024-05-07T14:02:18.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:18.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022453+0000", 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00067671500000000004 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022551+0000", 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8312000000000003e-05 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022651+0000", 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9213e-05 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.870731540999998, 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038721300000000001, 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 210 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.961 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:18.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:18.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046474+0000", 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.517e-06 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046487+0000", 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3113e-05 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046521+0000", 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3556000000000002e-05 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046537+0000", 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.643e-05 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046651+0000", 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011368500000000001 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046873+0000", 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221802 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.047335+0000", 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046227300000000002 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.048993+0000", 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016576679999999999 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050186+0000", 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001193284 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050273+0000", 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7189999999999997e-05 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050343+0000", 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9611999999999997e-05 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.966 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.841224795000002, 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034712530000000001, 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 218 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075980+0000", 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.774e-06 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075992+0000", 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2283000000000001e-05 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076024+0000", 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1242999999999999e-05 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076038+0000", 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4663e-05 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076199+0000", 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160865 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076539+0000", 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033995800000000001 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.077234+0000", 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000694581 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.078996+0000", 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001762633 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079276+0000", 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027998399999999999 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079380+0000", 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103266 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079449+0000", 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9003000000000003e-05 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.777642662999995, 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.972 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:18.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.977 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.978 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:18.978 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:18.978 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.744532004999996, 2024-05-07T14:02:18.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:02:18.978 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.978 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.978 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.978 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:18.978 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:18.978 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:18.978 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:02:18.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.979 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:18.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:18.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:02:18.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:02:18.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:18.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:02:18.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:02:18.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:18.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:02:18.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:02:18.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.983 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.737622086000002, 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041680119999999996, 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:18.984 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 382 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179581+0000", 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179585+0000", 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4800000000000003e-06 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179598+0000", 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2322e-05 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179604+0000", 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.823e-06 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179657+0000", 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3937000000000002e-05 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179714+0000", 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6165000000000002e-05 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179830+0000", 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011632 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.180515+0000", 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00068531400000000002 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183667+0000", 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031522009999999999 2024-05-07T14:02:18.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183704+0000", 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6925999999999998e-05 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183748+0000", 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3618999999999997e-05 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.989 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:499 6.13 e33/27 6:cedbb205:::obj_delete_at_hint.0000000017:head v 33'4, mlcod=33'1)", 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.664249432000005, 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043323679999999996, 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252954+0000", 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.71e-07 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252960+0000", 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.46e-06 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252974+0000", 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4249e-05 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252982+0000", 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253055+0000", 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3162000000000002e-05 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253075+0000", 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9451999999999999e-05 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257253+0000", 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041781179999999998 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257285+0000", 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2075e-05 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.993 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:550 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.628595250000004, 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035552140000000001, 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 550 2024-05-07T14:02:18.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:18.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288608+0000", 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0529999999999999e-06 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288613+0000", 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7060000000000003e-06 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288624+0000", 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1547e-05 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:18.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288630+0000", 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288734+0000", 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103872 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288884+0000", 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014987400000000001 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289167+0000", 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028341999999999999 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289813+0000", 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064550199999999995 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292082+0000", 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022696000000000001 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292120+0000", 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7367999999999999e-05 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292162+0000", 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2568000000000003e-05 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:667 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:18.999 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.532653216, 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050309150000000004, 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 667 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:19.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384550+0000", 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7000000000000003e-07 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384555+0000", 2024-05-07T14:02:19.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.135e-06 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384565+0000", 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0541e-05 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384571+0000", 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.857e-06 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384670+0000", 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8461999999999993e-05 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384822+0000", 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152039 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.385123+0000", 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030070699999999999 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.386099+0000", 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097677300000000001 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389495+0000", 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033959139999999999 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389530+0000", 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.472e-05 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389580+0000", 2024-05-07T14:02:19.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9897e-05 2024-05-07T14:02:19.005 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.005 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.005 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.005 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.005 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.005 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:19.006 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:02:19.007 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:19.017+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:19.107 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:19.117+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:19.177 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:19.177 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:19.177 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:19.177 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:19.193 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:02:19.240 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:19.253+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:19.309 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:19.321+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:19.316 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:19.317 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:19.317 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:19.317 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:19.317 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:19.329 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:02:19.424 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:19.437+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:19.486 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:19.486 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:19.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:19.486 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:19.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.486 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:19.487 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:19.487 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 79.513093239, 2024-05-07T14:02:19.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:02:19.487 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.487 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.487 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:19.487 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.487 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:19.487 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:19.487 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:02:19.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.487 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.488 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:19.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.488 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:19.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:02:19.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:02:19.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:02:19.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:02:19.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:02:19.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:02:19.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:02:19.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:02:19.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:02:19.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:02:19.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:19.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:02:19.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:02:19.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.492 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 75.465927367999996, 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:02:19.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:02:19.496 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 75.365599648, 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.497 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:02:19.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:02:19.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.463055591, 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.503 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:02:19.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:02:19.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:19.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.508 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.443745622999998, 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:19.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:19.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:02:19.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:02:19.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:02:19.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:02:19.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:02:19.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:02:19.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.514 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.514 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:02:19.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:02:19.514 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.514 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.514 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.514 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.418378712999996, 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:02:19.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:02:19.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:02:19.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:02:19.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:19.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:02:19.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.398589329000004, 2024-05-07T14:02:19.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:02:19.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:02:19.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:02:19.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:02:19.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:02:19.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.526 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:02:19.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:02:19.526 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.526 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.526 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.526 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.526 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:19.526 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.365350968000001, 2024-05-07T14:02:19.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:02:19.526 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.526 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:02:19.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:02:19.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:19.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:02:19.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:02:19.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:02:19.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:02:19.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:02:19.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:02:19.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:02:19.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:02:19.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.329989947000001, 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.532 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:19.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.534 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:02:19.535 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:02:19.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.535 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:02:19.535 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:02:19.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.535 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:02:19.535 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:02:19.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:02:19.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:02:19.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:19.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:02:19.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:02:19.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:02:19.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:02:19.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:02:19.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:02:19.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:02:19.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:02:19.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.305246381000003, 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.538 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.539 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.539 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.539 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.539 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.539 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:02:19.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.539 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.539 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.539 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:19.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:19.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:02:19.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:02:19.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:02:19.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:02:19.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:02:19.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:02:19.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:19.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:02:19.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:02:19.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:02:19.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.194369977999997, 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:02:19.544 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:19.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:02:19.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:02:19.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:02:19.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:02:19.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:02:19.550 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.550 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.550 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.550 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.550 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:19.550 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.138206029000003, 2024-05-07T14:02:19.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:02:19.550 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:02:19.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:02:19.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:02:19.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:02:19.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:02:19.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.554 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.122320844000001, 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.556 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.559 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:02:19.561 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.872954591999999, 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.562 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:02:19.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:02:19.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:02:19.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.566 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:19.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:02:19.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:02:19.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.566 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:02:19.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:02:19.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.567 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.811581769, 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:02:19.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:02:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:02:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:02:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:02:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:02:19.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.574 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.574 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:19.574 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.615793427, 2024-05-07T14:02:19.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:02:19.574 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.574 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.574 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.574 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.574 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.574 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.574 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:02:19.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.574 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:02:19.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:19.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:02:19.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:02:19.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:02:19.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:02:19.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:19.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:02:19.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:02:19.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:02:19.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:02:19.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.579 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.611489977000005, 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003023937, 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 918 2024-05-07T14:02:19.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886558+0000", 2024-05-07T14:02:19.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1229999999999998e-06 2024-05-07T14:02:19.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886569+0000", 2024-05-07T14:02:19.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1497e-05 2024-05-07T14:02:19.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886600+0000", 2024-05-07T14:02:19.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0809999999999998e-05 2024-05-07T14:02:19.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886618+0000", 2024-05-07T14:02:19.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7799e-05 2024-05-07T14:02:19.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886736+0000", 2024-05-07T14:02:19.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118276 2024-05-07T14:02:19.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886951+0000", 2024-05-07T14:02:19.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021467200000000001 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.887437+0000", 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048624900000000001 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.888687+0000", 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012498310000000001 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889318+0000", 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063122199999999997 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889463+0000", 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144769 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889580+0000", 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011668899999999999 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.586 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.586 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:19.586 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.580489252999996, 2024-05-07T14:02:19.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:02:19.586 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.586 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.586 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.586 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.586 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.586 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.586 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:02:19.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.587 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:19.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:19.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:02:19.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:02:19.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:02:19.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:02:19.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:02:19.591 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.591 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.591 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.575604361000003, 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.592 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:02:19.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:02:19.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:02:19.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:19.597 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 71.543682989999994, 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:19.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:19.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:19.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:19.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:19.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:02:19.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:02:19.603 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.603 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.603 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.603 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:19.603 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:19.603 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:19.605 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:02:19.605 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:02:19.606 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:19.617+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:19.706 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:19.717+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:19.765 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:19.765 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:19.765 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:19.777 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:02:19.825 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:19.837+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:19.884 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:19.884 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:19.884 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:19.884 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:19.885 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:19.897 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:02:19.908 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:19.921+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:20.009 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:20.021+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:20.082 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:20.082 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:20.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:20.082 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:20.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.082 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:40 5.8 5:168cc6a2:::zonegroup_info.7881bf19-2c91-49be-82bb-722579314d1c:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:20.082 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 80.052801307999999, 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002658582, 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 40 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:20.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:20.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042176+0000", 2024-05-07T14:02:20.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7719999999999999e-06 2024-05-07T14:02:20.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042186+0000", 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0020000000000001e-05 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042209+0000", 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3224e-05 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042220+0000", 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1153e-05 2024-05-07T14:02:20.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042358+0000", 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137389 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042594+0000", 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023630100000000001 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042900+0000", 2024-05-07T14:02:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030576799999999999 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044463+0000", 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015627130000000001 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044675+0000", 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021186999999999999 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044768+0000", 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3046000000000003e-05 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044833+0000", 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5326000000000004e-05 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:20.088 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.058246423, 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025872120000000002, 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 52 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036732+0000", 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4980000000000001e-06 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036744+0000", 2024-05-07T14:02:20.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2269999999999999e-05 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036772+0000", 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8002000000000001e-05 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036817+0000", 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4608999999999999e-05 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036946+0000", 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012988400000000001 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037184+0000", 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000237178 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037405+0000", 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221418 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.038548+0000", 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011433540000000001 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039179+0000", 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063016999999999999 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039231+0000", 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2434e-05 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039316+0000", 2024-05-07T14:02:20.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5395000000000005e-05 2024-05-07T14:02:20.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.094 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.094 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.094 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:20.094 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.949663960999999, 2024-05-07T14:02:20.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:02:20.094 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:02:20.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:02:20.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:02:20.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:02:20.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:02:20.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:02:20.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:02:20.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:02:20.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:02:20.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:02:20.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.100 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.100 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.100 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:20.100 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.937245020000006, 2024-05-07T14:02:20.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:02:20.100 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.101 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.101 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.101 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:02:20.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.101 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:20.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:20.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:02:20.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:02:20.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:02:20.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:02:20.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:02:20.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:02:20.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:02:20.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:02:20.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:02:20.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:02:20.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.106 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.933365297999998, 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:02:20.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:02:20.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:02:20.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:02:20.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:02:20.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:02:20.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:02:20.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:20.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:02:20.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:02:20.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:02:20.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:02:20.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.802709794999998, 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:02:20.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:02:20.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:02:20.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:02:20.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:02:20.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:02:20.118 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.118 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.118 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.795542472999998, 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.119 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:02:20.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:02:20.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:02:20.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:02:20.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:02:20.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.124 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.125 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:20.125 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:20.125 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.505009784999999, 2024-05-07T14:02:20.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:02:20.125 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.125 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.125 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.125 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:20.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:02:20.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:02:20.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:02:20.129 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.129 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.129 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.129 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.129 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:20.129 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.439928390999995, 2024-05-07T14:02:20.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025880500000000002, 2024-05-07T14:02:20.129 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.129 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 819 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655049+0000", 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6640000000000001e-06 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655057+0000", 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5639999999999997e-06 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655082+0000", 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4119999999999999e-05 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655093+0000", 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1598e-05 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655273+0000", 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017975599999999999 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655432+0000", 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000158682 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655720+0000", 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028791400000000001 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.656823+0000", 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001103435 2024-05-07T14:02:20.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657483+0000", 2024-05-07T14:02:20.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000659828 2024-05-07T14:02:20.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657571+0000", 2024-05-07T14:02:20.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7756000000000005e-05 2024-05-07T14:02:20.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657635+0000", 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4733000000000005e-05 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.387652157999995, 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028535079999999998, 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.135 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 841 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:20.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707326+0000", 2024-05-07T14:02:20.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:02:20.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707338+0000", 2024-05-07T14:02:20.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2036e-05 2024-05-07T14:02:20.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707367+0000", 2024-05-07T14:02:20.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8816999999999999e-05 2024-05-07T14:02:20.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707382+0000", 2024-05-07T14:02:20.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4912999999999999e-05 2024-05-07T14:02:20.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707523+0000", 2024-05-07T14:02:20.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014165599999999999 2024-05-07T14:02:20.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707748+0000", 2024-05-07T14:02:20.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000224315 2024-05-07T14:02:20.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:20.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.708055+0000", 2024-05-07T14:02:20.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030739800000000001 2024-05-07T14:02:20.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.709147+0000", 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001091788 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710030+0000", 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088367000000000003 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710114+0000", 2024-05-07T14:02:20.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3936000000000004e-05 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710177+0000", 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2675999999999994e-05 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.383985619000001, 2024-05-07T14:02:20.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026153460000000002, 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 843 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710992+0000", 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.666e-06 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711000+0000", 2024-05-07T14:02:20.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.977e-06 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711020+0000", 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.033e-05 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711030+0000", 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9790000000000005e-06 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711133+0000", 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102563 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711256+0000", 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012337599999999999 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711555+0000", 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029948699999999997 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.712654+0000", 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001098819 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713451+0000", 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000796424 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713541+0000", 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9981999999999993e-05 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713605+0000", 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4743e-05 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.374529503000005, 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027995160000000002, 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.147 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 847 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720448+0000", 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720460+0000", 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1157e-05 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720490+0000", 2024-05-07T14:02:20.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0960000000000002e-05 2024-05-07T14:02:20.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720507+0000", 2024-05-07T14:02:20.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6477000000000002e-05 2024-05-07T14:02:20.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720681+0000", 2024-05-07T14:02:20.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017396800000000001 2024-05-07T14:02:20.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720897+0000", 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215775 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.721203+0000", 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030621499999999998 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.722485+0000", 2024-05-07T14:02:20.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012818599999999999 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723091+0000", 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060651499999999996 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723182+0000", 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0692999999999994e-05 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723246+0000", 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3643e-05 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.370762154000005, 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.153 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:20.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:02:20.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:02:20.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:02:20.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:02:20.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:02:20.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.325048757999994, 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.159 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:02:20.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:20.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:02:20.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:02:20.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:02:20.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:02:20.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.318772019999997, 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.165 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:20.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:20.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.170 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.232258900000005, 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028016680000000002, 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 907 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862719+0000", 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862733+0000", 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3067e-05 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862763+0000", 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0926000000000002e-05 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862779+0000", 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5787e-05 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862924+0000", 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014509899999999999 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863160+0000", 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000235701 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863523+0000", 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000362567 2024-05-07T14:02:20.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.864872+0000", 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00134954 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865350+0000", 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000478009 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865437+0000", 2024-05-07T14:02:20.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6712999999999995e-05 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865518+0000", 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1493000000000001e-05 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.228529613000006, 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027054290000000001, 2024-05-07T14:02:20.176 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 909 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866448+0000", 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866459+0000", 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1207e-05 2024-05-07T14:02:20.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866491+0000", 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362999999999998e-05 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866506+0000", 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4790000000000001e-05 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866632+0000", 2024-05-07T14:02:20.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000126422 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866761+0000", 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128832 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.867037+0000", 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027612200000000001 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.868118+0000", 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001080941 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869004+0000", 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088632000000000001 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869081+0000", 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7195999999999997e-05 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869151+0000", 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0066000000000003e-05 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.133680814000002, 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.182 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:02:20.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:02:20.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:20.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:02:20.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:02:20.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:02:20.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:02:20.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:02:20.187 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.120511460000003, 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027821920000000002, 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.188 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 955 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974466+0000", 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0999999999999998e-06 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974480+0000", 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3876999999999999e-05 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974510+0000", 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0273e-05 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974525+0000", 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.485e-05 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974618+0000", 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2359000000000001e-05 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974822+0000", 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000204148 2024-05-07T14:02:20.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.975126+0000", 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030382800000000002 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976565+0000", 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014395160000000001 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976963+0000", 2024-05-07T14:02:20.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00039772700000000001 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977128+0000", 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165508 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977246+0000", 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011800599999999999 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.194 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.194 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:20.194 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.116595896999996, 2024-05-07T14:02:20.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027683989999999999, 2024-05-07T14:02:20.194 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.194 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.194 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.194 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.194 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.194 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.194 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 957 2024-05-07T14:02:20.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978382+0000", 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.95e-06 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978393+0000", 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.084e-05 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978424+0000", 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1022999999999998e-05 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978441+0000", 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7782999999999999e-05 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978565+0000", 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012348900000000001 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978794+0000", 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000229335 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:20.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.979262+0000", 2024-05-07T14:02:20.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046826700000000002 2024-05-07T14:02:20.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.980470+0000", 2024-05-07T14:02:20.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012071899999999999 2024-05-07T14:02:20.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981002+0000", 2024-05-07T14:02:20.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053222299999999996 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981086+0000", 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4073000000000006e-05 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981148+0000", 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2225999999999997e-05 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.199 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.200 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.200 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:20.201 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:02:20.202 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:20.213+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:20.302 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:20.313+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:20.359 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:20.359 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:20.359 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:20.359 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:20.372 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:02:20.403 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:20.413+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:20.479 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:20.479 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:20.479 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:20.479 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:20.479 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:20.492 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:02:20.502 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:02:20.537 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:20.549+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:20.604 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:20.617+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:20.652 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:20.653 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:20.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:20.653 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:20.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.653 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:02:20.653 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:20.653 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 78.661709971999997, 2024-05-07T14:02:20.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:02:20.654 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.654 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.654 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:20.654 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.654 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.654 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.655 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:02:20.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.655 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:20.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:20.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:02:20.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:02:20.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:02:20.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:02:20.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:02:20.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:02:20.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:02:20.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:02:20.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.641306151999999, 2024-05-07T14:02:20.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:20.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:02:20.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:02:20.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:02:20.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:02:20.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:02:20.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:02:20.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:02:20.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:02:20.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:02:20.666 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.666 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.539056438000003, 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036480649999999998, 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 231 2024-05-07T14:02:20.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.668 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:02:20.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:02:20.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125133+0000", 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.063e-06 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125143+0000", 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9769999999999995e-06 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125170+0000", 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7152999999999999e-05 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125184+0000", 2024-05-07T14:02:20.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4372999999999999e-05 2024-05-07T14:02:20.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125295+0000", 2024-05-07T14:02:20.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111036 2024-05-07T14:02:20.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125510+0000", 2024-05-07T14:02:20.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215102 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125920+0000", 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040954700000000001 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.127419+0000", 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001499261 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128635+0000", 2024-05-07T14:02:20.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001215818 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128718+0000", 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3048999999999997e-05 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128779+0000", 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0686000000000001e-05 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:235 6.0 e33/27 6:013d6c33:gc::gc.30:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.523599417, 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038113629999999999, 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140590+0000", 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140604+0000", 2024-05-07T14:02:20.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4324e-05 2024-05-07T14:02:20.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140640+0000", 2024-05-07T14:02:20.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6009e-05 2024-05-07T14:02:20.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140659+0000", 2024-05-07T14:02:20.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9340000000000001e-05 2024-05-07T14:02:20.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140815+0000", 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155329 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140868+0000", 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3455999999999998e-05 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144310+0000", 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034414239999999998 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144399+0000", 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9492000000000003e-05 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:400 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.473178020999995, 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039416900000000003, 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.677 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 400 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191010+0000", 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.09e-07 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191014+0000", 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999996e-06 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191024+0000", 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0274e-05 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191030+0000", 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.789e-06 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191085+0000", 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4741999999999999e-05 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191169+0000", 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4532999999999999e-05 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191383+0000", 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021415400000000001 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194408+0000", 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003024901 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194860+0000", 2024-05-07T14:02:20.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045153599999999999 2024-05-07T14:02:20.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194915+0000", 2024-05-07T14:02:20.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4737999999999997e-05 2024-05-07T14:02:20.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194951+0000", 2024-05-07T14:02:20.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6183999999999998e-05 2024-05-07T14:02:20.683 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.683 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.683 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.683 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:403 6.2 e33/27 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 33'4, mlcod=33'2)", 2024-05-07T14:02:20.683 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:02:20.684 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.470080340999999, 2024-05-07T14:02:20.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003750841, 2024-05-07T14:02:20.684 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.684 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.684 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.684 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:02:20.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:02:20.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194108+0000", 2024-05-07T14:02:20.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.051e-06 2024-05-07T14:02:20.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194116+0000", 2024-05-07T14:02:20.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1149999999999994e-06 2024-05-07T14:02:20.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194128+0000", 2024-05-07T14:02:20.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1972e-05 2024-05-07T14:02:20.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194135+0000", 2024-05-07T14:02:20.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1130000000000003e-06 2024-05-07T14:02:20.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194191+0000", 2024-05-07T14:02:20.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:02:20.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194218+0000", 2024-05-07T14:02:20.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6242e-05 2024-05-07T14:02:20.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197807+0000", 2024-05-07T14:02:20.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003589283 2024-05-07T14:02:20.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197858+0000", 2024-05-07T14:02:20.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0572999999999998e-05 2024-05-07T14:02:20.690 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.690 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.690 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.690 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:415 6.7 e33/27 6:e622f76a:gc::gc.20:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:20.691 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:20.691 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.462378498999996, 2024-05-07T14:02:20.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044669840000000002, 2024-05-07T14:02:20.691 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.691 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.691 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.691 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:20.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:20.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:20.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1799999999999995e-07 2024-05-07T14:02:20.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201814+0000", 2024-05-07T14:02:20.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4170000000000002e-06 2024-05-07T14:02:20.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201824+0000", 2024-05-07T14:02:20.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0217999999999999e-05 2024-05-07T14:02:20.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201838+0000", 2024-05-07T14:02:20.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3723000000000001e-05 2024-05-07T14:02:20.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201890+0000", 2024-05-07T14:02:20.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2320000000000001e-05 2024-05-07T14:02:20.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201906+0000", 2024-05-07T14:02:20.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5894999999999999e-05 2024-05-07T14:02:20.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206242+0000", 2024-05-07T14:02:20.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043366489999999997 2024-05-07T14:02:20.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206276+0000", 2024-05-07T14:02:20.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:432 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.451132919000003, 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045128019999999998, 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.697 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 432 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213055+0000", 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7000000000000005e-07 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213058+0000", 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0369999999999999e-06 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213066+0000", 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3680000000000002e-06 2024-05-07T14:02:20.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213084+0000", 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7946999999999999e-05 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213127+0000", 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2673999999999998e-05 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213222+0000", 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5488000000000005e-05 2024-05-07T14:02:20.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213412+0000", 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000189307 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.214754+0000", 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001342069 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217447+0000", 2024-05-07T14:02:20.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026931250000000002 2024-05-07T14:02:20.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217521+0000", 2024-05-07T14:02:20.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3997000000000003e-05 2024-05-07T14:02:20.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217567+0000", 2024-05-07T14:02:20.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6220000000000001e-05 2024-05-07T14:02:20.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.702 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:430 6.7 e33/27 6:e1cdb60d:reshard::reshard.0000000008:head v 33'9, mlcod=33'6)", 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.451086435999997, 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043702330000000003, 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:20.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0400000000000005e-07 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213107+0000", 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5740000000000003e-06 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213117+0000", 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8349999999999999e-06 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213122+0000", 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5140000000000001e-06 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213169+0000", 2024-05-07T14:02:20.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6551000000000002e-05 2024-05-07T14:02:20.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213198+0000", 2024-05-07T14:02:20.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:02:20.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217415+0000", 2024-05-07T14:02:20.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042171090000000001 2024-05-07T14:02:20.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217471+0000", 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5766000000000001e-05 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:480 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.422622281000002, 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052104459999999997, 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.707 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 480 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6199999999999997e-07 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241570+0000", 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2479999999999998e-06 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241580+0000", 2024-05-07T14:02:20.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8719999999999997e-06 2024-05-07T14:02:20.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241584+0000", 2024-05-07T14:02:20.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7210000000000002e-06 2024-05-07T14:02:20.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241629+0000", 2024-05-07T14:02:20.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4465000000000002e-05 2024-05-07T14:02:20.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241671+0000", 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2370999999999998e-05 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241772+0000", 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101048 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.243876+0000", 2024-05-07T14:02:20.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021036789999999998 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246710+0000", 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028339060000000002 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246747+0000", 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7061000000000003e-05 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246775+0000", 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8413000000000001e-05 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:499 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.411741559999996, 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050166450000000001, 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.713 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.714 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.714 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 499 2024-05-07T14:02:20.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.714 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:20.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:20.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4300000000000002e-07 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252451+0000", 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1290000000000004e-06 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252463+0000", 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1238e-05 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252470+0000", 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2019999999999998e-06 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252534+0000", 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4178999999999997e-05 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252706+0000", 2024-05-07T14:02:20.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017197 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252871+0000", 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016508199999999999 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254444+0000", 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001573112 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257407+0000", 2024-05-07T14:02:20.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029630989999999999 2024-05-07T14:02:20.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257437+0000", 2024-05-07T14:02:20.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0009999999999999e-05 2024-05-07T14:02:20.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257462+0000", 2024-05-07T14:02:20.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4780999999999999e-05 2024-05-07T14:02:20.718 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.718 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:500 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.411455457000002, 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046354220000000002, 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.719 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 500 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252733+0000", 2024-05-07T14:02:20.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9399999999999993e-07 2024-05-07T14:02:20.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252738+0000", 2024-05-07T14:02:20.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6779999999999997e-06 2024-05-07T14:02:20.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252750+0000", 2024-05-07T14:02:20.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1882000000000001e-05 2024-05-07T14:02:20.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252758+0000", 2024-05-07T14:02:20.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0649999999999999e-06 2024-05-07T14:02:20.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252811+0000", 2024-05-07T14:02:20.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2859000000000003e-05 2024-05-07T14:02:20.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252870+0000", 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8956000000000003e-05 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252992+0000", 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122275 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254326+0000", 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013334449999999999 2024-05-07T14:02:20.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257254+0000", 2024-05-07T14:02:20.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029284039999999999 2024-05-07T14:02:20.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257316+0000", 2024-05-07T14:02:20.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1348999999999998e-05 2024-05-07T14:02:20.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257367+0000", 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1514999999999997e-05 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:510 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.405372818000004, 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041639090000000004, 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.725 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.726 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.726 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 510 2024-05-07T14:02:20.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.726 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:02:20.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:02:20.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258815+0000", 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258819+0000", 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0090000000000001e-06 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258828+0000", 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2529999999999993e-06 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258833+0000", 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7219999999999999e-06 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258870+0000", 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6368000000000001e-05 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258915+0000", 2024-05-07T14:02:20.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.528e-05 2024-05-07T14:02:20.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:20.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.259016+0000", 2024-05-07T14:02:20.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010074200000000001 2024-05-07T14:02:20.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.260655+0000", 2024-05-07T14:02:20.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016394999999999999 2024-05-07T14:02:20.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262752+0000", 2024-05-07T14:02:20.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002096531 2024-05-07T14:02:20.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262871+0000", 2024-05-07T14:02:20.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119645 2024-05-07T14:02:20.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262978+0000", 2024-05-07T14:02:20.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010695400000000001 2024-05-07T14:02:20.731 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.731 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.731 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.731 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:552 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.731 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:02:20.731 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.373613316000004, 2024-05-07T14:02:20.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042166790000000001, 2024-05-07T14:02:20.732 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.732 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.732 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.732 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.732 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.732 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.732 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 552 2024-05-07T14:02:20.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.732 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:02:20.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:02:20.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290575+0000", 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.85e-07 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290578+0000", 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999999e-06 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290587+0000", 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.268e-06 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290592+0000", 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7029999999999997e-06 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290694+0000", 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101841 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290840+0000", 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014613899999999999 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:20.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.291137+0000", 2024-05-07T14:02:20.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029714800000000001 2024-05-07T14:02:20.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292561+0000", 2024-05-07T14:02:20.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014235020000000001 2024-05-07T14:02:20.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294568+0000", 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020076540000000002 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294692+0000", 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012394500000000001 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294790+0000", 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8194000000000002e-05 2024-05-07T14:02:20.737 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:553 6.f e33/27 6:f24cb4a8:gc::gc.31:head v 33'4, mlcod=33'2)", 2024-05-07T14:02:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.371354457999999, 2024-05-07T14:02:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043350139999999999, 2024-05-07T14:02:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.738 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:20.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:20.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2900000000000004e-07 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292838+0000", 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5560000000000001e-06 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292847+0000", 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8619999999999992e-06 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292851+0000", 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9010000000000002e-06 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292922+0000", 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0827000000000005e-05 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292973+0000", 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0492999999999999e-05 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297114+0000", 2024-05-07T14:02:20.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041408970000000002 2024-05-07T14:02:20.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297168+0000", 2024-05-07T14:02:20.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3949000000000001e-05 2024-05-07T14:02:20.742 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.742 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.743 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.743 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:686 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.743 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:20.743 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.261608573000004, 2024-05-07T14:02:20.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046254349999999998, 2024-05-07T14:02:20.743 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.743 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.743 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 686 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:20.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402581+0000", 2024-05-07T14:02:20.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:02:20.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402592+0000", 2024-05-07T14:02:20.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0984e-05 2024-05-07T14:02:20.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402619+0000", 2024-05-07T14:02:20.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7583e-05 2024-05-07T14:02:20.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402633+0000", 2024-05-07T14:02:20.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3553000000000001e-05 2024-05-07T14:02:20.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402699+0000", 2024-05-07T14:02:20.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6013000000000006e-05 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402792+0000", 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3455999999999994e-05 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402928+0000", 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013596800000000001 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.403918+0000", 2024-05-07T14:02:20.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00099017000000000007 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407144+0000", 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032257449999999999 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407180+0000", 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5462e-05 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407204+0000", 2024-05-07T14:02:20.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4247999999999999e-05 2024-05-07T14:02:20.749 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.749 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.749 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.749 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.749 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:02:20.749 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.992696995000003, 2024-05-07T14:02:20.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003355448, 2024-05-07T14:02:20.749 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.750 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.750 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.750 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.750 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.750 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.750 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 826 2024-05-07T14:02:20.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.750 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:02:20.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671493+0000", 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-06 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671506+0000", 2024-05-07T14:02:20.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2746e-05 2024-05-07T14:02:20.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671542+0000", 2024-05-07T14:02:20.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6162999999999999e-05 2024-05-07T14:02:20.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671557+0000", 2024-05-07T14:02:20.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4786999999999999e-05 2024-05-07T14:02:20.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671705+0000", 2024-05-07T14:02:20.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000147792 2024-05-07T14:02:20.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671872+0000", 2024-05-07T14:02:20.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016705499999999999 2024-05-07T14:02:20.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:20.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.672101+0000", 2024-05-07T14:02:20.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022892999999999999 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.673101+0000", 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001000775 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674701+0000", 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016000599999999999 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674795+0000", 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3653000000000006e-05 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674846+0000", 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0473000000000003e-05 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:868 6.f e33/27 6:f6792a7a:::obj_delete_at_hint.0000000097:head v 33'10, mlcod=33'8)", 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.893292509000005, 2024-05-07T14:02:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033639339999999998, 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770897+0000", 2024-05-07T14:02:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9700000000000002e-06 2024-05-07T14:02:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770909+0000", 2024-05-07T14:02:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2034e-05 2024-05-07T14:02:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770937+0000", 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.796e-05 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770954+0000", 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7555999999999999e-05 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771084+0000", 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013033599999999999 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771136+0000", 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1925999999999997e-05 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774168+0000", 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030316200000000001 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774259+0000", 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0532000000000007e-05 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.829302315999996, 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035607859999999998, 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 895 2024-05-07T14:02:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834888+0000", 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.41e-06 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834899+0000", 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0987e-05 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834929+0000", 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9706e-05 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834943+0000", 2024-05-07T14:02:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4354e-05 2024-05-07T14:02:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835100+0000", 2024-05-07T14:02:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156582 2024-05-07T14:02:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835499+0000", 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000399214 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.836052+0000", 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00055334500000000001 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.837279+0000", 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012266270000000001 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838177+0000", 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089768699999999999 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838332+0000", 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155155 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838446+0000", 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113719 2024-05-07T14:02:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 72.821774786999995, 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033546700000000001, 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 898 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842414+0000", 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.863e-06 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842425+0000", 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0533000000000001e-05 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842450+0000", 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5259999999999999e-05 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842463+0000", 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3373000000000001e-05 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842599+0000", 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013549600000000001 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842936+0000", 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033763400000000001 2024-05-07T14:02:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.843484+0000", 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054733899999999999 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.844749+0000", 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012656639999999999 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845499+0000", 2024-05-07T14:02:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074904400000000003 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845646+0000", 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014709900000000001 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845767+0000", 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121365 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:20.773 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:20.774 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:02:20.775 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:20.775 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:20.775 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:20.776 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:20.776 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:20.776 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:20.777 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:20.777 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:20.777 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:20.777 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:20.778 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:20.785+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:20.787 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:20.787 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:20.805 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:20.805 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:20.822 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:20.876 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:20.885+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:20.910 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:20.910 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:20.924 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:02:20.975 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:20.985+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:21.076 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:21.089+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:21.093 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:21.093 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:21.107 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:02:21.177 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:21.189+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:21.269 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:21.269 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:21.278 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:21.289+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:21.283 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:02:21.379 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:21.389+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:21.449 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:21.449 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:21.466 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:21.508 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:21.521+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:21.580 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:21.589+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:21.607 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:02:21.632 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:21.632 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:21.647 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:21.692 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:21.705+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:21.765 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:21.765 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:21.780 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:21.824 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:21.837+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:21.883 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:21.893+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:21.950 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:21.950 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:21.964 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:22.008 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:22.021+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:22.086 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:22.097+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:22.131 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:22.131 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:22.146 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:22.187 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:22.197+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:22.288 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:22.297+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:22.305 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:22.305 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:22.320 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:22.389 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:22.401+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:22.442 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:22.443 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:22.458 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:22.490 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:22.501+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:22.549 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:02:22.585 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:22.585 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:22.599 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:02:22.612 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:22.625+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:22.691 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:22.701+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:22.723 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:22.723 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:22.737 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:02:22.792 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:22.801+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:22.843 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:02:22.892 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:22.901+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:22.910 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:22.910 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:22.931 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:02:22.993 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:23.005+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:23.044 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:23.045 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:23.075 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:23.075 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:23.094 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:23.105+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:23.105 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:23.106 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:23.136 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:23.136 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:23.150 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:23.151 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:23.167 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:02:23.169 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:23.170 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:23.202 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:23.202 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:23.202 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:23.213+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:23.240 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:23.241 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:23.273 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:23.274 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:23.296 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:23.305+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:23.338 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:129 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'87, mlcod=17'85)", 2024-05-07T14:02:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.050760396000001, 2024-05-07T14:02:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034674469999999998, 2024-05-07T14:02:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299075+0000", 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.736e-06 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299087+0000", 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2067e-05 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299122+0000", 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4643e-05 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299141+0000", 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9224000000000001e-05 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299323+0000", 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018190400000000001 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299385+0000", 2024-05-07T14:02:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2126999999999997e-05 2024-05-07T14:02:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302462+0000", 2024-05-07T14:02:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030768330000000002 2024-05-07T14:02:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302541+0000", 2024-05-07T14:02:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8912999999999995e-05 2024-05-07T14:02:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:131 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'89, mlcod=17'85)", 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.049427722999994, 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038759010000000002, 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300407+0000", 2024-05-07T14:02:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0299999999999998e-07 2024-05-07T14:02:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300577+0000", 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000170259 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300592+0000", 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4707e-05 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300601+0000", 2024-05-07T14:02:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999995e-06 2024-05-07T14:02:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301133+0000", 2024-05-07T14:02:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053150199999999999 2024-05-07T14:02:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301186+0000", 2024-05-07T14:02:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.342e-05 2024-05-07T14:02:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304217+0000", 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030307429999999998 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304282+0000", 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5316999999999998e-05 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:132 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'90, mlcod=17'85)", 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.048375628000002, 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041397580000000003, 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301459+0000", 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.47e-07 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301470+0000", 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0933e-05 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301483+0000", 2024-05-07T14:02:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2427e-05 2024-05-07T14:02:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301491+0000", 2024-05-07T14:02:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6130000000000004e-06 2024-05-07T14:02:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302683+0000", 2024-05-07T14:02:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011919980000000001 2024-05-07T14:02:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302741+0000", 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7963000000000001e-05 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305494+0000", 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027531420000000001 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305598+0000", 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103835 2024-05-07T14:02:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:134 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'92, mlcod=17'85)", 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.046089730999995, 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037081470000000002, 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303747+0000", 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303805+0000", 2024-05-07T14:02:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8554999999999998e-05 2024-05-07T14:02:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303829+0000", 2024-05-07T14:02:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3799999999999999e-05 2024-05-07T14:02:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303871+0000", 2024-05-07T14:02:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2079999999999997e-05 2024-05-07T14:02:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304359+0000", 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048822999999999998 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304415+0000", 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5405999999999998e-05 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307388+0000", 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029728070000000001 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307452+0000", 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4789000000000006e-05 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:137 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'95, mlcod=17'88)", 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.042465829999998, 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004097552, 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307370+0000", 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3939999999999999e-06 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307454+0000", 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4639000000000001e-05 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307474+0000", 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0242999999999999e-05 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307485+0000", 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0710000000000001e-05 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307538+0000", 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2623000000000001e-05 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307566+0000", 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.781e-05 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311405+0000", 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038392299999999999 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311466+0000", 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0903000000000003e-05 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:138 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'96, mlcod=17'93)", 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.039169692000002, 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034036700000000001, 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310666+0000", 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310680+0000", 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4047e-05 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310715+0000", 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4826000000000002e-05 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310739+0000", 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3796000000000001e-05 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310862+0000", 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123132 2024-05-07T14:02:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310896+0000", 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.43e-05 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313965+0000", 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030685959999999998 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314068+0000", 2024-05-07T14:02:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102963 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.038264009000002, 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:02:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:02:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.037357612999998, 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:02:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.035944994000005, 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:143 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'101, mlcod=17'98)", 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.028052224999996, 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036609120000000001, 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321783+0000", 2024-05-07T14:02:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3599999999999999e-06 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321905+0000", 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121923 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321929+0000", 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4295999999999999e-05 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321945+0000", 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5773999999999998e-05 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322070+0000", 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012457899999999999 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322101+0000", 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1213000000000001e-05 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325342+0000", 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032410579999999998 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325443+0000", 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100709 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:144 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-05-07T14:02:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.026983482999995, 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003406484, 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322852+0000", 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8369999999999999e-06 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323022+0000", 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016984199999999999 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323048+0000", 2024-05-07T14:02:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5752999999999999e-05 2024-05-07T14:02:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323071+0000", 2024-05-07T14:02:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.266e-05 2024-05-07T14:02:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323188+0000", 2024-05-07T14:02:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011728200000000001 2024-05-07T14:02:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323224+0000", 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6380000000000001e-05 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326163+0000", 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029386170000000001 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326257+0000", 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4112999999999998e-05 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.330652569999998, 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034691510000000002, 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 206 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019184+0000", 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6170000000000001e-06 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019198+0000", 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4113e-05 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019229+0000", 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0423e-05 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019244+0000", 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5047e-05 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019478+0000", 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000234398 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019723+0000", 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024469500000000001 2024-05-07T14:02:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.020149+0000", 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042592999999999998 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.021776+0000", 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001627688 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022453+0000", 2024-05-07T14:02:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00067671500000000004 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022551+0000", 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8312000000000003e-05 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022651+0000", 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9213e-05 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.303363390000001, 2024-05-07T14:02:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038721300000000001, 2024-05-07T14:02:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 210 2024-05-07T14:02:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046474+0000", 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.517e-06 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046487+0000", 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3113e-05 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046521+0000", 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3556000000000002e-05 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046537+0000", 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.643e-05 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046651+0000", 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011368500000000001 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046873+0000", 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221802 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.047335+0000", 2024-05-07T14:02:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046227300000000002 2024-05-07T14:02:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.048993+0000", 2024-05-07T14:02:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016576679999999999 2024-05-07T14:02:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050186+0000", 2024-05-07T14:02:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001193284 2024-05-07T14:02:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050273+0000", 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7189999999999997e-05 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050343+0000", 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9611999999999997e-05 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.273856644000006, 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034712530000000001, 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 218 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075980+0000", 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.774e-06 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075992+0000", 2024-05-07T14:02:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2283000000000001e-05 2024-05-07T14:02:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076024+0000", 2024-05-07T14:02:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1242999999999999e-05 2024-05-07T14:02:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076038+0000", 2024-05-07T14:02:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4663e-05 2024-05-07T14:02:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076199+0000", 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160865 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076539+0000", 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033995800000000001 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.077234+0000", 2024-05-07T14:02:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000694581 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.078996+0000", 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001762633 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079276+0000", 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027998399999999999 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079380+0000", 2024-05-07T14:02:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103266 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079449+0000", 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9003000000000003e-05 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.210274511999998, 2024-05-07T14:02:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:02:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:02:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.177163854, 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.411 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:02:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:02:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:02:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:02:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:02:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:02:23.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:02:23.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.170253935000005, 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041680119999999996, 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:23.417 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:23.418 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:23.418 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 382 2024-05-07T14:02:23.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.418 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:23.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:23.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179581+0000", 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179585+0000", 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4800000000000003e-06 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179598+0000", 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2322e-05 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179604+0000", 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.823e-06 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179657+0000", 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3937000000000002e-05 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179714+0000", 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6165000000000002e-05 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179830+0000", 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011632 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.180515+0000", 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00068531400000000002 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:23.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183667+0000", 2024-05-07T14:02:23.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031522009999999999 2024-05-07T14:02:23.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183704+0000", 2024-05-07T14:02:23.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6925999999999998e-05 2024-05-07T14:02:23.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183748+0000", 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3618999999999997e-05 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:499 6.13 e33/27 6:cedbb205:::obj_delete_at_hint.0000000017:head v 33'4, mlcod=33'1)", 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.096881280999995, 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043323679999999996, 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.423 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252954+0000", 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.71e-07 2024-05-07T14:02:23.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252960+0000", 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.46e-06 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252974+0000", 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4249e-05 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252982+0000", 2024-05-07T14:02:23.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:02:23.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253055+0000", 2024-05-07T14:02:23.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3162000000000002e-05 2024-05-07T14:02:23.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253075+0000", 2024-05-07T14:02:23.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9451999999999999e-05 2024-05-07T14:02:23.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257253+0000", 2024-05-07T14:02:23.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041781179999999998 2024-05-07T14:02:23.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257285+0000", 2024-05-07T14:02:23.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2075e-05 2024-05-07T14:02:23.427 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.427 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.427 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.427 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:550 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.061227099000007, 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035552140000000001, 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 550 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288608+0000", 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0529999999999999e-06 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288613+0000", 2024-05-07T14:02:23.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7060000000000003e-06 2024-05-07T14:02:23.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288624+0000", 2024-05-07T14:02:23.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1547e-05 2024-05-07T14:02:23.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288630+0000", 2024-05-07T14:02:23.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288734+0000", 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103872 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288884+0000", 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014987400000000001 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:23.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289167+0000", 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028341999999999999 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289813+0000", 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064550199999999995 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292082+0000", 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022696000000000001 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292120+0000", 2024-05-07T14:02:23.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7367999999999999e-05 2024-05-07T14:02:23.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292162+0000", 2024-05-07T14:02:23.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2568000000000003e-05 2024-05-07T14:02:23.433 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.433 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.433 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.433 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:667 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 75.965285065000003, 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050309150000000004, 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 667 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384550+0000", 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7000000000000003e-07 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:23.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384555+0000", 2024-05-07T14:02:23.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.135e-06 2024-05-07T14:02:23.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:23.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384565+0000", 2024-05-07T14:02:23.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0541e-05 2024-05-07T14:02:23.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:23.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384571+0000", 2024-05-07T14:02:23.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.857e-06 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384670+0000", 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8461999999999993e-05 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384822+0000", 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152039 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:23.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.385123+0000", 2024-05-07T14:02:23.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030070699999999999 2024-05-07T14:02:23.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:23.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.386099+0000", 2024-05-07T14:02:23.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097677300000000001 2024-05-07T14:02:23.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:23.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389495+0000", 2024-05-07T14:02:23.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033959139999999999 2024-05-07T14:02:23.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389530+0000", 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.472e-05 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389580+0000", 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9897e-05 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:23.439 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:23.441 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:02:23.441 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:23.453+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:23.542 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:23.553+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:23.643 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:23.653+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:23.653 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:23.653 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:23.653 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:23.653 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:23.671 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:02:23.745 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:23.757+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:23.846 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:23.857+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:23.880 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:23.881 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:23.881 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:23.881 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:23.881 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:23.897 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:02:23.947 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:23.957+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:24.048 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:24.057+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:24.070 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:24.070 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:24.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:24.070 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:24.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.071 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:24.071 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:24.071 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.096847764000003, 2024-05-07T14:02:24.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:02:24.071 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.071 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.071 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:24.071 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.071 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:02:24.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:02:24.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:02:24.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:02:24.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:02:24.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:02:24.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:02:24.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:02:24.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:02:24.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:02:24.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:24.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:02:24.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:02:24.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:02:24.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:02:24.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:02:24.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:02:24.076 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.076 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.076 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.076 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:24.076 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:24.076 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 80.049681892999999, 2024-05-07T14:02:24.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:02:24.077 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.077 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.077 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.077 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:24.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:02:24.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:02:24.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:02:24.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:02:24.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:02:24.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:02:24.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:02:24.081 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.081 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.081 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.081 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:24.081 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:24.081 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 79.949354173000003, 2024-05-07T14:02:24.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:02:24.081 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.081 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.082 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.082 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.082 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.082 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.082 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:02:24.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.082 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:24.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:02:24.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:02:24.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:02:24.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:02:24.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:02:24.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:02:24.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:02:24.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:02:24.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.046810116000003, 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:02:24.087 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.088 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.088 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.088 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.088 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.088 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.088 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:02:24.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.088 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:24.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:24.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:02:24.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:02:24.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:02:24.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:02:24.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:02:24.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:02:24.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:02:24.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:02:24.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:02:24.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:02:24.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:02:24.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:02:24.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:02:24.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:02:24.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:02:24.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:02:24.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:02:24.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:02:24.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:02:24.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:02:24.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:02:24.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:02:24.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.095 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.095 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.095 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:24.095 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.027500148000001, 2024-05-07T14:02:24.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:02:24.095 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.095 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.096 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.096 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.096 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.096 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.096 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:02:24.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.096 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:24.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:24.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:02:24.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:02:24.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:02:24.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:02:24.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:02:24.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:02:24.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:02:24.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:02:24.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:02:24.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:02:24.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:02:24.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:02:24.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:02:24.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:02:24.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:02:24.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:02:24.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:02:24.101 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.102 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.102 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.102 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.102 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:24.102 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.002133237999999, 2024-05-07T14:02:24.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:02:24.102 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.103 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.103 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.103 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.103 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.103 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.103 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:02:24.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.103 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:24.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:24.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:02:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:02:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:02:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:02:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:02:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:02:24.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:02:24.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:02:24.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:02:24.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:02:24.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:02:24.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:02:24.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.108 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.982343854000007, 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:02:24.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:02:24.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:02:24.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:02:24.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:02:24.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:02:24.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:02:24.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:02:24.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:02:24.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:02:24.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:02:24.114 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.114 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.114 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.949105493000005, 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:02:24.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:02:24.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:02:24.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:02:24.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:02:24.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:02:24.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:02:24.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:02:24.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:02:24.120 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.120 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.120 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.120 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.913744472000005, 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:24.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:24.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:02:24.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:02:24.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:02:24.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:02:24.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:02:24.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:02:24.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:24.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:02:24.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:02:24.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:02:24.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:02:24.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:02:24.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:02:24.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:02:24.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:02:24.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:02:24.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:02:24.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.127 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.127 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.127 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:24.127 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.889000906000007, 2024-05-07T14:02:24.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:02:24.127 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.127 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.127 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.127 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.128 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.128 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.128 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:02:24.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.128 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:24.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:24.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:02:24.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:02:24.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:02:24.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:02:24.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:02:24.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:02:24.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:02:24.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:02:24.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:02:24.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:02:24.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.133 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.133 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.778124503000001, 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:24.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:24.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:02:24.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:02:24.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:02:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:02:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:02:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:02:24.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:02:24.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:02:24.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:02:24.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:02:24.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:02:24.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.721960554000006, 2024-05-07T14:02:24.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:02:24.140 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.140 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.140 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.140 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.140 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.140 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.140 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:02:24.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.140 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:24.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:02:24.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:02:24.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:02:24.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:02:24.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:02:24.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:02:24.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:02:24.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.706075369000004, 2024-05-07T14:02:24.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:02:24.146 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.146 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.146 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.146 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.146 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.146 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.146 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:02:24.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.146 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:02:24.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:02:24.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:02:24.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:02:24.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:02:24.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:02:24.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:02:24.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:02:24.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:02:24.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:02:24.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:24.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:02:24.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:02:24.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:02:24.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:02:24.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:02:24.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:02:24.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.152 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.152 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:24.152 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.456709117000003, 2024-05-07T14:02:24.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:02:24.152 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.152 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.152 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.152 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.152 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.152 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.152 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:02:24.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.153 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:24.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:24.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:02:24.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:02:24.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:02:24.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:02:24.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:02:24.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:02:24.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:02:24.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:02:24.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:02:24.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:02:24.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:02:24.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:02:24.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:02:24.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.395336294000003, 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.159 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:02:24.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:02:24.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:02:24.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:02:24.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:02:24.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:02:24.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:02:24.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:24.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:02:24.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:02:24.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:02:24.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:02:24.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:02:24.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:02:24.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:02:24.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:02:24.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:02:24.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:02:24.166 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.167 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.167 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.167 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.167 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:24.167 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.199547952000003, 2024-05-07T14:02:24.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:02:24.168 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.168 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.168 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.168 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.168 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.169 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.169 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:02:24.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.169 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:24.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:24.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:02:24.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:24.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:02:24.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:02:24.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:02:24.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:02:24.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:02:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:02:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:02:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:02:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:02:24.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:02:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:02:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:02:24.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:02:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:02:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:02:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:02:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:02:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:02:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:02:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:02:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.195244501999994, 2024-05-07T14:02:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003023937, 2024-05-07T14:02:24.181 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.182 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 918 2024-05-07T14:02:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:24.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886558+0000", 2024-05-07T14:02:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1229999999999998e-06 2024-05-07T14:02:24.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886569+0000", 2024-05-07T14:02:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1497e-05 2024-05-07T14:02:24.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886600+0000", 2024-05-07T14:02:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0809999999999998e-05 2024-05-07T14:02:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886618+0000", 2024-05-07T14:02:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7799e-05 2024-05-07T14:02:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886736+0000", 2024-05-07T14:02:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118276 2024-05-07T14:02:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886951+0000", 2024-05-07T14:02:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021467200000000001 2024-05-07T14:02:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.887437+0000", 2024-05-07T14:02:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048624900000000001 2024-05-07T14:02:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.888687+0000", 2024-05-07T14:02:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012498310000000001 2024-05-07T14:02:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889318+0000", 2024-05-07T14:02:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063122199999999997 2024-05-07T14:02:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889463+0000", 2024-05-07T14:02:24.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144769 2024-05-07T14:02:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889580+0000", 2024-05-07T14:02:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011668899999999999 2024-05-07T14:02:24.194 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.195 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.164243777999999, 2024-05-07T14:02:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:02:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.196 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:02:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:02:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:02:24.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:02:24.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:02:24.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:02:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:02:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:02:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:02:24.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:02:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:02:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:02:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:02:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:02:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:02:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:02:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:02:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:02:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:02:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:02:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:02:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:02:24.204 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.159358886000007, 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.205 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:02:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:02:24.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:02:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:02:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:02:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:02:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:02:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:02:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:02:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:02:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:02:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:02:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.127437514999997, 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:02:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:02:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:02:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:02:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:02:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:02:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:02:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.217 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:24.218 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:02:24.219 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:24.229+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:24.319 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:24.329+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:24.387 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:24.388 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:24.388 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:24.388 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:24.404 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:02:24.449 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:24.461+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:24.521 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:24.533+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:24.571 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:02:24.572 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:24.572 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:24.573 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:24.573 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:24.573 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:24.591 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:02:24.633 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:24.645+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:24.724 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:24.733+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:24.804 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:24.804 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:24.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:24.804 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:24.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.804 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:40 5.8 5:168cc6a2:::zonegroup_info.7881bf19-2c91-49be-82bb-722579314d1c:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:24.804 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:24.804 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.773264909000005, 2024-05-07T14:02:24.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002658582, 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 40 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:24.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042176+0000", 2024-05-07T14:02:24.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7719999999999999e-06 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042186+0000", 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0020000000000001e-05 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042209+0000", 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3224e-05 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042220+0000", 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1153e-05 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042358+0000", 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137389 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042594+0000", 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023630100000000001 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:24.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042900+0000", 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030576799999999999 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044463+0000", 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015627130000000001 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044675+0000", 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021186999999999999 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044768+0000", 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3046000000000003e-05 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044833+0000", 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5326000000000004e-05 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:24.810 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 80.778710024000006, 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025872120000000002, 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 52 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036732+0000", 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4980000000000001e-06 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036744+0000", 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2269999999999999e-05 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036772+0000", 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8002000000000001e-05 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036817+0000", 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4608999999999999e-05 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036946+0000", 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012988400000000001 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037184+0000", 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000237178 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037405+0000", 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221418 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.038548+0000", 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011433540000000001 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039179+0000", 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063016999999999999 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039231+0000", 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2434e-05 2024-05-07T14:02:24.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039316+0000", 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5395000000000005e-05 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.670127562000005, 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.816 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:24.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:02:24.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:02:24.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:02:24.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:02:24.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:02:24.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:02:24.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:02:24.822 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.822 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.822 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.822 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.822 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:24.822 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.657708620999998, 2024-05-07T14:02:24.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:02:24.822 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.822 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:02:24.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:02:24.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:02:24.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:02:24.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:02:24.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.653828899000004, 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.828 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:24.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:02:24.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:02:24.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:02:24.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:02:24.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:02:24.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:02:24.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:24.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:02:24.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:02:24.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:02:24.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.523173396000004, 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.834 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:02:24.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:02:24.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:02:24.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:24.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:02:24.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:02:24.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:02:24.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:02:24.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:02:24.839 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.516006074000003, 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.840 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:02:24.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:02:24.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:02:24.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:02:24.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:02:24.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:02:24.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.845 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.225473386000004, 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:24.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:02:24.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.160391992000001, 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025880500000000002, 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.850 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 819 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:24.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655049+0000", 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6640000000000001e-06 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655057+0000", 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5639999999999997e-06 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655082+0000", 2024-05-07T14:02:24.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4119999999999999e-05 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655093+0000", 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1598e-05 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655273+0000", 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017975599999999999 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655432+0000", 2024-05-07T14:02:24.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000158682 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655720+0000", 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028791400000000001 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.656823+0000", 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001103435 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657483+0000", 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000659828 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657571+0000", 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7756000000000005e-05 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657635+0000", 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4733000000000005e-05 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.855 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.856 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.856 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:24.856 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.108115759, 2024-05-07T14:02:24.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028535079999999998, 2024-05-07T14:02:24.856 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.856 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.856 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.856 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.856 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.856 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.856 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 841 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707326+0000", 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707338+0000", 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2036e-05 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707367+0000", 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8816999999999999e-05 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707382+0000", 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4912999999999999e-05 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707523+0000", 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014165599999999999 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707748+0000", 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000224315 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.708055+0000", 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030739800000000001 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.709147+0000", 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001091788 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710030+0000", 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088367000000000003 2024-05-07T14:02:24.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710114+0000", 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3936000000000004e-05 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710177+0000", 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2675999999999994e-05 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.104449220000006, 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026153460000000002, 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 843 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710992+0000", 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.666e-06 2024-05-07T14:02:24.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711000+0000", 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.977e-06 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711020+0000", 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.033e-05 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711030+0000", 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9790000000000005e-06 2024-05-07T14:02:24.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711133+0000", 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102563 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711256+0000", 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012337599999999999 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711555+0000", 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029948699999999997 2024-05-07T14:02:24.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.712654+0000", 2024-05-07T14:02:24.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001098819 2024-05-07T14:02:24.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713451+0000", 2024-05-07T14:02:24.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000796424 2024-05-07T14:02:24.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713541+0000", 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9981999999999993e-05 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713605+0000", 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4743e-05 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:24.867 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.094993103999997, 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027995160000000002, 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 847 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720448+0000", 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720460+0000", 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1157e-05 2024-05-07T14:02:24.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720490+0000", 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0960000000000002e-05 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720507+0000", 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6477000000000002e-05 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720681+0000", 2024-05-07T14:02:24.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017396800000000001 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720897+0000", 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215775 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.721203+0000", 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030621499999999998 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.722485+0000", 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012818599999999999 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723091+0000", 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060651499999999996 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723182+0000", 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0692999999999994e-05 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723246+0000", 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3643e-05 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.091225754999996, 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.873 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.874 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.874 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.874 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.874 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:02:24.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.874 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:24.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:02:24.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:02:24.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.045512359, 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.879 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:02:24.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:02:24.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 77.039235621000003, 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.885 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:02:24.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:02:24.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:02:24.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:02:24.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:02:24.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:02:24.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:02:24.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:02:24.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:02:24.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:02:24.890 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.890 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.890 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.890 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.952722500999997, 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028016680000000002, 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 907 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862719+0000", 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862733+0000", 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3067e-05 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862763+0000", 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0926000000000002e-05 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862779+0000", 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5787e-05 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862924+0000", 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014509899999999999 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863160+0000", 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000235701 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863523+0000", 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000362567 2024-05-07T14:02:24.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.864872+0000", 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00134954 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865350+0000", 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000478009 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865437+0000", 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6712999999999995e-05 2024-05-07T14:02:24.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865518+0000", 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1493000000000001e-05 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.948993213999998, 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027054290000000001, 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.896 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 909 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866448+0000", 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866459+0000", 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1207e-05 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866491+0000", 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362999999999998e-05 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866506+0000", 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4790000000000001e-05 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866632+0000", 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000126422 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866761+0000", 2024-05-07T14:02:24.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128832 2024-05-07T14:02:24.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:24.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.867037+0000", 2024-05-07T14:02:24.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027612200000000001 2024-05-07T14:02:24.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.868118+0000", 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001080941 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869004+0000", 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088632000000000001 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869081+0000", 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7195999999999997e-05 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869151+0000", 2024-05-07T14:02:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0066000000000003e-05 2024-05-07T14:02:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.854144414999993, 2024-05-07T14:02:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:02:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:02:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:02:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.840975060999995, 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027821920000000002, 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 955 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974466+0000", 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0999999999999998e-06 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974480+0000", 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3876999999999999e-05 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974510+0000", 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0273e-05 2024-05-07T14:02:24.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974525+0000", 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.485e-05 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974618+0000", 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2359000000000001e-05 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974822+0000", 2024-05-07T14:02:24.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000204148 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.975126+0000", 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030382800000000002 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976565+0000", 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014395160000000001 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976963+0000", 2024-05-07T14:02:24.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00039772700000000001 2024-05-07T14:02:24.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977128+0000", 2024-05-07T14:02:24.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165508 2024-05-07T14:02:24.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977246+0000", 2024-05-07T14:02:24.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011800599999999999 2024-05-07T14:02:24.913 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.913 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.837059498000002, 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027683989999999999, 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:24.914 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 957 2024-05-07T14:02:24.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.915 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:24.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:24.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:24.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:24.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:24.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:24.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978382+0000", 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.95e-06 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978393+0000", 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.084e-05 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978424+0000", 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1022999999999998e-05 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:24.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978441+0000", 2024-05-07T14:02:24.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7782999999999999e-05 2024-05-07T14:02:24.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:24.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978565+0000", 2024-05-07T14:02:24.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012348900000000001 2024-05-07T14:02:24.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:24.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978794+0000", 2024-05-07T14:02:24.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000229335 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.979262+0000", 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046826700000000002 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.980470+0000", 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012071899999999999 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:24.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981002+0000", 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053222299999999996 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981086+0000", 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4073000000000006e-05 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981148+0000", 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2225999999999997e-05 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.919 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.920 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:24.920 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:24.920 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:24.920 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-07T14:02:24.920 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-07T14:02:24.921 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:24.933+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:24.922 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:02:25.022 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:25.033+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:25.123 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:25.133+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:25.135 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:25.136 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:25.136 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:25.136 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:25.154 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:02:25.224 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:25.237+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:25.299 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:02:25.344 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:25.357+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:25.364 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:25.364 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:25.364 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:25.364 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:25.364 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:25.383 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:02:25.425 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:25.437+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:25.496 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:25.496 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:25.526 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:25.537+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:25.526 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:25.526 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:25.556 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:25.557 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.0 to 1 (10000) 2024-05-07T14:02:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:02:25.589 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:25.609 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-07T14:02:25.609 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:25.609 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:25.624 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:25.624 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:25.626 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:25.637+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:25.631 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:02:25.656 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:25.686 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:25.686 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:25.719 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:25.720 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:25.727 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:25.737+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:25.766 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:25.766 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:25.780 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:02:25.828 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:25.841+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:25.901 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:25.902 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:25.915 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:02:25.956 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:25.969+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:26.030 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:26.041+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:26.081 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:26.082 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:26.096 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:02:26.144 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:26.157+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:26.221 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:26.221 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:26.231 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:26.241+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:26.235 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:26.332 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:26.341+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:26.397 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:26.398 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:26.411 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:26.433 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:26.445+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:26.531 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:26.531 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:26.534 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:26.545+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:26.546 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:26.583 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.1 to 1 (10000) 2024-05-07T14:02:26.606 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-07T14:02:26.648 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:26.661+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:26.711 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:26.711 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:26.727 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:26.735 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:26.745+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:26.836 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:26.849+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:26.850 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:26.850 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:26.864 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:26.938 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:26.949+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:26.982 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:26.982 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:26.997 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:27.044 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:27.057+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:27.139 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:27.149+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:27.164 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:27.164 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:27.179 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:27.240 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:27.253+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:27.304 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:27.304 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:27.318 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:02:27.364 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:27.377+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:27.441 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:27.441 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:27.443 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:27.453+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:27.455 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:02:27.543 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:27.553+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.2 to 1 (10000) 2024-05-07T14:02:27.613 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-07T14:02:27.618 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:02:27.625 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:27.625 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:27.647 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:02:27.647 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:27.657+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:27.743 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:02:27.745 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:27.757+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:27.846 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:27.857+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:27.881 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:27.881 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:27.899 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:02:27.952 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:27.953 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:27.953 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:27.965+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:27.987 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:27.987 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:28.023 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:28.023 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:28.047 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:28.057+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:28.054 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:28.054 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:28.094 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:28.117 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:129 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'87, mlcod=17'85)", 2024-05-07T14:02:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.830379804, 2024-05-07T14:02:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034674469999999998, 2024-05-07T14:02:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299075+0000", 2024-05-07T14:02:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.736e-06 2024-05-07T14:02:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299087+0000", 2024-05-07T14:02:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2067e-05 2024-05-07T14:02:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299122+0000", 2024-05-07T14:02:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4643e-05 2024-05-07T14:02:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299141+0000", 2024-05-07T14:02:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9224000000000001e-05 2024-05-07T14:02:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299323+0000", 2024-05-07T14:02:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018190400000000001 2024-05-07T14:02:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299385+0000", 2024-05-07T14:02:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2126999999999997e-05 2024-05-07T14:02:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302462+0000", 2024-05-07T14:02:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030768330000000002 2024-05-07T14:02:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302541+0000", 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8912999999999995e-05 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:131 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'89, mlcod=17'85)", 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.829047131, 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038759010000000002, 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300407+0000", 2024-05-07T14:02:28.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0299999999999998e-07 2024-05-07T14:02:28.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300577+0000", 2024-05-07T14:02:28.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000170259 2024-05-07T14:02:28.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300592+0000", 2024-05-07T14:02:28.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4707e-05 2024-05-07T14:02:28.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300601+0000", 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999995e-06 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301133+0000", 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053150199999999999 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301186+0000", 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.342e-05 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304217+0000", 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030307429999999998 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304282+0000", 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5316999999999998e-05 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.127 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:132 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'90, mlcod=17'85)", 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.827995036, 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041397580000000003, 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:28.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301459+0000", 2024-05-07T14:02:28.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.47e-07 2024-05-07T14:02:28.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301470+0000", 2024-05-07T14:02:28.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0933e-05 2024-05-07T14:02:28.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301483+0000", 2024-05-07T14:02:28.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2427e-05 2024-05-07T14:02:28.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301491+0000", 2024-05-07T14:02:28.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6130000000000004e-06 2024-05-07T14:02:28.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302683+0000", 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011919980000000001 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302741+0000", 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7963000000000001e-05 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305494+0000", 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027531420000000001 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305598+0000", 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103835 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:134 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'92, mlcod=17'85)", 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.825709139, 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037081470000000002, 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.132 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:28.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:28.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303747+0000", 2024-05-07T14:02:28.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:02:28.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303805+0000", 2024-05-07T14:02:28.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8554999999999998e-05 2024-05-07T14:02:28.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303829+0000", 2024-05-07T14:02:28.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3799999999999999e-05 2024-05-07T14:02:28.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303871+0000", 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2079999999999997e-05 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304359+0000", 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048822999999999998 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304415+0000", 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5405999999999998e-05 2024-05-07T14:02:28.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307388+0000", 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029728070000000001 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307452+0000", 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4789000000000006e-05 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:137 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'95, mlcod=17'88)", 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.822085238, 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004097552, 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:28.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307370+0000", 2024-05-07T14:02:28.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3939999999999999e-06 2024-05-07T14:02:28.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307454+0000", 2024-05-07T14:02:28.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4639000000000001e-05 2024-05-07T14:02:28.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307474+0000", 2024-05-07T14:02:28.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0242999999999999e-05 2024-05-07T14:02:28.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307485+0000", 2024-05-07T14:02:28.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0710000000000001e-05 2024-05-07T14:02:28.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307538+0000", 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2623000000000001e-05 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307566+0000", 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.781e-05 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311405+0000", 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038392299999999999 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311466+0000", 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0903000000000003e-05 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:138 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'96, mlcod=17'93)", 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.8187891, 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034036700000000001, 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.141 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.142 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:28.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:28.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310666+0000", 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310680+0000", 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4047e-05 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310715+0000", 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4826000000000002e-05 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310739+0000", 2024-05-07T14:02:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3796000000000001e-05 2024-05-07T14:02:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310862+0000", 2024-05-07T14:02:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123132 2024-05-07T14:02:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310896+0000", 2024-05-07T14:02:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.43e-05 2024-05-07T14:02:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313965+0000", 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030685959999999998 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314068+0000", 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102963 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:02:28.145 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:28.146 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.817883417, 2024-05-07T14:02:28.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:02:28.146 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.146 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.146 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.146 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:28.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:02:28.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:02:28.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:02:28.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:02:28.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:02:28.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:02:28.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:02:28.150 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.150 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.150 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.150 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:02:28.150 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:28.150 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.816977021, 2024-05-07T14:02:28.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:02:28.150 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.150 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:02:28.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:02:28.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:02:28.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:02:28.154 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.154 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.154 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.155 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:02:28.155 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:28.155 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.81556440200001, 2024-05-07T14:02:28.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:02:28.155 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.155 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.155 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.155 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:28.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:02:28.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:02:28.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:02:28.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:02:28.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:02:28.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:02:28.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:02:28.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:02:28.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:02:28.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:02:28.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:02:28.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:02:28.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:02:28.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:02:28.159 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.159 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.159 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.159 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:143 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'101, mlcod=17'98)", 2024-05-07T14:02:28.159 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.807671633, 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036609120000000001, 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:28.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321783+0000", 2024-05-07T14:02:28.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3599999999999999e-06 2024-05-07T14:02:28.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321905+0000", 2024-05-07T14:02:28.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121923 2024-05-07T14:02:28.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321929+0000", 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4295999999999999e-05 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321945+0000", 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5773999999999998e-05 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322070+0000", 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012457899999999999 2024-05-07T14:02:28.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322101+0000", 2024-05-07T14:02:28.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1213000000000001e-05 2024-05-07T14:02:28.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325342+0000", 2024-05-07T14:02:28.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032410579999999998 2024-05-07T14:02:28.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325443+0000", 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100709 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:144 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.806602891, 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003406484, 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.164 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:28.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:28.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322852+0000", 2024-05-07T14:02:28.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8369999999999999e-06 2024-05-07T14:02:28.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323022+0000", 2024-05-07T14:02:28.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016984199999999999 2024-05-07T14:02:28.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323048+0000", 2024-05-07T14:02:28.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5752999999999999e-05 2024-05-07T14:02:28.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323071+0000", 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.266e-05 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323188+0000", 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011728200000000001 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323224+0000", 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6380000000000001e-05 2024-05-07T14:02:28.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326163+0000", 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029386170000000001 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326257+0000", 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4112999999999998e-05 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.169 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:02:28.169 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:28.169 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.110271978, 2024-05-07T14:02:28.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034691510000000002, 2024-05-07T14:02:28.169 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.169 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.169 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.169 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.169 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.169 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.169 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 206 2024-05-07T14:02:28.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.169 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019184+0000", 2024-05-07T14:02:28.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6170000000000001e-06 2024-05-07T14:02:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019198+0000", 2024-05-07T14:02:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4113e-05 2024-05-07T14:02:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019229+0000", 2024-05-07T14:02:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0423e-05 2024-05-07T14:02:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019244+0000", 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5047e-05 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019478+0000", 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000234398 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019723+0000", 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024469500000000001 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:28.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.020149+0000", 2024-05-07T14:02:28.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042592999999999998 2024-05-07T14:02:28.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.021776+0000", 2024-05-07T14:02:28.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001627688 2024-05-07T14:02:28.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022453+0000", 2024-05-07T14:02:28.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00067671500000000004 2024-05-07T14:02:28.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022551+0000", 2024-05-07T14:02:28.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8312000000000003e-05 2024-05-07T14:02:28.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022651+0000", 2024-05-07T14:02:28.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9213e-05 2024-05-07T14:02:28.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.082982798000003, 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038721300000000001, 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.175 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.176 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 210 2024-05-07T14:02:28.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.176 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:28.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:28.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046474+0000", 2024-05-07T14:02:28.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.517e-06 2024-05-07T14:02:28.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046487+0000", 2024-05-07T14:02:28.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3113e-05 2024-05-07T14:02:28.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046521+0000", 2024-05-07T14:02:28.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3556000000000002e-05 2024-05-07T14:02:28.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046537+0000", 2024-05-07T14:02:28.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.643e-05 2024-05-07T14:02:28.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046651+0000", 2024-05-07T14:02:28.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011368500000000001 2024-05-07T14:02:28.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046873+0000", 2024-05-07T14:02:28.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221802 2024-05-07T14:02:28.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:28.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.047335+0000", 2024-05-07T14:02:28.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046227300000000002 2024-05-07T14:02:28.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.048993+0000", 2024-05-07T14:02:28.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016576679999999999 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050186+0000", 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001193284 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050273+0000", 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7189999999999997e-05 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050343+0000", 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9611999999999997e-05 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.053476051999994, 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034712530000000001, 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.181 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 218 2024-05-07T14:02:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075980+0000", 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.774e-06 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075992+0000", 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2283000000000001e-05 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076024+0000", 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1242999999999999e-05 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076038+0000", 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4663e-05 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076199+0000", 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160865 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076539+0000", 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033995800000000001 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.077234+0000", 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000694581 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.078996+0000", 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001762633 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079276+0000", 2024-05-07T14:02:28.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027998399999999999 2024-05-07T14:02:28.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079380+0000", 2024-05-07T14:02:28.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103266 2024-05-07T14:02:28.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079449+0000", 2024-05-07T14:02:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9003000000000003e-05 2024-05-07T14:02:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 80.98989392, 2024-05-07T14:02:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:02:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.187 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:02:28.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:02:28.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:02:28.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:02:28.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:02:28.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:02:28.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:02:28.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:02:28.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:02:28.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:02:28.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:02:28.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:02:28.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:02:28.193 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.193 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.193 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.193 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.193 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:28.193 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 80.956783262000002, 2024-05-07T14:02:28.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:02:28.194 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.194 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.194 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.194 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.194 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.194 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.194 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:02:28.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.194 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:28.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:02:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:02:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:02:28.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:02:28.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:02:28.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:02:28.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:02:28.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:02:28.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:02:28.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:28.199 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 80.949873342999993, 2024-05-07T14:02:28.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041680119999999996, 2024-05-07T14:02:28.200 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.200 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.200 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.200 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.200 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.200 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.200 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 382 2024-05-07T14:02:28.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.200 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179581+0000", 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179585+0000", 2024-05-07T14:02:28.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4800000000000003e-06 2024-05-07T14:02:28.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179598+0000", 2024-05-07T14:02:28.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2322e-05 2024-05-07T14:02:28.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179604+0000", 2024-05-07T14:02:28.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.823e-06 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179657+0000", 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3937000000000002e-05 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179714+0000", 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6165000000000002e-05 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:28.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179830+0000", 2024-05-07T14:02:28.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011632 2024-05-07T14:02:28.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.180515+0000", 2024-05-07T14:02:28.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00068531400000000002 2024-05-07T14:02:28.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183667+0000", 2024-05-07T14:02:28.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031522009999999999 2024-05-07T14:02:28.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183704+0000", 2024-05-07T14:02:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6925999999999998e-05 2024-05-07T14:02:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183748+0000", 2024-05-07T14:02:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3618999999999997e-05 2024-05-07T14:02:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.206 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:499 6.13 e33/27 6:cedbb205:::obj_delete_at_hint.0000000017:head v 33'4, mlcod=33'1)", 2024-05-07T14:02:28.206 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:28.206 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 80.876500688999997, 2024-05-07T14:02:28.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043323679999999996, 2024-05-07T14:02:28.206 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.206 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.206 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.206 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:28.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:28.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252954+0000", 2024-05-07T14:02:28.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.71e-07 2024-05-07T14:02:28.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252960+0000", 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.46e-06 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252974+0000", 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4249e-05 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252982+0000", 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:02:28.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253055+0000", 2024-05-07T14:02:28.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3162000000000002e-05 2024-05-07T14:02:28.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253075+0000", 2024-05-07T14:02:28.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9451999999999999e-05 2024-05-07T14:02:28.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257253+0000", 2024-05-07T14:02:28.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041781179999999998 2024-05-07T14:02:28.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257285+0000", 2024-05-07T14:02:28.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2075e-05 2024-05-07T14:02:28.210 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.210 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.211 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.211 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:550 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.211 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:28.211 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 80.840846506999995, 2024-05-07T14:02:28.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035552140000000001, 2024-05-07T14:02:28.211 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.211 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.211 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.211 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.211 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.212 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.212 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 550 2024-05-07T14:02:28.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.212 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:28.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:28.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288608+0000", 2024-05-07T14:02:28.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0529999999999999e-06 2024-05-07T14:02:28.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288613+0000", 2024-05-07T14:02:28.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7060000000000003e-06 2024-05-07T14:02:28.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288624+0000", 2024-05-07T14:02:28.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1547e-05 2024-05-07T14:02:28.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288630+0000", 2024-05-07T14:02:28.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:02:28.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288734+0000", 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103872 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288884+0000", 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014987400000000001 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289167+0000", 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028341999999999999 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289813+0000", 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064550199999999995 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292082+0000", 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022696000000000001 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292120+0000", 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7367999999999999e-05 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292162+0000", 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2568000000000003e-05 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:667 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 80.744904473000005, 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050309150000000004, 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.217 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 667 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.218 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:28.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384550+0000", 2024-05-07T14:02:28.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7000000000000003e-07 2024-05-07T14:02:28.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384555+0000", 2024-05-07T14:02:28.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.135e-06 2024-05-07T14:02:28.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384565+0000", 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0541e-05 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384571+0000", 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.857e-06 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384670+0000", 2024-05-07T14:02:28.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8461999999999993e-05 2024-05-07T14:02:28.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384822+0000", 2024-05-07T14:02:28.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152039 2024-05-07T14:02:28.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:28.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.385123+0000", 2024-05-07T14:02:28.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030070699999999999 2024-05-07T14:02:28.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.386099+0000", 2024-05-07T14:02:28.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097677300000000001 2024-05-07T14:02:28.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.222 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389495+0000", 2024-05-07T14:02:28.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033959139999999999 2024-05-07T14:02:28.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.222 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389530+0000", 2024-05-07T14:02:28.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.472e-05 2024-05-07T14:02:28.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389580+0000", 2024-05-07T14:02:28.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9897e-05 2024-05-07T14:02:28.223 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.223 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.223 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.223 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.223 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.223 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:28.226 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:28.226 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:28.227 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:02:28.228 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:28.228 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:28.228 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:28.229 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:28.230 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:28.237+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:28.327 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:28.337+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:28.427 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:28.437+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:28.441 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:28.442 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:28.442 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:28.461 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:02:28.528 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:28.541+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:28.597 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.3 to 1 (10000) 2024-05-07T14:02:28.609 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:02:28.627 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-07T14:02:28.628 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:28.641+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:28.675 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:28.675 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:28.675 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:28.676 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:28.676 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:28.694 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:02:28.736 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:28.749+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:28.831 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:28.841+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:28.915 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.941097006999996, 2024-05-07T14:02:28.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:02:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:02:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:28.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:28.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:02:28.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:02:28.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:02:28.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:02:28.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:02:28.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:02:28.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:02:28.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:02:28.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:02:28.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:02:28.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:28.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:02:28.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:02:28.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:02:28.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:02:28.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:02:28.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:02:28.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.921 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.921 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:28.921 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:28.921 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.893931136000006, 2024-05-07T14:02:28.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:02:28.922 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.922 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.922 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.922 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:28.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:28.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:02:28.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:02:28.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:02:28.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:02:28.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:02:28.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:02:28.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:02:28.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:02:28.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:02:28.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:02:28.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:02:28.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:02:28.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:02:28.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:02:28.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:02:28.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:02:28.926 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.927 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.927 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.927 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:28.927 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:28.927 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.793603415999996, 2024-05-07T14:02:28.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:02:28.928 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.928 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.928 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.928 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.928 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.928 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.928 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:02:28.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.928 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:28.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:28.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:02:28.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:02:28.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:02:28.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:02:28.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:02:28.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:02:28.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:02:28.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:02:28.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:02:28.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:02:28.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:02:28.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:02:28.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:28.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:02:28.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:02:28.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:02:28.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:02:28.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:02:28.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:02:28.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:02:28.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:02:28.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:02:28.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:02:28.934 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.934 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.934 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.934 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.934 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:28.934 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.891059358999996, 2024-05-07T14:02:28.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:02:28.934 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.934 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.935 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.935 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.935 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.935 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.935 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:02:28.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.935 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:28.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:28.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:02:28.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:02:28.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:02:28.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:02:28.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:02:28.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:02:28.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:02:28.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:02:28.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:02:28.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:02:28.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:02:28.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:02:28.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:28.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:02:28.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:02:28.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:02:28.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:02:28.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:02:28.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:02:28.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:02:28.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:02:28.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:02:28.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:02:28.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.941 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.941 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.941 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:28.941 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.871749390999994, 2024-05-07T14:02:28.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:02:28.942 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.942 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.942 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.942 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.942 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.942 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.942 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:02:28.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.942 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:28.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:28.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:02:28.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:02:28.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:02:28.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:02:28.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:02:28.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:02:28.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:02:28.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:02:28.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:02:28.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:02:28.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:02:28.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:02:28.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:28.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:02:28.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:02:28.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:02:28.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:02:28.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:02:28.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:02:28.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:02:28.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:02:28.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:02:28.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:02:28.948 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.948 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.948 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.948 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.948 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:28.948 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.846382481000006, 2024-05-07T14:02:28.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:02:28.948 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.948 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.949 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.949 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.949 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.949 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.949 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:02:28.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.949 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:28.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:28.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:02:28.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:02:28.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:02:28.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:02:28.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:02:28.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:02:28.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:02:28.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:02:28.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:02:28.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:02:28.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:02:28.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:02:28.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:28.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:02:28.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:02:28.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:02:28.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:02:28.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:02:28.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:02:28.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:02:28.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:02:28.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:02:28.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:02:28.955 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.955 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.955 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.955 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.956 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:28.956 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.826593097, 2024-05-07T14:02:28.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:02:28.956 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.956 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.956 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.956 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.956 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.956 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.956 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:02:28.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.956 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:28.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:28.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:02:28.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:02:28.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:02:28.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:02:28.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:02:28.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:02:28.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:02:28.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:02:28.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:02:28.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:02:28.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:02:28.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:02:28.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:28.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:02:28.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:02:28.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:02:28.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:02:28.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:02:28.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:02:28.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:02:28.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:02:28.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:02:28.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:02:28.962 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.962 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.962 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.963 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.963 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:28.963 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.793354735999998, 2024-05-07T14:02:28.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:02:28.963 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.963 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.963 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.963 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.963 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:02:28.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:02:28.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:02:28.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:02:28.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:02:28.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:02:28.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.968 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.757993714999998, 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:02:28.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.970 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:28.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:28.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:02:28.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:02:28.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:02:28.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:02:28.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:02:28.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:02:28.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:02:28.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:28.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:02:28.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:02:28.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:02:28.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:02:28.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:02:28.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:02:28.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:02:28.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:02:28.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:02:28.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:02:28.976 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.976 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.977 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.977 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.977 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:28.977 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.733250149, 2024-05-07T14:02:28.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:02:28.978 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.978 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.978 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.978 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.979 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.979 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.979 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:02:28.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.979 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:28.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:28.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:02:28.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:02:28.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:02:28.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:02:28.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:02:28.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:02:28.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:02:28.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:02:28.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:02:28.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:02:28.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:02:28.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:02:28.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:28.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:02:28.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:02:28.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:02:28.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:02:28.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:02:28.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:02:28.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:02:28.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:02:28.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:02:28.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:02:28.988 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.989 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.989 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.989 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.990 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:28.990 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.622373745999994, 2024-05-07T14:02:28.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:02:28.990 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.990 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.990 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.990 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.991 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.991 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.991 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:02:28.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.991 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:28.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:28.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:28.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:02:28.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:02:28.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:02:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:02:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:28.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.997 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.566209796999999, 2024-05-07T14:02:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:02:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:28.998 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:28.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:02:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:02:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:02:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:02:29.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:02:29.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:02:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:02:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:02:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:02:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.003 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.550324611999997, 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.004 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:02:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:02:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:02:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:02:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.300958359999996, 2024-05-07T14:02:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:02:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.010 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:02:29.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:02:29.015 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.239585536999996, 2024-05-07T14:02:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:02:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.017 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:02:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:29.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:02:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:02:29.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:02:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:02:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:02:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:02:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.043797194999996, 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.023 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:02:29.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:02:29.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:02:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:02:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:02:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:02:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.039493745000001, 2024-05-07T14:02:29.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003023937, 2024-05-07T14:02:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.031 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 918 2024-05-07T14:02:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:29.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886558+0000", 2024-05-07T14:02:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1229999999999998e-06 2024-05-07T14:02:29.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886569+0000", 2024-05-07T14:02:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1497e-05 2024-05-07T14:02:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886600+0000", 2024-05-07T14:02:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0809999999999998e-05 2024-05-07T14:02:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886618+0000", 2024-05-07T14:02:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7799e-05 2024-05-07T14:02:29.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886736+0000", 2024-05-07T14:02:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118276 2024-05-07T14:02:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886951+0000", 2024-05-07T14:02:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021467200000000001 2024-05-07T14:02:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.887437+0000", 2024-05-07T14:02:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048624900000000001 2024-05-07T14:02:29.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.888687+0000", 2024-05-07T14:02:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012498310000000001 2024-05-07T14:02:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889318+0000", 2024-05-07T14:02:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063122199999999997 2024-05-07T14:02:29.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889463+0000", 2024-05-07T14:02:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144769 2024-05-07T14:02:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889580+0000", 2024-05-07T14:02:29.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011668899999999999 2024-05-07T14:02:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.043 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.008493021000007, 2024-05-07T14:02:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:02:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.044 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:02:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:02:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:02:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:02:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:02:29.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:02:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:02:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:02:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:02:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:02:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:02:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:02:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:02:29.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:02:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:02:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:02:29.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:02:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:02:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:02:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:02:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:02:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:02:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.054 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.003608129, 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:02:29.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:02:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:02:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:02:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:02:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:02:29.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:02:29.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 80.971686758000004, 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:29.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:29.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:02:29.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:02:29.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:02:29.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:02:29.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:02:29.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:02:29.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:02:29.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:29.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:02:29.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:02:29.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:02:29.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:02:29.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:02:29.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:02:29.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:02:29.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:02:29.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:02:29.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:02:29.067 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.067 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.067 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.067 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.067 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.067 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:29.069 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:02:29.069 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:29.081+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:29.169 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:29.181+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:29.270 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:29.281+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:29.280 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:29.280 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:29.280 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:29.280 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:29.297 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:02:29.385 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:29.397+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:29.472 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:29.485+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:29.509 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:29.509 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:29.509 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:29.509 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:29.509 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:29.527 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:02:29.573 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:29.585+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:29.610 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.4 to 1 (10000) 2024-05-07T14:02:29.638 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-07T14:02:29.674 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:29.685+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:29.743 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:29.743 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:29.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:29.743 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:29.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.743 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:40 5.8 5:168cc6a2:::zonegroup_info.7881bf19-2c91-49be-82bb-722579314d1c:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:29.743 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:29.743 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 89.712244968999997, 2024-05-07T14:02:29.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002658582, 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 40 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:29.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042176+0000", 2024-05-07T14:02:29.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7719999999999999e-06 2024-05-07T14:02:29.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042186+0000", 2024-05-07T14:02:29.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0020000000000001e-05 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042209+0000", 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3224e-05 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042220+0000", 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1153e-05 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042358+0000", 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137389 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042594+0000", 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023630100000000001 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042900+0000", 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030576799999999999 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044463+0000", 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015627130000000001 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044675+0000", 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021186999999999999 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044768+0000", 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3046000000000003e-05 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044833+0000", 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5326000000000004e-05 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 85.717690083999997, 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025872120000000002, 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.749 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.750 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.750 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.750 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.750 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 52 2024-05-07T14:02:29.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.750 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:29.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036732+0000", 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4980000000000001e-06 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036744+0000", 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2269999999999999e-05 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036772+0000", 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8002000000000001e-05 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036817+0000", 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4608999999999999e-05 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036946+0000", 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012988400000000001 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037184+0000", 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000237178 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037405+0000", 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221418 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.038548+0000", 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011433540000000001 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039179+0000", 2024-05-07T14:02:29.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063016999999999999 2024-05-07T14:02:29.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039231+0000", 2024-05-07T14:02:29.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2434e-05 2024-05-07T14:02:29.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039316+0000", 2024-05-07T14:02:29.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5395000000000005e-05 2024-05-07T14:02:29.754 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.755 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.755 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.755 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.755 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:29.755 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.609107621999996, 2024-05-07T14:02:29.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:02:29.755 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.755 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.755 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.755 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.755 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:02:29.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:02:29.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.760 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.596688681000003, 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:02:29.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:02:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:02:29.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:02:29.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.592808958999996, 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:02:29.766 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:29.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:02:29.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:02:29.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:02:29.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:02:29.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:02:29.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:02:29.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:02:29.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:29.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:02:29.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:02:29.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:02:29.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.462153455999996, 2024-05-07T14:02:29.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:02:29.773 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.773 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.773 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.773 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:02:29.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.773 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:29.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:29.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:02:29.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:02:29.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:02:29.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:02:29.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:02:29.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:02:29.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:29.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:02:29.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:02:29.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:02:29.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:02:29.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:02:29.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.778 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.778 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.454986133999995, 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:29.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:02:29.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:02:29.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.164453445999996, 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.099372052000007, 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025880500000000002, 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.788 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 819 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655049+0000", 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6640000000000001e-06 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655057+0000", 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5639999999999997e-06 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655082+0000", 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4119999999999999e-05 2024-05-07T14:02:29.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655093+0000", 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1598e-05 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655273+0000", 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017975599999999999 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655432+0000", 2024-05-07T14:02:29.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000158682 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655720+0000", 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028791400000000001 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.656823+0000", 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001103435 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657483+0000", 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000659828 2024-05-07T14:02:29.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657571+0000", 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7756000000000005e-05 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657635+0000", 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4733000000000005e-05 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.793 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.047095819000006, 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028535079999999998, 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 841 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707326+0000", 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707338+0000", 2024-05-07T14:02:29.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2036e-05 2024-05-07T14:02:29.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707367+0000", 2024-05-07T14:02:29.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8816999999999999e-05 2024-05-07T14:02:29.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707382+0000", 2024-05-07T14:02:29.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4912999999999999e-05 2024-05-07T14:02:29.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707523+0000", 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014165599999999999 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707748+0000", 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000224315 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.708055+0000", 2024-05-07T14:02:29.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030739800000000001 2024-05-07T14:02:29.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.709147+0000", 2024-05-07T14:02:29.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001091788 2024-05-07T14:02:29.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710030+0000", 2024-05-07T14:02:29.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088367000000000003 2024-05-07T14:02:29.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710114+0000", 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3936000000000004e-05 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710177+0000", 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2675999999999994e-05 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.799 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.043429279999998, 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026153460000000002, 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 843 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710992+0000", 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.666e-06 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711000+0000", 2024-05-07T14:02:29.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.977e-06 2024-05-07T14:02:29.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711020+0000", 2024-05-07T14:02:29.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.033e-05 2024-05-07T14:02:29.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711030+0000", 2024-05-07T14:02:29.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9790000000000005e-06 2024-05-07T14:02:29.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711133+0000", 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102563 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711256+0000", 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012337599999999999 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711555+0000", 2024-05-07T14:02:29.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029948699999999997 2024-05-07T14:02:29.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.712654+0000", 2024-05-07T14:02:29.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001098819 2024-05-07T14:02:29.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713451+0000", 2024-05-07T14:02:29.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000796424 2024-05-07T14:02:29.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713541+0000", 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9981999999999993e-05 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713605+0000", 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4743e-05 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:29.805 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.033973164000002, 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027995160000000002, 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 847 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:29.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720448+0000", 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720460+0000", 2024-05-07T14:02:29.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1157e-05 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720490+0000", 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0960000000000002e-05 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720507+0000", 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6477000000000002e-05 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720681+0000", 2024-05-07T14:02:29.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017396800000000001 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720897+0000", 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215775 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.721203+0000", 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030621499999999998 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.722485+0000", 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012818599999999999 2024-05-07T14:02:29.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723091+0000", 2024-05-07T14:02:29.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060651499999999996 2024-05-07T14:02:29.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723182+0000", 2024-05-07T14:02:29.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0692999999999994e-05 2024-05-07T14:02:29.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723246+0000", 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3643e-05 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.030205815000002, 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.811 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:29.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:02:29.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:02:29.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:02:29.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:29.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:02:29.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:02:29.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:02:29.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:02:29.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:02:29.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:02:29.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.984492419000006, 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.817 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.818 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.818 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.818 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:02:29.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.818 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:29.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:02:29.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:02:29.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:29.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:02:29.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:02:29.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:02:29.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.978215680999995, 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.823 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:29.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:02:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:02:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:02:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:02:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:02:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:02:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.891702561000002, 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028016680000000002, 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.829 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 907 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862719+0000", 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862733+0000", 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3067e-05 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862763+0000", 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0926000000000002e-05 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862779+0000", 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5787e-05 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862924+0000", 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014509899999999999 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863160+0000", 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000235701 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:29.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863523+0000", 2024-05-07T14:02:29.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000362567 2024-05-07T14:02:29.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.864872+0000", 2024-05-07T14:02:29.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00134954 2024-05-07T14:02:29.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865350+0000", 2024-05-07T14:02:29.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000478009 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865437+0000", 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6712999999999995e-05 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865518+0000", 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1493000000000001e-05 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.835 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.835 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:29.835 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.887973274000004, 2024-05-07T14:02:29.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027054290000000001, 2024-05-07T14:02:29.835 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.835 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.835 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.835 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.835 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.835 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.835 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 909 2024-05-07T14:02:29.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866448+0000", 2024-05-07T14:02:29.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866459+0000", 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1207e-05 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866491+0000", 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362999999999998e-05 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866506+0000", 2024-05-07T14:02:29.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4790000000000001e-05 2024-05-07T14:02:29.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866632+0000", 2024-05-07T14:02:29.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000126422 2024-05-07T14:02:29.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866761+0000", 2024-05-07T14:02:29.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128832 2024-05-07T14:02:29.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.867037+0000", 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027612200000000001 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.868118+0000", 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001080941 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869004+0000", 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088632000000000001 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869081+0000", 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7195999999999997e-05 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869151+0000", 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0066000000000003e-05 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:29.840 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.793124474999999, 2024-05-07T14:02:29.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:02:29.841 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.841 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.841 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.841 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.841 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.841 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.841 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:02:29.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.841 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:02:29.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:02:29.846 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.846 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.846 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.846 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.846 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:29.846 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.779955121, 2024-05-07T14:02:29.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027821920000000002, 2024-05-07T14:02:29.846 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 955 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974466+0000", 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0999999999999998e-06 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974480+0000", 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3876999999999999e-05 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974510+0000", 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0273e-05 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974525+0000", 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.485e-05 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974618+0000", 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2359000000000001e-05 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974822+0000", 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000204148 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.975126+0000", 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030382800000000002 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976565+0000", 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014395160000000001 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976963+0000", 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00039772700000000001 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977128+0000", 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165508 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977246+0000", 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011800599999999999 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 81.776039557999994, 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027683989999999999, 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 957 2024-05-07T14:02:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978382+0000", 2024-05-07T14:02:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.95e-06 2024-05-07T14:02:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978393+0000", 2024-05-07T14:02:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.084e-05 2024-05-07T14:02:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978424+0000", 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1022999999999998e-05 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978441+0000", 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7782999999999999e-05 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978565+0000", 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012348900000000001 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978794+0000", 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000229335 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.979262+0000", 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046826700000000002 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.980470+0000", 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012071899999999999 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981002+0000", 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053222299999999996 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981086+0000", 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4073000000000006e-05 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981148+0000", 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2225999999999997e-05 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:29.858 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:29.859 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:02:29.860 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:29.869+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:29.960 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:29.969+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:30.013 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:30.013 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:30.013 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:30.013 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:30.026 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:02:30.069 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:30.081+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:30.162 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:30.173+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:30.177 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:30.177 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:30.177 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:30.177 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:30.177 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:30.190 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:02:30.230 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:02:30.264 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:30.277+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:30.365 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:30.377+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:30.404 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:02:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.413424144000004, 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:02:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:02:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.393020324000005, 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:02:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:02:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:02:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.290770609999996, 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036480649999999998, 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 231 2024-05-07T14:02:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125133+0000", 2024-05-07T14:02:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.063e-06 2024-05-07T14:02:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125143+0000", 2024-05-07T14:02:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9769999999999995e-06 2024-05-07T14:02:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125170+0000", 2024-05-07T14:02:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7152999999999999e-05 2024-05-07T14:02:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125184+0000", 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4372999999999999e-05 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125295+0000", 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111036 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125510+0000", 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215102 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125920+0000", 2024-05-07T14:02:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040954700000000001 2024-05-07T14:02:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.127419+0000", 2024-05-07T14:02:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001499261 2024-05-07T14:02:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128635+0000", 2024-05-07T14:02:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001215818 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128718+0000", 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3048999999999997e-05 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128779+0000", 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0686000000000001e-05 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:235 6.0 e33/27 6:013d6c33:gc::gc.30:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.275313589000007, 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038113629999999999, 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140590+0000", 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140604+0000", 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4324e-05 2024-05-07T14:02:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140640+0000", 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6009e-05 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140659+0000", 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9340000000000001e-05 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140815+0000", 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155329 2024-05-07T14:02:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140868+0000", 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3455999999999998e-05 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144310+0000", 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034414239999999998 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144399+0000", 2024-05-07T14:02:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9492000000000003e-05 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:400 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.224892193000002, 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039416900000000003, 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 400 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191010+0000", 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.09e-07 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191014+0000", 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999996e-06 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191024+0000", 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0274e-05 2024-05-07T14:02:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191030+0000", 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.789e-06 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191085+0000", 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4741999999999999e-05 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191169+0000", 2024-05-07T14:02:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4532999999999999e-05 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191383+0000", 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021415400000000001 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194408+0000", 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003024901 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194860+0000", 2024-05-07T14:02:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045153599999999999 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194915+0000", 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4737999999999997e-05 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194951+0000", 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6183999999999998e-05 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:403 6.2 e33/27 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 33'4, mlcod=33'2)", 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.221794513000006, 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003750841, 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194108+0000", 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.051e-06 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194116+0000", 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1149999999999994e-06 2024-05-07T14:02:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194128+0000", 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1972e-05 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194135+0000", 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1130000000000003e-06 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194191+0000", 2024-05-07T14:02:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194218+0000", 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6242e-05 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197807+0000", 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003589283 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197858+0000", 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0572999999999998e-05 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:415 6.7 e33/27 6:e622f76a:gc::gc.20:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.214092671000003, 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044669840000000002, 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1799999999999995e-07 2024-05-07T14:02:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201814+0000", 2024-05-07T14:02:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4170000000000002e-06 2024-05-07T14:02:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201824+0000", 2024-05-07T14:02:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0217999999999999e-05 2024-05-07T14:02:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201838+0000", 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3723000000000001e-05 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201890+0000", 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2320000000000001e-05 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201906+0000", 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5894999999999999e-05 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206242+0000", 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043366489999999997 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206276+0000", 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:432 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.202847090999995, 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045128019999999998, 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 432 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213055+0000", 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7000000000000005e-07 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213058+0000", 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0369999999999999e-06 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213066+0000", 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3680000000000002e-06 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213084+0000", 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7946999999999999e-05 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213127+0000", 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2673999999999998e-05 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213222+0000", 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5488000000000005e-05 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213412+0000", 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000189307 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.214754+0000", 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001342069 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217447+0000", 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026931250000000002 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217521+0000", 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3997000000000003e-05 2024-05-07T14:02:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217567+0000", 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6220000000000001e-05 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:430 6.7 e33/27 6:e1cdb60d:reshard::reshard.0000000008:head v 33'9, mlcod=33'6)", 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.202800608000004, 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043702330000000003, 2024-05-07T14:02:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0400000000000005e-07 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213107+0000", 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5740000000000003e-06 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213117+0000", 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8349999999999999e-06 2024-05-07T14:02:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213122+0000", 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5140000000000001e-06 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213169+0000", 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6551000000000002e-05 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213198+0000", 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:02:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217415+0000", 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042171090000000001 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217471+0000", 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5766000000000001e-05 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:480 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.174336452999995, 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052104459999999997, 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 480 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6199999999999997e-07 2024-05-07T14:02:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241570+0000", 2024-05-07T14:02:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2479999999999998e-06 2024-05-07T14:02:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241580+0000", 2024-05-07T14:02:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8719999999999997e-06 2024-05-07T14:02:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241584+0000", 2024-05-07T14:02:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7210000000000002e-06 2024-05-07T14:02:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241629+0000", 2024-05-07T14:02:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4465000000000002e-05 2024-05-07T14:02:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241671+0000", 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2370999999999998e-05 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241772+0000", 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101048 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.243876+0000", 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021036789999999998 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246710+0000", 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028339060000000002 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246747+0000", 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7061000000000003e-05 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246775+0000", 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8413000000000001e-05 2024-05-07T14:02:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:499 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.163455732000003, 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050166450000000001, 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 499 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4300000000000002e-07 2024-05-07T14:02:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252451+0000", 2024-05-07T14:02:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1290000000000004e-06 2024-05-07T14:02:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252463+0000", 2024-05-07T14:02:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1238e-05 2024-05-07T14:02:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252470+0000", 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2019999999999998e-06 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252534+0000", 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4178999999999997e-05 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252706+0000", 2024-05-07T14:02:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017197 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252871+0000", 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016508199999999999 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254444+0000", 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001573112 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257407+0000", 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029630989999999999 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257437+0000", 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0009999999999999e-05 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257462+0000", 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4780999999999999e-05 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:500 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.163169628999995, 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046354220000000002, 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 500 2024-05-07T14:02:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252733+0000", 2024-05-07T14:02:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9399999999999993e-07 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252738+0000", 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6779999999999997e-06 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252750+0000", 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1882000000000001e-05 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252758+0000", 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0649999999999999e-06 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252811+0000", 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2859000000000003e-05 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252870+0000", 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8956000000000003e-05 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252992+0000", 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122275 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254326+0000", 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013334449999999999 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257254+0000", 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029284039999999999 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257316+0000", 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1348999999999998e-05 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257367+0000", 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1514999999999997e-05 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:510 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.157086989999996, 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041639090000000004, 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 510 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:02:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258815+0000", 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258819+0000", 2024-05-07T14:02:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0090000000000001e-06 2024-05-07T14:02:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258828+0000", 2024-05-07T14:02:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2529999999999993e-06 2024-05-07T14:02:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258833+0000", 2024-05-07T14:02:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7219999999999999e-06 2024-05-07T14:02:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258870+0000", 2024-05-07T14:02:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6368000000000001e-05 2024-05-07T14:02:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258915+0000", 2024-05-07T14:02:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.528e-05 2024-05-07T14:02:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.259016+0000", 2024-05-07T14:02:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010074200000000001 2024-05-07T14:02:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.260655+0000", 2024-05-07T14:02:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016394999999999999 2024-05-07T14:02:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262752+0000", 2024-05-07T14:02:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002096531 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262871+0000", 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119645 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262978+0000", 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010695400000000001 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:552 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.125327487999996, 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042166790000000001, 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 552 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290575+0000", 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.85e-07 2024-05-07T14:02:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290578+0000", 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999999e-06 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290587+0000", 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.268e-06 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290592+0000", 2024-05-07T14:02:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7029999999999997e-06 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290694+0000", 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101841 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290840+0000", 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014613899999999999 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.291137+0000", 2024-05-07T14:02:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029714800000000001 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292561+0000", 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014235020000000001 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294568+0000", 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020076540000000002 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294692+0000", 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012394500000000001 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294790+0000", 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8194000000000002e-05 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:553 6.f e33/27 6:f24cb4a8:gc::gc.31:head v 33'4, mlcod=33'2)", 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.123068630000006, 2024-05-07T14:02:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043350139999999999, 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2900000000000004e-07 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292838+0000", 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5560000000000001e-06 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292847+0000", 2024-05-07T14:02:30.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8619999999999992e-06 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292851+0000", 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9010000000000002e-06 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292922+0000", 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0827000000000005e-05 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292973+0000", 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0492999999999999e-05 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297114+0000", 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041408970000000002 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297168+0000", 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3949000000000001e-05 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.485 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.486 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:686 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:30.486 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:30.486 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.013322744999996, 2024-05-07T14:02:30.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046254349999999998, 2024-05-07T14:02:30.486 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.486 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.486 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.486 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.486 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.486 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.486 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 686 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402581+0000", 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402592+0000", 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0984e-05 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402619+0000", 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7583e-05 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402633+0000", 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3553000000000001e-05 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402699+0000", 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6013000000000006e-05 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402792+0000", 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3455999999999994e-05 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402928+0000", 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013596800000000001 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.403918+0000", 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00099017000000000007 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407144+0000", 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032257449999999999 2024-05-07T14:02:30.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407180+0000", 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5462e-05 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407204+0000", 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4247999999999999e-05 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.744411166999996, 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003355448, 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 826 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671493+0000", 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-06 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671506+0000", 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2746e-05 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671542+0000", 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6162999999999999e-05 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671557+0000", 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4786999999999999e-05 2024-05-07T14:02:30.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671705+0000", 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000147792 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671872+0000", 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016705499999999999 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.672101+0000", 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022892999999999999 2024-05-07T14:02:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.673101+0000", 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001000775 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674701+0000", 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016000599999999999 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674795+0000", 2024-05-07T14:02:30.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3653000000000006e-05 2024-05-07T14:02:30.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674846+0000", 2024-05-07T14:02:30.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0473000000000003e-05 2024-05-07T14:02:30.497 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.497 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.497 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.497 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:868 6.f e33/27 6:f6792a7a:::obj_delete_at_hint.0000000097:head v 33'10, mlcod=33'8)", 2024-05-07T14:02:30.497 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:02:30.497 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.645006680999998, 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033639339999999998, 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:02:30.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770897+0000", 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9700000000000002e-06 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770909+0000", 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2034e-05 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770937+0000", 2024-05-07T14:02:30.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.796e-05 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770954+0000", 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7555999999999999e-05 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771084+0000", 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013033599999999999 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771136+0000", 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1925999999999997e-05 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774168+0000", 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030316200000000001 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774259+0000", 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0532000000000007e-05 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.581016488000003, 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035607859999999998, 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 895 2024-05-07T14:02:30.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834888+0000", 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.41e-06 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834899+0000", 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0987e-05 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834929+0000", 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9706e-05 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834943+0000", 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4354e-05 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835100+0000", 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156582 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835499+0000", 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000399214 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:30.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.836052+0000", 2024-05-07T14:02:30.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00055334500000000001 2024-05-07T14:02:30.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:30.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.837279+0000", 2024-05-07T14:02:30.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012266270000000001 2024-05-07T14:02:30.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:30.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838177+0000", 2024-05-07T14:02:30.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089768699999999999 2024-05-07T14:02:30.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838332+0000", 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155155 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838446+0000", 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113719 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 82.573488959000002, 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033546700000000001, 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 898 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:30.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:30.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:02:30.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:30.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:02:30.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:30.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:30.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842414+0000", 2024-05-07T14:02:30.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.863e-06 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842425+0000", 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0533000000000001e-05 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842450+0000", 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5259999999999999e-05 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:30.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842463+0000", 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3373000000000001e-05 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842599+0000", 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013549600000000001 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842936+0000", 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033763400000000001 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.843484+0000", 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054733899999999999 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.844749+0000", 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012656639999999999 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845499+0000", 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074904400000000003 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:30.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845646+0000", 2024-05-07T14:02:30.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014709900000000001 2024-05-07T14:02:30.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:30.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:30.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:30.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845767+0000", 2024-05-07T14:02:30.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121365 2024-05-07T14:02:30.513 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.513 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.513 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.513 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:30.513 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:30.513 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:30.515 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:02:30.515 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:30.516 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:30.516 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:30.516 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:30.516 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:30.517 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:30.517 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:30.525+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:30.519 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:30.520 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:30.551 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:30.551 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:30.582 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:30.583 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:30.615 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:30.615 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:30.616 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:30.625+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:30.621 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.5 to 1 (10000) 2024-05-07T14:02:30.637 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:02:30.647 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-07T14:02:30.650 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:30.651 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:30.653 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:30.653 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:30.668 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:02:30.716 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:30.729+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:30.793 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:30.793 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:30.808 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:02:30.852 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:30.865+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:30.918 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:30.929+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:30.975 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:30.975 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:30.989 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:02:31.032 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:31.045+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:31.121 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:31.133+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:31.154 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:31.154 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:31.168 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:31.256 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:31.269+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:31.323 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:31.333+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:31.559 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:31.559 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:31.559 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:31.560 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:31.569+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:31.627 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:02:31.631 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.6 to 1 (10000) 2024-05-07T14:02:31.657 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-07T14:02:31.659 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:31.669+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:31.730 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:31.730 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:31.744 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:31.788 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:31.801+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:31.860 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:31.873+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:31.913 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:31.914 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:31.927 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:31.972 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:31.985+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:32.056 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:32.056 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:32.062 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:32.073+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:32.070 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:32.162 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:32.173+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:32.233 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:32.233 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:32.249 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:32.263 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:32.273+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:32.364 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:32.373+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:32.420 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:32.420 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:32.434 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:32.480 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:32.493+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:32.557 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:32.557 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:32.565 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:32.577+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:32.571 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:02:32.635 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.7 to 1 (10000) 2024-05-07T14:02:32.662 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-07T14:02:32.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:02:32.675 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:02:32.705 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:32.717+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:32.741 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:32.741 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:32.755 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:02:32.801 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:32.813+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:32.867 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:32.877+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:32.903 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:32.903 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:32.930 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:32.930 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:32.930 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:32.930 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:32.937 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:32.937 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:32.948 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:02:32.968 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:32.968 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:32.969 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:32.981+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:33.002 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:33.003 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:33.038 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:33.039 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:33.069 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:33.081+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:33.071 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:33.071 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:33.104 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:33.105 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:33.137 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:33.138 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:33.146 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:33.146 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:33.146 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:33.166 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:02:33.209 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:33.221+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:33.229 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:02:33.236 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:02:33.251 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2024-05-07T14:02:32.646373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":809,"num_read_kb":552,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":527,"ondisk_log_size":527,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228080,"kb_used_data":7736,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746640,"statfs":{"total":773094113280,"available":772860559360,"internally_reserved":0,"allocated":7921664,"data_stored":4699794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031471"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640820+0000","last_change":"2024-05-07T14:00:55.983744+0000","last_active":"2024-05-07T14:02:31.640820+0000","last_peered":"2024-05-07T14:02:31.640820+0000","last_clean":"2024-05-07T14:02:31.640820+0000","last_became_active":"2024-05-07T14:00:55.982993+0000","last_became_peered":"2024-05-07T14:00:55.982993+0000","last_unstale":"2024-05-07T14:02:31.640820+0000","last_undegraded":"2024-05-07T14:02:31.640820+0000","last_fullsized":"2024-05-07T14:02:31.640820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257110+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:02:32.257110+0000","last_peered":"2024-05-07T14:02:32.257110+0000","last_clean":"2024-05-07T14:02:32.257110+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:02:32.257110+0000","last_undegraded":"2024-05-07T14:02:32.257110+0000","last_fullsized":"2024-05-07T14:02:32.257110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356138+0000","last_change":"2024-05-07T14:00:55.973967+0000","last_active":"2024-05-07T14:02:32.356138+0000","last_peered":"2024-05-07T14:02:32.356138+0000","last_clean":"2024-05-07T14:02:32.356138+0000","last_became_active":"2024-05-07T14:00:55.973677+0000","last_became_peered":"2024-05-07T14:00:55.973677+0000","last_unstale":"2024-05-07T14:02:32.356138+0000","last_undegraded":"2024-05-07T14:02:32.356138+0000","last_fullsized":"2024-05-07T14:02:32.356138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639745+0000","last_change":"2024-05-07T14:00:57.988092+0000","last_active":"2024-05-07T14:02:31.639745+0000","last_peered":"2024-05-07T14:02:31.639745+0000","last_clean":"2024-05-07T14:02:31.639745+0000","last_became_active":"2024-05-07T14:00:57.987091+0000","last_became_peered":"2024-05-07T14:00:57.987091+0000","last_unstale":"2024-05-07T14:02:31.639745+0000","last_undegraded":"2024-05-07T14:02:31.639745+0000","last_fullsized":"2024-05-07T14:02:31.639745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408924+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:02:32.408924+0000","last_peered":"2024-05-07T14:02:32.408924+0000","last_clean":"2024-05-07T14:02:32.408924+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:02:32.408924+0000","last_undegraded":"2024-05-07T14:02:32.408924+0000","last_fullsized":"2024-05-07T14:02:32.408924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635394+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:02:31.635394+0000","last_peered":"2024-05-07T14:02:31.635394+0000","last_clean":"2024-05-07T14:02:31.635394+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:02:31.635394+0000","last_undegraded":"2024-05-07T14:02:31.635394+0000","last_fullsized":"2024-05-07T14:02:31.635394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257408+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:02:32.257408+0000","last_peered":"2024-05-07T14:02:32.257408+0000","last_clean":"2024-05-07T14:02:32.257408+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:02:32.257408+0000","last_undegraded":"2024-05-07T14:02:32.257408+0000","last_fullsized":"2024-05-07T14:02:32.257408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409659+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:02:32.409659+0000","last_peered":"2024-05-07T14:02:32.409659+0000","last_clean":"2024-05-07T14:02:32.409659+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:02:32.409659+0000","last_undegraded":"2024-05-07T14:02:32.409659+0000","last_fullsized":"2024-05-07T14:02:32.409659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640138+0000","last_change":"2024-05-07T14:00:55.973419+0000","last_active":"2024-05-07T14:02:31.640138+0000","last_peered":"2024-05-07T14:02:31.640138+0000","last_clean":"2024-05-07T14:02:31.640138+0000","last_became_active":"2024-05-07T14:00:55.963467+0000","last_became_peered":"2024-05-07T14:00:55.963467+0000","last_unstale":"2024-05-07T14:02:31.640138+0000","last_undegraded":"2024-05-07T14:02:31.640138+0000","last_fullsized":"2024-05-07T14:02:31.640138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004251+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:02:32.004251+0000","last_peered":"2024-05-07T14:02:32.004251+0000","last_clean":"2024-05-07T14:02:32.004251+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:02:32.004251+0000","last_undegraded":"2024-05-07T14:02:32.004251+0000","last_fullsized":"2024-05-07T14:02:32.004251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256311+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:02:32.256311+0000","last_peered":"2024-05-07T14:02:32.256311+0000","last_clean":"2024-05-07T14:02:32.256311+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:02:32.256311+0000","last_undegraded":"2024-05-07T14:02:32.256311+0000","last_fullsized":"2024-05-07T14:02:32.256311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635936+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:02:31.635936+0000","last_peered":"2024-05-07T14:02:31.635936+0000","last_clean":"2024-05-07T14:02:31.635936+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:02:31.635936+0000","last_undegraded":"2024-05-07T14:02:31.635936+0000","last_fullsized":"2024-05-07T14:02:31.635936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639946+0000","last_change":"2024-05-07T14:00:55.962579+0000","last_active":"2024-05-07T14:02:31.639946+0000","last_peered":"2024-05-07T14:02:31.639946+0000","last_clean":"2024-05-07T14:02:31.639946+0000","last_became_active":"2024-05-07T14:00:55.961815+0000","last_became_peered":"2024-05-07T14:00:55.961815+0000","last_unstale":"2024-05-07T14:02:31.639946+0000","last_undegraded":"2024-05-07T14:02:31.639946+0000","last_fullsized":"2024-05-07T14:02:31.639946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257945+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:02:32.257945+0000","last_peered":"2024-05-07T14:02:32.257945+0000","last_clean":"2024-05-07T14:02:32.257945+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:02:32.257945+0000","last_undegraded":"2024-05-07T14:02:32.257945+0000","last_fullsized":"2024-05-07T14:02:32.257945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391120+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:02:32.391120+0000","last_peered":"2024-05-07T14:02:32.391120+0000","last_clean":"2024-05-07T14:02:32.391120+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:02:32.391120+0000","last_undegraded":"2024-05-07T14:02:32.391120+0000","last_fullsized":"2024-05-07T14:02:32.391120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.643446+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:02:31.643446+0000","last_peered":"2024-05-07T14:02:31.643446+0000","last_clean":"2024-05-07T14:02:31.643446+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:02:31.643446+0000","last_undegraded":"2024-05-07T14:02:31.643446+0000","last_fullsized":"2024-05-07T14:02:31.643446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634949+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:02:31.634949+0000","last_peered":"2024-05-07T14:02:31.634949+0000","last_clean":"2024-05-07T14:02:31.634949+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:02:31.634949+0000","last_undegraded":"2024-05-07T14:02:31.634949+0000","last_fullsized":"2024-05-07T14:02:31.634949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640900+0000","last_change":"2024-05-07T14:00:56.003776+0000","last_active":"2024-05-07T14:02:31.640900+0000","last_peered":"2024-05-07T14:02:31.640900+0000","last_clean":"2024-05-07T14:02:31.640900+0000","last_became_active":"2024-05-07T14:00:56.002996+0000","last_became_peered":"2024-05-07T14:00:56.002996+0000","last_unstale":"2024-05-07T14:02:31.640900+0000","last_undegraded":"2024-05-07T14:02:31.640900+0000","last_fullsized":"2024-05-07T14:02:31.640900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:17.583140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639757+0000","last_change":"2024-05-07T14:00:57.987026+0000","last_active":"2024-05-07T14:02:31.639757+0000","last_peered":"2024-05-07T14:02:31.639757+0000","last_clean":"2024-05-07T14:02:31.639757+0000","last_became_active":"2024-05-07T14:00:57.986048+0000","last_became_peered":"2024-05-07T14:00:57.986048+0000","last_unstale":"2024-05-07T14:02:31.639757+0000","last_undegraded":"2024-05-07T14:02:31.639757+0000","last_fullsized":"2024-05-07T14:02:31.639757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004377+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:02:32.004377+0000","last_peered":"2024-05-07T14:02:32.004377+0000","last_clean":"2024-05-07T14:02:32.004377+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:02:32.004377+0000","last_undegraded":"2024-05-07T14:02:32.004377+0000","last_fullsized":"2024-05-07T14:02:32.004377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256754+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:02:32.256754+0000","last_peered":"2024-05-07T14:02:32.256754+0000","last_clean":"2024-05-07T14:02:32.256754+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:02:32.256754+0000","last_undegraded":"2024-05-07T14:02:32.256754+0000","last_fullsized":"2024-05-07T14:02:32.256754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004788+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:02:32.004788+0000","last_peered":"2024-05-07T14:02:32.004788+0000","last_clean":"2024-05-07T14:02:32.004788+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:02:32.004788+0000","last_undegraded":"2024-05-07T14:02:32.004788+0000","last_fullsized":"2024-05-07T14:02:32.004788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638279+0000","last_change":"2024-05-07T14:01:37.318563+0000","last_active":"2024-05-07T14:02:31.638279+0000","last_peered":"2024-05-07T14:02:31.638279+0000","last_clean":"2024-05-07T14:02:31.638279+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:02:31.638279+0000","last_undegraded":"2024-05-07T14:02:31.638279+0000","last_fullsized":"2024-05-07T14:02:31.638279+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:27.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635289+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:02:31.635289+0000","last_peered":"2024-05-07T14:02:31.635289+0000","last_clean":"2024-05-07T14:02:31.635289+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:02:31.635289+0000","last_undegraded":"2024-05-07T14:02:31.635289+0000","last_fullsized":"2024-05-07T14:02:31.635289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638604+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:02:31.638604+0000","last_peered":"2024-05-07T14:02:31.638604+0000","last_clean":"2024-05-07T14:02:31.638604+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:02:31.638604+0000","last_undegraded":"2024-05-07T14:02:31.638604+0000","last_fullsized":"2024-05-07T14:02:31.638604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392183+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:02:32.392183+0000","last_peered":"2024-05-07T14:02:32.392183+0000","last_clean":"2024-05-07T14:02:32.392183+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:02:32.392183+0000","last_undegraded":"2024-05-07T14:02:32.392183+0000","last_fullsized":"2024-05-07T14:02:32.392183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636027+0000","last_change":"2024-05-07T14:00:58.008214+0000","last_active":"2024-05-07T14:02:31.636027+0000","last_peered":"2024-05-07T14:02:31.636027+0000","last_clean":"2024-05-07T14:02:31.636027+0000","last_became_active":"2024-05-07T14:00:58.005516+0000","last_became_peered":"2024-05-07T14:00:58.005516+0000","last_unstale":"2024-05-07T14:02:31.636027+0000","last_undegraded":"2024-05-07T14:02:31.636027+0000","last_fullsized":"2024-05-07T14:02:31.636027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410201+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:02:32.410201+0000","last_peered":"2024-05-07T14:02:32.410201+0000","last_clean":"2024-05-07T14:02:32.410201+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:02:32.410201+0000","last_undegraded":"2024-05-07T14:02:32.410201+0000","last_fullsized":"2024-05-07T14:02:32.410201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634642+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:02:31.634642+0000","last_peered":"2024-05-07T14:02:31.634642+0000","last_clean":"2024-05-07T14:02:31.634642+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:02:31.634642+0000","last_undegraded":"2024-05-07T14:02:31.634642+0000","last_fullsized":"2024-05-07T14:02:31.634642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391544+0000","last_change":"2024-05-07T14:00:57.988107+0000","last_active":"2024-05-07T14:02:32.391544+0000","last_peered":"2024-05-07T14:02:32.391544+0000","last_clean":"2024-05-07T14:02:32.391544+0000","last_became_active":"2024-05-07T14:00:57.987604+0000","last_became_peered":"2024-05-07T14:00:57.987604+0000","last_unstale":"2024-05-07T14:02:32.391544+0000","last_undegraded":"2024-05-07T14:02:32.391544+0000","last_fullsized":"2024-05-07T14:02:32.391544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638195+0000","last_change":"2024-05-07T14:01:37.311718+0000","last_active":"2024-05-07T14:02:31.638195+0000","last_peered":"2024-05-07T14:02:31.638195+0000","last_clean":"2024-05-07T14:02:31.638195+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:02:31.638195+0000","last_undegraded":"2024-05-07T14:02:31.638195+0000","last_fullsized":"2024-05-07T14:02:31.638195+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:24.211300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257380+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:02:32.257380+0000","last_peered":"2024-05-07T14:02:32.257380+0000","last_clean":"2024-05-07T14:02:32.257380+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:02:32.257380+0000","last_undegraded":"2024-05-07T14:02:32.257380+0000","last_fullsized":"2024-05-07T14:02:32.257380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410909+0000","last_change":"2024-05-07T14:01:01.993679+0000","last_active":"2024-05-07T14:02:32.410909+0000","last_peered":"2024-05-07T14:02:32.410909+0000","last_clean":"2024-05-07T14:02:32.410909+0000","last_became_active":"2024-05-07T14:01:01.993241+0000","last_became_peered":"2024-05-07T14:01:01.993241+0000","last_unstale":"2024-05-07T14:02:32.410909+0000","last_undegraded":"2024-05-07T14:02:32.410909+0000","last_fullsized":"2024-05-07T14:02:32.410909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640587+0000","last_change":"2024-05-07T14:01:04.017472+0000","last_active":"2024-05-07T14:02:31.640587+0000","last_peered":"2024-05-07T14:02:31.640587+0000","last_clean":"2024-05-07T14:02:31.640587+0000","last_became_active":"2024-05-07T14:01:04.016757+0000","last_became_peered":"2024-05-07T14:01:04.016757+0000","last_unstale":"2024-05-07T14:02:31.640587+0000","last_undegraded":"2024-05-07T14:02:31.640587+0000","last_fullsized":"2024-05-07T14:02:31.640587+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256294+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:02:32.256294+0000","last_peered":"2024-05-07T14:02:32.256294+0000","last_clean":"2024-05-07T14:02:32.256294+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:02:32.256294+0000","last_undegraded":"2024-05-07T14:02:32.256294+0000","last_fullsized":"2024-05-07T14:02:32.256294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257958+0000","last_change":"2024-05-07T14:00:57.984789+0000","last_active":"2024-05-07T14:02:32.257958+0000","last_peered":"2024-05-07T14:02:32.257958+0000","last_clean":"2024-05-07T14:02:32.257958+0000","last_became_active":"2024-05-07T14:00:57.983524+0000","last_became_peered":"2024-05-07T14:00:57.983524+0000","last_unstale":"2024-05-07T14:02:32.257958+0000","last_undegraded":"2024-05-07T14:02:32.257958+0000","last_fullsized":"2024-05-07T14:02:32.257958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408899+0000","last_change":"2024-05-07T14:00:55.989797+0000","last_active":"2024-05-07T14:02:32.408899+0000","last_peered":"2024-05-07T14:02:32.408899+0000","last_clean":"2024-05-07T14:02:32.408899+0000","last_became_active":"2024-05-07T14:00:55.989449+0000","last_became_peered":"2024-05-07T14:00:55.989449+0000","last_unstale":"2024-05-07T14:02:32.408899+0000","last_undegraded":"2024-05-07T14:02:32.408899+0000","last_fullsized":"2024-05-07T14:02:32.408899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391421+0000","last_change":"2024-05-07T14:00:59.983880+0000","last_active":"2024-05-07T14:02:32.391421+0000","last_peered":"2024-05-07T14:02:32.391421+0000","last_clean":"2024-05-07T14:02:32.391421+0000","last_became_active":"2024-05-07T14:00:59.983186+0000","last_became_peered":"2024-05-07T14:00:59.983186+0000","last_unstale":"2024-05-07T14:02:32.391421+0000","last_undegraded":"2024-05-07T14:02:32.391421+0000","last_fullsized":"2024-05-07T14:02:32.391421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:27.067433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":101,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636252+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:02:31.636252+0000","last_peered":"2024-05-07T14:02:31.636252+0000","last_clean":"2024-05-07T14:02:31.636252+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:02:31.636252+0000","last_undegraded":"2024-05-07T14:02:31.636252+0000","last_fullsized":"2024-05-07T14:02:31.636252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635949+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:02:31.635949+0000","last_peered":"2024-05-07T14:02:31.635949+0000","last_clean":"2024-05-07T14:02:31.635949+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:02:31.635949+0000","last_undegraded":"2024-05-07T14:02:31.635949+0000","last_fullsized":"2024-05-07T14:02:31.635949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409970+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:02:32.409970+0000","last_peered":"2024-05-07T14:02:32.409970+0000","last_clean":"2024-05-07T14:02:32.409970+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:02:32.409970+0000","last_undegraded":"2024-05-07T14:02:32.409970+0000","last_fullsized":"2024-05-07T14:02:32.409970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411352+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:02:32.411352+0000","last_peered":"2024-05-07T14:02:32.411352+0000","last_clean":"2024-05-07T14:02:32.411352+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:02:32.411352+0000","last_undegraded":"2024-05-07T14:02:32.411352+0000","last_fullsized":"2024-05-07T14:02:32.411352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639953+0000","last_change":"2024-05-07T14:00:55.986233+0000","last_active":"2024-05-07T14:02:31.639953+0000","last_peered":"2024-05-07T14:02:31.639953+0000","last_clean":"2024-05-07T14:02:31.639953+0000","last_became_active":"2024-05-07T14:00:55.984927+0000","last_became_peered":"2024-05-07T14:00:55.984927+0000","last_unstale":"2024-05-07T14:02:31.639953+0000","last_undegraded":"2024-05-07T14:02:31.639953+0000","last_fullsized":"2024-05-07T14:02:31.639953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392420+0000","last_change":"2024-05-07T14:00:59.992166+0000","last_active":"2024-05-07T14:02:32.392420+0000","last_peered":"2024-05-07T14:02:32.392420+0000","last_clean":"2024-05-07T14:02:32.392420+0000","last_became_active":"2024-05-07T14:00:59.991408+0000","last_became_peered":"2024-05-07T14:00:59.991408+0000","last_unstale":"2024-05-07T14:02:32.392420+0000","last_undegraded":"2024-05-07T14:02:32.392420+0000","last_fullsized":"2024-05-07T14:02:32.392420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":106,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638389+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:02:31.638389+0000","last_peered":"2024-05-07T14:02:31.638389+0000","last_clean":"2024-05-07T14:02:31.638389+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:02:31.638389+0000","last_undegraded":"2024-05-07T14:02:31.638389+0000","last_fullsized":"2024-05-07T14:02:31.638389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640188+0000","last_change":"2024-05-07T14:01:04.007238+0000","last_active":"2024-05-07T14:02:31.640188+0000","last_peered":"2024-05-07T14:02:31.640188+0000","last_clean":"2024-05-07T14:02:31.640188+0000","last_became_active":"2024-05-07T14:01:04.006204+0000","last_became_peered":"2024-05-07T14:01:04.006204+0000","last_unstale":"2024-05-07T14:02:31.640188+0000","last_undegraded":"2024-05-07T14:02:31.640188+0000","last_fullsized":"2024-05-07T14:02:31.640188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635120+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:02:31.635120+0000","last_peered":"2024-05-07T14:02:31.635120+0000","last_clean":"2024-05-07T14:02:31.635120+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:02:31.635120+0000","last_undegraded":"2024-05-07T14:02:31.635120+0000","last_fullsized":"2024-05-07T14:02:31.635120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392078+0000","last_change":"2024-05-07T14:00:57.998824+0000","last_active":"2024-05-07T14:02:32.392078+0000","last_peered":"2024-05-07T14:02:32.392078+0000","last_clean":"2024-05-07T14:02:32.392078+0000","last_became_active":"2024-05-07T14:00:57.998316+0000","last_became_peered":"2024-05-07T14:00:57.998316+0000","last_unstale":"2024-05-07T14:02:32.392078+0000","last_undegraded":"2024-05-07T14:02:32.392078+0000","last_fullsized":"2024-05-07T14:02:32.392078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.005080+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:02:32.005080+0000","last_peered":"2024-05-07T14:02:32.005080+0000","last_clean":"2024-05-07T14:02:32.005080+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:02:32.005080+0000","last_undegraded":"2024-05-07T14:02:32.005080+0000","last_fullsized":"2024-05-07T14:02:32.005080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257540+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:02:32.257540+0000","last_peered":"2024-05-07T14:02:32.257540+0000","last_clean":"2024-05-07T14:02:32.257540+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:02:32.257540+0000","last_undegraded":"2024-05-07T14:02:32.257540+0000","last_fullsized":"2024-05-07T14:02:32.257540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640380+0000","last_change":"2024-05-07T14:01:02.151107+0000","last_active":"2024-05-07T14:02:31.640380+0000","last_peered":"2024-05-07T14:02:31.640380+0000","last_clean":"2024-05-07T14:02:31.640380+0000","last_became_active":"2024-05-07T14:01:02.150351+0000","last_became_peered":"2024-05-07T14:01:02.150351+0000","last_unstale":"2024-05-07T14:02:31.640380+0000","last_undegraded":"2024-05-07T14:02:31.640380+0000","last_fullsized":"2024-05-07T14:02:31.640380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:28:13.159757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391061+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:02:32.391061+0000","last_peered":"2024-05-07T14:02:32.391061+0000","last_clean":"2024-05-07T14:02:32.391061+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:02:32.391061+0000","last_undegraded":"2024-05-07T14:02:32.391061+0000","last_fullsized":"2024-05-07T14:02:32.391061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257818+0000","last_change":"2024-05-07T14:00:57.979757+0000","last_active":"2024-05-07T14:02:32.257818+0000","last_peered":"2024-05-07T14:02:32.257818+0000","last_clean":"2024-05-07T14:02:32.257818+0000","last_became_active":"2024-05-07T14:00:57.979030+0000","last_became_peered":"2024-05-07T14:00:57.979030+0000","last_unstale":"2024-05-07T14:02:32.257818+0000","last_undegraded":"2024-05-07T14:02:32.257818+0000","last_fullsized":"2024-05-07T14:02:32.257818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640974+0000","last_change":"2024-05-07T14:00:55.980339+0000","last_active":"2024-05-07T14:02:31.640974+0000","last_peered":"2024-05-07T14:02:31.640974+0000","last_clean":"2024-05-07T14:02:31.640974+0000","last_became_active":"2024-05-07T14:00:55.979609+0000","last_became_peered":"2024-05-07T14:00:55.979609+0000","last_unstale":"2024-05-07T14:02:31.640974+0000","last_undegraded":"2024-05-07T14:02:31.640974+0000","last_fullsized":"2024-05-07T14:02:31.640974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:52.518278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639519+0000","last_change":"2024-05-07T14:00:59.982771+0000","last_active":"2024-05-07T14:02:31.639519+0000","last_peered":"2024-05-07T14:02:31.639519+0000","last_clean":"2024-05-07T14:02:31.639519+0000","last_became_active":"2024-05-07T14:00:59.982018+0000","last_became_peered":"2024-05-07T14:00:59.982018+0000","last_unstale":"2024-05-07T14:02:31.639519+0000","last_undegraded":"2024-05-07T14:02:31.639519+0000","last_fullsized":"2024-05-07T14:02:31.639519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:47.657483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":123,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256091+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:02:32.256091+0000","last_peered":"2024-05-07T14:02:32.256091+0000","last_clean":"2024-05-07T14:02:32.256091+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:02:32.256091+0000","last_undegraded":"2024-05-07T14:02:32.256091+0000","last_fullsized":"2024-05-07T14:02:32.256091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355576+0000","last_change":"2024-05-07T14:01:04.021895+0000","last_active":"2024-05-07T14:02:32.355576+0000","last_peered":"2024-05-07T14:02:32.355576+0000","last_clean":"2024-05-07T14:02:32.355576+0000","last_became_active":"2024-05-07T14:01:04.021043+0000","last_became_peered":"2024-05-07T14:01:04.021043+0000","last_unstale":"2024-05-07T14:02:32.355576+0000","last_undegraded":"2024-05-07T14:02:32.355576+0000","last_fullsized":"2024-05-07T14:02:32.355576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:58.601458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257086+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:02:32.257086+0000","last_peered":"2024-05-07T14:02:32.257086+0000","last_clean":"2024-05-07T14:02:32.257086+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:02:32.257086+0000","last_undegraded":"2024-05-07T14:02:32.257086+0000","last_fullsized":"2024-05-07T14:02:32.257086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634941+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:02:31.634941+0000","last_peered":"2024-05-07T14:02:31.634941+0000","last_clean":"2024-05-07T14:02:31.634941+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:02:31.634941+0000","last_undegraded":"2024-05-07T14:02:31.634941+0000","last_fullsized":"2024-05-07T14:02:31.634941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640735+0000","last_change":"2024-05-07T14:00:55.980488+0000","last_active":"2024-05-07T14:02:31.640735+0000","last_peered":"2024-05-07T14:02:31.640735+0000","last_clean":"2024-05-07T14:02:31.640735+0000","last_became_active":"2024-05-07T14:00:55.979688+0000","last_became_peered":"2024-05-07T14:00:55.979688+0000","last_unstale":"2024-05-07T14:02:31.640735+0000","last_undegraded":"2024-05-07T14:02:31.640735+0000","last_fullsized":"2024-05-07T14:02:31.640735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:32.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":97,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.637922+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:02:31.637922+0000","last_peered":"2024-05-07T14:02:31.637922+0000","last_clean":"2024-05-07T14:02:31.637922+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:02:31.637922+0000","last_undegraded":"2024-05-07T14:02:31.637922+0000","last_fullsized":"2024-05-07T14:02:31.637922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392546+0000","last_change":"2024-05-07T14:01:02.014265+0000","last_active":"2024-05-07T14:02:32.392546+0000","last_peered":"2024-05-07T14:02:32.392546+0000","last_clean":"2024-05-07T14:02:32.392546+0000","last_became_active":"2024-05-07T14:01:02.009335+0000","last_became_peered":"2024-05-07T14:01:02.009335+0000","last_unstale":"2024-05-07T14:02:32.392546+0000","last_undegraded":"2024-05-07T14:02:32.392546+0000","last_fullsized":"2024-05-07T14:02:32.392546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392767+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:02:32.392767+0000","last_peered":"2024-05-07T14:02:32.392767+0000","last_clean":"2024-05-07T14:02:32.392767+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:02:32.392767+0000","last_undegraded":"2024-05-07T14:02:32.392767+0000","last_fullsized":"2024-05-07T14:02:32.392767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004228+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:02:32.004228+0000","last_peered":"2024-05-07T14:02:32.004228+0000","last_clean":"2024-05-07T14:02:32.004228+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:02:32.004228+0000","last_undegraded":"2024-05-07T14:02:32.004228+0000","last_fullsized":"2024-05-07T14:02:32.004228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004623+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:02:32.004623+0000","last_peered":"2024-05-07T14:02:32.004623+0000","last_clean":"2024-05-07T14:02:32.004623+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:02:32.004623+0000","last_undegraded":"2024-05-07T14:02:32.004623+0000","last_fullsized":"2024-05-07T14:02:32.004623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640854+0000","last_change":"2024-05-07T14:00:56.008026+0000","last_active":"2024-05-07T14:02:31.640854+0000","last_peered":"2024-05-07T14:02:31.640854+0000","last_clean":"2024-05-07T14:02:31.640854+0000","last_became_active":"2024-05-07T14:00:56.007374+0000","last_became_peered":"2024-05-07T14:00:56.007374+0000","last_unstale":"2024-05-07T14:02:31.640854+0000","last_undegraded":"2024-05-07T14:02:31.640854+0000","last_fullsized":"2024-05-07T14:02:31.640854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638494+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:02:31.638494+0000","last_peered":"2024-05-07T14:02:31.638494+0000","last_clean":"2024-05-07T14:02:31.638494+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:02:31.638494+0000","last_undegraded":"2024-05-07T14:02:31.638494+0000","last_fullsized":"2024-05-07T14:02:31.638494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":117,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640088+0000","last_change":"2024-05-07T14:01:01.997489+0000","last_active":"2024-05-07T14:02:31.640088+0000","last_peered":"2024-05-07T14:02:31.640088+0000","last_clean":"2024-05-07T14:02:31.640088+0000","last_became_active":"2024-05-07T14:01:01.994656+0000","last_became_peered":"2024-05-07T14:01:01.994656+0000","last_unstale":"2024-05-07T14:02:31.640088+0000","last_undegraded":"2024-05-07T14:02:31.640088+0000","last_fullsized":"2024-05-07T14:02:31.640088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:12.091721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409573+0000","last_change":"2024-05-07T14:01:04.009157+0000","last_active":"2024-05-07T14:02:32.409573+0000","last_peered":"2024-05-07T14:02:32.409573+0000","last_clean":"2024-05-07T14:02:32.409573+0000","last_became_active":"2024-05-07T14:01:04.008594+0000","last_became_peered":"2024-05-07T14:01:04.008594+0000","last_unstale":"2024-05-07T14:02:32.409573+0000","last_undegraded":"2024-05-07T14:02:32.409573+0000","last_fullsized":"2024-05-07T14:02:32.409573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410993+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:02:32.410993+0000","last_peered":"2024-05-07T14:02:32.410993+0000","last_clean":"2024-05-07T14:02:32.410993+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:02:32.410993+0000","last_undegraded":"2024-05-07T14:02:32.410993+0000","last_fullsized":"2024-05-07T14:02:32.410993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410157+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:02:32.410157+0000","last_peered":"2024-05-07T14:02:32.410157+0000","last_clean":"2024-05-07T14:02:32.410157+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:02:32.410157+0000","last_undegraded":"2024-05-07T14:02:32.410157+0000","last_fullsized":"2024-05-07T14:02:32.410157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257706+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:02:32.257706+0000","last_peered":"2024-05-07T14:02:32.257706+0000","last_clean":"2024-05-07T14:02:32.257706+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:02:32.257706+0000","last_undegraded":"2024-05-07T14:02:32.257706+0000","last_fullsized":"2024-05-07T14:02:32.257706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640054+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:02:31.640054+0000","last_peered":"2024-05-07T14:02:31.640054+0000","last_clean":"2024-05-07T14:02:31.640054+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:02:31.640054+0000","last_undegraded":"2024-05-07T14:02:31.640054+0000","last_fullsized":"2024-05-07T14:02:31.640054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":114,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409729+0000","last_change":"2024-05-07T14:01:01.995144+0000","last_active":"2024-05-07T14:02:32.409729+0000","last_peered":"2024-05-07T14:02:32.409729+0000","last_clean":"2024-05-07T14:02:32.409729+0000","last_became_active":"2024-05-07T14:01:01.993073+0000","last_became_peered":"2024-05-07T14:01:01.993073+0000","last_unstale":"2024-05-07T14:02:32.409729+0000","last_undegraded":"2024-05-07T14:02:32.409729+0000","last_fullsized":"2024-05-07T14:02:32.409729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:54.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.637799+0000","last_change":"2024-05-07T14:01:04.012216+0000","last_active":"2024-05-07T14:02:31.637799+0000","last_peered":"2024-05-07T14:02:31.637799+0000","last_clean":"2024-05-07T14:02:31.637799+0000","last_became_active":"2024-05-07T14:01:04.011476+0000","last_became_peered":"2024-05-07T14:01:04.011476+0000","last_unstale":"2024-05-07T14:02:31.637799+0000","last_undegraded":"2024-05-07T14:02:31.637799+0000","last_fullsized":"2024-05-07T14:02:31.637799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:46.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355963+0000","last_change":"2024-05-07T14:01:06.024311+0000","last_active":"2024-05-07T14:02:32.355963+0000","last_peered":"2024-05-07T14:02:32.355963+0000","last_clean":"2024-05-07T14:02:32.355963+0000","last_became_active":"2024-05-07T14:01:06.023404+0000","last_became_peered":"2024-05-07T14:01:06.023404+0000","last_unstale":"2024-05-07T14:02:32.355963+0000","last_undegraded":"2024-05-07T14:02:32.355963+0000","last_fullsized":"2024-05-07T14:02:32.355963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:26.544302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635610+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:02:31.635610+0000","last_peered":"2024-05-07T14:02:31.635610+0000","last_clean":"2024-05-07T14:02:31.635610+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:02:31.635610+0000","last_undegraded":"2024-05-07T14:02:31.635610+0000","last_fullsized":"2024-05-07T14:02:31.635610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391978+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:02:32.391978+0000","last_peered":"2024-05-07T14:02:32.391978+0000","last_clean":"2024-05-07T14:02:32.391978+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:02:32.391978+0000","last_undegraded":"2024-05-07T14:02:32.391978+0000","last_fullsized":"2024-05-07T14:02:32.391978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638434+0000","last_change":"2024-05-07T14:00:59.992897+0000","last_active":"2024-05-07T14:02:31.638434+0000","last_peered":"2024-05-07T14:02:31.638434+0000","last_clean":"2024-05-07T14:02:31.638434+0000","last_became_active":"2024-05-07T14:00:59.992067+0000","last_became_peered":"2024-05-07T14:00:59.992067+0000","last_unstale":"2024-05-07T14:02:31.638434+0000","last_undegraded":"2024-05-07T14:02:31.638434+0000","last_fullsized":"2024-05-07T14:02:31.638434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:19.526884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635917+0000","last_change":"2024-05-07T14:01:02.012335+0000","last_active":"2024-05-07T14:02:31.635917+0000","last_peered":"2024-05-07T14:02:31.635917+0000","last_clean":"2024-05-07T14:02:31.635917+0000","last_became_active":"2024-05-07T14:01:02.011651+0000","last_became_peered":"2024-05-07T14:01:02.011651+0000","last_unstale":"2024-05-07T14:02:31.635917+0000","last_undegraded":"2024-05-07T14:02:31.635917+0000","last_fullsized":"2024-05-07T14:02:31.635917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410607+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:02:32.410607+0000","last_peered":"2024-05-07T14:02:32.410607+0000","last_clean":"2024-05-07T14:02:32.410607+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:02:32.410607+0000","last_undegraded":"2024-05-07T14:02:32.410607+0000","last_fullsized":"2024-05-07T14:02:32.410607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390662+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:02:32.390662+0000","last_peered":"2024-05-07T14:02:32.390662+0000","last_clean":"2024-05-07T14:02:32.390662+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:02:32.390662+0000","last_undegraded":"2024-05-07T14:02:32.390662+0000","last_fullsized":"2024-05-07T14:02:32.390662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636074+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:02:31.636074+0000","last_peered":"2024-05-07T14:02:31.636074+0000","last_clean":"2024-05-07T14:02:31.636074+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:02:31.636074+0000","last_undegraded":"2024-05-07T14:02:31.636074+0000","last_fullsized":"2024-05-07T14:02:31.636074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.003506+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:02:32.003506+0000","last_peered":"2024-05-07T14:02:32.003506+0000","last_clean":"2024-05-07T14:02:32.003506+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:02:32.003506+0000","last_undegraded":"2024-05-07T14:02:32.003506+0000","last_fullsized":"2024-05-07T14:02:32.003506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":97,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356388+0000","last_change":"2024-05-07T14:01:00.006802+0000","last_active":"2024-05-07T14:02:32.356388+0000","last_peered":"2024-05-07T14:02:32.356388+0000","last_clean":"2024-05-07T14:02:32.356388+0000","last_became_active":"2024-05-07T14:01:00.006254+0000","last_became_peered":"2024-05-07T14:01:00.006254+0000","last_unstale":"2024-05-07T14:02:32.356388+0000","last_undegraded":"2024-05-07T14:02:32.356388+0000","last_fullsized":"2024-05-07T14:02:32.356388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:40.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":116,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638613+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:02:31.638613+0000","last_peered":"2024-05-07T14:02:31.638613+0000","last_clean":"2024-05-07T14:02:31.638613+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:02:31.638613+0000","last_undegraded":"2024-05-07T14:02:31.638613+0000","last_fullsized":"2024-05-07T14:02:31.638613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640082+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:02:31.640082+0000","last_peered":"2024-05-07T14:02:31.640082+0000","last_clean":"2024-05-07T14:02:31.640082+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:02:31.640082+0000","last_undegraded":"2024-05-07T14:02:31.640082+0000","last_fullsized":"2024-05-07T14:02:31.640082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355301+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:02:32.355301+0000","last_peered":"2024-05-07T14:02:32.355301+0000","last_clean":"2024-05-07T14:02:32.355301+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:02:32.355301+0000","last_undegraded":"2024-05-07T14:02:32.355301+0000","last_fullsized":"2024-05-07T14:02:32.355301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636367+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:02:31.636367+0000","last_peered":"2024-05-07T14:02:31.636367+0000","last_clean":"2024-05-07T14:02:31.636367+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:02:31.636367+0000","last_undegraded":"2024-05-07T14:02:31.636367+0000","last_fullsized":"2024-05-07T14:02:31.636367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635487+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:02:31.635487+0000","last_peered":"2024-05-07T14:02:31.635487+0000","last_clean":"2024-05-07T14:02:31.635487+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:02:31.635487+0000","last_undegraded":"2024-05-07T14:02:31.635487+0000","last_fullsized":"2024-05-07T14:02:31.635487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257847+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:02:32.257847+0000","last_peered":"2024-05-07T14:02:32.257847+0000","last_clean":"2024-05-07T14:02:32.257847+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:02:32.257847+0000","last_undegraded":"2024-05-07T14:02:32.257847+0000","last_fullsized":"2024-05-07T14:02:32.257847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391230+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:02:32.391230+0000","last_peered":"2024-05-07T14:02:32.391230+0000","last_clean":"2024-05-07T14:02:32.391230+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:02:32.391230+0000","last_undegraded":"2024-05-07T14:02:32.391230+0000","last_fullsized":"2024-05-07T14:02:32.391230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004535+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:02:32.004535+0000","last_peered":"2024-05-07T14:02:32.004535+0000","last_clean":"2024-05-07T14:02:32.004535+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:02:32.004535+0000","last_undegraded":"2024-05-07T14:02:32.004535+0000","last_fullsized":"2024-05-07T14:02:32.004535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635355+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:02:31.635355+0000","last_peered":"2024-05-07T14:02:31.635355+0000","last_clean":"2024-05-07T14:02:31.635355+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:02:31.635355+0000","last_undegraded":"2024-05-07T14:02:31.635355+0000","last_fullsized":"2024-05-07T14:02:31.635355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356351+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:02:32.356351+0000","last_peered":"2024-05-07T14:02:32.356351+0000","last_clean":"2024-05-07T14:02:32.356351+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:02:32.356351+0000","last_undegraded":"2024-05-07T14:02:32.356351+0000","last_fullsized":"2024-05-07T14:02:32.356351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391644+0000","last_change":"2024-05-07T14:00:55.974435+0000","last_active":"2024-05-07T14:02:32.391644+0000","last_peered":"2024-05-07T14:02:32.391644+0000","last_clean":"2024-05-07T14:02:32.391644+0000","last_became_active":"2024-05-07T14:00:55.974010+0000","last_became_peered":"2024-05-07T14:00:55.974010+0000","last_unstale":"2024-05-07T14:02:32.391644+0000","last_undegraded":"2024-05-07T14:02:32.391644+0000","last_fullsized":"2024-05-07T14:02:32.391644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636105+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:02:31.636105+0000","last_peered":"2024-05-07T14:02:31.636105+0000","last_clean":"2024-05-07T14:02:31.636105+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:02:31.636105+0000","last_undegraded":"2024-05-07T14:02:31.636105+0000","last_fullsized":"2024-05-07T14:02:31.636105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":120,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257329+0000","last_change":"2024-05-07T14:01:02.013314+0000","last_active":"2024-05-07T14:02:32.257329+0000","last_peered":"2024-05-07T14:02:32.257329+0000","last_clean":"2024-05-07T14:02:32.257329+0000","last_became_active":"2024-05-07T14:01:02.012667+0000","last_became_peered":"2024-05-07T14:01:02.012667+0000","last_unstale":"2024-05-07T14:02:32.257329+0000","last_undegraded":"2024-05-07T14:02:32.257329+0000","last_fullsized":"2024-05-07T14:02:32.257329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004026+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:02:32.004026+0000","last_peered":"2024-05-07T14:02:32.004026+0000","last_clean":"2024-05-07T14:02:32.004026+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:02:32.004026+0000","last_undegraded":"2024-05-07T14:02:32.004026+0000","last_fullsized":"2024-05-07T14:02:32.004026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355488+0000","last_change":"2024-05-07T14:01:06.031381+0000","last_active":"2024-05-07T14:02:32.355488+0000","last_peered":"2024-05-07T14:02:32.355488+0000","last_clean":"2024-05-07T14:02:32.355488+0000","last_became_active":"2024-05-07T14:01:06.030958+0000","last_became_peered":"2024-05-07T14:01:06.030958+0000","last_unstale":"2024-05-07T14:02:32.355488+0000","last_undegraded":"2024-05-07T14:02:32.355488+0000","last_fullsized":"2024-05-07T14:02:32.355488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:26.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.005047+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:02:32.005047+0000","last_peered":"2024-05-07T14:02:32.005047+0000","last_clean":"2024-05-07T14:02:32.005047+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:02:32.005047+0000","last_undegraded":"2024-05-07T14:02:32.005047+0000","last_fullsized":"2024-05-07T14:02:32.005047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640260+0000","last_change":"2024-05-07T14:00:45.460158+0000","last_active":"2024-05-07T14:02:31.640260+0000","last_peered":"2024-05-07T14:02:31.640260+0000","last_clean":"2024-05-07T14:02:31.640260+0000","last_became_active":"2024-05-07T14:00:45.458198+0000","last_became_peered":"2024-05-07T14:00:45.458198+0000","last_unstale":"2024-05-07T14:02:31.640260+0000","last_undegraded":"2024-05-07T14:02:31.640260+0000","last_fullsized":"2024-05-07T14:02:31.640260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:18.582514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256827+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:02:32.256827+0000","last_peered":"2024-05-07T14:02:32.256827+0000","last_clean":"2024-05-07T14:02:32.256827+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:02:32.256827+0000","last_undegraded":"2024-05-07T14:02:32.256827+0000","last_fullsized":"2024-05-07T14:02:32.256827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638157+0000","last_change":"2024-05-07T14:01:37.317794+0000","last_active":"2024-05-07T14:02:31.638157+0000","last_peered":"2024-05-07T14:02:31.638157+0000","last_clean":"2024-05-07T14:02:31.638157+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:02:31.638157+0000","last_undegraded":"2024-05-07T14:02:31.638157+0000","last_fullsized":"2024-05-07T14:02:31.638157+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:17.582561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640399+0000","last_change":"2024-05-07T14:00:59.988489+0000","last_active":"2024-05-07T14:02:31.640399+0000","last_peered":"2024-05-07T14:02:31.640399+0000","last_clean":"2024-05-07T14:02:31.640399+0000","last_became_active":"2024-05-07T14:00:59.987757+0000","last_became_peered":"2024-05-07T14:00:59.987757+0000","last_unstale":"2024-05-07T14:02:31.640399+0000","last_undegraded":"2024-05-07T14:02:31.640399+0000","last_fullsized":"2024-05-07T14:02:31.640399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":119,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.258075+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:02:32.258075+0000","last_peered":"2024-05-07T14:02:32.258075+0000","last_clean":"2024-05-07T14:02:32.258075+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:02:32.258075+0000","last_undegraded":"2024-05-07T14:02:32.258075+0000","last_fullsized":"2024-05-07T14:02:32.258075+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409106+0000","last_change":"2024-05-07T14:01:04.007712+0000","last_active":"2024-05-07T14:02:32.409106+0000","last_peered":"2024-05-07T14:02:32.409106+0000","last_clean":"2024-05-07T14:02:32.409106+0000","last_became_active":"2024-05-07T14:01:04.006934+0000","last_became_peered":"2024-05-07T14:01:04.006934+0000","last_unstale":"2024-05-07T14:02:32.409106+0000","last_undegraded":"2024-05-07T14:02:32.409106+0000","last_fullsized":"2024-05-07T14:02:32.409106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004345+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:02:32.004345+0000","last_peered":"2024-05-07T14:02:32.004345+0000","last_clean":"2024-05-07T14:02:32.004345+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:02:32.004345+0000","last_undegraded":"2024-05-07T14:02:32.004345+0000","last_fullsized":"2024-05-07T14:02:32.004345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411270+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:02:32.411270+0000","last_peered":"2024-05-07T14:02:32.411270+0000","last_clean":"2024-05-07T14:02:32.411270+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:02:32.411270+0000","last_undegraded":"2024-05-07T14:02:32.411270+0000","last_fullsized":"2024-05-07T14:02:32.411270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640390+0000","last_change":"2024-05-07T14:00:49.930222+0000","last_active":"2024-05-07T14:02:31.640390+0000","last_peered":"2024-05-07T14:02:31.640390+0000","last_clean":"2024-05-07T14:02:31.640390+0000","last_became_active":"2024-05-07T14:00:49.929538+0000","last_became_peered":"2024-05-07T14:00:49.929538+0000","last_unstale":"2024-05-07T14:02:31.640390+0000","last_undegraded":"2024-05-07T14:02:31.640390+0000","last_fullsized":"2024-05-07T14:02:31.640390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:43.069683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408792+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:02:32.408792+0000","last_peered":"2024-05-07T14:02:32.408792+0000","last_clean":"2024-05-07T14:02:32.408792+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:02:32.408792+0000","last_undegraded":"2024-05-07T14:02:32.408792+0000","last_fullsized":"2024-05-07T14:02:32.408792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.258338+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:02:32.258338+0000","last_peered":"2024-05-07T14:02:32.258338+0000","last_clean":"2024-05-07T14:02:32.258338+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:02:32.258338+0000","last_undegraded":"2024-05-07T14:02:32.258338+0000","last_fullsized":"2024-05-07T14:02:32.258338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":150,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356303+0000","last_change":"2024-05-07T14:01:02.014645+0000","last_active":"2024-05-07T14:02:32.356303+0000","last_peered":"2024-05-07T14:02:32.356303+0000","last_clean":"2024-05-07T14:02:32.356303+0000","last_became_active":"2024-05-07T14:01:02.013904+0000","last_became_peered":"2024-05-07T14:01:02.013904+0000","last_unstale":"2024-05-07T14:02:32.356303+0000","last_undegraded":"2024-05-07T14:02:32.356303+0000","last_fullsized":"2024-05-07T14:02:32.356303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:31.441743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640523+0000","last_change":"2024-05-07T14:01:04.012527+0000","last_active":"2024-05-07T14:02:31.640523+0000","last_peered":"2024-05-07T14:02:31.640523+0000","last_clean":"2024-05-07T14:02:31.640523+0000","last_became_active":"2024-05-07T14:01:04.007658+0000","last_became_peered":"2024-05-07T14:01:04.007658+0000","last_unstale":"2024-05-07T14:02:31.640523+0000","last_undegraded":"2024-05-07T14:02:31.640523+0000","last_fullsized":"2024-05-07T14:02:31.640523+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355410+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:02:32.355410+0000","last_peered":"2024-05-07T14:02:32.355410+0000","last_clean":"2024-05-07T14:02:32.355410+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:02:32.355410+0000","last_undegraded":"2024-05-07T14:02:32.355410+0000","last_fullsized":"2024-05-07T14:02:32.355410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356422+0000","last_change":"2024-05-07T14:00:57.989314+0000","last_active":"2024-05-07T14:02:32.356422+0000","last_peered":"2024-05-07T14:02:32.356422+0000","last_clean":"2024-05-07T14:02:32.356422+0000","last_became_active":"2024-05-07T14:00:57.988994+0000","last_became_peered":"2024-05-07T14:00:57.988994+0000","last_unstale":"2024-05-07T14:02:32.356422+0000","last_undegraded":"2024-05-07T14:02:32.356422+0000","last_fullsized":"2024-05-07T14:02:32.356422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638224+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:02:31.638224+0000","last_peered":"2024-05-07T14:02:31.638224+0000","last_clean":"2024-05-07T14:02:31.638224+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:02:31.638224+0000","last_undegraded":"2024-05-07T14:02:31.638224+0000","last_fullsized":"2024-05-07T14:02:31.638224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.354684+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:02:32.354684+0000","last_peered":"2024-05-07T14:02:32.354684+0000","last_clean":"2024-05-07T14:02:32.354684+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:02:32.354684+0000","last_undegraded":"2024-05-07T14:02:32.354684+0000","last_fullsized":"2024-05-07T14:02:32.354684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640173+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:02:31.640173+0000","last_peered":"2024-05-07T14:02:31.640173+0000","last_clean":"2024-05-07T14:02:31.640173+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:02:31.640173+0000","last_undegraded":"2024-05-07T14:02:31.640173+0000","last_fullsized":"2024-05-07T14:02:31.640173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":131,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640679+0000","last_change":"2024-05-07T14:01:02.148182+0000","last_active":"2024-05-07T14:02:31.640679+0000","last_peered":"2024-05-07T14:02:31.640679+0000","last_clean":"2024-05-07T14:02:31.640679+0000","last_became_active":"2024-05-07T14:01:02.147442+0000","last_became_peered":"2024-05-07T14:01:02.147442+0000","last_unstale":"2024-05-07T14:02:31.640679+0000","last_undegraded":"2024-05-07T14:02:31.640679+0000","last_fullsized":"2024-05-07T14:02:31.640679+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:24.955989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409049+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:02:32.409049+0000","last_peered":"2024-05-07T14:02:32.409049+0000","last_clean":"2024-05-07T14:02:32.409049+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:02:32.409049+0000","last_undegraded":"2024-05-07T14:02:32.409049+0000","last_fullsized":"2024-05-07T14:02:32.409049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392329+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:02:32.392329+0000","last_peered":"2024-05-07T14:02:32.392329+0000","last_clean":"2024-05-07T14:02:32.392329+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:02:32.392329+0000","last_undegraded":"2024-05-07T14:02:32.392329+0000","last_fullsized":"2024-05-07T14:02:32.392329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":54,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257259+0000","last_change":"2024-05-07T14:01:37.318739+0000","last_active":"2024-05-07T14:02:32.257259+0000","last_peered":"2024-05-07T14:02:32.257259+0000","last_clean":"2024-05-07T14:02:32.257259+0000","last_became_active":"2024-05-07T14:01:37.317858+0000","last_became_peered":"2024-05-07T14:01:37.317858+0000","last_unstale":"2024-05-07T14:02:32.257259+0000","last_undegraded":"2024-05-07T14:02:32.257259+0000","last_fullsized":"2024-05-07T14:02:32.257259+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:42:22.624696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256903+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:02:32.256903+0000","last_peered":"2024-05-07T14:02:32.256903+0000","last_clean":"2024-05-07T14:02:32.256903+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:02:32.256903+0000","last_undegraded":"2024-05-07T14:02:32.256903+0000","last_fullsized":"2024-05-07T14:02:32.256903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635777+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:02:31.635777+0000","last_peered":"2024-05-07T14:02:31.635777+0000","last_clean":"2024-05-07T14:02:31.635777+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:02:31.635777+0000","last_undegraded":"2024-05-07T14:02:31.635777+0000","last_fullsized":"2024-05-07T14:02:31.635777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410623+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:02:32.410623+0000","last_peered":"2024-05-07T14:02:32.410623+0000","last_clean":"2024-05-07T14:02:32.410623+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:02:32.410623+0000","last_undegraded":"2024-05-07T14:02:32.410623+0000","last_fullsized":"2024-05-07T14:02:32.410623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391598+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:02:32.391598+0000","last_peered":"2024-05-07T14:02:32.391598+0000","last_clean":"2024-05-07T14:02:32.391598+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:02:32.391598+0000","last_undegraded":"2024-05-07T14:02:32.391598+0000","last_fullsized":"2024-05-07T14:02:32.391598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004517+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:02:32.004517+0000","last_peered":"2024-05-07T14:02:32.004517+0000","last_clean":"2024-05-07T14:02:32.004517+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:02:32.004517+0000","last_undegraded":"2024-05-07T14:02:32.004517+0000","last_fullsized":"2024-05-07T14:02:32.004517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256515+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:02:32.256515+0000","last_peered":"2024-05-07T14:02:32.256515+0000","last_clean":"2024-05-07T14:02:32.256515+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:02:32.256515+0000","last_undegraded":"2024-05-07T14:02:32.256515+0000","last_fullsized":"2024-05-07T14:02:32.256515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355718+0000","last_change":"2024-05-07T14:00:57.989747+0000","last_active":"2024-05-07T14:02:32.355718+0000","last_peered":"2024-05-07T14:02:32.355718+0000","last_clean":"2024-05-07T14:02:32.355718+0000","last_became_active":"2024-05-07T14:00:57.989252+0000","last_became_peered":"2024-05-07T14:00:57.989252+0000","last_unstale":"2024-05-07T14:02:32.355718+0000","last_undegraded":"2024-05-07T14:02:32.355718+0000","last_fullsized":"2024-05-07T14:02:32.355718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:44.815601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.258132+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:02:32.258132+0000","last_peered":"2024-05-07T14:02:32.258132+0000","last_clean":"2024-05-07T14:02:32.258132+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:02:32.258132+0000","last_undegraded":"2024-05-07T14:02:32.258132+0000","last_fullsized":"2024-05-07T14:02:32.258132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356638+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:02:32.356638+0000","last_peered":"2024-05-07T14:02:32.356638+0000","last_clean":"2024-05-07T14:02:32.356638+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:02:32.356638+0000","last_undegraded":"2024-05-07T14:02:32.356638+0000","last_fullsized":"2024-05-07T14:02:32.356638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409819+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:02:32.409819+0000","last_peered":"2024-05-07T14:02:32.409819+0000","last_clean":"2024-05-07T14:02:32.409819+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:02:32.409819+0000","last_undegraded":"2024-05-07T14:02:32.409819+0000","last_fullsized":"2024-05-07T14:02:32.409819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":123,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409777+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:02:32.409777+0000","last_peered":"2024-05-07T14:02:32.409777+0000","last_clean":"2024-05-07T14:02:32.409777+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:02:32.409777+0000","last_undegraded":"2024-05-07T14:02:32.409777+0000","last_fullsized":"2024-05-07T14:02:32.409777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634736+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:02:31.634736+0000","last_peered":"2024-05-07T14:02:31.634736+0000","last_clean":"2024-05-07T14:02:31.634736+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:02:31.634736+0000","last_undegraded":"2024-05-07T14:02:31.634736+0000","last_fullsized":"2024-05-07T14:02:31.634736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410817+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:02:32.410817+0000","last_peered":"2024-05-07T14:02:32.410817+0000","last_clean":"2024-05-07T14:02:32.410817+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:02:32.410817+0000","last_undegraded":"2024-05-07T14:02:32.410817+0000","last_fullsized":"2024-05-07T14:02:32.410817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410076+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:02:32.410076+0000","last_peered":"2024-05-07T14:02:32.410076+0000","last_clean":"2024-05-07T14:02:32.410076+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:02:32.410076+0000","last_undegraded":"2024-05-07T14:02:32.410076+0000","last_fullsized":"2024-05-07T14:02:32.410076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355091+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:02:32.355091+0000","last_peered":"2024-05-07T14:02:32.355091+0000","last_clean":"2024-05-07T14:02:32.355091+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:02:32.355091+0000","last_undegraded":"2024-05-07T14:02:32.355091+0000","last_fullsized":"2024-05-07T14:02:32.355091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640996+0000","last_change":"2024-05-07T14:00:49.928907+0000","last_active":"2024-05-07T14:02:31.640996+0000","last_peered":"2024-05-07T14:02:31.640996+0000","last_clean":"2024-05-07T14:02:31.640996+0000","last_became_active":"2024-05-07T14:00:49.928146+0000","last_became_peered":"2024-05-07T14:00:49.928146+0000","last_unstale":"2024-05-07T14:02:31.640996+0000","last_undegraded":"2024-05-07T14:02:31.640996+0000","last_fullsized":"2024-05-07T14:02:31.640996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:07.032835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004435+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:02:32.004435+0000","last_peered":"2024-05-07T14:02:32.004435+0000","last_clean":"2024-05-07T14:02:32.004435+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:02:32.004435+0000","last_undegraded":"2024-05-07T14:02:32.004435+0000","last_fullsized":"2024-05-07T14:02:32.004435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":112,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355206+0000","last_change":"2024-05-07T14:01:02.148499+0000","last_active":"2024-05-07T14:02:32.355206+0000","last_peered":"2024-05-07T14:02:32.355206+0000","last_clean":"2024-05-07T14:02:32.355206+0000","last_became_active":"2024-05-07T14:01:02.147567+0000","last_became_peered":"2024-05-07T14:01:02.147567+0000","last_unstale":"2024-05-07T14:02:32.355206+0000","last_undegraded":"2024-05-07T14:02:32.355206+0000","last_fullsized":"2024-05-07T14:02:32.355206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:30.162886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257409+0000","last_change":"2024-05-07T14:01:04.015930+0000","last_active":"2024-05-07T14:02:32.257409+0000","last_peered":"2024-05-07T14:02:32.257409+0000","last_clean":"2024-05-07T14:02:32.257409+0000","last_became_active":"2024-05-07T14:01:04.011643+0000","last_became_peered":"2024-05-07T14:01:04.011643+0000","last_unstale":"2024-05-07T14:02:32.257409+0000","last_undegraded":"2024-05-07T14:02:32.257409+0000","last_fullsized":"2024-05-07T14:02:32.257409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392166+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:02:32.392166+0000","last_peered":"2024-05-07T14:02:32.392166+0000","last_clean":"2024-05-07T14:02:32.392166+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:02:32.392166+0000","last_undegraded":"2024-05-07T14:02:32.392166+0000","last_fullsized":"2024-05-07T14:02:32.392166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390923+0000","last_change":"2024-05-07T14:00:57.998539+0000","last_active":"2024-05-07T14:02:32.390923+0000","last_peered":"2024-05-07T14:02:32.390923+0000","last_clean":"2024-05-07T14:02:32.390923+0000","last_became_active":"2024-05-07T14:00:57.998025+0000","last_became_peered":"2024-05-07T14:00:57.998025+0000","last_unstale":"2024-05-07T14:02:32.390923+0000","last_undegraded":"2024-05-07T14:02:32.390923+0000","last_fullsized":"2024-05-07T14:02:32.390923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391887+0000","last_change":"2024-05-07T14:00:55.988508+0000","last_active":"2024-05-07T14:02:32.391887+0000","last_peered":"2024-05-07T14:02:32.391887+0000","last_clean":"2024-05-07T14:02:32.391887+0000","last_became_active":"2024-05-07T14:00:55.988230+0000","last_became_peered":"2024-05-07T14:00:55.988230+0000","last_unstale":"2024-05-07T14:02:32.391887+0000","last_undegraded":"2024-05-07T14:02:32.391887+0000","last_fullsized":"2024-05-07T14:02:32.391887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356213+0000","last_change":"2024-05-07T14:00:49.936072+0000","last_active":"2024-05-07T14:02:32.356213+0000","last_peered":"2024-05-07T14:02:32.356213+0000","last_clean":"2024-05-07T14:02:32.356213+0000","last_became_active":"2024-05-07T14:00:49.935768+0000","last_became_peered":"2024-05-07T14:00:49.935768+0000","last_unstale":"2024-05-07T14:02:32.356213+0000","last_undegraded":"2024-05-07T14:02:32.356213+0000","last_fullsized":"2024-05-07T14:02:32.356213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634918+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:02:31.634918+0000","last_peered":"2024-05-07T14:02:31.634918+0000","last_clean":"2024-05-07T14:02:31.634918+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:02:31.634918+0000","last_undegraded":"2024-05-07T14:02:31.634918+0000","last_fullsized":"2024-05-07T14:02:31.634918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635502+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:02:31.635502+0000","last_peered":"2024-05-07T14:02:31.635502+0000","last_clean":"2024-05-07T14:02:31.635502+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:02:31.635502+0000","last_undegraded":"2024-05-07T14:02:31.635502+0000","last_fullsized":"2024-05-07T14:02:31.635502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391794+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:02:32.391794+0000","last_peered":"2024-05-07T14:02:32.391794+0000","last_clean":"2024-05-07T14:02:32.391794+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:02:32.391794+0000","last_undegraded":"2024-05-07T14:02:32.391794+0000","last_fullsized":"2024-05-07T14:02:32.391794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410429+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:02:32.410429+0000","last_peered":"2024-05-07T14:02:32.410429+0000","last_clean":"2024-05-07T14:02:32.410429+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:02:32.410429+0000","last_undegraded":"2024-05-07T14:02:32.410429+0000","last_fullsized":"2024-05-07T14:02:32.410429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635240+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:02:31.635240+0000","last_peered":"2024-05-07T14:02:31.635240+0000","last_clean":"2024-05-07T14:02:31.635240+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:02:31.635240+0000","last_undegraded":"2024-05-07T14:02:31.635240+0000","last_fullsized":"2024-05-07T14:02:31.635240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411400+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:02:32.411400+0000","last_peered":"2024-05-07T14:02:32.411400+0000","last_clean":"2024-05-07T14:02:32.411400+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:02:32.411400+0000","last_undegraded":"2024-05-07T14:02:32.411400+0000","last_fullsized":"2024-05-07T14:02:32.411400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.005023+0000","last_change":"2024-05-07T14:00:49.938879+0000","last_active":"2024-05-07T14:02:32.005023+0000","last_peered":"2024-05-07T14:02:32.005023+0000","last_clean":"2024-05-07T14:02:32.005023+0000","last_became_active":"2024-05-07T14:00:49.938066+0000","last_became_peered":"2024-05-07T14:00:49.938066+0000","last_unstale":"2024-05-07T14:02:32.005023+0000","last_undegraded":"2024-05-07T14:02:32.005023+0000","last_fullsized":"2024-05-07T14:02:32.005023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390805+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:02:32.390805+0000","last_peered":"2024-05-07T14:02:32.390805+0000","last_clean":"2024-05-07T14:02:32.390805+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:02:32.390805+0000","last_undegraded":"2024-05-07T14:02:32.390805+0000","last_fullsized":"2024-05-07T14:02:32.390805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":128,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639659+0000","last_change":"2024-05-07T14:01:02.148095+0000","last_active":"2024-05-07T14:02:31.639659+0000","last_peered":"2024-05-07T14:02:31.639659+0000","last_clean":"2024-05-07T14:02:31.639659+0000","last_became_active":"2024-05-07T14:01:02.147334+0000","last_became_peered":"2024-05-07T14:01:02.147334+0000","last_unstale":"2024-05-07T14:02:31.639659+0000","last_undegraded":"2024-05-07T14:02:31.639659+0000","last_fullsized":"2024-05-07T14:02:31.639659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392864+0000","last_change":"2024-05-07T14:01:04.024279+0000","last_active":"2024-05-07T14:02:32.392864+0000","last_peered":"2024-05-07T14:02:32.392864+0000","last_clean":"2024-05-07T14:02:32.392864+0000","last_became_active":"2024-05-07T14:01:04.022870+0000","last_became_peered":"2024-05-07T14:01:04.022870+0000","last_unstale":"2024-05-07T14:02:32.392864+0000","last_undegraded":"2024-05-07T14:02:32.392864+0000","last_fullsized":"2024-05-07T14:02:32.392864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:28.158572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257047+0000","last_change":"2024-05-07T14:01:06.039788+0000","last_active":"2024-05-07T14:02:32.257047+0000","last_peered":"2024-05-07T14:02:32.257047+0000","last_clean":"2024-05-07T14:02:32.257047+0000","last_became_active":"2024-05-07T14:01:06.039050+0000","last_became_peered":"2024-05-07T14:01:06.039050+0000","last_unstale":"2024-05-07T14:02:32.257047+0000","last_undegraded":"2024-05-07T14:02:32.257047+0000","last_fullsized":"2024-05-07T14:02:32.257047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410592+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:02:32.410592+0000","last_peered":"2024-05-07T14:02:32.410592+0000","last_clean":"2024-05-07T14:02:32.410592+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:02:32.410592+0000","last_undegraded":"2024-05-07T14:02:32.410592+0000","last_fullsized":"2024-05-07T14:02:32.410592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635383+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:02:31.635383+0000","last_peered":"2024-05-07T14:02:31.635383+0000","last_clean":"2024-05-07T14:02:31.635383+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:02:31.635383+0000","last_undegraded":"2024-05-07T14:02:31.635383+0000","last_fullsized":"2024-05-07T14:02:31.635383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635151+0000","last_change":"2024-05-07T14:00:55.991934+0000","last_active":"2024-05-07T14:02:31.635151+0000","last_peered":"2024-05-07T14:02:31.635151+0000","last_clean":"2024-05-07T14:02:31.635151+0000","last_became_active":"2024-05-07T14:00:55.991303+0000","last_became_peered":"2024-05-07T14:00:55.991303+0000","last_unstale":"2024-05-07T14:02:31.635151+0000","last_undegraded":"2024-05-07T14:02:31.635151+0000","last_fullsized":"2024-05-07T14:02:31.635151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355809+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:02:32.355809+0000","last_peered":"2024-05-07T14:02:32.355809+0000","last_clean":"2024-05-07T14:02:32.355809+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:02:32.355809+0000","last_undegraded":"2024-05-07T14:02:32.355809+0000","last_fullsized":"2024-05-07T14:02:32.355809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390229+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:02:32.390229+0000","last_peered":"2024-05-07T14:02:32.390229+0000","last_clean":"2024-05-07T14:02:32.390229+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:02:32.390229+0000","last_undegraded":"2024-05-07T14:02:32.390229+0000","last_fullsized":"2024-05-07T14:02:32.390229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390456+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:02:32.390456+0000","last_peered":"2024-05-07T14:02:32.390456+0000","last_clean":"2024-05-07T14:02:32.390456+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:02:32.390456+0000","last_undegraded":"2024-05-07T14:02:32.390456+0000","last_fullsized":"2024-05-07T14:02:32.390456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391361+0000","last_change":"2024-05-07T14:01:06.013974+0000","last_active":"2024-05-07T14:02:32.391361+0000","last_peered":"2024-05-07T14:02:32.391361+0000","last_clean":"2024-05-07T14:02:32.391361+0000","last_became_active":"2024-05-07T14:01:06.013281+0000","last_became_peered":"2024-05-07T14:01:06.013281+0000","last_unstale":"2024-05-07T14:02:32.391361+0000","last_undegraded":"2024-05-07T14:02:32.391361+0000","last_fullsized":"2024-05-07T14:02:32.391361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:46.349394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355642+0000","last_change":"2024-05-07T14:00:58.001752+0000","last_active":"2024-05-07T14:02:32.355642+0000","last_peered":"2024-05-07T14:02:32.355642+0000","last_clean":"2024-05-07T14:02:32.355642+0000","last_became_active":"2024-05-07T14:00:57.999982+0000","last_became_peered":"2024-05-07T14:00:57.999982+0000","last_unstale":"2024-05-07T14:02:32.355642+0000","last_undegraded":"2024-05-07T14:02:32.355642+0000","last_fullsized":"2024-05-07T14:02:32.355642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640857+0000","last_change":"2024-05-07T14:00:55.968287+0000","last_active":"2024-05-07T14:02:31.640857+0000","last_peered":"2024-05-07T14:02:31.640857+0000","last_clean":"2024-05-07T14:02:31.640857+0000","last_became_active":"2024-05-07T14:00:55.967578+0000","last_became_peered":"2024-05-07T14:00:55.967578+0000","last_unstale":"2024-05-07T14:02:31.640857+0000","last_undegraded":"2024-05-07T14:02:31.640857+0000","last_fullsized":"2024-05-07T14:02:31.640857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392255+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:02:32.392255+0000","last_peered":"2024-05-07T14:02:32.392255+0000","last_clean":"2024-05-07T14:02:32.392255+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:02:32.392255+0000","last_undegraded":"2024-05-07T14:02:32.392255+0000","last_fullsized":"2024-05-07T14:02:32.392255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"46'5","reported_seq":98,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409638+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:02:32.409638+0000","last_peered":"2024-05-07T14:02:32.409638+0000","last_clean":"2024-05-07T14:02:32.409638+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:02:32.409638+0000","last_undegraded":"2024-05-07T14:02:32.409638+0000","last_fullsized":"2024-05-07T14:02:32.409638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639595+0000","last_change":"2024-05-07T14:01:04.012628+0000","last_active":"2024-05-07T14:02:31.639595+0000","last_peered":"2024-05-07T14:02:31.639595+0000","last_clean":"2024-05-07T14:02:31.639595+0000","last_became_active":"2024-05-07T14:01:04.011910+0000","last_became_peered":"2024-05-07T14:01:04.011910+0000","last_unstale":"2024-05-07T14:02:31.639595+0000","last_undegraded":"2024-05-07T14:02:31.639595+0000","last_fullsized":"2024-05-07T14:02:31.639595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410530+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:02:32.410530+0000","last_peered":"2024-05-07T14:02:32.410530+0000","last_clean":"2024-05-07T14:02:32.410530+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:02:32.410530+0000","last_undegraded":"2024-05-07T14:02:32.410530+0000","last_fullsized":"2024-05-07T14:02:32.410530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390541+0000","last_change":"2024-05-07T14:00:57.999019+0000","last_active":"2024-05-07T14:02:32.390541+0000","last_peered":"2024-05-07T14:02:32.390541+0000","last_clean":"2024-05-07T14:02:32.390541+0000","last_became_active":"2024-05-07T14:00:57.998526+0000","last_became_peered":"2024-05-07T14:00:57.998526+0000","last_unstale":"2024-05-07T14:02:32.390541+0000","last_undegraded":"2024-05-07T14:02:32.390541+0000","last_fullsized":"2024-05-07T14:02:32.390541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255566+0000","last_change":"2024-05-07T14:00:55.999548+0000","last_active":"2024-05-07T14:02:32.255566+0000","last_peered":"2024-05-07T14:02:32.255566+0000","last_clean":"2024-05-07T14:02:32.255566+0000","last_became_active":"2024-05-07T14:00:55.995284+0000","last_became_peered":"2024-05-07T14:00:55.995284+0000","last_unstale":"2024-05-07T14:02:32.255566+0000","last_undegraded":"2024-05-07T14:02:32.255566+0000","last_fullsized":"2024-05-07T14:02:32.255566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639182+0000","last_change":"2024-05-07T14:00:59.996971+0000","last_active":"2024-05-07T14:02:31.639182+0000","last_peered":"2024-05-07T14:02:31.639182+0000","last_clean":"2024-05-07T14:02:31.639182+0000","last_became_active":"2024-05-07T14:00:59.996254+0000","last_became_peered":"2024-05-07T14:00:59.996254+0000","last_unstale":"2024-05-07T14:02:31.639182+0000","last_undegraded":"2024-05-07T14:02:31.639182+0000","last_fullsized":"2024-05-07T14:02:31.639182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392101+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:02:32.392101+0000","last_peered":"2024-05-07T14:02:32.392101+0000","last_clean":"2024-05-07T14:02:32.392101+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:02:32.392101+0000","last_undegraded":"2024-05-07T14:02:32.392101+0000","last_fullsized":"2024-05-07T14:02:32.392101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004389+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:02:32.004389+0000","last_peered":"2024-05-07T14:02:32.004389+0000","last_clean":"2024-05-07T14:02:32.004389+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:02:32.004389+0000","last_undegraded":"2024-05-07T14:02:32.004389+0000","last_fullsized":"2024-05-07T14:02:32.004389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256988+0000","last_change":"2024-05-07T14:01:06.038138+0000","last_active":"2024-05-07T14:02:32.256988+0000","last_peered":"2024-05-07T14:02:32.256988+0000","last_clean":"2024-05-07T14:02:32.256988+0000","last_became_active":"2024-05-07T14:01:06.030966+0000","last_became_peered":"2024-05-07T14:01:06.030966+0000","last_unstale":"2024-05-07T14:02:32.256988+0000","last_undegraded":"2024-05-07T14:02:32.256988+0000","last_fullsized":"2024-05-07T14:02:32.256988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391039+0000","last_change":"2024-05-07T14:00:57.987879+0000","last_active":"2024-05-07T14:02:32.391039+0000","last_peered":"2024-05-07T14:02:32.391039+0000","last_clean":"2024-05-07T14:02:32.391039+0000","last_became_active":"2024-05-07T14:00:57.987544+0000","last_became_peered":"2024-05-07T14:00:57.987544+0000","last_unstale":"2024-05-07T14:02:32.391039+0000","last_undegraded":"2024-05-07T14:02:32.391039+0000","last_fullsized":"2024-05-07T14:02:32.391039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.643382+0000","last_change":"2024-05-07T14:01:37.318408+0000","last_active":"2024-05-07T14:02:31.643382+0000","last_peered":"2024-05-07T14:02:31.643382+0000","last_clean":"2024-05-07T14:02:31.643382+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:02:31.643382+0000","last_undegraded":"2024-05-07T14:02:31.643382+0000","last_fullsized":"2024-05-07T14:02:31.643382+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:43.643434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004141+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:02:32.004141+0000","last_peered":"2024-05-07T14:02:32.004141+0000","last_clean":"2024-05-07T14:02:32.004141+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:02:32.004141+0000","last_undegraded":"2024-05-07T14:02:32.004141+0000","last_fullsized":"2024-05-07T14:02:32.004141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639461+0000","last_change":"2024-05-07T14:01:01.995377+0000","last_active":"2024-05-07T14:02:31.639461+0000","last_peered":"2024-05-07T14:02:31.639461+0000","last_clean":"2024-05-07T14:02:31.639461+0000","last_became_active":"2024-05-07T14:01:01.994566+0000","last_became_peered":"2024-05-07T14:01:01.994566+0000","last_unstale":"2024-05-07T14:02:31.639461+0000","last_undegraded":"2024-05-07T14:02:31.639461+0000","last_fullsized":"2024-05-07T14:02:31.639461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409159+0000","last_change":"2024-05-07T14:01:03.997116+0000","last_active":"2024-05-07T14:02:32.409159+0000","last_peered":"2024-05-07T14:02:32.409159+0000","last_clean":"2024-05-07T14:02:32.409159+0000","last_became_active":"2024-05-07T14:01:03.996555+0000","last_became_peered":"2024-05-07T14:01:03.996555+0000","last_unstale":"2024-05-07T14:02:32.409159+0000","last_undegraded":"2024-05-07T14:02:32.409159+0000","last_fullsized":"2024-05-07T14:02:32.409159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004797+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:02:32.004797+0000","last_peered":"2024-05-07T14:02:32.004797+0000","last_clean":"2024-05-07T14:02:32.004797+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:02:32.004797+0000","last_undegraded":"2024-05-07T14:02:32.004797+0000","last_fullsized":"2024-05-07T14:02:32.004797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391560+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:02:32.391560+0000","last_peered":"2024-05-07T14:02:32.391560+0000","last_clean":"2024-05-07T14:02:32.391560+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:02:32.391560+0000","last_undegraded":"2024-05-07T14:02:32.391560+0000","last_fullsized":"2024-05-07T14:02:32.391560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411078+0000","last_change":"2024-05-07T14:00:59.995694+0000","last_active":"2024-05-07T14:02:32.411078+0000","last_peered":"2024-05-07T14:02:32.411078+0000","last_clean":"2024-05-07T14:02:32.411078+0000","last_became_active":"2024-05-07T14:00:59.993899+0000","last_became_peered":"2024-05-07T14:00:59.993899+0000","last_unstale":"2024-05-07T14:02:32.411078+0000","last_undegraded":"2024-05-07T14:02:32.411078+0000","last_fullsized":"2024-05-07T14:02:32.411078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:28.225348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":114,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356788+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:02:32.356788+0000","last_peered":"2024-05-07T14:02:32.356788+0000","last_clean":"2024-05-07T14:02:32.356788+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:02:32.356788+0000","last_undegraded":"2024-05-07T14:02:32.356788+0000","last_fullsized":"2024-05-07T14:02:32.356788+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257183+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:02:32.257183+0000","last_peered":"2024-05-07T14:02:32.257183+0000","last_clean":"2024-05-07T14:02:32.257183+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:02:32.257183+0000","last_undegraded":"2024-05-07T14:02:32.257183+0000","last_fullsized":"2024-05-07T14:02:32.257183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391893+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:02:32.391893+0000","last_peered":"2024-05-07T14:02:32.391893+0000","last_clean":"2024-05-07T14:02:32.391893+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:02:32.391893+0000","last_undegraded":"2024-05-07T14:02:32.391893+0000","last_fullsized":"2024-05-07T14:02:32.391893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411199+0000","last_change":"2024-05-07T14:00:57.995989+0000","last_active":"2024-05-07T14:02:32.411199+0000","last_peered":"2024-05-07T14:02:32.411199+0000","last_clean":"2024-05-07T14:02:32.411199+0000","last_became_active":"2024-05-07T14:00:57.995721+0000","last_became_peered":"2024-05-07T14:00:57.995721+0000","last_unstale":"2024-05-07T14:02:32.411199+0000","last_undegraded":"2024-05-07T14:02:32.411199+0000","last_fullsized":"2024-05-07T14:02:32.411199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355551+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:02:32.355551+0000","last_peered":"2024-05-07T14:02:32.355551+0000","last_clean":"2024-05-07T14:02:32.355551+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:02:32.355551+0000","last_undegraded":"2024-05-07T14:02:32.355551+0000","last_fullsized":"2024-05-07T14:02:32.355551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004702+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:02:32.004702+0000","last_peered":"2024-05-07T14:02:32.004702+0000","last_clean":"2024-05-07T14:02:32.004702+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:02:32.004702+0000","last_undegraded":"2024-05-07T14:02:32.004702+0000","last_fullsized":"2024-05-07T14:02:32.004702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":117,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639868+0000","last_change":"2024-05-07T14:01:02.002384+0000","last_active":"2024-05-07T14:02:31.639868+0000","last_peered":"2024-05-07T14:02:31.639868+0000","last_clean":"2024-05-07T14:02:31.639868+0000","last_became_active":"2024-05-07T14:01:02.001676+0000","last_became_peered":"2024-05-07T14:01:02.001676+0000","last_unstale":"2024-05-07T14:02:31.639868+0000","last_undegraded":"2024-05-07T14:02:31.639868+0000","last_fullsized":"2024-05-07T14:02:31.639868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.354935+0000","last_change":"2024-05-07T14:01:04.015893+0000","last_active":"2024-05-07T14:02:32.354935+0000","last_peered":"2024-05-07T14:02:32.354935+0000","last_clean":"2024-05-07T14:02:32.354935+0000","last_became_active":"2024-05-07T14:01:04.015329+0000","last_became_peered":"2024-05-07T14:01:04.015329+0000","last_unstale":"2024-05-07T14:02:32.354935+0000","last_undegraded":"2024-05-07T14:02:32.354935+0000","last_fullsized":"2024-05-07T14:02:32.354935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:53.413495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004057+0000","last_change":"2024-05-07T14:01:06.025917+0000","last_active":"2024-05-07T14:02:32.004057+0000","last_peered":"2024-05-07T14:02:32.004057+0000","last_clean":"2024-05-07T14:02:32.004057+0000","last_became_active":"2024-05-07T14:01:06.025044+0000","last_became_peered":"2024-05-07T14:01:06.025044+0000","last_unstale":"2024-05-07T14:02:32.004057+0000","last_undegraded":"2024-05-07T14:02:32.004057+0000","last_fullsized":"2024-05-07T14:02:32.004057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:55.419668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391344+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:02:32.391344+0000","last_peered":"2024-05-07T14:02:32.391344+0000","last_clean":"2024-05-07T14:02:32.391344+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:02:32.391344+0000","last_undegraded":"2024-05-07T14:02:32.391344+0000","last_fullsized":"2024-05-07T14:02:32.391344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635813+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:02:31.635813+0000","last_peered":"2024-05-07T14:02:31.635813+0000","last_clean":"2024-05-07T14:02:31.635813+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:02:31.635813+0000","last_undegraded":"2024-05-07T14:02:31.635813+0000","last_fullsized":"2024-05-07T14:02:31.635813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636179+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:02:31.636179+0000","last_peered":"2024-05-07T14:02:31.636179+0000","last_clean":"2024-05-07T14:02:31.636179+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:02:31.636179+0000","last_undegraded":"2024-05-07T14:02:31.636179+0000","last_fullsized":"2024-05-07T14:02:31.636179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392289+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:02:32.392289+0000","last_peered":"2024-05-07T14:02:32.392289+0000","last_clean":"2024-05-07T14:02:32.392289+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:02:32.392289+0000","last_undegraded":"2024-05-07T14:02:32.392289+0000","last_fullsized":"2024-05-07T14:02:32.392289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356057+0000","last_change":"2024-05-07T14:01:04.026470+0000","last_active":"2024-05-07T14:02:32.356057+0000","last_peered":"2024-05-07T14:02:32.356057+0000","last_clean":"2024-05-07T14:02:32.356057+0000","last_became_active":"2024-05-07T14:01:04.025881+0000","last_became_peered":"2024-05-07T14:01:04.025881+0000","last_unstale":"2024-05-07T14:02:32.356057+0000","last_undegraded":"2024-05-07T14:02:32.356057+0000","last_fullsized":"2024-05-07T14:02:32.356057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:54.595283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256529+0000","last_change":"2024-05-07T14:01:06.038979+0000","last_active":"2024-05-07T14:02:32.256529+0000","last_peered":"2024-05-07T14:02:32.256529+0000","last_clean":"2024-05-07T14:02:32.256529+0000","last_became_active":"2024-05-07T14:01:06.035737+0000","last_became_peered":"2024-05-07T14:01:06.035737+0000","last_unstale":"2024-05-07T14:02:32.256529+0000","last_undegraded":"2024-05-07T14:02:32.256529+0000","last_fullsized":"2024-05-07T14:02:32.256529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.643372+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:02:31.643372+0000","last_peered":"2024-05-07T14:02:31.643372+0000","last_clean":"2024-05-07T14:02:31.643372+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:02:31.643372+0000","last_undegraded":"2024-05-07T14:02:31.643372+0000","last_fullsized":"2024-05-07T14:02:31.643372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409055+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:02:32.409055+0000","last_peered":"2024-05-07T14:02:32.409055+0000","last_clean":"2024-05-07T14:02:32.409055+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:02:32.409055+0000","last_undegraded":"2024-05-07T14:02:32.409055+0000","last_fullsized":"2024-05-07T14:02:32.409055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.357057+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:02:32.357057+0000","last_peered":"2024-05-07T14:02:32.357057+0000","last_clean":"2024-05-07T14:02:32.357057+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:02:32.357057+0000","last_undegraded":"2024-05-07T14:02:32.357057+0000","last_fullsized":"2024-05-07T14:02:32.357057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636288+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:02:31.636288+0000","last_peered":"2024-05-07T14:02:31.636288+0000","last_clean":"2024-05-07T14:02:31.636288+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:02:31.636288+0000","last_undegraded":"2024-05-07T14:02:31.636288+0000","last_fullsized":"2024-05-07T14:02:31.636288+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004327+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:02:32.004327+0000","last_peered":"2024-05-07T14:02:32.004327+0000","last_clean":"2024-05-07T14:02:32.004327+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:02:32.004327+0000","last_undegraded":"2024-05-07T14:02:32.004327+0000","last_fullsized":"2024-05-07T14:02:32.004327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639186+0000","last_change":"2024-05-07T14:01:06.037755+0000","last_active":"2024-05-07T14:02:31.639186+0000","last_peered":"2024-05-07T14:02:31.639186+0000","last_clean":"2024-05-07T14:02:31.639186+0000","last_became_active":"2024-05-07T14:01:06.037156+0000","last_became_peered":"2024-05-07T14:01:06.037156+0000","last_unstale":"2024-05-07T14:02:31.639186+0000","last_undegraded":"2024-05-07T14:02:31.639186+0000","last_fullsized":"2024-05-07T14:02:31.639186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:30.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635286+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:02:31.635286+0000","last_peered":"2024-05-07T14:02:31.635286+0000","last_clean":"2024-05-07T14:02:31.635286+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:02:31.635286+0000","last_undegraded":"2024-05-07T14:02:31.635286+0000","last_fullsized":"2024-05-07T14:02:31.635286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255491+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:02:32.255491+0000","last_peered":"2024-05-07T14:02:32.255491+0000","last_clean":"2024-05-07T14:02:32.255491+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:02:32.255491+0000","last_undegraded":"2024-05-07T14:02:32.255491+0000","last_fullsized":"2024-05-07T14:02:32.255491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639575+0000","last_change":"2024-05-07T14:00:59.998197+0000","last_active":"2024-05-07T14:02:31.639575+0000","last_peered":"2024-05-07T14:02:31.639575+0000","last_clean":"2024-05-07T14:02:31.639575+0000","last_became_active":"2024-05-07T14:00:59.997438+0000","last_became_peered":"2024-05-07T14:00:59.997438+0000","last_unstale":"2024-05-07T14:02:31.639575+0000","last_undegraded":"2024-05-07T14:02:31.639575+0000","last_fullsized":"2024-05-07T14:02:31.639575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:29.430229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":117,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256971+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:02:32.256971+0000","last_peered":"2024-05-07T14:02:32.256971+0000","last_clean":"2024-05-07T14:02:32.256971+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:02:32.256971+0000","last_undegraded":"2024-05-07T14:02:32.256971+0000","last_fullsized":"2024-05-07T14:02:32.256971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408640+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:02:32.408640+0000","last_peered":"2024-05-07T14:02:32.408640+0000","last_clean":"2024-05-07T14:02:32.408640+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:02:32.408640+0000","last_undegraded":"2024-05-07T14:02:32.408640+0000","last_fullsized":"2024-05-07T14:02:32.408640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.641050+0000","last_change":"2024-05-07T14:01:06.025913+0000","last_active":"2024-05-07T14:02:31.641050+0000","last_peered":"2024-05-07T14:02:31.641050+0000","last_clean":"2024-05-07T14:02:31.641050+0000","last_became_active":"2024-05-07T14:01:06.025220+0000","last_became_peered":"2024-05-07T14:01:06.025220+0000","last_unstale":"2024-05-07T14:02:31.641050+0000","last_undegraded":"2024-05-07T14:02:31.641050+0000","last_fullsized":"2024-05-07T14:02:31.641050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:30.164745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635545+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:02:31.635545+0000","last_peered":"2024-05-07T14:02:31.635545+0000","last_clean":"2024-05-07T14:02:31.635545+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:02:31.635545+0000","last_undegraded":"2024-05-07T14:02:31.635545+0000","last_fullsized":"2024-05-07T14:02:31.635545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255764+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:02:32.255764+0000","last_peered":"2024-05-07T14:02:32.255764+0000","last_clean":"2024-05-07T14:02:32.255764+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:02:32.255764+0000","last_undegraded":"2024-05-07T14:02:32.255764+0000","last_fullsized":"2024-05-07T14:02:32.255764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256617+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:02:32.256617+0000","last_peered":"2024-05-07T14:02:32.256617+0000","last_clean":"2024-05-07T14:02:32.256617+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:02:32.256617+0000","last_undegraded":"2024-05-07T14:02:32.256617+0000","last_fullsized":"2024-05-07T14:02:32.256617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409396+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:02:32.409396+0000","last_peered":"2024-05-07T14:02:32.409396+0000","last_clean":"2024-05-07T14:02:32.409396+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:02:32.409396+0000","last_undegraded":"2024-05-07T14:02:32.409396+0000","last_fullsized":"2024-05-07T14:02:32.409396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.003924+0000","last_change":"2024-05-07T14:01:04.017099+0000","last_active":"2024-05-07T14:02:32.003924+0000","last_peered":"2024-05-07T14:02:32.003924+0000","last_clean":"2024-05-07T14:02:32.003924+0000","last_became_active":"2024-05-07T14:01:04.011036+0000","last_became_peered":"2024-05-07T14:01:04.011036+0000","last_unstale":"2024-05-07T14:02:32.003924+0000","last_undegraded":"2024-05-07T14:02:32.003924+0000","last_fullsized":"2024-05-07T14:02:32.003924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:32.242974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391463+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:02:32.391463+0000","last_peered":"2024-05-07T14:02:32.391463+0000","last_clean":"2024-05-07T14:02:32.391463+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:02:32.391463+0000","last_undegraded":"2024-05-07T14:02:32.391463+0000","last_fullsized":"2024-05-07T14:02:32.391463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390658+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:02:32.390658+0000","last_peered":"2024-05-07T14:02:32.390658+0000","last_clean":"2024-05-07T14:02:32.390658+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:02:32.390658+0000","last_undegraded":"2024-05-07T14:02:32.390658+0000","last_fullsized":"2024-05-07T14:02:32.390658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392679+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:02:32.392679+0000","last_peered":"2024-05-07T14:02:32.392679+0000","last_clean":"2024-05-07T14:02:32.392679+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:02:32.392679+0000","last_undegraded":"2024-05-07T14:02:32.392679+0000","last_fullsized":"2024-05-07T14:02:32.392679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634663+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:02:31.634663+0000","last_peered":"2024-05-07T14:02:31.634663+0000","last_clean":"2024-05-07T14:02:31.634663+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:02:31.634663+0000","last_undegraded":"2024-05-07T14:02:31.634663+0000","last_fullsized":"2024-05-07T14:02:31.634663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":102,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392628+0000","last_change":"2024-05-07T14:01:02.013617+0000","last_active":"2024-05-07T14:02:32.392628+0000","last_peered":"2024-05-07T14:02:32.392628+0000","last_clean":"2024-05-07T14:02:32.392628+0000","last_became_active":"2024-05-07T14:01:02.009243+0000","last_became_peered":"2024-05-07T14:01:02.009243+0000","last_unstale":"2024-05-07T14:02:32.392628+0000","last_undegraded":"2024-05-07T14:02:32.392628+0000","last_fullsized":"2024-05-07T14:02:32.392628+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635072+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:02:31.635072+0000","last_peered":"2024-05-07T14:02:31.635072+0000","last_clean":"2024-05-07T14:02:31.635072+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:02:31.635072+0000","last_undegraded":"2024-05-07T14:02:31.635072+0000","last_fullsized":"2024-05-07T14:02:31.635072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640526+0000","last_change":"2024-05-07T14:01:06.023907+0000","last_active":"2024-05-07T14:02:31.640526+0000","last_peered":"2024-05-07T14:02:31.640526+0000","last_clean":"2024-05-07T14:02:31.640526+0000","last_became_active":"2024-05-07T14:01:06.023307+0000","last_became_peered":"2024-05-07T14:01:06.023307+0000","last_unstale":"2024-05-07T14:02:31.640526+0000","last_undegraded":"2024-05-07T14:02:31.640526+0000","last_fullsized":"2024-05-07T14:02:31.640526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:41.916580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634967+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:02:31.634967+0000","last_peered":"2024-05-07T14:02:31.634967+0000","last_clean":"2024-05-07T14:02:31.634967+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:02:31.634967+0000","last_undegraded":"2024-05-07T14:02:31.634967+0000","last_fullsized":"2024-05-07T14:02:31.634967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410774+0000","last_change":"2024-05-07T14:01:37.554242+0000","last_active":"2024-05-07T14:02:32.410774+0000","last_peered":"2024-05-07T14:02:32.410774+0000","last_clean":"2024-05-07T14:02:32.410774+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:02:32.410774+0000","last_undegraded":"2024-05-07T14:02:32.410774+0000","last_fullsized":"2024-05-07T14:02:32.410774+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:16:22.149514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355222+0000","last_change":"2024-05-07T14:00:59.998767+0000","last_active":"2024-05-07T14:02:32.355222+0000","last_peered":"2024-05-07T14:02:32.355222+0000","last_clean":"2024-05-07T14:02:32.355222+0000","last_became_active":"2024-05-07T14:00:59.998055+0000","last_became_peered":"2024-05-07T14:00:59.998055+0000","last_unstale":"2024-05-07T14:02:32.355222+0000","last_undegraded":"2024-05-07T14:02:32.355222+0000","last_fullsized":"2024-05-07T14:02:32.355222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:41.593806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635100+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:02:31.635100+0000","last_peered":"2024-05-07T14:02:31.635100+0000","last_clean":"2024-05-07T14:02:31.635100+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:02:31.635100+0000","last_undegraded":"2024-05-07T14:02:31.635100+0000","last_fullsized":"2024-05-07T14:02:31.635100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409187+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:02:32.409187+0000","last_peered":"2024-05-07T14:02:32.409187+0000","last_clean":"2024-05-07T14:02:32.409187+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:02:32.409187+0000","last_undegraded":"2024-05-07T14:02:32.409187+0000","last_fullsized":"2024-05-07T14:02:32.409187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636266+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:02:31.636266+0000","last_peered":"2024-05-07T14:02:31.636266+0000","last_clean":"2024-05-07T14:02:31.636266+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:02:31.636266+0000","last_undegraded":"2024-05-07T14:02:31.636266+0000","last_fullsized":"2024-05-07T14:02:31.636266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356276+0000","last_change":"2024-05-07T14:00:58.005276+0000","last_active":"2024-05-07T14:02:32.356276+0000","last_peered":"2024-05-07T14:02:32.356276+0000","last_clean":"2024-05-07T14:02:32.356276+0000","last_became_active":"2024-05-07T14:00:58.004903+0000","last_became_peered":"2024-05-07T14:00:58.004903+0000","last_unstale":"2024-05-07T14:02:32.356276+0000","last_undegraded":"2024-05-07T14:02:32.356276+0000","last_fullsized":"2024-05-07T14:02:32.356276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.005040+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:02:32.005040+0000","last_peered":"2024-05-07T14:02:32.005040+0000","last_clean":"2024-05-07T14:02:32.005040+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:02:32.005040+0000","last_undegraded":"2024-05-07T14:02:32.005040+0000","last_fullsized":"2024-05-07T14:02:32.005040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356008+0000","last_change":"2024-05-07T14:00:57.986882+0000","last_active":"2024-05-07T14:02:32.356008+0000","last_peered":"2024-05-07T14:02:32.356008+0000","last_clean":"2024-05-07T14:02:32.356008+0000","last_became_active":"2024-05-07T14:00:57.984867+0000","last_became_peered":"2024-05-07T14:00:57.984867+0000","last_unstale":"2024-05-07T14:02:32.356008+0000","last_undegraded":"2024-05-07T14:02:32.356008+0000","last_fullsized":"2024-05-07T14:02:32.356008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638086+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:02:31.638086+0000","last_peered":"2024-05-07T14:02:31.638086+0000","last_clean":"2024-05-07T14:02:31.638086+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:02:31.638086+0000","last_undegraded":"2024-05-07T14:02:31.638086+0000","last_fullsized":"2024-05-07T14:02:31.638086+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:01.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257588+0000","last_change":"2024-05-07T14:00:57.985233+0000","last_active":"2024-05-07T14:02:32.257588+0000","last_peered":"2024-05-07T14:02:32.257588+0000","last_clean":"2024-05-07T14:02:32.257588+0000","last_became_active":"2024-05-07T14:00:57.984523+0000","last_became_peered":"2024-05-07T14:00:57.984523+0000","last_unstale":"2024-05-07T14:02:32.257588+0000","last_undegraded":"2024-05-07T14:02:32.257588+0000","last_fullsized":"2024-05-07T14:02:32.257588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256637+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:02:32.256637+0000","last_peered":"2024-05-07T14:02:32.256637+0000","last_clean":"2024-05-07T14:02:32.256637+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:02:32.256637+0000","last_undegraded":"2024-05-07T14:02:32.256637+0000","last_fullsized":"2024-05-07T14:02:32.256637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356567+0000","last_change":"2024-05-07T14:00:57.989787+0000","last_active":"2024-05-07T14:02:32.356567+0000","last_peered":"2024-05-07T14:02:32.356567+0000","last_clean":"2024-05-07T14:02:32.356567+0000","last_became_active":"2024-05-07T14:00:57.989498+0000","last_became_peered":"2024-05-07T14:00:57.989498+0000","last_unstale":"2024-05-07T14:02:32.356567+0000","last_undegraded":"2024-05-07T14:02:32.356567+0000","last_fullsized":"2024-05-07T14:02:32.356567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409741+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:02:32.409741+0000","last_peered":"2024-05-07T14:02:32.409741+0000","last_clean":"2024-05-07T14:02:32.409741+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:02:32.409741+0000","last_undegraded":"2024-05-07T14:02:32.409741+0000","last_fullsized":"2024-05-07T14:02:32.409741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392468+0000","last_change":"2024-05-07T14:00:57.998054+0000","last_active":"2024-05-07T14:02:32.392468+0000","last_peered":"2024-05-07T14:02:32.392468+0000","last_clean":"2024-05-07T14:02:32.392468+0000","last_became_active":"2024-05-07T14:00:57.997750+0000","last_became_peered":"2024-05-07T14:00:57.997750+0000","last_unstale":"2024-05-07T14:02:32.392468+0000","last_undegraded":"2024-05-07T14:02:32.392468+0000","last_fullsized":"2024-05-07T14:02:32.392468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390873+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:02:32.390873+0000","last_peered":"2024-05-07T14:02:32.390873+0000","last_clean":"2024-05-07T14:02:32.390873+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:02:32.390873+0000","last_undegraded":"2024-05-07T14:02:32.390873+0000","last_fullsized":"2024-05-07T14:02:32.390873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635807+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:02:31.635807+0000","last_peered":"2024-05-07T14:02:31.635807+0000","last_clean":"2024-05-07T14:02:31.635807+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:02:31.635807+0000","last_undegraded":"2024-05-07T14:02:31.635807+0000","last_fullsized":"2024-05-07T14:02:31.635807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.357223+0000","last_change":"2024-05-07T14:00:55.974072+0000","last_active":"2024-05-07T14:02:32.357223+0000","last_peered":"2024-05-07T14:02:32.357223+0000","last_clean":"2024-05-07T14:02:32.357223+0000","last_became_active":"2024-05-07T14:00:55.973647+0000","last_became_peered":"2024-05-07T14:00:55.973647+0000","last_unstale":"2024-05-07T14:02:32.357223+0000","last_undegraded":"2024-05-07T14:02:32.357223+0000","last_fullsized":"2024-05-07T14:02:32.357223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390463+0000","last_change":"2024-05-07T14:00:57.988167+0000","last_active":"2024-05-07T14:02:32.390463+0000","last_peered":"2024-05-07T14:02:32.390463+0000","last_clean":"2024-05-07T14:02:32.390463+0000","last_became_active":"2024-05-07T14:00:57.987884+0000","last_became_peered":"2024-05-07T14:00:57.987884+0000","last_unstale":"2024-05-07T14:02:32.390463+0000","last_undegraded":"2024-05-07T14:02:32.390463+0000","last_fullsized":"2024-05-07T14:02:32.390463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.003566+0000","last_change":"2024-05-07T14:00:55.997287+0000","last_active":"2024-05-07T14:02:32.003566+0000","last_peered":"2024-05-07T14:02:32.003566+0000","last_clean":"2024-05-07T14:02:32.003566+0000","last_became_active":"2024-05-07T14:00:55.996467+0000","last_became_peered":"2024-05-07T14:00:55.996467+0000","last_unstale":"2024-05-07T14:02:32.003566+0000","last_undegraded":"2024-05-07T14:02:32.003566+0000","last_fullsized":"2024-05-07T14:02:32.003566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004844+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:02:32.004844+0000","last_peered":"2024-05-07T14:02:32.004844+0000","last_clean":"2024-05-07T14:02:32.004844+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:02:32.004844+0000","last_undegraded":"2024-05-07T14:02:32.004844+0000","last_fullsized":"2024-05-07T14:02:32.004844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391794+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:02:32.391794+0000","last_peered":"2024-05-07T14:02:32.391794+0000","last_clean":"2024-05-07T14:02:32.391794+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:02:32.391794+0000","last_undegraded":"2024-05-07T14:02:32.391794+0000","last_fullsized":"2024-05-07T14:02:32.391794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410693+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:02:32.410693+0000","last_peered":"2024-05-07T14:02:32.410693+0000","last_clean":"2024-05-07T14:02:32.410693+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:02:32.410693+0000","last_undegraded":"2024-05-07T14:02:32.410693+0000","last_fullsized":"2024-05-07T14:02:32.410693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.258176+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:02:32.258176+0000","last_peered":"2024-05-07T14:02:32.258176+0000","last_clean":"2024-05-07T14:02:32.258176+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:02:32.258176+0000","last_undegraded":"2024-05-07T14:02:32.258176+0000","last_fullsized":"2024-05-07T14:02:32.258176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636229+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:02:31.636229+0000","last_peered":"2024-05-07T14:02:31.636229+0000","last_clean":"2024-05-07T14:02:31.636229+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:02:31.636229+0000","last_undegraded":"2024-05-07T14:02:31.636229+0000","last_fullsized":"2024-05-07T14:02:31.636229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.389986+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:02:32.389986+0000","last_peered":"2024-05-07T14:02:32.389986+0000","last_clean":"2024-05-07T14:02:32.389986+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:02:32.389986+0000","last_undegraded":"2024-05-07T14:02:32.389986+0000","last_fullsized":"2024-05-07T14:02:32.389986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.643479+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:02:31.643479+0000","last_peered":"2024-05-07T14:02:31.643479+0000","last_clean":"2024-05-07T14:02:31.643479+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:02:31.643479+0000","last_undegraded":"2024-05-07T14:02:31.643479+0000","last_fullsized":"2024-05-07T14:02:31.643479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255516+0000","last_change":"2024-05-07T14:00:56.001135+0000","last_active":"2024-05-07T14:02:32.255516+0000","last_peered":"2024-05-07T14:02:32.255516+0000","last_clean":"2024-05-07T14:02:32.255516+0000","last_became_active":"2024-05-07T14:00:55.999884+0000","last_became_peered":"2024-05-07T14:00:55.999884+0000","last_unstale":"2024-05-07T14:02:32.255516+0000","last_undegraded":"2024-05-07T14:02:32.255516+0000","last_fullsized":"2024-05-07T14:02:32.255516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636001+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:02:31.636001+0000","last_peered":"2024-05-07T14:02:31.636001+0000","last_clean":"2024-05-07T14:02:31.636001+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:02:31.636001+0000","last_undegraded":"2024-05-07T14:02:31.636001+0000","last_fullsized":"2024-05-07T14:02:31.636001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408963+0000","last_change":"2024-05-07T14:00:55.989670+0000","last_active":"2024-05-07T14:02:32.408963+0000","last_peered":"2024-05-07T14:02:32.408963+0000","last_clean":"2024-05-07T14:02:32.408963+0000","last_became_active":"2024-05-07T14:00:55.989455+0000","last_became_peered":"2024-05-07T14:00:55.989455+0000","last_unstale":"2024-05-07T14:02:32.408963+0000","last_undegraded":"2024-05-07T14:02:32.408963+0000","last_fullsized":"2024-05-07T14:02:32.408963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640060+0000","last_change":"2024-05-07T14:00:57.979022+0000","last_active":"2024-05-07T14:02:31.640060+0000","last_peered":"2024-05-07T14:02:31.640060+0000","last_clean":"2024-05-07T14:02:31.640060+0000","last_became_active":"2024-05-07T14:00:57.977403+0000","last_became_peered":"2024-05-07T14:00:57.977403+0000","last_unstale":"2024-05-07T14:02:31.640060+0000","last_undegraded":"2024-05-07T14:02:31.640060+0000","last_fullsized":"2024-05-07T14:02:31.640060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.003519+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:02:32.003519+0000","last_peered":"2024-05-07T14:02:32.003519+0000","last_clean":"2024-05-07T14:02:32.003519+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:02:32.003519+0000","last_undegraded":"2024-05-07T14:02:32.003519+0000","last_fullsized":"2024-05-07T14:02:32.003519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409889+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:02:32.409889+0000","last_peered":"2024-05-07T14:02:32.409889+0000","last_clean":"2024-05-07T14:02:32.409889+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:02:32.409889+0000","last_undegraded":"2024-05-07T14:02:32.409889+0000","last_fullsized":"2024-05-07T14:02:32.409889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640998+0000","last_change":"2024-05-07T14:00:55.978771+0000","last_active":"2024-05-07T14:02:31.640998+0000","last_peered":"2024-05-07T14:02:31.640998+0000","last_clean":"2024-05-07T14:02:31.640998+0000","last_became_active":"2024-05-07T14:00:55.978000+0000","last_became_peered":"2024-05-07T14:00:55.978000+0000","last_unstale":"2024-05-07T14:02:31.640998+0000","last_undegraded":"2024-05-07T14:02:31.640998+0000","last_fullsized":"2024-05-07T14:02:31.640998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390386+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:02:32.390386+0000","last_peered":"2024-05-07T14:02:32.390386+0000","last_clean":"2024-05-07T14:02:32.390386+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:02:32.390386+0000","last_undegraded":"2024-05-07T14:02:32.390386+0000","last_fullsized":"2024-05-07T14:02:32.390386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640396+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:02:31.640396+0000","last_peered":"2024-05-07T14:02:31.640396+0000","last_clean":"2024-05-07T14:02:31.640396+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:02:31.640396+0000","last_undegraded":"2024-05-07T14:02:31.640396+0000","last_fullsized":"2024-05-07T14:02:31.640396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639690+0000","last_change":"2024-05-07T14:00:57.979073+0000","last_active":"2024-05-07T14:02:31.639690+0000","last_peered":"2024-05-07T14:02:31.639690+0000","last_clean":"2024-05-07T14:02:31.639690+0000","last_became_active":"2024-05-07T14:00:57.978215+0000","last_became_peered":"2024-05-07T14:00:57.978215+0000","last_unstale":"2024-05-07T14:02:31.639690+0000","last_undegraded":"2024-05-07T14:02:31.639690+0000","last_fullsized":"2024-05-07T14:02:31.639690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255516+0000","last_change":"2024-05-07T14:00:56.001199+0000","last_active":"2024-05-07T14:02:32.255516+0000","last_peered":"2024-05-07T14:02:32.255516+0000","last_clean":"2024-05-07T14:02:32.255516+0000","last_became_active":"2024-05-07T14:00:56.000434+0000","last_became_peered":"2024-05-07T14:00:56.000434+0000","last_unstale":"2024-05-07T14:02:32.255516+0000","last_undegraded":"2024-05-07T14:02:32.255516+0000","last_fullsized":"2024-05-07T14:02:32.255516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257933+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:02:32.257933+0000","last_peered":"2024-05-07T14:02:32.257933+0000","last_clean":"2024-05-07T14:02:32.257933+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:02:32.257933+0000","last_undegraded":"2024-05-07T14:02:32.257933+0000","last_fullsized":"2024-05-07T14:02:32.257933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410692+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:02:32.410692+0000","last_peered":"2024-05-07T14:02:32.410692+0000","last_clean":"2024-05-07T14:02:32.410692+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:02:32.410692+0000","last_undegraded":"2024-05-07T14:02:32.410692+0000","last_fullsized":"2024-05-07T14:02:32.410692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.354818+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:02:32.354818+0000","last_peered":"2024-05-07T14:02:32.354818+0000","last_clean":"2024-05-07T14:02:32.354818+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:02:32.354818+0000","last_undegraded":"2024-05-07T14:02:32.354818+0000","last_fullsized":"2024-05-07T14:02:32.354818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257944+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:02:32.257944+0000","last_peered":"2024-05-07T14:02:32.257944+0000","last_clean":"2024-05-07T14:02:32.257944+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:02:32.257944+0000","last_undegraded":"2024-05-07T14:02:32.257944+0000","last_fullsized":"2024-05-07T14:02:32.257944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1454080,"data_stored":1034318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":435445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":436273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":443781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":839680,"data_stored":435841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":443288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":444533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343424,"statfs":{"total":96636764160,"available":96607666176,"internally_reserved":0,"allocated":1425408,"data_stored":1026315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:02:33.262 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:02:33.271 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:33.281+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:33.372 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:33.385+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:33.381 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:33.381 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:33.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:33.381 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:33.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.381 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:129 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'87, mlcod=17'85)", 2024-05-07T14:02:33.381 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:33.381 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 107.093829314, 2024-05-07T14:02:33.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034674469999999998, 2024-05-07T14:02:33.381 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.381 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.381 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.381 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299075+0000", 2024-05-07T14:02:33.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.736e-06 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299087+0000", 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2067e-05 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299122+0000", 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4643e-05 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299141+0000", 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9224000000000001e-05 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299323+0000", 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018190400000000001 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299385+0000", 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2126999999999997e-05 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302462+0000", 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030768330000000002 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302541+0000", 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8912999999999995e-05 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:131 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'89, mlcod=17'85)", 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:33.385 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 107.092496641, 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038759010000000002, 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:33.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300407+0000", 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0299999999999998e-07 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300577+0000", 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000170259 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300592+0000", 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4707e-05 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300601+0000", 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999995e-06 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301133+0000", 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053150199999999999 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301186+0000", 2024-05-07T14:02:33.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.342e-05 2024-05-07T14:02:33.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304217+0000", 2024-05-07T14:02:33.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030307429999999998 2024-05-07T14:02:33.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304282+0000", 2024-05-07T14:02:33.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5316999999999998e-05 2024-05-07T14:02:33.389 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:132 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'90, mlcod=17'85)", 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 107.09144454600001, 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041397580000000003, 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301459+0000", 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.47e-07 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301470+0000", 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0933e-05 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301483+0000", 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2427e-05 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301491+0000", 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6130000000000004e-06 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302683+0000", 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011919980000000001 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302741+0000", 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7963000000000001e-05 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305494+0000", 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027531420000000001 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305598+0000", 2024-05-07T14:02:33.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103835 2024-05-07T14:02:33.394 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.394 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.394 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.394 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:134 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'92, mlcod=17'85)", 2024-05-07T14:02:33.394 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:33.394 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 107.089158649, 2024-05-07T14:02:33.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037081470000000002, 2024-05-07T14:02:33.394 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303747+0000", 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303805+0000", 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8554999999999998e-05 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303829+0000", 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3799999999999999e-05 2024-05-07T14:02:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303871+0000", 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2079999999999997e-05 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304359+0000", 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048822999999999998 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304415+0000", 2024-05-07T14:02:33.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5405999999999998e-05 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307388+0000", 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029728070000000001 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307452+0000", 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4789000000000006e-05 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:137 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'95, mlcod=17'88)", 2024-05-07T14:02:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 107.085534748, 2024-05-07T14:02:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004097552, 2024-05-07T14:02:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:33.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307370+0000", 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3939999999999999e-06 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307454+0000", 2024-05-07T14:02:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4639000000000001e-05 2024-05-07T14:02:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307474+0000", 2024-05-07T14:02:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0242999999999999e-05 2024-05-07T14:02:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307485+0000", 2024-05-07T14:02:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0710000000000001e-05 2024-05-07T14:02:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307538+0000", 2024-05-07T14:02:33.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2623000000000001e-05 2024-05-07T14:02:33.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307566+0000", 2024-05-07T14:02:33.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.781e-05 2024-05-07T14:02:33.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311405+0000", 2024-05-07T14:02:33.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038392299999999999 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311466+0000", 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0903000000000003e-05 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:138 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'96, mlcod=17'93)", 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 107.08223861, 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034036700000000001, 2024-05-07T14:02:33.403 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.404 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.404 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.404 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:33.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:33.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310666+0000", 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310680+0000", 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4047e-05 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310715+0000", 2024-05-07T14:02:33.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4826000000000002e-05 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310739+0000", 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3796000000000001e-05 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310862+0000", 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123132 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310896+0000", 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.43e-05 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313965+0000", 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030685959999999998 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314068+0000", 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102963 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.407 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 107.08133292700001, 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:33.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:02:33.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:02:33.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 107.080426531, 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.412 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:02:33.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:02:33.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:02:33.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:02:33.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:02:33.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:02:33.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:02:33.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 107.07901391199999, 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:02:33.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:02:33.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:143 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'101, mlcod=17'98)", 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 107.071121143, 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036609120000000001, 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321783+0000", 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3599999999999999e-06 2024-05-07T14:02:33.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321905+0000", 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121923 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321929+0000", 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4295999999999999e-05 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321945+0000", 2024-05-07T14:02:33.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5773999999999998e-05 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322070+0000", 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012457899999999999 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322101+0000", 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1213000000000001e-05 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325342+0000", 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032410579999999998 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325443+0000", 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100709 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:144 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:33.425 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 107.070052401, 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003406484, 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322852+0000", 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8369999999999999e-06 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323022+0000", 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016984199999999999 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323048+0000", 2024-05-07T14:02:33.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5752999999999999e-05 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323071+0000", 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.266e-05 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323188+0000", 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011728200000000001 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323224+0000", 2024-05-07T14:02:33.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6380000000000001e-05 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326163+0000", 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029386170000000001 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326257+0000", 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4112999999999998e-05 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.430 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:02:33.430 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:33.430 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.373721488000001, 2024-05-07T14:02:33.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034691510000000002, 2024-05-07T14:02:33.430 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.430 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.430 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.430 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:33.430 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:33.430 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:33.430 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 206 2024-05-07T14:02:33.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019184+0000", 2024-05-07T14:02:33.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6170000000000001e-06 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019198+0000", 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4113e-05 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019229+0000", 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0423e-05 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019244+0000", 2024-05-07T14:02:33.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5047e-05 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019478+0000", 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000234398 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019723+0000", 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024469500000000001 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.020149+0000", 2024-05-07T14:02:33.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042592999999999998 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.021776+0000", 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001627688 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022453+0000", 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00067671500000000004 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022551+0000", 2024-05-07T14:02:33.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8312000000000003e-05 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022651+0000", 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9213e-05 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.346432308000004, 2024-05-07T14:02:33.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038721300000000001, 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 210 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:33.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046474+0000", 2024-05-07T14:02:33.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.517e-06 2024-05-07T14:02:33.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046487+0000", 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3113e-05 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046521+0000", 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3556000000000002e-05 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046537+0000", 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.643e-05 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046651+0000", 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011368500000000001 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046873+0000", 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221802 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.047335+0000", 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046227300000000002 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.048993+0000", 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016576679999999999 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050186+0000", 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001193284 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050273+0000", 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7189999999999997e-05 2024-05-07T14:02:33.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050343+0000", 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9611999999999997e-05 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.316925561999994, 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034712530000000001, 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.441 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.442 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.442 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:33.442 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:33.442 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:33.442 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 218 2024-05-07T14:02:33.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.442 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:33.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075980+0000", 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.774e-06 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075992+0000", 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2283000000000001e-05 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076024+0000", 2024-05-07T14:02:33.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1242999999999999e-05 2024-05-07T14:02:33.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076038+0000", 2024-05-07T14:02:33.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4663e-05 2024-05-07T14:02:33.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076199+0000", 2024-05-07T14:02:33.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160865 2024-05-07T14:02:33.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076539+0000", 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033995800000000001 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.077234+0000", 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000694581 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.078996+0000", 2024-05-07T14:02:33.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001762633 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079276+0000", 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027998399999999999 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079380+0000", 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103266 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079449+0000", 2024-05-07T14:02:33.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9003000000000003e-05 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.253343430000001, 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:33.447 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:02:33.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:02:33.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:02:33.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:02:33.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:02:33.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:02:33.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.220232772000003, 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:02:33.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:02:33.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:02:33.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:33.458 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.213322852999994, 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041680119999999996, 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 382 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179581+0000", 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179585+0000", 2024-05-07T14:02:33.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4800000000000003e-06 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179598+0000", 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2322e-05 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179604+0000", 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.823e-06 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179657+0000", 2024-05-07T14:02:33.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3937000000000002e-05 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179714+0000", 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6165000000000002e-05 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179830+0000", 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011632 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:33.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.180515+0000", 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00068531400000000002 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183667+0000", 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031522009999999999 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183704+0000", 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6925999999999998e-05 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183748+0000", 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3618999999999997e-05 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:499 6.13 e33/27 6:cedbb205:::obj_delete_at_hint.0000000017:head v 33'4, mlcod=33'1)", 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.139950198999998, 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043323679999999996, 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.464 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252954+0000", 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.71e-07 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252960+0000", 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.46e-06 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252974+0000", 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4249e-05 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252982+0000", 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253055+0000", 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3162000000000002e-05 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253075+0000", 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9451999999999999e-05 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257253+0000", 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041781179999999998 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257285+0000", 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2075e-05 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:550 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.104296016999996, 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035552140000000001, 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.468 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 550 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:33.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288608+0000", 2024-05-07T14:02:33.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0529999999999999e-06 2024-05-07T14:02:33.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288613+0000", 2024-05-07T14:02:33.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7060000000000003e-06 2024-05-07T14:02:33.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288624+0000", 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1547e-05 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288630+0000", 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288734+0000", 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103872 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288884+0000", 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014987400000000001 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289167+0000", 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028341999999999999 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289813+0000", 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064550199999999995 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292082+0000", 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022696000000000001 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292120+0000", 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7367999999999999e-05 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292162+0000", 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2568000000000003e-05 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:667 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.008353983000006, 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050309150000000004, 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 667 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:33.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384550+0000", 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7000000000000003e-07 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384555+0000", 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.135e-06 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384565+0000", 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0541e-05 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384571+0000", 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.857e-06 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384670+0000", 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8461999999999993e-05 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384822+0000", 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152039 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.385123+0000", 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030070699999999999 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:33.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.386099+0000", 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097677300000000001 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389495+0000", 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033959139999999999 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389530+0000", 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.472e-05 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:33.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:33.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389580+0000", 2024-05-07T14:02:33.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9897e-05 2024-05-07T14:02:33.479 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.479 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.479 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.479 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:33.479 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:33.479 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:33.481 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:02:33.481 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:33.493+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:33.581 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:33.593+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:33.660 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:02:33.694 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:33.694 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:33.695 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:33.695 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:33.705+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:33.714 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:02:33.801 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:33.813+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:33.817 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:02:33.823 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:02:33.845 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2024-05-07T14:02:33.252011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":809,"num_read_kb":552,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":527,"ondisk_log_size":527,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228080,"kb_used_data":7736,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746640,"statfs":{"total":773094113280,"available":772860559360,"internally_reserved":0,"allocated":7921664,"data_stored":4699794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000844"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640820+0000","last_change":"2024-05-07T14:00:55.983744+0000","last_active":"2024-05-07T14:02:31.640820+0000","last_peered":"2024-05-07T14:02:31.640820+0000","last_clean":"2024-05-07T14:02:31.640820+0000","last_became_active":"2024-05-07T14:00:55.982993+0000","last_became_peered":"2024-05-07T14:00:55.982993+0000","last_unstale":"2024-05-07T14:02:31.640820+0000","last_undegraded":"2024-05-07T14:02:31.640820+0000","last_fullsized":"2024-05-07T14:02:31.640820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257110+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:02:32.257110+0000","last_peered":"2024-05-07T14:02:32.257110+0000","last_clean":"2024-05-07T14:02:32.257110+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:02:32.257110+0000","last_undegraded":"2024-05-07T14:02:32.257110+0000","last_fullsized":"2024-05-07T14:02:32.257110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356138+0000","last_change":"2024-05-07T14:00:55.973967+0000","last_active":"2024-05-07T14:02:32.356138+0000","last_peered":"2024-05-07T14:02:32.356138+0000","last_clean":"2024-05-07T14:02:32.356138+0000","last_became_active":"2024-05-07T14:00:55.973677+0000","last_became_peered":"2024-05-07T14:00:55.973677+0000","last_unstale":"2024-05-07T14:02:32.356138+0000","last_undegraded":"2024-05-07T14:02:32.356138+0000","last_fullsized":"2024-05-07T14:02:32.356138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639745+0000","last_change":"2024-05-07T14:00:57.988092+0000","last_active":"2024-05-07T14:02:31.639745+0000","last_peered":"2024-05-07T14:02:31.639745+0000","last_clean":"2024-05-07T14:02:31.639745+0000","last_became_active":"2024-05-07T14:00:57.987091+0000","last_became_peered":"2024-05-07T14:00:57.987091+0000","last_unstale":"2024-05-07T14:02:31.639745+0000","last_undegraded":"2024-05-07T14:02:31.639745+0000","last_fullsized":"2024-05-07T14:02:31.639745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408924+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:02:32.408924+0000","last_peered":"2024-05-07T14:02:32.408924+0000","last_clean":"2024-05-07T14:02:32.408924+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:02:32.408924+0000","last_undegraded":"2024-05-07T14:02:32.408924+0000","last_fullsized":"2024-05-07T14:02:32.408924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635394+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:02:31.635394+0000","last_peered":"2024-05-07T14:02:31.635394+0000","last_clean":"2024-05-07T14:02:31.635394+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:02:31.635394+0000","last_undegraded":"2024-05-07T14:02:31.635394+0000","last_fullsized":"2024-05-07T14:02:31.635394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257408+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:02:32.257408+0000","last_peered":"2024-05-07T14:02:32.257408+0000","last_clean":"2024-05-07T14:02:32.257408+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:02:32.257408+0000","last_undegraded":"2024-05-07T14:02:32.257408+0000","last_fullsized":"2024-05-07T14:02:32.257408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409659+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:02:32.409659+0000","last_peered":"2024-05-07T14:02:32.409659+0000","last_clean":"2024-05-07T14:02:32.409659+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:02:32.409659+0000","last_undegraded":"2024-05-07T14:02:32.409659+0000","last_fullsized":"2024-05-07T14:02:32.409659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640138+0000","last_change":"2024-05-07T14:00:55.973419+0000","last_active":"2024-05-07T14:02:31.640138+0000","last_peered":"2024-05-07T14:02:31.640138+0000","last_clean":"2024-05-07T14:02:31.640138+0000","last_became_active":"2024-05-07T14:00:55.963467+0000","last_became_peered":"2024-05-07T14:00:55.963467+0000","last_unstale":"2024-05-07T14:02:31.640138+0000","last_undegraded":"2024-05-07T14:02:31.640138+0000","last_fullsized":"2024-05-07T14:02:31.640138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004251+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:02:32.004251+0000","last_peered":"2024-05-07T14:02:32.004251+0000","last_clean":"2024-05-07T14:02:32.004251+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:02:32.004251+0000","last_undegraded":"2024-05-07T14:02:32.004251+0000","last_fullsized":"2024-05-07T14:02:32.004251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256311+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:02:32.256311+0000","last_peered":"2024-05-07T14:02:32.256311+0000","last_clean":"2024-05-07T14:02:32.256311+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:02:32.256311+0000","last_undegraded":"2024-05-07T14:02:32.256311+0000","last_fullsized":"2024-05-07T14:02:32.256311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635936+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:02:31.635936+0000","last_peered":"2024-05-07T14:02:31.635936+0000","last_clean":"2024-05-07T14:02:31.635936+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:02:31.635936+0000","last_undegraded":"2024-05-07T14:02:31.635936+0000","last_fullsized":"2024-05-07T14:02:31.635936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639946+0000","last_change":"2024-05-07T14:00:55.962579+0000","last_active":"2024-05-07T14:02:31.639946+0000","last_peered":"2024-05-07T14:02:31.639946+0000","last_clean":"2024-05-07T14:02:31.639946+0000","last_became_active":"2024-05-07T14:00:55.961815+0000","last_became_peered":"2024-05-07T14:00:55.961815+0000","last_unstale":"2024-05-07T14:02:31.639946+0000","last_undegraded":"2024-05-07T14:02:31.639946+0000","last_fullsized":"2024-05-07T14:02:31.639946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257945+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:02:32.257945+0000","last_peered":"2024-05-07T14:02:32.257945+0000","last_clean":"2024-05-07T14:02:32.257945+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:02:32.257945+0000","last_undegraded":"2024-05-07T14:02:32.257945+0000","last_fullsized":"2024-05-07T14:02:32.257945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391120+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:02:32.391120+0000","last_peered":"2024-05-07T14:02:32.391120+0000","last_clean":"2024-05-07T14:02:32.391120+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:02:32.391120+0000","last_undegraded":"2024-05-07T14:02:32.391120+0000","last_fullsized":"2024-05-07T14:02:32.391120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.643446+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:02:31.643446+0000","last_peered":"2024-05-07T14:02:31.643446+0000","last_clean":"2024-05-07T14:02:31.643446+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:02:31.643446+0000","last_undegraded":"2024-05-07T14:02:31.643446+0000","last_fullsized":"2024-05-07T14:02:31.643446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634949+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:02:31.634949+0000","last_peered":"2024-05-07T14:02:31.634949+0000","last_clean":"2024-05-07T14:02:31.634949+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:02:31.634949+0000","last_undegraded":"2024-05-07T14:02:31.634949+0000","last_fullsized":"2024-05-07T14:02:31.634949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640900+0000","last_change":"2024-05-07T14:00:56.003776+0000","last_active":"2024-05-07T14:02:31.640900+0000","last_peered":"2024-05-07T14:02:31.640900+0000","last_clean":"2024-05-07T14:02:31.640900+0000","last_became_active":"2024-05-07T14:00:56.002996+0000","last_became_peered":"2024-05-07T14:00:56.002996+0000","last_unstale":"2024-05-07T14:02:31.640900+0000","last_undegraded":"2024-05-07T14:02:31.640900+0000","last_fullsized":"2024-05-07T14:02:31.640900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:17.583140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639757+0000","last_change":"2024-05-07T14:00:57.987026+0000","last_active":"2024-05-07T14:02:31.639757+0000","last_peered":"2024-05-07T14:02:31.639757+0000","last_clean":"2024-05-07T14:02:31.639757+0000","last_became_active":"2024-05-07T14:00:57.986048+0000","last_became_peered":"2024-05-07T14:00:57.986048+0000","last_unstale":"2024-05-07T14:02:31.639757+0000","last_undegraded":"2024-05-07T14:02:31.639757+0000","last_fullsized":"2024-05-07T14:02:31.639757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004377+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:02:32.004377+0000","last_peered":"2024-05-07T14:02:32.004377+0000","last_clean":"2024-05-07T14:02:32.004377+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:02:32.004377+0000","last_undegraded":"2024-05-07T14:02:32.004377+0000","last_fullsized":"2024-05-07T14:02:32.004377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256754+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:02:32.256754+0000","last_peered":"2024-05-07T14:02:32.256754+0000","last_clean":"2024-05-07T14:02:32.256754+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:02:32.256754+0000","last_undegraded":"2024-05-07T14:02:32.256754+0000","last_fullsized":"2024-05-07T14:02:32.256754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004788+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:02:32.004788+0000","last_peered":"2024-05-07T14:02:32.004788+0000","last_clean":"2024-05-07T14:02:32.004788+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:02:32.004788+0000","last_undegraded":"2024-05-07T14:02:32.004788+0000","last_fullsized":"2024-05-07T14:02:32.004788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638279+0000","last_change":"2024-05-07T14:01:37.318563+0000","last_active":"2024-05-07T14:02:31.638279+0000","last_peered":"2024-05-07T14:02:31.638279+0000","last_clean":"2024-05-07T14:02:31.638279+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:02:31.638279+0000","last_undegraded":"2024-05-07T14:02:31.638279+0000","last_fullsized":"2024-05-07T14:02:31.638279+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:27.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635289+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:02:31.635289+0000","last_peered":"2024-05-07T14:02:31.635289+0000","last_clean":"2024-05-07T14:02:31.635289+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:02:31.635289+0000","last_undegraded":"2024-05-07T14:02:31.635289+0000","last_fullsized":"2024-05-07T14:02:31.635289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638604+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:02:31.638604+0000","last_peered":"2024-05-07T14:02:31.638604+0000","last_clean":"2024-05-07T14:02:31.638604+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:02:31.638604+0000","last_undegraded":"2024-05-07T14:02:31.638604+0000","last_fullsized":"2024-05-07T14:02:31.638604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392183+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:02:32.392183+0000","last_peered":"2024-05-07T14:02:32.392183+0000","last_clean":"2024-05-07T14:02:32.392183+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:02:32.392183+0000","last_undegraded":"2024-05-07T14:02:32.392183+0000","last_fullsized":"2024-05-07T14:02:32.392183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636027+0000","last_change":"2024-05-07T14:00:58.008214+0000","last_active":"2024-05-07T14:02:31.636027+0000","last_peered":"2024-05-07T14:02:31.636027+0000","last_clean":"2024-05-07T14:02:31.636027+0000","last_became_active":"2024-05-07T14:00:58.005516+0000","last_became_peered":"2024-05-07T14:00:58.005516+0000","last_unstale":"2024-05-07T14:02:31.636027+0000","last_undegraded":"2024-05-07T14:02:31.636027+0000","last_fullsized":"2024-05-07T14:02:31.636027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410201+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:02:32.410201+0000","last_peered":"2024-05-07T14:02:32.410201+0000","last_clean":"2024-05-07T14:02:32.410201+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:02:32.410201+0000","last_undegraded":"2024-05-07T14:02:32.410201+0000","last_fullsized":"2024-05-07T14:02:32.410201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634642+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:02:31.634642+0000","last_peered":"2024-05-07T14:02:31.634642+0000","last_clean":"2024-05-07T14:02:31.634642+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:02:31.634642+0000","last_undegraded":"2024-05-07T14:02:31.634642+0000","last_fullsized":"2024-05-07T14:02:31.634642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391544+0000","last_change":"2024-05-07T14:00:57.988107+0000","last_active":"2024-05-07T14:02:32.391544+0000","last_peered":"2024-05-07T14:02:32.391544+0000","last_clean":"2024-05-07T14:02:32.391544+0000","last_became_active":"2024-05-07T14:00:57.987604+0000","last_became_peered":"2024-05-07T14:00:57.987604+0000","last_unstale":"2024-05-07T14:02:32.391544+0000","last_undegraded":"2024-05-07T14:02:32.391544+0000","last_fullsized":"2024-05-07T14:02:32.391544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638195+0000","last_change":"2024-05-07T14:01:37.311718+0000","last_active":"2024-05-07T14:02:31.638195+0000","last_peered":"2024-05-07T14:02:31.638195+0000","last_clean":"2024-05-07T14:02:31.638195+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:02:31.638195+0000","last_undegraded":"2024-05-07T14:02:31.638195+0000","last_fullsized":"2024-05-07T14:02:31.638195+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:24.211300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257380+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:02:32.257380+0000","last_peered":"2024-05-07T14:02:32.257380+0000","last_clean":"2024-05-07T14:02:32.257380+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:02:32.257380+0000","last_undegraded":"2024-05-07T14:02:32.257380+0000","last_fullsized":"2024-05-07T14:02:32.257380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410909+0000","last_change":"2024-05-07T14:01:01.993679+0000","last_active":"2024-05-07T14:02:32.410909+0000","last_peered":"2024-05-07T14:02:32.410909+0000","last_clean":"2024-05-07T14:02:32.410909+0000","last_became_active":"2024-05-07T14:01:01.993241+0000","last_became_peered":"2024-05-07T14:01:01.993241+0000","last_unstale":"2024-05-07T14:02:32.410909+0000","last_undegraded":"2024-05-07T14:02:32.410909+0000","last_fullsized":"2024-05-07T14:02:32.410909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640587+0000","last_change":"2024-05-07T14:01:04.017472+0000","last_active":"2024-05-07T14:02:31.640587+0000","last_peered":"2024-05-07T14:02:31.640587+0000","last_clean":"2024-05-07T14:02:31.640587+0000","last_became_active":"2024-05-07T14:01:04.016757+0000","last_became_peered":"2024-05-07T14:01:04.016757+0000","last_unstale":"2024-05-07T14:02:31.640587+0000","last_undegraded":"2024-05-07T14:02:31.640587+0000","last_fullsized":"2024-05-07T14:02:31.640587+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256294+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:02:32.256294+0000","last_peered":"2024-05-07T14:02:32.256294+0000","last_clean":"2024-05-07T14:02:32.256294+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:02:32.256294+0000","last_undegraded":"2024-05-07T14:02:32.256294+0000","last_fullsized":"2024-05-07T14:02:32.256294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257958+0000","last_change":"2024-05-07T14:00:57.984789+0000","last_active":"2024-05-07T14:02:32.257958+0000","last_peered":"2024-05-07T14:02:32.257958+0000","last_clean":"2024-05-07T14:02:32.257958+0000","last_became_active":"2024-05-07T14:00:57.983524+0000","last_became_peered":"2024-05-07T14:00:57.983524+0000","last_unstale":"2024-05-07T14:02:32.257958+0000","last_undegraded":"2024-05-07T14:02:32.257958+0000","last_fullsized":"2024-05-07T14:02:32.257958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408899+0000","last_change":"2024-05-07T14:00:55.989797+0000","last_active":"2024-05-07T14:02:32.408899+0000","last_peered":"2024-05-07T14:02:32.408899+0000","last_clean":"2024-05-07T14:02:32.408899+0000","last_became_active":"2024-05-07T14:00:55.989449+0000","last_became_peered":"2024-05-07T14:00:55.989449+0000","last_unstale":"2024-05-07T14:02:32.408899+0000","last_undegraded":"2024-05-07T14:02:32.408899+0000","last_fullsized":"2024-05-07T14:02:32.408899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391421+0000","last_change":"2024-05-07T14:00:59.983880+0000","last_active":"2024-05-07T14:02:32.391421+0000","last_peered":"2024-05-07T14:02:32.391421+0000","last_clean":"2024-05-07T14:02:32.391421+0000","last_became_active":"2024-05-07T14:00:59.983186+0000","last_became_peered":"2024-05-07T14:00:59.983186+0000","last_unstale":"2024-05-07T14:02:32.391421+0000","last_undegraded":"2024-05-07T14:02:32.391421+0000","last_fullsized":"2024-05-07T14:02:32.391421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:27.067433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":101,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636252+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:02:31.636252+0000","last_peered":"2024-05-07T14:02:31.636252+0000","last_clean":"2024-05-07T14:02:31.636252+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:02:31.636252+0000","last_undegraded":"2024-05-07T14:02:31.636252+0000","last_fullsized":"2024-05-07T14:02:31.636252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635949+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:02:31.635949+0000","last_peered":"2024-05-07T14:02:31.635949+0000","last_clean":"2024-05-07T14:02:31.635949+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:02:31.635949+0000","last_undegraded":"2024-05-07T14:02:31.635949+0000","last_fullsized":"2024-05-07T14:02:31.635949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409970+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:02:32.409970+0000","last_peered":"2024-05-07T14:02:32.409970+0000","last_clean":"2024-05-07T14:02:32.409970+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:02:32.409970+0000","last_undegraded":"2024-05-07T14:02:32.409970+0000","last_fullsized":"2024-05-07T14:02:32.409970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411352+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:02:32.411352+0000","last_peered":"2024-05-07T14:02:32.411352+0000","last_clean":"2024-05-07T14:02:32.411352+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:02:32.411352+0000","last_undegraded":"2024-05-07T14:02:32.411352+0000","last_fullsized":"2024-05-07T14:02:32.411352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639953+0000","last_change":"2024-05-07T14:00:55.986233+0000","last_active":"2024-05-07T14:02:31.639953+0000","last_peered":"2024-05-07T14:02:31.639953+0000","last_clean":"2024-05-07T14:02:31.639953+0000","last_became_active":"2024-05-07T14:00:55.984927+0000","last_became_peered":"2024-05-07T14:00:55.984927+0000","last_unstale":"2024-05-07T14:02:31.639953+0000","last_undegraded":"2024-05-07T14:02:31.639953+0000","last_fullsized":"2024-05-07T14:02:31.639953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392420+0000","last_change":"2024-05-07T14:00:59.992166+0000","last_active":"2024-05-07T14:02:32.392420+0000","last_peered":"2024-05-07T14:02:32.392420+0000","last_clean":"2024-05-07T14:02:32.392420+0000","last_became_active":"2024-05-07T14:00:59.991408+0000","last_became_peered":"2024-05-07T14:00:59.991408+0000","last_unstale":"2024-05-07T14:02:32.392420+0000","last_undegraded":"2024-05-07T14:02:32.392420+0000","last_fullsized":"2024-05-07T14:02:32.392420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":106,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638389+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:02:31.638389+0000","last_peered":"2024-05-07T14:02:31.638389+0000","last_clean":"2024-05-07T14:02:31.638389+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:02:31.638389+0000","last_undegraded":"2024-05-07T14:02:31.638389+0000","last_fullsized":"2024-05-07T14:02:31.638389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640188+0000","last_change":"2024-05-07T14:01:04.007238+0000","last_active":"2024-05-07T14:02:31.640188+0000","last_peered":"2024-05-07T14:02:31.640188+0000","last_clean":"2024-05-07T14:02:31.640188+0000","last_became_active":"2024-05-07T14:01:04.006204+0000","last_became_peered":"2024-05-07T14:01:04.006204+0000","last_unstale":"2024-05-07T14:02:31.640188+0000","last_undegraded":"2024-05-07T14:02:31.640188+0000","last_fullsized":"2024-05-07T14:02:31.640188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635120+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:02:31.635120+0000","last_peered":"2024-05-07T14:02:31.635120+0000","last_clean":"2024-05-07T14:02:31.635120+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:02:31.635120+0000","last_undegraded":"2024-05-07T14:02:31.635120+0000","last_fullsized":"2024-05-07T14:02:31.635120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392078+0000","last_change":"2024-05-07T14:00:57.998824+0000","last_active":"2024-05-07T14:02:32.392078+0000","last_peered":"2024-05-07T14:02:32.392078+0000","last_clean":"2024-05-07T14:02:32.392078+0000","last_became_active":"2024-05-07T14:00:57.998316+0000","last_became_peered":"2024-05-07T14:00:57.998316+0000","last_unstale":"2024-05-07T14:02:32.392078+0000","last_undegraded":"2024-05-07T14:02:32.392078+0000","last_fullsized":"2024-05-07T14:02:32.392078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.005080+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:02:32.005080+0000","last_peered":"2024-05-07T14:02:32.005080+0000","last_clean":"2024-05-07T14:02:32.005080+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:02:32.005080+0000","last_undegraded":"2024-05-07T14:02:32.005080+0000","last_fullsized":"2024-05-07T14:02:32.005080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257540+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:02:32.257540+0000","last_peered":"2024-05-07T14:02:32.257540+0000","last_clean":"2024-05-07T14:02:32.257540+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:02:32.257540+0000","last_undegraded":"2024-05-07T14:02:32.257540+0000","last_fullsized":"2024-05-07T14:02:32.257540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640380+0000","last_change":"2024-05-07T14:01:02.151107+0000","last_active":"2024-05-07T14:02:31.640380+0000","last_peered":"2024-05-07T14:02:31.640380+0000","last_clean":"2024-05-07T14:02:31.640380+0000","last_became_active":"2024-05-07T14:01:02.150351+0000","last_became_peered":"2024-05-07T14:01:02.150351+0000","last_unstale":"2024-05-07T14:02:31.640380+0000","last_undegraded":"2024-05-07T14:02:31.640380+0000","last_fullsized":"2024-05-07T14:02:31.640380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:28:13.159757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391061+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:02:32.391061+0000","last_peered":"2024-05-07T14:02:32.391061+0000","last_clean":"2024-05-07T14:02:32.391061+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:02:32.391061+0000","last_undegraded":"2024-05-07T14:02:32.391061+0000","last_fullsized":"2024-05-07T14:02:32.391061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257818+0000","last_change":"2024-05-07T14:00:57.979757+0000","last_active":"2024-05-07T14:02:32.257818+0000","last_peered":"2024-05-07T14:02:32.257818+0000","last_clean":"2024-05-07T14:02:32.257818+0000","last_became_active":"2024-05-07T14:00:57.979030+0000","last_became_peered":"2024-05-07T14:00:57.979030+0000","last_unstale":"2024-05-07T14:02:32.257818+0000","last_undegraded":"2024-05-07T14:02:32.257818+0000","last_fullsized":"2024-05-07T14:02:32.257818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640974+0000","last_change":"2024-05-07T14:00:55.980339+0000","last_active":"2024-05-07T14:02:31.640974+0000","last_peered":"2024-05-07T14:02:31.640974+0000","last_clean":"2024-05-07T14:02:31.640974+0000","last_became_active":"2024-05-07T14:00:55.979609+0000","last_became_peered":"2024-05-07T14:00:55.979609+0000","last_unstale":"2024-05-07T14:02:31.640974+0000","last_undegraded":"2024-05-07T14:02:31.640974+0000","last_fullsized":"2024-05-07T14:02:31.640974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:52.518278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639519+0000","last_change":"2024-05-07T14:00:59.982771+0000","last_active":"2024-05-07T14:02:31.639519+0000","last_peered":"2024-05-07T14:02:31.639519+0000","last_clean":"2024-05-07T14:02:31.639519+0000","last_became_active":"2024-05-07T14:00:59.982018+0000","last_became_peered":"2024-05-07T14:00:59.982018+0000","last_unstale":"2024-05-07T14:02:31.639519+0000","last_undegraded":"2024-05-07T14:02:31.639519+0000","last_fullsized":"2024-05-07T14:02:31.639519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:47.657483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":123,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256091+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:02:32.256091+0000","last_peered":"2024-05-07T14:02:32.256091+0000","last_clean":"2024-05-07T14:02:32.256091+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:02:32.256091+0000","last_undegraded":"2024-05-07T14:02:32.256091+0000","last_fullsized":"2024-05-07T14:02:32.256091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355576+0000","last_change":"2024-05-07T14:01:04.021895+0000","last_active":"2024-05-07T14:02:32.355576+0000","last_peered":"2024-05-07T14:02:32.355576+0000","last_clean":"2024-05-07T14:02:32.355576+0000","last_became_active":"2024-05-07T14:01:04.021043+0000","last_became_peered":"2024-05-07T14:01:04.021043+0000","last_unstale":"2024-05-07T14:02:32.355576+0000","last_undegraded":"2024-05-07T14:02:32.355576+0000","last_fullsized":"2024-05-07T14:02:32.355576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:58.601458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257086+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:02:32.257086+0000","last_peered":"2024-05-07T14:02:32.257086+0000","last_clean":"2024-05-07T14:02:32.257086+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:02:32.257086+0000","last_undegraded":"2024-05-07T14:02:32.257086+0000","last_fullsized":"2024-05-07T14:02:32.257086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634941+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:02:31.634941+0000","last_peered":"2024-05-07T14:02:31.634941+0000","last_clean":"2024-05-07T14:02:31.634941+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:02:31.634941+0000","last_undegraded":"2024-05-07T14:02:31.634941+0000","last_fullsized":"2024-05-07T14:02:31.634941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640735+0000","last_change":"2024-05-07T14:00:55.980488+0000","last_active":"2024-05-07T14:02:31.640735+0000","last_peered":"2024-05-07T14:02:31.640735+0000","last_clean":"2024-05-07T14:02:31.640735+0000","last_became_active":"2024-05-07T14:00:55.979688+0000","last_became_peered":"2024-05-07T14:00:55.979688+0000","last_unstale":"2024-05-07T14:02:31.640735+0000","last_undegraded":"2024-05-07T14:02:31.640735+0000","last_fullsized":"2024-05-07T14:02:31.640735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:32.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":97,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.637922+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:02:31.637922+0000","last_peered":"2024-05-07T14:02:31.637922+0000","last_clean":"2024-05-07T14:02:31.637922+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:02:31.637922+0000","last_undegraded":"2024-05-07T14:02:31.637922+0000","last_fullsized":"2024-05-07T14:02:31.637922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392546+0000","last_change":"2024-05-07T14:01:02.014265+0000","last_active":"2024-05-07T14:02:32.392546+0000","last_peered":"2024-05-07T14:02:32.392546+0000","last_clean":"2024-05-07T14:02:32.392546+0000","last_became_active":"2024-05-07T14:01:02.009335+0000","last_became_peered":"2024-05-07T14:01:02.009335+0000","last_unstale":"2024-05-07T14:02:32.392546+0000","last_undegraded":"2024-05-07T14:02:32.392546+0000","last_fullsized":"2024-05-07T14:02:32.392546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392767+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:02:32.392767+0000","last_peered":"2024-05-07T14:02:32.392767+0000","last_clean":"2024-05-07T14:02:32.392767+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:02:32.392767+0000","last_undegraded":"2024-05-07T14:02:32.392767+0000","last_fullsized":"2024-05-07T14:02:32.392767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004228+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:02:32.004228+0000","last_peered":"2024-05-07T14:02:32.004228+0000","last_clean":"2024-05-07T14:02:32.004228+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:02:32.004228+0000","last_undegraded":"2024-05-07T14:02:32.004228+0000","last_fullsized":"2024-05-07T14:02:32.004228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004623+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:02:32.004623+0000","last_peered":"2024-05-07T14:02:32.004623+0000","last_clean":"2024-05-07T14:02:32.004623+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:02:32.004623+0000","last_undegraded":"2024-05-07T14:02:32.004623+0000","last_fullsized":"2024-05-07T14:02:32.004623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640854+0000","last_change":"2024-05-07T14:00:56.008026+0000","last_active":"2024-05-07T14:02:31.640854+0000","last_peered":"2024-05-07T14:02:31.640854+0000","last_clean":"2024-05-07T14:02:31.640854+0000","last_became_active":"2024-05-07T14:00:56.007374+0000","last_became_peered":"2024-05-07T14:00:56.007374+0000","last_unstale":"2024-05-07T14:02:31.640854+0000","last_undegraded":"2024-05-07T14:02:31.640854+0000","last_fullsized":"2024-05-07T14:02:31.640854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638494+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:02:31.638494+0000","last_peered":"2024-05-07T14:02:31.638494+0000","last_clean":"2024-05-07T14:02:31.638494+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:02:31.638494+0000","last_undegraded":"2024-05-07T14:02:31.638494+0000","last_fullsized":"2024-05-07T14:02:31.638494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":117,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640088+0000","last_change":"2024-05-07T14:01:01.997489+0000","last_active":"2024-05-07T14:02:31.640088+0000","last_peered":"2024-05-07T14:02:31.640088+0000","last_clean":"2024-05-07T14:02:31.640088+0000","last_became_active":"2024-05-07T14:01:01.994656+0000","last_became_peered":"2024-05-07T14:01:01.994656+0000","last_unstale":"2024-05-07T14:02:31.640088+0000","last_undegraded":"2024-05-07T14:02:31.640088+0000","last_fullsized":"2024-05-07T14:02:31.640088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:12.091721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409573+0000","last_change":"2024-05-07T14:01:04.009157+0000","last_active":"2024-05-07T14:02:32.409573+0000","last_peered":"2024-05-07T14:02:32.409573+0000","last_clean":"2024-05-07T14:02:32.409573+0000","last_became_active":"2024-05-07T14:01:04.008594+0000","last_became_peered":"2024-05-07T14:01:04.008594+0000","last_unstale":"2024-05-07T14:02:32.409573+0000","last_undegraded":"2024-05-07T14:02:32.409573+0000","last_fullsized":"2024-05-07T14:02:32.409573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410993+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:02:32.410993+0000","last_peered":"2024-05-07T14:02:32.410993+0000","last_clean":"2024-05-07T14:02:32.410993+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:02:32.410993+0000","last_undegraded":"2024-05-07T14:02:32.410993+0000","last_fullsized":"2024-05-07T14:02:32.410993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410157+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:02:32.410157+0000","last_peered":"2024-05-07T14:02:32.410157+0000","last_clean":"2024-05-07T14:02:32.410157+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:02:32.410157+0000","last_undegraded":"2024-05-07T14:02:32.410157+0000","last_fullsized":"2024-05-07T14:02:32.410157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257706+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:02:32.257706+0000","last_peered":"2024-05-07T14:02:32.257706+0000","last_clean":"2024-05-07T14:02:32.257706+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:02:32.257706+0000","last_undegraded":"2024-05-07T14:02:32.257706+0000","last_fullsized":"2024-05-07T14:02:32.257706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640054+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:02:31.640054+0000","last_peered":"2024-05-07T14:02:31.640054+0000","last_clean":"2024-05-07T14:02:31.640054+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:02:31.640054+0000","last_undegraded":"2024-05-07T14:02:31.640054+0000","last_fullsized":"2024-05-07T14:02:31.640054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":114,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409729+0000","last_change":"2024-05-07T14:01:01.995144+0000","last_active":"2024-05-07T14:02:32.409729+0000","last_peered":"2024-05-07T14:02:32.409729+0000","last_clean":"2024-05-07T14:02:32.409729+0000","last_became_active":"2024-05-07T14:01:01.993073+0000","last_became_peered":"2024-05-07T14:01:01.993073+0000","last_unstale":"2024-05-07T14:02:32.409729+0000","last_undegraded":"2024-05-07T14:02:32.409729+0000","last_fullsized":"2024-05-07T14:02:32.409729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:54.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.637799+0000","last_change":"2024-05-07T14:01:04.012216+0000","last_active":"2024-05-07T14:02:31.637799+0000","last_peered":"2024-05-07T14:02:31.637799+0000","last_clean":"2024-05-07T14:02:31.637799+0000","last_became_active":"2024-05-07T14:01:04.011476+0000","last_became_peered":"2024-05-07T14:01:04.011476+0000","last_unstale":"2024-05-07T14:02:31.637799+0000","last_undegraded":"2024-05-07T14:02:31.637799+0000","last_fullsized":"2024-05-07T14:02:31.637799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:46.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355963+0000","last_change":"2024-05-07T14:01:06.024311+0000","last_active":"2024-05-07T14:02:32.355963+0000","last_peered":"2024-05-07T14:02:32.355963+0000","last_clean":"2024-05-07T14:02:32.355963+0000","last_became_active":"2024-05-07T14:01:06.023404+0000","last_became_peered":"2024-05-07T14:01:06.023404+0000","last_unstale":"2024-05-07T14:02:32.355963+0000","last_undegraded":"2024-05-07T14:02:32.355963+0000","last_fullsized":"2024-05-07T14:02:32.355963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:26.544302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635610+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:02:31.635610+0000","last_peered":"2024-05-07T14:02:31.635610+0000","last_clean":"2024-05-07T14:02:31.635610+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:02:31.635610+0000","last_undegraded":"2024-05-07T14:02:31.635610+0000","last_fullsized":"2024-05-07T14:02:31.635610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391978+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:02:32.391978+0000","last_peered":"2024-05-07T14:02:32.391978+0000","last_clean":"2024-05-07T14:02:32.391978+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:02:32.391978+0000","last_undegraded":"2024-05-07T14:02:32.391978+0000","last_fullsized":"2024-05-07T14:02:32.391978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638434+0000","last_change":"2024-05-07T14:00:59.992897+0000","last_active":"2024-05-07T14:02:31.638434+0000","last_peered":"2024-05-07T14:02:31.638434+0000","last_clean":"2024-05-07T14:02:31.638434+0000","last_became_active":"2024-05-07T14:00:59.992067+0000","last_became_peered":"2024-05-07T14:00:59.992067+0000","last_unstale":"2024-05-07T14:02:31.638434+0000","last_undegraded":"2024-05-07T14:02:31.638434+0000","last_fullsized":"2024-05-07T14:02:31.638434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:19.526884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635917+0000","last_change":"2024-05-07T14:01:02.012335+0000","last_active":"2024-05-07T14:02:31.635917+0000","last_peered":"2024-05-07T14:02:31.635917+0000","last_clean":"2024-05-07T14:02:31.635917+0000","last_became_active":"2024-05-07T14:01:02.011651+0000","last_became_peered":"2024-05-07T14:01:02.011651+0000","last_unstale":"2024-05-07T14:02:31.635917+0000","last_undegraded":"2024-05-07T14:02:31.635917+0000","last_fullsized":"2024-05-07T14:02:31.635917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410607+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:02:32.410607+0000","last_peered":"2024-05-07T14:02:32.410607+0000","last_clean":"2024-05-07T14:02:32.410607+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:02:32.410607+0000","last_undegraded":"2024-05-07T14:02:32.410607+0000","last_fullsized":"2024-05-07T14:02:32.410607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390662+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:02:32.390662+0000","last_peered":"2024-05-07T14:02:32.390662+0000","last_clean":"2024-05-07T14:02:32.390662+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:02:32.390662+0000","last_undegraded":"2024-05-07T14:02:32.390662+0000","last_fullsized":"2024-05-07T14:02:32.390662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636074+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:02:31.636074+0000","last_peered":"2024-05-07T14:02:31.636074+0000","last_clean":"2024-05-07T14:02:31.636074+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:02:31.636074+0000","last_undegraded":"2024-05-07T14:02:31.636074+0000","last_fullsized":"2024-05-07T14:02:31.636074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.003506+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:02:32.003506+0000","last_peered":"2024-05-07T14:02:32.003506+0000","last_clean":"2024-05-07T14:02:32.003506+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:02:32.003506+0000","last_undegraded":"2024-05-07T14:02:32.003506+0000","last_fullsized":"2024-05-07T14:02:32.003506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":97,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356388+0000","last_change":"2024-05-07T14:01:00.006802+0000","last_active":"2024-05-07T14:02:32.356388+0000","last_peered":"2024-05-07T14:02:32.356388+0000","last_clean":"2024-05-07T14:02:32.356388+0000","last_became_active":"2024-05-07T14:01:00.006254+0000","last_became_peered":"2024-05-07T14:01:00.006254+0000","last_unstale":"2024-05-07T14:02:32.356388+0000","last_undegraded":"2024-05-07T14:02:32.356388+0000","last_fullsized":"2024-05-07T14:02:32.356388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:40.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":116,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638613+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:02:31.638613+0000","last_peered":"2024-05-07T14:02:31.638613+0000","last_clean":"2024-05-07T14:02:31.638613+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:02:31.638613+0000","last_undegraded":"2024-05-07T14:02:31.638613+0000","last_fullsized":"2024-05-07T14:02:31.638613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640082+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:02:31.640082+0000","last_peered":"2024-05-07T14:02:31.640082+0000","last_clean":"2024-05-07T14:02:31.640082+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:02:31.640082+0000","last_undegraded":"2024-05-07T14:02:31.640082+0000","last_fullsized":"2024-05-07T14:02:31.640082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355301+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:02:32.355301+0000","last_peered":"2024-05-07T14:02:32.355301+0000","last_clean":"2024-05-07T14:02:32.355301+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:02:32.355301+0000","last_undegraded":"2024-05-07T14:02:32.355301+0000","last_fullsized":"2024-05-07T14:02:32.355301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636367+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:02:31.636367+0000","last_peered":"2024-05-07T14:02:31.636367+0000","last_clean":"2024-05-07T14:02:31.636367+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:02:31.636367+0000","last_undegraded":"2024-05-07T14:02:31.636367+0000","last_fullsized":"2024-05-07T14:02:31.636367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635487+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:02:31.635487+0000","last_peered":"2024-05-07T14:02:31.635487+0000","last_clean":"2024-05-07T14:02:31.635487+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:02:31.635487+0000","last_undegraded":"2024-05-07T14:02:31.635487+0000","last_fullsized":"2024-05-07T14:02:31.635487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257847+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:02:32.257847+0000","last_peered":"2024-05-07T14:02:32.257847+0000","last_clean":"2024-05-07T14:02:32.257847+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:02:32.257847+0000","last_undegraded":"2024-05-07T14:02:32.257847+0000","last_fullsized":"2024-05-07T14:02:32.257847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391230+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:02:32.391230+0000","last_peered":"2024-05-07T14:02:32.391230+0000","last_clean":"2024-05-07T14:02:32.391230+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:02:32.391230+0000","last_undegraded":"2024-05-07T14:02:32.391230+0000","last_fullsized":"2024-05-07T14:02:32.391230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004535+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:02:32.004535+0000","last_peered":"2024-05-07T14:02:32.004535+0000","last_clean":"2024-05-07T14:02:32.004535+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:02:32.004535+0000","last_undegraded":"2024-05-07T14:02:32.004535+0000","last_fullsized":"2024-05-07T14:02:32.004535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635355+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:02:31.635355+0000","last_peered":"2024-05-07T14:02:31.635355+0000","last_clean":"2024-05-07T14:02:31.635355+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:02:31.635355+0000","last_undegraded":"2024-05-07T14:02:31.635355+0000","last_fullsized":"2024-05-07T14:02:31.635355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356351+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:02:32.356351+0000","last_peered":"2024-05-07T14:02:32.356351+0000","last_clean":"2024-05-07T14:02:32.356351+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:02:32.356351+0000","last_undegraded":"2024-05-07T14:02:32.356351+0000","last_fullsized":"2024-05-07T14:02:32.356351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391644+0000","last_change":"2024-05-07T14:00:55.974435+0000","last_active":"2024-05-07T14:02:32.391644+0000","last_peered":"2024-05-07T14:02:32.391644+0000","last_clean":"2024-05-07T14:02:32.391644+0000","last_became_active":"2024-05-07T14:00:55.974010+0000","last_became_peered":"2024-05-07T14:00:55.974010+0000","last_unstale":"2024-05-07T14:02:32.391644+0000","last_undegraded":"2024-05-07T14:02:32.391644+0000","last_fullsized":"2024-05-07T14:02:32.391644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636105+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:02:31.636105+0000","last_peered":"2024-05-07T14:02:31.636105+0000","last_clean":"2024-05-07T14:02:31.636105+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:02:31.636105+0000","last_undegraded":"2024-05-07T14:02:31.636105+0000","last_fullsized":"2024-05-07T14:02:31.636105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":120,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257329+0000","last_change":"2024-05-07T14:01:02.013314+0000","last_active":"2024-05-07T14:02:32.257329+0000","last_peered":"2024-05-07T14:02:32.257329+0000","last_clean":"2024-05-07T14:02:32.257329+0000","last_became_active":"2024-05-07T14:01:02.012667+0000","last_became_peered":"2024-05-07T14:01:02.012667+0000","last_unstale":"2024-05-07T14:02:32.257329+0000","last_undegraded":"2024-05-07T14:02:32.257329+0000","last_fullsized":"2024-05-07T14:02:32.257329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004026+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:02:32.004026+0000","last_peered":"2024-05-07T14:02:32.004026+0000","last_clean":"2024-05-07T14:02:32.004026+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:02:32.004026+0000","last_undegraded":"2024-05-07T14:02:32.004026+0000","last_fullsized":"2024-05-07T14:02:32.004026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355488+0000","last_change":"2024-05-07T14:01:06.031381+0000","last_active":"2024-05-07T14:02:32.355488+0000","last_peered":"2024-05-07T14:02:32.355488+0000","last_clean":"2024-05-07T14:02:32.355488+0000","last_became_active":"2024-05-07T14:01:06.030958+0000","last_became_peered":"2024-05-07T14:01:06.030958+0000","last_unstale":"2024-05-07T14:02:32.355488+0000","last_undegraded":"2024-05-07T14:02:32.355488+0000","last_fullsized":"2024-05-07T14:02:32.355488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:26.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.005047+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:02:32.005047+0000","last_peered":"2024-05-07T14:02:32.005047+0000","last_clean":"2024-05-07T14:02:32.005047+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:02:32.005047+0000","last_undegraded":"2024-05-07T14:02:32.005047+0000","last_fullsized":"2024-05-07T14:02:32.005047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640260+0000","last_change":"2024-05-07T14:00:45.460158+0000","last_active":"2024-05-07T14:02:31.640260+0000","last_peered":"2024-05-07T14:02:31.640260+0000","last_clean":"2024-05-07T14:02:31.640260+0000","last_became_active":"2024-05-07T14:00:45.458198+0000","last_became_peered":"2024-05-07T14:00:45.458198+0000","last_unstale":"2024-05-07T14:02:31.640260+0000","last_undegraded":"2024-05-07T14:02:31.640260+0000","last_fullsized":"2024-05-07T14:02:31.640260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:18.582514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256827+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:02:32.256827+0000","last_peered":"2024-05-07T14:02:32.256827+0000","last_clean":"2024-05-07T14:02:32.256827+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:02:32.256827+0000","last_undegraded":"2024-05-07T14:02:32.256827+0000","last_fullsized":"2024-05-07T14:02:32.256827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638157+0000","last_change":"2024-05-07T14:01:37.317794+0000","last_active":"2024-05-07T14:02:31.638157+0000","last_peered":"2024-05-07T14:02:31.638157+0000","last_clean":"2024-05-07T14:02:31.638157+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:02:31.638157+0000","last_undegraded":"2024-05-07T14:02:31.638157+0000","last_fullsized":"2024-05-07T14:02:31.638157+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:17.582561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640399+0000","last_change":"2024-05-07T14:00:59.988489+0000","last_active":"2024-05-07T14:02:31.640399+0000","last_peered":"2024-05-07T14:02:31.640399+0000","last_clean":"2024-05-07T14:02:31.640399+0000","last_became_active":"2024-05-07T14:00:59.987757+0000","last_became_peered":"2024-05-07T14:00:59.987757+0000","last_unstale":"2024-05-07T14:02:31.640399+0000","last_undegraded":"2024-05-07T14:02:31.640399+0000","last_fullsized":"2024-05-07T14:02:31.640399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":119,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.258075+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:02:32.258075+0000","last_peered":"2024-05-07T14:02:32.258075+0000","last_clean":"2024-05-07T14:02:32.258075+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:02:32.258075+0000","last_undegraded":"2024-05-07T14:02:32.258075+0000","last_fullsized":"2024-05-07T14:02:32.258075+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409106+0000","last_change":"2024-05-07T14:01:04.007712+0000","last_active":"2024-05-07T14:02:32.409106+0000","last_peered":"2024-05-07T14:02:32.409106+0000","last_clean":"2024-05-07T14:02:32.409106+0000","last_became_active":"2024-05-07T14:01:04.006934+0000","last_became_peered":"2024-05-07T14:01:04.006934+0000","last_unstale":"2024-05-07T14:02:32.409106+0000","last_undegraded":"2024-05-07T14:02:32.409106+0000","last_fullsized":"2024-05-07T14:02:32.409106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004345+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:02:32.004345+0000","last_peered":"2024-05-07T14:02:32.004345+0000","last_clean":"2024-05-07T14:02:32.004345+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:02:32.004345+0000","last_undegraded":"2024-05-07T14:02:32.004345+0000","last_fullsized":"2024-05-07T14:02:32.004345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411270+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:02:32.411270+0000","last_peered":"2024-05-07T14:02:32.411270+0000","last_clean":"2024-05-07T14:02:32.411270+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:02:32.411270+0000","last_undegraded":"2024-05-07T14:02:32.411270+0000","last_fullsized":"2024-05-07T14:02:32.411270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640390+0000","last_change":"2024-05-07T14:00:49.930222+0000","last_active":"2024-05-07T14:02:31.640390+0000","last_peered":"2024-05-07T14:02:31.640390+0000","last_clean":"2024-05-07T14:02:31.640390+0000","last_became_active":"2024-05-07T14:00:49.929538+0000","last_became_peered":"2024-05-07T14:00:49.929538+0000","last_unstale":"2024-05-07T14:02:31.640390+0000","last_undegraded":"2024-05-07T14:02:31.640390+0000","last_fullsized":"2024-05-07T14:02:31.640390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:43.069683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408792+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:02:32.408792+0000","last_peered":"2024-05-07T14:02:32.408792+0000","last_clean":"2024-05-07T14:02:32.408792+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:02:32.408792+0000","last_undegraded":"2024-05-07T14:02:32.408792+0000","last_fullsized":"2024-05-07T14:02:32.408792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.258338+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:02:32.258338+0000","last_peered":"2024-05-07T14:02:32.258338+0000","last_clean":"2024-05-07T14:02:32.258338+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:02:32.258338+0000","last_undegraded":"2024-05-07T14:02:32.258338+0000","last_fullsized":"2024-05-07T14:02:32.258338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":150,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356303+0000","last_change":"2024-05-07T14:01:02.014645+0000","last_active":"2024-05-07T14:02:32.356303+0000","last_peered":"2024-05-07T14:02:32.356303+0000","last_clean":"2024-05-07T14:02:32.356303+0000","last_became_active":"2024-05-07T14:01:02.013904+0000","last_became_peered":"2024-05-07T14:01:02.013904+0000","last_unstale":"2024-05-07T14:02:32.356303+0000","last_undegraded":"2024-05-07T14:02:32.356303+0000","last_fullsized":"2024-05-07T14:02:32.356303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:31.441743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640523+0000","last_change":"2024-05-07T14:01:04.012527+0000","last_active":"2024-05-07T14:02:31.640523+0000","last_peered":"2024-05-07T14:02:31.640523+0000","last_clean":"2024-05-07T14:02:31.640523+0000","last_became_active":"2024-05-07T14:01:04.007658+0000","last_became_peered":"2024-05-07T14:01:04.007658+0000","last_unstale":"2024-05-07T14:02:31.640523+0000","last_undegraded":"2024-05-07T14:02:31.640523+0000","last_fullsized":"2024-05-07T14:02:31.640523+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355410+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:02:32.355410+0000","last_peered":"2024-05-07T14:02:32.355410+0000","last_clean":"2024-05-07T14:02:32.355410+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:02:32.355410+0000","last_undegraded":"2024-05-07T14:02:32.355410+0000","last_fullsized":"2024-05-07T14:02:32.355410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356422+0000","last_change":"2024-05-07T14:00:57.989314+0000","last_active":"2024-05-07T14:02:32.356422+0000","last_peered":"2024-05-07T14:02:32.356422+0000","last_clean":"2024-05-07T14:02:32.356422+0000","last_became_active":"2024-05-07T14:00:57.988994+0000","last_became_peered":"2024-05-07T14:00:57.988994+0000","last_unstale":"2024-05-07T14:02:32.356422+0000","last_undegraded":"2024-05-07T14:02:32.356422+0000","last_fullsized":"2024-05-07T14:02:32.356422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638224+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:02:31.638224+0000","last_peered":"2024-05-07T14:02:31.638224+0000","last_clean":"2024-05-07T14:02:31.638224+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:02:31.638224+0000","last_undegraded":"2024-05-07T14:02:31.638224+0000","last_fullsized":"2024-05-07T14:02:31.638224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.354684+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:02:32.354684+0000","last_peered":"2024-05-07T14:02:32.354684+0000","last_clean":"2024-05-07T14:02:32.354684+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:02:32.354684+0000","last_undegraded":"2024-05-07T14:02:32.354684+0000","last_fullsized":"2024-05-07T14:02:32.354684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640173+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:02:31.640173+0000","last_peered":"2024-05-07T14:02:31.640173+0000","last_clean":"2024-05-07T14:02:31.640173+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:02:31.640173+0000","last_undegraded":"2024-05-07T14:02:31.640173+0000","last_fullsized":"2024-05-07T14:02:31.640173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":131,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640679+0000","last_change":"2024-05-07T14:01:02.148182+0000","last_active":"2024-05-07T14:02:31.640679+0000","last_peered":"2024-05-07T14:02:31.640679+0000","last_clean":"2024-05-07T14:02:31.640679+0000","last_became_active":"2024-05-07T14:01:02.147442+0000","last_became_peered":"2024-05-07T14:01:02.147442+0000","last_unstale":"2024-05-07T14:02:31.640679+0000","last_undegraded":"2024-05-07T14:02:31.640679+0000","last_fullsized":"2024-05-07T14:02:31.640679+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:24.955989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409049+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:02:32.409049+0000","last_peered":"2024-05-07T14:02:32.409049+0000","last_clean":"2024-05-07T14:02:32.409049+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:02:32.409049+0000","last_undegraded":"2024-05-07T14:02:32.409049+0000","last_fullsized":"2024-05-07T14:02:32.409049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392329+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:02:32.392329+0000","last_peered":"2024-05-07T14:02:32.392329+0000","last_clean":"2024-05-07T14:02:32.392329+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:02:32.392329+0000","last_undegraded":"2024-05-07T14:02:32.392329+0000","last_fullsized":"2024-05-07T14:02:32.392329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":54,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257259+0000","last_change":"2024-05-07T14:01:37.318739+0000","last_active":"2024-05-07T14:02:32.257259+0000","last_peered":"2024-05-07T14:02:32.257259+0000","last_clean":"2024-05-07T14:02:32.257259+0000","last_became_active":"2024-05-07T14:01:37.317858+0000","last_became_peered":"2024-05-07T14:01:37.317858+0000","last_unstale":"2024-05-07T14:02:32.257259+0000","last_undegraded":"2024-05-07T14:02:32.257259+0000","last_fullsized":"2024-05-07T14:02:32.257259+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:42:22.624696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256903+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:02:32.256903+0000","last_peered":"2024-05-07T14:02:32.256903+0000","last_clean":"2024-05-07T14:02:32.256903+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:02:32.256903+0000","last_undegraded":"2024-05-07T14:02:32.256903+0000","last_fullsized":"2024-05-07T14:02:32.256903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635777+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:02:31.635777+0000","last_peered":"2024-05-07T14:02:31.635777+0000","last_clean":"2024-05-07T14:02:31.635777+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:02:31.635777+0000","last_undegraded":"2024-05-07T14:02:31.635777+0000","last_fullsized":"2024-05-07T14:02:31.635777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410623+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:02:32.410623+0000","last_peered":"2024-05-07T14:02:32.410623+0000","last_clean":"2024-05-07T14:02:32.410623+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:02:32.410623+0000","last_undegraded":"2024-05-07T14:02:32.410623+0000","last_fullsized":"2024-05-07T14:02:32.410623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391598+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:02:32.391598+0000","last_peered":"2024-05-07T14:02:32.391598+0000","last_clean":"2024-05-07T14:02:32.391598+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:02:32.391598+0000","last_undegraded":"2024-05-07T14:02:32.391598+0000","last_fullsized":"2024-05-07T14:02:32.391598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004517+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:02:32.004517+0000","last_peered":"2024-05-07T14:02:32.004517+0000","last_clean":"2024-05-07T14:02:32.004517+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:02:32.004517+0000","last_undegraded":"2024-05-07T14:02:32.004517+0000","last_fullsized":"2024-05-07T14:02:32.004517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256515+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:02:32.256515+0000","last_peered":"2024-05-07T14:02:32.256515+0000","last_clean":"2024-05-07T14:02:32.256515+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:02:32.256515+0000","last_undegraded":"2024-05-07T14:02:32.256515+0000","last_fullsized":"2024-05-07T14:02:32.256515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355718+0000","last_change":"2024-05-07T14:00:57.989747+0000","last_active":"2024-05-07T14:02:32.355718+0000","last_peered":"2024-05-07T14:02:32.355718+0000","last_clean":"2024-05-07T14:02:32.355718+0000","last_became_active":"2024-05-07T14:00:57.989252+0000","last_became_peered":"2024-05-07T14:00:57.989252+0000","last_unstale":"2024-05-07T14:02:32.355718+0000","last_undegraded":"2024-05-07T14:02:32.355718+0000","last_fullsized":"2024-05-07T14:02:32.355718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:44.815601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.258132+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:02:32.258132+0000","last_peered":"2024-05-07T14:02:32.258132+0000","last_clean":"2024-05-07T14:02:32.258132+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:02:32.258132+0000","last_undegraded":"2024-05-07T14:02:32.258132+0000","last_fullsized":"2024-05-07T14:02:32.258132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356638+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:02:32.356638+0000","last_peered":"2024-05-07T14:02:32.356638+0000","last_clean":"2024-05-07T14:02:32.356638+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:02:32.356638+0000","last_undegraded":"2024-05-07T14:02:32.356638+0000","last_fullsized":"2024-05-07T14:02:32.356638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409819+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:02:32.409819+0000","last_peered":"2024-05-07T14:02:32.409819+0000","last_clean":"2024-05-07T14:02:32.409819+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:02:32.409819+0000","last_undegraded":"2024-05-07T14:02:32.409819+0000","last_fullsized":"2024-05-07T14:02:32.409819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":123,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409777+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:02:32.409777+0000","last_peered":"2024-05-07T14:02:32.409777+0000","last_clean":"2024-05-07T14:02:32.409777+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:02:32.409777+0000","last_undegraded":"2024-05-07T14:02:32.409777+0000","last_fullsized":"2024-05-07T14:02:32.409777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634736+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:02:31.634736+0000","last_peered":"2024-05-07T14:02:31.634736+0000","last_clean":"2024-05-07T14:02:31.634736+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:02:31.634736+0000","last_undegraded":"2024-05-07T14:02:31.634736+0000","last_fullsized":"2024-05-07T14:02:31.634736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410817+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:02:32.410817+0000","last_peered":"2024-05-07T14:02:32.410817+0000","last_clean":"2024-05-07T14:02:32.410817+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:02:32.410817+0000","last_undegraded":"2024-05-07T14:02:32.410817+0000","last_fullsized":"2024-05-07T14:02:32.410817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410076+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:02:32.410076+0000","last_peered":"2024-05-07T14:02:32.410076+0000","last_clean":"2024-05-07T14:02:32.410076+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:02:32.410076+0000","last_undegraded":"2024-05-07T14:02:32.410076+0000","last_fullsized":"2024-05-07T14:02:32.410076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355091+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:02:32.355091+0000","last_peered":"2024-05-07T14:02:32.355091+0000","last_clean":"2024-05-07T14:02:32.355091+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:02:32.355091+0000","last_undegraded":"2024-05-07T14:02:32.355091+0000","last_fullsized":"2024-05-07T14:02:32.355091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640996+0000","last_change":"2024-05-07T14:00:49.928907+0000","last_active":"2024-05-07T14:02:31.640996+0000","last_peered":"2024-05-07T14:02:31.640996+0000","last_clean":"2024-05-07T14:02:31.640996+0000","last_became_active":"2024-05-07T14:00:49.928146+0000","last_became_peered":"2024-05-07T14:00:49.928146+0000","last_unstale":"2024-05-07T14:02:31.640996+0000","last_undegraded":"2024-05-07T14:02:31.640996+0000","last_fullsized":"2024-05-07T14:02:31.640996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:07.032835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004435+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:02:32.004435+0000","last_peered":"2024-05-07T14:02:32.004435+0000","last_clean":"2024-05-07T14:02:32.004435+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:02:32.004435+0000","last_undegraded":"2024-05-07T14:02:32.004435+0000","last_fullsized":"2024-05-07T14:02:32.004435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":112,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355206+0000","last_change":"2024-05-07T14:01:02.148499+0000","last_active":"2024-05-07T14:02:32.355206+0000","last_peered":"2024-05-07T14:02:32.355206+0000","last_clean":"2024-05-07T14:02:32.355206+0000","last_became_active":"2024-05-07T14:01:02.147567+0000","last_became_peered":"2024-05-07T14:01:02.147567+0000","last_unstale":"2024-05-07T14:02:32.355206+0000","last_undegraded":"2024-05-07T14:02:32.355206+0000","last_fullsized":"2024-05-07T14:02:32.355206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:30.162886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257409+0000","last_change":"2024-05-07T14:01:04.015930+0000","last_active":"2024-05-07T14:02:32.257409+0000","last_peered":"2024-05-07T14:02:32.257409+0000","last_clean":"2024-05-07T14:02:32.257409+0000","last_became_active":"2024-05-07T14:01:04.011643+0000","last_became_peered":"2024-05-07T14:01:04.011643+0000","last_unstale":"2024-05-07T14:02:32.257409+0000","last_undegraded":"2024-05-07T14:02:32.257409+0000","last_fullsized":"2024-05-07T14:02:32.257409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392166+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:02:32.392166+0000","last_peered":"2024-05-07T14:02:32.392166+0000","last_clean":"2024-05-07T14:02:32.392166+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:02:32.392166+0000","last_undegraded":"2024-05-07T14:02:32.392166+0000","last_fullsized":"2024-05-07T14:02:32.392166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390923+0000","last_change":"2024-05-07T14:00:57.998539+0000","last_active":"2024-05-07T14:02:32.390923+0000","last_peered":"2024-05-07T14:02:32.390923+0000","last_clean":"2024-05-07T14:02:32.390923+0000","last_became_active":"2024-05-07T14:00:57.998025+0000","last_became_peered":"2024-05-07T14:00:57.998025+0000","last_unstale":"2024-05-07T14:02:32.390923+0000","last_undegraded":"2024-05-07T14:02:32.390923+0000","last_fullsized":"2024-05-07T14:02:32.390923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391887+0000","last_change":"2024-05-07T14:00:55.988508+0000","last_active":"2024-05-07T14:02:32.391887+0000","last_peered":"2024-05-07T14:02:32.391887+0000","last_clean":"2024-05-07T14:02:32.391887+0000","last_became_active":"2024-05-07T14:00:55.988230+0000","last_became_peered":"2024-05-07T14:00:55.988230+0000","last_unstale":"2024-05-07T14:02:32.391887+0000","last_undegraded":"2024-05-07T14:02:32.391887+0000","last_fullsized":"2024-05-07T14:02:32.391887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356213+0000","last_change":"2024-05-07T14:00:49.936072+0000","last_active":"2024-05-07T14:02:32.356213+0000","last_peered":"2024-05-07T14:02:32.356213+0000","last_clean":"2024-05-07T14:02:32.356213+0000","last_became_active":"2024-05-07T14:00:49.935768+0000","last_became_peered":"2024-05-07T14:00:49.935768+0000","last_unstale":"2024-05-07T14:02:32.356213+0000","last_undegraded":"2024-05-07T14:02:32.356213+0000","last_fullsized":"2024-05-07T14:02:32.356213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634918+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:02:31.634918+0000","last_peered":"2024-05-07T14:02:31.634918+0000","last_clean":"2024-05-07T14:02:31.634918+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:02:31.634918+0000","last_undegraded":"2024-05-07T14:02:31.634918+0000","last_fullsized":"2024-05-07T14:02:31.634918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635502+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:02:31.635502+0000","last_peered":"2024-05-07T14:02:31.635502+0000","last_clean":"2024-05-07T14:02:31.635502+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:02:31.635502+0000","last_undegraded":"2024-05-07T14:02:31.635502+0000","last_fullsized":"2024-05-07T14:02:31.635502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391794+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:02:32.391794+0000","last_peered":"2024-05-07T14:02:32.391794+0000","last_clean":"2024-05-07T14:02:32.391794+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:02:32.391794+0000","last_undegraded":"2024-05-07T14:02:32.391794+0000","last_fullsized":"2024-05-07T14:02:32.391794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410429+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:02:32.410429+0000","last_peered":"2024-05-07T14:02:32.410429+0000","last_clean":"2024-05-07T14:02:32.410429+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:02:32.410429+0000","last_undegraded":"2024-05-07T14:02:32.410429+0000","last_fullsized":"2024-05-07T14:02:32.410429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635240+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:02:31.635240+0000","last_peered":"2024-05-07T14:02:31.635240+0000","last_clean":"2024-05-07T14:02:31.635240+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:02:31.635240+0000","last_undegraded":"2024-05-07T14:02:31.635240+0000","last_fullsized":"2024-05-07T14:02:31.635240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411400+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:02:32.411400+0000","last_peered":"2024-05-07T14:02:32.411400+0000","last_clean":"2024-05-07T14:02:32.411400+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:02:32.411400+0000","last_undegraded":"2024-05-07T14:02:32.411400+0000","last_fullsized":"2024-05-07T14:02:32.411400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.005023+0000","last_change":"2024-05-07T14:00:49.938879+0000","last_active":"2024-05-07T14:02:32.005023+0000","last_peered":"2024-05-07T14:02:32.005023+0000","last_clean":"2024-05-07T14:02:32.005023+0000","last_became_active":"2024-05-07T14:00:49.938066+0000","last_became_peered":"2024-05-07T14:00:49.938066+0000","last_unstale":"2024-05-07T14:02:32.005023+0000","last_undegraded":"2024-05-07T14:02:32.005023+0000","last_fullsized":"2024-05-07T14:02:32.005023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390805+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:02:32.390805+0000","last_peered":"2024-05-07T14:02:32.390805+0000","last_clean":"2024-05-07T14:02:32.390805+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:02:32.390805+0000","last_undegraded":"2024-05-07T14:02:32.390805+0000","last_fullsized":"2024-05-07T14:02:32.390805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":128,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639659+0000","last_change":"2024-05-07T14:01:02.148095+0000","last_active":"2024-05-07T14:02:31.639659+0000","last_peered":"2024-05-07T14:02:31.639659+0000","last_clean":"2024-05-07T14:02:31.639659+0000","last_became_active":"2024-05-07T14:01:02.147334+0000","last_became_peered":"2024-05-07T14:01:02.147334+0000","last_unstale":"2024-05-07T14:02:31.639659+0000","last_undegraded":"2024-05-07T14:02:31.639659+0000","last_fullsized":"2024-05-07T14:02:31.639659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392864+0000","last_change":"2024-05-07T14:01:04.024279+0000","last_active":"2024-05-07T14:02:32.392864+0000","last_peered":"2024-05-07T14:02:32.392864+0000","last_clean":"2024-05-07T14:02:32.392864+0000","last_became_active":"2024-05-07T14:01:04.022870+0000","last_became_peered":"2024-05-07T14:01:04.022870+0000","last_unstale":"2024-05-07T14:02:32.392864+0000","last_undegraded":"2024-05-07T14:02:32.392864+0000","last_fullsized":"2024-05-07T14:02:32.392864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:28.158572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257047+0000","last_change":"2024-05-07T14:01:06.039788+0000","last_active":"2024-05-07T14:02:32.257047+0000","last_peered":"2024-05-07T14:02:32.257047+0000","last_clean":"2024-05-07T14:02:32.257047+0000","last_became_active":"2024-05-07T14:01:06.039050+0000","last_became_peered":"2024-05-07T14:01:06.039050+0000","last_unstale":"2024-05-07T14:02:32.257047+0000","last_undegraded":"2024-05-07T14:02:32.257047+0000","last_fullsized":"2024-05-07T14:02:32.257047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410592+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:02:32.410592+0000","last_peered":"2024-05-07T14:02:32.410592+0000","last_clean":"2024-05-07T14:02:32.410592+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:02:32.410592+0000","last_undegraded":"2024-05-07T14:02:32.410592+0000","last_fullsized":"2024-05-07T14:02:32.410592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635383+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:02:31.635383+0000","last_peered":"2024-05-07T14:02:31.635383+0000","last_clean":"2024-05-07T14:02:31.635383+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:02:31.635383+0000","last_undegraded":"2024-05-07T14:02:31.635383+0000","last_fullsized":"2024-05-07T14:02:31.635383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635151+0000","last_change":"2024-05-07T14:00:55.991934+0000","last_active":"2024-05-07T14:02:31.635151+0000","last_peered":"2024-05-07T14:02:31.635151+0000","last_clean":"2024-05-07T14:02:31.635151+0000","last_became_active":"2024-05-07T14:00:55.991303+0000","last_became_peered":"2024-05-07T14:00:55.991303+0000","last_unstale":"2024-05-07T14:02:31.635151+0000","last_undegraded":"2024-05-07T14:02:31.635151+0000","last_fullsized":"2024-05-07T14:02:31.635151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355809+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:02:32.355809+0000","last_peered":"2024-05-07T14:02:32.355809+0000","last_clean":"2024-05-07T14:02:32.355809+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:02:32.355809+0000","last_undegraded":"2024-05-07T14:02:32.355809+0000","last_fullsized":"2024-05-07T14:02:32.355809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390229+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:02:32.390229+0000","last_peered":"2024-05-07T14:02:32.390229+0000","last_clean":"2024-05-07T14:02:32.390229+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:02:32.390229+0000","last_undegraded":"2024-05-07T14:02:32.390229+0000","last_fullsized":"2024-05-07T14:02:32.390229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390456+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:02:32.390456+0000","last_peered":"2024-05-07T14:02:32.390456+0000","last_clean":"2024-05-07T14:02:32.390456+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:02:32.390456+0000","last_undegraded":"2024-05-07T14:02:32.390456+0000","last_fullsized":"2024-05-07T14:02:32.390456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391361+0000","last_change":"2024-05-07T14:01:06.013974+0000","last_active":"2024-05-07T14:02:32.391361+0000","last_peered":"2024-05-07T14:02:32.391361+0000","last_clean":"2024-05-07T14:02:32.391361+0000","last_became_active":"2024-05-07T14:01:06.013281+0000","last_became_peered":"2024-05-07T14:01:06.013281+0000","last_unstale":"2024-05-07T14:02:32.391361+0000","last_undegraded":"2024-05-07T14:02:32.391361+0000","last_fullsized":"2024-05-07T14:02:32.391361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:46.349394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355642+0000","last_change":"2024-05-07T14:00:58.001752+0000","last_active":"2024-05-07T14:02:32.355642+0000","last_peered":"2024-05-07T14:02:32.355642+0000","last_clean":"2024-05-07T14:02:32.355642+0000","last_became_active":"2024-05-07T14:00:57.999982+0000","last_became_peered":"2024-05-07T14:00:57.999982+0000","last_unstale":"2024-05-07T14:02:32.355642+0000","last_undegraded":"2024-05-07T14:02:32.355642+0000","last_fullsized":"2024-05-07T14:02:32.355642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640857+0000","last_change":"2024-05-07T14:00:55.968287+0000","last_active":"2024-05-07T14:02:31.640857+0000","last_peered":"2024-05-07T14:02:31.640857+0000","last_clean":"2024-05-07T14:02:31.640857+0000","last_became_active":"2024-05-07T14:00:55.967578+0000","last_became_peered":"2024-05-07T14:00:55.967578+0000","last_unstale":"2024-05-07T14:02:31.640857+0000","last_undegraded":"2024-05-07T14:02:31.640857+0000","last_fullsized":"2024-05-07T14:02:31.640857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392255+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:02:32.392255+0000","last_peered":"2024-05-07T14:02:32.392255+0000","last_clean":"2024-05-07T14:02:32.392255+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:02:32.392255+0000","last_undegraded":"2024-05-07T14:02:32.392255+0000","last_fullsized":"2024-05-07T14:02:32.392255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"46'5","reported_seq":98,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409638+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:02:32.409638+0000","last_peered":"2024-05-07T14:02:32.409638+0000","last_clean":"2024-05-07T14:02:32.409638+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:02:32.409638+0000","last_undegraded":"2024-05-07T14:02:32.409638+0000","last_fullsized":"2024-05-07T14:02:32.409638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639595+0000","last_change":"2024-05-07T14:01:04.012628+0000","last_active":"2024-05-07T14:02:31.639595+0000","last_peered":"2024-05-07T14:02:31.639595+0000","last_clean":"2024-05-07T14:02:31.639595+0000","last_became_active":"2024-05-07T14:01:04.011910+0000","last_became_peered":"2024-05-07T14:01:04.011910+0000","last_unstale":"2024-05-07T14:02:31.639595+0000","last_undegraded":"2024-05-07T14:02:31.639595+0000","last_fullsized":"2024-05-07T14:02:31.639595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410530+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:02:32.410530+0000","last_peered":"2024-05-07T14:02:32.410530+0000","last_clean":"2024-05-07T14:02:32.410530+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:02:32.410530+0000","last_undegraded":"2024-05-07T14:02:32.410530+0000","last_fullsized":"2024-05-07T14:02:32.410530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390541+0000","last_change":"2024-05-07T14:00:57.999019+0000","last_active":"2024-05-07T14:02:32.390541+0000","last_peered":"2024-05-07T14:02:32.390541+0000","last_clean":"2024-05-07T14:02:32.390541+0000","last_became_active":"2024-05-07T14:00:57.998526+0000","last_became_peered":"2024-05-07T14:00:57.998526+0000","last_unstale":"2024-05-07T14:02:32.390541+0000","last_undegraded":"2024-05-07T14:02:32.390541+0000","last_fullsized":"2024-05-07T14:02:32.390541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255566+0000","last_change":"2024-05-07T14:00:55.999548+0000","last_active":"2024-05-07T14:02:32.255566+0000","last_peered":"2024-05-07T14:02:32.255566+0000","last_clean":"2024-05-07T14:02:32.255566+0000","last_became_active":"2024-05-07T14:00:55.995284+0000","last_became_peered":"2024-05-07T14:00:55.995284+0000","last_unstale":"2024-05-07T14:02:32.255566+0000","last_undegraded":"2024-05-07T14:02:32.255566+0000","last_fullsized":"2024-05-07T14:02:32.255566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639182+0000","last_change":"2024-05-07T14:00:59.996971+0000","last_active":"2024-05-07T14:02:31.639182+0000","last_peered":"2024-05-07T14:02:31.639182+0000","last_clean":"2024-05-07T14:02:31.639182+0000","last_became_active":"2024-05-07T14:00:59.996254+0000","last_became_peered":"2024-05-07T14:00:59.996254+0000","last_unstale":"2024-05-07T14:02:31.639182+0000","last_undegraded":"2024-05-07T14:02:31.639182+0000","last_fullsized":"2024-05-07T14:02:31.639182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392101+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:02:32.392101+0000","last_peered":"2024-05-07T14:02:32.392101+0000","last_clean":"2024-05-07T14:02:32.392101+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:02:32.392101+0000","last_undegraded":"2024-05-07T14:02:32.392101+0000","last_fullsized":"2024-05-07T14:02:32.392101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004389+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:02:32.004389+0000","last_peered":"2024-05-07T14:02:32.004389+0000","last_clean":"2024-05-07T14:02:32.004389+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:02:32.004389+0000","last_undegraded":"2024-05-07T14:02:32.004389+0000","last_fullsized":"2024-05-07T14:02:32.004389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256988+0000","last_change":"2024-05-07T14:01:06.038138+0000","last_active":"2024-05-07T14:02:32.256988+0000","last_peered":"2024-05-07T14:02:32.256988+0000","last_clean":"2024-05-07T14:02:32.256988+0000","last_became_active":"2024-05-07T14:01:06.030966+0000","last_became_peered":"2024-05-07T14:01:06.030966+0000","last_unstale":"2024-05-07T14:02:32.256988+0000","last_undegraded":"2024-05-07T14:02:32.256988+0000","last_fullsized":"2024-05-07T14:02:32.256988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391039+0000","last_change":"2024-05-07T14:00:57.987879+0000","last_active":"2024-05-07T14:02:32.391039+0000","last_peered":"2024-05-07T14:02:32.391039+0000","last_clean":"2024-05-07T14:02:32.391039+0000","last_became_active":"2024-05-07T14:00:57.987544+0000","last_became_peered":"2024-05-07T14:00:57.987544+0000","last_unstale":"2024-05-07T14:02:32.391039+0000","last_undegraded":"2024-05-07T14:02:32.391039+0000","last_fullsized":"2024-05-07T14:02:32.391039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.643382+0000","last_change":"2024-05-07T14:01:37.318408+0000","last_active":"2024-05-07T14:02:31.643382+0000","last_peered":"2024-05-07T14:02:31.643382+0000","last_clean":"2024-05-07T14:02:31.643382+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:02:31.643382+0000","last_undegraded":"2024-05-07T14:02:31.643382+0000","last_fullsized":"2024-05-07T14:02:31.643382+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:43.643434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004141+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:02:32.004141+0000","last_peered":"2024-05-07T14:02:32.004141+0000","last_clean":"2024-05-07T14:02:32.004141+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:02:32.004141+0000","last_undegraded":"2024-05-07T14:02:32.004141+0000","last_fullsized":"2024-05-07T14:02:32.004141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639461+0000","last_change":"2024-05-07T14:01:01.995377+0000","last_active":"2024-05-07T14:02:31.639461+0000","last_peered":"2024-05-07T14:02:31.639461+0000","last_clean":"2024-05-07T14:02:31.639461+0000","last_became_active":"2024-05-07T14:01:01.994566+0000","last_became_peered":"2024-05-07T14:01:01.994566+0000","last_unstale":"2024-05-07T14:02:31.639461+0000","last_undegraded":"2024-05-07T14:02:31.639461+0000","last_fullsized":"2024-05-07T14:02:31.639461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409159+0000","last_change":"2024-05-07T14:01:03.997116+0000","last_active":"2024-05-07T14:02:32.409159+0000","last_peered":"2024-05-07T14:02:32.409159+0000","last_clean":"2024-05-07T14:02:32.409159+0000","last_became_active":"2024-05-07T14:01:03.996555+0000","last_became_peered":"2024-05-07T14:01:03.996555+0000","last_unstale":"2024-05-07T14:02:32.409159+0000","last_undegraded":"2024-05-07T14:02:32.409159+0000","last_fullsized":"2024-05-07T14:02:32.409159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004797+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:02:32.004797+0000","last_peered":"2024-05-07T14:02:32.004797+0000","last_clean":"2024-05-07T14:02:32.004797+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:02:32.004797+0000","last_undegraded":"2024-05-07T14:02:32.004797+0000","last_fullsized":"2024-05-07T14:02:32.004797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391560+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:02:32.391560+0000","last_peered":"2024-05-07T14:02:32.391560+0000","last_clean":"2024-05-07T14:02:32.391560+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:02:32.391560+0000","last_undegraded":"2024-05-07T14:02:32.391560+0000","last_fullsized":"2024-05-07T14:02:32.391560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411078+0000","last_change":"2024-05-07T14:00:59.995694+0000","last_active":"2024-05-07T14:02:32.411078+0000","last_peered":"2024-05-07T14:02:32.411078+0000","last_clean":"2024-05-07T14:02:32.411078+0000","last_became_active":"2024-05-07T14:00:59.993899+0000","last_became_peered":"2024-05-07T14:00:59.993899+0000","last_unstale":"2024-05-07T14:02:32.411078+0000","last_undegraded":"2024-05-07T14:02:32.411078+0000","last_fullsized":"2024-05-07T14:02:32.411078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:28.225348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":114,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356788+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:02:32.356788+0000","last_peered":"2024-05-07T14:02:32.356788+0000","last_clean":"2024-05-07T14:02:32.356788+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:02:32.356788+0000","last_undegraded":"2024-05-07T14:02:32.356788+0000","last_fullsized":"2024-05-07T14:02:32.356788+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257183+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:02:32.257183+0000","last_peered":"2024-05-07T14:02:32.257183+0000","last_clean":"2024-05-07T14:02:32.257183+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:02:32.257183+0000","last_undegraded":"2024-05-07T14:02:32.257183+0000","last_fullsized":"2024-05-07T14:02:32.257183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391893+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:02:32.391893+0000","last_peered":"2024-05-07T14:02:32.391893+0000","last_clean":"2024-05-07T14:02:32.391893+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:02:32.391893+0000","last_undegraded":"2024-05-07T14:02:32.391893+0000","last_fullsized":"2024-05-07T14:02:32.391893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411199+0000","last_change":"2024-05-07T14:00:57.995989+0000","last_active":"2024-05-07T14:02:32.411199+0000","last_peered":"2024-05-07T14:02:32.411199+0000","last_clean":"2024-05-07T14:02:32.411199+0000","last_became_active":"2024-05-07T14:00:57.995721+0000","last_became_peered":"2024-05-07T14:00:57.995721+0000","last_unstale":"2024-05-07T14:02:32.411199+0000","last_undegraded":"2024-05-07T14:02:32.411199+0000","last_fullsized":"2024-05-07T14:02:32.411199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355551+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:02:32.355551+0000","last_peered":"2024-05-07T14:02:32.355551+0000","last_clean":"2024-05-07T14:02:32.355551+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:02:32.355551+0000","last_undegraded":"2024-05-07T14:02:32.355551+0000","last_fullsized":"2024-05-07T14:02:32.355551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004702+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:02:32.004702+0000","last_peered":"2024-05-07T14:02:32.004702+0000","last_clean":"2024-05-07T14:02:32.004702+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:02:32.004702+0000","last_undegraded":"2024-05-07T14:02:32.004702+0000","last_fullsized":"2024-05-07T14:02:32.004702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":117,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639868+0000","last_change":"2024-05-07T14:01:02.002384+0000","last_active":"2024-05-07T14:02:31.639868+0000","last_peered":"2024-05-07T14:02:31.639868+0000","last_clean":"2024-05-07T14:02:31.639868+0000","last_became_active":"2024-05-07T14:01:02.001676+0000","last_became_peered":"2024-05-07T14:01:02.001676+0000","last_unstale":"2024-05-07T14:02:31.639868+0000","last_undegraded":"2024-05-07T14:02:31.639868+0000","last_fullsized":"2024-05-07T14:02:31.639868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.354935+0000","last_change":"2024-05-07T14:01:04.015893+0000","last_active":"2024-05-07T14:02:32.354935+0000","last_peered":"2024-05-07T14:02:32.354935+0000","last_clean":"2024-05-07T14:02:32.354935+0000","last_became_active":"2024-05-07T14:01:04.015329+0000","last_became_peered":"2024-05-07T14:01:04.015329+0000","last_unstale":"2024-05-07T14:02:32.354935+0000","last_undegraded":"2024-05-07T14:02:32.354935+0000","last_fullsized":"2024-05-07T14:02:32.354935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:53.413495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004057+0000","last_change":"2024-05-07T14:01:06.025917+0000","last_active":"2024-05-07T14:02:32.004057+0000","last_peered":"2024-05-07T14:02:32.004057+0000","last_clean":"2024-05-07T14:02:32.004057+0000","last_became_active":"2024-05-07T14:01:06.025044+0000","last_became_peered":"2024-05-07T14:01:06.025044+0000","last_unstale":"2024-05-07T14:02:32.004057+0000","last_undegraded":"2024-05-07T14:02:32.004057+0000","last_fullsized":"2024-05-07T14:02:32.004057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:55.419668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391344+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:02:32.391344+0000","last_peered":"2024-05-07T14:02:32.391344+0000","last_clean":"2024-05-07T14:02:32.391344+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:02:32.391344+0000","last_undegraded":"2024-05-07T14:02:32.391344+0000","last_fullsized":"2024-05-07T14:02:32.391344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635813+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:02:31.635813+0000","last_peered":"2024-05-07T14:02:31.635813+0000","last_clean":"2024-05-07T14:02:31.635813+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:02:31.635813+0000","last_undegraded":"2024-05-07T14:02:31.635813+0000","last_fullsized":"2024-05-07T14:02:31.635813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636179+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:02:31.636179+0000","last_peered":"2024-05-07T14:02:31.636179+0000","last_clean":"2024-05-07T14:02:31.636179+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:02:31.636179+0000","last_undegraded":"2024-05-07T14:02:31.636179+0000","last_fullsized":"2024-05-07T14:02:31.636179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392289+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:02:32.392289+0000","last_peered":"2024-05-07T14:02:32.392289+0000","last_clean":"2024-05-07T14:02:32.392289+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:02:32.392289+0000","last_undegraded":"2024-05-07T14:02:32.392289+0000","last_fullsized":"2024-05-07T14:02:32.392289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356057+0000","last_change":"2024-05-07T14:01:04.026470+0000","last_active":"2024-05-07T14:02:32.356057+0000","last_peered":"2024-05-07T14:02:32.356057+0000","last_clean":"2024-05-07T14:02:32.356057+0000","last_became_active":"2024-05-07T14:01:04.025881+0000","last_became_peered":"2024-05-07T14:01:04.025881+0000","last_unstale":"2024-05-07T14:02:32.356057+0000","last_undegraded":"2024-05-07T14:02:32.356057+0000","last_fullsized":"2024-05-07T14:02:32.356057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:54.595283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256529+0000","last_change":"2024-05-07T14:01:06.038979+0000","last_active":"2024-05-07T14:02:32.256529+0000","last_peered":"2024-05-07T14:02:32.256529+0000","last_clean":"2024-05-07T14:02:32.256529+0000","last_became_active":"2024-05-07T14:01:06.035737+0000","last_became_peered":"2024-05-07T14:01:06.035737+0000","last_unstale":"2024-05-07T14:02:32.256529+0000","last_undegraded":"2024-05-07T14:02:32.256529+0000","last_fullsized":"2024-05-07T14:02:32.256529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.643372+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:02:31.643372+0000","last_peered":"2024-05-07T14:02:31.643372+0000","last_clean":"2024-05-07T14:02:31.643372+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:02:31.643372+0000","last_undegraded":"2024-05-07T14:02:31.643372+0000","last_fullsized":"2024-05-07T14:02:31.643372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409055+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:02:32.409055+0000","last_peered":"2024-05-07T14:02:32.409055+0000","last_clean":"2024-05-07T14:02:32.409055+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:02:32.409055+0000","last_undegraded":"2024-05-07T14:02:32.409055+0000","last_fullsized":"2024-05-07T14:02:32.409055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.357057+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:02:32.357057+0000","last_peered":"2024-05-07T14:02:32.357057+0000","last_clean":"2024-05-07T14:02:32.357057+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:02:32.357057+0000","last_undegraded":"2024-05-07T14:02:32.357057+0000","last_fullsized":"2024-05-07T14:02:32.357057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636288+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:02:31.636288+0000","last_peered":"2024-05-07T14:02:31.636288+0000","last_clean":"2024-05-07T14:02:31.636288+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:02:31.636288+0000","last_undegraded":"2024-05-07T14:02:31.636288+0000","last_fullsized":"2024-05-07T14:02:31.636288+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004327+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:02:32.004327+0000","last_peered":"2024-05-07T14:02:32.004327+0000","last_clean":"2024-05-07T14:02:32.004327+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:02:32.004327+0000","last_undegraded":"2024-05-07T14:02:32.004327+0000","last_fullsized":"2024-05-07T14:02:32.004327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639186+0000","last_change":"2024-05-07T14:01:06.037755+0000","last_active":"2024-05-07T14:02:31.639186+0000","last_peered":"2024-05-07T14:02:31.639186+0000","last_clean":"2024-05-07T14:02:31.639186+0000","last_became_active":"2024-05-07T14:01:06.037156+0000","last_became_peered":"2024-05-07T14:01:06.037156+0000","last_unstale":"2024-05-07T14:02:31.639186+0000","last_undegraded":"2024-05-07T14:02:31.639186+0000","last_fullsized":"2024-05-07T14:02:31.639186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:30.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635286+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:02:31.635286+0000","last_peered":"2024-05-07T14:02:31.635286+0000","last_clean":"2024-05-07T14:02:31.635286+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:02:31.635286+0000","last_undegraded":"2024-05-07T14:02:31.635286+0000","last_fullsized":"2024-05-07T14:02:31.635286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255491+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:02:32.255491+0000","last_peered":"2024-05-07T14:02:32.255491+0000","last_clean":"2024-05-07T14:02:32.255491+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:02:32.255491+0000","last_undegraded":"2024-05-07T14:02:32.255491+0000","last_fullsized":"2024-05-07T14:02:32.255491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639575+0000","last_change":"2024-05-07T14:00:59.998197+0000","last_active":"2024-05-07T14:02:31.639575+0000","last_peered":"2024-05-07T14:02:31.639575+0000","last_clean":"2024-05-07T14:02:31.639575+0000","last_became_active":"2024-05-07T14:00:59.997438+0000","last_became_peered":"2024-05-07T14:00:59.997438+0000","last_unstale":"2024-05-07T14:02:31.639575+0000","last_undegraded":"2024-05-07T14:02:31.639575+0000","last_fullsized":"2024-05-07T14:02:31.639575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:29.430229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":117,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256971+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:02:32.256971+0000","last_peered":"2024-05-07T14:02:32.256971+0000","last_clean":"2024-05-07T14:02:32.256971+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:02:32.256971+0000","last_undegraded":"2024-05-07T14:02:32.256971+0000","last_fullsized":"2024-05-07T14:02:32.256971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408640+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:02:32.408640+0000","last_peered":"2024-05-07T14:02:32.408640+0000","last_clean":"2024-05-07T14:02:32.408640+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:02:32.408640+0000","last_undegraded":"2024-05-07T14:02:32.408640+0000","last_fullsized":"2024-05-07T14:02:32.408640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.641050+0000","last_change":"2024-05-07T14:01:06.025913+0000","last_active":"2024-05-07T14:02:31.641050+0000","last_peered":"2024-05-07T14:02:31.641050+0000","last_clean":"2024-05-07T14:02:31.641050+0000","last_became_active":"2024-05-07T14:01:06.025220+0000","last_became_peered":"2024-05-07T14:01:06.025220+0000","last_unstale":"2024-05-07T14:02:31.641050+0000","last_undegraded":"2024-05-07T14:02:31.641050+0000","last_fullsized":"2024-05-07T14:02:31.641050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:30.164745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635545+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:02:31.635545+0000","last_peered":"2024-05-07T14:02:31.635545+0000","last_clean":"2024-05-07T14:02:31.635545+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:02:31.635545+0000","last_undegraded":"2024-05-07T14:02:31.635545+0000","last_fullsized":"2024-05-07T14:02:31.635545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255764+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:02:32.255764+0000","last_peered":"2024-05-07T14:02:32.255764+0000","last_clean":"2024-05-07T14:02:32.255764+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:02:32.255764+0000","last_undegraded":"2024-05-07T14:02:32.255764+0000","last_fullsized":"2024-05-07T14:02:32.255764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256617+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:02:32.256617+0000","last_peered":"2024-05-07T14:02:32.256617+0000","last_clean":"2024-05-07T14:02:32.256617+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:02:32.256617+0000","last_undegraded":"2024-05-07T14:02:32.256617+0000","last_fullsized":"2024-05-07T14:02:32.256617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409396+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:02:32.409396+0000","last_peered":"2024-05-07T14:02:32.409396+0000","last_clean":"2024-05-07T14:02:32.409396+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:02:32.409396+0000","last_undegraded":"2024-05-07T14:02:32.409396+0000","last_fullsized":"2024-05-07T14:02:32.409396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.003924+0000","last_change":"2024-05-07T14:01:04.017099+0000","last_active":"2024-05-07T14:02:32.003924+0000","last_peered":"2024-05-07T14:02:32.003924+0000","last_clean":"2024-05-07T14:02:32.003924+0000","last_became_active":"2024-05-07T14:01:04.011036+0000","last_became_peered":"2024-05-07T14:01:04.011036+0000","last_unstale":"2024-05-07T14:02:32.003924+0000","last_undegraded":"2024-05-07T14:02:32.003924+0000","last_fullsized":"2024-05-07T14:02:32.003924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:32.242974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391463+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:02:32.391463+0000","last_peered":"2024-05-07T14:02:32.391463+0000","last_clean":"2024-05-07T14:02:32.391463+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:02:32.391463+0000","last_undegraded":"2024-05-07T14:02:32.391463+0000","last_fullsized":"2024-05-07T14:02:32.391463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390658+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:02:32.390658+0000","last_peered":"2024-05-07T14:02:32.390658+0000","last_clean":"2024-05-07T14:02:32.390658+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:02:32.390658+0000","last_undegraded":"2024-05-07T14:02:32.390658+0000","last_fullsized":"2024-05-07T14:02:32.390658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392679+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:02:32.392679+0000","last_peered":"2024-05-07T14:02:32.392679+0000","last_clean":"2024-05-07T14:02:32.392679+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:02:32.392679+0000","last_undegraded":"2024-05-07T14:02:32.392679+0000","last_fullsized":"2024-05-07T14:02:32.392679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634663+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:02:31.634663+0000","last_peered":"2024-05-07T14:02:31.634663+0000","last_clean":"2024-05-07T14:02:31.634663+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:02:31.634663+0000","last_undegraded":"2024-05-07T14:02:31.634663+0000","last_fullsized":"2024-05-07T14:02:31.634663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":102,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392628+0000","last_change":"2024-05-07T14:01:02.013617+0000","last_active":"2024-05-07T14:02:32.392628+0000","last_peered":"2024-05-07T14:02:32.392628+0000","last_clean":"2024-05-07T14:02:32.392628+0000","last_became_active":"2024-05-07T14:01:02.009243+0000","last_became_peered":"2024-05-07T14:01:02.009243+0000","last_unstale":"2024-05-07T14:02:32.392628+0000","last_undegraded":"2024-05-07T14:02:32.392628+0000","last_fullsized":"2024-05-07T14:02:32.392628+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635072+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:02:31.635072+0000","last_peered":"2024-05-07T14:02:31.635072+0000","last_clean":"2024-05-07T14:02:31.635072+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:02:31.635072+0000","last_undegraded":"2024-05-07T14:02:31.635072+0000","last_fullsized":"2024-05-07T14:02:31.635072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640526+0000","last_change":"2024-05-07T14:01:06.023907+0000","last_active":"2024-05-07T14:02:31.640526+0000","last_peered":"2024-05-07T14:02:31.640526+0000","last_clean":"2024-05-07T14:02:31.640526+0000","last_became_active":"2024-05-07T14:01:06.023307+0000","last_became_peered":"2024-05-07T14:01:06.023307+0000","last_unstale":"2024-05-07T14:02:31.640526+0000","last_undegraded":"2024-05-07T14:02:31.640526+0000","last_fullsized":"2024-05-07T14:02:31.640526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:41.916580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634967+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:02:31.634967+0000","last_peered":"2024-05-07T14:02:31.634967+0000","last_clean":"2024-05-07T14:02:31.634967+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:02:31.634967+0000","last_undegraded":"2024-05-07T14:02:31.634967+0000","last_fullsized":"2024-05-07T14:02:31.634967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410774+0000","last_change":"2024-05-07T14:01:37.554242+0000","last_active":"2024-05-07T14:02:32.410774+0000","last_peered":"2024-05-07T14:02:32.410774+0000","last_clean":"2024-05-07T14:02:32.410774+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:02:32.410774+0000","last_undegraded":"2024-05-07T14:02:32.410774+0000","last_fullsized":"2024-05-07T14:02:32.410774+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:16:22.149514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355222+0000","last_change":"2024-05-07T14:00:59.998767+0000","last_active":"2024-05-07T14:02:32.355222+0000","last_peered":"2024-05-07T14:02:32.355222+0000","last_clean":"2024-05-07T14:02:32.355222+0000","last_became_active":"2024-05-07T14:00:59.998055+0000","last_became_peered":"2024-05-07T14:00:59.998055+0000","last_unstale":"2024-05-07T14:02:32.355222+0000","last_undegraded":"2024-05-07T14:02:32.355222+0000","last_fullsized":"2024-05-07T14:02:32.355222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:41.593806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635100+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:02:31.635100+0000","last_peered":"2024-05-07T14:02:31.635100+0000","last_clean":"2024-05-07T14:02:31.635100+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:02:31.635100+0000","last_undegraded":"2024-05-07T14:02:31.635100+0000","last_fullsized":"2024-05-07T14:02:31.635100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409187+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:02:32.409187+0000","last_peered":"2024-05-07T14:02:32.409187+0000","last_clean":"2024-05-07T14:02:32.409187+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:02:32.409187+0000","last_undegraded":"2024-05-07T14:02:32.409187+0000","last_fullsized":"2024-05-07T14:02:32.409187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636266+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:02:31.636266+0000","last_peered":"2024-05-07T14:02:31.636266+0000","last_clean":"2024-05-07T14:02:31.636266+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:02:31.636266+0000","last_undegraded":"2024-05-07T14:02:31.636266+0000","last_fullsized":"2024-05-07T14:02:31.636266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356276+0000","last_change":"2024-05-07T14:00:58.005276+0000","last_active":"2024-05-07T14:02:32.356276+0000","last_peered":"2024-05-07T14:02:32.356276+0000","last_clean":"2024-05-07T14:02:32.356276+0000","last_became_active":"2024-05-07T14:00:58.004903+0000","last_became_peered":"2024-05-07T14:00:58.004903+0000","last_unstale":"2024-05-07T14:02:32.356276+0000","last_undegraded":"2024-05-07T14:02:32.356276+0000","last_fullsized":"2024-05-07T14:02:32.356276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.005040+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:02:32.005040+0000","last_peered":"2024-05-07T14:02:32.005040+0000","last_clean":"2024-05-07T14:02:32.005040+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:02:32.005040+0000","last_undegraded":"2024-05-07T14:02:32.005040+0000","last_fullsized":"2024-05-07T14:02:32.005040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356008+0000","last_change":"2024-05-07T14:00:57.986882+0000","last_active":"2024-05-07T14:02:32.356008+0000","last_peered":"2024-05-07T14:02:32.356008+0000","last_clean":"2024-05-07T14:02:32.356008+0000","last_became_active":"2024-05-07T14:00:57.984867+0000","last_became_peered":"2024-05-07T14:00:57.984867+0000","last_unstale":"2024-05-07T14:02:32.356008+0000","last_undegraded":"2024-05-07T14:02:32.356008+0000","last_fullsized":"2024-05-07T14:02:32.356008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638086+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:02:31.638086+0000","last_peered":"2024-05-07T14:02:31.638086+0000","last_clean":"2024-05-07T14:02:31.638086+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:02:31.638086+0000","last_undegraded":"2024-05-07T14:02:31.638086+0000","last_fullsized":"2024-05-07T14:02:31.638086+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:01.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257588+0000","last_change":"2024-05-07T14:00:57.985233+0000","last_active":"2024-05-07T14:02:32.257588+0000","last_peered":"2024-05-07T14:02:32.257588+0000","last_clean":"2024-05-07T14:02:32.257588+0000","last_became_active":"2024-05-07T14:00:57.984523+0000","last_became_peered":"2024-05-07T14:00:57.984523+0000","last_unstale":"2024-05-07T14:02:32.257588+0000","last_undegraded":"2024-05-07T14:02:32.257588+0000","last_fullsized":"2024-05-07T14:02:32.257588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256637+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:02:32.256637+0000","last_peered":"2024-05-07T14:02:32.256637+0000","last_clean":"2024-05-07T14:02:32.256637+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:02:32.256637+0000","last_undegraded":"2024-05-07T14:02:32.256637+0000","last_fullsized":"2024-05-07T14:02:32.256637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356567+0000","last_change":"2024-05-07T14:00:57.989787+0000","last_active":"2024-05-07T14:02:32.356567+0000","last_peered":"2024-05-07T14:02:32.356567+0000","last_clean":"2024-05-07T14:02:32.356567+0000","last_became_active":"2024-05-07T14:00:57.989498+0000","last_became_peered":"2024-05-07T14:00:57.989498+0000","last_unstale":"2024-05-07T14:02:32.356567+0000","last_undegraded":"2024-05-07T14:02:32.356567+0000","last_fullsized":"2024-05-07T14:02:32.356567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409741+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:02:32.409741+0000","last_peered":"2024-05-07T14:02:32.409741+0000","last_clean":"2024-05-07T14:02:32.409741+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:02:32.409741+0000","last_undegraded":"2024-05-07T14:02:32.409741+0000","last_fullsized":"2024-05-07T14:02:32.409741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392468+0000","last_change":"2024-05-07T14:00:57.998054+0000","last_active":"2024-05-07T14:02:32.392468+0000","last_peered":"2024-05-07T14:02:32.392468+0000","last_clean":"2024-05-07T14:02:32.392468+0000","last_became_active":"2024-05-07T14:00:57.997750+0000","last_became_peered":"2024-05-07T14:00:57.997750+0000","last_unstale":"2024-05-07T14:02:32.392468+0000","last_undegraded":"2024-05-07T14:02:32.392468+0000","last_fullsized":"2024-05-07T14:02:32.392468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390873+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:02:32.390873+0000","last_peered":"2024-05-07T14:02:32.390873+0000","last_clean":"2024-05-07T14:02:32.390873+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:02:32.390873+0000","last_undegraded":"2024-05-07T14:02:32.390873+0000","last_fullsized":"2024-05-07T14:02:32.390873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635807+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:02:31.635807+0000","last_peered":"2024-05-07T14:02:31.635807+0000","last_clean":"2024-05-07T14:02:31.635807+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:02:31.635807+0000","last_undegraded":"2024-05-07T14:02:31.635807+0000","last_fullsized":"2024-05-07T14:02:31.635807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.357223+0000","last_change":"2024-05-07T14:00:55.974072+0000","last_active":"2024-05-07T14:02:32.357223+0000","last_peered":"2024-05-07T14:02:32.357223+0000","last_clean":"2024-05-07T14:02:32.357223+0000","last_became_active":"2024-05-07T14:00:55.973647+0000","last_became_peered":"2024-05-07T14:00:55.973647+0000","last_unstale":"2024-05-07T14:02:32.357223+0000","last_undegraded":"2024-05-07T14:02:32.357223+0000","last_fullsized":"2024-05-07T14:02:32.357223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390463+0000","last_change":"2024-05-07T14:00:57.988167+0000","last_active":"2024-05-07T14:02:32.390463+0000","last_peered":"2024-05-07T14:02:32.390463+0000","last_clean":"2024-05-07T14:02:32.390463+0000","last_became_active":"2024-05-07T14:00:57.987884+0000","last_became_peered":"2024-05-07T14:00:57.987884+0000","last_unstale":"2024-05-07T14:02:32.390463+0000","last_undegraded":"2024-05-07T14:02:32.390463+0000","last_fullsized":"2024-05-07T14:02:32.390463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.003566+0000","last_change":"2024-05-07T14:00:55.997287+0000","last_active":"2024-05-07T14:02:32.003566+0000","last_peered":"2024-05-07T14:02:32.003566+0000","last_clean":"2024-05-07T14:02:32.003566+0000","last_became_active":"2024-05-07T14:00:55.996467+0000","last_became_peered":"2024-05-07T14:00:55.996467+0000","last_unstale":"2024-05-07T14:02:32.003566+0000","last_undegraded":"2024-05-07T14:02:32.003566+0000","last_fullsized":"2024-05-07T14:02:32.003566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004844+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:02:32.004844+0000","last_peered":"2024-05-07T14:02:32.004844+0000","last_clean":"2024-05-07T14:02:32.004844+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:02:32.004844+0000","last_undegraded":"2024-05-07T14:02:32.004844+0000","last_fullsized":"2024-05-07T14:02:32.004844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391794+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:02:32.391794+0000","last_peered":"2024-05-07T14:02:32.391794+0000","last_clean":"2024-05-07T14:02:32.391794+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:02:32.391794+0000","last_undegraded":"2024-05-07T14:02:32.391794+0000","last_fullsized":"2024-05-07T14:02:32.391794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410693+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:02:32.410693+0000","last_peered":"2024-05-07T14:02:32.410693+0000","last_clean":"2024-05-07T14:02:32.410693+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:02:32.410693+0000","last_undegraded":"2024-05-07T14:02:32.410693+0000","last_fullsized":"2024-05-07T14:02:32.410693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.258176+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:02:32.258176+0000","last_peered":"2024-05-07T14:02:32.258176+0000","last_clean":"2024-05-07T14:02:32.258176+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:02:32.258176+0000","last_undegraded":"2024-05-07T14:02:32.258176+0000","last_fullsized":"2024-05-07T14:02:32.258176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636229+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:02:31.636229+0000","last_peered":"2024-05-07T14:02:31.636229+0000","last_clean":"2024-05-07T14:02:31.636229+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:02:31.636229+0000","last_undegraded":"2024-05-07T14:02:31.636229+0000","last_fullsized":"2024-05-07T14:02:31.636229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.389986+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:02:32.389986+0000","last_peered":"2024-05-07T14:02:32.389986+0000","last_clean":"2024-05-07T14:02:32.389986+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:02:32.389986+0000","last_undegraded":"2024-05-07T14:02:32.389986+0000","last_fullsized":"2024-05-07T14:02:32.389986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.643479+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:02:31.643479+0000","last_peered":"2024-05-07T14:02:31.643479+0000","last_clean":"2024-05-07T14:02:31.643479+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:02:31.643479+0000","last_undegraded":"2024-05-07T14:02:31.643479+0000","last_fullsized":"2024-05-07T14:02:31.643479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255516+0000","last_change":"2024-05-07T14:00:56.001135+0000","last_active":"2024-05-07T14:02:32.255516+0000","last_peered":"2024-05-07T14:02:32.255516+0000","last_clean":"2024-05-07T14:02:32.255516+0000","last_became_active":"2024-05-07T14:00:55.999884+0000","last_became_peered":"2024-05-07T14:00:55.999884+0000","last_unstale":"2024-05-07T14:02:32.255516+0000","last_undegraded":"2024-05-07T14:02:32.255516+0000","last_fullsized":"2024-05-07T14:02:32.255516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636001+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:02:31.636001+0000","last_peered":"2024-05-07T14:02:31.636001+0000","last_clean":"2024-05-07T14:02:31.636001+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:02:31.636001+0000","last_undegraded":"2024-05-07T14:02:31.636001+0000","last_fullsized":"2024-05-07T14:02:31.636001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408963+0000","last_change":"2024-05-07T14:00:55.989670+0000","last_active":"2024-05-07T14:02:32.408963+0000","last_peered":"2024-05-07T14:02:32.408963+0000","last_clean":"2024-05-07T14:02:32.408963+0000","last_became_active":"2024-05-07T14:00:55.989455+0000","last_became_peered":"2024-05-07T14:00:55.989455+0000","last_unstale":"2024-05-07T14:02:32.408963+0000","last_undegraded":"2024-05-07T14:02:32.408963+0000","last_fullsized":"2024-05-07T14:02:32.408963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640060+0000","last_change":"2024-05-07T14:00:57.979022+0000","last_active":"2024-05-07T14:02:31.640060+0000","last_peered":"2024-05-07T14:02:31.640060+0000","last_clean":"2024-05-07T14:02:31.640060+0000","last_became_active":"2024-05-07T14:00:57.977403+0000","last_became_peered":"2024-05-07T14:00:57.977403+0000","last_unstale":"2024-05-07T14:02:31.640060+0000","last_undegraded":"2024-05-07T14:02:31.640060+0000","last_fullsized":"2024-05-07T14:02:31.640060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.003519+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:02:32.003519+0000","last_peered":"2024-05-07T14:02:32.003519+0000","last_clean":"2024-05-07T14:02:32.003519+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:02:32.003519+0000","last_undegraded":"2024-05-07T14:02:32.003519+0000","last_fullsized":"2024-05-07T14:02:32.003519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409889+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:02:32.409889+0000","last_peered":"2024-05-07T14:02:32.409889+0000","last_clean":"2024-05-07T14:02:32.409889+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:02:32.409889+0000","last_undegraded":"2024-05-07T14:02:32.409889+0000","last_fullsized":"2024-05-07T14:02:32.409889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640998+0000","last_change":"2024-05-07T14:00:55.978771+0000","last_active":"2024-05-07T14:02:31.640998+0000","last_peered":"2024-05-07T14:02:31.640998+0000","last_clean":"2024-05-07T14:02:31.640998+0000","last_became_active":"2024-05-07T14:00:55.978000+0000","last_became_peered":"2024-05-07T14:00:55.978000+0000","last_unstale":"2024-05-07T14:02:31.640998+0000","last_undegraded":"2024-05-07T14:02:31.640998+0000","last_fullsized":"2024-05-07T14:02:31.640998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390386+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:02:32.390386+0000","last_peered":"2024-05-07T14:02:32.390386+0000","last_clean":"2024-05-07T14:02:32.390386+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:02:32.390386+0000","last_undegraded":"2024-05-07T14:02:32.390386+0000","last_fullsized":"2024-05-07T14:02:32.390386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640396+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:02:31.640396+0000","last_peered":"2024-05-07T14:02:31.640396+0000","last_clean":"2024-05-07T14:02:31.640396+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:02:31.640396+0000","last_undegraded":"2024-05-07T14:02:31.640396+0000","last_fullsized":"2024-05-07T14:02:31.640396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639690+0000","last_change":"2024-05-07T14:00:57.979073+0000","last_active":"2024-05-07T14:02:31.639690+0000","last_peered":"2024-05-07T14:02:31.639690+0000","last_clean":"2024-05-07T14:02:31.639690+0000","last_became_active":"2024-05-07T14:00:57.978215+0000","last_became_peered":"2024-05-07T14:00:57.978215+0000","last_unstale":"2024-05-07T14:02:31.639690+0000","last_undegraded":"2024-05-07T14:02:31.639690+0000","last_fullsized":"2024-05-07T14:02:31.639690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255516+0000","last_change":"2024-05-07T14:00:56.001199+0000","last_active":"2024-05-07T14:02:32.255516+0000","last_peered":"2024-05-07T14:02:32.255516+0000","last_clean":"2024-05-07T14:02:32.255516+0000","last_became_active":"2024-05-07T14:00:56.000434+0000","last_became_peered":"2024-05-07T14:00:56.000434+0000","last_unstale":"2024-05-07T14:02:32.255516+0000","last_undegraded":"2024-05-07T14:02:32.255516+0000","last_fullsized":"2024-05-07T14:02:32.255516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257933+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:02:32.257933+0000","last_peered":"2024-05-07T14:02:32.257933+0000","last_clean":"2024-05-07T14:02:32.257933+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:02:32.257933+0000","last_undegraded":"2024-05-07T14:02:32.257933+0000","last_fullsized":"2024-05-07T14:02:32.257933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410692+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:02:32.410692+0000","last_peered":"2024-05-07T14:02:32.410692+0000","last_clean":"2024-05-07T14:02:32.410692+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:02:32.410692+0000","last_undegraded":"2024-05-07T14:02:32.410692+0000","last_fullsized":"2024-05-07T14:02:32.410692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.354818+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:02:32.354818+0000","last_peered":"2024-05-07T14:02:32.354818+0000","last_clean":"2024-05-07T14:02:32.354818+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:02:32.354818+0000","last_undegraded":"2024-05-07T14:02:32.354818+0000","last_fullsized":"2024-05-07T14:02:32.354818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257944+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:02:32.257944+0000","last_peered":"2024-05-07T14:02:32.257944+0000","last_clean":"2024-05-07T14:02:32.257944+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:02:32.257944+0000","last_undegraded":"2024-05-07T14:02:32.257944+0000","last_fullsized":"2024-05-07T14:02:32.257944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1454080,"data_stored":1034318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":435445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":436273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":443781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":839680,"data_stored":435841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":443288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":444533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343424,"statfs":{"total":96636764160,"available":96607666176,"internally_reserved":0,"allocated":1425408,"data_stored":1026315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:02:33.855 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-07T14:02:33.855 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-07T14:02:33.855 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-05-07T14:02:33.855 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-05-07T14:02:33.885 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:33.897+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:33.932 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:33.932 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:33.932 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:33.932 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:33.932 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:33.952 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:02:33.984 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:33.997+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:34.085 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:34.097+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:34.126 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 94.153159876000004, 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:34.127 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:02:34.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:02:34.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:02:34.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:02:34.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:02:34.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:34.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.132 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:34.132 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:34.132 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 90.105994004999999, 2024-05-07T14:02:34.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:02:34.132 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.132 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.132 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.132 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:34.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:34.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:02:34.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:02:34.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:02:34.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:02:34.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:02:34.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:02:34.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:02:34.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:02:34.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:02:34.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:02:34.137 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.137 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.137 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.137 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:34.137 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:34.137 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 90.005666285000004, 2024-05-07T14:02:34.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:02:34.138 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.138 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.138 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.138 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.138 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.138 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.138 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:02:34.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.138 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:34.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:34.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:02:34.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:02:34.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:02:34.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:02:34.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:02:34.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:02:34.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:02:34.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:02:34.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:02:34.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:02:34.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:02:34.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:02:34.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:02:34.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:02:34.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:02:34.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:02:34.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:02:34.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:02:34.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:02:34.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.103122228000004, 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:02:34.144 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:02:34.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:02:34.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:02:34.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:02:34.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:02:34.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:02:34.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:02:34.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:02:34.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:02:34.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:02:34.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:02:34.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:02:34.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:02:34.150 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.151 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.151 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.151 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.153 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:34.153 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.083812260000002, 2024-05-07T14:02:34.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:02:34.153 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.153 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.153 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.153 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.154 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.154 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.154 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:02:34.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.154 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:34.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:02:34.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:02:34.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:02:34.159 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.159 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.159 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.159 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.159 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:34.159 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.05844535, 2024-05-07T14:02:34.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:02:34.159 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.159 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.159 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.159 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:02:34.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:02:34.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:02:34.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:02:34.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:02:34.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:02:34.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:02:34.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:02:34.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:02:34.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:02:34.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:02:34.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:02:34.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:02:34.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.038655965999993, 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.165 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:02:34.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:02:34.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:02:34.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:02:34.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:02:34.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:02:34.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:02:34.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:02:34.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:02:34.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:02:34.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:02:34.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:02:34.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:02:34.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:02:34.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.005417605000005, 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:02:34.171 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.172 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.172 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.172 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.172 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.172 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.172 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:02:34.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.172 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:34.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:34.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:02:34.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:02:34.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:02:34.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:02:34.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:02:34.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:02:34.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:02:34.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:02:34.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:02:34.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:02:34.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:02:34.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:02:34.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:02:34.178 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.178 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.178 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.178 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.178 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:34.178 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.970056584000005, 2024-05-07T14:02:34.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:02:34.179 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.179 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.179 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.179 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.179 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.179 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.179 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:02:34.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.179 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:34.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:34.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:02:34.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:02:34.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:02:34.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:02:34.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:02:34.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:02:34.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:02:34.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:02:34.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:02:34.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:02:34.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:02:34.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:02:34.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:34.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:02:34.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:02:34.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:02:34.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:02:34.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:02:34.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:02:34.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:02:34.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:02:34.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:02:34.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:02:34.186 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.186 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.186 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.187 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.187 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:34.187 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.945313017999993, 2024-05-07T14:02:34.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:02:34.187 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.187 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.187 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.187 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.187 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.187 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:02:34.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:02:34.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:02:34.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:02:34.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:02:34.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:02:34.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:02:34.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:02:34.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:02:34.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:02:34.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.192 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.834436615000001, 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.193 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:34.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:34.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:02:34.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:02:34.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:02:34.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:02:34.198 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.198 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.198 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.778272666000007, 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:34.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:02:34.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:02:34.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:02:34.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.762387481000005, 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:02:34.204 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:34.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:02:34.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:34.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:02:34.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:02:34.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:02:34.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:02:34.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:02:34.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:34.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:02:34.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:02:34.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:02:34.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:02:34.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:02:34.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:02:34.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:02:34.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:02:34.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:02:34.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:02:34.210 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.210 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.210 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.211 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.211 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:34.211 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.513021229000003, 2024-05-07T14:02:34.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:02:34.211 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.211 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.211 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.211 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.211 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:02:34.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:02:34.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:02:34.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:02:34.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:02:34.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:02:34.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:02:34.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:02:34.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:02:34.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:02:34.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:02:34.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:02:34.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:02:34.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:02:34.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:02:34.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:02:34.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:02:34.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:02:34.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:02:34.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:02:34.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:02:34.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:02:34.217 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.217 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.217 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.218 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.218 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:34.218 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.451648406000004, 2024-05-07T14:02:34.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:02:34.218 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.218 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.218 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.218 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.218 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.218 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.219 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:02:34.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.219 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:34.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:34.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:02:34.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:34.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:02:34.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:34.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:02:34.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:02:34.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:02:34.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:02:34.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:02:34.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:02:34.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.222 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:02:34.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:02:34.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.222 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:34.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:02:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:02:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:02:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:02:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:02:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:02:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.224 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.224 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:02:34.224 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:02:34.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.224 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.224 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:02:34.224 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:02:34.224 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.224 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.224 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.225 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.225 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:34.225 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.255860064000004, 2024-05-07T14:02:34.225 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:02:34.225 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.225 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.225 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.225 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.225 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.226 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.226 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:02:34.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.226 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.226 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.226 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:34.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.226 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.226 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:34.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:02:34.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.228 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:02:34.229 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:02:34.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.229 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.229 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:02:34.229 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:02:34.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.229 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.229 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:02:34.229 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:02:34.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:02:34.230 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.251556613999995, 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003023937, 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.231 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.232 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 918 2024-05-07T14:02:34.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.232 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.232 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:34.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.232 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:34.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886558+0000", 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1229999999999998e-06 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886569+0000", 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1497e-05 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886600+0000", 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0809999999999998e-05 2024-05-07T14:02:34.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.234 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.234 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886618+0000", 2024-05-07T14:02:34.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7799e-05 2024-05-07T14:02:34.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.234 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.234 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886736+0000", 2024-05-07T14:02:34.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118276 2024-05-07T14:02:34.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.234 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.234 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886951+0000", 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021467200000000001 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.887437+0000", 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048624900000000001 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.888687+0000", 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012498310000000001 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.235 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889318+0000", 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063122199999999997 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889463+0000", 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144769 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889580+0000", 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011668899999999999 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.236 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.237 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.237 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:34.237 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.22055589, 2024-05-07T14:02:34.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:02:34.237 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.237 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.237 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.237 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.237 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.237 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.237 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.238 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.241 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:34.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:02:34.241 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:02:34.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.241 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:02:34.241 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:02:34.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.241 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:02:34.241 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.215670997999993, 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.243 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:02:34.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.245 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:02:34.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:02:34.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.245 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:02:34.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:02:34.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.245 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:02:34.246 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:02:34.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.246 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.246 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:02:34.246 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:02:34.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.246 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.246 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:02:34.246 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:02:34.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.247 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:34.247 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:02:34.247 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:02:34.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.247 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.247 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.247 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:02:34.247 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:02:34.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:02:34.248 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.249 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.249 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.249 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.249 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:34.249 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.183749626999997, 2024-05-07T14:02:34.249 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:02:34.249 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.249 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.250 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.250 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.250 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.250 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.250 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:02:34.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.250 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.250 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.250 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:34.250 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.251 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.251 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:34.251 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.251 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.251 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:02:34.251 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:02:34.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.251 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.251 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:02:34.251 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:02:34.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.252 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.252 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:02:34.252 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:02:34.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.252 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.252 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:02:34.252 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:02:34.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:02:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:02:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:02:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:02:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.253 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:02:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:02:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:02:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:02:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.254 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:02:34.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:02:34.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:02:34.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:02:34.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:02:34.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:02:34.255 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.256 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.256 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.256 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.256 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.256 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:34.258 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:02:34.258 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:34.269+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:34.358 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:34.369+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:34.383 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:02:34.383 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:34.383 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 70, 2024-05-07T14:02:34.383 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "0d349e2f-0c2b-4aab-8a22-181c69b40dbb", 2024-05-07T14:02:34.383 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-05-07T14:00:30.482506+0000", 2024-05-07T14:02:34.383 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-05-07T14:02:32.644035+0000", 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: "last_up_change": "2024-05-07T14:00:41.658097+0000", 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: "last_in_change": "2024-05-07T14:00:32.857383+0000", 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_num": 5806080, 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_set": [ 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: "nodeep-scrub", 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: "noscrub", 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: "pglog_hardlimit", 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: "purged_snapdirs", 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_deletes", 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: "sortbitwise" 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_version": 4, 2024-05-07T14:02:34.384 INFO:teuthology.orchestra.run.smithi106.stdout: "full_ratio": 0.94999998807907104, 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: "nearfull_ratio": 0.85000002384185791, 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_snapshot": "", 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_max": 8, 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: "max_osd": 8, 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: "require_min_compat_client": "luminous", 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: "min_compat_client": "luminous", 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: "require_osd_release": "squid", 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: "allow_crimson": false, 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: "pools": [ 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 1, 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": ".mgr", 2024-05-07T14:02:34.385 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:00:43.291253+0000", 2024-05-07T14:02:34.386 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:02:34.386 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:02:34.386 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:02:34.386 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:02:34.386 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:02:34.386 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:02:34.386 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:02:34.386 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:02:34.386 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:02:34.386 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:02:34.386 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:02:34.386 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 1, 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 1, 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 1, 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 1, 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 1, 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.387 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "17", 2024-05-07T14:02:34.388 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:02:34.388 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:02:34.388 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:02:34.388 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:02:34.388 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:02:34.388 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:02:34.388 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:02:34.388 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:02:34.388 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:02:34.388 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:02:34.388 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:02:34.388 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:02:34.388 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:02:34.389 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:02:34.389 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:02:34.389 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:02:34.389 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:02:34.389 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:02:34.389 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:02:34.389 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:02:34.389 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:02:34.389 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:02:34.389 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:02:34.389 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:02:34.389 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:02:34.389 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: "options": { 2024-05-07T14:02:34.390 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_max": 32, 2024-05-07T14:02:34.391 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_min": 1 2024-05-07T14:02:34.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.391 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:02:34.391 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": {} 2024-05-07T14:02:34.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.391 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:02:34.391 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:02:34.391 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 8, 2024-05-07T14:02:34.391 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 8, 2024-05-07T14:02:34.391 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 0.25, 2024-05-07T14:02:34.391 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 2, 2024-05-07T14:02:34.391 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 2, 2024-05-07T14:02:34.391 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:02:34.392 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:02:34.392 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:02:34.392 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.392 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 2, 2024-05-07T14:02:34.392 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": "rbd", 2024-05-07T14:02:34.392 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:00:48.791671+0000", 2024-05-07T14:02:34.392 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:02:34.392 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:02:34.392 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:02:34.392 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:02:34.392 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 8, 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 8, 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 8, 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 8, 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 8, 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:02:34.393 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:02:34.394 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:02:34.394 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:02:34.394 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:02:34.394 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:02:34.394 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:02:34.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.394 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "20", 2024-05-07T14:02:34.394 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:02:34.394 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:02:34.395 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:02:34.396 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:02:34.396 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:02:34.396 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:02:34.396 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:02:34.396 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:02:34.396 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:02:34.396 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:02:34.396 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:02:34.396 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:02:34.396 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:02:34.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.396 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:02:34.396 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:02:34.397 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:02:34.397 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:02:34.397 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:02:34.397 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:02:34.397 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:02:34.397 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:02:34.397 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:02:34.397 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:02:34.397 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:02:34.397 INFO:teuthology.orchestra.run.smithi106.stdout: "options": {}, 2024-05-07T14:02:34.397 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:02:34.398 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd": {} 2024-05-07T14:02:34.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.398 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:02:34.398 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:02:34.398 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 1.9900000095367432, 2024-05-07T14:02:34.398 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 1.9900000095367432, 2024-05-07T14:02:34.398 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 0.87999999523162842, 2024-05-07T14:02:34.398 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 1.75, 2024-05-07T14:02:34.398 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 1.75, 2024-05-07T14:02:34.398 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:02:34.398 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:02:34.398 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:02:34.398 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 3, 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": "default.rgw.buckets.data", 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:00:54.652419+0000", 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:02:34.399 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:02:34.400 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:02:34.400 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:02:34.400 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:02:34.400 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 64, 2024-05-07T14:02:34.400 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 64, 2024-05-07T14:02:34.400 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 64, 2024-05-07T14:02:34.400 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 64, 2024-05-07T14:02:34.400 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 64, 2024-05-07T14:02:34.400 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:02:34.400 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:02:34.400 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:02:34.400 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:02:34.400 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "23", 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:02:34.401 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:02:34.402 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:02:34.403 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:02:34.403 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:02:34.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.403 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:02:34.403 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:02:34.403 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:02:34.403 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:02:34.403 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:02:34.403 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:02:34.403 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:02:34.403 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:02:34.403 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:02:34.403 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:02:34.404 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:02:34.404 INFO:teuthology.orchestra.run.smithi106.stdout: "options": {}, 2024-05-07T14:02:34.404 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:02:34.404 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw": {} 2024-05-07T14:02:34.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.404 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:02:34.404 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:02:34.404 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 1.5, 2024-05-07T14:02:34.404 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 1.5, 2024-05-07T14:02:34.405 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 1, 2024-05-07T14:02:34.405 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 1.5, 2024-05-07T14:02:34.405 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 1.5, 2024-05-07T14:02:34.405 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:02:34.405 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:02:34.405 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:02:34.405 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.405 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 4, 2024-05-07T14:02:34.405 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": "default.rgw.buckets.index", 2024-05-07T14:02:34.405 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:00:56.328700+0000", 2024-05-07T14:02:34.405 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:02:34.406 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:02:34.406 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:02:34.406 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:02:34.406 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:02:34.406 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:02:34.406 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:02:34.406 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:02:34.406 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:02:34.406 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:02:34.406 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:02:34.407 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:02:34.407 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 64, 2024-05-07T14:02:34.407 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 64, 2024-05-07T14:02:34.407 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 64, 2024-05-07T14:02:34.407 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 64, 2024-05-07T14:02:34.407 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 64, 2024-05-07T14:02:34.407 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:02:34.407 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:02:34.407 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:02:34.407 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:02:34.408 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:02:34.408 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:02:34.408 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:02:34.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.408 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "25", 2024-05-07T14:02:34.408 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:02:34.408 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:02:34.408 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:02:34.408 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:02:34.408 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:02:34.409 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:02:34.409 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:02:34.409 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:02:34.409 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:02:34.409 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:02:34.409 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:02:34.409 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:02:34.409 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:02:34.409 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:02:34.409 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:02:34.409 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:02:34.410 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:02:34.410 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:02:34.410 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:02:34.410 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:02:34.410 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:02:34.410 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:02:34.410 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:02:34.410 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:02:34.410 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:02:34.411 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:02:34.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.411 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:02:34.411 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:02:34.411 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:02:34.411 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:02:34.411 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:02:34.411 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:02:34.411 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:02:34.411 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:02:34.412 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:02:34.412 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:02:34.412 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:02:34.412 INFO:teuthology.orchestra.run.smithi106.stdout: "options": {}, 2024-05-07T14:02:34.412 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:02:34.412 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw": {} 2024-05-07T14:02:34.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.412 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:02:34.413 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:02:34.413 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 2, 2024-05-07T14:02:34.413 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 2, 2024-05-07T14:02:34.413 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 1, 2024-05-07T14:02:34.413 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 2, 2024-05-07T14:02:34.413 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 2, 2024-05-07T14:02:34.413 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:02:34.413 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:02:34.413 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:02:34.413 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 5, 2024-05-07T14:02:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": ".rgw.root", 2024-05-07T14:02:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:00:58.247912+0000", 2024-05-07T14:02:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:02:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:02:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:02:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:02:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:02:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:02:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:02:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:02:34.414 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 32, 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 32, 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 32, 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 32, 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 32, 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:02:34.415 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "27", 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:02:34.416 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:02:34.417 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:02:34.418 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:02:34.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.418 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:02:34.418 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:02:34.418 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:02:34.418 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:02:34.418 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:02:34.418 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:02:34.418 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:02:34.418 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:02:34.418 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:02:34.418 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:02:34.418 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: "options": {}, 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw": {} 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 1.25, 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 1.25, 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 1, 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 1.25, 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 1.25, 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:02:34.419 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:02:34.420 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.420 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 6, 2024-05-07T14:02:34.420 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": "default.rgw.log", 2024-05-07T14:02:34.420 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:01:00.134259+0000", 2024-05-07T14:02:34.420 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:02:34.420 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:02:34.420 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:02:34.420 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:02:34.420 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:02:34.420 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:02:34.420 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 32, 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 32, 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 32, 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 32, 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 32, 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:02:34.421 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "29", 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:02:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:02:34.423 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:02:34.423 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:02:34.423 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:02:34.423 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:02:34.423 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:02:34.423 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:02:34.423 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:02:34.423 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:02:34.423 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:02:34.423 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:02:34.423 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:02:34.423 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:02:34.424 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:02:34.425 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:02:34.425 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:02:34.425 INFO:teuthology.orchestra.run.smithi106.stdout: "options": {}, 2024-05-07T14:02:34.425 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:02:34.425 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw": {} 2024-05-07T14:02:34.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.425 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:02:34.425 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:02:34.425 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 1.75, 2024-05-07T14:02:34.425 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 1.75, 2024-05-07T14:02:34.425 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 1, 2024-05-07T14:02:34.425 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 1.75, 2024-05-07T14:02:34.425 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 1.75, 2024-05-07T14:02:34.426 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:02:34.426 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:02:34.426 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:02:34.426 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.426 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 7, 2024-05-07T14:02:34.426 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": "default.rgw.control", 2024-05-07T14:02:34.427 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:01:02.056070+0000", 2024-05-07T14:02:34.427 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:02:34.427 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:02:34.427 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:02:34.427 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:02:34.427 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:02:34.427 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:02:34.427 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:02:34.427 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:02:34.427 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:02:34.427 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:02:34.427 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 32, 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 32, 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 32, 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 32, 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 32, 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:02:34.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "31", 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:02:34.429 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:02:34.430 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:02:34.430 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:02:34.430 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:02:34.430 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:02:34.430 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:02:34.430 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:02:34.430 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:02:34.430 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:02:34.430 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:02:34.430 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:02:34.430 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:02:34.430 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:02:34.431 INFO:teuthology.orchestra.run.smithi106.stdout: "options": {}, 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw": {} 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 1.75, 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 1.75, 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 1, 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 1.75, 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 1.75, 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:02:34.432 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 8, 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": "default.rgw.meta", 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:01:04.177565+0000", 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:02:34.433 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 32, 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 32, 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 32, 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 32, 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 32, 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:02:34.434 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:02:34.435 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:02:34.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.435 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "33", 2024-05-07T14:02:34.435 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:02:34.435 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:02:34.435 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:02:34.435 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:02:34.435 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:02:34.435 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:02:34.436 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:02:34.437 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:02:34.437 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:02:34.437 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:02:34.437 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:02:34.437 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:02:34.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.437 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:02:34.437 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:02:34.437 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:02:34.437 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:02:34.437 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:02:34.438 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:02:34.438 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:02:34.438 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:02:34.438 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:02:34.438 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:02:34.438 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:02:34.438 INFO:teuthology.orchestra.run.smithi106.stdout: "options": { 2024-05-07T14:02:34.438 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_bias": 4 2024-05-07T14:02:34.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.438 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:02:34.438 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw": {} 2024-05-07T14:02:34.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.439 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:02:34.439 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:02:34.439 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 1.5, 2024-05-07T14:02:34.439 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 1.5, 2024-05-07T14:02:34.439 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 1, 2024-05-07T14:02:34.439 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 1.5, 2024-05-07T14:02:34.439 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 1.5, 2024-05-07T14:02:34.439 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:02:34.439 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:02:34.440 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:02:34.440 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.440 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.440 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:02:34.440 INFO:teuthology.orchestra.run.smithi106.stdout: "osds": [ 2024-05-07T14:02:34.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.440 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 0, 2024-05-07T14:02:34.440 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "e76f5d56-1400-488e-b58f-7af657fa63ab", 2024-05-07T14:02:34.440 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:02:34.440 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 46, 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6800", 2024-05-07T14:02:34.441 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6801", 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6802", 2024-05-07T14:02:34.442 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6803", 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6807", 2024-05-07T14:02:34.443 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6809", 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6804", 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:02:34.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6805", 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6801/3743893730", 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.106:6803/3743893730", 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.106:6809/3743893730", 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.106:6805/3743893730", 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:02:34.445 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 1, 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "aad5864b-9a5f-426f-a8fd-15d02590106e", 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 31, 2024-05-07T14:02:34.446 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:02:34.447 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:02:34.447 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:02:34.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.447 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6816", 2024-05-07T14:02:34.447 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:02:34.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.448 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.448 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6817", 2024-05-07T14:02:34.448 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:02:34.448 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.448 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.448 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:02:34.448 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.449 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.449 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6818", 2024-05-07T14:02:34.449 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:02:34.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.449 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.449 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6819", 2024-05-07T14:02:34.449 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:02:34.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.450 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.450 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:02:34.450 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.450 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.450 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6822", 2024-05-07T14:02:34.450 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:02:34.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.450 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.450 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6823", 2024-05-07T14:02:34.450 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:02:34.451 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.451 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.451 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:02:34.451 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.451 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.451 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6820", 2024-05-07T14:02:34.451 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:02:34.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.452 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.452 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6821", 2024-05-07T14:02:34.452 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:02:34.452 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.452 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.452 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6817/3901521345", 2024-05-07T14:02:34.452 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.106:6819/3901521345", 2024-05-07T14:02:34.453 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.106:6823/3901521345", 2024-05-07T14:02:34.453 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.106:6821/3901521345", 2024-05-07T14:02:34.453 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:02:34.453 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:02:34.453 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:02:34.453 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.453 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 2, 2024-05-07T14:02:34.453 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "eea131cd-e4ca-4360-a8a0-5005a2d827d1", 2024-05-07T14:02:34.454 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:02:34.454 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:02:34.454 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:02:34.454 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:02:34.454 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:02:34.454 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:02:34.454 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:02:34.454 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 46, 2024-05-07T14:02:34.454 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:02:34.454 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:02:34.454 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:02:34.454 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6824", 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6825", 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6826", 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6827", 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6830", 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6831", 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6828", 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6829", 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6825/1784825450", 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.106:6827/1784825450", 2024-05-07T14:02:34.458 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.106:6831/1784825450", 2024-05-07T14:02:34.459 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.106:6829/1784825450", 2024-05-07T14:02:34.459 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:02:34.459 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:02:34.459 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:02:34.459 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.459 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 3, 2024-05-07T14:02:34.459 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "bdcb438c-1d40-45a2-8e8a-f29ba9c98909", 2024-05-07T14:02:34.459 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:02:34.459 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 31, 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6806", 2024-05-07T14:02:34.460 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6808", 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6810", 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:02:34.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.462 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.462 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6811", 2024-05-07T14:02:34.462 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:02:34.462 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.462 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.462 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:02:34.462 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.462 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6814", 2024-05-07T14:02:34.463 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:02:34.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.463 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6815", 2024-05-07T14:02:34.463 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:02:34.463 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.463 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.463 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:02:34.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.464 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6812", 2024-05-07T14:02:34.464 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:02:34.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.464 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6813", 2024-05-07T14:02:34.464 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:02:34.464 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.464 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.464 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6808/123863977", 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.106:6811/123863977", 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.106:6815/123863977", 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.106:6813/123863977", 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 4, 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "703f4a52-4283-4395-bc29-4de194d4a4ef", 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:02:34.465 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:02:34.466 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:02:34.466 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:02:34.466 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:02:34.466 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 31, 2024-05-07T14:02:34.466 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:02:34.466 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:02:34.466 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:02:34.466 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.466 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.466 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6816", 2024-05-07T14:02:34.466 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:02:34.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6817", 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6818", 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:02:34.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6819", 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6822", 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:02:34.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6824", 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6820", 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:02:34.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.470 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.470 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6821", 2024-05-07T14:02:34.470 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:02:34.470 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.470 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.470 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.107:6817/3575310712", 2024-05-07T14:02:34.470 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.107:6819/3575310712", 2024-05-07T14:02:34.470 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.107:6824/3575310712", 2024-05-07T14:02:34.470 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.107:6821/3575310712", 2024-05-07T14:02:34.470 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:02:34.470 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:02:34.471 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:02:34.471 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.471 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 5, 2024-05-07T14:02:34.471 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "8b70f365-8b0d-429e-b3f8-601a37cfb6ac", 2024-05-07T14:02:34.471 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:02:34.471 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:02:34.471 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:02:34.471 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:02:34.472 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:02:34.472 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:02:34.472 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:02:34.472 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 46, 2024-05-07T14:02:34.472 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:02:34.472 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:02:34.472 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:02:34.472 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.472 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.472 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6800", 2024-05-07T14:02:34.472 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:02:34.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6801", 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6802", 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:02:34.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.474 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6803", 2024-05-07T14:02:34.474 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:02:34.474 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.474 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.474 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:02:34.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.475 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6806", 2024-05-07T14:02:34.475 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:02:34.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.475 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6807", 2024-05-07T14:02:34.475 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:02:34.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.475 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.476 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:02:34.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.476 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6804", 2024-05-07T14:02:34.476 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:02:34.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.476 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6805", 2024-05-07T14:02:34.477 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:02:34.477 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.477 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.477 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.107:6801/2178038050", 2024-05-07T14:02:34.477 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.107:6803/2178038050", 2024-05-07T14:02:34.477 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.107:6807/2178038050", 2024-05-07T14:02:34.477 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.107:6805/2178038050", 2024-05-07T14:02:34.477 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:02:34.477 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:02:34.477 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:02:34.477 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 6, 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "b65085d6-47af-4dfc-91a8-cdc7a6fa937c", 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 31, 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:02:34.478 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:02:34.479 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.479 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.479 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6823", 2024-05-07T14:02:34.479 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:02:34.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.479 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.479 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6825", 2024-05-07T14:02:34.479 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:02:34.479 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.479 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6826", 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6827", 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.480 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:02:34.481 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.481 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.481 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6830", 2024-05-07T14:02:34.481 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:02:34.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.481 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.481 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6831", 2024-05-07T14:02:34.481 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:02:34.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.482 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.482 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:02:34.482 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.482 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.482 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6828", 2024-05-07T14:02:34.482 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:02:34.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.482 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.482 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6829", 2024-05-07T14:02:34.483 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:02:34.483 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.483 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.483 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.107:6825/3168866293", 2024-05-07T14:02:34.483 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.107:6827/3168866293", 2024-05-07T14:02:34.483 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.107:6831/3168866293", 2024-05-07T14:02:34.483 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.107:6829/3168866293", 2024-05-07T14:02:34.483 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:02:34.483 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:02:34.483 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:02:34.483 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.484 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 7, 2024-05-07T14:02:34.484 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "9a808e41-afba-400f-886a-8f17689bebda", 2024-05-07T14:02:34.484 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:02:34.484 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:02:34.484 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:02:34.484 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:02:34.484 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:02:34.484 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:02:34.484 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:02:34.484 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 31, 2024-05-07T14:02:34.485 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:02:34.485 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:02:34.485 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:02:34.485 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.485 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.485 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6808", 2024-05-07T14:02:34.485 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:02:34.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.486 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.486 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6809", 2024-05-07T14:02:34.486 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:02:34.486 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.486 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.486 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:02:34.486 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.487 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.487 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6810", 2024-05-07T14:02:34.487 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:02:34.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.487 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.487 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6811", 2024-05-07T14:02:34.487 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:02:34.487 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.487 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.488 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:02:34.488 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.488 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.488 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6814", 2024-05-07T14:02:34.488 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:02:34.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.488 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.488 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6815", 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6812", 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:02:34.489 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6813", 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.107:6809/1073700008", 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.107:6811/1073700008", 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.107:6815/1073700008", 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.107:6813/1073700008", 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.490 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:02:34.491 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_xinfo": [ 2024-05-07T14:02:34.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.491 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 0, 2024-05-07T14:02:34.491 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:02:34.491 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:02:34.491 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:02:34.491 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:02:34.491 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:02:34.491 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.435492+0000", 2024-05-07T14:02:34.491 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:02:34.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.491 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 1, 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.545586+0000", 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 2, 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:02:34.492 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.430790+0000", 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 3, 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.530476+0000", 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.494 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 4, 2024-05-07T14:02:34.494 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:02:34.494 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:02:34.494 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:02:34.494 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:02:34.494 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:02:34.494 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.487321+0000", 2024-05-07T14:02:34.494 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:02:34.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.494 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 5, 2024-05-07T14:02:34.494 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:02:34.494 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.254353+0000", 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 6, 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.381089+0000", 2024-05-07T14:02:34.495 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 7, 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.430233+0000", 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_upmap": [], 2024-05-07T14:02:34.496 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_upmap_items": [ 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "3.2", 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 3, 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 2 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "3.13", 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 7, 2024-05-07T14:02:34.497 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 2 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "3.17", 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 0, 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 2 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.498 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "3.1f", 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 5, 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 1 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "3.21", 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 5, 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 1 2024-05-07T14:02:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "4.4", 2024-05-07T14:02:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:02:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 1, 2024-05-07T14:02:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 5 2024-05-07T14:02:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.500 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "4.33", 2024-05-07T14:02:34.501 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:02:34.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.501 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 3, 2024-05-07T14:02:34.501 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 5 2024-05-07T14:02:34.501 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.501 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.501 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.501 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:02:34.501 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_upmap_primaries": [], 2024-05-07T14:02:34.501 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_temp": [], 2024-05-07T14:02:34.501 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_temp": [], 2024-05-07T14:02:34.502 INFO:teuthology.orchestra.run.smithi106.stdout: "blocklist": {}, 2024-05-07T14:02:34.502 INFO:teuthology.orchestra.run.smithi106.stdout: "range_blocklist": {}, 2024-05-07T14:02:34.502 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profiles": { 2024-05-07T14:02:34.502 INFO:teuthology.orchestra.run.smithi106.stdout: "default": { 2024-05-07T14:02:34.502 INFO:teuthology.orchestra.run.smithi106.stdout: "crush-failure-domain": "osd", 2024-05-07T14:02:34.502 INFO:teuthology.orchestra.run.smithi106.stdout: "k": "2", 2024-05-07T14:02:34.502 INFO:teuthology.orchestra.run.smithi106.stdout: "m": "1", 2024-05-07T14:02:34.502 INFO:teuthology.orchestra.run.smithi106.stdout: "plugin": "jerasure", 2024-05-07T14:02:34.502 INFO:teuthology.orchestra.run.smithi106.stdout: "technique": "reed_sol_van" 2024-05-07T14:02:34.503 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.503 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps_queue": [], 2024-05-07T14:02:34.503 INFO:teuthology.orchestra.run.smithi106.stdout: "new_removed_snaps": [], 2024-05-07T14:02:34.503 INFO:teuthology.orchestra.run.smithi106.stdout: "new_purged_snaps": [], 2024-05-07T14:02:34.503 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_node_flags": {}, 2024-05-07T14:02:34.503 INFO:teuthology.orchestra.run.smithi106.stdout: "device_class_flags": {}, 2024-05-07T14:02:34.503 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": { 2024-05-07T14:02:34.503 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode_enabled": false, 2024-05-07T14:02:34.503 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_bucket_count": 0, 2024-05-07T14:02:34.503 INFO:teuthology.orchestra.run.smithi106.stdout: "degraded_stretch_mode": 0, 2024-05-07T14:02:34.503 INFO:teuthology.orchestra.run.smithi106.stdout: "recovering_stretch_mode": 0, 2024-05-07T14:02:34.503 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode_bucket": 0 2024-05-07T14:02:34.504 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.504 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:34.506 INFO:tasks.thrashosds.thrasher:j is {'epoch': 70, 'fsid': '0d349e2f-0c2b-4aab-8a22-181c69b40dbb', 'created': '2024-05-07T14:00:30.482506+0000', 'modified': '2024-05-07T14:02:32.644035+0000', 'last_up_change': '2024-05-07T14:00:41.658097+0000', 'last_in_change': '2024-05-07T14:00:32.857383+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-07T14:00:43.291253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-07T14:00:48.791671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-05-07T14:00:54.652419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-05-07T14:00:56.328700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-05-07T14:00:58.247912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-05-07T14:01:00.134259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-05-07T14:01:02.056070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-05-07T14:01:04.177565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e76f5d56-1400-488e-b58f-7af657fa63ab', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6800', 'nonce': 3743893730}, {'type': 'v1', 'addr': '172.21.15.106:6801', 'nonce': 3743893730}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6802', 'nonce': 3743893730}, {'type': 'v1', 'addr': '172.21.15.106:6803', 'nonce': 3743893730}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6807', 'nonce': 3743893730}, {'type': 'v1', 'addr': '172.21.15.106:6809', 'nonce': 3743893730}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6804', 'nonce': 3743893730}, {'type': 'v1', 'addr': '172.21.15.106:6805', 'nonce': 3743893730}]}, 'public_addr': '172.21.15.106:6801/3743893730', 'cluster_addr': '172.21.15.106:6803/3743893730', 'heartbeat_back_addr': '172.21.15.106:6809/3743893730', 'heartbeat_front_addr': '172.21.15.106:6805/3743893730', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aad5864b-9a5f-426f-a8fd-15d02590106e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6816', 'nonce': 3901521345}, {'type': 'v1', 'addr': '172.21.15.106:6817', 'nonce': 3901521345}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6818', 'nonce': 3901521345}, {'type': 'v1', 'addr': '172.21.15.106:6819', 'nonce': 3901521345}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6822', 'nonce': 3901521345}, {'type': 'v1', 'addr': '172.21.15.106:6823', 'nonce': 3901521345}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6820', 'nonce': 3901521345}, {'type': 'v1', 'addr': '172.21.15.106:6821', 'nonce': 3901521345}]}, 'public_addr': '172.21.15.106:6817/3901521345', 'cluster_addr': '172.21.15.106:6819/3901521345', 'heartbeat_back_addr': '172.21.15.106:6823/3901521345', 'heartbeat_front_addr': '172.21.15.106:6821/3901521345', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'eea131cd-e4ca-4360-a8a0-5005a2d827d1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6824', 'nonce': 1784825450}, {'type': 'v1', 'addr': '172.21.15.106:6825', 'nonce': 1784825450}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6826', 'nonce': 1784825450}, {'type': 'v1', 'addr': '172.21.15.106:6827', 'nonce': 1784825450}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6830', 'nonce': 1784825450}, {'type': 'v1', 'addr': '172.21.15.106:6831', 'nonce': 1784825450}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6828', 'nonce': 1784825450}, {'type': 'v1', 'addr': '172.21.15.106:6829', 'nonce': 1784825450}]}, 'public_addr': '172.21.15.106:6825/1784825450', 'cluster_addr': '172.21.15.106:6827/1784825450', 'heartbeat_back_addr': '172.21.15.106:6831/1784825450', 'heartbeat_front_addr': '172.21.15.106:6829/1784825450', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'bdcb438c-1d40-45a2-8e8a-f29ba9c98909', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6806', 'nonce': 123863977}, {'type': 'v1', 'addr': '172.21.15.106:6808', 'nonce': 123863977}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6810', 'nonce': 123863977}, {'type': 'v1', 'addr': '172.21.15.106:6811', 'nonce': 123863977}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6814', 'nonce': 123863977}, {'type': 'v1', 'addr': '172.21.15.106:6815', 'nonce': 123863977}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6812', 'nonce': 123863977}, {'type': 'v1', 'addr': '172.21.15.106:6813', 'nonce': 123863977}]}, 'public_addr': '172.21.15.106:6808/123863977', 'cluster_addr': '172.21.15.106:6811/123863977', 'heartbeat_back_addr': '172.21.15.106:6815/123863977', 'heartbeat_front_addr': '172.21.15.106:6813/123863977', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '703f4a52-4283-4395-bc29-4de194d4a4ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6816', 'nonce': 3575310712}, {'type': 'v1', 'addr': '172.21.15.107:6817', 'nonce': 3575310712}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6818', 'nonce': 3575310712}, {'type': 'v1', 'addr': '172.21.15.107:6819', 'nonce': 3575310712}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6822', 'nonce': 3575310712}, {'type': 'v1', 'addr': '172.21.15.107:6824', 'nonce': 3575310712}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6820', 'nonce': 3575310712}, {'type': 'v1', 'addr': '172.21.15.107:6821', 'nonce': 3575310712}]}, 'public_addr': '172.21.15.107:6817/3575310712', 'cluster_addr': '172.21.15.107:6819/3575310712', 'heartbeat_back_addr': '172.21.15.107:6824/3575310712', 'heartbeat_front_addr': '172.21.15.107:6821/3575310712', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '8b70f365-8b0d-429e-b3f8-601a37cfb6ac', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 46, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 2178038050}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 2178038050}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 2178038050}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 2178038050}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 2178038050}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 2178038050}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 2178038050}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 2178038050}]}, 'public_addr': '172.21.15.107:6801/2178038050', 'cluster_addr': '172.21.15.107:6803/2178038050', 'heartbeat_back_addr': '172.21.15.107:6807/2178038050', 'heartbeat_front_addr': '172.21.15.107:6805/2178038050', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'b65085d6-47af-4dfc-91a8-cdc7a6fa937c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6823', 'nonce': 3168866293}, {'type': 'v1', 'addr': '172.21.15.107:6825', 'nonce': 3168866293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6826', 'nonce': 3168866293}, {'type': 'v1', 'addr': '172.21.15.107:6827', 'nonce': 3168866293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6830', 'nonce': 3168866293}, {'type': 'v1', 'addr': '172.21.15.107:6831', 'nonce': 3168866293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6828', 'nonce': 3168866293}, {'type': 'v1', 'addr': '172.21.15.107:6829', 'nonce': 3168866293}]}, 'public_addr': '172.21.15.107:6825/3168866293', 'cluster_addr': '172.21.15.107:6827/3168866293', 'heartbeat_back_addr': '172.21.15.107:6831/3168866293', 'heartbeat_front_addr': '172.21.15.107:6829/3168866293', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '9a808e41-afba-400f-886a-8f17689bebda', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 31, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6808', 'nonce': 1073700008}, {'type': 'v1', 'addr': '172.21.15.107:6809', 'nonce': 1073700008}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6810', 'nonce': 1073700008}, {'type': 'v1', 'addr': '172.21.15.107:6811', 'nonce': 1073700008}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6814', 'nonce': 1073700008}, {'type': 'v1', 'addr': '172.21.15.107:6815', 'nonce': 1073700008}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6812', 'nonce': 1073700008}, {'type': 'v1', 'addr': '172.21.15.107:6813', 'nonce': 1073700008}]}, 'public_addr': '172.21.15.107:6809/1073700008', 'cluster_addr': '172.21.15.107:6811/1073700008', 'heartbeat_back_addr': '172.21.15.107:6815/1073700008', 'heartbeat_front_addr': '172.21.15.107:6813/1073700008', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.435492+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.545586+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.430790+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.530476+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.487321+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.254353+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.381089+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.430233+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.2', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '3.13', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '3.17', 'mappings': [{'from': 0, 'to': 2}]}, {'pgid': '3.1f', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '3.21', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '4.4', 'mappings': [{'from': 1, 'to': 5}]}, {'pgid': '4.33', 'mappings': [{'from': 3, 'to': 5}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-05-07T14:02:34.506 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:02:34.507 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:34.507 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:34.507 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:34.507 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:34.508 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:02:34.508 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:34.517+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:34.606 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:34.617+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:34.652 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:02:34.707 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:34.717+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:34.710 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:34.710 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:34.710 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:34.710 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:34.710 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:34.725 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:02:34.808 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:34.821+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:34.882 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:34.882 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:34.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:40 5.8 5:168cc6a2:::zonegroup_info.7881bf19-2c91-49be-82bb-722579314d1c:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 94.852891107000005, 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002658582, 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 40 2024-05-07T14:02:34.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.884 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:34.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:34.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042176+0000", 2024-05-07T14:02:34.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7719999999999999e-06 2024-05-07T14:02:34.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042186+0000", 2024-05-07T14:02:34.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0020000000000001e-05 2024-05-07T14:02:34.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042209+0000", 2024-05-07T14:02:34.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3224e-05 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042220+0000", 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1153e-05 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042358+0000", 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137389 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042594+0000", 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023630100000000001 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042900+0000", 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030576799999999999 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044463+0000", 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015627130000000001 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044675+0000", 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021186999999999999 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044768+0000", 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3046000000000003e-05 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044833+0000", 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5326000000000004e-05 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.888 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 90.858336222000005, 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025872120000000002, 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.889 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 52 2024-05-07T14:02:34.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.890 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:34.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:34.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036732+0000", 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4980000000000001e-06 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036744+0000", 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2269999999999999e-05 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036772+0000", 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8002000000000001e-05 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036817+0000", 2024-05-07T14:02:34.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4608999999999999e-05 2024-05-07T14:02:34.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036946+0000", 2024-05-07T14:02:34.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012988400000000001 2024-05-07T14:02:34.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037184+0000", 2024-05-07T14:02:34.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000237178 2024-05-07T14:02:34.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:34.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037405+0000", 2024-05-07T14:02:34.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221418 2024-05-07T14:02:34.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.038548+0000", 2024-05-07T14:02:34.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011433540000000001 2024-05-07T14:02:34.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039179+0000", 2024-05-07T14:02:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063016999999999999 2024-05-07T14:02:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039231+0000", 2024-05-07T14:02:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2434e-05 2024-05-07T14:02:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039316+0000", 2024-05-07T14:02:34.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5395000000000005e-05 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.749753760000004, 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.895 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:02:34.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:02:34.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:02:34.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:02:34.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:02:34.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:02:34.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:02:34.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:02:34.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:02:34.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:02:34.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:02:34.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:02:34.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:34.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:02:34.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:02:34.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:02:34.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:02:34.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:02:34.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:02:34.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:02:34.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:02:34.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:02:34.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:02:34.902 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.902 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.902 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.902 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.902 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:34.902 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.737334818999997, 2024-05-07T14:02:34.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:02:34.903 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.903 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.903 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.903 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.903 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.903 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.903 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:02:34.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.903 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:34.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:34.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:02:34.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:02:34.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:02:34.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:02:34.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:02:34.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:02:34.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:02:34.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:02:34.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:02:34.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:02:34.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:02:34.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:02:34.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.908 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.733455097000004, 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:34.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:34.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:02:34.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:02:34.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:02:34.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:02:34.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:02:34.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:02:34.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:02:34.914 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.914 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.914 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.914 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.914 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:34.914 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.602799594000004, 2024-05-07T14:02:34.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:02:34.915 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.915 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.915 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.915 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.915 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.915 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.915 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:02:34.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.915 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:34.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:34.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:02:34.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:02:34.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:02:34.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:02:34.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:02:34.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:02:34.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:02:34.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:02:34.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:02:34.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:02:34.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:02:34.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:02:34.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:34.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:02:34.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:02:34.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:02:34.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:02:34.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:02:34.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.921 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.921 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:34.921 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.595632272000003, 2024-05-07T14:02:34.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:02:34.921 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.921 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.921 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.921 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.921 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.921 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.921 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:02:34.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.922 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:34.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:34.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:02:34.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:02:34.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:02:34.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:02:34.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:02:34.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:02:34.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:02:34.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:02:34.926 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.926 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.305099584000004, 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:02:34.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:02:34.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:02:34.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:02:34.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:02:34.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.240018190000001, 2024-05-07T14:02:34.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025880500000000002, 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 819 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655049+0000", 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6640000000000001e-06 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655057+0000", 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5639999999999997e-06 2024-05-07T14:02:34.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655082+0000", 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4119999999999999e-05 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655093+0000", 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1598e-05 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655273+0000", 2024-05-07T14:02:34.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017975599999999999 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655432+0000", 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000158682 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655720+0000", 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028791400000000001 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.656823+0000", 2024-05-07T14:02:34.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001103435 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657483+0000", 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000659828 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657571+0000", 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7756000000000005e-05 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657635+0000", 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4733000000000005e-05 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.187741957, 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028535079999999998, 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.937 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 841 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:34.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707326+0000", 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707338+0000", 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2036e-05 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707367+0000", 2024-05-07T14:02:34.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8816999999999999e-05 2024-05-07T14:02:34.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707382+0000", 2024-05-07T14:02:34.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4912999999999999e-05 2024-05-07T14:02:34.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707523+0000", 2024-05-07T14:02:34.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014165599999999999 2024-05-07T14:02:34.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707748+0000", 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000224315 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.708055+0000", 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030739800000000001 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.709147+0000", 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001091788 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710030+0000", 2024-05-07T14:02:34.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088367000000000003 2024-05-07T14:02:34.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710114+0000", 2024-05-07T14:02:34.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3936000000000004e-05 2024-05-07T14:02:34.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710177+0000", 2024-05-07T14:02:34.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2675999999999994e-05 2024-05-07T14:02:34.942 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.184075418000006, 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026153460000000002, 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.943 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 843 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710992+0000", 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.666e-06 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711000+0000", 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.977e-06 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711020+0000", 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.033e-05 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711030+0000", 2024-05-07T14:02:34.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9790000000000005e-06 2024-05-07T14:02:34.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711133+0000", 2024-05-07T14:02:34.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102563 2024-05-07T14:02:34.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711256+0000", 2024-05-07T14:02:34.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012337599999999999 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711555+0000", 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029948699999999997 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.712654+0000", 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001098819 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713451+0000", 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000796424 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713541+0000", 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9981999999999993e-05 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713605+0000", 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4743e-05 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.948 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.949 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.949 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:34.949 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.174619301999996, 2024-05-07T14:02:34.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027995160000000002, 2024-05-07T14:02:34.949 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.949 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.949 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.949 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.949 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.949 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.949 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 847 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720448+0000", 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720460+0000", 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1157e-05 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720490+0000", 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0960000000000002e-05 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720507+0000", 2024-05-07T14:02:34.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6477000000000002e-05 2024-05-07T14:02:34.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720681+0000", 2024-05-07T14:02:34.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017396800000000001 2024-05-07T14:02:34.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720897+0000", 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215775 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.721203+0000", 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030621499999999998 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.722485+0000", 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012818599999999999 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723091+0000", 2024-05-07T14:02:34.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060651499999999996 2024-05-07T14:02:34.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723182+0000", 2024-05-07T14:02:34.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0692999999999994e-05 2024-05-07T14:02:34.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723246+0000", 2024-05-07T14:02:34.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3643e-05 2024-05-07T14:02:34.954 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.954 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.955 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.955 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.955 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:34.955 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.170851952999996, 2024-05-07T14:02:34.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:02:34.955 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.955 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.955 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.955 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.955 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.955 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:02:34.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:02:34.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:34.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:02:34.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:02:34.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:02:34.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:02:34.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:02:34.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:02:34.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:02:34.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:02:34.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.125138557, 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.961 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.962 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:02:34.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.962 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:34.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:34.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:02:34.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:02:34.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:02:34.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:02:34.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:02:34.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:02:34.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:02:34.966 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.967 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.967 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.967 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.967 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:34.967 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.118861819000003, 2024-05-07T14:02:34.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:02:34.967 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.967 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.967 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:02:34.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:02:34.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:02:34.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:02:34.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:02:34.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:02:34.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:02:34.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:02:34.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.032348698999996, 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028016680000000002, 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.973 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.974 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.974 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 907 2024-05-07T14:02:34.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.974 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:34.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:34.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862719+0000", 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862733+0000", 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3067e-05 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862763+0000", 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0926000000000002e-05 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862779+0000", 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5787e-05 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862924+0000", 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014509899999999999 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863160+0000", 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000235701 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863523+0000", 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000362567 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.864872+0000", 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00134954 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865350+0000", 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000478009 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865437+0000", 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6712999999999995e-05 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865518+0000", 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1493000000000001e-05 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.978 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.028619411999998, 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027054290000000001, 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.979 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 909 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866448+0000", 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866459+0000", 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1207e-05 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866491+0000", 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362999999999998e-05 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866506+0000", 2024-05-07T14:02:34.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4790000000000001e-05 2024-05-07T14:02:34.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866632+0000", 2024-05-07T14:02:34.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000126422 2024-05-07T14:02:34.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866761+0000", 2024-05-07T14:02:34.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128832 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.867037+0000", 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027612200000000001 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.868118+0000", 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001080941 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869004+0000", 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088632000000000001 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869081+0000", 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7195999999999997e-05 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869151+0000", 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0066000000000003e-05 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.984 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.933770612999993, 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.985 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:34.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:34.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:02:34.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:02:34.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:02:34.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:02:34.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:02:34.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:02:34.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:02:34.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:02:34.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:02:34.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:02:34.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:02:34.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:02:34.990 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.990 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.990 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.991 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.991 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:34.991 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.920601258999994, 2024-05-07T14:02:34.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027821920000000002, 2024-05-07T14:02:34.991 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.991 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.991 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.991 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.991 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.991 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.991 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 955 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974466+0000", 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0999999999999998e-06 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974480+0000", 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3876999999999999e-05 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974510+0000", 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0273e-05 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974525+0000", 2024-05-07T14:02:34.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.485e-05 2024-05-07T14:02:34.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:34.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974618+0000", 2024-05-07T14:02:34.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2359000000000001e-05 2024-05-07T14:02:34.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:34.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974822+0000", 2024-05-07T14:02:34.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000204148 2024-05-07T14:02:34.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.975126+0000", 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030382800000000002 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976565+0000", 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014395160000000001 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976963+0000", 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00039772700000000001 2024-05-07T14:02:34.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977128+0000", 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165508 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977246+0000", 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011800599999999999 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.916685696000002, 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027683989999999999, 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 957 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:34.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978382+0000", 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.95e-06 2024-05-07T14:02:34.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978393+0000", 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.084e-05 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978424+0000", 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1022999999999998e-05 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978441+0000", 2024-05-07T14:02:34.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7782999999999999e-05 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978565+0000", 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012348900000000001 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978794+0000", 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000229335 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:35.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.979262+0000", 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046826700000000002 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.980470+0000", 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012071899999999999 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981002+0000", 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053222299999999996 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:35.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:35.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981086+0000", 2024-05-07T14:02:35.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4073000000000006e-05 2024-05-07T14:02:35.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:35.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:35.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:35.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981148+0000", 2024-05-07T14:02:35.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2225999999999997e-05 2024-05-07T14:02:35.002 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:35.002 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:35.002 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:35.002 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:35.002 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:35.002 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:35.004 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:02:35.004 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:35.013+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:35.026 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:02:35.035 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:02:35.052 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-05-07T14:02:34.666981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":809,"num_read_kb":552,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":527,"ondisk_log_size":527,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228080,"kb_used_data":7736,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754746640,"statfs":{"total":773094113280,"available":772860559360,"internally_reserved":0,"allocated":7921664,"data_stored":4699794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.052530"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640820+0000","last_change":"2024-05-07T14:00:55.983744+0000","last_active":"2024-05-07T14:02:31.640820+0000","last_peered":"2024-05-07T14:02:31.640820+0000","last_clean":"2024-05-07T14:02:31.640820+0000","last_became_active":"2024-05-07T14:00:55.982993+0000","last_became_peered":"2024-05-07T14:00:55.982993+0000","last_unstale":"2024-05-07T14:02:31.640820+0000","last_undegraded":"2024-05-07T14:02:31.640820+0000","last_fullsized":"2024-05-07T14:02:31.640820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257110+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:02:32.257110+0000","last_peered":"2024-05-07T14:02:32.257110+0000","last_clean":"2024-05-07T14:02:32.257110+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:02:32.257110+0000","last_undegraded":"2024-05-07T14:02:32.257110+0000","last_fullsized":"2024-05-07T14:02:32.257110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356138+0000","last_change":"2024-05-07T14:00:55.973967+0000","last_active":"2024-05-07T14:02:32.356138+0000","last_peered":"2024-05-07T14:02:32.356138+0000","last_clean":"2024-05-07T14:02:32.356138+0000","last_became_active":"2024-05-07T14:00:55.973677+0000","last_became_peered":"2024-05-07T14:00:55.973677+0000","last_unstale":"2024-05-07T14:02:32.356138+0000","last_undegraded":"2024-05-07T14:02:32.356138+0000","last_fullsized":"2024-05-07T14:02:32.356138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639745+0000","last_change":"2024-05-07T14:00:57.988092+0000","last_active":"2024-05-07T14:02:31.639745+0000","last_peered":"2024-05-07T14:02:31.639745+0000","last_clean":"2024-05-07T14:02:31.639745+0000","last_became_active":"2024-05-07T14:00:57.987091+0000","last_became_peered":"2024-05-07T14:00:57.987091+0000","last_unstale":"2024-05-07T14:02:31.639745+0000","last_undegraded":"2024-05-07T14:02:31.639745+0000","last_fullsized":"2024-05-07T14:02:31.639745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408924+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:02:32.408924+0000","last_peered":"2024-05-07T14:02:32.408924+0000","last_clean":"2024-05-07T14:02:32.408924+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:02:32.408924+0000","last_undegraded":"2024-05-07T14:02:32.408924+0000","last_fullsized":"2024-05-07T14:02:32.408924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635394+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:02:31.635394+0000","last_peered":"2024-05-07T14:02:31.635394+0000","last_clean":"2024-05-07T14:02:31.635394+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:02:31.635394+0000","last_undegraded":"2024-05-07T14:02:31.635394+0000","last_fullsized":"2024-05-07T14:02:31.635394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257408+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:02:32.257408+0000","last_peered":"2024-05-07T14:02:32.257408+0000","last_clean":"2024-05-07T14:02:32.257408+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:02:32.257408+0000","last_undegraded":"2024-05-07T14:02:32.257408+0000","last_fullsized":"2024-05-07T14:02:32.257408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409659+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:02:32.409659+0000","last_peered":"2024-05-07T14:02:32.409659+0000","last_clean":"2024-05-07T14:02:32.409659+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:02:32.409659+0000","last_undegraded":"2024-05-07T14:02:32.409659+0000","last_fullsized":"2024-05-07T14:02:32.409659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640138+0000","last_change":"2024-05-07T14:00:55.973419+0000","last_active":"2024-05-07T14:02:31.640138+0000","last_peered":"2024-05-07T14:02:31.640138+0000","last_clean":"2024-05-07T14:02:31.640138+0000","last_became_active":"2024-05-07T14:00:55.963467+0000","last_became_peered":"2024-05-07T14:00:55.963467+0000","last_unstale":"2024-05-07T14:02:31.640138+0000","last_undegraded":"2024-05-07T14:02:31.640138+0000","last_fullsized":"2024-05-07T14:02:31.640138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004251+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:02:32.004251+0000","last_peered":"2024-05-07T14:02:32.004251+0000","last_clean":"2024-05-07T14:02:32.004251+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:02:32.004251+0000","last_undegraded":"2024-05-07T14:02:32.004251+0000","last_fullsized":"2024-05-07T14:02:32.004251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256311+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:02:32.256311+0000","last_peered":"2024-05-07T14:02:32.256311+0000","last_clean":"2024-05-07T14:02:32.256311+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:02:32.256311+0000","last_undegraded":"2024-05-07T14:02:32.256311+0000","last_fullsized":"2024-05-07T14:02:32.256311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635936+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:02:31.635936+0000","last_peered":"2024-05-07T14:02:31.635936+0000","last_clean":"2024-05-07T14:02:31.635936+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:02:31.635936+0000","last_undegraded":"2024-05-07T14:02:31.635936+0000","last_fullsized":"2024-05-07T14:02:31.635936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639946+0000","last_change":"2024-05-07T14:00:55.962579+0000","last_active":"2024-05-07T14:02:31.639946+0000","last_peered":"2024-05-07T14:02:31.639946+0000","last_clean":"2024-05-07T14:02:31.639946+0000","last_became_active":"2024-05-07T14:00:55.961815+0000","last_became_peered":"2024-05-07T14:00:55.961815+0000","last_unstale":"2024-05-07T14:02:31.639946+0000","last_undegraded":"2024-05-07T14:02:31.639946+0000","last_fullsized":"2024-05-07T14:02:31.639946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257945+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:02:32.257945+0000","last_peered":"2024-05-07T14:02:32.257945+0000","last_clean":"2024-05-07T14:02:32.257945+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:02:32.257945+0000","last_undegraded":"2024-05-07T14:02:32.257945+0000","last_fullsized":"2024-05-07T14:02:32.257945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391120+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:02:32.391120+0000","last_peered":"2024-05-07T14:02:32.391120+0000","last_clean":"2024-05-07T14:02:32.391120+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:02:32.391120+0000","last_undegraded":"2024-05-07T14:02:32.391120+0000","last_fullsized":"2024-05-07T14:02:32.391120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.643446+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:02:31.643446+0000","last_peered":"2024-05-07T14:02:31.643446+0000","last_clean":"2024-05-07T14:02:31.643446+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:02:31.643446+0000","last_undegraded":"2024-05-07T14:02:31.643446+0000","last_fullsized":"2024-05-07T14:02:31.643446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634949+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:02:31.634949+0000","last_peered":"2024-05-07T14:02:31.634949+0000","last_clean":"2024-05-07T14:02:31.634949+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:02:31.634949+0000","last_undegraded":"2024-05-07T14:02:31.634949+0000","last_fullsized":"2024-05-07T14:02:31.634949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640900+0000","last_change":"2024-05-07T14:00:56.003776+0000","last_active":"2024-05-07T14:02:31.640900+0000","last_peered":"2024-05-07T14:02:31.640900+0000","last_clean":"2024-05-07T14:02:31.640900+0000","last_became_active":"2024-05-07T14:00:56.002996+0000","last_became_peered":"2024-05-07T14:00:56.002996+0000","last_unstale":"2024-05-07T14:02:31.640900+0000","last_undegraded":"2024-05-07T14:02:31.640900+0000","last_fullsized":"2024-05-07T14:02:31.640900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:17.583140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639757+0000","last_change":"2024-05-07T14:00:57.987026+0000","last_active":"2024-05-07T14:02:31.639757+0000","last_peered":"2024-05-07T14:02:31.639757+0000","last_clean":"2024-05-07T14:02:31.639757+0000","last_became_active":"2024-05-07T14:00:57.986048+0000","last_became_peered":"2024-05-07T14:00:57.986048+0000","last_unstale":"2024-05-07T14:02:31.639757+0000","last_undegraded":"2024-05-07T14:02:31.639757+0000","last_fullsized":"2024-05-07T14:02:31.639757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004377+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:02:32.004377+0000","last_peered":"2024-05-07T14:02:32.004377+0000","last_clean":"2024-05-07T14:02:32.004377+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:02:32.004377+0000","last_undegraded":"2024-05-07T14:02:32.004377+0000","last_fullsized":"2024-05-07T14:02:32.004377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256754+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:02:32.256754+0000","last_peered":"2024-05-07T14:02:32.256754+0000","last_clean":"2024-05-07T14:02:32.256754+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:02:32.256754+0000","last_undegraded":"2024-05-07T14:02:32.256754+0000","last_fullsized":"2024-05-07T14:02:32.256754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004788+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:02:32.004788+0000","last_peered":"2024-05-07T14:02:32.004788+0000","last_clean":"2024-05-07T14:02:32.004788+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:02:32.004788+0000","last_undegraded":"2024-05-07T14:02:32.004788+0000","last_fullsized":"2024-05-07T14:02:32.004788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638279+0000","last_change":"2024-05-07T14:01:37.318563+0000","last_active":"2024-05-07T14:02:31.638279+0000","last_peered":"2024-05-07T14:02:31.638279+0000","last_clean":"2024-05-07T14:02:31.638279+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:02:31.638279+0000","last_undegraded":"2024-05-07T14:02:31.638279+0000","last_fullsized":"2024-05-07T14:02:31.638279+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:27.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635289+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:02:31.635289+0000","last_peered":"2024-05-07T14:02:31.635289+0000","last_clean":"2024-05-07T14:02:31.635289+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:02:31.635289+0000","last_undegraded":"2024-05-07T14:02:31.635289+0000","last_fullsized":"2024-05-07T14:02:31.635289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638604+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:02:31.638604+0000","last_peered":"2024-05-07T14:02:31.638604+0000","last_clean":"2024-05-07T14:02:31.638604+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:02:31.638604+0000","last_undegraded":"2024-05-07T14:02:31.638604+0000","last_fullsized":"2024-05-07T14:02:31.638604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392183+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:02:32.392183+0000","last_peered":"2024-05-07T14:02:32.392183+0000","last_clean":"2024-05-07T14:02:32.392183+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:02:32.392183+0000","last_undegraded":"2024-05-07T14:02:32.392183+0000","last_fullsized":"2024-05-07T14:02:32.392183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636027+0000","last_change":"2024-05-07T14:00:58.008214+0000","last_active":"2024-05-07T14:02:31.636027+0000","last_peered":"2024-05-07T14:02:31.636027+0000","last_clean":"2024-05-07T14:02:31.636027+0000","last_became_active":"2024-05-07T14:00:58.005516+0000","last_became_peered":"2024-05-07T14:00:58.005516+0000","last_unstale":"2024-05-07T14:02:31.636027+0000","last_undegraded":"2024-05-07T14:02:31.636027+0000","last_fullsized":"2024-05-07T14:02:31.636027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410201+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:02:32.410201+0000","last_peered":"2024-05-07T14:02:32.410201+0000","last_clean":"2024-05-07T14:02:32.410201+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:02:32.410201+0000","last_undegraded":"2024-05-07T14:02:32.410201+0000","last_fullsized":"2024-05-07T14:02:32.410201+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634642+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:02:31.634642+0000","last_peered":"2024-05-07T14:02:31.634642+0000","last_clean":"2024-05-07T14:02:31.634642+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:02:31.634642+0000","last_undegraded":"2024-05-07T14:02:31.634642+0000","last_fullsized":"2024-05-07T14:02:31.634642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391544+0000","last_change":"2024-05-07T14:00:57.988107+0000","last_active":"2024-05-07T14:02:32.391544+0000","last_peered":"2024-05-07T14:02:32.391544+0000","last_clean":"2024-05-07T14:02:32.391544+0000","last_became_active":"2024-05-07T14:00:57.987604+0000","last_became_peered":"2024-05-07T14:00:57.987604+0000","last_unstale":"2024-05-07T14:02:32.391544+0000","last_undegraded":"2024-05-07T14:02:32.391544+0000","last_fullsized":"2024-05-07T14:02:32.391544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638195+0000","last_change":"2024-05-07T14:01:37.311718+0000","last_active":"2024-05-07T14:02:31.638195+0000","last_peered":"2024-05-07T14:02:31.638195+0000","last_clean":"2024-05-07T14:02:31.638195+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:02:31.638195+0000","last_undegraded":"2024-05-07T14:02:31.638195+0000","last_fullsized":"2024-05-07T14:02:31.638195+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:24.211300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257380+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:02:32.257380+0000","last_peered":"2024-05-07T14:02:32.257380+0000","last_clean":"2024-05-07T14:02:32.257380+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:02:32.257380+0000","last_undegraded":"2024-05-07T14:02:32.257380+0000","last_fullsized":"2024-05-07T14:02:32.257380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"33'9","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410909+0000","last_change":"2024-05-07T14:01:01.993679+0000","last_active":"2024-05-07T14:02:32.410909+0000","last_peered":"2024-05-07T14:02:32.410909+0000","last_clean":"2024-05-07T14:02:32.410909+0000","last_became_active":"2024-05-07T14:01:01.993241+0000","last_became_peered":"2024-05-07T14:01:01.993241+0000","last_unstale":"2024-05-07T14:02:32.410909+0000","last_undegraded":"2024-05-07T14:02:32.410909+0000","last_fullsized":"2024-05-07T14:02:32.410909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640587+0000","last_change":"2024-05-07T14:01:04.017472+0000","last_active":"2024-05-07T14:02:31.640587+0000","last_peered":"2024-05-07T14:02:31.640587+0000","last_clean":"2024-05-07T14:02:31.640587+0000","last_became_active":"2024-05-07T14:01:04.016757+0000","last_became_peered":"2024-05-07T14:01:04.016757+0000","last_unstale":"2024-05-07T14:02:31.640587+0000","last_undegraded":"2024-05-07T14:02:31.640587+0000","last_fullsized":"2024-05-07T14:02:31.640587+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256294+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:02:32.256294+0000","last_peered":"2024-05-07T14:02:32.256294+0000","last_clean":"2024-05-07T14:02:32.256294+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:02:32.256294+0000","last_undegraded":"2024-05-07T14:02:32.256294+0000","last_fullsized":"2024-05-07T14:02:32.256294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257958+0000","last_change":"2024-05-07T14:00:57.984789+0000","last_active":"2024-05-07T14:02:32.257958+0000","last_peered":"2024-05-07T14:02:32.257958+0000","last_clean":"2024-05-07T14:02:32.257958+0000","last_became_active":"2024-05-07T14:00:57.983524+0000","last_became_peered":"2024-05-07T14:00:57.983524+0000","last_unstale":"2024-05-07T14:02:32.257958+0000","last_undegraded":"2024-05-07T14:02:32.257958+0000","last_fullsized":"2024-05-07T14:02:32.257958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408899+0000","last_change":"2024-05-07T14:00:55.989797+0000","last_active":"2024-05-07T14:02:32.408899+0000","last_peered":"2024-05-07T14:02:32.408899+0000","last_clean":"2024-05-07T14:02:32.408899+0000","last_became_active":"2024-05-07T14:00:55.989449+0000","last_became_peered":"2024-05-07T14:00:55.989449+0000","last_unstale":"2024-05-07T14:02:32.408899+0000","last_undegraded":"2024-05-07T14:02:32.408899+0000","last_fullsized":"2024-05-07T14:02:32.408899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391421+0000","last_change":"2024-05-07T14:00:59.983880+0000","last_active":"2024-05-07T14:02:32.391421+0000","last_peered":"2024-05-07T14:02:32.391421+0000","last_clean":"2024-05-07T14:02:32.391421+0000","last_became_active":"2024-05-07T14:00:59.983186+0000","last_became_peered":"2024-05-07T14:00:59.983186+0000","last_unstale":"2024-05-07T14:02:32.391421+0000","last_undegraded":"2024-05-07T14:02:32.391421+0000","last_fullsized":"2024-05-07T14:02:32.391421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:27.067433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"33'6","reported_seq":101,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636252+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:02:31.636252+0000","last_peered":"2024-05-07T14:02:31.636252+0000","last_clean":"2024-05-07T14:02:31.636252+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:02:31.636252+0000","last_undegraded":"2024-05-07T14:02:31.636252+0000","last_fullsized":"2024-05-07T14:02:31.636252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635949+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:02:31.635949+0000","last_peered":"2024-05-07T14:02:31.635949+0000","last_clean":"2024-05-07T14:02:31.635949+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:02:31.635949+0000","last_undegraded":"2024-05-07T14:02:31.635949+0000","last_fullsized":"2024-05-07T14:02:31.635949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409970+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:02:32.409970+0000","last_peered":"2024-05-07T14:02:32.409970+0000","last_clean":"2024-05-07T14:02:32.409970+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:02:32.409970+0000","last_undegraded":"2024-05-07T14:02:32.409970+0000","last_fullsized":"2024-05-07T14:02:32.409970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411352+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:02:32.411352+0000","last_peered":"2024-05-07T14:02:32.411352+0000","last_clean":"2024-05-07T14:02:32.411352+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:02:32.411352+0000","last_undegraded":"2024-05-07T14:02:32.411352+0000","last_fullsized":"2024-05-07T14:02:32.411352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639953+0000","last_change":"2024-05-07T14:00:55.986233+0000","last_active":"2024-05-07T14:02:31.639953+0000","last_peered":"2024-05-07T14:02:31.639953+0000","last_clean":"2024-05-07T14:02:31.639953+0000","last_became_active":"2024-05-07T14:00:55.984927+0000","last_became_peered":"2024-05-07T14:00:55.984927+0000","last_unstale":"2024-05-07T14:02:31.639953+0000","last_undegraded":"2024-05-07T14:02:31.639953+0000","last_fullsized":"2024-05-07T14:02:31.639953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392420+0000","last_change":"2024-05-07T14:00:59.992166+0000","last_active":"2024-05-07T14:02:32.392420+0000","last_peered":"2024-05-07T14:02:32.392420+0000","last_clean":"2024-05-07T14:02:32.392420+0000","last_became_active":"2024-05-07T14:00:59.991408+0000","last_became_peered":"2024-05-07T14:00:59.991408+0000","last_unstale":"2024-05-07T14:02:32.392420+0000","last_undegraded":"2024-05-07T14:02:32.392420+0000","last_fullsized":"2024-05-07T14:02:32.392420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"33'10","reported_seq":106,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638389+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:02:31.638389+0000","last_peered":"2024-05-07T14:02:31.638389+0000","last_clean":"2024-05-07T14:02:31.638389+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:02:31.638389+0000","last_undegraded":"2024-05-07T14:02:31.638389+0000","last_fullsized":"2024-05-07T14:02:31.638389+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640188+0000","last_change":"2024-05-07T14:01:04.007238+0000","last_active":"2024-05-07T14:02:31.640188+0000","last_peered":"2024-05-07T14:02:31.640188+0000","last_clean":"2024-05-07T14:02:31.640188+0000","last_became_active":"2024-05-07T14:01:04.006204+0000","last_became_peered":"2024-05-07T14:01:04.006204+0000","last_unstale":"2024-05-07T14:02:31.640188+0000","last_undegraded":"2024-05-07T14:02:31.640188+0000","last_fullsized":"2024-05-07T14:02:31.640188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635120+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:02:31.635120+0000","last_peered":"2024-05-07T14:02:31.635120+0000","last_clean":"2024-05-07T14:02:31.635120+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:02:31.635120+0000","last_undegraded":"2024-05-07T14:02:31.635120+0000","last_fullsized":"2024-05-07T14:02:31.635120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392078+0000","last_change":"2024-05-07T14:00:57.998824+0000","last_active":"2024-05-07T14:02:32.392078+0000","last_peered":"2024-05-07T14:02:32.392078+0000","last_clean":"2024-05-07T14:02:32.392078+0000","last_became_active":"2024-05-07T14:00:57.998316+0000","last_became_peered":"2024-05-07T14:00:57.998316+0000","last_unstale":"2024-05-07T14:02:32.392078+0000","last_undegraded":"2024-05-07T14:02:32.392078+0000","last_fullsized":"2024-05-07T14:02:32.392078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.005080+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:02:32.005080+0000","last_peered":"2024-05-07T14:02:32.005080+0000","last_clean":"2024-05-07T14:02:32.005080+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:02:32.005080+0000","last_undegraded":"2024-05-07T14:02:32.005080+0000","last_fullsized":"2024-05-07T14:02:32.005080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257540+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:02:32.257540+0000","last_peered":"2024-05-07T14:02:32.257540+0000","last_clean":"2024-05-07T14:02:32.257540+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:02:32.257540+0000","last_undegraded":"2024-05-07T14:02:32.257540+0000","last_fullsized":"2024-05-07T14:02:32.257540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640380+0000","last_change":"2024-05-07T14:01:02.151107+0000","last_active":"2024-05-07T14:02:31.640380+0000","last_peered":"2024-05-07T14:02:31.640380+0000","last_clean":"2024-05-07T14:02:31.640380+0000","last_became_active":"2024-05-07T14:01:02.150351+0000","last_became_peered":"2024-05-07T14:01:02.150351+0000","last_unstale":"2024-05-07T14:02:31.640380+0000","last_undegraded":"2024-05-07T14:02:31.640380+0000","last_fullsized":"2024-05-07T14:02:31.640380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:28:13.159757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391061+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:02:32.391061+0000","last_peered":"2024-05-07T14:02:32.391061+0000","last_clean":"2024-05-07T14:02:32.391061+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:02:32.391061+0000","last_undegraded":"2024-05-07T14:02:32.391061+0000","last_fullsized":"2024-05-07T14:02:32.391061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257818+0000","last_change":"2024-05-07T14:00:57.979757+0000","last_active":"2024-05-07T14:02:32.257818+0000","last_peered":"2024-05-07T14:02:32.257818+0000","last_clean":"2024-05-07T14:02:32.257818+0000","last_became_active":"2024-05-07T14:00:57.979030+0000","last_became_peered":"2024-05-07T14:00:57.979030+0000","last_unstale":"2024-05-07T14:02:32.257818+0000","last_undegraded":"2024-05-07T14:02:32.257818+0000","last_fullsized":"2024-05-07T14:02:32.257818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640974+0000","last_change":"2024-05-07T14:00:55.980339+0000","last_active":"2024-05-07T14:02:31.640974+0000","last_peered":"2024-05-07T14:02:31.640974+0000","last_clean":"2024-05-07T14:02:31.640974+0000","last_became_active":"2024-05-07T14:00:55.979609+0000","last_became_peered":"2024-05-07T14:00:55.979609+0000","last_unstale":"2024-05-07T14:02:31.640974+0000","last_undegraded":"2024-05-07T14:02:31.640974+0000","last_fullsized":"2024-05-07T14:02:31.640974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:52.518278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639519+0000","last_change":"2024-05-07T14:00:59.982771+0000","last_active":"2024-05-07T14:02:31.639519+0000","last_peered":"2024-05-07T14:02:31.639519+0000","last_clean":"2024-05-07T14:02:31.639519+0000","last_became_active":"2024-05-07T14:00:59.982018+0000","last_became_peered":"2024-05-07T14:00:59.982018+0000","last_unstale":"2024-05-07T14:02:31.639519+0000","last_undegraded":"2024-05-07T14:02:31.639519+0000","last_fullsized":"2024-05-07T14:02:31.639519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:47.657483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"33'19","reported_seq":123,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256091+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:02:32.256091+0000","last_peered":"2024-05-07T14:02:32.256091+0000","last_clean":"2024-05-07T14:02:32.256091+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:02:32.256091+0000","last_undegraded":"2024-05-07T14:02:32.256091+0000","last_fullsized":"2024-05-07T14:02:32.256091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355576+0000","last_change":"2024-05-07T14:01:04.021895+0000","last_active":"2024-05-07T14:02:32.355576+0000","last_peered":"2024-05-07T14:02:32.355576+0000","last_clean":"2024-05-07T14:02:32.355576+0000","last_became_active":"2024-05-07T14:01:04.021043+0000","last_became_peered":"2024-05-07T14:01:04.021043+0000","last_unstale":"2024-05-07T14:02:32.355576+0000","last_undegraded":"2024-05-07T14:02:32.355576+0000","last_fullsized":"2024-05-07T14:02:32.355576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:58.601458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257086+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:02:32.257086+0000","last_peered":"2024-05-07T14:02:32.257086+0000","last_clean":"2024-05-07T14:02:32.257086+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:02:32.257086+0000","last_undegraded":"2024-05-07T14:02:32.257086+0000","last_fullsized":"2024-05-07T14:02:32.257086+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634941+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:02:31.634941+0000","last_peered":"2024-05-07T14:02:31.634941+0000","last_clean":"2024-05-07T14:02:31.634941+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:02:31.634941+0000","last_undegraded":"2024-05-07T14:02:31.634941+0000","last_fullsized":"2024-05-07T14:02:31.634941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640735+0000","last_change":"2024-05-07T14:00:55.980488+0000","last_active":"2024-05-07T14:02:31.640735+0000","last_peered":"2024-05-07T14:02:31.640735+0000","last_clean":"2024-05-07T14:02:31.640735+0000","last_became_active":"2024-05-07T14:00:55.979688+0000","last_became_peered":"2024-05-07T14:00:55.979688+0000","last_unstale":"2024-05-07T14:02:31.640735+0000","last_undegraded":"2024-05-07T14:02:31.640735+0000","last_fullsized":"2024-05-07T14:02:31.640735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:32.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":97,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.637922+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:02:31.637922+0000","last_peered":"2024-05-07T14:02:31.637922+0000","last_clean":"2024-05-07T14:02:31.637922+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:02:31.637922+0000","last_undegraded":"2024-05-07T14:02:31.637922+0000","last_fullsized":"2024-05-07T14:02:31.637922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392546+0000","last_change":"2024-05-07T14:01:02.014265+0000","last_active":"2024-05-07T14:02:32.392546+0000","last_peered":"2024-05-07T14:02:32.392546+0000","last_clean":"2024-05-07T14:02:32.392546+0000","last_became_active":"2024-05-07T14:01:02.009335+0000","last_became_peered":"2024-05-07T14:01:02.009335+0000","last_unstale":"2024-05-07T14:02:32.392546+0000","last_undegraded":"2024-05-07T14:02:32.392546+0000","last_fullsized":"2024-05-07T14:02:32.392546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392767+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:02:32.392767+0000","last_peered":"2024-05-07T14:02:32.392767+0000","last_clean":"2024-05-07T14:02:32.392767+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:02:32.392767+0000","last_undegraded":"2024-05-07T14:02:32.392767+0000","last_fullsized":"2024-05-07T14:02:32.392767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004228+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:02:32.004228+0000","last_peered":"2024-05-07T14:02:32.004228+0000","last_clean":"2024-05-07T14:02:32.004228+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:02:32.004228+0000","last_undegraded":"2024-05-07T14:02:32.004228+0000","last_fullsized":"2024-05-07T14:02:32.004228+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004623+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:02:32.004623+0000","last_peered":"2024-05-07T14:02:32.004623+0000","last_clean":"2024-05-07T14:02:32.004623+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:02:32.004623+0000","last_undegraded":"2024-05-07T14:02:32.004623+0000","last_fullsized":"2024-05-07T14:02:32.004623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640854+0000","last_change":"2024-05-07T14:00:56.008026+0000","last_active":"2024-05-07T14:02:31.640854+0000","last_peered":"2024-05-07T14:02:31.640854+0000","last_clean":"2024-05-07T14:02:31.640854+0000","last_became_active":"2024-05-07T14:00:56.007374+0000","last_became_peered":"2024-05-07T14:00:56.007374+0000","last_unstale":"2024-05-07T14:02:31.640854+0000","last_undegraded":"2024-05-07T14:02:31.640854+0000","last_fullsized":"2024-05-07T14:02:31.640854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638494+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:02:31.638494+0000","last_peered":"2024-05-07T14:02:31.638494+0000","last_clean":"2024-05-07T14:02:31.638494+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:02:31.638494+0000","last_undegraded":"2024-05-07T14:02:31.638494+0000","last_fullsized":"2024-05-07T14:02:31.638494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"33'15","reported_seq":117,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640088+0000","last_change":"2024-05-07T14:01:01.997489+0000","last_active":"2024-05-07T14:02:31.640088+0000","last_peered":"2024-05-07T14:02:31.640088+0000","last_clean":"2024-05-07T14:02:31.640088+0000","last_became_active":"2024-05-07T14:01:01.994656+0000","last_became_peered":"2024-05-07T14:01:01.994656+0000","last_unstale":"2024-05-07T14:02:31.640088+0000","last_undegraded":"2024-05-07T14:02:31.640088+0000","last_fullsized":"2024-05-07T14:02:31.640088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:12.091721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409573+0000","last_change":"2024-05-07T14:01:04.009157+0000","last_active":"2024-05-07T14:02:32.409573+0000","last_peered":"2024-05-07T14:02:32.409573+0000","last_clean":"2024-05-07T14:02:32.409573+0000","last_became_active":"2024-05-07T14:01:04.008594+0000","last_became_peered":"2024-05-07T14:01:04.008594+0000","last_unstale":"2024-05-07T14:02:32.409573+0000","last_undegraded":"2024-05-07T14:02:32.409573+0000","last_fullsized":"2024-05-07T14:02:32.409573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:41:04.866447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410993+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:02:32.410993+0000","last_peered":"2024-05-07T14:02:32.410993+0000","last_clean":"2024-05-07T14:02:32.410993+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:02:32.410993+0000","last_undegraded":"2024-05-07T14:02:32.410993+0000","last_fullsized":"2024-05-07T14:02:32.410993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410157+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:02:32.410157+0000","last_peered":"2024-05-07T14:02:32.410157+0000","last_clean":"2024-05-07T14:02:32.410157+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:02:32.410157+0000","last_undegraded":"2024-05-07T14:02:32.410157+0000","last_fullsized":"2024-05-07T14:02:32.410157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257706+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:02:32.257706+0000","last_peered":"2024-05-07T14:02:32.257706+0000","last_clean":"2024-05-07T14:02:32.257706+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:02:32.257706+0000","last_undegraded":"2024-05-07T14:02:32.257706+0000","last_fullsized":"2024-05-07T14:02:32.257706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640054+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:02:31.640054+0000","last_peered":"2024-05-07T14:02:31.640054+0000","last_clean":"2024-05-07T14:02:31.640054+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:02:31.640054+0000","last_undegraded":"2024-05-07T14:02:31.640054+0000","last_fullsized":"2024-05-07T14:02:31.640054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"33'12","reported_seq":114,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409729+0000","last_change":"2024-05-07T14:01:01.995144+0000","last_active":"2024-05-07T14:02:32.409729+0000","last_peered":"2024-05-07T14:02:32.409729+0000","last_clean":"2024-05-07T14:02:32.409729+0000","last_became_active":"2024-05-07T14:01:01.993073+0000","last_became_peered":"2024-05-07T14:01:01.993073+0000","last_unstale":"2024-05-07T14:02:32.409729+0000","last_undegraded":"2024-05-07T14:02:32.409729+0000","last_fullsized":"2024-05-07T14:02:32.409729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:54.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.637799+0000","last_change":"2024-05-07T14:01:04.012216+0000","last_active":"2024-05-07T14:02:31.637799+0000","last_peered":"2024-05-07T14:02:31.637799+0000","last_clean":"2024-05-07T14:02:31.637799+0000","last_became_active":"2024-05-07T14:01:04.011476+0000","last_became_peered":"2024-05-07T14:01:04.011476+0000","last_unstale":"2024-05-07T14:02:31.637799+0000","last_undegraded":"2024-05-07T14:02:31.637799+0000","last_fullsized":"2024-05-07T14:02:31.637799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:46.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355963+0000","last_change":"2024-05-07T14:01:06.024311+0000","last_active":"2024-05-07T14:02:32.355963+0000","last_peered":"2024-05-07T14:02:32.355963+0000","last_clean":"2024-05-07T14:02:32.355963+0000","last_became_active":"2024-05-07T14:01:06.023404+0000","last_became_peered":"2024-05-07T14:01:06.023404+0000","last_unstale":"2024-05-07T14:02:32.355963+0000","last_undegraded":"2024-05-07T14:02:32.355963+0000","last_fullsized":"2024-05-07T14:02:32.355963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:26.544302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635610+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:02:31.635610+0000","last_peered":"2024-05-07T14:02:31.635610+0000","last_clean":"2024-05-07T14:02:31.635610+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:02:31.635610+0000","last_undegraded":"2024-05-07T14:02:31.635610+0000","last_fullsized":"2024-05-07T14:02:31.635610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391978+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:02:32.391978+0000","last_peered":"2024-05-07T14:02:32.391978+0000","last_clean":"2024-05-07T14:02:32.391978+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:02:32.391978+0000","last_undegraded":"2024-05-07T14:02:32.391978+0000","last_fullsized":"2024-05-07T14:02:32.391978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638434+0000","last_change":"2024-05-07T14:00:59.992897+0000","last_active":"2024-05-07T14:02:31.638434+0000","last_peered":"2024-05-07T14:02:31.638434+0000","last_clean":"2024-05-07T14:02:31.638434+0000","last_became_active":"2024-05-07T14:00:59.992067+0000","last_became_peered":"2024-05-07T14:00:59.992067+0000","last_unstale":"2024-05-07T14:02:31.638434+0000","last_undegraded":"2024-05-07T14:02:31.638434+0000","last_fullsized":"2024-05-07T14:02:31.638434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:19.526884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635917+0000","last_change":"2024-05-07T14:01:02.012335+0000","last_active":"2024-05-07T14:02:31.635917+0000","last_peered":"2024-05-07T14:02:31.635917+0000","last_clean":"2024-05-07T14:02:31.635917+0000","last_became_active":"2024-05-07T14:01:02.011651+0000","last_became_peered":"2024-05-07T14:01:02.011651+0000","last_unstale":"2024-05-07T14:02:31.635917+0000","last_undegraded":"2024-05-07T14:02:31.635917+0000","last_fullsized":"2024-05-07T14:02:31.635917+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410607+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:02:32.410607+0000","last_peered":"2024-05-07T14:02:32.410607+0000","last_clean":"2024-05-07T14:02:32.410607+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:02:32.410607+0000","last_undegraded":"2024-05-07T14:02:32.410607+0000","last_fullsized":"2024-05-07T14:02:32.410607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390662+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:02:32.390662+0000","last_peered":"2024-05-07T14:02:32.390662+0000","last_clean":"2024-05-07T14:02:32.390662+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:02:32.390662+0000","last_undegraded":"2024-05-07T14:02:32.390662+0000","last_fullsized":"2024-05-07T14:02:32.390662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636074+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:02:31.636074+0000","last_peered":"2024-05-07T14:02:31.636074+0000","last_clean":"2024-05-07T14:02:31.636074+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:02:31.636074+0000","last_undegraded":"2024-05-07T14:02:31.636074+0000","last_fullsized":"2024-05-07T14:02:31.636074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.003506+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:02:32.003506+0000","last_peered":"2024-05-07T14:02:32.003506+0000","last_clean":"2024-05-07T14:02:32.003506+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:02:32.003506+0000","last_undegraded":"2024-05-07T14:02:32.003506+0000","last_fullsized":"2024-05-07T14:02:32.003506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":97,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356388+0000","last_change":"2024-05-07T14:01:00.006802+0000","last_active":"2024-05-07T14:02:32.356388+0000","last_peered":"2024-05-07T14:02:32.356388+0000","last_clean":"2024-05-07T14:02:32.356388+0000","last_became_active":"2024-05-07T14:01:00.006254+0000","last_became_peered":"2024-05-07T14:01:00.006254+0000","last_unstale":"2024-05-07T14:02:32.356388+0000","last_undegraded":"2024-05-07T14:02:32.356388+0000","last_fullsized":"2024-05-07T14:02:32.356388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:40.998377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"33'15","reported_seq":116,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638613+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:02:31.638613+0000","last_peered":"2024-05-07T14:02:31.638613+0000","last_clean":"2024-05-07T14:02:31.638613+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:02:31.638613+0000","last_undegraded":"2024-05-07T14:02:31.638613+0000","last_fullsized":"2024-05-07T14:02:31.638613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640082+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:02:31.640082+0000","last_peered":"2024-05-07T14:02:31.640082+0000","last_clean":"2024-05-07T14:02:31.640082+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:02:31.640082+0000","last_undegraded":"2024-05-07T14:02:31.640082+0000","last_fullsized":"2024-05-07T14:02:31.640082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355301+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:02:32.355301+0000","last_peered":"2024-05-07T14:02:32.355301+0000","last_clean":"2024-05-07T14:02:32.355301+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:02:32.355301+0000","last_undegraded":"2024-05-07T14:02:32.355301+0000","last_fullsized":"2024-05-07T14:02:32.355301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636367+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:02:31.636367+0000","last_peered":"2024-05-07T14:02:31.636367+0000","last_clean":"2024-05-07T14:02:31.636367+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:02:31.636367+0000","last_undegraded":"2024-05-07T14:02:31.636367+0000","last_fullsized":"2024-05-07T14:02:31.636367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635487+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:02:31.635487+0000","last_peered":"2024-05-07T14:02:31.635487+0000","last_clean":"2024-05-07T14:02:31.635487+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:02:31.635487+0000","last_undegraded":"2024-05-07T14:02:31.635487+0000","last_fullsized":"2024-05-07T14:02:31.635487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257847+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:02:32.257847+0000","last_peered":"2024-05-07T14:02:32.257847+0000","last_clean":"2024-05-07T14:02:32.257847+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:02:32.257847+0000","last_undegraded":"2024-05-07T14:02:32.257847+0000","last_fullsized":"2024-05-07T14:02:32.257847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391230+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:02:32.391230+0000","last_peered":"2024-05-07T14:02:32.391230+0000","last_clean":"2024-05-07T14:02:32.391230+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:02:32.391230+0000","last_undegraded":"2024-05-07T14:02:32.391230+0000","last_fullsized":"2024-05-07T14:02:32.391230+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004535+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:02:32.004535+0000","last_peered":"2024-05-07T14:02:32.004535+0000","last_clean":"2024-05-07T14:02:32.004535+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:02:32.004535+0000","last_undegraded":"2024-05-07T14:02:32.004535+0000","last_fullsized":"2024-05-07T14:02:32.004535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635355+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:02:31.635355+0000","last_peered":"2024-05-07T14:02:31.635355+0000","last_clean":"2024-05-07T14:02:31.635355+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:02:31.635355+0000","last_undegraded":"2024-05-07T14:02:31.635355+0000","last_fullsized":"2024-05-07T14:02:31.635355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356351+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:02:32.356351+0000","last_peered":"2024-05-07T14:02:32.356351+0000","last_clean":"2024-05-07T14:02:32.356351+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:02:32.356351+0000","last_undegraded":"2024-05-07T14:02:32.356351+0000","last_fullsized":"2024-05-07T14:02:32.356351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391644+0000","last_change":"2024-05-07T14:00:55.974435+0000","last_active":"2024-05-07T14:02:32.391644+0000","last_peered":"2024-05-07T14:02:32.391644+0000","last_clean":"2024-05-07T14:02:32.391644+0000","last_became_active":"2024-05-07T14:00:55.974010+0000","last_became_peered":"2024-05-07T14:00:55.974010+0000","last_unstale":"2024-05-07T14:02:32.391644+0000","last_undegraded":"2024-05-07T14:02:32.391644+0000","last_fullsized":"2024-05-07T14:02:32.391644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636105+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:02:31.636105+0000","last_peered":"2024-05-07T14:02:31.636105+0000","last_clean":"2024-05-07T14:02:31.636105+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:02:31.636105+0000","last_undegraded":"2024-05-07T14:02:31.636105+0000","last_fullsized":"2024-05-07T14:02:31.636105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"33'17","reported_seq":120,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257329+0000","last_change":"2024-05-07T14:01:02.013314+0000","last_active":"2024-05-07T14:02:32.257329+0000","last_peered":"2024-05-07T14:02:32.257329+0000","last_clean":"2024-05-07T14:02:32.257329+0000","last_became_active":"2024-05-07T14:01:02.012667+0000","last_became_peered":"2024-05-07T14:01:02.012667+0000","last_unstale":"2024-05-07T14:02:32.257329+0000","last_undegraded":"2024-05-07T14:02:32.257329+0000","last_fullsized":"2024-05-07T14:02:32.257329+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004026+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:02:32.004026+0000","last_peered":"2024-05-07T14:02:32.004026+0000","last_clean":"2024-05-07T14:02:32.004026+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:02:32.004026+0000","last_undegraded":"2024-05-07T14:02:32.004026+0000","last_fullsized":"2024-05-07T14:02:32.004026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355488+0000","last_change":"2024-05-07T14:01:06.031381+0000","last_active":"2024-05-07T14:02:32.355488+0000","last_peered":"2024-05-07T14:02:32.355488+0000","last_clean":"2024-05-07T14:02:32.355488+0000","last_became_active":"2024-05-07T14:01:06.030958+0000","last_became_peered":"2024-05-07T14:01:06.030958+0000","last_unstale":"2024-05-07T14:02:32.355488+0000","last_undegraded":"2024-05-07T14:02:32.355488+0000","last_fullsized":"2024-05-07T14:02:32.355488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:26.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.005047+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:02:32.005047+0000","last_peered":"2024-05-07T14:02:32.005047+0000","last_clean":"2024-05-07T14:02:32.005047+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:02:32.005047+0000","last_undegraded":"2024-05-07T14:02:32.005047+0000","last_fullsized":"2024-05-07T14:02:32.005047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":266,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640260+0000","last_change":"2024-05-07T14:00:45.460158+0000","last_active":"2024-05-07T14:02:31.640260+0000","last_peered":"2024-05-07T14:02:31.640260+0000","last_clean":"2024-05-07T14:02:31.640260+0000","last_became_active":"2024-05-07T14:00:45.458198+0000","last_became_peered":"2024-05-07T14:00:45.458198+0000","last_unstale":"2024-05-07T14:02:31.640260+0000","last_undegraded":"2024-05-07T14:02:31.640260+0000","last_fullsized":"2024-05-07T14:02:31.640260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:18.582514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256827+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:02:32.256827+0000","last_peered":"2024-05-07T14:02:32.256827+0000","last_clean":"2024-05-07T14:02:32.256827+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:02:32.256827+0000","last_undegraded":"2024-05-07T14:02:32.256827+0000","last_fullsized":"2024-05-07T14:02:32.256827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638157+0000","last_change":"2024-05-07T14:01:37.317794+0000","last_active":"2024-05-07T14:02:31.638157+0000","last_peered":"2024-05-07T14:02:31.638157+0000","last_clean":"2024-05-07T14:02:31.638157+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:02:31.638157+0000","last_undegraded":"2024-05-07T14:02:31.638157+0000","last_fullsized":"2024-05-07T14:02:31.638157+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:17.582561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640399+0000","last_change":"2024-05-07T14:00:59.988489+0000","last_active":"2024-05-07T14:02:31.640399+0000","last_peered":"2024-05-07T14:02:31.640399+0000","last_clean":"2024-05-07T14:02:31.640399+0000","last_became_active":"2024-05-07T14:00:59.987757+0000","last_became_peered":"2024-05-07T14:00:59.987757+0000","last_unstale":"2024-05-07T14:02:31.640399+0000","last_undegraded":"2024-05-07T14:02:31.640399+0000","last_fullsized":"2024-05-07T14:02:31.640399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"33'13","reported_seq":119,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.258075+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:02:32.258075+0000","last_peered":"2024-05-07T14:02:32.258075+0000","last_clean":"2024-05-07T14:02:32.258075+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:02:32.258075+0000","last_undegraded":"2024-05-07T14:02:32.258075+0000","last_fullsized":"2024-05-07T14:02:32.258075+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409106+0000","last_change":"2024-05-07T14:01:04.007712+0000","last_active":"2024-05-07T14:02:32.409106+0000","last_peered":"2024-05-07T14:02:32.409106+0000","last_clean":"2024-05-07T14:02:32.409106+0000","last_became_active":"2024-05-07T14:01:04.006934+0000","last_became_peered":"2024-05-07T14:01:04.006934+0000","last_unstale":"2024-05-07T14:02:32.409106+0000","last_undegraded":"2024-05-07T14:02:32.409106+0000","last_fullsized":"2024-05-07T14:02:32.409106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004345+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:02:32.004345+0000","last_peered":"2024-05-07T14:02:32.004345+0000","last_clean":"2024-05-07T14:02:32.004345+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:02:32.004345+0000","last_undegraded":"2024-05-07T14:02:32.004345+0000","last_fullsized":"2024-05-07T14:02:32.004345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411270+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:02:32.411270+0000","last_peered":"2024-05-07T14:02:32.411270+0000","last_clean":"2024-05-07T14:02:32.411270+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:02:32.411270+0000","last_undegraded":"2024-05-07T14:02:32.411270+0000","last_fullsized":"2024-05-07T14:02:32.411270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640390+0000","last_change":"2024-05-07T14:00:49.930222+0000","last_active":"2024-05-07T14:02:31.640390+0000","last_peered":"2024-05-07T14:02:31.640390+0000","last_clean":"2024-05-07T14:02:31.640390+0000","last_became_active":"2024-05-07T14:00:49.929538+0000","last_became_peered":"2024-05-07T14:00:49.929538+0000","last_unstale":"2024-05-07T14:02:31.640390+0000","last_undegraded":"2024-05-07T14:02:31.640390+0000","last_fullsized":"2024-05-07T14:02:31.640390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:43.069683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408792+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:02:32.408792+0000","last_peered":"2024-05-07T14:02:32.408792+0000","last_clean":"2024-05-07T14:02:32.408792+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:02:32.408792+0000","last_undegraded":"2024-05-07T14:02:32.408792+0000","last_fullsized":"2024-05-07T14:02:32.408792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.258338+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:02:32.258338+0000","last_peered":"2024-05-07T14:02:32.258338+0000","last_clean":"2024-05-07T14:02:32.258338+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:02:32.258338+0000","last_undegraded":"2024-05-07T14:02:32.258338+0000","last_fullsized":"2024-05-07T14:02:32.258338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"33'23","reported_seq":150,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356303+0000","last_change":"2024-05-07T14:01:02.014645+0000","last_active":"2024-05-07T14:02:32.356303+0000","last_peered":"2024-05-07T14:02:32.356303+0000","last_clean":"2024-05-07T14:02:32.356303+0000","last_became_active":"2024-05-07T14:01:02.013904+0000","last_became_peered":"2024-05-07T14:01:02.013904+0000","last_unstale":"2024-05-07T14:02:32.356303+0000","last_undegraded":"2024-05-07T14:02:32.356303+0000","last_fullsized":"2024-05-07T14:02:32.356303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:31.441743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640523+0000","last_change":"2024-05-07T14:01:04.012527+0000","last_active":"2024-05-07T14:02:31.640523+0000","last_peered":"2024-05-07T14:02:31.640523+0000","last_clean":"2024-05-07T14:02:31.640523+0000","last_became_active":"2024-05-07T14:01:04.007658+0000","last_became_peered":"2024-05-07T14:01:04.007658+0000","last_unstale":"2024-05-07T14:02:31.640523+0000","last_undegraded":"2024-05-07T14:02:31.640523+0000","last_fullsized":"2024-05-07T14:02:31.640523+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355410+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:02:32.355410+0000","last_peered":"2024-05-07T14:02:32.355410+0000","last_clean":"2024-05-07T14:02:32.355410+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:02:32.355410+0000","last_undegraded":"2024-05-07T14:02:32.355410+0000","last_fullsized":"2024-05-07T14:02:32.355410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356422+0000","last_change":"2024-05-07T14:00:57.989314+0000","last_active":"2024-05-07T14:02:32.356422+0000","last_peered":"2024-05-07T14:02:32.356422+0000","last_clean":"2024-05-07T14:02:32.356422+0000","last_became_active":"2024-05-07T14:00:57.988994+0000","last_became_peered":"2024-05-07T14:00:57.988994+0000","last_unstale":"2024-05-07T14:02:32.356422+0000","last_undegraded":"2024-05-07T14:02:32.356422+0000","last_fullsized":"2024-05-07T14:02:32.356422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638224+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:02:31.638224+0000","last_peered":"2024-05-07T14:02:31.638224+0000","last_clean":"2024-05-07T14:02:31.638224+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:02:31.638224+0000","last_undegraded":"2024-05-07T14:02:31.638224+0000","last_fullsized":"2024-05-07T14:02:31.638224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.354684+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:02:32.354684+0000","last_peered":"2024-05-07T14:02:32.354684+0000","last_clean":"2024-05-07T14:02:32.354684+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:02:32.354684+0000","last_undegraded":"2024-05-07T14:02:32.354684+0000","last_fullsized":"2024-05-07T14:02:32.354684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640173+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:02:31.640173+0000","last_peered":"2024-05-07T14:02:31.640173+0000","last_clean":"2024-05-07T14:02:31.640173+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:02:31.640173+0000","last_undegraded":"2024-05-07T14:02:31.640173+0000","last_fullsized":"2024-05-07T14:02:31.640173+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":131,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640679+0000","last_change":"2024-05-07T14:01:02.148182+0000","last_active":"2024-05-07T14:02:31.640679+0000","last_peered":"2024-05-07T14:02:31.640679+0000","last_clean":"2024-05-07T14:02:31.640679+0000","last_became_active":"2024-05-07T14:01:02.147442+0000","last_became_peered":"2024-05-07T14:01:02.147442+0000","last_unstale":"2024-05-07T14:02:31.640679+0000","last_undegraded":"2024-05-07T14:02:31.640679+0000","last_fullsized":"2024-05-07T14:02:31.640679+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:24.955989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409049+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:02:32.409049+0000","last_peered":"2024-05-07T14:02:32.409049+0000","last_clean":"2024-05-07T14:02:32.409049+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:02:32.409049+0000","last_undegraded":"2024-05-07T14:02:32.409049+0000","last_fullsized":"2024-05-07T14:02:32.409049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392329+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:02:32.392329+0000","last_peered":"2024-05-07T14:02:32.392329+0000","last_clean":"2024-05-07T14:02:32.392329+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:02:32.392329+0000","last_undegraded":"2024-05-07T14:02:32.392329+0000","last_fullsized":"2024-05-07T14:02:32.392329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":54,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257259+0000","last_change":"2024-05-07T14:01:37.318739+0000","last_active":"2024-05-07T14:02:32.257259+0000","last_peered":"2024-05-07T14:02:32.257259+0000","last_clean":"2024-05-07T14:02:32.257259+0000","last_became_active":"2024-05-07T14:01:37.317858+0000","last_became_peered":"2024-05-07T14:01:37.317858+0000","last_unstale":"2024-05-07T14:02:32.257259+0000","last_undegraded":"2024-05-07T14:02:32.257259+0000","last_fullsized":"2024-05-07T14:02:32.257259+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:42:22.624696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256903+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:02:32.256903+0000","last_peered":"2024-05-07T14:02:32.256903+0000","last_clean":"2024-05-07T14:02:32.256903+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:02:32.256903+0000","last_undegraded":"2024-05-07T14:02:32.256903+0000","last_fullsized":"2024-05-07T14:02:32.256903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635777+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:02:31.635777+0000","last_peered":"2024-05-07T14:02:31.635777+0000","last_clean":"2024-05-07T14:02:31.635777+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:02:31.635777+0000","last_undegraded":"2024-05-07T14:02:31.635777+0000","last_fullsized":"2024-05-07T14:02:31.635777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410623+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:02:32.410623+0000","last_peered":"2024-05-07T14:02:32.410623+0000","last_clean":"2024-05-07T14:02:32.410623+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:02:32.410623+0000","last_undegraded":"2024-05-07T14:02:32.410623+0000","last_fullsized":"2024-05-07T14:02:32.410623+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391598+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:02:32.391598+0000","last_peered":"2024-05-07T14:02:32.391598+0000","last_clean":"2024-05-07T14:02:32.391598+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:02:32.391598+0000","last_undegraded":"2024-05-07T14:02:32.391598+0000","last_fullsized":"2024-05-07T14:02:32.391598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004517+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:02:32.004517+0000","last_peered":"2024-05-07T14:02:32.004517+0000","last_clean":"2024-05-07T14:02:32.004517+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:02:32.004517+0000","last_undegraded":"2024-05-07T14:02:32.004517+0000","last_fullsized":"2024-05-07T14:02:32.004517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256515+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:02:32.256515+0000","last_peered":"2024-05-07T14:02:32.256515+0000","last_clean":"2024-05-07T14:02:32.256515+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:02:32.256515+0000","last_undegraded":"2024-05-07T14:02:32.256515+0000","last_fullsized":"2024-05-07T14:02:32.256515+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355718+0000","last_change":"2024-05-07T14:00:57.989747+0000","last_active":"2024-05-07T14:02:32.355718+0000","last_peered":"2024-05-07T14:02:32.355718+0000","last_clean":"2024-05-07T14:02:32.355718+0000","last_became_active":"2024-05-07T14:00:57.989252+0000","last_became_peered":"2024-05-07T14:00:57.989252+0000","last_unstale":"2024-05-07T14:02:32.355718+0000","last_undegraded":"2024-05-07T14:02:32.355718+0000","last_fullsized":"2024-05-07T14:02:32.355718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:44.815601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.258132+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:02:32.258132+0000","last_peered":"2024-05-07T14:02:32.258132+0000","last_clean":"2024-05-07T14:02:32.258132+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:02:32.258132+0000","last_undegraded":"2024-05-07T14:02:32.258132+0000","last_fullsized":"2024-05-07T14:02:32.258132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356638+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:02:32.356638+0000","last_peered":"2024-05-07T14:02:32.356638+0000","last_clean":"2024-05-07T14:02:32.356638+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:02:32.356638+0000","last_undegraded":"2024-05-07T14:02:32.356638+0000","last_fullsized":"2024-05-07T14:02:32.356638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409819+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:02:32.409819+0000","last_peered":"2024-05-07T14:02:32.409819+0000","last_clean":"2024-05-07T14:02:32.409819+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:02:32.409819+0000","last_undegraded":"2024-05-07T14:02:32.409819+0000","last_fullsized":"2024-05-07T14:02:32.409819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'18","reported_seq":123,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409777+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:02:32.409777+0000","last_peered":"2024-05-07T14:02:32.409777+0000","last_clean":"2024-05-07T14:02:32.409777+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:02:32.409777+0000","last_undegraded":"2024-05-07T14:02:32.409777+0000","last_fullsized":"2024-05-07T14:02:32.409777+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634736+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:02:31.634736+0000","last_peered":"2024-05-07T14:02:31.634736+0000","last_clean":"2024-05-07T14:02:31.634736+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:02:31.634736+0000","last_undegraded":"2024-05-07T14:02:31.634736+0000","last_fullsized":"2024-05-07T14:02:31.634736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410817+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:02:32.410817+0000","last_peered":"2024-05-07T14:02:32.410817+0000","last_clean":"2024-05-07T14:02:32.410817+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:02:32.410817+0000","last_undegraded":"2024-05-07T14:02:32.410817+0000","last_fullsized":"2024-05-07T14:02:32.410817+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410076+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:02:32.410076+0000","last_peered":"2024-05-07T14:02:32.410076+0000","last_clean":"2024-05-07T14:02:32.410076+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:02:32.410076+0000","last_undegraded":"2024-05-07T14:02:32.410076+0000","last_fullsized":"2024-05-07T14:02:32.410076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355091+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:02:32.355091+0000","last_peered":"2024-05-07T14:02:32.355091+0000","last_clean":"2024-05-07T14:02:32.355091+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:02:32.355091+0000","last_undegraded":"2024-05-07T14:02:32.355091+0000","last_fullsized":"2024-05-07T14:02:32.355091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640996+0000","last_change":"2024-05-07T14:00:49.928907+0000","last_active":"2024-05-07T14:02:31.640996+0000","last_peered":"2024-05-07T14:02:31.640996+0000","last_clean":"2024-05-07T14:02:31.640996+0000","last_became_active":"2024-05-07T14:00:49.928146+0000","last_became_peered":"2024-05-07T14:00:49.928146+0000","last_unstale":"2024-05-07T14:02:31.640996+0000","last_undegraded":"2024-05-07T14:02:31.640996+0000","last_fullsized":"2024-05-07T14:02:31.640996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:07.032835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004435+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:02:32.004435+0000","last_peered":"2024-05-07T14:02:32.004435+0000","last_clean":"2024-05-07T14:02:32.004435+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:02:32.004435+0000","last_undegraded":"2024-05-07T14:02:32.004435+0000","last_fullsized":"2024-05-07T14:02:32.004435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":112,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355206+0000","last_change":"2024-05-07T14:01:02.148499+0000","last_active":"2024-05-07T14:02:32.355206+0000","last_peered":"2024-05-07T14:02:32.355206+0000","last_clean":"2024-05-07T14:02:32.355206+0000","last_became_active":"2024-05-07T14:01:02.147567+0000","last_became_peered":"2024-05-07T14:01:02.147567+0000","last_unstale":"2024-05-07T14:02:32.355206+0000","last_undegraded":"2024-05-07T14:02:32.355206+0000","last_fullsized":"2024-05-07T14:02:32.355206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:30.162886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257409+0000","last_change":"2024-05-07T14:01:04.015930+0000","last_active":"2024-05-07T14:02:32.257409+0000","last_peered":"2024-05-07T14:02:32.257409+0000","last_clean":"2024-05-07T14:02:32.257409+0000","last_became_active":"2024-05-07T14:01:04.011643+0000","last_became_peered":"2024-05-07T14:01:04.011643+0000","last_unstale":"2024-05-07T14:02:32.257409+0000","last_undegraded":"2024-05-07T14:02:32.257409+0000","last_fullsized":"2024-05-07T14:02:32.257409+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392166+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:02:32.392166+0000","last_peered":"2024-05-07T14:02:32.392166+0000","last_clean":"2024-05-07T14:02:32.392166+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:02:32.392166+0000","last_undegraded":"2024-05-07T14:02:32.392166+0000","last_fullsized":"2024-05-07T14:02:32.392166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390923+0000","last_change":"2024-05-07T14:00:57.998539+0000","last_active":"2024-05-07T14:02:32.390923+0000","last_peered":"2024-05-07T14:02:32.390923+0000","last_clean":"2024-05-07T14:02:32.390923+0000","last_became_active":"2024-05-07T14:00:57.998025+0000","last_became_peered":"2024-05-07T14:00:57.998025+0000","last_unstale":"2024-05-07T14:02:32.390923+0000","last_undegraded":"2024-05-07T14:02:32.390923+0000","last_fullsized":"2024-05-07T14:02:32.390923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391887+0000","last_change":"2024-05-07T14:00:55.988508+0000","last_active":"2024-05-07T14:02:32.391887+0000","last_peered":"2024-05-07T14:02:32.391887+0000","last_clean":"2024-05-07T14:02:32.391887+0000","last_became_active":"2024-05-07T14:00:55.988230+0000","last_became_peered":"2024-05-07T14:00:55.988230+0000","last_unstale":"2024-05-07T14:02:32.391887+0000","last_undegraded":"2024-05-07T14:02:32.391887+0000","last_fullsized":"2024-05-07T14:02:32.391887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356213+0000","last_change":"2024-05-07T14:00:49.936072+0000","last_active":"2024-05-07T14:02:32.356213+0000","last_peered":"2024-05-07T14:02:32.356213+0000","last_clean":"2024-05-07T14:02:32.356213+0000","last_became_active":"2024-05-07T14:00:49.935768+0000","last_became_peered":"2024-05-07T14:00:49.935768+0000","last_unstale":"2024-05-07T14:02:32.356213+0000","last_undegraded":"2024-05-07T14:02:32.356213+0000","last_fullsized":"2024-05-07T14:02:32.356213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634918+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:02:31.634918+0000","last_peered":"2024-05-07T14:02:31.634918+0000","last_clean":"2024-05-07T14:02:31.634918+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:02:31.634918+0000","last_undegraded":"2024-05-07T14:02:31.634918+0000","last_fullsized":"2024-05-07T14:02:31.634918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635502+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:02:31.635502+0000","last_peered":"2024-05-07T14:02:31.635502+0000","last_clean":"2024-05-07T14:02:31.635502+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:02:31.635502+0000","last_undegraded":"2024-05-07T14:02:31.635502+0000","last_fullsized":"2024-05-07T14:02:31.635502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"30'2","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391794+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:02:32.391794+0000","last_peered":"2024-05-07T14:02:32.391794+0000","last_clean":"2024-05-07T14:02:32.391794+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:02:32.391794+0000","last_undegraded":"2024-05-07T14:02:32.391794+0000","last_fullsized":"2024-05-07T14:02:32.391794+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410429+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:02:32.410429+0000","last_peered":"2024-05-07T14:02:32.410429+0000","last_clean":"2024-05-07T14:02:32.410429+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:02:32.410429+0000","last_undegraded":"2024-05-07T14:02:32.410429+0000","last_fullsized":"2024-05-07T14:02:32.410429+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635240+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:02:31.635240+0000","last_peered":"2024-05-07T14:02:31.635240+0000","last_clean":"2024-05-07T14:02:31.635240+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:02:31.635240+0000","last_undegraded":"2024-05-07T14:02:31.635240+0000","last_fullsized":"2024-05-07T14:02:31.635240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411400+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:02:32.411400+0000","last_peered":"2024-05-07T14:02:32.411400+0000","last_clean":"2024-05-07T14:02:32.411400+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:02:32.411400+0000","last_undegraded":"2024-05-07T14:02:32.411400+0000","last_fullsized":"2024-05-07T14:02:32.411400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.005023+0000","last_change":"2024-05-07T14:00:49.938879+0000","last_active":"2024-05-07T14:02:32.005023+0000","last_peered":"2024-05-07T14:02:32.005023+0000","last_clean":"2024-05-07T14:02:32.005023+0000","last_became_active":"2024-05-07T14:00:49.938066+0000","last_became_peered":"2024-05-07T14:00:49.938066+0000","last_unstale":"2024-05-07T14:02:32.005023+0000","last_undegraded":"2024-05-07T14:02:32.005023+0000","last_fullsized":"2024-05-07T14:02:32.005023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390805+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:02:32.390805+0000","last_peered":"2024-05-07T14:02:32.390805+0000","last_clean":"2024-05-07T14:02:32.390805+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:02:32.390805+0000","last_undegraded":"2024-05-07T14:02:32.390805+0000","last_fullsized":"2024-05-07T14:02:32.390805+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'19","reported_seq":128,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639659+0000","last_change":"2024-05-07T14:01:02.148095+0000","last_active":"2024-05-07T14:02:31.639659+0000","last_peered":"2024-05-07T14:02:31.639659+0000","last_clean":"2024-05-07T14:02:31.639659+0000","last_became_active":"2024-05-07T14:01:02.147334+0000","last_became_peered":"2024-05-07T14:01:02.147334+0000","last_unstale":"2024-05-07T14:02:31.639659+0000","last_undegraded":"2024-05-07T14:02:31.639659+0000","last_fullsized":"2024-05-07T14:02:31.639659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392864+0000","last_change":"2024-05-07T14:01:04.024279+0000","last_active":"2024-05-07T14:02:32.392864+0000","last_peered":"2024-05-07T14:02:32.392864+0000","last_clean":"2024-05-07T14:02:32.392864+0000","last_became_active":"2024-05-07T14:01:04.022870+0000","last_became_peered":"2024-05-07T14:01:04.022870+0000","last_unstale":"2024-05-07T14:02:32.392864+0000","last_undegraded":"2024-05-07T14:02:32.392864+0000","last_fullsized":"2024-05-07T14:02:32.392864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:28.158572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257047+0000","last_change":"2024-05-07T14:01:06.039788+0000","last_active":"2024-05-07T14:02:32.257047+0000","last_peered":"2024-05-07T14:02:32.257047+0000","last_clean":"2024-05-07T14:02:32.257047+0000","last_became_active":"2024-05-07T14:01:06.039050+0000","last_became_peered":"2024-05-07T14:01:06.039050+0000","last_unstale":"2024-05-07T14:02:32.257047+0000","last_undegraded":"2024-05-07T14:02:32.257047+0000","last_fullsized":"2024-05-07T14:02:32.257047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410592+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:02:32.410592+0000","last_peered":"2024-05-07T14:02:32.410592+0000","last_clean":"2024-05-07T14:02:32.410592+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:02:32.410592+0000","last_undegraded":"2024-05-07T14:02:32.410592+0000","last_fullsized":"2024-05-07T14:02:32.410592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635383+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:02:31.635383+0000","last_peered":"2024-05-07T14:02:31.635383+0000","last_clean":"2024-05-07T14:02:31.635383+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:02:31.635383+0000","last_undegraded":"2024-05-07T14:02:31.635383+0000","last_fullsized":"2024-05-07T14:02:31.635383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635151+0000","last_change":"2024-05-07T14:00:55.991934+0000","last_active":"2024-05-07T14:02:31.635151+0000","last_peered":"2024-05-07T14:02:31.635151+0000","last_clean":"2024-05-07T14:02:31.635151+0000","last_became_active":"2024-05-07T14:00:55.991303+0000","last_became_peered":"2024-05-07T14:00:55.991303+0000","last_unstale":"2024-05-07T14:02:31.635151+0000","last_undegraded":"2024-05-07T14:02:31.635151+0000","last_fullsized":"2024-05-07T14:02:31.635151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355809+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:02:32.355809+0000","last_peered":"2024-05-07T14:02:32.355809+0000","last_clean":"2024-05-07T14:02:32.355809+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:02:32.355809+0000","last_undegraded":"2024-05-07T14:02:32.355809+0000","last_fullsized":"2024-05-07T14:02:32.355809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390229+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:02:32.390229+0000","last_peered":"2024-05-07T14:02:32.390229+0000","last_clean":"2024-05-07T14:02:32.390229+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:02:32.390229+0000","last_undegraded":"2024-05-07T14:02:32.390229+0000","last_fullsized":"2024-05-07T14:02:32.390229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390456+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:02:32.390456+0000","last_peered":"2024-05-07T14:02:32.390456+0000","last_clean":"2024-05-07T14:02:32.390456+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:02:32.390456+0000","last_undegraded":"2024-05-07T14:02:32.390456+0000","last_fullsized":"2024-05-07T14:02:32.390456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391361+0000","last_change":"2024-05-07T14:01:06.013974+0000","last_active":"2024-05-07T14:02:32.391361+0000","last_peered":"2024-05-07T14:02:32.391361+0000","last_clean":"2024-05-07T14:02:32.391361+0000","last_became_active":"2024-05-07T14:01:06.013281+0000","last_became_peered":"2024-05-07T14:01:06.013281+0000","last_unstale":"2024-05-07T14:02:32.391361+0000","last_undegraded":"2024-05-07T14:02:32.391361+0000","last_fullsized":"2024-05-07T14:02:32.391361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:46.349394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355642+0000","last_change":"2024-05-07T14:00:58.001752+0000","last_active":"2024-05-07T14:02:32.355642+0000","last_peered":"2024-05-07T14:02:32.355642+0000","last_clean":"2024-05-07T14:02:32.355642+0000","last_became_active":"2024-05-07T14:00:57.999982+0000","last_became_peered":"2024-05-07T14:00:57.999982+0000","last_unstale":"2024-05-07T14:02:32.355642+0000","last_undegraded":"2024-05-07T14:02:32.355642+0000","last_fullsized":"2024-05-07T14:02:32.355642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640857+0000","last_change":"2024-05-07T14:00:55.968287+0000","last_active":"2024-05-07T14:02:31.640857+0000","last_peered":"2024-05-07T14:02:31.640857+0000","last_clean":"2024-05-07T14:02:31.640857+0000","last_became_active":"2024-05-07T14:00:55.967578+0000","last_became_peered":"2024-05-07T14:00:55.967578+0000","last_unstale":"2024-05-07T14:02:31.640857+0000","last_undegraded":"2024-05-07T14:02:31.640857+0000","last_fullsized":"2024-05-07T14:02:31.640857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392255+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:02:32.392255+0000","last_peered":"2024-05-07T14:02:32.392255+0000","last_clean":"2024-05-07T14:02:32.392255+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:02:32.392255+0000","last_undegraded":"2024-05-07T14:02:32.392255+0000","last_fullsized":"2024-05-07T14:02:32.392255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"46'5","reported_seq":98,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409638+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:02:32.409638+0000","last_peered":"2024-05-07T14:02:32.409638+0000","last_clean":"2024-05-07T14:02:32.409638+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:02:32.409638+0000","last_undegraded":"2024-05-07T14:02:32.409638+0000","last_fullsized":"2024-05-07T14:02:32.409638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639595+0000","last_change":"2024-05-07T14:01:04.012628+0000","last_active":"2024-05-07T14:02:31.639595+0000","last_peered":"2024-05-07T14:02:31.639595+0000","last_clean":"2024-05-07T14:02:31.639595+0000","last_became_active":"2024-05-07T14:01:04.011910+0000","last_became_peered":"2024-05-07T14:01:04.011910+0000","last_unstale":"2024-05-07T14:02:31.639595+0000","last_undegraded":"2024-05-07T14:02:31.639595+0000","last_fullsized":"2024-05-07T14:02:31.639595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410530+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:02:32.410530+0000","last_peered":"2024-05-07T14:02:32.410530+0000","last_clean":"2024-05-07T14:02:32.410530+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:02:32.410530+0000","last_undegraded":"2024-05-07T14:02:32.410530+0000","last_fullsized":"2024-05-07T14:02:32.410530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390541+0000","last_change":"2024-05-07T14:00:57.999019+0000","last_active":"2024-05-07T14:02:32.390541+0000","last_peered":"2024-05-07T14:02:32.390541+0000","last_clean":"2024-05-07T14:02:32.390541+0000","last_became_active":"2024-05-07T14:00:57.998526+0000","last_became_peered":"2024-05-07T14:00:57.998526+0000","last_unstale":"2024-05-07T14:02:32.390541+0000","last_undegraded":"2024-05-07T14:02:32.390541+0000","last_fullsized":"2024-05-07T14:02:32.390541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255566+0000","last_change":"2024-05-07T14:00:55.999548+0000","last_active":"2024-05-07T14:02:32.255566+0000","last_peered":"2024-05-07T14:02:32.255566+0000","last_clean":"2024-05-07T14:02:32.255566+0000","last_became_active":"2024-05-07T14:00:55.995284+0000","last_became_peered":"2024-05-07T14:00:55.995284+0000","last_unstale":"2024-05-07T14:02:32.255566+0000","last_undegraded":"2024-05-07T14:02:32.255566+0000","last_fullsized":"2024-05-07T14:02:32.255566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639182+0000","last_change":"2024-05-07T14:00:59.996971+0000","last_active":"2024-05-07T14:02:31.639182+0000","last_peered":"2024-05-07T14:02:31.639182+0000","last_clean":"2024-05-07T14:02:31.639182+0000","last_became_active":"2024-05-07T14:00:59.996254+0000","last_became_peered":"2024-05-07T14:00:59.996254+0000","last_unstale":"2024-05-07T14:02:31.639182+0000","last_undegraded":"2024-05-07T14:02:31.639182+0000","last_fullsized":"2024-05-07T14:02:31.639182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392101+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:02:32.392101+0000","last_peered":"2024-05-07T14:02:32.392101+0000","last_clean":"2024-05-07T14:02:32.392101+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:02:32.392101+0000","last_undegraded":"2024-05-07T14:02:32.392101+0000","last_fullsized":"2024-05-07T14:02:32.392101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004389+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:02:32.004389+0000","last_peered":"2024-05-07T14:02:32.004389+0000","last_clean":"2024-05-07T14:02:32.004389+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:02:32.004389+0000","last_undegraded":"2024-05-07T14:02:32.004389+0000","last_fullsized":"2024-05-07T14:02:32.004389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256988+0000","last_change":"2024-05-07T14:01:06.038138+0000","last_active":"2024-05-07T14:02:32.256988+0000","last_peered":"2024-05-07T14:02:32.256988+0000","last_clean":"2024-05-07T14:02:32.256988+0000","last_became_active":"2024-05-07T14:01:06.030966+0000","last_became_peered":"2024-05-07T14:01:06.030966+0000","last_unstale":"2024-05-07T14:02:32.256988+0000","last_undegraded":"2024-05-07T14:02:32.256988+0000","last_fullsized":"2024-05-07T14:02:32.256988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391039+0000","last_change":"2024-05-07T14:00:57.987879+0000","last_active":"2024-05-07T14:02:32.391039+0000","last_peered":"2024-05-07T14:02:32.391039+0000","last_clean":"2024-05-07T14:02:32.391039+0000","last_became_active":"2024-05-07T14:00:57.987544+0000","last_became_peered":"2024-05-07T14:00:57.987544+0000","last_unstale":"2024-05-07T14:02:32.391039+0000","last_undegraded":"2024-05-07T14:02:32.391039+0000","last_fullsized":"2024-05-07T14:02:32.391039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":53,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.643382+0000","last_change":"2024-05-07T14:01:37.318408+0000","last_active":"2024-05-07T14:02:31.643382+0000","last_peered":"2024-05-07T14:02:31.643382+0000","last_clean":"2024-05-07T14:02:31.643382+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:02:31.643382+0000","last_undegraded":"2024-05-07T14:02:31.643382+0000","last_fullsized":"2024-05-07T14:02:31.643382+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:43.643434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004141+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:02:32.004141+0000","last_peered":"2024-05-07T14:02:32.004141+0000","last_clean":"2024-05-07T14:02:32.004141+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:02:32.004141+0000","last_undegraded":"2024-05-07T14:02:32.004141+0000","last_fullsized":"2024-05-07T14:02:32.004141+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639461+0000","last_change":"2024-05-07T14:01:01.995377+0000","last_active":"2024-05-07T14:02:31.639461+0000","last_peered":"2024-05-07T14:02:31.639461+0000","last_clean":"2024-05-07T14:02:31.639461+0000","last_became_active":"2024-05-07T14:01:01.994566+0000","last_became_peered":"2024-05-07T14:01:01.994566+0000","last_unstale":"2024-05-07T14:02:31.639461+0000","last_undegraded":"2024-05-07T14:02:31.639461+0000","last_fullsized":"2024-05-07T14:02:31.639461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409159+0000","last_change":"2024-05-07T14:01:03.997116+0000","last_active":"2024-05-07T14:02:32.409159+0000","last_peered":"2024-05-07T14:02:32.409159+0000","last_clean":"2024-05-07T14:02:32.409159+0000","last_became_active":"2024-05-07T14:01:03.996555+0000","last_became_peered":"2024-05-07T14:01:03.996555+0000","last_unstale":"2024-05-07T14:02:32.409159+0000","last_undegraded":"2024-05-07T14:02:32.409159+0000","last_fullsized":"2024-05-07T14:02:32.409159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004797+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:02:32.004797+0000","last_peered":"2024-05-07T14:02:32.004797+0000","last_clean":"2024-05-07T14:02:32.004797+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:02:32.004797+0000","last_undegraded":"2024-05-07T14:02:32.004797+0000","last_fullsized":"2024-05-07T14:02:32.004797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391560+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:02:32.391560+0000","last_peered":"2024-05-07T14:02:32.391560+0000","last_clean":"2024-05-07T14:02:32.391560+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:02:32.391560+0000","last_undegraded":"2024-05-07T14:02:32.391560+0000","last_fullsized":"2024-05-07T14:02:32.391560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411078+0000","last_change":"2024-05-07T14:00:59.995694+0000","last_active":"2024-05-07T14:02:32.411078+0000","last_peered":"2024-05-07T14:02:32.411078+0000","last_clean":"2024-05-07T14:02:32.411078+0000","last_became_active":"2024-05-07T14:00:59.993899+0000","last_became_peered":"2024-05-07T14:00:59.993899+0000","last_unstale":"2024-05-07T14:02:32.411078+0000","last_undegraded":"2024-05-07T14:02:32.411078+0000","last_fullsized":"2024-05-07T14:02:32.411078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:28.225348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'12","reported_seq":114,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356788+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:02:32.356788+0000","last_peered":"2024-05-07T14:02:32.356788+0000","last_clean":"2024-05-07T14:02:32.356788+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:02:32.356788+0000","last_undegraded":"2024-05-07T14:02:32.356788+0000","last_fullsized":"2024-05-07T14:02:32.356788+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257183+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:02:32.257183+0000","last_peered":"2024-05-07T14:02:32.257183+0000","last_clean":"2024-05-07T14:02:32.257183+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:02:32.257183+0000","last_undegraded":"2024-05-07T14:02:32.257183+0000","last_fullsized":"2024-05-07T14:02:32.257183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391893+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:02:32.391893+0000","last_peered":"2024-05-07T14:02:32.391893+0000","last_clean":"2024-05-07T14:02:32.391893+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:02:32.391893+0000","last_undegraded":"2024-05-07T14:02:32.391893+0000","last_fullsized":"2024-05-07T14:02:32.391893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.411199+0000","last_change":"2024-05-07T14:00:57.995989+0000","last_active":"2024-05-07T14:02:32.411199+0000","last_peered":"2024-05-07T14:02:32.411199+0000","last_clean":"2024-05-07T14:02:32.411199+0000","last_became_active":"2024-05-07T14:00:57.995721+0000","last_became_peered":"2024-05-07T14:00:57.995721+0000","last_unstale":"2024-05-07T14:02:32.411199+0000","last_undegraded":"2024-05-07T14:02:32.411199+0000","last_fullsized":"2024-05-07T14:02:32.411199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355551+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:02:32.355551+0000","last_peered":"2024-05-07T14:02:32.355551+0000","last_clean":"2024-05-07T14:02:32.355551+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:02:32.355551+0000","last_undegraded":"2024-05-07T14:02:32.355551+0000","last_fullsized":"2024-05-07T14:02:32.355551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004702+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:02:32.004702+0000","last_peered":"2024-05-07T14:02:32.004702+0000","last_clean":"2024-05-07T14:02:32.004702+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:02:32.004702+0000","last_undegraded":"2024-05-07T14:02:32.004702+0000","last_fullsized":"2024-05-07T14:02:32.004702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"33'15","reported_seq":117,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639868+0000","last_change":"2024-05-07T14:01:02.002384+0000","last_active":"2024-05-07T14:02:31.639868+0000","last_peered":"2024-05-07T14:02:31.639868+0000","last_clean":"2024-05-07T14:02:31.639868+0000","last_became_active":"2024-05-07T14:01:02.001676+0000","last_became_peered":"2024-05-07T14:01:02.001676+0000","last_unstale":"2024-05-07T14:02:31.639868+0000","last_undegraded":"2024-05-07T14:02:31.639868+0000","last_fullsized":"2024-05-07T14:02:31.639868+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.354935+0000","last_change":"2024-05-07T14:01:04.015893+0000","last_active":"2024-05-07T14:02:32.354935+0000","last_peered":"2024-05-07T14:02:32.354935+0000","last_clean":"2024-05-07T14:02:32.354935+0000","last_became_active":"2024-05-07T14:01:04.015329+0000","last_became_peered":"2024-05-07T14:01:04.015329+0000","last_unstale":"2024-05-07T14:02:32.354935+0000","last_undegraded":"2024-05-07T14:02:32.354935+0000","last_fullsized":"2024-05-07T14:02:32.354935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:53.413495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004057+0000","last_change":"2024-05-07T14:01:06.025917+0000","last_active":"2024-05-07T14:02:32.004057+0000","last_peered":"2024-05-07T14:02:32.004057+0000","last_clean":"2024-05-07T14:02:32.004057+0000","last_became_active":"2024-05-07T14:01:06.025044+0000","last_became_peered":"2024-05-07T14:01:06.025044+0000","last_unstale":"2024-05-07T14:02:32.004057+0000","last_undegraded":"2024-05-07T14:02:32.004057+0000","last_fullsized":"2024-05-07T14:02:32.004057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:55.419668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391344+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:02:32.391344+0000","last_peered":"2024-05-07T14:02:32.391344+0000","last_clean":"2024-05-07T14:02:32.391344+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:02:32.391344+0000","last_undegraded":"2024-05-07T14:02:32.391344+0000","last_fullsized":"2024-05-07T14:02:32.391344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635813+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:02:31.635813+0000","last_peered":"2024-05-07T14:02:31.635813+0000","last_clean":"2024-05-07T14:02:31.635813+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:02:31.635813+0000","last_undegraded":"2024-05-07T14:02:31.635813+0000","last_fullsized":"2024-05-07T14:02:31.635813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636179+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:02:31.636179+0000","last_peered":"2024-05-07T14:02:31.636179+0000","last_clean":"2024-05-07T14:02:31.636179+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:02:31.636179+0000","last_undegraded":"2024-05-07T14:02:31.636179+0000","last_fullsized":"2024-05-07T14:02:31.636179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"33'11","reported_seq":111,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392289+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:02:32.392289+0000","last_peered":"2024-05-07T14:02:32.392289+0000","last_clean":"2024-05-07T14:02:32.392289+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:02:32.392289+0000","last_undegraded":"2024-05-07T14:02:32.392289+0000","last_fullsized":"2024-05-07T14:02:32.392289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356057+0000","last_change":"2024-05-07T14:01:04.026470+0000","last_active":"2024-05-07T14:02:32.356057+0000","last_peered":"2024-05-07T14:02:32.356057+0000","last_clean":"2024-05-07T14:02:32.356057+0000","last_became_active":"2024-05-07T14:01:04.025881+0000","last_became_peered":"2024-05-07T14:01:04.025881+0000","last_unstale":"2024-05-07T14:02:32.356057+0000","last_undegraded":"2024-05-07T14:02:32.356057+0000","last_fullsized":"2024-05-07T14:02:32.356057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:54.595283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256529+0000","last_change":"2024-05-07T14:01:06.038979+0000","last_active":"2024-05-07T14:02:32.256529+0000","last_peered":"2024-05-07T14:02:32.256529+0000","last_clean":"2024-05-07T14:02:32.256529+0000","last_became_active":"2024-05-07T14:01:06.035737+0000","last_became_peered":"2024-05-07T14:01:06.035737+0000","last_unstale":"2024-05-07T14:02:32.256529+0000","last_undegraded":"2024-05-07T14:02:32.256529+0000","last_fullsized":"2024-05-07T14:02:32.256529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.643372+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:02:31.643372+0000","last_peered":"2024-05-07T14:02:31.643372+0000","last_clean":"2024-05-07T14:02:31.643372+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:02:31.643372+0000","last_undegraded":"2024-05-07T14:02:31.643372+0000","last_fullsized":"2024-05-07T14:02:31.643372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409055+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:02:32.409055+0000","last_peered":"2024-05-07T14:02:32.409055+0000","last_clean":"2024-05-07T14:02:32.409055+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:02:32.409055+0000","last_undegraded":"2024-05-07T14:02:32.409055+0000","last_fullsized":"2024-05-07T14:02:32.409055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.357057+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:02:32.357057+0000","last_peered":"2024-05-07T14:02:32.357057+0000","last_clean":"2024-05-07T14:02:32.357057+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:02:32.357057+0000","last_undegraded":"2024-05-07T14:02:32.357057+0000","last_fullsized":"2024-05-07T14:02:32.357057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636288+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:02:31.636288+0000","last_peered":"2024-05-07T14:02:31.636288+0000","last_clean":"2024-05-07T14:02:31.636288+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:02:31.636288+0000","last_undegraded":"2024-05-07T14:02:31.636288+0000","last_fullsized":"2024-05-07T14:02:31.636288+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"30'2","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004327+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:02:32.004327+0000","last_peered":"2024-05-07T14:02:32.004327+0000","last_clean":"2024-05-07T14:02:32.004327+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:02:32.004327+0000","last_undegraded":"2024-05-07T14:02:32.004327+0000","last_fullsized":"2024-05-07T14:02:32.004327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639186+0000","last_change":"2024-05-07T14:01:06.037755+0000","last_active":"2024-05-07T14:02:31.639186+0000","last_peered":"2024-05-07T14:02:31.639186+0000","last_clean":"2024-05-07T14:02:31.639186+0000","last_became_active":"2024-05-07T14:01:06.037156+0000","last_became_peered":"2024-05-07T14:01:06.037156+0000","last_unstale":"2024-05-07T14:02:31.639186+0000","last_undegraded":"2024-05-07T14:02:31.639186+0000","last_fullsized":"2024-05-07T14:02:31.639186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:30.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635286+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:02:31.635286+0000","last_peered":"2024-05-07T14:02:31.635286+0000","last_clean":"2024-05-07T14:02:31.635286+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:02:31.635286+0000","last_undegraded":"2024-05-07T14:02:31.635286+0000","last_fullsized":"2024-05-07T14:02:31.635286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255491+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:02:32.255491+0000","last_peered":"2024-05-07T14:02:32.255491+0000","last_clean":"2024-05-07T14:02:32.255491+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:02:32.255491+0000","last_undegraded":"2024-05-07T14:02:32.255491+0000","last_fullsized":"2024-05-07T14:02:32.255491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639575+0000","last_change":"2024-05-07T14:00:59.998197+0000","last_active":"2024-05-07T14:02:31.639575+0000","last_peered":"2024-05-07T14:02:31.639575+0000","last_clean":"2024-05-07T14:02:31.639575+0000","last_became_active":"2024-05-07T14:00:59.997438+0000","last_became_peered":"2024-05-07T14:00:59.997438+0000","last_unstale":"2024-05-07T14:02:31.639575+0000","last_undegraded":"2024-05-07T14:02:31.639575+0000","last_fullsized":"2024-05-07T14:02:31.639575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:29.430229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"33'15","reported_seq":117,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256971+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:02:32.256971+0000","last_peered":"2024-05-07T14:02:32.256971+0000","last_clean":"2024-05-07T14:02:32.256971+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:02:32.256971+0000","last_undegraded":"2024-05-07T14:02:32.256971+0000","last_fullsized":"2024-05-07T14:02:32.256971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408640+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:02:32.408640+0000","last_peered":"2024-05-07T14:02:32.408640+0000","last_clean":"2024-05-07T14:02:32.408640+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:02:32.408640+0000","last_undegraded":"2024-05-07T14:02:32.408640+0000","last_fullsized":"2024-05-07T14:02:32.408640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.641050+0000","last_change":"2024-05-07T14:01:06.025913+0000","last_active":"2024-05-07T14:02:31.641050+0000","last_peered":"2024-05-07T14:02:31.641050+0000","last_clean":"2024-05-07T14:02:31.641050+0000","last_became_active":"2024-05-07T14:01:06.025220+0000","last_became_peered":"2024-05-07T14:01:06.025220+0000","last_unstale":"2024-05-07T14:02:31.641050+0000","last_undegraded":"2024-05-07T14:02:31.641050+0000","last_fullsized":"2024-05-07T14:02:31.641050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:30.164745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635545+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:02:31.635545+0000","last_peered":"2024-05-07T14:02:31.635545+0000","last_clean":"2024-05-07T14:02:31.635545+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:02:31.635545+0000","last_undegraded":"2024-05-07T14:02:31.635545+0000","last_fullsized":"2024-05-07T14:02:31.635545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255764+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:02:32.255764+0000","last_peered":"2024-05-07T14:02:32.255764+0000","last_clean":"2024-05-07T14:02:32.255764+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:02:32.255764+0000","last_undegraded":"2024-05-07T14:02:32.255764+0000","last_fullsized":"2024-05-07T14:02:32.255764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256617+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:02:32.256617+0000","last_peered":"2024-05-07T14:02:32.256617+0000","last_clean":"2024-05-07T14:02:32.256617+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:02:32.256617+0000","last_undegraded":"2024-05-07T14:02:32.256617+0000","last_fullsized":"2024-05-07T14:02:32.256617+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"33'9","reported_seq":107,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409396+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:02:32.409396+0000","last_peered":"2024-05-07T14:02:32.409396+0000","last_clean":"2024-05-07T14:02:32.409396+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:02:32.409396+0000","last_undegraded":"2024-05-07T14:02:32.409396+0000","last_fullsized":"2024-05-07T14:02:32.409396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.003924+0000","last_change":"2024-05-07T14:01:04.017099+0000","last_active":"2024-05-07T14:02:32.003924+0000","last_peered":"2024-05-07T14:02:32.003924+0000","last_clean":"2024-05-07T14:02:32.003924+0000","last_became_active":"2024-05-07T14:01:04.011036+0000","last_became_peered":"2024-05-07T14:01:04.011036+0000","last_unstale":"2024-05-07T14:02:32.003924+0000","last_undegraded":"2024-05-07T14:02:32.003924+0000","last_fullsized":"2024-05-07T14:02:32.003924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:32.242974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391463+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:02:32.391463+0000","last_peered":"2024-05-07T14:02:32.391463+0000","last_clean":"2024-05-07T14:02:32.391463+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:02:32.391463+0000","last_undegraded":"2024-05-07T14:02:32.391463+0000","last_fullsized":"2024-05-07T14:02:32.391463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390658+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:02:32.390658+0000","last_peered":"2024-05-07T14:02:32.390658+0000","last_clean":"2024-05-07T14:02:32.390658+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:02:32.390658+0000","last_undegraded":"2024-05-07T14:02:32.390658+0000","last_fullsized":"2024-05-07T14:02:32.390658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392679+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:02:32.392679+0000","last_peered":"2024-05-07T14:02:32.392679+0000","last_clean":"2024-05-07T14:02:32.392679+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:02:32.392679+0000","last_undegraded":"2024-05-07T14:02:32.392679+0000","last_fullsized":"2024-05-07T14:02:32.392679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634663+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:02:31.634663+0000","last_peered":"2024-05-07T14:02:31.634663+0000","last_clean":"2024-05-07T14:02:31.634663+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:02:31.634663+0000","last_undegraded":"2024-05-07T14:02:31.634663+0000","last_fullsized":"2024-05-07T14:02:31.634663+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"33'5","reported_seq":102,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392628+0000","last_change":"2024-05-07T14:01:02.013617+0000","last_active":"2024-05-07T14:02:32.392628+0000","last_peered":"2024-05-07T14:02:32.392628+0000","last_clean":"2024-05-07T14:02:32.392628+0000","last_became_active":"2024-05-07T14:01:02.009243+0000","last_became_peered":"2024-05-07T14:01:02.009243+0000","last_unstale":"2024-05-07T14:02:32.392628+0000","last_undegraded":"2024-05-07T14:02:32.392628+0000","last_fullsized":"2024-05-07T14:02:32.392628+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635072+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:02:31.635072+0000","last_peered":"2024-05-07T14:02:31.635072+0000","last_clean":"2024-05-07T14:02:31.635072+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:02:31.635072+0000","last_undegraded":"2024-05-07T14:02:31.635072+0000","last_fullsized":"2024-05-07T14:02:31.635072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640526+0000","last_change":"2024-05-07T14:01:06.023907+0000","last_active":"2024-05-07T14:02:31.640526+0000","last_peered":"2024-05-07T14:02:31.640526+0000","last_clean":"2024-05-07T14:02:31.640526+0000","last_became_active":"2024-05-07T14:01:06.023307+0000","last_became_peered":"2024-05-07T14:01:06.023307+0000","last_unstale":"2024-05-07T14:02:31.640526+0000","last_undegraded":"2024-05-07T14:02:31.640526+0000","last_fullsized":"2024-05-07T14:02:31.640526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:41.916580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.634967+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:02:31.634967+0000","last_peered":"2024-05-07T14:02:31.634967+0000","last_clean":"2024-05-07T14:02:31.634967+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:02:31.634967+0000","last_undegraded":"2024-05-07T14:02:31.634967+0000","last_fullsized":"2024-05-07T14:02:31.634967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410774+0000","last_change":"2024-05-07T14:01:37.554242+0000","last_active":"2024-05-07T14:02:32.410774+0000","last_peered":"2024-05-07T14:02:32.410774+0000","last_clean":"2024-05-07T14:02:32.410774+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:02:32.410774+0000","last_undegraded":"2024-05-07T14:02:32.410774+0000","last_fullsized":"2024-05-07T14:02:32.410774+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:16:22.149514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":96,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.355222+0000","last_change":"2024-05-07T14:00:59.998767+0000","last_active":"2024-05-07T14:02:32.355222+0000","last_peered":"2024-05-07T14:02:32.355222+0000","last_clean":"2024-05-07T14:02:32.355222+0000","last_became_active":"2024-05-07T14:00:59.998055+0000","last_became_peered":"2024-05-07T14:00:59.998055+0000","last_unstale":"2024-05-07T14:02:32.355222+0000","last_undegraded":"2024-05-07T14:02:32.355222+0000","last_fullsized":"2024-05-07T14:02:32.355222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:41.593806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'9","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635100+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:02:31.635100+0000","last_peered":"2024-05-07T14:02:31.635100+0000","last_clean":"2024-05-07T14:02:31.635100+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:02:31.635100+0000","last_undegraded":"2024-05-07T14:02:31.635100+0000","last_fullsized":"2024-05-07T14:02:31.635100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409187+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:02:32.409187+0000","last_peered":"2024-05-07T14:02:32.409187+0000","last_clean":"2024-05-07T14:02:32.409187+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:02:32.409187+0000","last_undegraded":"2024-05-07T14:02:32.409187+0000","last_fullsized":"2024-05-07T14:02:32.409187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":84,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636266+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:02:31.636266+0000","last_peered":"2024-05-07T14:02:31.636266+0000","last_clean":"2024-05-07T14:02:31.636266+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:02:31.636266+0000","last_undegraded":"2024-05-07T14:02:31.636266+0000","last_fullsized":"2024-05-07T14:02:31.636266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356276+0000","last_change":"2024-05-07T14:00:58.005276+0000","last_active":"2024-05-07T14:02:32.356276+0000","last_peered":"2024-05-07T14:02:32.356276+0000","last_clean":"2024-05-07T14:02:32.356276+0000","last_became_active":"2024-05-07T14:00:58.004903+0000","last_became_peered":"2024-05-07T14:00:58.004903+0000","last_unstale":"2024-05-07T14:02:32.356276+0000","last_undegraded":"2024-05-07T14:02:32.356276+0000","last_fullsized":"2024-05-07T14:02:32.356276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.005040+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:02:32.005040+0000","last_peered":"2024-05-07T14:02:32.005040+0000","last_clean":"2024-05-07T14:02:32.005040+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:02:32.005040+0000","last_undegraded":"2024-05-07T14:02:32.005040+0000","last_fullsized":"2024-05-07T14:02:32.005040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356008+0000","last_change":"2024-05-07T14:00:57.986882+0000","last_active":"2024-05-07T14:02:32.356008+0000","last_peered":"2024-05-07T14:02:32.356008+0000","last_clean":"2024-05-07T14:02:32.356008+0000","last_became_active":"2024-05-07T14:00:57.984867+0000","last_became_peered":"2024-05-07T14:00:57.984867+0000","last_unstale":"2024-05-07T14:02:32.356008+0000","last_undegraded":"2024-05-07T14:02:32.356008+0000","last_fullsized":"2024-05-07T14:02:32.356008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":108,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.638086+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:02:31.638086+0000","last_peered":"2024-05-07T14:02:31.638086+0000","last_clean":"2024-05-07T14:02:31.638086+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:02:31.638086+0000","last_undegraded":"2024-05-07T14:02:31.638086+0000","last_fullsized":"2024-05-07T14:02:31.638086+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:01.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257588+0000","last_change":"2024-05-07T14:00:57.985233+0000","last_active":"2024-05-07T14:02:32.257588+0000","last_peered":"2024-05-07T14:02:32.257588+0000","last_clean":"2024-05-07T14:02:32.257588+0000","last_became_active":"2024-05-07T14:00:57.984523+0000","last_became_peered":"2024-05-07T14:00:57.984523+0000","last_unstale":"2024-05-07T14:02:32.257588+0000","last_undegraded":"2024-05-07T14:02:32.257588+0000","last_fullsized":"2024-05-07T14:02:32.257588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.256637+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:02:32.256637+0000","last_peered":"2024-05-07T14:02:32.256637+0000","last_clean":"2024-05-07T14:02:32.256637+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:02:32.256637+0000","last_undegraded":"2024-05-07T14:02:32.256637+0000","last_fullsized":"2024-05-07T14:02:32.256637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.356567+0000","last_change":"2024-05-07T14:00:57.989787+0000","last_active":"2024-05-07T14:02:32.356567+0000","last_peered":"2024-05-07T14:02:32.356567+0000","last_clean":"2024-05-07T14:02:32.356567+0000","last_became_active":"2024-05-07T14:00:57.989498+0000","last_became_peered":"2024-05-07T14:00:57.989498+0000","last_unstale":"2024-05-07T14:02:32.356567+0000","last_undegraded":"2024-05-07T14:02:32.356567+0000","last_fullsized":"2024-05-07T14:02:32.356567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409741+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:02:32.409741+0000","last_peered":"2024-05-07T14:02:32.409741+0000","last_clean":"2024-05-07T14:02:32.409741+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:02:32.409741+0000","last_undegraded":"2024-05-07T14:02:32.409741+0000","last_fullsized":"2024-05-07T14:02:32.409741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.392468+0000","last_change":"2024-05-07T14:00:57.998054+0000","last_active":"2024-05-07T14:02:32.392468+0000","last_peered":"2024-05-07T14:02:32.392468+0000","last_clean":"2024-05-07T14:02:32.392468+0000","last_became_active":"2024-05-07T14:00:57.997750+0000","last_became_peered":"2024-05-07T14:00:57.997750+0000","last_unstale":"2024-05-07T14:02:32.392468+0000","last_undegraded":"2024-05-07T14:02:32.392468+0000","last_fullsized":"2024-05-07T14:02:32.392468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390873+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:02:32.390873+0000","last_peered":"2024-05-07T14:02:32.390873+0000","last_clean":"2024-05-07T14:02:32.390873+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:02:32.390873+0000","last_undegraded":"2024-05-07T14:02:32.390873+0000","last_fullsized":"2024-05-07T14:02:32.390873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.635807+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:02:31.635807+0000","last_peered":"2024-05-07T14:02:31.635807+0000","last_clean":"2024-05-07T14:02:31.635807+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:02:31.635807+0000","last_undegraded":"2024-05-07T14:02:31.635807+0000","last_fullsized":"2024-05-07T14:02:31.635807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.357223+0000","last_change":"2024-05-07T14:00:55.974072+0000","last_active":"2024-05-07T14:02:32.357223+0000","last_peered":"2024-05-07T14:02:32.357223+0000","last_clean":"2024-05-07T14:02:32.357223+0000","last_became_active":"2024-05-07T14:00:55.973647+0000","last_became_peered":"2024-05-07T14:00:55.973647+0000","last_unstale":"2024-05-07T14:02:32.357223+0000","last_undegraded":"2024-05-07T14:02:32.357223+0000","last_fullsized":"2024-05-07T14:02:32.357223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390463+0000","last_change":"2024-05-07T14:00:57.988167+0000","last_active":"2024-05-07T14:02:32.390463+0000","last_peered":"2024-05-07T14:02:32.390463+0000","last_clean":"2024-05-07T14:02:32.390463+0000","last_became_active":"2024-05-07T14:00:57.987884+0000","last_became_peered":"2024-05-07T14:00:57.987884+0000","last_unstale":"2024-05-07T14:02:32.390463+0000","last_undegraded":"2024-05-07T14:02:32.390463+0000","last_fullsized":"2024-05-07T14:02:32.390463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.003566+0000","last_change":"2024-05-07T14:00:55.997287+0000","last_active":"2024-05-07T14:02:32.003566+0000","last_peered":"2024-05-07T14:02:32.003566+0000","last_clean":"2024-05-07T14:02:32.003566+0000","last_became_active":"2024-05-07T14:00:55.996467+0000","last_became_peered":"2024-05-07T14:00:55.996467+0000","last_unstale":"2024-05-07T14:02:32.003566+0000","last_undegraded":"2024-05-07T14:02:32.003566+0000","last_fullsized":"2024-05-07T14:02:32.003566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.004844+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:02:32.004844+0000","last_peered":"2024-05-07T14:02:32.004844+0000","last_clean":"2024-05-07T14:02:32.004844+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:02:32.004844+0000","last_undegraded":"2024-05-07T14:02:32.004844+0000","last_fullsized":"2024-05-07T14:02:32.004844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.391794+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:02:32.391794+0000","last_peered":"2024-05-07T14:02:32.391794+0000","last_clean":"2024-05-07T14:02:32.391794+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:02:32.391794+0000","last_undegraded":"2024-05-07T14:02:32.391794+0000","last_fullsized":"2024-05-07T14:02:32.391794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410693+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:02:32.410693+0000","last_peered":"2024-05-07T14:02:32.410693+0000","last_clean":"2024-05-07T14:02:32.410693+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:02:32.410693+0000","last_undegraded":"2024-05-07T14:02:32.410693+0000","last_fullsized":"2024-05-07T14:02:32.410693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.258176+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:02:32.258176+0000","last_peered":"2024-05-07T14:02:32.258176+0000","last_clean":"2024-05-07T14:02:32.258176+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:02:32.258176+0000","last_undegraded":"2024-05-07T14:02:32.258176+0000","last_fullsized":"2024-05-07T14:02:32.258176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636229+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:02:31.636229+0000","last_peered":"2024-05-07T14:02:31.636229+0000","last_clean":"2024-05-07T14:02:31.636229+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:02:31.636229+0000","last_undegraded":"2024-05-07T14:02:31.636229+0000","last_fullsized":"2024-05-07T14:02:31.636229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.389986+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:02:32.389986+0000","last_peered":"2024-05-07T14:02:32.389986+0000","last_clean":"2024-05-07T14:02:32.389986+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:02:32.389986+0000","last_undegraded":"2024-05-07T14:02:32.389986+0000","last_fullsized":"2024-05-07T14:02:32.389986+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.643479+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:02:31.643479+0000","last_peered":"2024-05-07T14:02:31.643479+0000","last_clean":"2024-05-07T14:02:31.643479+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:02:31.643479+0000","last_undegraded":"2024-05-07T14:02:31.643479+0000","last_fullsized":"2024-05-07T14:02:31.643479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255516+0000","last_change":"2024-05-07T14:00:56.001135+0000","last_active":"2024-05-07T14:02:32.255516+0000","last_peered":"2024-05-07T14:02:32.255516+0000","last_clean":"2024-05-07T14:02:32.255516+0000","last_became_active":"2024-05-07T14:00:55.999884+0000","last_became_peered":"2024-05-07T14:00:55.999884+0000","last_unstale":"2024-05-07T14:02:32.255516+0000","last_undegraded":"2024-05-07T14:02:32.255516+0000","last_fullsized":"2024-05-07T14:02:32.255516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.636001+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:02:31.636001+0000","last_peered":"2024-05-07T14:02:31.636001+0000","last_clean":"2024-05-07T14:02:31.636001+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:02:31.636001+0000","last_undegraded":"2024-05-07T14:02:31.636001+0000","last_fullsized":"2024-05-07T14:02:31.636001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.408963+0000","last_change":"2024-05-07T14:00:55.989670+0000","last_active":"2024-05-07T14:02:32.408963+0000","last_peered":"2024-05-07T14:02:32.408963+0000","last_clean":"2024-05-07T14:02:32.408963+0000","last_became_active":"2024-05-07T14:00:55.989455+0000","last_became_peered":"2024-05-07T14:00:55.989455+0000","last_unstale":"2024-05-07T14:02:32.408963+0000","last_undegraded":"2024-05-07T14:02:32.408963+0000","last_fullsized":"2024-05-07T14:02:32.408963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640060+0000","last_change":"2024-05-07T14:00:57.979022+0000","last_active":"2024-05-07T14:02:31.640060+0000","last_peered":"2024-05-07T14:02:31.640060+0000","last_clean":"2024-05-07T14:02:31.640060+0000","last_became_active":"2024-05-07T14:00:57.977403+0000","last_became_peered":"2024-05-07T14:00:57.977403+0000","last_unstale":"2024-05-07T14:02:31.640060+0000","last_undegraded":"2024-05-07T14:02:31.640060+0000","last_fullsized":"2024-05-07T14:02:31.640060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.003519+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:02:32.003519+0000","last_peered":"2024-05-07T14:02:32.003519+0000","last_clean":"2024-05-07T14:02:32.003519+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:02:32.003519+0000","last_undegraded":"2024-05-07T14:02:32.003519+0000","last_fullsized":"2024-05-07T14:02:32.003519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.409889+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:02:32.409889+0000","last_peered":"2024-05-07T14:02:32.409889+0000","last_clean":"2024-05-07T14:02:32.409889+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:02:32.409889+0000","last_undegraded":"2024-05-07T14:02:32.409889+0000","last_fullsized":"2024-05-07T14:02:32.409889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640998+0000","last_change":"2024-05-07T14:00:55.978771+0000","last_active":"2024-05-07T14:02:31.640998+0000","last_peered":"2024-05-07T14:02:31.640998+0000","last_clean":"2024-05-07T14:02:31.640998+0000","last_became_active":"2024-05-07T14:00:55.978000+0000","last_became_peered":"2024-05-07T14:00:55.978000+0000","last_unstale":"2024-05-07T14:02:31.640998+0000","last_undegraded":"2024-05-07T14:02:31.640998+0000","last_fullsized":"2024-05-07T14:02:31.640998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.390386+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:02:32.390386+0000","last_peered":"2024-05-07T14:02:32.390386+0000","last_clean":"2024-05-07T14:02:32.390386+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:02:32.390386+0000","last_undegraded":"2024-05-07T14:02:32.390386+0000","last_fullsized":"2024-05-07T14:02:32.390386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.640396+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:02:31.640396+0000","last_peered":"2024-05-07T14:02:31.640396+0000","last_clean":"2024-05-07T14:02:31.640396+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:02:31.640396+0000","last_undegraded":"2024-05-07T14:02:31.640396+0000","last_fullsized":"2024-05-07T14:02:31.640396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:31.639690+0000","last_change":"2024-05-07T14:00:57.979073+0000","last_active":"2024-05-07T14:02:31.639690+0000","last_peered":"2024-05-07T14:02:31.639690+0000","last_clean":"2024-05-07T14:02:31.639690+0000","last_became_active":"2024-05-07T14:00:57.978215+0000","last_became_peered":"2024-05-07T14:00:57.978215+0000","last_unstale":"2024-05-07T14:02:31.639690+0000","last_undegraded":"2024-05-07T14:02:31.639690+0000","last_fullsized":"2024-05-07T14:02:31.639690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.255516+0000","last_change":"2024-05-07T14:00:56.001199+0000","last_active":"2024-05-07T14:02:32.255516+0000","last_peered":"2024-05-07T14:02:32.255516+0000","last_clean":"2024-05-07T14:02:32.255516+0000","last_became_active":"2024-05-07T14:00:56.000434+0000","last_became_peered":"2024-05-07T14:00:56.000434+0000","last_unstale":"2024-05-07T14:02:32.255516+0000","last_undegraded":"2024-05-07T14:02:32.255516+0000","last_fullsized":"2024-05-07T14:02:32.255516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":104,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257933+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:02:32.257933+0000","last_peered":"2024-05-07T14:02:32.257933+0000","last_clean":"2024-05-07T14:02:32.257933+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:02:32.257933+0000","last_undegraded":"2024-05-07T14:02:32.257933+0000","last_fullsized":"2024-05-07T14:02:32.257933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":99,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.410692+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:02:32.410692+0000","last_peered":"2024-05-07T14:02:32.410692+0000","last_clean":"2024-05-07T14:02:32.410692+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:02:32.410692+0000","last_undegraded":"2024-05-07T14:02:32.410692+0000","last_fullsized":"2024-05-07T14:02:32.410692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":103,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.354818+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:02:32.354818+0000","last_peered":"2024-05-07T14:02:32.354818+0000","last_clean":"2024-05-07T14:02:32.354818+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:02:32.354818+0000","last_undegraded":"2024-05-07T14:02:32.354818+0000","last_fullsized":"2024-05-07T14:02:32.354818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":100,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-07T14:02:32.257944+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:02:32.257944+0000","last_peered":"2024-05-07T14:02:32.257944+0000","last_clean":"2024-05-07T14:02:32.257944+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:02:32.257944+0000","last_undegraded":"2024-05-07T14:02:32.257944+0000","last_fullsized":"2024-05-07T14:02:32.257944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1454080,"data_stored":1034318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":435445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":436273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":443781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":839680,"data_stored":435841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":443288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":444533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28416,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343424,"statfs":{"total":96636764160,"available":96607666176,"internally_reserved":0,"allocated":1425408,"data_stored":1026315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:02:35.062 INFO:tasks.thrashosds.thrasher:Setting 1.0 to [6, 3] 2024-05-07T14:02:35.062 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '1.0', '6', '3'] 2024-05-07T14:02:35.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 1.0 6 3 2024-05-07T14:02:35.105 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:35.117+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:35.141 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:35.142 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:35.142 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:35.142 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:35.155 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:02:35.162 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:02:35.245 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:35.257+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:35.307 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:35.317+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:35.311 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:35.311 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:35.332 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:02:35.365 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:35.366 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:35.396 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:35.397 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:35.409 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:35.421+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:35.426 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:35.426 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:35.457 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:35.457 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:35.490 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:35.491 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:35.509 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:35.521+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:35.523 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:35.524 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:35.536 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:35.537 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:35.551 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:02:35.556 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:35.556 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:35.574 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:35.575 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:35.610 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:35.621+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:35.666 INFO:teuthology.orchestra.run.smithi106.stderr:set 1.0 pg_upmap mapping to [6,3] 2024-05-07T14:02:35.690 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:35.690 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:35.704 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:02:35.710 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:35.721+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:35.812 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:35.821+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:35.869 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:35.869 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:35.883 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:02:35.913 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:35.925+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:36.005 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:36.005 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:36.013 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:36.025+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:36.019 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:02:36.114 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:36.125+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:36.181 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:36.182 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:36.196 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:36.214 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:36.225+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:36.316 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:36.329+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:36.361 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:36.362 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:36.375 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:36.417 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:36.429+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:36.518 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:36.529+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:36.539 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:36.539 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:36.553 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:36.618 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:36.629+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:36.677 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:36.678 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:36.690 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:02:36.696 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:36.719 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:36.729+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:36.820 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:36.833+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:36.868 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:36.868 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:36.882 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:36.922 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:36.933+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:37.024 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:37.037+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:37.056 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:37.056 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:37.070 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:37.160 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:37.173+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:37.225 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:37.237+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:37.238 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:37.238 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:37.252 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:37.325 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:37.337+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:37.413 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:37.413 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:37.427 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:02:37.461 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:37.437+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:37.527 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:37.537+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:37.551 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:37.551 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:37.565 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:02:37.593 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:02:37.653 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:37.665+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:37.681 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:02:37.737 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:37.738 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:37.738 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:37.749+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:37.757 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:02:37.789 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:37.790 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:37.808 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:37.809 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:37.825 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:37.826 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:37.829 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:37.841+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:37.841 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:37.842 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:37.872 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:37.872 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:37.893 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:37.893 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:37.915 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:37.915 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:37.930 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:37.941+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:37.935 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:37.935 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:37.960 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:37.960 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:37.960 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:37.973 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:02:38.064 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:38.077+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:38.131 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:38.132 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:38.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:38.132 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:38.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.132 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:129 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'87, mlcod=17'85)", 2024-05-07T14:02:38.132 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:38.132 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 111.84419323900001, 2024-05-07T14:02:38.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034674469999999998, 2024-05-07T14:02:38.132 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.132 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.132 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.132 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299075+0000", 2024-05-07T14:02:38.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.736e-06 2024-05-07T14:02:38.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299087+0000", 2024-05-07T14:02:38.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2067e-05 2024-05-07T14:02:38.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299122+0000", 2024-05-07T14:02:38.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4643e-05 2024-05-07T14:02:38.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299141+0000", 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9224000000000001e-05 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299323+0000", 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018190400000000001 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299385+0000", 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2126999999999997e-05 2024-05-07T14:02:38.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302462+0000", 2024-05-07T14:02:38.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030768330000000002 2024-05-07T14:02:38.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302541+0000", 2024-05-07T14:02:38.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8912999999999995e-05 2024-05-07T14:02:38.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.136 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.137 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:131 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'89, mlcod=17'85)", 2024-05-07T14:02:38.137 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:38.137 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 111.842860566, 2024-05-07T14:02:38.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038759010000000002, 2024-05-07T14:02:38.137 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.137 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.137 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.137 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:38.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:38.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300407+0000", 2024-05-07T14:02:38.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0299999999999998e-07 2024-05-07T14:02:38.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300577+0000", 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000170259 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300592+0000", 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4707e-05 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300601+0000", 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999995e-06 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301133+0000", 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053150199999999999 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301186+0000", 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.342e-05 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304217+0000", 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030307429999999998 2024-05-07T14:02:38.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304282+0000", 2024-05-07T14:02:38.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5316999999999998e-05 2024-05-07T14:02:38.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.141 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.141 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:132 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'90, mlcod=17'85)", 2024-05-07T14:02:38.141 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:38.141 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 111.84180847099999, 2024-05-07T14:02:38.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041397580000000003, 2024-05-07T14:02:38.142 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.142 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.142 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.142 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:38.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:38.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301459+0000", 2024-05-07T14:02:38.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.47e-07 2024-05-07T14:02:38.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301470+0000", 2024-05-07T14:02:38.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0933e-05 2024-05-07T14:02:38.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301483+0000", 2024-05-07T14:02:38.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2427e-05 2024-05-07T14:02:38.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301491+0000", 2024-05-07T14:02:38.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6130000000000004e-06 2024-05-07T14:02:38.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302683+0000", 2024-05-07T14:02:38.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011919980000000001 2024-05-07T14:02:38.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302741+0000", 2024-05-07T14:02:38.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7963000000000001e-05 2024-05-07T14:02:38.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305494+0000", 2024-05-07T14:02:38.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027531420000000001 2024-05-07T14:02:38.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305598+0000", 2024-05-07T14:02:38.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103835 2024-05-07T14:02:38.146 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.146 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.146 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:134 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'92, mlcod=17'85)", 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 111.839522574, 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037081470000000002, 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303747+0000", 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303805+0000", 2024-05-07T14:02:38.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8554999999999998e-05 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303829+0000", 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3799999999999999e-05 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303871+0000", 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2079999999999997e-05 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304359+0000", 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048822999999999998 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304415+0000", 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5405999999999998e-05 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307388+0000", 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029728070000000001 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307452+0000", 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4789000000000006e-05 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:137 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'95, mlcod=17'88)", 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 111.835898673, 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004097552, 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.151 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.152 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:38.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:38.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307370+0000", 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3939999999999999e-06 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307454+0000", 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4639000000000001e-05 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307474+0000", 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0242999999999999e-05 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307485+0000", 2024-05-07T14:02:38.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0710000000000001e-05 2024-05-07T14:02:38.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307538+0000", 2024-05-07T14:02:38.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2623000000000001e-05 2024-05-07T14:02:38.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307566+0000", 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.781e-05 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311405+0000", 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038392299999999999 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311466+0000", 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0903000000000003e-05 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.155 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:138 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'96, mlcod=17'93)", 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 111.83260253500001, 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034036700000000001, 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:38.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310666+0000", 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310680+0000", 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4047e-05 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310715+0000", 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4826000000000002e-05 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310739+0000", 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3796000000000001e-05 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310862+0000", 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123132 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310896+0000", 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.43e-05 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313965+0000", 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030685959999999998 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314068+0000", 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102963 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 111.83169685199999, 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.160 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.161 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:38.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:38.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:02:38.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:02:38.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:02:38.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:02:38.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:02:38.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:02:38.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:02:38.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:02:38.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 111.830790456, 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.165 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:38.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:38.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.169 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 111.829377837, 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:38.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:02:38.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:02:38.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:02:38.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:02:38.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:02:38.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:02:38.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:02:38.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.174 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.174 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:143 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'101, mlcod=17'98)", 2024-05-07T14:02:38.174 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:38.174 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 111.821485068, 2024-05-07T14:02:38.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036609120000000001, 2024-05-07T14:02:38.174 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.174 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.174 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.175 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:38.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:38.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321783+0000", 2024-05-07T14:02:38.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3599999999999999e-06 2024-05-07T14:02:38.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321905+0000", 2024-05-07T14:02:38.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121923 2024-05-07T14:02:38.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321929+0000", 2024-05-07T14:02:38.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4295999999999999e-05 2024-05-07T14:02:38.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321945+0000", 2024-05-07T14:02:38.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5773999999999998e-05 2024-05-07T14:02:38.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322070+0000", 2024-05-07T14:02:38.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012457899999999999 2024-05-07T14:02:38.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322101+0000", 2024-05-07T14:02:38.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1213000000000001e-05 2024-05-07T14:02:38.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325342+0000", 2024-05-07T14:02:38.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032410579999999998 2024-05-07T14:02:38.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325443+0000", 2024-05-07T14:02:38.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100709 2024-05-07T14:02:38.178 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:144 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 111.820416326, 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003406484, 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:38.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:38.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322852+0000", 2024-05-07T14:02:38.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8369999999999999e-06 2024-05-07T14:02:38.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323022+0000", 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016984199999999999 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323048+0000", 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5752999999999999e-05 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323071+0000", 2024-05-07T14:02:38.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.266e-05 2024-05-07T14:02:38.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323188+0000", 2024-05-07T14:02:38.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011728200000000001 2024-05-07T14:02:38.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323224+0000", 2024-05-07T14:02:38.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6380000000000001e-05 2024-05-07T14:02:38.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326163+0000", 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029386170000000001 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326257+0000", 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4112999999999998e-05 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:02:38.183 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.124085413000003, 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034691510000000002, 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 206 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019184+0000", 2024-05-07T14:02:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6170000000000001e-06 2024-05-07T14:02:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019198+0000", 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4113e-05 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019229+0000", 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0423e-05 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019244+0000", 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5047e-05 2024-05-07T14:02:38.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019478+0000", 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000234398 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019723+0000", 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024469500000000001 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.020149+0000", 2024-05-07T14:02:38.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042592999999999998 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.021776+0000", 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001627688 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022453+0000", 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00067671500000000004 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022551+0000", 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8312000000000003e-05 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022651+0000", 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9213e-05 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:38.189 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.096796233000006, 2024-05-07T14:02:38.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038721300000000001, 2024-05-07T14:02:38.190 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.190 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.190 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.190 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.190 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.190 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.190 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 210 2024-05-07T14:02:38.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.190 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:38.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:38.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046474+0000", 2024-05-07T14:02:38.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.517e-06 2024-05-07T14:02:38.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046487+0000", 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3113e-05 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046521+0000", 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3556000000000002e-05 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046537+0000", 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.643e-05 2024-05-07T14:02:38.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046651+0000", 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011368500000000001 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046873+0000", 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221802 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.047335+0000", 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046227300000000002 2024-05-07T14:02:38.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.048993+0000", 2024-05-07T14:02:38.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016576679999999999 2024-05-07T14:02:38.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050186+0000", 2024-05-07T14:02:38.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001193284 2024-05-07T14:02:38.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050273+0000", 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7189999999999997e-05 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050343+0000", 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9611999999999997e-05 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:38.195 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.067289486999996, 2024-05-07T14:02:38.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034712530000000001, 2024-05-07T14:02:38.196 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.196 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.196 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.196 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.196 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.196 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.196 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 218 2024-05-07T14:02:38.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.196 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:38.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:38.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075980+0000", 2024-05-07T14:02:38.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.774e-06 2024-05-07T14:02:38.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075992+0000", 2024-05-07T14:02:38.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2283000000000001e-05 2024-05-07T14:02:38.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076024+0000", 2024-05-07T14:02:38.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1242999999999999e-05 2024-05-07T14:02:38.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076038+0000", 2024-05-07T14:02:38.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4663e-05 2024-05-07T14:02:38.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076199+0000", 2024-05-07T14:02:38.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160865 2024-05-07T14:02:38.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076539+0000", 2024-05-07T14:02:38.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033995800000000001 2024-05-07T14:02:38.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:38.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.077234+0000", 2024-05-07T14:02:38.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000694581 2024-05-07T14:02:38.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.078996+0000", 2024-05-07T14:02:38.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001762633 2024-05-07T14:02:38.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079276+0000", 2024-05-07T14:02:38.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027998399999999999 2024-05-07T14:02:38.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079380+0000", 2024-05-07T14:02:38.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103266 2024-05-07T14:02:38.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079449+0000", 2024-05-07T14:02:38.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9003000000000003e-05 2024-05-07T14:02:38.202 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.202 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.202 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.202 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.203 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:38.203 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.003707355000003, 2024-05-07T14:02:38.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:02:38.203 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.203 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.203 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.203 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.203 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.203 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.203 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:02:38.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.203 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:38.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:38.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:02:38.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:02:38.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:02:38.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:02:38.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:02:38.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:02:38.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:02:38.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 90.970596697000005, 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:38.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:38.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:02:38.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:02:38.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:02:38.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:02:38.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:02:38.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.215 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 90.963686777999996, 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041680119999999996, 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.216 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 382 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179581+0000", 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179585+0000", 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4800000000000003e-06 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179598+0000", 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2322e-05 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179604+0000", 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.823e-06 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179657+0000", 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3937000000000002e-05 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179714+0000", 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6165000000000002e-05 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179830+0000", 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011632 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.180515+0000", 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00068531400000000002 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183667+0000", 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031522009999999999 2024-05-07T14:02:38.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183704+0000", 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6925999999999998e-05 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183748+0000", 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3618999999999997e-05 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.222 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:499 6.13 e33/27 6:cedbb205:::obj_delete_at_hint.0000000017:head v 33'4, mlcod=33'1)", 2024-05-07T14:02:38.222 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:38.222 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 90.890314124, 2024-05-07T14:02:38.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043323679999999996, 2024-05-07T14:02:38.222 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.222 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.222 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.222 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.222 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:38.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252954+0000", 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.71e-07 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252960+0000", 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.46e-06 2024-05-07T14:02:38.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252974+0000", 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4249e-05 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252982+0000", 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253055+0000", 2024-05-07T14:02:38.224 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3162000000000002e-05 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253075+0000", 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9451999999999999e-05 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257253+0000", 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041781179999999998 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.225 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257285+0000", 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2075e-05 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:550 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 90.854659941999998, 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035552140000000001, 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.226 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 550 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:38.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288608+0000", 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0529999999999999e-06 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288613+0000", 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7060000000000003e-06 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288624+0000", 2024-05-07T14:02:38.228 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1547e-05 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288630+0000", 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288734+0000", 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103872 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.229 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288884+0000", 2024-05-07T14:02:38.230 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014987400000000001 2024-05-07T14:02:38.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.230 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.230 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:38.230 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289167+0000", 2024-05-07T14:02:38.230 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028341999999999999 2024-05-07T14:02:38.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.230 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.230 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.230 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289813+0000", 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064550199999999995 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292082+0000", 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022696000000000001 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292120+0000", 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7367999999999999e-05 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.231 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292162+0000", 2024-05-07T14:02:38.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2568000000000003e-05 2024-05-07T14:02:38.232 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.232 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.232 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.232 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:667 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.232 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:38.232 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 90.758717907999994, 2024-05-07T14:02:38.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050309150000000004, 2024-05-07T14:02:38.232 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.232 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 667 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384550+0000", 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7000000000000003e-07 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384555+0000", 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.135e-06 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384565+0000", 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0541e-05 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384571+0000", 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.857e-06 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384670+0000", 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8461999999999993e-05 2024-05-07T14:02:38.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384822+0000", 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152039 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.385123+0000", 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030070699999999999 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.386099+0000", 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097677300000000001 2024-05-07T14:02:38.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389495+0000", 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033959139999999999 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389530+0000", 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.472e-05 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389580+0000", 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9897e-05 2024-05-07T14:02:38.237 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.238 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.238 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.238 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.238 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.238 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:38.238 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:38.141+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:38.239 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:02:38.241 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:38.253+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:38.341 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:38.353+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:38.442 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:38.453+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:38.449 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:38.449 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:38.450 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:38.450 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:38.468 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:02:38.543 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:38.553+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:38.644 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:38.657+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:38.683 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:38.683 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:38.684 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:38.684 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:38.684 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:38.705 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:02:38.748 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:38.761+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:38.846 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:38.857+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:38.919 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:38.920 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:38.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:38.920 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:38.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.920 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:38.920 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:38.920 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 98.946217603999997, 2024-05-07T14:02:38.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:02:38.920 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.920 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.920 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:02:38.924 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 94.899051732999993, 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:38.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:38.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:02:38.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:02:38.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:02:38.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:02:38.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:02:38.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:02:38.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:02:38.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 94.798724012999998, 2024-05-07T14:02:38.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:02:38.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:02:38.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:02:38.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:02:38.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:02:38.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:38.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:02:38.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:02:38.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:02:38.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:02:38.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:02:38.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:02:38.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:38.935 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.896179955999997, 2024-05-07T14:02:38.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:02:38.936 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.936 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.936 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.936 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.936 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.936 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.936 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:02:38.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.936 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:02:38.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:02:38.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:02:38.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:02:38.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:02:38.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:02:38.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:02:38.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:02:38.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.876869987999996, 2024-05-07T14:02:38.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:02:38.942 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.942 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.942 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.942 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.942 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.942 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.942 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:02:38.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.942 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:38.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:02:38.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:02:38.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:02:38.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:02:38.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:02:38.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.851503077999993, 2024-05-07T14:02:38.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:02:38.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:02:38.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:02:38.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:02:38.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:02:38.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:02:38.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:02:38.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:02:38.953 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.953 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.953 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.953 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.953 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:38.953 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.831713694000001, 2024-05-07T14:02:38.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:02:38.953 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.953 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:02:38.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:02:38.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:02:38.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:02:38.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:02:38.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.798475332999999, 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.959 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:02:38.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:02:38.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:02:38.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:02:38.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:02:38.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:02:38.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:02:38.964 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.763114311999999, 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.965 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:38.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:02:38.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:02:38.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:02:38.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:02:38.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:02:38.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.971 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.971 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:38.971 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.738370746000001, 2024-05-07T14:02:38.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:02:38.971 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.971 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.971 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.971 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.971 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.971 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.971 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:02:38.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.976 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.977 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:38.977 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.627494342999995, 2024-05-07T14:02:38.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:02:38.977 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.977 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.977 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.977 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.977 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.977 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.977 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:02:38.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.977 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:02:38.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:02:38.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:02:38.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:02:38.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:02:38.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:02:38.982 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.982 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.982 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.982 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.982 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.571330394, 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:38.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:02:38.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:02:38.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:02:38.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:02:38.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:02:38.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:02:38.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:02:38.989 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.989 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.989 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.989 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.989 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:38.989 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.555445208999998, 2024-05-07T14:02:38.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:02:38.989 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.989 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.989 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.990 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.990 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.990 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.990 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:02:38.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.990 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:38.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:02:38.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:02:38.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:38.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:02:38.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:02:38.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:02:38.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:02:38.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:38.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:02:38.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:02:38.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:38.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:02:38.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:02:38.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:38.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.306078956999997, 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:38.995 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:38.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:02:38.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:02:38.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:38.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:02:38.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:02:38.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:38.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:02:38.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:02:38.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:38.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.000 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.244706133999998, 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.001 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:02:39.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:02:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:02:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:02:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:02:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.006 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.048917791999997, 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.007 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:02:39.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:39.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:02:39.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:02:39.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:02:39.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:02:39.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:02:39.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:02:39.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.044614342000003, 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003023937, 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 918 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:39.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:39.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886558+0000", 2024-05-07T14:02:39.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1229999999999998e-06 2024-05-07T14:02:39.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886569+0000", 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1497e-05 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886600+0000", 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0809999999999998e-05 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886618+0000", 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7799e-05 2024-05-07T14:02:39.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886736+0000", 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118276 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886951+0000", 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021467200000000001 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.887437+0000", 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048624900000000001 2024-05-07T14:02:39.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.888687+0000", 2024-05-07T14:02:39.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012498310000000001 2024-05-07T14:02:39.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889318+0000", 2024-05-07T14:02:39.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063122199999999997 2024-05-07T14:02:39.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889463+0000", 2024-05-07T14:02:39.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144769 2024-05-07T14:02:39.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889580+0000", 2024-05-07T14:02:39.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011668899999999999 2024-05-07T14:02:39.018 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.018 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.018 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.018 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.018 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.013613617999994, 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:39.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:02:39.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:02:39.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:02:39.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:02:39.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:02:39.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:39.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:02:39.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:02:39.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:02:39.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:02:39.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:02:39.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:02:39.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:02:39.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:02:39.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:02:39.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:02:39.024 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.024 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.024 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.024 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.024 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:39.024 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.008728726000001, 2024-05-07T14:02:39.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:02:39.025 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.025 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.025 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.025 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.025 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.025 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.025 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:02:39.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.025 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:02:39.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:02:39.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:02:39.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:02:39.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:39.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:02:39.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:02:39.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:02:39.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:02:39.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:02:39.030 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.030 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.030 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.030 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.030 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:39.030 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 90.976807355000005, 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:39.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:02:39.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:02:39.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:02:39.036 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.036 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.036 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.036 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.036 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.036 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:39.038 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:02:39.038 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:39.049+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:39.138 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:39.149+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:39.239 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:39.249+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:39.251 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:39.251 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:39.251 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:39.251 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:39.268 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:02:39.341 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:39.353+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:39.442 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:39.453+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:39.479 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:39.479 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:39.479 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:39.480 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:39.480 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:39.497 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:02:39.543 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:39.553+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:39.643 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:39.653+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:39.669 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:39.669 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:39.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:39.669 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:39.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.669 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:40 5.8 5:168cc6a2:::zonegroup_info.7881bf19-2c91-49be-82bb-722579314d1c:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:39.669 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:39.669 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 99.638355511, 2024-05-07T14:02:39.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002658582, 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 40 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042176+0000", 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7719999999999999e-06 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042186+0000", 2024-05-07T14:02:39.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0020000000000001e-05 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042209+0000", 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3224e-05 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042220+0000", 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1153e-05 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042358+0000", 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137389 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042594+0000", 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023630100000000001 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042900+0000", 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030576799999999999 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044463+0000", 2024-05-07T14:02:39.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015627130000000001 2024-05-07T14:02:39.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044675+0000", 2024-05-07T14:02:39.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021186999999999999 2024-05-07T14:02:39.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044768+0000", 2024-05-07T14:02:39.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3046000000000003e-05 2024-05-07T14:02:39.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044833+0000", 2024-05-07T14:02:39.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5326000000000004e-05 2024-05-07T14:02:39.675 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.675 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.675 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.675 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:39.675 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:39.675 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.643800626000001, 2024-05-07T14:02:39.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025872120000000002, 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 52 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036732+0000", 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4980000000000001e-06 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036744+0000", 2024-05-07T14:02:39.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2269999999999999e-05 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036772+0000", 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8002000000000001e-05 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036817+0000", 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4608999999999999e-05 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036946+0000", 2024-05-07T14:02:39.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012988400000000001 2024-05-07T14:02:39.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037184+0000", 2024-05-07T14:02:39.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000237178 2024-05-07T14:02:39.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:39.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037405+0000", 2024-05-07T14:02:39.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221418 2024-05-07T14:02:39.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.038548+0000", 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011433540000000001 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039179+0000", 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063016999999999999 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039231+0000", 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2434e-05 2024-05-07T14:02:39.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039316+0000", 2024-05-07T14:02:39.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5395000000000005e-05 2024-05-07T14:02:39.681 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.681 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.681 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.681 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.681 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:39.681 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.535218164, 2024-05-07T14:02:39.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:02:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:02:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:02:39.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:02:39.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:02:39.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:02:39.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:02:39.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:02:39.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:02:39.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:02:39.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:02:39.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:02:39.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:02:39.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:02:39.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:02:39.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.522799223000007, 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.688 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:02:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:02:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:02:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:02:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:02:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:02:39.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:02:39.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:02:39.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:02:39.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:02:39.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:02:39.694 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.694 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.694 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.695 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.695 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:39.695 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.518919500999999, 2024-05-07T14:02:39.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:02:39.695 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.695 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.695 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.695 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.696 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.696 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.696 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:02:39.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.696 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:39.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:02:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:02:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:02:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:02:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:02:39.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:02:39.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:02:39.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:02:39.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:02:39.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:02:39.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:02:39.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:02:39.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:39.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:02:39.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:02:39.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:02:39.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:02:39.701 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.701 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.701 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.701 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.701 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:39.701 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.388263997999999, 2024-05-07T14:02:39.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:02:39.701 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.702 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.702 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.702 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.702 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.702 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.702 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:02:39.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.702 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:39.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:02:39.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:02:39.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:02:39.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:02:39.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:02:39.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:02:39.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:02:39.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:02:39.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:02:39.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:02:39.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:39.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:02:39.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:02:39.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:02:39.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:02:39.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:02:39.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:02:39.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:02:39.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:02:39.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:02:39.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:02:39.707 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.707 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.708 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.708 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.708 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:39.708 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.381096675999999, 2024-05-07T14:02:39.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:02:39.708 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.708 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.708 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.709 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.709 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.709 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:02:39.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.709 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:39.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:39.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:02:39.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:02:39.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:02:39.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:02:39.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:02:39.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:02:39.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:02:39.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:02:39.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:02:39.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:02:39.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:02:39.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:02:39.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:39.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:02:39.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:02:39.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:02:39.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:02:39.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:02:39.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:02:39.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:02:39.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:02:39.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:02:39.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:02:39.714 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.714 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.714 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.715 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:39.715 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:39.716 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.090563988, 2024-05-07T14:02:39.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:02:39.716 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.716 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.716 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.716 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:02:39.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:02:39.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:02:39.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:02:39.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:02:39.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:02:39.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:02:39.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:02:39.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:02:39.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:02:39.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:02:39.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:02:39.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:02:39.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:02:39.720 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.720 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.720 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.025482593999996, 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025880500000000002, 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 819 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:39.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:39.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655049+0000", 2024-05-07T14:02:39.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6640000000000001e-06 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655057+0000", 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5639999999999997e-06 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655082+0000", 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4119999999999999e-05 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655093+0000", 2024-05-07T14:02:39.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1598e-05 2024-05-07T14:02:39.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655273+0000", 2024-05-07T14:02:39.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017975599999999999 2024-05-07T14:02:39.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655432+0000", 2024-05-07T14:02:39.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000158682 2024-05-07T14:02:39.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655720+0000", 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028791400000000001 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.656823+0000", 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001103435 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657483+0000", 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000659828 2024-05-07T14:02:39.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657571+0000", 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7756000000000005e-05 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657635+0000", 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4733000000000005e-05 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.973206360999995, 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028535079999999998, 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 841 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707326+0000", 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:02:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707338+0000", 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2036e-05 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707367+0000", 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8816999999999999e-05 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707382+0000", 2024-05-07T14:02:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4912999999999999e-05 2024-05-07T14:02:39.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707523+0000", 2024-05-07T14:02:39.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014165599999999999 2024-05-07T14:02:39.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707748+0000", 2024-05-07T14:02:39.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000224315 2024-05-07T14:02:39.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:39.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.708055+0000", 2024-05-07T14:02:39.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030739800000000001 2024-05-07T14:02:39.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.709147+0000", 2024-05-07T14:02:39.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001091788 2024-05-07T14:02:39.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710030+0000", 2024-05-07T14:02:39.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088367000000000003 2024-05-07T14:02:39.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710114+0000", 2024-05-07T14:02:39.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3936000000000004e-05 2024-05-07T14:02:39.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710177+0000", 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2675999999999994e-05 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.969539822000002, 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026153460000000002, 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.733 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.734 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.734 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.734 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 843 2024-05-07T14:02:39.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.734 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:39.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710992+0000", 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.666e-06 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711000+0000", 2024-05-07T14:02:39.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.977e-06 2024-05-07T14:02:39.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711020+0000", 2024-05-07T14:02:39.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.033e-05 2024-05-07T14:02:39.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711030+0000", 2024-05-07T14:02:39.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9790000000000005e-06 2024-05-07T14:02:39.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711133+0000", 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102563 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711256+0000", 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012337599999999999 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711555+0000", 2024-05-07T14:02:39.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029948699999999997 2024-05-07T14:02:39.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.712654+0000", 2024-05-07T14:02:39.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001098819 2024-05-07T14:02:39.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713451+0000", 2024-05-07T14:02:39.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000796424 2024-05-07T14:02:39.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713541+0000", 2024-05-07T14:02:39.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9981999999999993e-05 2024-05-07T14:02:39.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713605+0000", 2024-05-07T14:02:39.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4743e-05 2024-05-07T14:02:39.739 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.739 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.739 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.740 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.740 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:39.740 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.960083706000006, 2024-05-07T14:02:39.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027995160000000002, 2024-05-07T14:02:39.740 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.740 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.740 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.740 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.740 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.740 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.741 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 847 2024-05-07T14:02:39.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.741 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:39.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:39.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720448+0000", 2024-05-07T14:02:39.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:02:39.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720460+0000", 2024-05-07T14:02:39.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1157e-05 2024-05-07T14:02:39.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720490+0000", 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0960000000000002e-05 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720507+0000", 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6477000000000002e-05 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720681+0000", 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017396800000000001 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720897+0000", 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215775 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.721203+0000", 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030621499999999998 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.722485+0000", 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012818599999999999 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723091+0000", 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060651499999999996 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723182+0000", 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0692999999999994e-05 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723246+0000", 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3643e-05 2024-05-07T14:02:39.745 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.746 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.746 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.746 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.746 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:39.746 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.956316357000006, 2024-05-07T14:02:39.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:02:39.746 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.746 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.746 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.746 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.746 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:02:39.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:02:39.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:02:39.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:39.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:02:39.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:02:39.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:02:39.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:02:39.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:39.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:02:39.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:02:39.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:02:39.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:02:39.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:02:39.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:02:39.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:02:39.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:02:39.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:02:39.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:02:39.752 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.752 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.752 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.752 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.752 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:39.752 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.910602960999995, 2024-05-07T14:02:39.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:02:39.752 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.752 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.752 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.753 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.753 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.753 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.753 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:02:39.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.753 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:39.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:39.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:02:39.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:02:39.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:02:39.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:02:39.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:02:39.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:02:39.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:02:39.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:02:39.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:02:39.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:02:39.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:02:39.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:02:39.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:02:39.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:02:39.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.904326222999998, 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.758 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:39.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:02:39.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:02:39.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:02:39.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:02:39.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:02:39.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:02:39.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:02:39.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:02:39.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:39.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:02:39.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:02:39.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.817813103000006, 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028016680000000002, 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.764 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 907 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:39.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862719+0000", 2024-05-07T14:02:39.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:02:39.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862733+0000", 2024-05-07T14:02:39.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3067e-05 2024-05-07T14:02:39.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862763+0000", 2024-05-07T14:02:39.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0926000000000002e-05 2024-05-07T14:02:39.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862779+0000", 2024-05-07T14:02:39.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5787e-05 2024-05-07T14:02:39.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862924+0000", 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014509899999999999 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863160+0000", 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000235701 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863523+0000", 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000362567 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.864872+0000", 2024-05-07T14:02:39.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00134954 2024-05-07T14:02:39.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865350+0000", 2024-05-07T14:02:39.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000478009 2024-05-07T14:02:39.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865437+0000", 2024-05-07T14:02:39.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6712999999999995e-05 2024-05-07T14:02:39.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865518+0000", 2024-05-07T14:02:39.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1493000000000001e-05 2024-05-07T14:02:39.770 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.770 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.770 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.771 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.771 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:39.771 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.814083815999993, 2024-05-07T14:02:39.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027054290000000001, 2024-05-07T14:02:39.771 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.771 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.771 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.771 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.771 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.771 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.771 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 909 2024-05-07T14:02:39.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.772 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:39.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:39.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866448+0000", 2024-05-07T14:02:39.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:39.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866459+0000", 2024-05-07T14:02:39.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1207e-05 2024-05-07T14:02:39.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866491+0000", 2024-05-07T14:02:39.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362999999999998e-05 2024-05-07T14:02:39.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866506+0000", 2024-05-07T14:02:39.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4790000000000001e-05 2024-05-07T14:02:39.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866632+0000", 2024-05-07T14:02:39.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000126422 2024-05-07T14:02:39.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866761+0000", 2024-05-07T14:02:39.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128832 2024-05-07T14:02:39.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:39.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.867037+0000", 2024-05-07T14:02:39.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027612200000000001 2024-05-07T14:02:39.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.868118+0000", 2024-05-07T14:02:39.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001080941 2024-05-07T14:02:39.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869004+0000", 2024-05-07T14:02:39.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088632000000000001 2024-05-07T14:02:39.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869081+0000", 2024-05-07T14:02:39.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7195999999999997e-05 2024-05-07T14:02:39.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869151+0000", 2024-05-07T14:02:39.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0066000000000003e-05 2024-05-07T14:02:39.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.778 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.778 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:39.778 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.719235017000003, 2024-05-07T14:02:39.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:02:39.778 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.778 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.778 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:02:39.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:02:39.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:02:39.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:02:39.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:02:39.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:02:39.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:02:39.784 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.784 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.784 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.784 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.784 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:39.784 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.706065663000004, 2024-05-07T14:02:39.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027821920000000002, 2024-05-07T14:02:39.784 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.784 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 955 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:39.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974466+0000", 2024-05-07T14:02:39.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0999999999999998e-06 2024-05-07T14:02:39.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974480+0000", 2024-05-07T14:02:39.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3876999999999999e-05 2024-05-07T14:02:39.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974510+0000", 2024-05-07T14:02:39.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0273e-05 2024-05-07T14:02:39.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974525+0000", 2024-05-07T14:02:39.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.485e-05 2024-05-07T14:02:39.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974618+0000", 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2359000000000001e-05 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974822+0000", 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000204148 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.975126+0000", 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030382800000000002 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976565+0000", 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014395160000000001 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976963+0000", 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00039772700000000001 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977128+0000", 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165508 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977246+0000", 2024-05-07T14:02:39.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011800599999999999 2024-05-07T14:02:39.790 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.790 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.790 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.790 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:39.790 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:39.790 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.702150099999997, 2024-05-07T14:02:39.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027683989999999999, 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 957 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978382+0000", 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.95e-06 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978393+0000", 2024-05-07T14:02:39.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.084e-05 2024-05-07T14:02:39.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:39.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978424+0000", 2024-05-07T14:02:39.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1022999999999998e-05 2024-05-07T14:02:39.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:39.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978441+0000", 2024-05-07T14:02:39.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7782999999999999e-05 2024-05-07T14:02:39.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:39.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978565+0000", 2024-05-07T14:02:39.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012348900000000001 2024-05-07T14:02:39.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:39.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978794+0000", 2024-05-07T14:02:39.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000229335 2024-05-07T14:02:39.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:39.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.979262+0000", 2024-05-07T14:02:39.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046826700000000002 2024-05-07T14:02:39.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.980470+0000", 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012071899999999999 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981002+0000", 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053222299999999996 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981086+0000", 2024-05-07T14:02:39.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4073000000000006e-05 2024-05-07T14:02:39.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:39.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:39.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:39.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981148+0000", 2024-05-07T14:02:39.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2225999999999997e-05 2024-05-07T14:02:39.796 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.796 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.796 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.796 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:39.796 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:39.796 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:39.797 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:02:39.799 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:02:39.799 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:39.809+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:39.899 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:39.909+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:39.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:02:40.000 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:40.013+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:40.021 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:40.021 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:40.022 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:40.022 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:40.042 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:02:40.102 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:40.113+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:40.176 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:40.176 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:40.203 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:40.213+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:40.207 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:40.207 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:40.214 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:40.215 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:40.228 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:02:40.237 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:40.237 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:40.268 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:40.268 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:40.302 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:40.302 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:40.303 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:40.313+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:40.335 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:40.335 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:40.350 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:40.350 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:40.365 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:02:40.369 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:40.369 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:40.400 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:40.400 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:40.404 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:40.417+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:40.496 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:40.497 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:40.505 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:40.517+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:40.510 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:02:40.606 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:40.617+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:40.675 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:40.675 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:40.689 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:02:40.716 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:02:40.732 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:40.745+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:40.808 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:40.817+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:40.849 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:40.849 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:40.863 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:02:40.908 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:40.921+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:40.987 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:40.987 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:41.001 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:41.010 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:41.021+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:41.111 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:41.121+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:41.168 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:41.168 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:41.182 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:41.212 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:41.221+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:41.313 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:41.325+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:41.353 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:41.354 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:41.368 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:41.414 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:41.425+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:41.491 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:41.491 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:41.506 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:41.552 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:41.565+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:41.617 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:41.629+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:41.629 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:41.629 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:41.643 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:41.728 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:41.741+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:41.808 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:41.808 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:41.819 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:41.829+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:41.823 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:41.919 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:41.929+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:41.988 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:41.988 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:42.003 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:42.048 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:42.061+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:42.122 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:42.133+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:42.166 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:42.166 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:42.180 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:02:42.225 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:42.237+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:42.324 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:42.333+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:42.347 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:42.347 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:42.361 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:02:42.421 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:02:42.424 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:42.433+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:42.525 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:42.537+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:42.530 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:42.530 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:42.551 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:02:42.620 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:42.621 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:42.625 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:42.637+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:42.651 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:42.651 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:42.681 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:42.682 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:42.712 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:42.713 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:42.726 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:42.737+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:42.741 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:02:42.746 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:42.746 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:42.761 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:42.761 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:42.761 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:42.761 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:42.761 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:42.780 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:02:42.781 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:42.781 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:42.813 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:42.813 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:42.828 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:42.841+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:42.846 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:42.846 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:42.929 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:42.941+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:42.985 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:42.986 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:42.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:42.986 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:42.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.986 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:129 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'87, mlcod=17'85)", 2024-05-07T14:02:42.986 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:42.986 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 116.698472944, 2024-05-07T14:02:42.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034674469999999998, 2024-05-07T14:02:42.986 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:42.986 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:42.986 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:42.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299075+0000", 2024-05-07T14:02:42.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.736e-06 2024-05-07T14:02:42.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:42.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299087+0000", 2024-05-07T14:02:42.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2067e-05 2024-05-07T14:02:42.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:42.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299122+0000", 2024-05-07T14:02:42.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4643e-05 2024-05-07T14:02:42.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299141+0000", 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9224000000000001e-05 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299323+0000", 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018190400000000001 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299385+0000", 2024-05-07T14:02:42.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2126999999999997e-05 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302462+0000", 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030768330000000002 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302541+0000", 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8912999999999995e-05 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:42.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:131 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'89, mlcod=17'85)", 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 116.69714027099999, 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038759010000000002, 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:42.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:42.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:42.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:42.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:42.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300407+0000", 2024-05-07T14:02:42.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0299999999999998e-07 2024-05-07T14:02:42.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:42.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300577+0000", 2024-05-07T14:02:42.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000170259 2024-05-07T14:02:42.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300592+0000", 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4707e-05 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300601+0000", 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999995e-06 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301133+0000", 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053150199999999999 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301186+0000", 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.342e-05 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304217+0000", 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030307429999999998 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304282+0000", 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5316999999999998e-05 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:42.995 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:42.996 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:42.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.996 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:132 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'90, mlcod=17'85)", 2024-05-07T14:02:42.996 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:42.996 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 116.696088176, 2024-05-07T14:02:42.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041397580000000003, 2024-05-07T14:02:42.996 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301459+0000", 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.47e-07 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301470+0000", 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0933e-05 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301483+0000", 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2427e-05 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:42.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301491+0000", 2024-05-07T14:02:42.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6130000000000004e-06 2024-05-07T14:02:42.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:42.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:42.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:42.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302683+0000", 2024-05-07T14:02:42.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011919980000000001 2024-05-07T14:02:42.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302741+0000", 2024-05-07T14:02:43.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7963000000000001e-05 2024-05-07T14:02:43.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305494+0000", 2024-05-07T14:02:43.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027531420000000001 2024-05-07T14:02:43.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305598+0000", 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103835 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:134 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'92, mlcod=17'85)", 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 116.693802279, 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037081470000000002, 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.001 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.002 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:43.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303747+0000", 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303805+0000", 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8554999999999998e-05 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303829+0000", 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3799999999999999e-05 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303871+0000", 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2079999999999997e-05 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304359+0000", 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048822999999999998 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304415+0000", 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5405999999999998e-05 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307388+0000", 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029728070000000001 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307452+0000", 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4789000000000006e-05 2024-05-07T14:02:43.005 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.006 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.006 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.006 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:137 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'95, mlcod=17'88)", 2024-05-07T14:02:43.006 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:43.006 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 116.690178378, 2024-05-07T14:02:43.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004097552, 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307370+0000", 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3939999999999999e-06 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307454+0000", 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4639000000000001e-05 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307474+0000", 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0242999999999999e-05 2024-05-07T14:02:43.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307485+0000", 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0710000000000001e-05 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307538+0000", 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2623000000000001e-05 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307566+0000", 2024-05-07T14:02:43.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.781e-05 2024-05-07T14:02:43.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311405+0000", 2024-05-07T14:02:43.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038392299999999999 2024-05-07T14:02:43.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311466+0000", 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0903000000000003e-05 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:138 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'96, mlcod=17'93)", 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 116.68688224, 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034036700000000001, 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.011 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.012 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.012 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:43.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:43.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310666+0000", 2024-05-07T14:02:43.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:02:43.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310680+0000", 2024-05-07T14:02:43.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4047e-05 2024-05-07T14:02:43.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310715+0000", 2024-05-07T14:02:43.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4826000000000002e-05 2024-05-07T14:02:43.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310739+0000", 2024-05-07T14:02:43.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3796000000000001e-05 2024-05-07T14:02:43.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310862+0000", 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123132 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310896+0000", 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.43e-05 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313965+0000", 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030685959999999998 2024-05-07T14:02:43.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314068+0000", 2024-05-07T14:02:43.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102963 2024-05-07T14:02:43.016 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.016 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.016 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.016 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:02:43.016 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:43.016 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 116.685976557, 2024-05-07T14:02:43.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:02:43.017 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.017 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.017 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.017 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:43.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:43.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:02:43.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:02:43.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:02:43.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:02:43.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:02:43.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:02:43.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:02:43.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:43.021 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 116.685070161, 2024-05-07T14:02:43.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:02:43.022 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.022 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.022 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.022 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:43.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.025 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:02:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 116.68365754200001, 2024-05-07T14:02:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:02:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:43.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:43.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:02:43.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:02:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:02:43.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:02:43.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:02:43.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:02:43.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:02:43.030 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.030 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.030 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.031 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:143 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'101, mlcod=17'98)", 2024-05-07T14:02:43.031 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:43.031 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 116.675764773, 2024-05-07T14:02:43.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036609120000000001, 2024-05-07T14:02:43.031 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.031 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.031 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321783+0000", 2024-05-07T14:02:43.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3599999999999999e-06 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321905+0000", 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121923 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321929+0000", 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4295999999999999e-05 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321945+0000", 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5773999999999998e-05 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322070+0000", 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012457899999999999 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322101+0000", 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1213000000000001e-05 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325342+0000", 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032410579999999998 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325443+0000", 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100709 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:144 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-05-07T14:02:43.035 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 116.674696031, 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003406484, 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:43.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322852+0000", 2024-05-07T14:02:43.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8369999999999999e-06 2024-05-07T14:02:43.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323022+0000", 2024-05-07T14:02:43.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016984199999999999 2024-05-07T14:02:43.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323048+0000", 2024-05-07T14:02:43.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5752999999999999e-05 2024-05-07T14:02:43.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323071+0000", 2024-05-07T14:02:43.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.266e-05 2024-05-07T14:02:43.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323188+0000", 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011728200000000001 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323224+0000", 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6380000000000001e-05 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326163+0000", 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029386170000000001 2024-05-07T14:02:43.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326257+0000", 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4112999999999998e-05 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.978365117999999, 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034691510000000002, 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.040 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.041 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.041 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.041 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.041 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.041 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 206 2024-05-07T14:02:43.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.041 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:43.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019184+0000", 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6170000000000001e-06 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019198+0000", 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4113e-05 2024-05-07T14:02:43.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019229+0000", 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0423e-05 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019244+0000", 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5047e-05 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019478+0000", 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000234398 2024-05-07T14:02:43.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019723+0000", 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024469500000000001 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.020149+0000", 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042592999999999998 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.021776+0000", 2024-05-07T14:02:43.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001627688 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022453+0000", 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00067671500000000004 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022551+0000", 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8312000000000003e-05 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022651+0000", 2024-05-07T14:02:43.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9213e-05 2024-05-07T14:02:43.046 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.046 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.046 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.046 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.046 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:43.046 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.951075938000002, 2024-05-07T14:02:43.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038721300000000001, 2024-05-07T14:02:43.046 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.046 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.046 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.046 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 210 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:43.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046474+0000", 2024-05-07T14:02:43.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.517e-06 2024-05-07T14:02:43.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046487+0000", 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3113e-05 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046521+0000", 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3556000000000002e-05 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046537+0000", 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.643e-05 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046651+0000", 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011368500000000001 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046873+0000", 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221802 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.047335+0000", 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046227300000000002 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.048993+0000", 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016576679999999999 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050186+0000", 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001193284 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050273+0000", 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7189999999999997e-05 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050343+0000", 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9611999999999997e-05 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.921569192000007, 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034712530000000001, 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.052 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 218 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075980+0000", 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.774e-06 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075992+0000", 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2283000000000001e-05 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076024+0000", 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1242999999999999e-05 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076038+0000", 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4663e-05 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076199+0000", 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160865 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076539+0000", 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033995800000000001 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.077234+0000", 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000694581 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.078996+0000", 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001762633 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079276+0000", 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027998399999999999 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079380+0000", 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103266 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079449+0000", 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9003000000000003e-05 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.057 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.058 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.058 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.058 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:43.058 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.857987059999999, 2024-05-07T14:02:43.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:02:43.058 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.058 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:02:43.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:02:43.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:43.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:02:43.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:02:43.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:02:43.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.824876402000001, 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.064 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.065 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.065 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.065 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.065 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.065 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:02:43.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.065 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:43.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:43.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:02:43.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:02:43.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.817966483000006, 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041680119999999996, 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.070 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 382 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:43.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179581+0000", 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179585+0000", 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4800000000000003e-06 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179598+0000", 2024-05-07T14:02:43.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2322e-05 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179604+0000", 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.823e-06 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179657+0000", 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3937000000000002e-05 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179714+0000", 2024-05-07T14:02:43.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6165000000000002e-05 2024-05-07T14:02:43.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:43.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179830+0000", 2024-05-07T14:02:43.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011632 2024-05-07T14:02:43.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.180515+0000", 2024-05-07T14:02:43.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00068531400000000002 2024-05-07T14:02:43.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183667+0000", 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031522009999999999 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183704+0000", 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6925999999999998e-05 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183748+0000", 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3618999999999997e-05 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.075 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:499 6.13 e33/27 6:cedbb205:::obj_delete_at_hint.0000000017:head v 33'4, mlcod=33'1)", 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.744593828999996, 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043323679999999996, 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:43.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252954+0000", 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.71e-07 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252960+0000", 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.46e-06 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252974+0000", 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4249e-05 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252982+0000", 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253055+0000", 2024-05-07T14:02:43.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3162000000000002e-05 2024-05-07T14:02:43.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253075+0000", 2024-05-07T14:02:43.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9451999999999999e-05 2024-05-07T14:02:43.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257253+0000", 2024-05-07T14:02:43.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041781179999999998 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257285+0000", 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2075e-05 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:550 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.708939646999994, 2024-05-07T14:02:43.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035552140000000001, 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 550 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288608+0000", 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0529999999999999e-06 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288613+0000", 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7060000000000003e-06 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288624+0000", 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1547e-05 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288630+0000", 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288734+0000", 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103872 2024-05-07T14:02:43.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288884+0000", 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014987400000000001 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289167+0000", 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028341999999999999 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289813+0000", 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064550199999999995 2024-05-07T14:02:43.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292082+0000", 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022696000000000001 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292120+0000", 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7367999999999999e-05 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292162+0000", 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2568000000000003e-05 2024-05-07T14:02:43.085 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:667 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.612997613000005, 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050309150000000004, 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.086 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 667 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384550+0000", 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7000000000000003e-07 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384555+0000", 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.135e-06 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384565+0000", 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0541e-05 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384571+0000", 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.857e-06 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384670+0000", 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8461999999999993e-05 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384822+0000", 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152039 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.385123+0000", 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030070699999999999 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.386099+0000", 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097677300000000001 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389495+0000", 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033959139999999999 2024-05-07T14:02:43.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389530+0000", 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.472e-05 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389580+0000", 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9897e-05 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.091 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:43.093 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:02:43.093 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:43.105+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:43.194 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:43.205+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:43.296 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:43.309+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:43.304 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:43.304 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:43.304 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:43.304 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:43.322 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:02:43.408 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:43.421+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:43.497 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:43.509+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:43.533 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:43.534 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:43.534 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:43.534 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:43.534 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:43.552 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:02:43.598 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:43.609+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:43.699 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:43.709+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:43.727 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:02:43.771 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:43.772 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:43.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:43.772 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:43.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.772 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:43.773 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:43.773 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 103.797991248, 2024-05-07T14:02:43.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:02:43.773 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.773 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.773 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:43.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:43.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:43.773 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:02:43.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.773 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:43.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:43.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:02:43.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:02:43.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:02:43.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:02:43.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:02:43.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:02:43.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:02:43.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:02:43.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:02:43.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:02:43.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:43.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:02:43.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:02:43.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.782 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 99.750825376999998, 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.786 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 99.650497657000003, 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:02:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.747953600000002, 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.728643632000001, 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.703276721999998, 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:02:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.683487338000006, 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:02:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:02:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.650248977000004, 2024-05-07T14:02:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:02:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:02:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:02:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:02:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:02:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:02:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:02:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:02:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:02:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:02:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:02:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:02:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:02:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:02:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:02:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.614887956000004, 2024-05-07T14:02:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:02:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:02:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:02:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:02:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:02:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:02:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:02:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:02:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:02:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:02:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:02:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:02:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:02:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:02:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:02:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:02:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:02:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:02:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:02:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:02:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.590144390000006, 2024-05-07T14:02:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:02:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:02:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:02:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:02:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:02:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:02:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:02:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:02:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:02:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:02:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:02:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:02:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:02:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:02:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:02:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:02:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:02:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.479267987, 2024-05-07T14:02:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:02:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:02:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:02:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:02:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:02:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:02:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:02:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:02:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:02:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:02:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:02:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:02:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:02:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:02:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:02:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:02:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:02:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:02:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:02:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.423104038000005, 2024-05-07T14:02:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:02:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:02:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:02:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:02:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:02:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:02:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:02:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:02:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:02:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:02:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:02:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:02:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:02:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:02:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:02:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:02:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:02:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:02:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:02:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.407218853000003, 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:02:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:02:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:02:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:02:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:02:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:02:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:02:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:02:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:02:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:02:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:02:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:02:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:02:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:02:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:02:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:02:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.157852601000002, 2024-05-07T14:02:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:02:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:02:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:02:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:02:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:02:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:02:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:02:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:02:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:02:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:02:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:02:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:02:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:02:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:02:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:02:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:02:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:02:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.096479778000003, 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:02:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:02:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:02:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:02:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:02:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:02:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:02:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:02:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:02:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.900691436000002, 2024-05-07T14:02:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:02:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:02:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:02:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:02:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:02:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:02:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.896387985999993, 2024-05-07T14:02:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003023937, 2024-05-07T14:02:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 918 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886558+0000", 2024-05-07T14:02:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1229999999999998e-06 2024-05-07T14:02:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886569+0000", 2024-05-07T14:02:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1497e-05 2024-05-07T14:02:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886600+0000", 2024-05-07T14:02:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0809999999999998e-05 2024-05-07T14:02:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886618+0000", 2024-05-07T14:02:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7799e-05 2024-05-07T14:02:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886736+0000", 2024-05-07T14:02:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118276 2024-05-07T14:02:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886951+0000", 2024-05-07T14:02:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021467200000000001 2024-05-07T14:02:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.887437+0000", 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048624900000000001 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.888687+0000", 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012498310000000001 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889318+0000", 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063122199999999997 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889463+0000", 2024-05-07T14:02:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144769 2024-05-07T14:02:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889580+0000", 2024-05-07T14:02:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011668899999999999 2024-05-07T14:02:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.865387261999999, 2024-05-07T14:02:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:02:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:02:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:02:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:02:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:02:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:02:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:02:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:02:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:02:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:02:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:02:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.860502370000006, 2024-05-07T14:02:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:02:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:02:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:02:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:02:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:02:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:02:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:02:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:02:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:02:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:02:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:02:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:02:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:02:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:02:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:02:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:02:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:02:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:02:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:02:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:02:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 95.828580998999996, 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:02:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:02:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:02:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:02:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:43.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:43.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:43.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:02:43.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:02:43.905 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.905 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.905 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.905 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:43.905 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:43.905 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:43.907 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:02:43.907 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:43.917+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:44.008 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:44.017+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:44.108 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:44.121+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:44.117 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:44.117 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:44.117 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:44.117 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:44.135 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:02:44.209 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:44.221+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:44.310 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:44.321+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:44.343 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:44.343 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:44.343 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:44.343 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:44.343 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:44.360 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:02:44.457 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:44.469+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:44.512 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:44.521+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:44.576 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:40 5.8 5:168cc6a2:::zonegroup_info.7881bf19-2c91-49be-82bb-722579314d1c:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 104.54425728, 2024-05-07T14:02:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002658582, 2024-05-07T14:02:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 40 2024-05-07T14:02:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042176+0000", 2024-05-07T14:02:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7719999999999999e-06 2024-05-07T14:02:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042186+0000", 2024-05-07T14:02:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0020000000000001e-05 2024-05-07T14:02:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042209+0000", 2024-05-07T14:02:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3224e-05 2024-05-07T14:02:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042220+0000", 2024-05-07T14:02:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1153e-05 2024-05-07T14:02:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042358+0000", 2024-05-07T14:02:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137389 2024-05-07T14:02:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042594+0000", 2024-05-07T14:02:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023630100000000001 2024-05-07T14:02:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042900+0000", 2024-05-07T14:02:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030576799999999999 2024-05-07T14:02:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044463+0000", 2024-05-07T14:02:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015627130000000001 2024-05-07T14:02:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044675+0000", 2024-05-07T14:02:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021186999999999999 2024-05-07T14:02:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044768+0000", 2024-05-07T14:02:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3046000000000003e-05 2024-05-07T14:02:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044833+0000", 2024-05-07T14:02:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5326000000000004e-05 2024-05-07T14:02:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.549702395, 2024-05-07T14:02:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025872120000000002, 2024-05-07T14:02:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 52 2024-05-07T14:02:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036732+0000", 2024-05-07T14:02:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4980000000000001e-06 2024-05-07T14:02:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036744+0000", 2024-05-07T14:02:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2269999999999999e-05 2024-05-07T14:02:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036772+0000", 2024-05-07T14:02:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8002000000000001e-05 2024-05-07T14:02:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036817+0000", 2024-05-07T14:02:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4608999999999999e-05 2024-05-07T14:02:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036946+0000", 2024-05-07T14:02:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012988400000000001 2024-05-07T14:02:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037184+0000", 2024-05-07T14:02:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000237178 2024-05-07T14:02:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037405+0000", 2024-05-07T14:02:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221418 2024-05-07T14:02:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.038548+0000", 2024-05-07T14:02:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011433540000000001 2024-05-07T14:02:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039179+0000", 2024-05-07T14:02:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063016999999999999 2024-05-07T14:02:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039231+0000", 2024-05-07T14:02:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2434e-05 2024-05-07T14:02:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039316+0000", 2024-05-07T14:02:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5395000000000005e-05 2024-05-07T14:02:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.441119932999996, 2024-05-07T14:02:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:02:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:02:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.428700992000003, 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:02:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.424821269999995, 2024-05-07T14:02:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:02:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:02:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:02:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:02:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:02:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:02:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:02:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:02:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:02:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:02:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:02:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:02:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:02:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:02:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:02:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:02:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:02:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:02:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:02:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.294165766999996, 2024-05-07T14:02:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:02:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:02:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:02:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:02:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:02:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:02:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:02:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:02:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:02:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 97.286998444999995, 2024-05-07T14:02:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:02:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:02:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:02:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:02:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:02:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:02:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:02:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:02:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:02:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:02:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:02:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:02:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:02:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:02:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:02:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:02:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:02:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:02:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:02:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:02:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:02:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:02:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:02:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:02:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.996465756999996, 2024-05-07T14:02:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:02:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:02:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:02:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:02:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:02:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:02:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:02:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:02:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:02:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:02:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:02:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:02:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:02:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:02:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:02:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:02:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.931384363000006, 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025880500000000002, 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 819 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655049+0000", 2024-05-07T14:02:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6640000000000001e-06 2024-05-07T14:02:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655057+0000", 2024-05-07T14:02:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5639999999999997e-06 2024-05-07T14:02:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655082+0000", 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4119999999999999e-05 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655093+0000", 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1598e-05 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655273+0000", 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017975599999999999 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655432+0000", 2024-05-07T14:02:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000158682 2024-05-07T14:02:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655720+0000", 2024-05-07T14:02:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028791400000000001 2024-05-07T14:02:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.656823+0000", 2024-05-07T14:02:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001103435 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657483+0000", 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000659828 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657571+0000", 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7756000000000005e-05 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657635+0000", 2024-05-07T14:02:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4733000000000005e-05 2024-05-07T14:02:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.879108130000006, 2024-05-07T14:02:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028535079999999998, 2024-05-07T14:02:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 841 2024-05-07T14:02:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707326+0000", 2024-05-07T14:02:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:02:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707338+0000", 2024-05-07T14:02:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2036e-05 2024-05-07T14:02:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707367+0000", 2024-05-07T14:02:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8816999999999999e-05 2024-05-07T14:02:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707382+0000", 2024-05-07T14:02:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4912999999999999e-05 2024-05-07T14:02:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707523+0000", 2024-05-07T14:02:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014165599999999999 2024-05-07T14:02:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707748+0000", 2024-05-07T14:02:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000224315 2024-05-07T14:02:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.708055+0000", 2024-05-07T14:02:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030739800000000001 2024-05-07T14:02:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.709147+0000", 2024-05-07T14:02:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001091788 2024-05-07T14:02:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710030+0000", 2024-05-07T14:02:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088367000000000003 2024-05-07T14:02:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710114+0000", 2024-05-07T14:02:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3936000000000004e-05 2024-05-07T14:02:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710177+0000", 2024-05-07T14:02:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2675999999999994e-05 2024-05-07T14:02:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.875441590999998, 2024-05-07T14:02:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026153460000000002, 2024-05-07T14:02:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 843 2024-05-07T14:02:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710992+0000", 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.666e-06 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711000+0000", 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.977e-06 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711020+0000", 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.033e-05 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711030+0000", 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9790000000000005e-06 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711133+0000", 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102563 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711256+0000", 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012337599999999999 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711555+0000", 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029948699999999997 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.712654+0000", 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001098819 2024-05-07T14:02:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713451+0000", 2024-05-07T14:02:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000796424 2024-05-07T14:02:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713541+0000", 2024-05-07T14:02:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9981999999999993e-05 2024-05-07T14:02:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713605+0000", 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4743e-05 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.865985475000002, 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027995160000000002, 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 847 2024-05-07T14:02:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720448+0000", 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720460+0000", 2024-05-07T14:02:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1157e-05 2024-05-07T14:02:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720490+0000", 2024-05-07T14:02:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0960000000000002e-05 2024-05-07T14:02:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720507+0000", 2024-05-07T14:02:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6477000000000002e-05 2024-05-07T14:02:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720681+0000", 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017396800000000001 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720897+0000", 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215775 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.721203+0000", 2024-05-07T14:02:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030621499999999998 2024-05-07T14:02:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.722485+0000", 2024-05-07T14:02:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012818599999999999 2024-05-07T14:02:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723091+0000", 2024-05-07T14:02:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060651499999999996 2024-05-07T14:02:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723182+0000", 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0692999999999994e-05 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723246+0000", 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3643e-05 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.862218126000002, 2024-05-07T14:02:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:02:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:02:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:02:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:02:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:02:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:02:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:02:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:02:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:02:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:02:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:02:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:02:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:02:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:02:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:02:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:02:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:02:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:02:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:02:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:02:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:02:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:02:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:02:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.816504730000005, 2024-05-07T14:02:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:02:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:02:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:02:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:02:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:02:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:02:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:02:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:02:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:02:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:02:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:02:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:02:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:02:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:02:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:02:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:02:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:02:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:02:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:02:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:02:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:02:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:02:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:02:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:02:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.810227991999994, 2024-05-07T14:02:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:02:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:02:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:02:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:02:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:02:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:02:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:02:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:02:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:02:44.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:02:44.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:02:44.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:02:44.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:02:44.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:02:44.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:44.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:02:44.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:02:44.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.723714872000002, 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028016680000000002, 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.680 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.681 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.681 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.681 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.681 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 907 2024-05-07T14:02:44.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.681 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:44.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:44.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862719+0000", 2024-05-07T14:02:44.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:02:44.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862733+0000", 2024-05-07T14:02:44.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3067e-05 2024-05-07T14:02:44.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862763+0000", 2024-05-07T14:02:44.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0926000000000002e-05 2024-05-07T14:02:44.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862779+0000", 2024-05-07T14:02:44.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5787e-05 2024-05-07T14:02:44.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862924+0000", 2024-05-07T14:02:44.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014509899999999999 2024-05-07T14:02:44.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863160+0000", 2024-05-07T14:02:44.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000235701 2024-05-07T14:02:44.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:44.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863523+0000", 2024-05-07T14:02:44.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000362567 2024-05-07T14:02:44.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.864872+0000", 2024-05-07T14:02:44.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00134954 2024-05-07T14:02:44.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865350+0000", 2024-05-07T14:02:44.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000478009 2024-05-07T14:02:44.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865437+0000", 2024-05-07T14:02:44.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6712999999999995e-05 2024-05-07T14:02:44.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865518+0000", 2024-05-07T14:02:44.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1493000000000001e-05 2024-05-07T14:02:44.687 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.687 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.687 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.687 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.687 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:44.687 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.719985585000003, 2024-05-07T14:02:44.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027054290000000001, 2024-05-07T14:02:44.688 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.688 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.688 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.688 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.688 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.688 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.688 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 909 2024-05-07T14:02:44.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.688 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:44.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:44.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866448+0000", 2024-05-07T14:02:44.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:44.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866459+0000", 2024-05-07T14:02:44.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1207e-05 2024-05-07T14:02:44.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866491+0000", 2024-05-07T14:02:44.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362999999999998e-05 2024-05-07T14:02:44.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866506+0000", 2024-05-07T14:02:44.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4790000000000001e-05 2024-05-07T14:02:44.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866632+0000", 2024-05-07T14:02:44.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000126422 2024-05-07T14:02:44.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866761+0000", 2024-05-07T14:02:44.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128832 2024-05-07T14:02:44.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:44.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.867037+0000", 2024-05-07T14:02:44.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027612200000000001 2024-05-07T14:02:44.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.868118+0000", 2024-05-07T14:02:44.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001080941 2024-05-07T14:02:44.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869004+0000", 2024-05-07T14:02:44.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088632000000000001 2024-05-07T14:02:44.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869081+0000", 2024-05-07T14:02:44.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7195999999999997e-05 2024-05-07T14:02:44.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869151+0000", 2024-05-07T14:02:44.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0066000000000003e-05 2024-05-07T14:02:44.695 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.695 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.695 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.695 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.695 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:44.695 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.625136785999999, 2024-05-07T14:02:44.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:02:44.696 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.696 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.696 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.696 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.696 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.696 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.696 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:02:44.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.696 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:44.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:44.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:02:44.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:02:44.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:02:44.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:44.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:02:44.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:02:44.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:02:44.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:02:44.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:02:44.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:02:44.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:02:44.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:02:44.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:44.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:02:44.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:02:44.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.611967432, 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027821920000000002, 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.702 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 955 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974466+0000", 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0999999999999998e-06 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974480+0000", 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3876999999999999e-05 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974510+0000", 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0273e-05 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974525+0000", 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.485e-05 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974618+0000", 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2359000000000001e-05 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974822+0000", 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000204148 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.975126+0000", 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030382800000000002 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976565+0000", 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014395160000000001 2024-05-07T14:02:44.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976963+0000", 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00039772700000000001 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977128+0000", 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165508 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977246+0000", 2024-05-07T14:02:44.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011800599999999999 2024-05-07T14:02:44.708 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.708 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.708 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.708 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:44.708 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:44.708 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 96.608051868999993, 2024-05-07T14:02:44.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027683989999999999, 2024-05-07T14:02:44.708 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:44.708 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:44.708 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:44.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 957 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:44.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:44.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:44.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978382+0000", 2024-05-07T14:02:44.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.95e-06 2024-05-07T14:02:44.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:44.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978393+0000", 2024-05-07T14:02:44.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.084e-05 2024-05-07T14:02:44.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:44.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978424+0000", 2024-05-07T14:02:44.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1022999999999998e-05 2024-05-07T14:02:44.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:44.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978441+0000", 2024-05-07T14:02:44.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7782999999999999e-05 2024-05-07T14:02:44.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:44.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978565+0000", 2024-05-07T14:02:44.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012348900000000001 2024-05-07T14:02:44.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:44.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978794+0000", 2024-05-07T14:02:44.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000229335 2024-05-07T14:02:44.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:44.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.979262+0000", 2024-05-07T14:02:44.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046826700000000002 2024-05-07T14:02:44.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:44.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.980470+0000", 2024-05-07T14:02:44.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012071899999999999 2024-05-07T14:02:44.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:44.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981002+0000", 2024-05-07T14:02:44.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053222299999999996 2024-05-07T14:02:44.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:44.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981086+0000", 2024-05-07T14:02:44.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4073000000000006e-05 2024-05-07T14:02:44.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:44.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:44.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:44.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981148+0000", 2024-05-07T14:02:44.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2225999999999997e-05 2024-05-07T14:02:44.714 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.714 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.715 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.715 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:44.715 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:44.715 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:44.717 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:02:44.717 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:44.725+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:44.817 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:44.829+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:44.870 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:02:44.919 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:44.929+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:44.928 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:44.928 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:44.928 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:44.947 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:02:45.032 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:45.045+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:45.070 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:45.070 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:45.101 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:45.101 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:45.121 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:45.133+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:45.131 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:45.132 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:45.135 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:45.135 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:45.135 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:45.135 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:45.135 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:45.150 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:02:45.161 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:45.162 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:45.194 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:45.222 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:45.233+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:45.227 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:45.227 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:45.260 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:45.261 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:45.270 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:45.270 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:45.283 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:02:45.293 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:45.293 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:45.356 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:45.369+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:45.417 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:45.418 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:45.424 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:45.437+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:45.432 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:02:45.525 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:45.537+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:45.601 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:45.602 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:45.616 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:02:45.664 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:45.677+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:45.726 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:45.737+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:45.735 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:45.735 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:45.750 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:02:45.752 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:02:45.828 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:45.837+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:45.915 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:45.929 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:45.941+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:45.930 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:46.030 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:46.041+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:46.095 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:46.095 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:46.109 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:46.131 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:46.141+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:46.232 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:46.245+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:46.275 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:46.275 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:46.289 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:46.333 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:46.345+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:46.408 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:46.408 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:46.422 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:46.434 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:46.445+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:46.535 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:46.545+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:46.546 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:46.547 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:46.561 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:46.636 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:46.649+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:46.677 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:46.678 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:46.692 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:46.729 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:02:46.736 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:46.749+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:46.838 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:46.849+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:46.855 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:46.856 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:46.869 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:46.956 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:46.969+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:47.034 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:47.034 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:47.040 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:47.053+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:47.048 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:02:47.142 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:47.153+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:47.217 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:47.218 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:47.230 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:02:47.272 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:47.285+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:47.314 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:02:47.343 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:47.357+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:47.352 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:47.352 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:47.366 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:02:47.444 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:47.457+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:47.449 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:47.450 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:47.466 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:47.466 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:47.483 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:47.483 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:47.499 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:47.499 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:47.519 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:47.520 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:47.522 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:47.522 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:47.522 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:47.522 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:47.523 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:47.536 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:02:47.540 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:47.540 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:47.562 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:47.562 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:47.562 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:47.573+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:47.583 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:47.583 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:47.646 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:47.657+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:47.651 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:47.651 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:47.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:47.651 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:47.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.651 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:129 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'87, mlcod=17'85)", 2024-05-07T14:02:47.652 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:47.652 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 121.36527718400001, 2024-05-07T14:02:47.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034674469999999998, 2024-05-07T14:02:47.652 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.652 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.652 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.652 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:47.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299074+0000", 2024-05-07T14:02:47.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299075+0000", 2024-05-07T14:02:47.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.736e-06 2024-05-07T14:02:47.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299087+0000", 2024-05-07T14:02:47.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2067e-05 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299122+0000", 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4643e-05 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299141+0000", 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9224000000000001e-05 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299323+0000", 2024-05-07T14:02:47.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018190400000000001 2024-05-07T14:02:47.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.299385+0000", 2024-05-07T14:02:47.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2126999999999997e-05 2024-05-07T14:02:47.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302462+0000", 2024-05-07T14:02:47.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030768330000000002 2024-05-07T14:02:47.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302541+0000", 2024-05-07T14:02:47.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8912999999999995e-05 2024-05-07T14:02:47.656 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.656 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.656 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.656 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:131 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'89, mlcod=17'85)", 2024-05-07T14:02:47.656 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:47.656 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 121.363944511, 2024-05-07T14:02:47.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038759010000000002, 2024-05-07T14:02:47.656 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300406+0000", 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300407+0000", 2024-05-07T14:02:47.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0299999999999998e-07 2024-05-07T14:02:47.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300577+0000", 2024-05-07T14:02:47.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000170259 2024-05-07T14:02:47.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300592+0000", 2024-05-07T14:02:47.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4707e-05 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.300601+0000", 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999995e-06 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301133+0000", 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053150199999999999 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301186+0000", 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.342e-05 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304217+0000", 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030307429999999998 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304282+0000", 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5316999999999998e-05 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.660 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:132 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'90, mlcod=17'85)", 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 121.36289241599999, 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041397580000000003, 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301458+0000", 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301459+0000", 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.47e-07 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301470+0000", 2024-05-07T14:02:47.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0933e-05 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301483+0000", 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2427e-05 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.301491+0000", 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6130000000000004e-06 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302683+0000", 2024-05-07T14:02:47.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011919980000000001 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.302741+0000", 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7963000000000001e-05 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305494+0000", 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027531420000000001 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.305598+0000", 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103835 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:134 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'92, mlcod=17'85)", 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 121.360606519, 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037081470000000002, 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.665 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303744+0000", 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303747+0000", 2024-05-07T14:02:47.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303805+0000", 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8554999999999998e-05 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303829+0000", 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3799999999999999e-05 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.303871+0000", 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2079999999999997e-05 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304359+0000", 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048822999999999998 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.304415+0000", 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5405999999999998e-05 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307388+0000", 2024-05-07T14:02:47.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029728070000000001 2024-05-07T14:02:47.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307452+0000", 2024-05-07T14:02:47.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4789000000000006e-05 2024-05-07T14:02:47.669 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.669 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.669 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.669 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:137 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'95, mlcod=17'88)", 2024-05-07T14:02:47.669 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 121.356982618, 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004097552, 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307368+0000", 2024-05-07T14:02:47.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307370+0000", 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3939999999999999e-06 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307454+0000", 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4639000000000001e-05 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307474+0000", 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0242999999999999e-05 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307485+0000", 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0710000000000001e-05 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307538+0000", 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2623000000000001e-05 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.307566+0000", 2024-05-07T14:02:47.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.781e-05 2024-05-07T14:02:47.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311405+0000", 2024-05-07T14:02:47.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038392299999999999 2024-05-07T14:02:47.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311466+0000", 2024-05-07T14:02:47.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0903000000000003e-05 2024-05-07T14:02:47.674 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.674 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.674 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.674 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:138 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'96, mlcod=17'93)", 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 121.35368647999999, 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034036700000000001, 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310664+0000", 2024-05-07T14:02:47.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310666+0000", 2024-05-07T14:02:47.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:02:47.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310680+0000", 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4047e-05 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310715+0000", 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4826000000000002e-05 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310739+0000", 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3796000000000001e-05 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310862+0000", 2024-05-07T14:02:47.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123132 2024-05-07T14:02:47.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.310896+0000", 2024-05-07T14:02:47.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.43e-05 2024-05-07T14:02:47.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313965+0000", 2024-05-07T14:02:47.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030685959999999998 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314068+0000", 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102963 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 121.35278079699999, 2024-05-07T14:02:47.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:02:47.680 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.680 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.680 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.680 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:47.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:02:47.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:02:47.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:02:47.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:02:47.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:02:47.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:02:47.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:02:47.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:02:47.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:02:47.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:02:47.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:02:47.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:02:47.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:02:47.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:02:47.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:02:47.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 121.351874401, 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.684 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:02:47.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:02:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:02:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:02:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:02:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:02:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:02:47.688 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:47.689 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 121.350461782, 2024-05-07T14:02:47.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:02:47.689 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.689 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.689 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.689 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:47.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:02:47.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:02:47.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:02:47.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:02:47.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:02:47.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:02:47.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:02:47.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:02:47.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:02:47.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:02:47.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:143 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'101, mlcod=17'98)", 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 121.342569013, 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036609120000000001, 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.693 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.694 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:47.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321782+0000", 2024-05-07T14:02:47.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321783+0000", 2024-05-07T14:02:47.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3599999999999999e-06 2024-05-07T14:02:47.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321905+0000", 2024-05-07T14:02:47.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121923 2024-05-07T14:02:47.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321929+0000", 2024-05-07T14:02:47.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4295999999999999e-05 2024-05-07T14:02:47.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.321945+0000", 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5773999999999998e-05 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322070+0000", 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012457899999999999 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322101+0000", 2024-05-07T14:02:47.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1213000000000001e-05 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325342+0000", 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032410579999999998 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.325443+0000", 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100709 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:144 1.0 e17/15 1:30306672:devicehealth::main.db.0000000000000000:head v 17'102, mlcod=17'98)", 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 121.341500271, 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003406484, 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322850+0000", 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.322852+0000", 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8369999999999999e-06 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323022+0000", 2024-05-07T14:02:47.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016984199999999999 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323048+0000", 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5752999999999999e-05 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323071+0000", 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.266e-05 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323188+0000", 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011728200000000001 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.323224+0000", 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6380000000000001e-05 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326163+0000", 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029386170000000001 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.326257+0000", 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4112999999999998e-05 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.645169358, 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034691510000000002, 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.702 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 206 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019181+0000", 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019184+0000", 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6170000000000001e-06 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019198+0000", 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4113e-05 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019229+0000", 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0423e-05 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019244+0000", 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5047e-05 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019478+0000", 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000234398 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.019723+0000", 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024469500000000001 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.020149+0000", 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042592999999999998 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.021776+0000", 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001627688 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022453+0000", 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00067671500000000004 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022551+0000", 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8312000000000003e-05 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022651+0000", 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9213e-05 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.707 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.708 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.708 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:47.708 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:47.708 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.61788017799999, 2024-05-07T14:02:47.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038721300000000001, 2024-05-07T14:02:47.708 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.708 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.708 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:47.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:47.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 210 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046471+0000", 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046474+0000", 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.517e-06 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046487+0000", 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3113e-05 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046521+0000", 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3556000000000002e-05 2024-05-07T14:02:47.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046537+0000", 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.643e-05 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046651+0000", 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011368500000000001 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.046873+0000", 2024-05-07T14:02:47.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221802 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.047335+0000", 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046227300000000002 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.048993+0000", 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016576679999999999 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:47.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050186+0000", 2024-05-07T14:02:47.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001193284 2024-05-07T14:02:47.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050273+0000", 2024-05-07T14:02:47.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7189999999999997e-05 2024-05-07T14:02:47.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.050343+0000", 2024-05-07T14:02:47.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9611999999999997e-05 2024-05-07T14:02:47.713 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.713 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.714 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.714 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:47.714 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:47.714 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.588373432, 2024-05-07T14:02:47.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034712530000000001, 2024-05-07T14:02:47.714 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.714 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.714 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.714 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:47.714 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:47.714 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:47.715 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 218 2024-05-07T14:02:47.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.715 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:47.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075977+0000", 2024-05-07T14:02:47.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075980+0000", 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.774e-06 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.075992+0000", 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2283000000000001e-05 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076024+0000", 2024-05-07T14:02:47.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1242999999999999e-05 2024-05-07T14:02:47.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076038+0000", 2024-05-07T14:02:47.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4663e-05 2024-05-07T14:02:47.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076199+0000", 2024-05-07T14:02:47.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160865 2024-05-07T14:02:47.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.076539+0000", 2024-05-07T14:02:47.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033995800000000001 2024-05-07T14:02:47.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:47.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.077234+0000", 2024-05-07T14:02:47.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000694581 2024-05-07T14:02:47.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:47.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.078996+0000", 2024-05-07T14:02:47.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001762633 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079276+0000", 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027998399999999999 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079380+0000", 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103266 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079449+0000", 2024-05-07T14:02:47.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9003000000000003e-05 2024-05-07T14:02:47.720 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.720 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.720 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.720 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:47.720 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:47.720 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.5247913, 2024-05-07T14:02:47.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:02:47.720 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.720 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:02:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:02:47.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:02:47.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:02:47.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:02:47.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:02:47.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.49168064200001, 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.726 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:02:47.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:02:47.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:02:47.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:02:47.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:47.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:02:47.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:02:47.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:47.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:02:47.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:02:47.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:02:47.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:02:47.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:382 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.484770723, 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041680119999999996, 2024-05-07T14:02:47.732 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 382 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179580+0000", 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179581+0000", 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179585+0000", 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4800000000000003e-06 2024-05-07T14:02:47.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179598+0000", 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2322e-05 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179604+0000", 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.823e-06 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179657+0000", 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3937000000000002e-05 2024-05-07T14:02:47.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179714+0000", 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6165000000000002e-05 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.179830+0000", 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011632 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.180515+0000", 2024-05-07T14:02:47.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00068531400000000002 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183667+0000", 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031522009999999999 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183704+0000", 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6925999999999998e-05 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.183748+0000", 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3618999999999997e-05 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:499 6.13 e33/27 6:cedbb205:::obj_delete_at_hint.0000000017:head v 33'4, mlcod=33'1)", 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.411398069, 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043323679999999996, 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.738 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252953+0000", 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252954+0000", 2024-05-07T14:02:47.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.71e-07 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252960+0000", 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.46e-06 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252974+0000", 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4249e-05 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252982+0000", 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253055+0000", 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3162000000000002e-05 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.253075+0000", 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9451999999999999e-05 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257253+0000", 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041781179999999998 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257285+0000", 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2075e-05 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:550 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:47.742 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.375743887, 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035552140000000001, 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 550 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288607+0000", 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288608+0000", 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0529999999999999e-06 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288613+0000", 2024-05-07T14:02:47.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7060000000000003e-06 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288624+0000", 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1547e-05 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288630+0000", 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288734+0000", 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103872 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.288884+0000", 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014987400000000001 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289167+0000", 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028341999999999999 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:47.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.289813+0000", 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064550199999999995 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292082+0000", 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022696000000000001 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292120+0000", 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7367999999999999e-05 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292162+0000", 2024-05-07T14:02:47.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2568000000000003e-05 2024-05-07T14:02:47.748 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.748 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.748 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.748 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:667 6.9 6:94441385:::obj_delete_at_hint.0000000039:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:47.748 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:47.748 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.279801853, 2024-05-07T14:02:47.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050309150000000004, 2024-05-07T14:02:47.748 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 667 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:47.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384549+0000", 2024-05-07T14:02:47.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:47.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:47.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384550+0000", 2024-05-07T14:02:47.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7000000000000003e-07 2024-05-07T14:02:47.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:47.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384555+0000", 2024-05-07T14:02:47.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.135e-06 2024-05-07T14:02:47.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:47.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384565+0000", 2024-05-07T14:02:47.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0541e-05 2024-05-07T14:02:47.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:47.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384571+0000", 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.857e-06 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384670+0000", 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8461999999999993e-05 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.384822+0000", 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152039 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:47.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.385123+0000", 2024-05-07T14:02:47.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030070699999999999 2024-05-07T14:02:47.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:47.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.386099+0000", 2024-05-07T14:02:47.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097677300000000001 2024-05-07T14:02:47.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:47.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389495+0000", 2024-05-07T14:02:47.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033959139999999999 2024-05-07T14:02:47.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:47.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389530+0000", 2024-05-07T14:02:47.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.472e-05 2024-05-07T14:02:47.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:47.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:47.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:47.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.389580+0000", 2024-05-07T14:02:47.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9897e-05 2024-05-07T14:02:47.754 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.754 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.754 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.754 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:47.755 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:47.755 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:47.756 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:02:47.757 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:47.765+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:47.857 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:47.869+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:47.884 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:47.884 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:47.884 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:47.884 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:47.899 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:02:47.959 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:47.969+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:48.053 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:48.053 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:48.053 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:48.053 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:48.054 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:48.059 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:48.069+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:48.066 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:02:48.160 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:48.169+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:48.229 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:48.229 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:48.229 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:48.230 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:48.230 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.230 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:48.230 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:48.230 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 108.255762108, 2024-05-07T14:02:48.230 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:02:48.230 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.230 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.230 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:48.230 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.230 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:48.230 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:48.230 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.231 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:02:48.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:02:48.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:02:48.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:02:48.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:48.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:02:48.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:02:48.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.234 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.234 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:02:48.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:02:48.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.234 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.234 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:02:48.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:02:48.234 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.234 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.234 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 104.20859623699999, 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:02:48.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:02:48.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:02:48.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.238 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.238 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:02:48.238 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:02:48.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.238 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.239 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:02:48.239 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:02:48.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.239 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.239 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:02:48.239 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:02:48.239 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.239 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.239 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.240 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:48.240 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:48.240 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 104.108268517, 2024-05-07T14:02:48.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:02:48.240 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.240 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.240 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.240 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.240 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.240 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.241 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:02:48.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.241 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.241 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.242 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.245 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:02:48.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:02:48.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.245 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:02:48.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:02:48.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.245 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:02:48.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:02:48.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.246 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.246 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:02:48.246 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:02:48.246 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.246 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.246 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.20572446, 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.247 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:02:48.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:02:48.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.250 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.250 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:02:48.250 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:02:48.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.250 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.250 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:02:48.250 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:02:48.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:02:48.251 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.253 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.253 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:48.253 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.186414492, 2024-05-07T14:02:48.253 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:02:48.253 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.253 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.253 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.253 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.253 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.253 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.253 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.254 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.258 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.258 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:02:48.258 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:02:48.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.258 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.258 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:02:48.258 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:02:48.258 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.258 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.258 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.16104758199999, 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:02:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:02:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:02:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:02:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:02:48.262 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:02:48.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.141258198, 2024-05-07T14:02:48.264 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:02:48.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:02:48.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:02:48.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:02:48.270 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:02:48.270 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.270 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.270 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.270 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.270 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:48.270 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.108019837, 2024-05-07T14:02:48.270 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:02:48.270 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.271 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.271 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.271 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.271 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.271 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.271 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:02:48.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.271 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.271 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.271 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.272 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.273 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:02:48.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.276 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.276 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:02:48.276 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:02:48.276 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.276 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.276 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.276 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.276 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:48.276 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.072658816, 2024-05-07T14:02:48.276 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:02:48.277 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.277 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.277 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.277 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.277 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.277 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.277 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:02:48.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.277 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.277 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.277 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:48.278 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.278 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.278 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:48.278 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.278 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.278 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:02:48.278 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:02:48.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:02:48.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:02:48.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:02:48.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.04791525, 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:02:48.282 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.283 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:02:48.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:02:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:02:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:02:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:02:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:02:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:02:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:02:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:02:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.291 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.937038847, 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:48.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:02:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:02:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:02:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:02:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:02:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:02:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:02:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:02:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:02:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:02:48.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:02:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:02:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:02:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:02:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:02:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.297 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.880874898, 2024-05-07T14:02:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:02:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:02:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.298 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:02:48.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.303 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.864989713, 2024-05-07T14:02:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:02:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:02:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:02:48.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:02:48.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.615623461, 2024-05-07T14:02:48.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:02:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:02:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:48.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:02:48.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.554250638, 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.315 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:02:48.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:02:48.320 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.358462296, 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.321 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.322 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:02:48.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.322 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:48.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:48.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:02:48.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:48.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:02:48.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:02:48.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:02:48.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:02:48.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:02:48.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:02:48.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:02:48.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.354158846, 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003023937, 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.327 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 918 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886556+0000", 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886558+0000", 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1229999999999998e-06 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886569+0000", 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1497e-05 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886600+0000", 2024-05-07T14:02:48.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0809999999999998e-05 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886618+0000", 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7799e-05 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886736+0000", 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118276 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.886951+0000", 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021467200000000001 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.887437+0000", 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00048624900000000001 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.888687+0000", 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012498310000000001 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889318+0000", 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063122199999999997 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889463+0000", 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144769 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.889580+0000", 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011668899999999999 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.332 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.323158122, 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.333 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:02:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:02:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:02:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:02:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:02:48.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:02:48.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:02:48.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:02:48.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:02:48.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:02:48.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:02:48.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:48.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:02:48.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:02:48.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:02:48.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:02:48.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:02:48.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.31827323, 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.339 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:02:48.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:02:48.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:02:48.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.28635185900001, 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.345 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:48.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.350 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.351 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.351 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:48.352 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:02:48.353 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:48.365+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:48.412 INFO:tasks.workunit.client.0.smithi106.stderr:Note: switching to '1dfb479e40144c07778a01ea762def8ca56f6eee'. 2024-05-07T14:02:48.412 INFO:tasks.workunit.client.0.smithi106.stderr: 2024-05-07T14:02:48.412 INFO:tasks.workunit.client.0.smithi106.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-07T14:02:48.413 INFO:tasks.workunit.client.0.smithi106.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-07T14:02:48.413 INFO:tasks.workunit.client.0.smithi106.stderr:state without impacting any branches by switching back to a branch. 2024-05-07T14:02:48.413 INFO:tasks.workunit.client.0.smithi106.stderr: 2024-05-07T14:02:48.413 INFO:tasks.workunit.client.0.smithi106.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-07T14:02:48.413 INFO:tasks.workunit.client.0.smithi106.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-07T14:02:48.413 INFO:tasks.workunit.client.0.smithi106.stderr: 2024-05-07T14:02:48.414 INFO:tasks.workunit.client.0.smithi106.stderr: git switch -c 2024-05-07T14:02:48.414 INFO:tasks.workunit.client.0.smithi106.stderr: 2024-05-07T14:02:48.414 INFO:tasks.workunit.client.0.smithi106.stderr:Or undo this operation with: 2024-05-07T14:02:48.414 INFO:tasks.workunit.client.0.smithi106.stderr: 2024-05-07T14:02:48.414 INFO:tasks.workunit.client.0.smithi106.stderr: git switch - 2024-05-07T14:02:48.414 INFO:tasks.workunit.client.0.smithi106.stderr: 2024-05-07T14:02:48.414 INFO:tasks.workunit.client.0.smithi106.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-07T14:02:48.415 INFO:tasks.workunit.client.0.smithi106.stderr: 2024-05-07T14:02:48.415 INFO:tasks.workunit.client.0.smithi106.stderr:HEAD is now at 1dfb479e401 Merge branches 'pr-57104', 'pr-57231', 'pr-57242' and 'pr-57300' into wip-cbodley2-testing 2024-05-07T14:02:48.420 DEBUG:teuthology.orchestra.run.smithi106:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-07T14:02:48.465 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:48.476+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:48.469 INFO:tasks.workunit.client.0.smithi106.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-07T14:02:48.471 INFO:tasks.workunit.client.0.smithi106.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-07T14:02:48.471 INFO:tasks.workunit.client.0.smithi106.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-07T14:02:48.508 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:48.508 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:48.509 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:48.509 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:48.521 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:02:48.554 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:48.565+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:48.656 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:48.669+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:48.682 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:48.683 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:48.683 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:48.683 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:48.683 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:48.698 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:02:48.753 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:02:48.756 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:48.769+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:48.812 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:48.812 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:48.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:48.812 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:48.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.812 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:40 5.8 5:168cc6a2:::zonegroup_info.7881bf19-2c91-49be-82bb-722579314d1c:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:48.812 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 108.78234317499999, 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002658582, 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 40 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042176+0000", 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7719999999999999e-06 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042186+0000", 2024-05-07T14:02:48.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0020000000000001e-05 2024-05-07T14:02:48.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042209+0000", 2024-05-07T14:02:48.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3224e-05 2024-05-07T14:02:48.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042220+0000", 2024-05-07T14:02:48.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1153e-05 2024-05-07T14:02:48.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042358+0000", 2024-05-07T14:02:48.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137389 2024-05-07T14:02:48.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042594+0000", 2024-05-07T14:02:48.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023630100000000001 2024-05-07T14:02:48.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042900+0000", 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030576799999999999 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044463+0000", 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015627130000000001 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044675+0000", 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021186999999999999 2024-05-07T14:02:48.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044768+0000", 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3046000000000003e-05 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044833+0000", 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5326000000000004e-05 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 104.78778828999999, 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025872120000000002, 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 52 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036729+0000", 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036732+0000", 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4980000000000001e-06 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036744+0000", 2024-05-07T14:02:48.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2269999999999999e-05 2024-05-07T14:02:48.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036772+0000", 2024-05-07T14:02:48.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8002000000000001e-05 2024-05-07T14:02:48.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036817+0000", 2024-05-07T14:02:48.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4608999999999999e-05 2024-05-07T14:02:48.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036946+0000", 2024-05-07T14:02:48.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012988400000000001 2024-05-07T14:02:48.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037184+0000", 2024-05-07T14:02:48.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000237178 2024-05-07T14:02:48.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.037405+0000", 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221418 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.038548+0000", 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011433540000000001 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039179+0000", 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00063016999999999999 2024-05-07T14:02:48.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039231+0000", 2024-05-07T14:02:48.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2434e-05 2024-05-07T14:02:48.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.039316+0000", 2024-05-07T14:02:48.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5395000000000005e-05 2024-05-07T14:02:48.824 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.825 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.825 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.825 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.825 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:48.825 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.67920582799999, 2024-05-07T14:02:48.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:02:48.825 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.825 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.825 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.825 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:48.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:02:48.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:02:48.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:02:48.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:02:48.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:02:48.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:02:48.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:48.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:02:48.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:02:48.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:02:48.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:02:48.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:02:48.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:02:48.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:02:48.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:02:48.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.666786887, 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:02:48.831 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:02:48.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:02:48.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:02:48.836 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.66290716500001, 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.837 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:02:48.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:02:48.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:02:48.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:02:48.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:02:48.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:02:48.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:48.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:02:48.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:02:48.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:02:48.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:02:48.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:02:48.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:02:48.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:02:48.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:02:48.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:02:48.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:02:48.843 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.843 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.843 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.843 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.843 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:48.843 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.53225166199999, 2024-05-07T14:02:48.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:02:48.844 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.844 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.844 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.844 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.844 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.844 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.844 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:02:48.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.844 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:48.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:48.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:02:48.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:02:48.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:02:48.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:02:48.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:02:48.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:02:48.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:02:48.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:02:48.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:02:48.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:02:48.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:02:48.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:02:48.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:48.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:02:48.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:02:48.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:02:48.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:02:48.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:02:48.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:02:48.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:02:48.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:02:48.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:02:48.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:02:48.850 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.850 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.850 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.850 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.850 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:48.850 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.52508434000001, 2024-05-07T14:02:48.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:02:48.850 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:48.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:02:48.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:02:48.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:02:48.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:02:48.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:02:48.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:02:48.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:02:48.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:02:48.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:02:48.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:02:48.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:02:48.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:02:48.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:48.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:02:48.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:02:48.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:02:48.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:02:48.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:02:48.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:02:48.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:02:48.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:02:48.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:02:48.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:02:48.857 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.857 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.857 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.857 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:48.857 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:48.858 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.23455165199999, 2024-05-07T14:02:48.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:02:48.858 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.858 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.858 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.858 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:48.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:02:48.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:02:48.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:02:48.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:02:48.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:02:48.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:02:48.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:02:48.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:02:48.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:02:48.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:02:48.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:02:48.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:02:48.862 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.862 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.862 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.862 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.862 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:48.862 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.169470258, 2024-05-07T14:02:48.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025880500000000002, 2024-05-07T14:02:48.863 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.863 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.863 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.863 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.863 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.863 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.863 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 819 2024-05-07T14:02:48.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.863 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:48.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655047+0000", 2024-05-07T14:02:48.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655049+0000", 2024-05-07T14:02:48.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6640000000000001e-06 2024-05-07T14:02:48.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655057+0000", 2024-05-07T14:02:48.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5639999999999997e-06 2024-05-07T14:02:48.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655082+0000", 2024-05-07T14:02:48.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4119999999999999e-05 2024-05-07T14:02:48.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655093+0000", 2024-05-07T14:02:48.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1598e-05 2024-05-07T14:02:48.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655273+0000", 2024-05-07T14:02:48.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017975599999999999 2024-05-07T14:02:48.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655432+0000", 2024-05-07T14:02:48.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000158682 2024-05-07T14:02:48.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:48.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.655720+0000", 2024-05-07T14:02:48.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028791400000000001 2024-05-07T14:02:48.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.656823+0000", 2024-05-07T14:02:48.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001103435 2024-05-07T14:02:48.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657483+0000", 2024-05-07T14:02:48.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000659828 2024-05-07T14:02:48.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657571+0000", 2024-05-07T14:02:48.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7756000000000005e-05 2024-05-07T14:02:48.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.657635+0000", 2024-05-07T14:02:48.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4733000000000005e-05 2024-05-07T14:02:48.869 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.869 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.869 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.870 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.870 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:48.870 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.117194025, 2024-05-07T14:02:48.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028535079999999998, 2024-05-07T14:02:48.870 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.870 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.870 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.870 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.870 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.870 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.870 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 841 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707326+0000", 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707338+0000", 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2036e-05 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707367+0000", 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8816999999999999e-05 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707382+0000", 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4912999999999999e-05 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707523+0000", 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014165599999999999 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707748+0000", 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000224315 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.708055+0000", 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030739800000000001 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.709147+0000", 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001091788 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710030+0000", 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088367000000000003 2024-05-07T14:02:48.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710114+0000", 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3936000000000004e-05 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710177+0000", 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2675999999999994e-05 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.875 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.113527486, 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026153460000000002, 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 843 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710990+0000", 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710992+0000", 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.666e-06 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711000+0000", 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.977e-06 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711020+0000", 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.033e-05 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711030+0000", 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9790000000000005e-06 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711133+0000", 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102563 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711256+0000", 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012337599999999999 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.711555+0000", 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029948699999999997 2024-05-07T14:02:48.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.712654+0000", 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001098819 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713451+0000", 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000796424 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713541+0000", 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9981999999999993e-05 2024-05-07T14:02:48.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.713605+0000", 2024-05-07T14:02:48.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4743e-05 2024-05-07T14:02:48.881 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.881 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.881 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.881 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.881 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:48.882 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.10407137, 2024-05-07T14:02:48.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027995160000000002, 2024-05-07T14:02:48.882 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.882 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.882 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.882 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.882 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.882 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.882 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 847 2024-05-07T14:02:48.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.882 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720448+0000", 2024-05-07T14:02:48.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:02:48.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720460+0000", 2024-05-07T14:02:48.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1157e-05 2024-05-07T14:02:48.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720490+0000", 2024-05-07T14:02:48.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0960000000000002e-05 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720507+0000", 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6477000000000002e-05 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720681+0000", 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017396800000000001 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720897+0000", 2024-05-07T14:02:48.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215775 2024-05-07T14:02:48.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:48.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.721203+0000", 2024-05-07T14:02:48.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030621499999999998 2024-05-07T14:02:48.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.722485+0000", 2024-05-07T14:02:48.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012818599999999999 2024-05-07T14:02:48.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723091+0000", 2024-05-07T14:02:48.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060651499999999996 2024-05-07T14:02:48.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723182+0000", 2024-05-07T14:02:48.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0692999999999994e-05 2024-05-07T14:02:48.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723246+0000", 2024-05-07T14:02:48.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3643e-05 2024-05-07T14:02:48.888 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.888 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.888 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.888 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.888 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:48.888 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.100304021, 2024-05-07T14:02:48.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:02:48.889 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.889 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.889 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.889 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.889 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.889 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.889 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:02:48.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.889 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:48.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:48.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:02:48.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:02:48.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:02:48.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:02:48.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:02:48.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:02:48.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:02:48.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:48.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:02:48.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:02:48.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:02:48.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:02:48.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:48.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:02:48.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:02:48.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:02:48.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:02:48.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:02:48.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:02:48.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:02:48.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:02:48.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:02:48.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:02:48.895 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.895 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.054590625, 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.896 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:02:48.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:48.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:02:48.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:02:48.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:02:48.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:02:48.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:02:48.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:02:48.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.903 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.04831388700001, 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:02:48.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:02:48.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.961800767, 2024-05-07T14:02:48.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028016680000000002, 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 907 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862719+0000", 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862733+0000", 2024-05-07T14:02:48.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3067e-05 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862763+0000", 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0926000000000002e-05 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862779+0000", 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5787e-05 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862924+0000", 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014509899999999999 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863160+0000", 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000235701 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863523+0000", 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000362567 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.864872+0000", 2024-05-07T14:02:48.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00134954 2024-05-07T14:02:48.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865350+0000", 2024-05-07T14:02:48.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000478009 2024-05-07T14:02:48.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865437+0000", 2024-05-07T14:02:48.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6712999999999995e-05 2024-05-07T14:02:48.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865518+0000", 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1493000000000001e-05 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.95807148, 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027054290000000001, 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.915 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 909 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:48.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866448+0000", 2024-05-07T14:02:48.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:48.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866459+0000", 2024-05-07T14:02:48.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1207e-05 2024-05-07T14:02:48.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866491+0000", 2024-05-07T14:02:48.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362999999999998e-05 2024-05-07T14:02:48.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866506+0000", 2024-05-07T14:02:48.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4790000000000001e-05 2024-05-07T14:02:48.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866632+0000", 2024-05-07T14:02:48.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000126422 2024-05-07T14:02:48.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866761+0000", 2024-05-07T14:02:48.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128832 2024-05-07T14:02:48.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:48.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.867037+0000", 2024-05-07T14:02:48.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027612200000000001 2024-05-07T14:02:48.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.868118+0000", 2024-05-07T14:02:48.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001080941 2024-05-07T14:02:48.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869004+0000", 2024-05-07T14:02:48.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088632000000000001 2024-05-07T14:02:48.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869081+0000", 2024-05-07T14:02:48.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7195999999999997e-05 2024-05-07T14:02:48.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869151+0000", 2024-05-07T14:02:48.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0066000000000003e-05 2024-05-07T14:02:48.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.922 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.922 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.922 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.922 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:48.922 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.863222681, 2024-05-07T14:02:48.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:02:48.922 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:02:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:02:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:02:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:02:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:02:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:02:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:02:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:02:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:02:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:02:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:02:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:02:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:02:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:02:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:02:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:02:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:02:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:02:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:02:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:02:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:02:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.850053327, 2024-05-07T14:02:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027821920000000002, 2024-05-07T14:02:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 955 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974466+0000", 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0999999999999998e-06 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974480+0000", 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3876999999999999e-05 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974510+0000", 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0273e-05 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974525+0000", 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.485e-05 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974618+0000", 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2359000000000001e-05 2024-05-07T14:02:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974822+0000", 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000204148 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.975126+0000", 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030382800000000002 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976565+0000", 2024-05-07T14:02:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014395160000000001 2024-05-07T14:02:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976963+0000", 2024-05-07T14:02:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00039772700000000001 2024-05-07T14:02:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977128+0000", 2024-05-07T14:02:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165508 2024-05-07T14:02:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977246+0000", 2024-05-07T14:02:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011800599999999999 2024-05-07T14:02:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.84613776400001, 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027683989999999999, 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 957 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978382+0000", 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.95e-06 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978393+0000", 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.084e-05 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978424+0000", 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1022999999999998e-05 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978441+0000", 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7782999999999999e-05 2024-05-07T14:02:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978565+0000", 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012348900000000001 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978794+0000", 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000229335 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.979262+0000", 2024-05-07T14:02:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046826700000000002 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.980470+0000", 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012071899999999999 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981002+0000", 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053222299999999996 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981086+0000", 2024-05-07T14:02:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4073000000000006e-05 2024-05-07T14:02:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981148+0000", 2024-05-07T14:02:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2225999999999997e-05 2024-05-07T14:02:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:48.942 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:48.944 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:02:48.944 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:48.957+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:49.045 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:49.056+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:49.058 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:49.058 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:49.058 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:49.058 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:49.071 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:02:49.107 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:02:49.176 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:49.188+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:49.222 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:49.222 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:49.222 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:49.222 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:49.222 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:49.235 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:02:49.247 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:49.257+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:49.258 INFO:tasks.workunit.client.0.smithi106.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-07T14:02:49.324 INFO:tasks.workunit.client.0.smithi106.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-07T14:02:49.347 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:49.357+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:49.371 INFO:tasks.workunit.client.0.smithi106.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-07T14:02:49.373 INFO:tasks.workunit.client.0.smithi106.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-07T14:02:49.373 INFO:tasks.workunit.client.0.smithi106.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-07T14:02:49.385 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:49.385 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:49.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:49.385 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:49.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.385 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:02:49.385 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:49.385 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 107.395446698, 2024-05-07T14:02:49.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:02:49.385 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.385 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.385 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:49.386 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.386 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.386 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.386 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:02:49.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.386 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:49.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:02:49.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:49.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:02:49.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:02:49.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:02:49.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:02:49.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.375042878, 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.390 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:02:49.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:02:49.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:49.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:02:49.396 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.27279316400001, 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036480649999999998, 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 231 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:02:49.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125131+0000", 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125133+0000", 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.063e-06 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125143+0000", 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9769999999999995e-06 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125170+0000", 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7152999999999999e-05 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125184+0000", 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4372999999999999e-05 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125295+0000", 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111036 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125510+0000", 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215102 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.125920+0000", 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040954700000000001 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.127419+0000", 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001499261 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128635+0000", 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001215818 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128718+0000", 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3048999999999997e-05 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.128779+0000", 2024-05-07T14:02:49.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0686000000000001e-05 2024-05-07T14:02:49.402 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.402 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.402 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.402 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:235 6.0 e33/27 6:013d6c33:gc::gc.30:head v 33'2, mlcod=0'0)", 2024-05-07T14:02:49.402 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:02:49.402 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.257336143, 2024-05-07T14:02:49.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038113629999999999, 2024-05-07T14:02:49.402 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.402 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140588+0000", 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140590+0000", 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140604+0000", 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4324e-05 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140640+0000", 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6009e-05 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140659+0000", 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9340000000000001e-05 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140815+0000", 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155329 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140868+0000", 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3455999999999998e-05 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144310+0000", 2024-05-07T14:02:49.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034414239999999998 2024-05-07T14:02:49.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144399+0000", 2024-05-07T14:02:49.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9492000000000003e-05 2024-05-07T14:02:49.406 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.406 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.406 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.407 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:400 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:49.407 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:02:49.407 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.206914747, 2024-05-07T14:02:49.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039416900000000003, 2024-05-07T14:02:49.407 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.407 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.407 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.407 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.407 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.407 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.407 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 400 2024-05-07T14:02:49.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.407 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191009+0000", 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191010+0000", 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.09e-07 2024-05-07T14:02:49.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191014+0000", 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999996e-06 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191024+0000", 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0274e-05 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191030+0000", 2024-05-07T14:02:49.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.789e-06 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191085+0000", 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4741999999999999e-05 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191169+0000", 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4532999999999999e-05 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:49.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.191383+0000", 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021415400000000001 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194408+0000", 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003024901 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194860+0000", 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045153599999999999 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194915+0000", 2024-05-07T14:02:49.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4737999999999997e-05 2024-05-07T14:02:49.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194951+0000", 2024-05-07T14:02:49.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6183999999999998e-05 2024-05-07T14:02:49.412 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.412 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.412 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.412 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:403 6.2 e33/27 6:4798f7e9:::obj_delete_at_hint.0000000007:head v 33'4, mlcod=33'2)", 2024-05-07T14:02:49.412 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.203817067, 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003750841, 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194107+0000", 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194108+0000", 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.051e-06 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194116+0000", 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1149999999999994e-06 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194128+0000", 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1972e-05 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194135+0000", 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1130000000000003e-06 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194191+0000", 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194218+0000", 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6242e-05 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197807+0000", 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003589283 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.197858+0000", 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0572999999999998e-05 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.416 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:415 6.7 e33/27 6:e622f76a:gc::gc.20:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.196115225, 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044669840000000002, 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:49.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:49.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:49.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1799999999999995e-07 2024-05-07T14:02:49.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201814+0000", 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4170000000000002e-06 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201824+0000", 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0217999999999999e-05 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201838+0000", 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3723000000000001e-05 2024-05-07T14:02:49.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201890+0000", 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2320000000000001e-05 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201906+0000", 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5894999999999999e-05 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206242+0000", 2024-05-07T14:02:49.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043366489999999997 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206276+0000", 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:432 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.18486964500001, 2024-05-07T14:02:49.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045128019999999998, 2024-05-07T14:02:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 432 2024-05-07T14:02:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:49.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213055+0000", 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7000000000000005e-07 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213058+0000", 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0369999999999999e-06 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213066+0000", 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3680000000000002e-06 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213084+0000", 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7946999999999999e-05 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213127+0000", 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2673999999999998e-05 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213222+0000", 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5488000000000005e-05 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213412+0000", 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000189307 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:49.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.214754+0000", 2024-05-07T14:02:49.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001342069 2024-05-07T14:02:49.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:49.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217447+0000", 2024-05-07T14:02:49.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026931250000000002 2024-05-07T14:02:49.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217521+0000", 2024-05-07T14:02:49.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3997000000000003e-05 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217567+0000", 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6220000000000001e-05 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:430 6.7 e33/27 6:e1cdb60d:reshard::reshard.0000000008:head v 33'9, mlcod=33'6)", 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.184823162, 2024-05-07T14:02:49.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043702330000000003, 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0400000000000005e-07 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213107+0000", 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5740000000000003e-06 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213117+0000", 2024-05-07T14:02:49.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8349999999999999e-06 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213122+0000", 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5140000000000001e-06 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213169+0000", 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6551000000000002e-05 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213198+0000", 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217415+0000", 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042171090000000001 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217471+0000", 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5766000000000001e-05 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:480 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.15635900700001, 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052104459999999997, 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 480 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.432 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:49.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:49.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:49.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6199999999999997e-07 2024-05-07T14:02:49.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241570+0000", 2024-05-07T14:02:49.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2479999999999998e-06 2024-05-07T14:02:49.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241580+0000", 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8719999999999997e-06 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241584+0000", 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7210000000000002e-06 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241629+0000", 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4465000000000002e-05 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241671+0000", 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2370999999999998e-05 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241772+0000", 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101048 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.243876+0000", 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021036789999999998 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246710+0000", 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028339060000000002 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246747+0000", 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7061000000000003e-05 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246775+0000", 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8413000000000001e-05 2024-05-07T14:02:49.437 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:499 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.145478286, 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050166450000000001, 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.438 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 499 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:49.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4300000000000002e-07 2024-05-07T14:02:49.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252451+0000", 2024-05-07T14:02:49.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1290000000000004e-06 2024-05-07T14:02:49.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252463+0000", 2024-05-07T14:02:49.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1238e-05 2024-05-07T14:02:49.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252470+0000", 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2019999999999998e-06 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252534+0000", 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4178999999999997e-05 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252706+0000", 2024-05-07T14:02:49.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017197 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252871+0000", 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016508199999999999 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254444+0000", 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001573112 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:49.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257407+0000", 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029630989999999999 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257437+0000", 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0009999999999999e-05 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257462+0000", 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4780999999999999e-05 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.443 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:500 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.14519218300001, 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046354220000000002, 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 500 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.444 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252733+0000", 2024-05-07T14:02:49.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9399999999999993e-07 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252738+0000", 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6779999999999997e-06 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252750+0000", 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1882000000000001e-05 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252758+0000", 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0649999999999999e-06 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252811+0000", 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2859000000000003e-05 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252870+0000", 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8956000000000003e-05 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:49.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252992+0000", 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122275 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254326+0000", 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013334449999999999 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257254+0000", 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029284039999999999 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257316+0000", 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1348999999999998e-05 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257367+0000", 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1514999999999997e-05 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:510 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:02:49.449 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.13910954399999, 2024-05-07T14:02:49.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041639090000000004, 2024-05-07T14:02:49.450 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.450 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.450 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.450 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.450 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.450 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.450 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 510 2024-05-07T14:02:49.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.450 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:02:49.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:02:49.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258815+0000", 2024-05-07T14:02:49.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258819+0000", 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0090000000000001e-06 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258828+0000", 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2529999999999993e-06 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258833+0000", 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7219999999999999e-06 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258870+0000", 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6368000000000001e-05 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258915+0000", 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.528e-05 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:49.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.259016+0000", 2024-05-07T14:02:49.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010074200000000001 2024-05-07T14:02:49.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:49.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.260655+0000", 2024-05-07T14:02:49.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016394999999999999 2024-05-07T14:02:49.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:49.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262752+0000", 2024-05-07T14:02:49.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002096531 2024-05-07T14:02:49.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262871+0000", 2024-05-07T14:02:49.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119645 2024-05-07T14:02:49.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262978+0000", 2024-05-07T14:02:49.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010695400000000001 2024-05-07T14:02:49.455 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.455 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.455 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.456 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:552 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:49.456 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:02:49.456 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.10735004199999, 2024-05-07T14:02:49.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042166790000000001, 2024-05-07T14:02:49.456 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.456 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.456 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.456 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.456 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.456 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.456 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 552 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290575+0000", 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.85e-07 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290578+0000", 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999999e-06 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290587+0000", 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.268e-06 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290592+0000", 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7029999999999997e-06 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290694+0000", 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101841 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290840+0000", 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014613899999999999 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.291137+0000", 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029714800000000001 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292561+0000", 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014235020000000001 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294568+0000", 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020076540000000002 2024-05-07T14:02:49.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294692+0000", 2024-05-07T14:02:49.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012394500000000001 2024-05-07T14:02:49.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294790+0000", 2024-05-07T14:02:49.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8194000000000002e-05 2024-05-07T14:02:49.461 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.461 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.461 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:553 6.f e33/27 6:f24cb4a8:gc::gc.31:head v 33'4, mlcod=33'2)", 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 102.105091184, 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043350139999999999, 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2900000000000004e-07 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292838+0000", 2024-05-07T14:02:49.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5560000000000001e-06 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292847+0000", 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8619999999999992e-06 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292851+0000", 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9010000000000002e-06 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292922+0000", 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0827000000000005e-05 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292973+0000", 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0492999999999999e-05 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297114+0000", 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041408970000000002 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297168+0000", 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3949000000000001e-05 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:686 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.99534529899999, 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046254349999999998, 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.466 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 686 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:49.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402581+0000", 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402592+0000", 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0984e-05 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402619+0000", 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7583e-05 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402633+0000", 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3553000000000001e-05 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402699+0000", 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6013000000000006e-05 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402792+0000", 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3455999999999994e-05 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402928+0000", 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013596800000000001 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.403918+0000", 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00099017000000000007 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407144+0000", 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032257449999999999 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407180+0000", 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5462e-05 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407204+0000", 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4247999999999999e-05 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.471 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.72643372100001, 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003355448, 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.472 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 826 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671490+0000", 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671493+0000", 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-06 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671506+0000", 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2746e-05 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671542+0000", 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6162999999999999e-05 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671557+0000", 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4786999999999999e-05 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671705+0000", 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000147792 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.671872+0000", 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016705499999999999 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.672101+0000", 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022892999999999999 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.673101+0000", 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001000775 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674701+0000", 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016000599999999999 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674795+0000", 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3653000000000006e-05 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.674846+0000", 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0473000000000003e-05 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:868 6.f e33/27 6:f6792a7a:::obj_delete_at_hint.0000000097:head v 33'10, mlcod=33'8)", 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:02:49.477 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.62702923499999, 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033639339999999998, 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770895+0000", 2024-05-07T14:02:49.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770897+0000", 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9700000000000002e-06 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770909+0000", 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2034e-05 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770937+0000", 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.796e-05 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770954+0000", 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7555999999999999e-05 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771084+0000", 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013033599999999999 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.771136+0000", 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1925999999999997e-05 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774168+0000", 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030316200000000001 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774259+0000", 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0532000000000007e-05 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.563039042, 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035607859999999998, 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 895 2024-05-07T14:02:49.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834885+0000", 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834888+0000", 2024-05-07T14:02:49.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.41e-06 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834899+0000", 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0987e-05 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834929+0000", 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9706e-05 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.834943+0000", 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4354e-05 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835100+0000", 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156582 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.835499+0000", 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000399214 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:49.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.836052+0000", 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00055334500000000001 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.837279+0000", 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012266270000000001 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838177+0000", 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089768699999999999 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838332+0000", 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155155 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.838446+0000", 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113719 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:02:49.487 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 101.555511513, 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033546700000000001, 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 898 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842412+0000", 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842414+0000", 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.863e-06 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842425+0000", 2024-05-07T14:02:49.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0533000000000001e-05 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842450+0000", 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5259999999999999e-05 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842463+0000", 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3373000000000001e-05 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:49.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842599+0000", 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013549600000000001 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.842936+0000", 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033763400000000001 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.843484+0000", 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054733899999999999 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:49.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.844749+0000", 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012656639999999999 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845499+0000", 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074904400000000003 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845646+0000", 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014709900000000001 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:49.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.845767+0000", 2024-05-07T14:02:49.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121365 2024-05-07T14:02:49.493 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.493 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.493 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.493 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:49.493 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:49.493 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:49.495 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:02:49.495 INFO:tasks.workunit.client.0.smithi106.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-07T14:02:49.496 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-05-07T14:02:49.496 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-07T14:02:49.496 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:49.505+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:49.501 INFO:tasks.workunit:Running workunits matching rgw/s3_bucket_quota.pl on client.0... 2024-05-07T14:02:49.502 INFO:tasks.workunit:Running workunit rgw/s3_bucket_quota.pl... 2024-05-07T14:02:49.503 DEBUG:teuthology.orchestra.run.smithi106:workunit test rgw/s3_bucket_quota.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1dfb479e40144c07778a01ea762def8ca56f6eee TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl 2024-05-07T14:02:49.595 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:49.604+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:49.604 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:02:49.628 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:49.628 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:49.628 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:49.629 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:49.643 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:02:49.696 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:49.709+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:49.750 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:49.750 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:49.764 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:49.764 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:49.764 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:49.765 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:49.765 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:49.766 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:49.766 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:49.778 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:02:49.783 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:49.783 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:49.800 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:49.800 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:49.817 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:49.818 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:49.820 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:49.833+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:49.835 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:49.850 INFO:tasks.workunit.client.0.smithi106.stderr:1+0 records in 2024-05-07T14:02:49.850 INFO:tasks.workunit.client.0.smithi106.stderr:1+0 records out 2024-05-07T14:02:49.850 INFO:tasks.workunit.client.0.smithi106.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0103473 s, 1.0 GB/s 2024-05-07T14:02:49.853 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:49.870 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:49.898 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:49.909+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:49.948 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:49.948 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:49.964 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:02:50.012 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:50.025+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:50.073 INFO:tasks.workunit.client.0.smithi106.stdout:Bucket Created: buck_2024_04_7_14_02_50 2024-05-07T14:02:50.101 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:50.112+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:50.140 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:50.140 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:50.156 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:50.201 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:50.212+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:50.217 INFO:tasks.workunit.client.0.smithi106.stdout:quota set for the bucket: buck_2024_04_7_14_02_50 2024-05-07T14:02:50.280 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:50.281 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:50.296 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:50.340 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:50.353+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:50.404 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:50.413+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:50.417 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:50.417 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:50.437 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:50.462 INFO:tasks.workunit.client.0.smithi106.stdout:quota enabled for the bucket: buck_2024_04_7_14_02_50 2024-05-07T14:02:50.462 INFO:tasks.workunit.client.0.smithi106.stdout:adding file to bucket: 10Mb. 2024-05-07T14:02:50.462 INFO:tasks.workunit.client.0.smithi106.stdout:upload file successful 2024-05-07T14:02:50.462 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:50.462 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - Test max objects passed 2024-05-07T14:02:50.462 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:50.524 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:50.537+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:50.605 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:50.617+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:50.611 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:50.611 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:50.628 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:50.707 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:50.716+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:50.716 INFO:tasks.workunit.client.0.smithi106.stdout:user qa_user deleted 2024-05-07T14:02:50.716 INFO:tasks.workunit.client.0.smithi106.stdout:bucket delete succeeded 2024-05-07T14:02:50.746 INFO:tasks.workunit.client.0.smithi106.stderr:1+0 records in 2024-05-07T14:02:50.746 INFO:tasks.workunit.client.0.smithi106.stderr:1+0 records out 2024-05-07T14:02:50.746 INFO:tasks.workunit.client.0.smithi106.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0258778 s, 405 MB/s 2024-05-07T14:02:50.799 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:50.799 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:50.807 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:50.816+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:50.813 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:50.906 INFO:tasks.workunit.client.0.smithi106.stdout:Bucket Created: buck_2024_04_7_14_02_50 2024-05-07T14:02:50.907 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:50.916+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:50.934 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:50.934 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:50.950 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:51.008 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:51.021+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:51.076 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:51.076 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:51.090 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:51.129 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:02:51.132 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:51.145+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:51.185 INFO:tasks.workunit.client.0.smithi106.stdout:bucket quota max_objs set for the given user: buck_2024_04_7_14_02_50 2024-05-07T14:02:51.211 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:51.221+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:51.252 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:51.252 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:51.267 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:02:51.312 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:51.320+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:51.413 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:51.425+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:51.416 INFO:tasks.workunit.client.0.smithi106.stdout:quota enabled for the bucket: buck_2024_04_7_14_02_50 2024-05-07T14:02:51.416 INFO:tasks.workunit.client.0.smithi106.stdout:adding file to bucket: 10Mb. 2024-05-07T14:02:51.416 INFO:tasks.workunit.client.0.smithi106.stdout:upload file successful 2024-05-07T14:02:51.416 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:51.416 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - Test max objects for the given user passed 2024-05-07T14:02:51.416 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:51.429 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:51.429 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:51.442 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:02:51.513 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:51.524+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:51.562 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:51.562 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:51.574 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:02:51.621 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:51.632+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:51.676 INFO:tasks.workunit.client.0.smithi106.stdout:user qa_user deleted 2024-05-07T14:02:51.677 INFO:tasks.workunit.client.0.smithi106.stdout:bucket delete succeeded 2024-05-07T14:02:51.715 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:51.724+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:51.729 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:51.730 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:51.739 INFO:tasks.workunit.client.0.smithi106.stderr:1+0 records in 2024-05-07T14:02:51.739 INFO:tasks.workunit.client.0.smithi106.stderr:1+0 records out 2024-05-07T14:02:51.739 INFO:tasks.workunit.client.0.smithi106.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.059712 s, 176 MB/s 2024-05-07T14:02:51.742 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:02:51.816 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:51.829+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:51.889 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:02:51.903 INFO:tasks.workunit.client.0.smithi106.stdout:Bucket Created: buck_2024_04_7_14_02_51 2024-05-07T14:02:51.906 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:51.906 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:51.917 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:51.928+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:51.921 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:02:52.018 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:52.028+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:52.028 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:52.029 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:52.048 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:52.049 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:52.057 INFO:tasks.workunit.client.0.smithi106.stdout:quota set for the bucket: buck_2024_04_7_14_02_51 2024-05-07T14:02:52.068 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:52.069 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:52.084 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:52.085 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:52.085 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:52.085 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:52.085 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:52.101 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:02:52.105 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:52.105 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:52.119 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:52.129+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:52.127 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:52.127 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:52.148 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:52.149 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:52.174 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:52.236 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:52.248+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:52.242 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:52.242 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:52.242 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:52.242 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:52.243 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:52.259 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:02:52.301 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:02:52.320 INFO:tasks.workunit.client.0.smithi106.stdout:quota enabled for the bucket: buck_2024_04_7_14_02_51 2024-05-07T14:02:52.320 INFO:tasks.workunit.client.0.smithi106.stdout:adding file to bucket: 10Mb. 2024-05-07T14:02:52.320 INFO:tasks.workunit.client.0.smithi106.stdout:upload file successful 2024-05-07T14:02:52.320 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:52.333+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:52.331 INFO:tasks.workunit.client.0.smithi106.stderr:1+0 records in 2024-05-07T14:02:52.332 INFO:tasks.workunit.client.0.smithi106.stderr:1+0 records out 2024-05-07T14:02:52.332 INFO:tasks.workunit.client.0.smithi106.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00952808 s, 1.1 GB/s 2024-05-07T14:02:52.379 INFO:tasks.workunit.client.0.smithi106.stdout:readding file to bucket: 10MBfile1 2024-05-07T14:02:52.379 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:52.379 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - set max objects and test beyond max objects passed 2024-05-07T14:02:52.379 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:52.414 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:52.414 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:52.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:52.415 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:52.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.415 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:52.415 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:52.416 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 112.44087393300001, 2024-05-07T14:02:52.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:02:52.416 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.416 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.416 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:52.416 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.417 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:52.417 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:52.417 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:02:52.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.417 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:52.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:52.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:02:52.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:02:52.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:02:52.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:02:52.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:02:52.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:02:52.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:02:52.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:02:52.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:02:52.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:02:52.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:52.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:02:52.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:02:52.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:02:52.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:02:52.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:02:52.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:02:52.426 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.426 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.426 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.426 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:52.427 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:52.427 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 108.393708062, 2024-05-07T14:02:52.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:02:52.427 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.427 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.427 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.427 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:52.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:52.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:02:52.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:02:52.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:02:52.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:02:52.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:02:52.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:02:52.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:02:52.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:02:52.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:02:52.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:02:52.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:02:52.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:02:52.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.431 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 108.29338034200001, 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032524110000000002, 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 193 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132446+0000", 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132448+0000", 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.227e-06 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132460+0000", 2024-05-07T14:02:52.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.133e-05 2024-05-07T14:02:52.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132491+0000", 2024-05-07T14:02:52.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0988999999999998e-05 2024-05-07T14:02:52.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132505+0000", 2024-05-07T14:02:52.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4572999999999999e-05 2024-05-07T14:02:52.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132622+0000", 2024-05-07T14:02:52.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011684900000000001 2024-05-07T14:02:52.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.132843+0000", 2024-05-07T14:02:52.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022081600000000001 2024-05-07T14:02:52.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:52.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.133102+0000", 2024-05-07T14:02:52.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025907099999999999 2024-05-07T14:02:52.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.134684+0000", 2024-05-07T14:02:52.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015815969999999999 2024-05-07T14:02:52.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135529+0000", 2024-05-07T14:02:52.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084490800000000001 2024-05-07T14:02:52.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135622+0000", 2024-05-07T14:02:52.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3024999999999998e-05 2024-05-07T14:02:52.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.135699+0000", 2024-05-07T14:02:52.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7026000000000004e-05 2024-05-07T14:02:52.437 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.437 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.438 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.438 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.438 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:52.438 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.39083628500001, 2024-05-07T14:02:52.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:02:52.439 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.439 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.439 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.439 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.439 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.439 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.439 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:02:52.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.440 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:52.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:52.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:02:52.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:02:52.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:02:52.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:02:52.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:02:52.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:02:52.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:02:52.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:02:52.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:02:52.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:02:52.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:02:52.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:02:52.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:02:52.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:02:52.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:02:52.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.371526317, 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003191751, 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.445 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.446 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.446 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 212 2024-05-07T14:02:52.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.446 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:52.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054300+0000", 2024-05-07T14:02:52.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054302+0000", 2024-05-07T14:02:52.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:02:52.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054311+0000", 2024-05-07T14:02:52.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3230000000000004e-06 2024-05-07T14:02:52.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054333+0000", 2024-05-07T14:02:52.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1359e-05 2024-05-07T14:02:52.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054378+0000", 2024-05-07T14:02:52.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040000000000002e-05 2024-05-07T14:02:52.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054505+0000", 2024-05-07T14:02:52.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012725200000000001 2024-05-07T14:02:52.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.054713+0000", 2024-05-07T14:02:52.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000207562 2024-05-07T14:02:52.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:52.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.055100+0000", 2024-05-07T14:02:52.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038774000000000002 2024-05-07T14:02:52.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.056623+0000", 2024-05-07T14:02:52.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015229620000000001 2024-05-07T14:02:52.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057344+0000", 2024-05-07T14:02:52.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072040799999999996 2024-05-07T14:02:52.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057429+0000", 2024-05-07T14:02:52.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5421999999999996e-05 2024-05-07T14:02:52.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.057492+0000", 2024-05-07T14:02:52.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2912999999999999e-05 2024-05-07T14:02:52.454 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.454 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.454 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.455 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.455 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:52.455 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.346159407, 2024-05-07T14:02:52.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033484539999999998, 2024-05-07T14:02:52.455 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.455 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.455 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.455 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.455 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.455 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.455 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 219 2024-05-07T14:02:52.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.455 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079667+0000", 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079669+0000", 2024-05-07T14:02:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3300000000000001e-06 2024-05-07T14:02:52.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079682+0000", 2024-05-07T14:02:52.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2407e-05 2024-05-07T14:02:52.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079713+0000", 2024-05-07T14:02:52.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.074e-05 2024-05-07T14:02:52.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079728+0000", 2024-05-07T14:02:52.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4956e-05 2024-05-07T14:02:52.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.079845+0000", 2024-05-07T14:02:52.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011773999999999999 2024-05-07T14:02:52.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080081+0000", 2024-05-07T14:02:52.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023531100000000001 2024-05-07T14:02:52.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:52.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.080508+0000", 2024-05-07T14:02:52.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042773000000000003 2024-05-07T14:02:52.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.081812+0000", 2024-05-07T14:02:52.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013033400000000001 2024-05-07T14:02:52.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082856+0000", 2024-05-07T14:02:52.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001044358 2024-05-07T14:02:52.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.082950+0000", 2024-05-07T14:02:52.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3865999999999999e-05 2024-05-07T14:02:52.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.083016+0000", 2024-05-07T14:02:52.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5675999999999999e-05 2024-05-07T14:02:52.461 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.461 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.461 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.462 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.462 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:52.462 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.326370023, 2024-05-07T14:02:52.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:02:52.462 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.462 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.462 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.462 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.462 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.462 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.462 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:02:52.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.463 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:52.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:52.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:02:52.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:02:52.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:02:52.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:02:52.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:02:52.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:02:52.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:02:52.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:02:52.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:52.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:02:52.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:02:52.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:02:52.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:02:52.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:02:52.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:02:52.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.469 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.469 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:52.469 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.29313166199999, 2024-05-07T14:02:52.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032623040000000002, 2024-05-07T14:02:52.469 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.469 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.469 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.469 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.469 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.469 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.470 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 233 2024-05-07T14:02:52.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.470 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:52.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132695+0000", 2024-05-07T14:02:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132697+0000", 2024-05-07T14:02:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.243e-06 2024-05-07T14:02:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132709+0000", 2024-05-07T14:02:52.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1453e-05 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132740+0000", 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1529999999999998e-05 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132755+0000", 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5290000000000001e-05 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.132887+0000", 2024-05-07T14:02:52.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013121199999999999 2024-05-07T14:02:52.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133125+0000", 2024-05-07T14:02:52.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023820499999999999 2024-05-07T14:02:52.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:52.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.133547+0000", 2024-05-07T14:02:52.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042190000000000001 2024-05-07T14:02:52.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.134810+0000", 2024-05-07T14:02:52.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012632170000000001 2024-05-07T14:02:52.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135654+0000", 2024-05-07T14:02:52.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084446 2024-05-07T14:02:52.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135826+0000", 2024-05-07T14:02:52.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017210500000000001 2024-05-07T14:02:52.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.135957+0000", 2024-05-07T14:02:52.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130689 2024-05-07T14:02:52.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.475 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.476 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.476 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:52.476 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.25777064099999, 2024-05-07T14:02:52.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:02:52.477 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.477 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.477 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.477 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.477 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.477 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.478 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:02:52.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.478 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:52.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:52.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:02:52.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:02:52.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:02:52.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:02:52.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.482 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.482 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:02:52.482 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:02:52.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.482 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:02:52.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:02:52.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:02:52.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:02:52.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:02:52.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:02:52.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:02:52.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:02:52.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.233027075, 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:02:52.486 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.488 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:52.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.488 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:02:52.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:02:52.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.488 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:02:52.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:02:52.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:02:52.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:02:52.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:02:52.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:52.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:02:52.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:02:52.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:02:52.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:02:52.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:02:52.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:02:52.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:02:52.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:02:52.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.122150672, 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.493 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:52.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.498 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.499 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.499 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.499 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:52.499 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.06598672299999, 2024-05-07T14:02:52.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:02:52.500 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.500 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.500 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.500 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.500 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.500 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.501 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:02:52.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.501 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:52.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:52.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:02:52.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:52.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:02:52.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:02:52.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:02:52.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:02:52.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:02:52.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:02:52.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:02:52.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:02:52.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:02:52.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:02:52.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:52.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:02:52.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:02:52.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:02:52.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:02:52.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:02:52.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:02:52.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:02:52.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:02:52.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:02:52.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:02:52.506 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.506 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.506 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.506 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:656 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.05010153800001, 2024-05-07T14:02:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00309793, 2024-05-07T14:02:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 656 2024-05-07T14:02:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:52.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375725+0000", 2024-05-07T14:02:52.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375727+0000", 2024-05-07T14:02:52.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:52.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375738+0000", 2024-05-07T14:02:52.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1123e-05 2024-05-07T14:02:52.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375768+0000", 2024-05-07T14:02:52.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0185999999999999e-05 2024-05-07T14:02:52.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375783+0000", 2024-05-07T14:02:52.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.432e-05 2024-05-07T14:02:52.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.375880+0000", 2024-05-07T14:02:52.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7483000000000002e-05 2024-05-07T14:02:52.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376017+0000", 2024-05-07T14:02:52.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000136864 2024-05-07T14:02:52.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:52.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.376238+0000", 2024-05-07T14:02:52.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022056699999999999 2024-05-07T14:02:52.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.377088+0000", 2024-05-07T14:02:52.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00084999900000000005 2024-05-07T14:02:52.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378735+0000", 2024-05-07T14:02:52.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001647786 2024-05-07T14:02:52.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378784+0000", 2024-05-07T14:02:52.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8409999999999999e-05 2024-05-07T14:02:52.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.378823+0000", 2024-05-07T14:02:52.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9022e-05 2024-05-07T14:02:52.513 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.513 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.513 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.513 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.514 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:52.514 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 104.80073528600001, 2024-05-07T14:02:52.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003227462, 2024-05-07T14:02:52.514 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.514 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.514 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.514 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.514 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.514 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.514 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 805 2024-05-07T14:02:52.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.514 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.515 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:52.515 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.515 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625091+0000", 2024-05-07T14:02:52.515 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625094+0000", 2024-05-07T14:02:52.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2630000000000002e-06 2024-05-07T14:02:52.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625105+0000", 2024-05-07T14:02:52.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:02:52.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625135+0000", 2024-05-07T14:02:52.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0122999999999999e-05 2024-05-07T14:02:52.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625150+0000", 2024-05-07T14:02:52.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.438e-05 2024-05-07T14:02:52.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625286+0000", 2024-05-07T14:02:52.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013610599999999999 2024-05-07T14:02:52.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625508+0000", 2024-05-07T14:02:52.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022203500000000001 2024-05-07T14:02:52.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:52.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.625836+0000", 2024-05-07T14:02:52.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032777799999999998 2024-05-07T14:02:52.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.627016+0000", 2024-05-07T14:02:52.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001180237 2024-05-07T14:02:52.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628038+0000", 2024-05-07T14:02:52.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010219389999999999 2024-05-07T14:02:52.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628198+0000", 2024-05-07T14:02:52.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016000199999999999 2024-05-07T14:02:52.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.520 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.520 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.628319+0000", 2024-05-07T14:02:52.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120976 2024-05-07T14:02:52.520 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.520 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.520 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.520 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.521 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:52.521 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 104.73936246300001, 2024-05-07T14:02:52.521 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031115019999999999, 2024-05-07T14:02:52.521 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.521 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.521 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.521 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.521 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.521 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.521 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 832 2024-05-07T14:02:52.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.521 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:52.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686464+0000", 2024-05-07T14:02:52.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686466+0000", 2024-05-07T14:02:52.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:52.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686479+0000", 2024-05-07T14:02:52.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:52.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686510+0000", 2024-05-07T14:02:52.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0818999999999997e-05 2024-05-07T14:02:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686525+0000", 2024-05-07T14:02:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4895999999999999e-05 2024-05-07T14:02:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686643+0000", 2024-05-07T14:02:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118786 2024-05-07T14:02:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.686895+0000", 2024-05-07T14:02:52.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000251687 2024-05-07T14:02:52.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:52.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.687369+0000", 2024-05-07T14:02:52.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047438500000000002 2024-05-07T14:02:52.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.688667+0000", 2024-05-07T14:02:52.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001297863 2024-05-07T14:02:52.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.526 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.526 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689411+0000", 2024-05-07T14:02:52.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00074384400000000002 2024-05-07T14:02:52.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.526 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.526 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689497+0000", 2024-05-07T14:02:52.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6229000000000004e-05 2024-05-07T14:02:52.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.689576+0000", 2024-05-07T14:02:52.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8265999999999999e-05 2024-05-07T14:02:52.527 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.527 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.527 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.527 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.527 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:52.527 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 104.54357412100001, 2024-05-07T14:02:52.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031447020000000001, 2024-05-07T14:02:52.528 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.528 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.528 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.528 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.528 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.528 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.528 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 916 2024-05-07T14:02:52.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.528 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:52.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882252+0000", 2024-05-07T14:02:52.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882255+0000", 2024-05-07T14:02:52.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:52.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882268+0000", 2024-05-07T14:02:52.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3803e-05 2024-05-07T14:02:52.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882298+0000", 2024-05-07T14:02:52.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663e-05 2024-05-07T14:02:52.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882313+0000", 2024-05-07T14:02:52.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4517e-05 2024-05-07T14:02:52.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882450+0000", 2024-05-07T14:02:52.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137699 2024-05-07T14:02:52.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.882682+0000", 2024-05-07T14:02:52.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000231351 2024-05-07T14:02:52.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:52.532 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.883014+0000", 2024-05-07T14:02:52.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033248099999999998 2024-05-07T14:02:52.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.532 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.884124+0000", 2024-05-07T14:02:52.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011097780000000001 2024-05-07T14:02:52.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.532 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885112+0000", 2024-05-07T14:02:52.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098824500000000001 2024-05-07T14:02:52.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885274+0000", 2024-05-07T14:02:52.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016144600000000001 2024-05-07T14:02:52.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.885397+0000", 2024-05-07T14:02:52.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123449 2024-05-07T14:02:52.533 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.534 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.534 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.534 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.534 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:52.534 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 104.508269947, 2024-05-07T14:02:52.534 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:02:52.534 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.534 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.534 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.534 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.535 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.535 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.535 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:02:52.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.535 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.535 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:52.535 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:52.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:02:52.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:52.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:02:52.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:02:52.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:02:52.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:02:52.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:02:52.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:02:52.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:02:52.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:02:52.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.538 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:02:52.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:02:52.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.538 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:52.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:02:52.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:02:52.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.539 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.539 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:02:52.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:02:52.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.539 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.539 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:02:52.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:02:52.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:02:52.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:02:52.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:02:52.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:02:52.540 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.540 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.540 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.541 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.541 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:52.541 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 104.503385055, 2024-05-07T14:02:52.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003256802, 2024-05-07T14:02:52.541 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.541 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.541 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.541 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.541 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.541 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.541 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 933 2024-05-07T14:02:52.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.542 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:52.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922441+0000", 2024-05-07T14:02:52.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922444+0000", 2024-05-07T14:02:52.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0870000000000001e-06 2024-05-07T14:02:52.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922454+0000", 2024-05-07T14:02:52.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0686000000000001e-05 2024-05-07T14:02:52.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922486+0000", 2024-05-07T14:02:52.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.146e-05 2024-05-07T14:02:52.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.544 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922505+0000", 2024-05-07T14:02:52.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8940000000000002e-05 2024-05-07T14:02:52.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.544 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922621+0000", 2024-05-07T14:02:52.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116699 2024-05-07T14:02:52.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.922844+0000", 2024-05-07T14:02:52.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022219500000000001 2024-05-07T14:02:52.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:52.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.923312+0000", 2024-05-07T14:02:52.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046889700000000002 2024-05-07T14:02:52.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.924559+0000", 2024-05-07T14:02:52.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012467400000000001 2024-05-07T14:02:52.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925435+0000", 2024-05-07T14:02:52.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087567000000000005 2024-05-07T14:02:52.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925580+0000", 2024-05-07T14:02:52.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014519899999999999 2024-05-07T14:02:52.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.925698+0000", 2024-05-07T14:02:52.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118229 2024-05-07T14:02:52.547 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.547 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.547 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.547 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:52.548 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:52.548 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 104.471463684, 2024-05-07T14:02:52.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031738550000000002, 2024-05-07T14:02:52.548 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.548 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.548 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.548 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:52.548 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:52.548 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:52.548 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 946 2024-05-07T14:02:52.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.548 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:52.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954363+0000", 2024-05-07T14:02:52.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954365+0000", 2024-05-07T14:02:52.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3130000000000001e-06 2024-05-07T14:02:52.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954376+0000", 2024-05-07T14:02:52.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.112e-05 2024-05-07T14:02:52.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954406+0000", 2024-05-07T14:02:52.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0179e-05 2024-05-07T14:02:52.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954425+0000", 2024-05-07T14:02:52.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8413000000000001e-05 2024-05-07T14:02:52.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954567+0000", 2024-05-07T14:02:52.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142583 2024-05-07T14:02:52.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.954796+0000", 2024-05-07T14:02:52.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022814100000000001 2024-05-07T14:02:52.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:52.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.955126+0000", 2024-05-07T14:02:52.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033088799999999999 2024-05-07T14:02:52.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:52.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.956486+0000", 2024-05-07T14:02:52.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001359926 2024-05-07T14:02:52.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:52.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957386+0000", 2024-05-07T14:02:52.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00089915000000000004 2024-05-07T14:02:52.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957472+0000", 2024-05-07T14:02:52.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6032999999999994e-05 2024-05-07T14:02:52.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.554 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.554 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.957537+0000", 2024-05-07T14:02:52.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5109000000000003e-05 2024-05-07T14:02:52.554 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.554 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.554 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.554 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1481 4.b e81/23 4:d1744c9b:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.0:head v 81'5, mlcod=80'3)", 2024-05-07T14:02:52.554 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.340086+0000", 2024-05-07T14:02:52.554 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.085740977999999995, 2024-05-07T14:02:52.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032869940000000001, 2024-05-07T14:02:52.554 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:52.555 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:52.555 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:52.555 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:52.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:52.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.340086+0000", 2024-05-07T14:02:52.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:52.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.340086+0000", 2024-05-07T14:02:52.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:52.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:52.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.340086+0000", 2024-05-07T14:02:52.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8500000000000002e-07 2024-05-07T14:02:52.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:52.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.340094+0000", 2024-05-07T14:02:52.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5900000000000002e-06 2024-05-07T14:02:52.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:52.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.340112+0000", 2024-05-07T14:02:52.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8284999999999999e-05 2024-05-07T14:02:52.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:52.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.340122+0000", 2024-05-07T14:02:52.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5999999999999996e-06 2024-05-07T14:02:52.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:52.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.340178+0000", 2024-05-07T14:02:52.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6885000000000002e-05 2024-05-07T14:02:52.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:52.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.340203+0000", 2024-05-07T14:02:52.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4394000000000001e-05 2024-05-07T14:02:52.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:52.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343328+0000", 2024-05-07T14:02:52.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031251540000000002 2024-05-07T14:02:52.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:52.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:52.559 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:52.559 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343373+0000", 2024-05-07T14:02:52.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4601000000000002e-05 2024-05-07T14:02:52.559 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.559 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.559 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.559 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:52.559 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:52.559 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:52.561 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:02:52.561 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:52.573+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:52.661 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:52.672+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:52.671 INFO:tasks.workunit.client.0.smithi106.stdout:user qa_user deleted 2024-05-07T14:02:52.671 INFO:tasks.workunit.client.0.smithi106.stdout:bucket delete succeeded 2024-05-07T14:02:52.719 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:52.720 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:52.720 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:52.720 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:52.729 INFO:tasks.workunit.client.0.smithi106.stderr:1+0 records in 2024-05-07T14:02:52.730 INFO:tasks.workunit.client.0.smithi106.stderr:1+0 records out 2024-05-07T14:02:52.730 INFO:tasks.workunit.client.0.smithi106.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0546887 s, 192 MB/s 2024-05-07T14:02:52.732 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:02:52.776 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:52.788+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:52.864 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:52.877+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:52.894 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:52.894 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:52.894 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:52.894 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:52.894 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:52.898 INFO:tasks.workunit.client.0.smithi106.stdout:Bucket Created: buck_2024_04_7_14_02_52 2024-05-07T14:02:52.908 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:02:52.965 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:52.977+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:53.025 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:53.025 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:53.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:53.025 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:53.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.025 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:40 5.8 5:168cc6a2:::zonegroup_info.7881bf19-2c91-49be-82bb-722579314d1c:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:53.025 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:53.025 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 112.99547245799999, 2024-05-07T14:02:53.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002658582, 2024-05-07T14:02:53.025 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.025 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.025 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.026 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.026 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:53.026 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:53.026 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 40 2024-05-07T14:02:53.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.026 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:53.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042174+0000", 2024-05-07T14:02:53.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042176+0000", 2024-05-07T14:02:53.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7719999999999999e-06 2024-05-07T14:02:53.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042186+0000", 2024-05-07T14:02:53.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0020000000000001e-05 2024-05-07T14:02:53.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042209+0000", 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3224e-05 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042220+0000", 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1153e-05 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042358+0000", 2024-05-07T14:02:53.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000137389 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042594+0000", 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023630100000000001 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.042900+0000", 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030576799999999999 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044463+0000", 2024-05-07T14:02:53.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015627130000000001 2024-05-07T14:02:53.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044675+0000", 2024-05-07T14:02:53.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021186999999999999 2024-05-07T14:02:53.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044768+0000", 2024-05-07T14:02:53.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3046000000000003e-05 2024-05-07T14:02:53.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.044833+0000", 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5326000000000004e-05 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.89233511099999, 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.031 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:02:53.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:02:53.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:53.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:02:53.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:02:53.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:02:53.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:02:53.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:02:53.037 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.037 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.037 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.037 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.037 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:53.037 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.87991617, 2024-05-07T14:02:53.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:02:53.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:02:53.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:02:53.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:02:53.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:02:53.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:02:53.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:02:53.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:02:53.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:02:53.043 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.043 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.043 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.043 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.043 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:53.043 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.87603644799999, 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:53.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:02:53.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.74538094499999, 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.049 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:02:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:02:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:02:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.73821362300001, 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:02:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:02:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:02:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:02:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:02:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:02:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:02:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:02:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:02:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:02:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:02:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:02:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:02:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:02:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:02:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:02:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:02:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:02:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:02:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:02:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:02:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:02:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.44768093499999, 2024-05-07T14:02:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:02:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:53.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:53.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:02:53.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:02:53.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:02:53.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:02:53.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:02:53.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:02:53.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:02:53.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:02:53.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:02:53.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:02:53.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:02:53.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:02:53.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.069 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.070 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:53.070 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.330323308, 2024-05-07T14:02:53.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028535079999999998, 2024-05-07T14:02:53.070 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.070 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.070 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.070 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.070 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.070 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.070 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 841 2024-05-07T14:02:53.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.070 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:53.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707323+0000", 2024-05-07T14:02:53.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707326+0000", 2024-05-07T14:02:53.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:02:53.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707338+0000", 2024-05-07T14:02:53.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2036e-05 2024-05-07T14:02:53.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707367+0000", 2024-05-07T14:02:53.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8816999999999999e-05 2024-05-07T14:02:53.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707382+0000", 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4912999999999999e-05 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707523+0000", 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014165599999999999 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.707748+0000", 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000224315 2024-05-07T14:02:53.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:53.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.708055+0000", 2024-05-07T14:02:53.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030739800000000001 2024-05-07T14:02:53.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.709147+0000", 2024-05-07T14:02:53.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001091788 2024-05-07T14:02:53.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710030+0000", 2024-05-07T14:02:53.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088367000000000003 2024-05-07T14:02:53.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710114+0000", 2024-05-07T14:02:53.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3936000000000004e-05 2024-05-07T14:02:53.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.710177+0000", 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2675999999999994e-05 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.317200653, 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027995160000000002, 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.076 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 847 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720446+0000", 2024-05-07T14:02:53.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720448+0000", 2024-05-07T14:02:53.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:02:53.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720460+0000", 2024-05-07T14:02:53.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1157e-05 2024-05-07T14:02:53.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720490+0000", 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0960000000000002e-05 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720507+0000", 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6477000000000002e-05 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720681+0000", 2024-05-07T14:02:53.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017396800000000001 2024-05-07T14:02:53.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.720897+0000", 2024-05-07T14:02:53.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215775 2024-05-07T14:02:53.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:53.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.721203+0000", 2024-05-07T14:02:53.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030621499999999998 2024-05-07T14:02:53.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.722485+0000", 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012818599999999999 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723091+0000", 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060651499999999996 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723182+0000", 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0692999999999994e-05 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.723246+0000", 2024-05-07T14:02:53.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3643e-05 2024-05-07T14:02:53.082 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.082 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.082 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.082 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.082 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:53.082 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.313433304, 2024-05-07T14:02:53.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:02:53.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:02:53.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:02:53.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:02:53.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:02:53.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:53.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:02:53.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:02:53.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:02:53.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.267719908, 2024-05-07T14:02:53.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:53.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:02:53.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:02:53.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:02:53.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:02:53.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:02:53.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:02:53.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:02:53.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:02:53.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:02:53.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:02:53.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:02:53.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.094 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.26144317000001, 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:02:53.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:02:53.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:02:53.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:02:53.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:02:53.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:02:53.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.100 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.17493005, 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028016680000000002, 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 907 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.101 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862717+0000", 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862719+0000", 2024-05-07T14:02:53.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862733+0000", 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3067e-05 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862763+0000", 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0926000000000002e-05 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862779+0000", 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5787e-05 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.862924+0000", 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014509899999999999 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863160+0000", 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000235701 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:53.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.863523+0000", 2024-05-07T14:02:53.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000362567 2024-05-07T14:02:53.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.864872+0000", 2024-05-07T14:02:53.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00134954 2024-05-07T14:02:53.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865350+0000", 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000478009 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865437+0000", 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6712999999999995e-05 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.865518+0000", 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1493000000000001e-05 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.171200763, 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027054290000000001, 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 909 2024-05-07T14:02:53.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866446+0000", 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866448+0000", 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.17e-06 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866459+0000", 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1207e-05 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866491+0000", 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362999999999998e-05 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866506+0000", 2024-05-07T14:02:53.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4790000000000001e-05 2024-05-07T14:02:53.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866632+0000", 2024-05-07T14:02:53.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000126422 2024-05-07T14:02:53.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.866761+0000", 2024-05-07T14:02:53.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128832 2024-05-07T14:02:53.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:53.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.867037+0000", 2024-05-07T14:02:53.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027612200000000001 2024-05-07T14:02:53.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.868118+0000", 2024-05-07T14:02:53.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001080941 2024-05-07T14:02:53.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869004+0000", 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00088632000000000001 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869081+0000", 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7195999999999997e-05 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.869151+0000", 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0066000000000003e-05 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.112 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.076351964, 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:02:53.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.114 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:53.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:53.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:02:53.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:02:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:02:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:02:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:02:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:02:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:02:53.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.06318261, 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027821920000000002, 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.119 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 955 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974464+0000", 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974466+0000", 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0999999999999998e-06 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974480+0000", 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3876999999999999e-05 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974510+0000", 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0273e-05 2024-05-07T14:02:53.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974525+0000", 2024-05-07T14:02:53.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.485e-05 2024-05-07T14:02:53.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974618+0000", 2024-05-07T14:02:53.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2359000000000001e-05 2024-05-07T14:02:53.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.974822+0000", 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000204148 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.975126+0000", 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030382800000000002 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976565+0000", 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014395160000000001 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.976963+0000", 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00039772700000000001 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977128+0000", 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165508 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.977246+0000", 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011800599999999999 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 105.05926704700001, 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027683989999999999, 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 957 2024-05-07T14:02:53.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.126 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:53.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978380+0000", 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978382+0000", 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.95e-06 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978393+0000", 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.084e-05 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978424+0000", 2024-05-07T14:02:53.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1022999999999998e-05 2024-05-07T14:02:53.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978441+0000", 2024-05-07T14:02:53.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7782999999999999e-05 2024-05-07T14:02:53.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978565+0000", 2024-05-07T14:02:53.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012348900000000001 2024-05-07T14:02:53.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.978794+0000", 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000229335 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.979262+0000", 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00046826700000000002 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.980470+0000", 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012071899999999999 2024-05-07T14:02:53.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981002+0000", 2024-05-07T14:02:53.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053222299999999996 2024-05-07T14:02:53.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981086+0000", 2024-05-07T14:02:53.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4073000000000006e-05 2024-05-07T14:02:53.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.981148+0000", 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2225999999999997e-05 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5099.0:56 7.14 e80/29 7:2b04a3e9:::notify.6:head v 80'36, mlcod=80'34)", 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.857790897, 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046522059999999999, 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.131 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:02:53.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1399999999999997e-07 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179862+0000", 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4330000000000003e-06 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179873+0000", 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0838e-05 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179879+0000", 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3099999999999997e-06 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179934+0000", 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4625e-05 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179955+0000", 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-05 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184469+0000", 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045139150000000003 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184508+0000", 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9001000000000001e-05 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5117.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94838143561296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:53.135 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.490856+0000", 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.54679036999999997, 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034216759999999998, 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5117", 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/62727776", 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 51 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490856+0000", 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490856+0000", 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490857+0000", 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490862+0000", 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3419999999999998e-06 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490871+0000", 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.089e-06 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490875+0000", 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8300000000000003e-06 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490910+0000", 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4856e-05 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490955+0000", 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5181e-05 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.491035+0000", 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9542999999999994e-05 2024-05-07T14:02:53.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.492688+0000", 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016531130000000001 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.494187+0000", 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014991099999999999 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.494233+0000", 2024-05-07T14:02:53.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5676000000000001e-05 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.494278+0000", 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5192999999999999e-05 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5117.0:56 7.14 e81/29 7:2b04a3e9:::notify.6:head v 81'39, mlcod=80'37)", 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.54119505700000003, 2024-05-07T14:02:53.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078436700000000005, 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.34e-07 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496456+0000", 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5410000000000001e-06 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496463+0000", 2024-05-07T14:02:53.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7689999999999996e-06 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496468+0000", 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1969999999999998e-06 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496518+0000", 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0793e-05 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496538+0000", 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0000000000000002e-05 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504267+0000", 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077288419999999997 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504295+0000", 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8093999999999999e-05 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.145 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.146 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.146 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:53.147 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:02:53.148 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:53.157+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:53.195 INFO:tasks.workunit.client.0.smithi106.stdout:bucket quota max_objs set for the given user: buck_2024_04_7_14_02_52 2024-05-07T14:02:53.248 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:53.257+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:53.278 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:53.279 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:53.279 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:53.279 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:53.292 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:02:53.349 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:53.361+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:53.419 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:53.419 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:53.419 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:53.419 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:53.435 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:02:53.450 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:53.461+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:53.456 INFO:tasks.workunit.client.0.smithi106.stdout:quota enabled for the bucket: buck_2024_04_7_14_02_52 2024-05-07T14:02:53.456 INFO:tasks.workunit.client.0.smithi106.stdout:adding file to bucket: 10Mb. 2024-05-07T14:02:53.456 INFO:tasks.workunit.client.0.smithi106.stdout:upload file successful 2024-05-07T14:02:53.489 INFO:tasks.workunit.client.0.smithi106.stderr:1+0 records in 2024-05-07T14:02:53.489 INFO:tasks.workunit.client.0.smithi106.stderr:1+0 records out 2024-05-07T14:02:53.489 INFO:tasks.workunit.client.0.smithi106.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0299234 s, 350 MB/s 2024-05-07T14:02:53.523 INFO:tasks.workunit.client.0.smithi106.stdout:readding file to bucket: 10MBfile1 2024-05-07T14:02:53.523 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:53.523 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - set max objects for a given user and test beyond max objects passed 2024-05-07T14:02:53.523 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 111.55439296599999, 2024-05-07T14:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 106.533989146, 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:02:53.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:02:53.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:02:53.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:02:53.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:02:53.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:02:53.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:02:53.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:02:53.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:02:53.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:02:53.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:02:53.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:02:53.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:02:53.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:02:53.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:02:53.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:02:53.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:02:53.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:02:53.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:02:53.558 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.558 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.558 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.559 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:415 6.7 e33/27 6:e622f76a:gc::gc.20:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:53.559 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:53.559 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 106.35506149299999, 2024-05-07T14:02:53.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044669840000000002, 2024-05-07T14:02:53.559 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.559 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.559 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.559 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:53.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1799999999999995e-07 2024-05-07T14:02:53.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201814+0000", 2024-05-07T14:02:53.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4170000000000002e-06 2024-05-07T14:02:53.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201824+0000", 2024-05-07T14:02:53.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0217999999999999e-05 2024-05-07T14:02:53.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201838+0000", 2024-05-07T14:02:53.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3723000000000001e-05 2024-05-07T14:02:53.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201890+0000", 2024-05-07T14:02:53.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2320000000000001e-05 2024-05-07T14:02:53.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201906+0000", 2024-05-07T14:02:53.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5894999999999999e-05 2024-05-07T14:02:53.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206242+0000", 2024-05-07T14:02:53.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043366489999999997 2024-05-07T14:02:53.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206276+0000", 2024-05-07T14:02:53.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:02:53.565 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.565 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.565 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.565 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:432 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.566 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:53.566 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 106.343815913, 2024-05-07T14:02:53.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045128019999999998, 2024-05-07T14:02:53.566 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.566 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.566 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.566 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.566 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.566 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.566 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 432 2024-05-07T14:02:53.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.566 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213055+0000", 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7000000000000005e-07 2024-05-07T14:02:53.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213058+0000", 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0369999999999999e-06 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213066+0000", 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3680000000000002e-06 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213084+0000", 2024-05-07T14:02:53.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7946999999999999e-05 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213127+0000", 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2673999999999998e-05 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213222+0000", 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5488000000000005e-05 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:53.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213412+0000", 2024-05-07T14:02:53.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000189307 2024-05-07T14:02:53.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.214754+0000", 2024-05-07T14:02:53.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001342069 2024-05-07T14:02:53.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217447+0000", 2024-05-07T14:02:53.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026931250000000002 2024-05-07T14:02:53.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217521+0000", 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3997000000000003e-05 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217567+0000", 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6220000000000001e-05 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.572 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:430 6.7 e33/27 6:e1cdb60d:reshard::reshard.0000000008:head v 33'9, mlcod=33'6)", 2024-05-07T14:02:53.572 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:53.572 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 106.34376942999999, 2024-05-07T14:02:53.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043702330000000003, 2024-05-07T14:02:53.572 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.572 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.572 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.572 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:53.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:53.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0400000000000005e-07 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213107+0000", 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5740000000000003e-06 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213117+0000", 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8349999999999999e-06 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213122+0000", 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5140000000000001e-06 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213169+0000", 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6551000000000002e-05 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213198+0000", 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217415+0000", 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042171090000000001 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217471+0000", 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5766000000000001e-05 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:480 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 106.315305275, 2024-05-07T14:02:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052104459999999997, 2024-05-07T14:02:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 480 2024-05-07T14:02:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:53.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:53.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6199999999999997e-07 2024-05-07T14:02:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241570+0000", 2024-05-07T14:02:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2479999999999998e-06 2024-05-07T14:02:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241580+0000", 2024-05-07T14:02:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8719999999999997e-06 2024-05-07T14:02:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241584+0000", 2024-05-07T14:02:53.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7210000000000002e-06 2024-05-07T14:02:53.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241629+0000", 2024-05-07T14:02:53.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4465000000000002e-05 2024-05-07T14:02:53.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241671+0000", 2024-05-07T14:02:53.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2370999999999998e-05 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241772+0000", 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101048 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.243876+0000", 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021036789999999998 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246710+0000", 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028339060000000002 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246747+0000", 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7061000000000003e-05 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246775+0000", 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8413000000000001e-05 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.582 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:499 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 106.30442455399999, 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050166450000000001, 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 499 2024-05-07T14:02:53.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.584 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:53.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:53.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4300000000000002e-07 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252451+0000", 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1290000000000004e-06 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252463+0000", 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1238e-05 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252470+0000", 2024-05-07T14:02:53.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2019999999999998e-06 2024-05-07T14:02:53.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252534+0000", 2024-05-07T14:02:53.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4178999999999997e-05 2024-05-07T14:02:53.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252706+0000", 2024-05-07T14:02:53.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017197 2024-05-07T14:02:53.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:53.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252871+0000", 2024-05-07T14:02:53.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016508199999999999 2024-05-07T14:02:53.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254444+0000", 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001573112 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257407+0000", 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029630989999999999 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257437+0000", 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0009999999999999e-05 2024-05-07T14:02:53.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257462+0000", 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4780999999999999e-05 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:500 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 106.304138451, 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046354220000000002, 2024-05-07T14:02:53.589 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 500 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252733+0000", 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9399999999999993e-07 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252738+0000", 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6779999999999997e-06 2024-05-07T14:02:53.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252750+0000", 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1882000000000001e-05 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252758+0000", 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0649999999999999e-06 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252811+0000", 2024-05-07T14:02:53.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2859000000000003e-05 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252870+0000", 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8956000000000003e-05 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252992+0000", 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122275 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254326+0000", 2024-05-07T14:02:53.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013334449999999999 2024-05-07T14:02:53.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257254+0000", 2024-05-07T14:02:53.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029284039999999999 2024-05-07T14:02:53.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257316+0000", 2024-05-07T14:02:53.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1348999999999998e-05 2024-05-07T14:02:53.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257367+0000", 2024-05-07T14:02:53.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1514999999999997e-05 2024-05-07T14:02:53.595 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.595 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.595 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.595 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:510 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.595 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:02:53.596 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 106.298055812, 2024-05-07T14:02:53.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041639090000000004, 2024-05-07T14:02:53.596 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.596 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.596 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.596 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.596 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.596 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.596 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 510 2024-05-07T14:02:53.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.596 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:02:53.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258814+0000", 2024-05-07T14:02:53.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258815+0000", 2024-05-07T14:02:53.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0500000000000002e-07 2024-05-07T14:02:53.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258819+0000", 2024-05-07T14:02:53.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0090000000000001e-06 2024-05-07T14:02:53.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258828+0000", 2024-05-07T14:02:53.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2529999999999993e-06 2024-05-07T14:02:53.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258833+0000", 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7219999999999999e-06 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258870+0000", 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6368000000000001e-05 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.258915+0000", 2024-05-07T14:02:53.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.528e-05 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.259016+0000", 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010074200000000001 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.260655+0000", 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016394999999999999 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262752+0000", 2024-05-07T14:02:53.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002096531 2024-05-07T14:02:53.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262871+0000", 2024-05-07T14:02:53.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119645 2024-05-07T14:02:53.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.262978+0000", 2024-05-07T14:02:53.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010695400000000001 2024-05-07T14:02:53.601 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.602 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.602 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.602 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:552 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.602 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:02:53.602 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 106.26629631, 2024-05-07T14:02:53.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042166790000000001, 2024-05-07T14:02:53.603 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.603 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.603 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.603 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.603 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.603 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.603 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 552 2024-05-07T14:02:53.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.606 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:02:53.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290574+0000", 2024-05-07T14:02:53.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290575+0000", 2024-05-07T14:02:53.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.85e-07 2024-05-07T14:02:53.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290578+0000", 2024-05-07T14:02:53.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999999e-06 2024-05-07T14:02:53.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290587+0000", 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.268e-06 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290592+0000", 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7029999999999997e-06 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290694+0000", 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101841 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.290840+0000", 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014613899999999999 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.291137+0000", 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029714800000000001 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292561+0000", 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014235020000000001 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294568+0000", 2024-05-07T14:02:53.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020076540000000002 2024-05-07T14:02:53.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294692+0000", 2024-05-07T14:02:53.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012394500000000001 2024-05-07T14:02:53.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294790+0000", 2024-05-07T14:02:53.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8194000000000002e-05 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:553 6.f e33/27 6:f24cb4a8:gc::gc.31:head v 33'4, mlcod=33'2)", 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 106.264037452, 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043350139999999999, 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:53.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:53.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292833+0000", 2024-05-07T14:02:53.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2900000000000004e-07 2024-05-07T14:02:53.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292838+0000", 2024-05-07T14:02:53.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5560000000000001e-06 2024-05-07T14:02:53.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292847+0000", 2024-05-07T14:02:53.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8619999999999992e-06 2024-05-07T14:02:53.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292851+0000", 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9010000000000002e-06 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292922+0000", 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0827000000000005e-05 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292973+0000", 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0492999999999999e-05 2024-05-07T14:02:53.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297114+0000", 2024-05-07T14:02:53.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041408970000000002 2024-05-07T14:02:53.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297168+0000", 2024-05-07T14:02:53.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3949000000000001e-05 2024-05-07T14:02:53.615 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.615 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.615 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:686 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 106.154291567, 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046254349999999998, 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 686 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402581+0000", 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:02:53.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402592+0000", 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0984e-05 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402619+0000", 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7583e-05 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402633+0000", 2024-05-07T14:02:53.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3553000000000001e-05 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402699+0000", 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6013000000000006e-05 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402792+0000", 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3455999999999994e-05 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:53.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402928+0000", 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013596800000000001 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.403918+0000", 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00099017000000000007 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407144+0000", 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032257449999999999 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407180+0000", 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5462e-05 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407204+0000", 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4247999999999999e-05 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5099.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:02:53.621 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.377504955, 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053287550000000001, 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5099", 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2788980923", 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:02:53.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:02:53.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179366+0000", 2024-05-07T14:02:53.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7299999999999996e-07 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179368+0000", 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7879999999999998e-06 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179378+0000", 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8870000000000004e-06 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179384+0000", 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3009999999999997e-06 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179438+0000", 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4731000000000002e-05 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179515+0000", 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6817999999999995e-05 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:02:53.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179637+0000", 2024-05-07T14:02:53.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122197 2024-05-07T14:02:53.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.181699+0000", 2024-05-07T14:02:53.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020617000000000001 2024-05-07T14:02:53.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184620+0000", 2024-05-07T14:02:53.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029204999999999999 2024-05-07T14:02:53.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184651+0000", 2024-05-07T14:02:53.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1267999999999999e-05 2024-05-07T14:02:53.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184694+0000", 2024-05-07T14:02:53.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2991999999999998e-05 2024-05-07T14:02:53.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.627 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.628 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1477 3.18 3:1a16f065:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:02:53.628 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:02:53.628 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.2713876230000001, 2024-05-07T14:02:53.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017437234999999999, 2024-05-07T14:02:53.628 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.628 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.628 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.628 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.628 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.628 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.628 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1477 2024-05-07T14:02:53.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285485+0000", 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.148e-06 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287428+0000", 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001943391 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287451+0000", 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2912e-05 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287464+0000", 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2758000000000001e-05 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287530+0000", 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6544999999999994e-05 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287643+0000", 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011307900000000001 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:53.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287732+0000", 2024-05-07T14:02:53.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8640999999999994e-05 2024-05-07T14:02:53.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.300987+0000", 2024-05-07T14:02:53.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013255052999999999 2024-05-07T14:02:53.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302819+0000", 2024-05-07T14:02:53.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001831533 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302874+0000", 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5946000000000003e-05 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302920+0000", 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5228999999999997e-05 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.634 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:02:53.634 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:02:53.634 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.2521255579999999, 2024-05-07T14:02:53.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:02:53.634 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.634 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.634 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.634 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.634 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:02:53.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:02:53.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:02:53.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:02:53.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:02:53.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:02:53.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:02:53.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:02:53.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:02:53.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:02:53.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:02:53.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:02:53.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:53.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:02:53.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:02:53.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:02:53.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:02:53.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:02:53.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:02:53.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:02:53.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:02:53.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5117.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.060882672, 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008462018, 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.641 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5117", 2024-05-07T14:02:53.642 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/62727776", 2024-05-07T14:02:53.642 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:02:53.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.642 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:02:53.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:02:53.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495988+0000", 2024-05-07T14:02:53.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999999e-07 2024-05-07T14:02:53.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495990+0000", 2024-05-07T14:02:53.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.765e-06 2024-05-07T14:02:53.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495995+0000", 2024-05-07T14:02:53.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3499999999999996e-06 2024-05-07T14:02:53.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495998+0000", 2024-05-07T14:02:53.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3739999999999998e-06 2024-05-07T14:02:53.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496050+0000", 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2015999999999998e-05 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496120+0000", 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9373000000000001e-05 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496224+0000", 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010395699999999999 2024-05-07T14:02:53.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.501395+0000", 2024-05-07T14:02:53.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051715090000000003 2024-05-07T14:02:53.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504399+0000", 2024-05-07T14:02:53.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030035930000000001 2024-05-07T14:02:53.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504428+0000", 2024-05-07T14:02:53.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:02:53.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504449+0000", 2024-05-07T14:02:53.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1608e-05 2024-05-07T14:02:53.647 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.647 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.647 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.648 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1485 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=14b,call rgw.obj_remove in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:53.648 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:02:53.648 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.936143842, 2024-05-07T14:02:53.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056592079999999998, 2024-05-07T14:02:53.648 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.648 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.648 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.648 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.648 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.649 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.649 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1485 2024-05-07T14:02:53.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.649 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:02:53.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:02:53.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620728+0000", 2024-05-07T14:02:53.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.457e-06 2024-05-07T14:02:53.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620734+0000", 2024-05-07T14:02:53.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0460000000000002e-06 2024-05-07T14:02:53.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620749+0000", 2024-05-07T14:02:53.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5067e-05 2024-05-07T14:02:53.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620758+0000", 2024-05-07T14:02:53.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6989999999999992e-06 2024-05-07T14:02:53.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620819+0000", 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1496999999999998e-05 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620880+0000", 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0908e-05 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.621007+0000", 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000127551 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.622196+0000", 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001188391 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626306+0000", 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041097779999999997 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626357+0000", 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0936999999999997e-05 2024-05-07T14:02:53.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626385+0000", 2024-05-07T14:02:53.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8877000000000002e-05 2024-05-07T14:02:53.654 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.654 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.654 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.654 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1487 6.13 6:c8333aab:gc::gc.11:head [call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_enqueue in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:53.654 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.626573+0000", 2024-05-07T14:02:53.654 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.93029678699999996, 2024-05-07T14:02:53.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043998559999999997, 2024-05-07T14:02:53.655 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.655 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.655 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.655 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.655 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:53.655 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:53.655 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1487 2024-05-07T14:02:53.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.655 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626573+0000", 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626573+0000", 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626574+0000", 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.066e-06 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626579+0000", 2024-05-07T14:02:53.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7879999999999997e-06 2024-05-07T14:02:53.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626590+0000", 2024-05-07T14:02:53.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0705e-05 2024-05-07T14:02:53.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626598+0000", 2024-05-07T14:02:53.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6899999999999992e-06 2024-05-07T14:02:53.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626660+0000", 2024-05-07T14:02:53.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2623e-05 2024-05-07T14:02:53.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626757+0000", 2024-05-07T14:02:53.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6368999999999998e-05 2024-05-07T14:02:53.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.627049+0000", 2024-05-07T14:02:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029227700000000002 2024-05-07T14:02:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.627919+0000", 2024-05-07T14:02:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087008300000000001 2024-05-07T14:02:53.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.630896+0000", 2024-05-07T14:02:53.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002976767 2024-05-07T14:02:53.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.630930+0000", 2024-05-07T14:02:53.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3847000000000003e-05 2024-05-07T14:02:53.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.630973+0000", 2024-05-07T14:02:53.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3640999999999998e-05 2024-05-07T14:02:53.662 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.662 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.662 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.662 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5165.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94404812944928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:53.662 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.159887+0000", 2024-05-07T14:02:53.663 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.39698309900000001, 2024-05-07T14:02:53.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043588630000000001, 2024-05-07T14:02:53.663 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.663 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.663 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.663 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.663 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5165", 2024-05-07T14:02:53.663 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/3551621939", 2024-05-07T14:02:53.663 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 55 2024-05-07T14:02:53.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.664 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159887+0000", 2024-05-07T14:02:53.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159887+0000", 2024-05-07T14:02:53.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159888+0000", 2024-05-07T14:02:53.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8899999999999999e-07 2024-05-07T14:02:53.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159892+0000", 2024-05-07T14:02:53.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2740000000000001e-06 2024-05-07T14:02:53.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159900+0000", 2024-05-07T14:02:53.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2770000000000005e-06 2024-05-07T14:02:53.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159905+0000", 2024-05-07T14:02:53.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7319999999999998e-06 2024-05-07T14:02:53.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159945+0000", 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0188000000000002e-05 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160002+0000", 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7413000000000001e-05 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160083+0000", 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0834999999999994e-05 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.161306+0000", 2024-05-07T14:02:53.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012223749999999999 2024-05-07T14:02:53.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164161+0000", 2024-05-07T14:02:53.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002855659 2024-05-07T14:02:53.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164207+0000", 2024-05-07T14:02:53.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5370000000000001e-05 2024-05-07T14:02:53.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164246+0000", 2024-05-07T14:02:53.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9150999999999998e-05 2024-05-07T14:02:53.669 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.669 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.669 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.670 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5165.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:53.670 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.159929+0000", 2024-05-07T14:02:53.670 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.39694083699999999, 2024-05-07T14:02:53.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043657139999999997, 2024-05-07T14:02:53.670 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:53.670 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:53.670 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:53.670 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:53.670 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5165", 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/3551621939", 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159929+0000", 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159929+0000", 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:53.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159930+0000", 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9299999999999998e-07 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159932+0000", 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5730000000000002e-06 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159946+0000", 2024-05-07T14:02:53.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3685e-05 2024-05-07T14:02:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159952+0000", 2024-05-07T14:02:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7150000000000003e-06 2024-05-07T14:02:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159998+0000", 2024-05-07T14:02:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6771999999999999e-05 2024-05-07T14:02:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160045+0000", 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6520999999999997e-05 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160107+0000", 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1790000000000003e-05 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.161190+0000", 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010833489999999999 2024-05-07T14:02:53.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164211+0000", 2024-05-07T14:02:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030213499999999999 2024-05-07T14:02:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164261+0000", 2024-05-07T14:02:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9521000000000002e-05 2024-05-07T14:02:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:53.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164295+0000", 2024-05-07T14:02:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3945000000000001e-05 2024-05-07T14:02:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:53.676 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:53.676 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:53.678 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:02:53.678 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:53.689+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:53.779 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:53.788+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:53.780 INFO:tasks.workunit.client.0.smithi106.stdout:user qa_user deleted 2024-05-07T14:02:53.780 INFO:tasks.workunit.client.0.smithi106.stdout:bucket delete succeeded 2024-05-07T14:02:53.816 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:53.816 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:53.816 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:53.816 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:53.830 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:02:53.880 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:53.893+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:53.919 INFO:tasks.workunit.client.0.smithi106.stdout:Bucket Created: buck_2024_04_7_14_02_53 2024-05-07T14:02:53.958 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:53.959 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:53.959 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:53.959 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:53.959 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:53.973 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:02:54.020 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:54.033+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:54.075 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:54.075 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - quota set for the bucket: buck_2024_04_7_14_02_53 with max size as zero 2024-05-07T14:02:54.075 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:54.075 INFO:tasks.workunit.client.0.smithi106.stdout:bucket delete succeeded 2024-05-07T14:02:54.081 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:54.093+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:54.153 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:02:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:02:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:02:54.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:02:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:02:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.168617643, 2024-05-07T14:02:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070064749999999999, 2024-05-07T14:02:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:02:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 43 2024-05-07T14:02:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.154 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:02:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:02:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994274+0000", 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7170000000000002e-06 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994292+0000", 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7819999999999999e-05 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994338+0000", 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6625999999999997e-05 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994362+0000", 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4063e-05 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994576+0000", 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021319500000000001 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994598+0000", 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2325999999999999e-05 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001023+0000", 2024-05-07T14:02:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00642546 2024-05-07T14:02:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001277+0000", 2024-05-07T14:02:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025326800000000002 2024-05-07T14:02:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 107.11298821699999, 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033678110000000001, 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 211 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049903+0000", 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.963e-06 2024-05-07T14:02:54.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049917+0000", 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049950+0000", 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3328999999999999e-05 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049966+0000", 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6333000000000001e-05 2024-05-07T14:02:54.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050100+0000", 2024-05-07T14:02:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013305599999999999 2024-05-07T14:02:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050363+0000", 2024-05-07T14:02:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026392100000000002 2024-05-07T14:02:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:54.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050827+0000", 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046316 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.052269+0000", 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014428760000000001 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053111+0000", 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084168999999999997 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053198+0000", 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6666e-05 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053267+0000", 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9503000000000002e-05 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:54.164 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 107.034533522, 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032702809999999999, 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 232 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128357+0000", 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1530000000000001e-06 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128369+0000", 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1823e-05 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128401+0000", 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128416+0000", 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4997000000000001e-05 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128538+0000", 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121406 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128773+0000", 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235121 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.129230+0000", 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00045679999999999999 2024-05-07T14:02:54.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.130836+0000", 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001606484 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131454+0000", 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061747199999999999 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131550+0000", 2024-05-07T14:02:54.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6636000000000001e-05 2024-05-07T14:02:54.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131624+0000", 2024-05-07T14:02:54.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4315999999999998e-05 2024-05-07T14:02:54.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.170 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.170 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:301 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:54.170 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:02:54.170 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 107.002956556, 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037043950000000001, 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 301 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:02:54.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159933+0000", 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6670000000000001e-06 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159943+0000", 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0176e-05 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159965+0000", 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2243e-05 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159980+0000", 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4747e-05 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160332+0000", 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000352004 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160574+0000", 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241838 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.161045+0000", 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000471526 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.162322+0000", 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001276241 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163376+0000", 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010539449999999999 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163516+0000", 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014034599999999999 2024-05-07T14:02:54.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163636+0000", 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011966199999999999 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:376 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 106.986841277, 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038557209999999999, 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.176 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 376 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176049+0000", 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176064+0000", 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.451e-05 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176101+0000", 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000003e-05 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176126+0000", 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176272+0000", 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014592899999999999 2024-05-07T14:02:54.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176402+0000", 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000129512 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176725+0000", 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032289800000000001 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.177826+0000", 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011017620000000001 2024-05-07T14:02:54.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179617+0000", 2024-05-07T14:02:54.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001791193 2024-05-07T14:02:54.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179781+0000", 2024-05-07T14:02:54.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016336899999999999 2024-05-07T14:02:54.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179902+0000", 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012131899999999999 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:397 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 106.974344187, 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034388040000000002, 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.182 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 397 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:02:54.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188546+0000", 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2000000000000001e-06 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188556+0000", 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0557000000000001e-05 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188590+0000", 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3626e-05 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188625+0000", 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5095999999999997e-05 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188768+0000", 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014279900000000001 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189124+0000", 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035646799999999998 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189633+0000", 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000508903 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.190638+0000", 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001004465 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191712+0000", 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001074759 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191871+0000", 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835900000000001 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191982+0000", 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011157199999999999 2024-05-07T14:02:54.187 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:403 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 106.970201409, 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004923172, 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.188 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 403 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192688+0000", 2024-05-07T14:02:54.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4640000000000001e-06 2024-05-07T14:02:54.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192696+0000", 2024-05-07T14:02:54.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9330000000000001e-06 2024-05-07T14:02:54.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192715+0000", 2024-05-07T14:02:54.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9746999999999999e-05 2024-05-07T14:02:54.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192726+0000", 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.026e-05 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192824+0000", 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8139000000000003e-05 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192971+0000", 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014717199999999999 2024-05-07T14:02:54.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.193232+0000", 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000260518 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.196090+0000", 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002858598 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197464+0000", 2024-05-07T14:02:54.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001373399 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197549+0000", 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5261999999999998e-05 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197609+0000", 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0680000000000002e-05 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.194 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:472 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:54.194 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:02:54.194 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 106.92589889600001, 2024-05-07T14:02:54.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044650219999999999, 2024-05-07T14:02:54.194 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.194 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.194 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.194 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.194 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.194 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.194 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 472 2024-05-07T14:02:54.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236991+0000", 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8589999999999999e-06 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237001+0000", 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0465999999999999e-05 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237019+0000", 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7666999999999999e-05 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237030+0000", 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0917000000000001e-05 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237184+0000", 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015438499999999999 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237427+0000", 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024296499999999999 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:54.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237900+0000", 2024-05-07T14:02:54.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047292599999999998 2024-05-07T14:02:54.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.239253+0000", 2024-05-07T14:02:54.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013527770000000001 2024-05-07T14:02:54.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241246+0000", 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019933249999999998 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241370+0000", 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012385599999999999 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241454+0000", 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3879000000000001e-05 2024-05-07T14:02:54.199 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:509 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:02:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 106.905010758, 2024-05-07T14:02:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003433874, 2024-05-07T14:02:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.201 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.201 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 509 2024-05-07T14:02:54.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.201 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:02:54.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:02:54.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257878+0000", 2024-05-07T14:02:54.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.528e-06 2024-05-07T14:02:54.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257886+0000", 2024-05-07T14:02:54.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2180000000000002e-06 2024-05-07T14:02:54.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257903+0000", 2024-05-07T14:02:54.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7484999999999999e-05 2024-05-07T14:02:54.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257912+0000", 2024-05-07T14:02:54.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0189999999999995e-06 2024-05-07T14:02:54.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258007+0000", 2024-05-07T14:02:54.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4627000000000001e-05 2024-05-07T14:02:54.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258124+0000", 2024-05-07T14:02:54.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116836 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258381+0000", 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025690899999999999 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.259428+0000", 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047177 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261154+0000", 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017262180000000001 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261224+0000", 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9913000000000006e-05 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261311+0000", 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6944e-05 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:625 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 106.817591097, 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039276240000000002, 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 625 2024-05-07T14:02:54.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:02:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:02:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345300+0000", 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.067e-06 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345315+0000", 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4857e-05 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345344+0000", 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9070000000000001e-05 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345359+0000", 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5656000000000001e-05 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345512+0000", 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015229600000000001 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345764+0000", 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025252100000000002 2024-05-07T14:02:54.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.346269+0000", 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000504613 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.347487+0000", 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001218317 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349071+0000", 2024-05-07T14:02:54.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015844279999999999 2024-05-07T14:02:54.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349156+0000", 2024-05-07T14:02:54.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4958999999999998e-05 2024-05-07T14:02:54.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349224+0000", 2024-05-07T14:02:54.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7840000000000001e-05 2024-05-07T14:02:54.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.214 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.215 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:54.215 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:02:54.215 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 106.36362396299999, 2024-05-07T14:02:54.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031874479999999998, 2024-05-07T14:02:54.215 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.215 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.218 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.218 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.218 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.218 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.218 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 880 2024-05-07T14:02:54.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.218 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:02:54.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799264+0000", 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799266+0000", 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.723e-06 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799280+0000", 2024-05-07T14:02:54.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3159999999999999e-05 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799311+0000", 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1083e-05 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799327+0000", 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5883e-05 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799438+0000", 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011096599999999999 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.799670+0000", 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023280800000000001 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.800012+0000", 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034192800000000002 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.801133+0000", 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011206009999999999 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802179+0000", 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010458080000000001 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802341+0000", 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000162533 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.802451+0000", 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109955 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1565 4.d 4:b05a54d0:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672774+0000", 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.490113842, 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052824339999999999, 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.223 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1565 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672774+0000", 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672774+0000", 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672776+0000", 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0700000000000001e-06 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672787+0000", 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0823e-05 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672818+0000", 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1676e-05 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672840+0000", 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1759999999999998e-05 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673009+0000", 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016833700000000001 2024-05-07T14:02:54.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673279+0000", 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027011899999999998 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673560+0000", 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028097000000000002 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.676617+0000", 2024-05-07T14:02:54.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030573150000000001 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677839+0000", 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012222240000000001 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677943+0000", 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103838 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678056+0000", 2024-05-07T14:02:54.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011330199999999999 2024-05-07T14:02:54.229 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.229 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.229 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.229 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1566 4.13 4:cabacdb3:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:54.229 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:02:54.229 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.4899993570000001, 2024-05-07T14:02:54.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057730890000000003, 2024-05-07T14:02:54.229 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.229 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1566 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672890+0000", 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.606e-06 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672898+0000", 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-06 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672924+0000", 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5599999999999999e-05 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672942+0000", 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7799999999999999e-05 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673078+0000", 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013645399999999999 2024-05-07T14:02:54.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673280+0000", 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020144999999999999 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673597+0000", 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031715200000000002 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.675496+0000", 2024-05-07T14:02:54.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018996830000000001 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678466+0000", 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029693639999999999 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678562+0000", 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6614999999999996e-05 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678661+0000", 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9024999999999995e-05 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1568 4.3d 4:bd9d380d:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.489904315, 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059901989999999999, 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.235 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1568 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:02:54.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672985+0000", 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672992+0000", 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7229999999999998e-06 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673011+0000", 2024-05-07T14:02:54.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9700000000000001e-05 2024-05-07T14:02:54.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673026+0000", 2024-05-07T14:02:54.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4506e-05 2024-05-07T14:02:54.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674436+0000", 2024-05-07T14:02:54.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001410445 2024-05-07T14:02:54.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674635+0000", 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019898299999999999 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674957+0000", 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032126499999999999 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.676898+0000", 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019413989999999999 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678780+0000", 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018816880000000001 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678912+0000", 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013280799999999999 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678974+0000", 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1192000000000006e-05 2024-05-07T14:02:54.240 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1570 4.1b 4:db659863:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.489838716, 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059406459999999999, 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.241 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.242 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1570 2024-05-07T14:02:54.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.242 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:02:54.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:02:54.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673050+0000", 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1230000000000001e-06 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673056+0000", 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5639999999999996e-06 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673073+0000", 2024-05-07T14:02:54.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7751999999999999e-05 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673086+0000", 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2656999999999999e-05 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674276+0000", 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011896350000000001 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674479+0000", 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020363600000000001 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674757+0000", 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027776599999999998 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677473+0000", 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027157739999999998 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678813+0000", 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013401120000000001 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678931+0000", 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118322 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678990+0000", 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8304999999999998e-05 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.246 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1572 4.13 4:c90a81ac:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.4897827299999999, 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062582080000000003, 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.247 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1572 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673106+0000", 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0729999999999999e-06 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673111+0000", 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3070000000000002e-06 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673129+0000", 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673143+0000", 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3579e-05 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674380+0000", 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001237908 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674578+0000", 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000197617 2024-05-07T14:02:54.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674864+0000", 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028589499999999999 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678694+0000", 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038299900000000001 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679226+0000", 2024-05-07T14:02:54.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053176199999999997 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679299+0000", 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3658000000000005e-05 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679363+0000", 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3816e-05 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1579 4.e 4:70198fec:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.897263+0000", 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.2656249100000001, 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004814881, 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1579 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.253 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897263+0000", 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897263+0000", 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897266+0000", 2024-05-07T14:02:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897279+0000", 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3029e-05 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2225999999999999e-05 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897364+0000", 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2726000000000003e-05 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897563+0000", 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019917700000000001 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897900+0000", 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000337175 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.898374+0000", 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000474229 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.901318+0000", 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029436499999999999 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.901935+0000", 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061724700000000002 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.902014+0000", 2024-05-07T14:02:54.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8949000000000006e-05 2024-05-07T14:02:54.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.902078+0000", 2024-05-07T14:02:54.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3726000000000006e-05 2024-05-07T14:02:54.258 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.258 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.258 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.258 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1587 4.1b 4:d97b2c21:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.897446+0000", 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.2654417200000001, 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033670710000000001, 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1587 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897446+0000", 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897446+0000", 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897448+0000", 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0600000000000002e-06 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897464+0000", 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5840000000000001e-05 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897498+0000", 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4569000000000001e-05 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897516+0000", 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7697e-05 2024-05-07T14:02:54.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897642+0000", 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012585499999999999 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897980+0000", 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000337478 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.898385+0000", 2024-05-07T14:02:54.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000405356 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.900329+0000", 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001943923 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.900368+0000", 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9332999999999998e-05 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.900624+0000", 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000255436 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.900813+0000", 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000189524 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1612 3.3 3:c1191b65:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.739997566, 2024-05-07T14:02:54.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013953758, 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1612 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422894+0000", 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3400000000000002e-06 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426732+0000", 2024-05-07T14:02:54.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386760000000001 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426772+0000", 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9740000000000002e-05 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426791+0000", 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426935+0000", 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144368 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.427196+0000", 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026091599999999998 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.427426+0000", 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022962899999999999 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.434735+0000", 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073090990000000003 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436629+0000", 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018938640000000001 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436721+0000", 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1943999999999999e-05 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436844+0000", 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012338900000000001 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1614 3.1d e81/21 3:baaad814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4_10Mb.:head v 81'1, mlcod=0'0)", 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.71274826700000005, 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013565693, 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:54.270 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450142+0000", 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3970000000000001e-06 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453081+0000", 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029395100000000002 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453123+0000", 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1356000000000002e-05 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453142+0000", 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453311+0000", 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016885700000000001 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453349+0000", 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8033e-05 2024-05-07T14:02:54.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.463599+0000", 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010250011 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.463705+0000", 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000105839 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:54.274 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:54.275 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:54.275 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:02:54.276 INFO:tasks.workunit.client.0.smithi106.stdout:Bucket Created: buck_2024_04_7_14_02_54 2024-05-07T14:02:54.277 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:54.284+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:54.277 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:02:54.323 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:02:54.377 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:54.388+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:54.393 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:54.393 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - quota set for the bucket: buck_2024_04_7_14_02_54 with max objects as zero 2024-05-07T14:02:54.394 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:54.394 INFO:tasks.workunit.client.0.smithi106.stdout:bucket delete succeeded 2024-05-07T14:02:54.425 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:54.425 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:54.446 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:54.446 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:54.453 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:54.454 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:54.454 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:54.454 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:54.467 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:54.468 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:54.468 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:54.478 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:54.488+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:54.487 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:54.487 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:54.506 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:54.507 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:54.526 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:54.560 INFO:tasks.workunit.client.0.smithi106.stdout:Bucket Created: buck_2024_04_7_14_02_54 2024-05-07T14:02:54.563 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:54.564 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:54.579 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:54.588+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:54.596 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:54.597 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:54.610 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:54.696 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:54.708+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:54.728 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:54.729 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - quota set for the bucket: buck_2024_04_7_14_02_54 max objects -1 2024-05-07T14:02:54.729 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:54.729 INFO:tasks.workunit.client.0.smithi106.stdout:bucket delete succeeded 2024-05-07T14:02:54.781 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:54.792+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:54.781 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:54.781 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:54.796 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:54.864 INFO:tasks.workunit.client.0.smithi106.stdout:Bucket Created: buck_2024_04_7_14_02_54 2024-05-07T14:02:54.888 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:54.900+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:54.968 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:54.968 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:54.984 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:54.984 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:54.992+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:55.039 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:55.039 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - quota set for the bucket: buck_2024_04_7_14_02_54 with max size -1 2024-05-07T14:02:55.039 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:02:55.039 INFO:tasks.workunit.client.0.smithi106.stdout:bucket delete succeeded 2024-05-07T14:02:55.084 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:55.096+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:55.152 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:55.152 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:55.167 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:55.212 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:55.224+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:55.287 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:55.296+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:55.289 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:55.289 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:55.303 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:55.319 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:02:55.388 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:55.396+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:55.470 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:55.471 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:55.484 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:55.532 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:55.544+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:55.590 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:55.600+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:55.607 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:55.607 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:55.621 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:02:55.691 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:55.700+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:55.786 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:55.786 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:55.792 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:55.804+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:55.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:02:55.893 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:02:55.904+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:02:55.916 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:55.916 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:55.932 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:02:56.020 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:56.032+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:56.095 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:56.108+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:56.098 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:56.098 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:56.115 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:02:56.196 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:56.208+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:56.270 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:56.270 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:56.286 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:02:56.297 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:56.308+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:56.339 INFO:tasks.workunit.client.0.smithi106.stderr:200+0 records in 2024-05-07T14:02:56.339 INFO:tasks.workunit.client.0.smithi106.stderr:200+0 records out 2024-05-07T14:02:56.339 INFO:tasks.workunit.client.0.smithi106.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 1.299 s, 1.6 GB/s 2024-05-07T14:02:56.397 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:56.408+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:56.405 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:56.405 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:56.419 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:02:56.504 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:56.516+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:56.512 INFO:tasks.workunit.client.0.smithi106.stdout:Bucket Created: buck_2024_04_7_14_02_56 2024-05-07T14:02:56.577 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:56.577 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:56.581 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:02:56.591 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:02:56.599 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:56.608+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:56.664 INFO:tasks.workunit.client.0.smithi106.stdout:quota set for the bucket: buck_2024_04_7_14_02_56 2024-05-07T14:02:56.700 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:56.712+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:56.717 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:56.717 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:56.735 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:56.735 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:56.752 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:56.752 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:56.762 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:56.762 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:56.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:56.762 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:56.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.762 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:02:56.762 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:56.762 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 116.789900328, 2024-05-07T14:02:56.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:02:56.762 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.763 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.763 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:56.763 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:56.763 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:02:56.763 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:02:56.763 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:02:56.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.763 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:56.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:02:56.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:02:56.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:02:56.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:56.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:02:56.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:02:56.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:02:56.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:02:56.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:50 7.15 e30/29 7:a93a5511:::notify.2:head v 30'1, mlcod=0'0)", 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 112.742734457, 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039612629999999996, 2024-05-07T14:02:56.767 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.768 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.768 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.768 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:56.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032118+0000", 2024-05-07T14:02:56.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032119+0000", 2024-05-07T14:02:56.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.82e-07 2024-05-07T14:02:56.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032147+0000", 2024-05-07T14:02:56.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7691999999999998e-05 2024-05-07T14:02:56.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032162+0000", 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.499e-05 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032173+0000", 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1042e-05 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032278+0000", 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105097 2024-05-07T14:02:56.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.032321+0000", 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2981000000000001e-05 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.035986+0000", 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003664755 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:04.036080+0000", 2024-05-07T14:02:56.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4223999999999998e-05 2024-05-07T14:02:56.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.772 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.772 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:56.772 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:56.772 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 109.73986268, 2024-05-07T14:02:56.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040082820000000002, 2024-05-07T14:02:56.772 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.772 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.772 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.772 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 208 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034990+0000", 2024-05-07T14:02:56.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034993+0000", 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8169999999999999e-06 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035021+0000", 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7900000000000001e-05 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035052+0000", 2024-05-07T14:02:56.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0979000000000003e-05 2024-05-07T14:02:56.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035074+0000", 2024-05-07T14:02:56.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.19e-05 2024-05-07T14:02:56.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035201+0000", 2024-05-07T14:02:56.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012677200000000001 2024-05-07T14:02:56.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035449+0000", 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024873799999999998 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.035883+0000", 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00043404700000000001 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.037339+0000", 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014560720000000001 2024-05-07T14:02:56.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038831+0000", 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001491888 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038937+0000", 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106006 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.038999+0000", 2024-05-07T14:02:56.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1162999999999997e-05 2024-05-07T14:02:56.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.778 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:56.778 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:56.778 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 109.67539641800001, 2024-05-07T14:02:56.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00350666, 2024-05-07T14:02:56.778 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.778 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.778 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.778 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 224 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099457+0000", 2024-05-07T14:02:56.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099459+0000", 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0229999999999999e-06 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099470+0000", 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1714e-05 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099499+0000", 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9223000000000001e-05 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099514+0000", 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4983e-05 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099637+0000", 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012221199999999999 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.099848+0000", 2024-05-07T14:02:56.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000211492 2024-05-07T14:02:56.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:56.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.100270+0000", 2024-05-07T14:02:56.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042227399999999999 2024-05-07T14:02:56.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:56.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.101553+0000", 2024-05-07T14:02:56.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001282243 2024-05-07T14:02:56.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:56.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102808+0000", 2024-05-07T14:02:56.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012549270000000001 2024-05-07T14:02:56.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102897+0000", 2024-05-07T14:02:56.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9240000000000006e-05 2024-05-07T14:02:56.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.102963+0000", 2024-05-07T14:02:56.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6328999999999995e-05 2024-05-07T14:02:56.784 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.784 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.784 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.784 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:56.784 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:56.784 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 109.606797036, 2024-05-07T14:02:56.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:02:56.784 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:02:56.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:02:56.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:02:56.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:02:56.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:02:56.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:02:56.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:02:56.790 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.790 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.790 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.790 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:402 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:56.790 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 109.58205347000001, 2024-05-07T14:02:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040762130000000004, 2024-05-07T14:02:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 402 2024-05-07T14:02:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:56.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192799+0000", 2024-05-07T14:02:56.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192801+0000", 2024-05-07T14:02:56.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6249999999999999e-06 2024-05-07T14:02:56.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192809+0000", 2024-05-07T14:02:56.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8490000000000006e-06 2024-05-07T14:02:56.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192822+0000", 2024-05-07T14:02:56.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3217999999999999e-05 2024-05-07T14:02:56.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192829+0000", 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4910000000000002e-06 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192891+0000", 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2681000000000005e-05 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.192992+0000", 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100189 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.193202+0000", 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021021200000000001 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.194843+0000", 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001640856 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196755+0000", 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019126309999999999 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196819+0000", 2024-05-07T14:02:56.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3727999999999997e-05 2024-05-07T14:02:56.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.196876+0000", 2024-05-07T14:02:56.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6733e-05 2024-05-07T14:02:56.796 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.796 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.796 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 109.471177067, 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:56.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:02:56.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:02:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:02:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:02:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:02:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:02:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:02:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:02:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:02:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:02:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:02:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:02:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:02:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:02:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:02:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:642 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 109.415013118, 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037040739999999999, 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 642 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359840+0000", 2024-05-07T14:02:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359842+0000", 2024-05-07T14:02:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2699999999999999e-06 2024-05-07T14:02:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359853+0000", 2024-05-07T14:02:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.077e-05 2024-05-07T14:02:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359885+0000", 2024-05-07T14:02:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:02:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359907+0000", 2024-05-07T14:02:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1756999999999999e-05 2024-05-07T14:02:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.359982+0000", 2024-05-07T14:02:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4995999999999998e-05 2024-05-07T14:02:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360089+0000", 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107204 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.360282+0000", 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000193575 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.361155+0000", 2024-05-07T14:02:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087206800000000004 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363393+0000", 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002238164 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363483+0000", 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.363544+0000", 2024-05-07T14:02:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1221000000000002e-05 2024-05-07T14:02:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 108.857296342, 2024-05-07T14:02:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003709258, 2024-05-07T14:02:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 931 2024-05-07T14:02:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917557+0000", 2024-05-07T14:02:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917559+0000", 2024-05-07T14:02:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2970000000000002e-06 2024-05-07T14:02:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917571+0000", 2024-05-07T14:02:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.169e-05 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917601+0000", 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0139999999999999e-05 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917615+0000", 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4708999999999999e-05 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.917756+0000", 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140233 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918110+0000", 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000354734 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.918656+0000", 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00054598199999999998 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.920100+0000", 2024-05-07T14:02:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014440220000000001 2024-05-07T14:02:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921005+0000", 2024-05-07T14:02:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00090457000000000005 2024-05-07T14:02:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921150+0000", 2024-05-07T14:02:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145465 2024-05-07T14:02:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.921266+0000", 2024-05-07T14:02:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011541599999999999 2024-05-07T14:02:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1571 4.24 4:26e499bb:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:02:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.1020039260000001, 2024-05-07T14:02:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063870100000000003, 2024-05-07T14:02:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1571 2024-05-07T14:02:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2800000000000002e-07 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672852+0000", 2024-05-07T14:02:56.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6599999999999999e-06 2024-05-07T14:02:56.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672866+0000", 2024-05-07T14:02:56.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3648999999999999e-05 2024-05-07T14:02:56.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672871+0000", 2024-05-07T14:02:56.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:02:56.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672926+0000", 2024-05-07T14:02:56.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4299999999999998e-05 2024-05-07T14:02:56.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673007+0000", 2024-05-07T14:02:56.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1429999999999998e-05 2024-05-07T14:02:56.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:56.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673097+0000", 2024-05-07T14:02:56.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0272000000000006e-05 2024-05-07T14:02:56.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:56.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673822+0000", 2024-05-07T14:02:56.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072425300000000001 2024-05-07T14:02:56.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:56.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679164+0000", 2024-05-07T14:02:56.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005341943 2024-05-07T14:02:56.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679209+0000", 2024-05-07T14:02:56.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5738000000000002e-05 2024-05-07T14:02:56.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679236+0000", 2024-05-07T14:02:56.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6633000000000001e-05 2024-05-07T14:02:56.821 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.821 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.821 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.822 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1564 4.10 e81/23 4:09f2eb25:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.2:head v 81'2, mlcod=0'0)", 2024-05-07T14:02:56.822 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.673092+0000", 2024-05-07T14:02:56.822 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.1017610629999997, 2024-05-07T14:02:56.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003431281, 2024-05-07T14:02:56.822 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.822 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.822 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.822 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673092+0000", 2024-05-07T14:02:56.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673092+0000", 2024-05-07T14:02:56.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673093+0000", 2024-05-07T14:02:56.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9699999999999995e-07 2024-05-07T14:02:56.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673099+0000", 2024-05-07T14:02:56.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8669999999999999e-06 2024-05-07T14:02:56.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673109+0000", 2024-05-07T14:02:56.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0658e-05 2024-05-07T14:02:56.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673116+0000", 2024-05-07T14:02:56.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6229999999999999e-06 2024-05-07T14:02:56.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673350+0000", 2024-05-07T14:02:56.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023397500000000001 2024-05-07T14:02:56.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673367+0000", 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7231000000000002e-05 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.676475+0000", 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031080499999999998 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.676523+0000", 2024-05-07T14:02:56.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.808e-05 2024-05-07T14:02:56.827 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.827 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.827 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.827 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1578 4.27 4:e7c87c96:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:56.827 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:02:56.827 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.8775417860000001, 2024-05-07T14:02:56.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046530510000000001, 2024-05-07T14:02:56.827 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1578 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897314+0000", 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7250000000000002e-06 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897328+0000", 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4e-05 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897352+0000", 2024-05-07T14:02:56.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4576999999999999e-05 2024-05-07T14:02:56.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897366+0000", 2024-05-07T14:02:56.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3173000000000001e-05 2024-05-07T14:02:56.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897473+0000", 2024-05-07T14:02:56.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010762100000000001 2024-05-07T14:02:56.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897601+0000", 2024-05-07T14:02:56.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012757099999999999 2024-05-07T14:02:56.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:56.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897754+0000", 2024-05-07T14:02:56.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152807 2024-05-07T14:02:56.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900001+0000", 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002247686 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901868+0000", 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018669940000000001 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901924+0000", 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5383999999999997e-05 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901964+0000", 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0513000000000003e-05 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1581 4.12 4:48df6db5:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897415+0000", 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.8774381660000001, 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036145650000000001, 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.836 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1581 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897415+0000", 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897415+0000", 2024-05-07T14:02:56.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897415+0000", 2024-05-07T14:02:56.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8800000000000002e-07 2024-05-07T14:02:56.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897420+0000", 2024-05-07T14:02:56.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3610000000000003e-06 2024-05-07T14:02:56.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897434+0000", 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4082e-05 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897440+0000", 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2009999999999996e-06 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897521+0000", 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0674999999999996e-05 2024-05-07T14:02:56.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897628+0000", 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106964 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897752+0000", 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000123848 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898839+0000", 2024-05-07T14:02:56.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010875030000000001 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900933+0000", 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020942270000000002 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900984+0000", 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0974999999999999e-05 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901029+0000", 2024-05-07T14:02:56.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5040999999999998e-05 2024-05-07T14:02:56.842 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.842 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.842 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.842 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1582 4.27 4:e6cd56b0:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:56.842 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:02:56.842 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.8773954339999999, 2024-05-07T14:02:56.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046596959999999996, 2024-05-07T14:02:56.842 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.842 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.842 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.843 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:56.843 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:56.843 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:56.843 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1582 2024-05-07T14:02:56.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.843 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:02:56.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:02:56.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897458+0000", 2024-05-07T14:02:56.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5700000000000002e-07 2024-05-07T14:02:56.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897462+0000", 2024-05-07T14:02:56.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0690000000000003e-06 2024-05-07T14:02:56.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897469+0000", 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0079999999999996e-06 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897474+0000", 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9420000000000003e-06 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898643+0000", 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011688709999999999 2024-05-07T14:02:56.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898756+0000", 2024-05-07T14:02:56.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113522 2024-05-07T14:02:56.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:56.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898961+0000", 2024-05-07T14:02:56.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020425799999999999 2024-05-07T14:02:56.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:56.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900212+0000", 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012512860000000001 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902014+0000", 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018024029999999999 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902075+0000", 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0509e-05 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902117+0000", 2024-05-07T14:02:56.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2271000000000002e-05 2024-05-07T14:02:56.848 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.848 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.848 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.848 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:47 7.0 e81/29 7:05bf5b68:::notify.1:head v 81'49, mlcod=81'47)", 2024-05-07T14:02:56.848 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.148500+0000", 2024-05-07T14:02:56.848 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.6263527440000001, 2024-05-07T14:02:56.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040597070000000001, 2024-05-07T14:02:56.848 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.848 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.848 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.849 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.148500+0000", 2024-05-07T14:02:56.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.148500+0000", 2024-05-07T14:02:56.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.148501+0000", 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4499999999999998e-07 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.148506+0000", 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2850000000000002e-06 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.148512+0000", 2024-05-07T14:02:56.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2620000000000004e-06 2024-05-07T14:02:56.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.148515+0000", 2024-05-07T14:02:56.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2720000000000002e-06 2024-05-07T14:02:56.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.148584+0000", 2024-05-07T14:02:56.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8385000000000003e-05 2024-05-07T14:02:56.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.148597+0000", 2024-05-07T14:02:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3183000000000001e-05 2024-05-07T14:02:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152531+0000", 2024-05-07T14:02:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039341840000000003 2024-05-07T14:02:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152560+0000", 2024-05-07T14:02:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8790999999999999e-05 2024-05-07T14:02:56.852 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:49 7.15 e81/29 7:a93a5511:::notify.2:head v 81'49, mlcod=81'47)", 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.6238733239999998, 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0070782700000000002, 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:02:56.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:02:56.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150981+0000", 2024-05-07T14:02:56.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2899999999999999e-06 2024-05-07T14:02:56.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150990+0000", 2024-05-07T14:02:56.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3959999999999995e-06 2024-05-07T14:02:56.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151011+0000", 2024-05-07T14:02:56.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.105e-05 2024-05-07T14:02:56.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151023+0000", 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151122+0000", 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9351999999999993e-05 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151155+0000", 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2459000000000002e-05 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158027+0000", 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.006871785 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158058+0000", 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1315000000000001e-05 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:52 7.d e81/29 7:b4812045:::notify.4:head v 81'48, mlcod=81'46)", 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:02:56.857 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.621426912, 2024-05-07T14:02:56.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0048232429999999996, 2024-05-07T14:02:56.858 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.858 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.858 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.858 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:02:56.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:02:56.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153427+0000", 2024-05-07T14:02:56.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6499999999999999e-07 2024-05-07T14:02:56.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153432+0000", 2024-05-07T14:02:56.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9579999999999998e-06 2024-05-07T14:02:56.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153441+0000", 2024-05-07T14:02:56.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.662e-06 2024-05-07T14:02:56.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153446+0000", 2024-05-07T14:02:56.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7530000000000001e-06 2024-05-07T14:02:56.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153492+0000", 2024-05-07T14:02:56.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5853999999999998e-05 2024-05-07T14:02:56.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153505+0000", 2024-05-07T14:02:56.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3288000000000001e-05 2024-05-07T14:02:56.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158230+0000", 2024-05-07T14:02:56.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0047249170000000004 2024-05-07T14:02:56.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158249+0000", 2024-05-07T14:02:56.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9145999999999999e-05 2024-05-07T14:02:56.862 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.862 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.862 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.862 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5535.0:47 7.0 e81/29 7:05bf5b68:::notify.1:head v 81'52, mlcod=81'50)", 2024-05-07T14:02:56.863 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.305910+0000", 2024-05-07T14:02:56.863 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.468943135, 2024-05-07T14:02:56.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034933709999999999, 2024-05-07T14:02:56.863 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.863 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.863 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.863 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.305910+0000", 2024-05-07T14:02:56.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.305910+0000", 2024-05-07T14:02:56.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.305910+0000", 2024-05-07T14:02:56.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9499999999999998e-07 2024-05-07T14:02:56.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.305913+0000", 2024-05-07T14:02:56.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9840000000000001e-06 2024-05-07T14:02:56.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.305917+0000", 2024-05-07T14:02:56.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2969999999999997e-06 2024-05-07T14:02:56.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.305921+0000", 2024-05-07T14:02:56.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7749999999999999e-06 2024-05-07T14:02:56.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.305961+0000", 2024-05-07T14:02:56.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9544e-05 2024-05-07T14:02:56.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.305973+0000", 2024-05-07T14:02:56.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2396e-05 2024-05-07T14:02:56.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.309359+0000", 2024-05-07T14:02:56.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033859419999999999 2024-05-07T14:02:56.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.309403+0000", 2024-05-07T14:02:56.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4138000000000003e-05 2024-05-07T14:02:56.867 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.867 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.867 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.868 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5535.0:49 7.15 e81/29 7:a93a5511:::notify.2:head v 81'52, mlcod=81'50)", 2024-05-07T14:02:56.868 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.308119+0000", 2024-05-07T14:02:56.868 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.466734099, 2024-05-07T14:02:56.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039538459999999996, 2024-05-07T14:02:56.868 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.868 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.868 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.868 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.308119+0000", 2024-05-07T14:02:56.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.308119+0000", 2024-05-07T14:02:56.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.308119+0000", 2024-05-07T14:02:56.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9599999999999999e-07 2024-05-07T14:02:56.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.308123+0000", 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0879999999999997e-06 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.308133+0000", 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1710000000000008e-06 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.308137+0000", 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4739999999999999e-06 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.308173+0000", 2024-05-07T14:02:56.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6335999999999999e-05 2024-05-07T14:02:56.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.308186+0000", 2024-05-07T14:02:56.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2344000000000001e-05 2024-05-07T14:02:56.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.312032+0000", 2024-05-07T14:02:56.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038460569999999999 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.312073+0000", 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0880000000000002e-05 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5535.0:52 7.d e81/29 7:b4812045:::notify.4:head v 81'51, mlcod=81'49)", 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.310585+0000", 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.4642679890000001, 2024-05-07T14:02:56.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042443120000000001, 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.310585+0000", 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.310585+0000", 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:56.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:56.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.310586+0000", 2024-05-07T14:02:56.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1099999999999995e-07 2024-05-07T14:02:56.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:56.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.310591+0000", 2024-05-07T14:02:56.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4569999999999996e-06 2024-05-07T14:02:56.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:56.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.310600+0000", 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3039999999999994e-06 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.310606+0000", 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7989999999999999e-06 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.310645+0000", 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9280999999999999e-05 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.310658+0000", 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2587e-05 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.314783+0000", 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041245960000000003 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.314829+0000", 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6677e-05 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.876 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.877 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.877 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:56.877 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:56.877 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:56.878 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:56.878 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:56.879 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:02:56.879 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:56.880 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:56.880 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:56.880 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:56.881 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:56.881 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:56.881 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:56.882 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:56.882 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:56.888+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:56.979 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:56.992+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:57.043 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:57.043 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:57.044 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:57.044 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:57.057 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:02:57.100 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:57.112+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:57.169 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:57.169 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:57.170 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:57.170 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:57.170 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:57.181 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:57.192+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:57.182 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:02:57.282 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:57.292+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:57.343 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:02:57.354 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:57.354 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:57.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:57.354 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:57.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.354 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.354 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 110.21974772599999, 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:02:57.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:02:57.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:02:57.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:02:57.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:57.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:02:57.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:02:57.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:02:57.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:02:57.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:02:57.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:02:57.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 110.207328785, 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:02:57.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:02:57.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:02:57.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:02:57.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:02:57.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:02:57.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:02:57.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:57.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:02:57.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:02:57.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:02:57.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:02:57.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:02:57.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:02:57.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 110.20344906299999, 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:02:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:02:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:02:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:02:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:02:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:02:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:02:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:02:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:02:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:02:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:02:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:02:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:02:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 110.07279355999999, 2024-05-07T14:02:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:02:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:02:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:02:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:02:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:02:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:02:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:02:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:02:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:02:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:02:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:02:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:02:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:02:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:02:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:02:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 110.06562623799999, 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:02:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.380 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:57.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:02:57.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:02:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:02:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:02:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:02:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:02:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:02:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:02:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:02:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:02:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:02:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 109.77509354999999, 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:02:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:02:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:02:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:02:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:02:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:02:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:02:57.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:02:57.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:02:57.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:02:57.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:02:57.389 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.389 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.389 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 109.640845919, 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:02:57.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.395 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.396 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:57.396 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 109.595132523, 2024-05-07T14:02:57.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:02:57.396 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.396 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.396 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.396 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.396 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.396 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.396 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:02:57.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:02:57.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:02:57.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:02:57.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:02:57.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:02:57.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:02:57.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:02:57.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:02:57.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:02:57.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:02:57.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:02:57.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:02:57.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:02:57.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:02:57.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:02:57.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:02:57.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:02:57.402 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.402 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.402 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.402 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.402 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:57.402 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 109.58885578500001, 2024-05-07T14:02:57.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:02:57.403 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.403 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.403 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.403 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.403 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.403 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.403 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:02:57.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.403 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:02:57.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:02:57.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:02:57.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:02:57.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:02:57.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:02:57.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:02:57.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:57.408 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 109.403764579, 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:57.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:02:57.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:02:57.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:02:57.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:02:57.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:02:57.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:02:57.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:02:57.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:57.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:02:57.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:02:57.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:02:57.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:02:57.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:02:57.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:02:57.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:02:57.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:02:57.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:02:57.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:02:57.414 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.414 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5099.0:56 7.14 e80/29 7:2b04a3e9:::notify.6:head v 80'36, mlcod=80'34)", 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.1852035120000002, 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046522059999999999, 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:02:57.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:02:57.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:02:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1399999999999997e-07 2024-05-07T14:02:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179862+0000", 2024-05-07T14:02:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4330000000000003e-06 2024-05-07T14:02:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179873+0000", 2024-05-07T14:02:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0838e-05 2024-05-07T14:02:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179879+0000", 2024-05-07T14:02:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3099999999999997e-06 2024-05-07T14:02:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179934+0000", 2024-05-07T14:02:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4625e-05 2024-05-07T14:02:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179955+0000", 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-05 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184469+0000", 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045139150000000003 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184508+0000", 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9001000000000001e-05 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5117.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94838143561296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.490856+0000", 2024-05-07T14:02:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.8742029850000002, 2024-05-07T14:02:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034216759999999998, 2024-05-07T14:02:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5117", 2024-05-07T14:02:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/62727776", 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 51 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490856+0000", 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490856+0000", 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490857+0000", 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490862+0000", 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3419999999999998e-06 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490871+0000", 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.089e-06 2024-05-07T14:02:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490875+0000", 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8300000000000003e-06 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490910+0000", 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4856e-05 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490955+0000", 2024-05-07T14:02:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5181e-05 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.491035+0000", 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9542999999999994e-05 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.492688+0000", 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016531130000000001 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.494187+0000", 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014991099999999999 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.494233+0000", 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5676000000000001e-05 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.494278+0000", 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5192999999999999e-05 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5117.0:56 7.14 e81/29 7:2b04a3e9:::notify.6:head v 81'39, mlcod=80'37)", 2024-05-07T14:02:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:02:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.8686076719999996, 2024-05-07T14:02:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078436700000000005, 2024-05-07T14:02:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:02:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:02:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:02:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.34e-07 2024-05-07T14:02:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496456+0000", 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5410000000000001e-06 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496463+0000", 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7689999999999996e-06 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496468+0000", 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1969999999999998e-06 2024-05-07T14:02:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496518+0000", 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0793e-05 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496538+0000", 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0000000000000002e-05 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504267+0000", 2024-05-07T14:02:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077288419999999997 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504295+0000", 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8093999999999999e-05 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1585 4.2d 4:b60c161e:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897371+0000", 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.467688442, 2024-05-07T14:02:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035527139999999998, 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1585 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897371+0000", 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897371+0000", 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897373+0000", 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2680000000000001e-06 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897382+0000", 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.85e-06 2024-05-07T14:02:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897402+0000", 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9732999999999999e-05 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897412+0000", 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0292000000000001e-05 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897477+0000", 2024-05-07T14:02:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4639000000000002e-05 2024-05-07T14:02:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897597+0000", 2024-05-07T14:02:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120727 2024-05-07T14:02:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897756+0000", 2024-05-07T14:02:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015853500000000001 2024-05-07T14:02:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898973+0000", 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012173780000000001 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900839+0000", 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00186578 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900890+0000", 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0991e-05 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900924+0000", 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3521e-05 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5165.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94404812949152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.152665+0000", 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.2123941049999996, 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031931310000000001, 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5165", 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/3551621939", 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 51 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152665+0000", 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152665+0000", 2024-05-07T14:02:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152666+0000", 2024-05-07T14:02:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9800000000000002e-07 2024-05-07T14:02:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152670+0000", 2024-05-07T14:02:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1219999999999997e-06 2024-05-07T14:02:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152684+0000", 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3198e-05 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152689+0000", 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4909999999999996e-06 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152730+0000", 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0772999999999997e-05 2024-05-07T14:02:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152791+0000", 2024-05-07T14:02:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1629000000000002e-05 2024-05-07T14:02:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152873+0000", 2024-05-07T14:02:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2097999999999999e-05 2024-05-07T14:02:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.154257+0000", 2024-05-07T14:02:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013832479999999999 2024-05-07T14:02:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.155746+0000", 2024-05-07T14:02:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014890249999999999 2024-05-07T14:02:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.155793+0000", 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7617000000000002e-05 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.155858+0000", 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5031999999999997e-05 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:56 7.14 e81/29 7:2b04a3e9:::notify.6:head v 81'48, mlcod=81'46)", 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:02:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.2048678319999997, 2024-05-07T14:02:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039243350000000001, 2024-05-07T14:02:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:02:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6199999999999999e-07 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160195+0000", 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3569999999999998e-06 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160202+0000", 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8120000000000002e-06 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160207+0000", 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5390000000000001e-06 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160259+0000", 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2578999999999999e-05 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160279+0000", 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9599999999999999e-05 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164086+0000", 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038071979999999999 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164116+0000", 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9887999999999999e-05 2024-05-07T14:02:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1720 4.1c 4:397a1514:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.5.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.4427842580000001, 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041467209999999999, 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1720 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922276+0000", 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4799999999999998e-07 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922280+0000", 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4839999999999998e-06 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922288+0000", 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9610000000000005e-06 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922300+0000", 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1365e-05 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922369+0000", 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9758999999999994e-05 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922491+0000", 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121383 2024-05-07T14:02:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922642+0000", 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015127200000000001 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.923617+0000", 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097548299999999997 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926352+0000", 2024-05-07T14:02:57.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027348170000000001 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926382+0000", 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9808e-05 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926422+0000", 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9740999999999998e-05 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1825 4.d e81/23 4:b33fbda9:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.4:head v 81'3, mlcod=80'1)", 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.215002+0000", 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.1500576499999999, 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029443249999999998, 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215002+0000", 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215002+0000", 2024-05-07T14:02:57.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215002+0000", 2024-05-07T14:02:57.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3799999999999997e-07 2024-05-07T14:02:57.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215007+0000", 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4129999999999999e-06 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215016+0000", 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0350000000000007e-06 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215022+0000", 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6200000000000001e-06 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215091+0000", 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8244000000000006e-05 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215109+0000", 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8338999999999998e-05 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.217910+0000", 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028009950000000001 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.217946+0000", 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6140999999999998e-05 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1919 4.19 e81/23 4:9aff226f:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.5:head v 81'3, mlcod=81'1)", 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.397819+0000", 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.9672406650000003, 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029787220000000001, 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.457 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397819+0000", 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397819+0000", 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397819+0000", 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1900000000000002e-07 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397825+0000", 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9170000000000003e-06 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397835+0000", 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0093e-05 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397845+0000", 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7769999999999997e-06 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397914+0000", 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8621000000000006e-05 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397933+0000", 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8902e-05 2024-05-07T14:02:57.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.400745+0000", 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028122080000000001 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.400797+0000", 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2485000000000003e-05 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.461 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1922 4.19 e81/23 4:9849ed33:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.8:head v 81'4, mlcod=81'1)", 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.9671944679999998, 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005911655, 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8200000000000001e-07 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397869+0000", 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5209999999999998e-06 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397875+0000", 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6599999999999998e-06 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397881+0000", 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1240000000000004e-06 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398179+0000", 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029815899999999999 2024-05-07T14:02:57.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398197+0000", 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8133000000000001e-05 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403738+0000", 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055410950000000002 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403777+0000", 2024-05-07T14:02:57.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8581000000000002e-05 2024-05-07T14:02:57.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.466 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.466 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.466 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:57.467 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:02:57.468 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:57.476+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:57.568 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:57.580+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:57.625 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:02:57.625 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:57.638 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:02:57.669 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:57.680+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:57.745 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:57.745 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:02:57.746 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:02:57.746 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:02:57.746 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:57.758 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:02:57.769 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:57.780+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:57.869 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:02:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:02:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:02:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:02:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:02:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 115.878333957, 2024-05-07T14:02:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:02:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:02:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:02:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:02:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:02:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:02:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:02:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:02:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:02:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:02:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:02:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:02:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:02:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:02:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:02:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:02:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:02:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:02:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:02:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:02:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:02:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 110.857930137, 2024-05-07T14:02:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:02:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:02:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:02:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:02:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:02:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:02:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:02:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:02:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:02:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:02:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:02:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:02:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:02:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:02:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:02:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:02:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:02:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:02:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:02:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:02:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:02:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:02:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:02:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:415 6.7 e33/27 6:e622f76a:gc::gc.20:head v 33'6, mlcod=33'4)", 2024-05-07T14:02:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 110.67900248399999, 2024-05-07T14:02:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044669840000000002, 2024-05-07T14:02:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1799999999999995e-07 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201814+0000", 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4170000000000002e-06 2024-05-07T14:02:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201824+0000", 2024-05-07T14:02:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0217999999999999e-05 2024-05-07T14:02:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201838+0000", 2024-05-07T14:02:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3723000000000001e-05 2024-05-07T14:02:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201890+0000", 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2320000000000001e-05 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201906+0000", 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5894999999999999e-05 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206242+0000", 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043366489999999997 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206276+0000", 2024-05-07T14:02:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:02:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:432 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 110.667756904, 2024-05-07T14:02:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045128019999999998, 2024-05-07T14:02:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 432 2024-05-07T14:02:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:02:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213055+0000", 2024-05-07T14:02:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7000000000000005e-07 2024-05-07T14:02:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213058+0000", 2024-05-07T14:02:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0369999999999999e-06 2024-05-07T14:02:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213066+0000", 2024-05-07T14:02:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3680000000000002e-06 2024-05-07T14:02:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213084+0000", 2024-05-07T14:02:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7946999999999999e-05 2024-05-07T14:02:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213127+0000", 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2673999999999998e-05 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213222+0000", 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5488000000000005e-05 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213412+0000", 2024-05-07T14:02:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000189307 2024-05-07T14:02:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.214754+0000", 2024-05-07T14:02:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001342069 2024-05-07T14:02:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217447+0000", 2024-05-07T14:02:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026931250000000002 2024-05-07T14:02:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217521+0000", 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3997000000000003e-05 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217567+0000", 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6220000000000001e-05 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:430 6.7 e33/27 6:e1cdb60d:reshard::reshard.0000000008:head v 33'9, mlcod=33'6)", 2024-05-07T14:02:57.896 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 110.667710421, 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043702330000000003, 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0400000000000005e-07 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213107+0000", 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5740000000000003e-06 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213117+0000", 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8349999999999999e-06 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213122+0000", 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5140000000000001e-06 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213169+0000", 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6551000000000002e-05 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213198+0000", 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217415+0000", 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042171090000000001 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217471+0000", 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5766000000000001e-05 2024-05-07T14:02:57.900 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:480 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 110.639246266, 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052104459999999997, 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.901 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.902 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 480 2024-05-07T14:02:57.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.902 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:57.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:57.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:02:57.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6199999999999997e-07 2024-05-07T14:02:57.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241570+0000", 2024-05-07T14:02:57.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2479999999999998e-06 2024-05-07T14:02:57.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241580+0000", 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8719999999999997e-06 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241584+0000", 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7210000000000002e-06 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241629+0000", 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4465000000000002e-05 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241671+0000", 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2370999999999998e-05 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241772+0000", 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101048 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.243876+0000", 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021036789999999998 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246710+0000", 2024-05-07T14:02:57.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028339060000000002 2024-05-07T14:02:57.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246747+0000", 2024-05-07T14:02:57.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7061000000000003e-05 2024-05-07T14:02:57.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246775+0000", 2024-05-07T14:02:57.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8413000000000001e-05 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:499 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 110.62836554499999, 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050166450000000001, 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.907 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 499 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4300000000000002e-07 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252451+0000", 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1290000000000004e-06 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252463+0000", 2024-05-07T14:02:57.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1238e-05 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252470+0000", 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2019999999999998e-06 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252534+0000", 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4178999999999997e-05 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252706+0000", 2024-05-07T14:02:57.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017197 2024-05-07T14:02:57.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:57.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252871+0000", 2024-05-07T14:02:57.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016508199999999999 2024-05-07T14:02:57.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254444+0000", 2024-05-07T14:02:57.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001573112 2024-05-07T14:02:57.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257407+0000", 2024-05-07T14:02:57.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029630989999999999 2024-05-07T14:02:57.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257437+0000", 2024-05-07T14:02:57.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0009999999999999e-05 2024-05-07T14:02:57.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257462+0000", 2024-05-07T14:02:57.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4780999999999999e-05 2024-05-07T14:02:57.913 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.913 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.913 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.913 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:500 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.913 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:57.913 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 110.628079442, 2024-05-07T14:02:57.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046354220000000002, 2024-05-07T14:02:57.913 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.913 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.913 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.914 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.914 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.914 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.914 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 500 2024-05-07T14:02:57.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.914 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:57.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252733+0000", 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9399999999999993e-07 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252738+0000", 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6779999999999997e-06 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252750+0000", 2024-05-07T14:02:57.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1882000000000001e-05 2024-05-07T14:02:57.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252758+0000", 2024-05-07T14:02:57.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0649999999999999e-06 2024-05-07T14:02:57.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252811+0000", 2024-05-07T14:02:57.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2859000000000003e-05 2024-05-07T14:02:57.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252870+0000", 2024-05-07T14:02:57.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8956000000000003e-05 2024-05-07T14:02:57.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:57.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252992+0000", 2024-05-07T14:02:57.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122275 2024-05-07T14:02:57.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254326+0000", 2024-05-07T14:02:57.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013334449999999999 2024-05-07T14:02:57.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257254+0000", 2024-05-07T14:02:57.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029284039999999999 2024-05-07T14:02:57.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257316+0000", 2024-05-07T14:02:57.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1348999999999998e-05 2024-05-07T14:02:57.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257367+0000", 2024-05-07T14:02:57.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1514999999999997e-05 2024-05-07T14:02:57.919 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.919 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.919 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.919 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:686 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 110.478232558, 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046254349999999998, 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 686 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:57.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:02:57.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402581+0000", 2024-05-07T14:02:57.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:02:57.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402592+0000", 2024-05-07T14:02:57.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0984e-05 2024-05-07T14:02:57.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402619+0000", 2024-05-07T14:02:57.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7583e-05 2024-05-07T14:02:57.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402633+0000", 2024-05-07T14:02:57.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3553000000000001e-05 2024-05-07T14:02:57.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402699+0000", 2024-05-07T14:02:57.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6013000000000006e-05 2024-05-07T14:02:57.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402792+0000", 2024-05-07T14:02:57.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3455999999999994e-05 2024-05-07T14:02:57.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402928+0000", 2024-05-07T14:02:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013596800000000001 2024-05-07T14:02:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.403918+0000", 2024-05-07T14:02:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00099017000000000007 2024-05-07T14:02:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407144+0000", 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032257449999999999 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407180+0000", 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5462e-05 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407204+0000", 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4247999999999999e-05 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.925 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5099.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.7014459459999998, 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053287550000000001, 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5099", 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2788980923", 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:02:57.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.927 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:02:57.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:02:57.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179366+0000", 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7299999999999996e-07 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179368+0000", 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7879999999999998e-06 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179378+0000", 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8870000000000004e-06 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179384+0000", 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3009999999999997e-06 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179438+0000", 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4731000000000002e-05 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179515+0000", 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6817999999999995e-05 2024-05-07T14:02:57.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:02:57.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179637+0000", 2024-05-07T14:02:57.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122197 2024-05-07T14:02:57.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.181699+0000", 2024-05-07T14:02:57.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020617000000000001 2024-05-07T14:02:57.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184620+0000", 2024-05-07T14:02:57.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029204999999999999 2024-05-07T14:02:57.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184651+0000", 2024-05-07T14:02:57.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1267999999999999e-05 2024-05-07T14:02:57.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184694+0000", 2024-05-07T14:02:57.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2991999999999998e-05 2024-05-07T14:02:57.931 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.931 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.932 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.932 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1477 3.18 3:1a16f065:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:02:57.932 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:02:57.932 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.5953286139999996, 2024-05-07T14:02:57.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017437234999999999, 2024-05-07T14:02:57.932 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.932 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.932 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.932 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.932 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.932 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1477 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285485+0000", 2024-05-07T14:02:57.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.148e-06 2024-05-07T14:02:57.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287428+0000", 2024-05-07T14:02:57.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001943391 2024-05-07T14:02:57.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287451+0000", 2024-05-07T14:02:57.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2912e-05 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287464+0000", 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2758000000000001e-05 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287530+0000", 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6544999999999994e-05 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287643+0000", 2024-05-07T14:02:57.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011307900000000001 2024-05-07T14:02:57.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:57.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287732+0000", 2024-05-07T14:02:57.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8640999999999994e-05 2024-05-07T14:02:57.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.300987+0000", 2024-05-07T14:02:57.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013255052999999999 2024-05-07T14:02:57.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302819+0000", 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001831533 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302874+0000", 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5946000000000003e-05 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302920+0000", 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5228999999999997e-05 2024-05-07T14:02:57.937 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.5760665490000001, 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.938 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:02:57.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:02:57.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:02:57.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:02:57.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:02:57.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:02:57.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:02:57.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:02:57.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:57.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:02:57.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:02:57.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:02:57.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:02:57.944 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.944 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.944 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.944 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5117.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:57.944 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:02:57.944 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.3848236629999997, 2024-05-07T14:02:57.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008462018, 2024-05-07T14:02:57.944 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.945 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.945 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.945 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.945 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5117", 2024-05-07T14:02:57.945 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/62727776", 2024-05-07T14:02:57.945 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:02:57.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.945 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:02:57.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:02:57.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495988+0000", 2024-05-07T14:02:57.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999999e-07 2024-05-07T14:02:57.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495990+0000", 2024-05-07T14:02:57.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.765e-06 2024-05-07T14:02:57.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495995+0000", 2024-05-07T14:02:57.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3499999999999996e-06 2024-05-07T14:02:57.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495998+0000", 2024-05-07T14:02:57.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3739999999999998e-06 2024-05-07T14:02:57.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496050+0000", 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2015999999999998e-05 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496120+0000", 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9373000000000001e-05 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496224+0000", 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010395699999999999 2024-05-07T14:02:57.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.501395+0000", 2024-05-07T14:02:57.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051715090000000003 2024-05-07T14:02:57.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504399+0000", 2024-05-07T14:02:57.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030035930000000001 2024-05-07T14:02:57.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504428+0000", 2024-05-07T14:02:57.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:02:57.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504449+0000", 2024-05-07T14:02:57.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1608e-05 2024-05-07T14:02:57.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.950 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.950 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1485 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=14b,call rgw.obj_remove in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:57.950 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.2600848329999996, 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056592079999999998, 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1485 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:02:57.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:02:57.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620728+0000", 2024-05-07T14:02:57.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.457e-06 2024-05-07T14:02:57.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620734+0000", 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0460000000000002e-06 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620749+0000", 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5067e-05 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620758+0000", 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6989999999999992e-06 2024-05-07T14:02:57.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620819+0000", 2024-05-07T14:02:57.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1496999999999998e-05 2024-05-07T14:02:57.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620880+0000", 2024-05-07T14:02:57.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0908e-05 2024-05-07T14:02:57.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:57.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.621007+0000", 2024-05-07T14:02:57.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000127551 2024-05-07T14:02:57.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.622196+0000", 2024-05-07T14:02:57.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001188391 2024-05-07T14:02:57.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626306+0000", 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041097779999999997 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626357+0000", 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0936999999999997e-05 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626385+0000", 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8877000000000002e-05 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.956 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1487 6.13 6:c8333aab:gc::gc.11:head [call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_enqueue in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.626573+0000", 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.2542377780000002, 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043998559999999997, 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1487 2024-05-07T14:02:57.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.958 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626573+0000", 2024-05-07T14:02:57.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626573+0000", 2024-05-07T14:02:57.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626574+0000", 2024-05-07T14:02:57.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.066e-06 2024-05-07T14:02:57.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626579+0000", 2024-05-07T14:02:57.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7879999999999997e-06 2024-05-07T14:02:57.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626590+0000", 2024-05-07T14:02:57.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0705e-05 2024-05-07T14:02:57.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626598+0000", 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6899999999999992e-06 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626660+0000", 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2623e-05 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626757+0000", 2024-05-07T14:02:57.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6368999999999998e-05 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.627049+0000", 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029227700000000002 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.627919+0000", 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087008300000000001 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.630896+0000", 2024-05-07T14:02:57.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002976767 2024-05-07T14:02:57.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.630930+0000", 2024-05-07T14:02:57.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3847000000000003e-05 2024-05-07T14:02:57.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.630973+0000", 2024-05-07T14:02:57.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3640999999999998e-05 2024-05-07T14:02:57.962 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.962 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5165.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.159929+0000", 2024-05-07T14:02:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.7208818279999996, 2024-05-07T14:02:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043657139999999997, 2024-05-07T14:02:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5165", 2024-05-07T14:02:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/3551621939", 2024-05-07T14:02:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:02:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159929+0000", 2024-05-07T14:02:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159929+0000", 2024-05-07T14:02:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159930+0000", 2024-05-07T14:02:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9299999999999998e-07 2024-05-07T14:02:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159932+0000", 2024-05-07T14:02:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5730000000000002e-06 2024-05-07T14:02:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159946+0000", 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3685e-05 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159952+0000", 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7150000000000003e-06 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159998+0000", 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6771999999999999e-05 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160045+0000", 2024-05-07T14:02:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6520999999999997e-05 2024-05-07T14:02:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:02:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160107+0000", 2024-05-07T14:02:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1790000000000003e-05 2024-05-07T14:02:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.161190+0000", 2024-05-07T14:02:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010833489999999999 2024-05-07T14:02:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164211+0000", 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030213499999999999 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164261+0000", 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9521000000000002e-05 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164295+0000", 2024-05-07T14:02:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3945000000000001e-05 2024-05-07T14:02:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1919 4.19 4:9aff226f:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396299+0000", 2024-05-07T14:02:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.4845117299999999, 2024-05-07T14:02:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0047192270000000003, 2024-05-07T14:02:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1919 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396299+0000", 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396299+0000", 2024-05-07T14:02:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396300+0000", 2024-05-07T14:02:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6400000000000002e-07 2024-05-07T14:02:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396303+0000", 2024-05-07T14:02:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.751e-06 2024-05-07T14:02:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396319+0000", 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6320999999999998e-05 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396325+0000", 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4250000000000003e-06 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396394+0000", 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8934000000000001e-05 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396471+0000", 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6638999999999996e-05 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396572+0000", 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101217 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397664+0000", 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010920599999999999 2024-05-07T14:02:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.400932+0000", 2024-05-07T14:02:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032676659999999998 2024-05-07T14:02:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.400987+0000", 2024-05-07T14:02:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5315000000000001e-05 2024-05-07T14:02:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401019+0000", 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1334999999999997e-05 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1920 4.0 4:03a7a160:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.4844553500000002, 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055799400000000002, 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1920 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:02:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.89e-07 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396360+0000", 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.284e-06 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396368+0000", 2024-05-07T14:02:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8769999999999993e-06 2024-05-07T14:02:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396374+0000", 2024-05-07T14:02:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2480000000000004e-06 2024-05-07T14:02:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396652+0000", 2024-05-07T14:02:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027788900000000002 2024-05-07T14:02:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396724+0000", 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2391000000000005e-05 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397033+0000", 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030929299999999998 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398442+0000", 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001409062 2024-05-07T14:02:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401881+0000", 2024-05-07T14:02:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034388639999999998 2024-05-07T14:02:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401909+0000", 2024-05-07T14:02:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7716e-05 2024-05-07T14:02:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401936+0000", 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6826999999999999e-05 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1922 4.19 4:9849ed33:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.4844206870000001, 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0075306310000000003, 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1922 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:02:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396391+0000", 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.46e-07 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396393+0000", 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3250000000000002e-06 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396400+0000", 2024-05-07T14:02:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9190000000000002e-06 2024-05-07T14:02:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396405+0000", 2024-05-07T14:02:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2839999999999997e-06 2024-05-07T14:02:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396919+0000", 2024-05-07T14:02:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00051340499999999998 2024-05-07T14:02:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396988+0000", 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8775999999999993e-05 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397099+0000", 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111239 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398350+0000", 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001250735 2024-05-07T14:02:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403874+0000", 2024-05-07T14:02:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005524307 2024-05-07T14:02:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403900+0000", 2024-05-07T14:02:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6499000000000002e-05 2024-05-07T14:02:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403921+0000", 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0696e-05 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1924 4.29 4:9770b4a5:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396413+0000", 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.4843982219999998, 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046902610000000003, 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1924 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396413+0000", 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396413+0000", 2024-05-07T14:02:57.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396413+0000", 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7999999999999996e-07 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396415+0000", 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1090000000000001e-06 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:02:57.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396422+0000", 2024-05-07T14:02:57.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3690000000000003e-06 2024-05-07T14:02:57.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:02:57.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396426+0000", 2024-05-07T14:02:57.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6410000000000001e-06 2024-05-07T14:02:57.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:02:57.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396992+0000", 2024-05-07T14:02:57.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056546899999999998 2024-05-07T14:02:57.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397495+0000", 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00050259000000000002 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397589+0000", 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4291999999999998e-05 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398620+0000", 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001031283 2024-05-07T14:02:57.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:02:57.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401034+0000", 2024-05-07T14:02:57.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024134999999999998 2024-05-07T14:02:57.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:02:57.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401073+0000", 2024-05-07T14:02:57.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9437999999999997e-05 2024-05-07T14:02:57.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:02:57.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:02:57.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:02:57.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401103+0000", 2024-05-07T14:02:57.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0090000000000002e-05 2024-05-07T14:02:57.993 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.993 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.993 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.993 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:02:57.993 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:02:57.993 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:02:57.995 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:02:57.995 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:58.004+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:58.096 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:58.104+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:58.127 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:58.127 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:58.127 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:58.128 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:58.141 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:02:58.196 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:58.208+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:58.264 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:58.264 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:58.264 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:58.278 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:02:58.297 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:58.308+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:58.335 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:02:58.397 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:58.408+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:58.399 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:58.400 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:02:58.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:02:58.400 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:02:58.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.400 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:02:58.400 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:02:58.400 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.41782143, 2024-05-07T14:02:58.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070064749999999999, 2024-05-07T14:02:58.400 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.400 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.400 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:02:58.400 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 43 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:02:58.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994274+0000", 2024-05-07T14:02:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7170000000000002e-06 2024-05-07T14:02:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994292+0000", 2024-05-07T14:02:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7819999999999999e-05 2024-05-07T14:02:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994338+0000", 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6625999999999997e-05 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994362+0000", 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4063e-05 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994576+0000", 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021319500000000001 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:02:58.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994598+0000", 2024-05-07T14:02:58.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2325999999999999e-05 2024-05-07T14:02:58.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001023+0000", 2024-05-07T14:02:58.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00642546 2024-05-07T14:02:58.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001277+0000", 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025326800000000002 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.36219200399999, 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033678110000000001, 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.405 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.406 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.406 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.406 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 211 2024-05-07T14:02:58.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.406 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:02:58.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:02:58.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049903+0000", 2024-05-07T14:02:58.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.963e-06 2024-05-07T14:02:58.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049917+0000", 2024-05-07T14:02:58.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-05-07T14:02:58.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049950+0000", 2024-05-07T14:02:58.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3328999999999999e-05 2024-05-07T14:02:58.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049966+0000", 2024-05-07T14:02:58.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6333000000000001e-05 2024-05-07T14:02:58.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050100+0000", 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013305599999999999 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050363+0000", 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026392100000000002 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050827+0000", 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046316 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.052269+0000", 2024-05-07T14:02:58.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014428760000000001 2024-05-07T14:02:58.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053111+0000", 2024-05-07T14:02:58.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084168999999999997 2024-05-07T14:02:58.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053198+0000", 2024-05-07T14:02:58.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6666e-05 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053267+0000", 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9503000000000002e-05 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.283737309, 2024-05-07T14:02:58.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032702809999999999, 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 232 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128357+0000", 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1530000000000001e-06 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128369+0000", 2024-05-07T14:02:58.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1823e-05 2024-05-07T14:02:58.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128401+0000", 2024-05-07T14:02:58.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:02:58.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128416+0000", 2024-05-07T14:02:58.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4997000000000001e-05 2024-05-07T14:02:58.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128538+0000", 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121406 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128773+0000", 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235121 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.129230+0000", 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00045679999999999999 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.130836+0000", 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001606484 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131454+0000", 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061747199999999999 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131550+0000", 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6636000000000001e-05 2024-05-07T14:02:58.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131624+0000", 2024-05-07T14:02:58.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4315999999999998e-05 2024-05-07T14:02:58.417 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.417 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.417 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.417 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:301 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:58.417 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:02:58.417 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.252160343, 2024-05-07T14:02:58.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037043950000000001, 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 301 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159933+0000", 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6670000000000001e-06 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159943+0000", 2024-05-07T14:02:58.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0176e-05 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159965+0000", 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2243e-05 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159980+0000", 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4747e-05 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160332+0000", 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000352004 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160574+0000", 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241838 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.161045+0000", 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000471526 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.162322+0000", 2024-05-07T14:02:58.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001276241 2024-05-07T14:02:58.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163376+0000", 2024-05-07T14:02:58.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010539449999999999 2024-05-07T14:02:58.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163516+0000", 2024-05-07T14:02:58.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014034599999999999 2024-05-07T14:02:58.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163636+0000", 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011966199999999999 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:376 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.236045064, 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038557209999999999, 2024-05-07T14:02:58.423 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 376 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176049+0000", 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176064+0000", 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.451e-05 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176101+0000", 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000003e-05 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176126+0000", 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176272+0000", 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014592899999999999 2024-05-07T14:02:58.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176402+0000", 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000129512 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176725+0000", 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032289800000000001 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.177826+0000", 2024-05-07T14:02:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011017620000000001 2024-05-07T14:02:58.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179617+0000", 2024-05-07T14:02:58.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001791193 2024-05-07T14:02:58.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179781+0000", 2024-05-07T14:02:58.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016336899999999999 2024-05-07T14:02:58.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179902+0000", 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012131899999999999 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:397 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.223547974, 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034388040000000002, 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.429 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 397 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:02:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188546+0000", 2024-05-07T14:02:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2000000000000001e-06 2024-05-07T14:02:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188556+0000", 2024-05-07T14:02:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0557000000000001e-05 2024-05-07T14:02:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188590+0000", 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3626e-05 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188625+0000", 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5095999999999997e-05 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188768+0000", 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014279900000000001 2024-05-07T14:02:58.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189124+0000", 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035646799999999998 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189633+0000", 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000508903 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.190638+0000", 2024-05-07T14:02:58.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001004465 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191712+0000", 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001074759 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191871+0000", 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835900000000001 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191982+0000", 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011157199999999999 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:403 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.219405196, 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004923172, 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.435 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.436 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.436 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.436 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 403 2024-05-07T14:02:58.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.436 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:02:58.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192688+0000", 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4640000000000001e-06 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192696+0000", 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9330000000000001e-06 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192715+0000", 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9746999999999999e-05 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192726+0000", 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.026e-05 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192824+0000", 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8139000000000003e-05 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192971+0000", 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014717199999999999 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.193232+0000", 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000260518 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.196090+0000", 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002858598 2024-05-07T14:02:58.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197464+0000", 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001373399 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197549+0000", 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5261999999999998e-05 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197609+0000", 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0680000000000002e-05 2024-05-07T14:02:58.440 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:472 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.17510268300001, 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044650219999999999, 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.441 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.442 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 472 2024-05-07T14:02:58.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.442 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:02:58.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:02:58.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236991+0000", 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8589999999999999e-06 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237001+0000", 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0465999999999999e-05 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237019+0000", 2024-05-07T14:02:58.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7666999999999999e-05 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237030+0000", 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0917000000000001e-05 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237184+0000", 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015438499999999999 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237427+0000", 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024296499999999999 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237900+0000", 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047292599999999998 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.239253+0000", 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013527770000000001 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241246+0000", 2024-05-07T14:02:58.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019933249999999998 2024-05-07T14:02:58.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241370+0000", 2024-05-07T14:02:58.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012385599999999999 2024-05-07T14:02:58.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241454+0000", 2024-05-07T14:02:58.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3879000000000001e-05 2024-05-07T14:02:58.446 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.446 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:509 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.154214545, 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003433874, 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.447 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 509 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257878+0000", 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.528e-06 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257886+0000", 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2180000000000002e-06 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257903+0000", 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7484999999999999e-05 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257912+0000", 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0189999999999995e-06 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258007+0000", 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4627000000000001e-05 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258124+0000", 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116836 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258381+0000", 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025690899999999999 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.259428+0000", 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047177 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261154+0000", 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017262180000000001 2024-05-07T14:02:58.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261224+0000", 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9913000000000006e-05 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261311+0000", 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6944e-05 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:625 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.066794884, 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039276240000000002, 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 625 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345300+0000", 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.067e-06 2024-05-07T14:02:58.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345315+0000", 2024-05-07T14:02:58.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4857e-05 2024-05-07T14:02:58.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345344+0000", 2024-05-07T14:02:58.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9070000000000001e-05 2024-05-07T14:02:58.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345359+0000", 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5656000000000001e-05 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345512+0000", 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015229600000000001 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345764+0000", 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025252100000000002 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.346269+0000", 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000504613 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.347487+0000", 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001218317 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349071+0000", 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015844279999999999 2024-05-07T14:02:58.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349156+0000", 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4958999999999998e-05 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349224+0000", 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7840000000000001e-05 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.459 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1565 4.d 4:b05a54d0:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:58.459 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672774+0000", 2024-05-07T14:02:58.459 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.7393176290000003, 2024-05-07T14:02:58.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052824339999999999, 2024-05-07T14:02:58.459 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.459 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.459 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.459 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.459 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.459 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.459 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1565 2024-05-07T14:02:58.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.459 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672774+0000", 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672774+0000", 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672776+0000", 2024-05-07T14:02:58.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0700000000000001e-06 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672787+0000", 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0823e-05 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672818+0000", 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1676e-05 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672840+0000", 2024-05-07T14:02:58.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1759999999999998e-05 2024-05-07T14:02:58.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673009+0000", 2024-05-07T14:02:58.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016833700000000001 2024-05-07T14:02:58.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673279+0000", 2024-05-07T14:02:58.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027011899999999998 2024-05-07T14:02:58.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673560+0000", 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028097000000000002 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.676617+0000", 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030573150000000001 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677839+0000", 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012222240000000001 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677943+0000", 2024-05-07T14:02:58.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103838 2024-05-07T14:02:58.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678056+0000", 2024-05-07T14:02:58.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011330199999999999 2024-05-07T14:02:58.464 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.464 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.464 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.465 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1566 4.13 4:cabacdb3:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:58.465 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:02:58.465 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.7392031440000002, 2024-05-07T14:02:58.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057730890000000003, 2024-05-07T14:02:58.465 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.465 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.465 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.465 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.465 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.465 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.465 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1566 2024-05-07T14:02:58.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.465 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672890+0000", 2024-05-07T14:02:58.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.606e-06 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672898+0000", 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-06 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672924+0000", 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5599999999999999e-05 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672942+0000", 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7799999999999999e-05 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673078+0000", 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013645399999999999 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673280+0000", 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020144999999999999 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:58.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673597+0000", 2024-05-07T14:02:58.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031715200000000002 2024-05-07T14:02:58.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.675496+0000", 2024-05-07T14:02:58.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018996830000000001 2024-05-07T14:02:58.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678466+0000", 2024-05-07T14:02:58.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029693639999999999 2024-05-07T14:02:58.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678562+0000", 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6614999999999996e-05 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678661+0000", 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9024999999999995e-05 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.470 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1568 4.3d 4:bd9d380d:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.7391081020000003, 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059901989999999999, 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1568 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672985+0000", 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672992+0000", 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7229999999999998e-06 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673011+0000", 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9700000000000001e-05 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673026+0000", 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4506e-05 2024-05-07T14:02:58.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674436+0000", 2024-05-07T14:02:58.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001410445 2024-05-07T14:02:58.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674635+0000", 2024-05-07T14:02:58.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019898299999999999 2024-05-07T14:02:58.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:58.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674957+0000", 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032126499999999999 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.676898+0000", 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019413989999999999 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678780+0000", 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018816880000000001 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678912+0000", 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013280799999999999 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678974+0000", 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1192000000000006e-05 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1570 4.1b 4:db659863:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:58.476 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.7390425030000003, 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059406459999999999, 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1570 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673050+0000", 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1230000000000001e-06 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673056+0000", 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5639999999999996e-06 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673073+0000", 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7751999999999999e-05 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673086+0000", 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2656999999999999e-05 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674276+0000", 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011896350000000001 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674479+0000", 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020363600000000001 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674757+0000", 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027776599999999998 2024-05-07T14:02:58.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677473+0000", 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027157739999999998 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678813+0000", 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013401120000000001 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678931+0000", 2024-05-07T14:02:58.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118322 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678990+0000", 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8304999999999998e-05 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1572 4.13 4:c90a81ac:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.7389865169999998, 2024-05-07T14:02:58.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062582080000000003, 2024-05-07T14:02:58.483 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.483 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.483 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.483 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.483 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.483 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1572 2024-05-07T14:02:58.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.483 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:02:58.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673106+0000", 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0729999999999999e-06 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673111+0000", 2024-05-07T14:02:58.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3070000000000002e-06 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673129+0000", 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673143+0000", 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3579e-05 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674380+0000", 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001237908 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674578+0000", 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000197617 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674864+0000", 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028589499999999999 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678694+0000", 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038299900000000001 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679226+0000", 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053176199999999997 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679299+0000", 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3658000000000005e-05 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679363+0000", 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3816e-05 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1579 4.e 4:70198fec:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.897263+0000", 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.5148286970000004, 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004814881, 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.488 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1579 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897263+0000", 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897263+0000", 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897266+0000", 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897279+0000", 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3029e-05 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2225999999999999e-05 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897364+0000", 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2726000000000003e-05 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897563+0000", 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019917700000000001 2024-05-07T14:02:58.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897900+0000", 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000337175 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.898374+0000", 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000474229 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.901318+0000", 2024-05-07T14:02:58.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029436499999999999 2024-05-07T14:02:58.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.901935+0000", 2024-05-07T14:02:58.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061724700000000002 2024-05-07T14:02:58.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.902014+0000", 2024-05-07T14:02:58.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8949000000000006e-05 2024-05-07T14:02:58.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.902078+0000", 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3726000000000006e-05 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1587 4.1b 4:d97b2c21:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.897446+0000", 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.514645507, 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033670710000000001, 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.494 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1587 2024-05-07T14:02:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897446+0000", 2024-05-07T14:02:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897446+0000", 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897448+0000", 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0600000000000002e-06 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897464+0000", 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5840000000000001e-05 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897498+0000", 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4569000000000001e-05 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897516+0000", 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7697e-05 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897642+0000", 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012585499999999999 2024-05-07T14:02:58.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897980+0000", 2024-05-07T14:02:58.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000337478 2024-05-07T14:02:58.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:58.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.898385+0000", 2024-05-07T14:02:58.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000405356 2024-05-07T14:02:58.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.900329+0000", 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001943923 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.900368+0000", 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9332999999999998e-05 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.900624+0000", 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000255436 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.900813+0000", 2024-05-07T14:02:58.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000189524 2024-05-07T14:02:58.500 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.500 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.500 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.500 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1612 3.3 3:c1191b65:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:58.500 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:02:58.500 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.9892013530000003, 2024-05-07T14:02:58.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013953758, 2024-05-07T14:02:58.500 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.500 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.501 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.501 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.501 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.501 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.501 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1612 2024-05-07T14:02:58.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.501 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:02:58.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:02:58.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422894+0000", 2024-05-07T14:02:58.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3400000000000002e-06 2024-05-07T14:02:58.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426732+0000", 2024-05-07T14:02:58.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386760000000001 2024-05-07T14:02:58.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426772+0000", 2024-05-07T14:02:58.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9740000000000002e-05 2024-05-07T14:02:58.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426791+0000", 2024-05-07T14:02:58.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:02:58.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426935+0000", 2024-05-07T14:02:58.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144368 2024-05-07T14:02:58.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.427196+0000", 2024-05-07T14:02:58.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026091599999999998 2024-05-07T14:02:58.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:58.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.427426+0000", 2024-05-07T14:02:58.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022962899999999999 2024-05-07T14:02:58.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.434735+0000", 2024-05-07T14:02:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073090990000000003 2024-05-07T14:02:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436629+0000", 2024-05-07T14:02:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018938640000000001 2024-05-07T14:02:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436721+0000", 2024-05-07T14:02:58.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1943999999999999e-05 2024-05-07T14:02:58.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436844+0000", 2024-05-07T14:02:58.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012338900000000001 2024-05-07T14:02:58.506 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.506 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.506 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.506 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1614 3.1d e81/21 3:baaad814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4_10Mb.:head v 81'1, mlcod=0'0)", 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.9619520540000002, 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013565693, 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450142+0000", 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3970000000000001e-06 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453081+0000", 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029395100000000002 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453123+0000", 2024-05-07T14:02:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1356000000000002e-05 2024-05-07T14:02:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453142+0000", 2024-05-07T14:02:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-05-07T14:02:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453311+0000", 2024-05-07T14:02:58.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016885700000000001 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453349+0000", 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8033e-05 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.463599+0000", 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010250011 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.463705+0000", 2024-05-07T14:02:58.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000105839 2024-05-07T14:02:58.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.511 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.511 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1825 4.d 4:b33fbda9:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:58.514 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:54.214034+0000", 2024-05-07T14:02:58.514 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1980570909999999, 2024-05-07T14:02:58.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041675660000000002, 2024-05-07T14:02:58.514 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:58.514 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:58.514 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:58.514 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:58.514 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:58.514 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:58.514 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1825 2024-05-07T14:02:58.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.514 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214034+0000", 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214034+0000", 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214035+0000", 2024-05-07T14:02:58.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7599999999999996e-07 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214040+0000", 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3579999999999996e-06 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214049+0000", 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5240000000000006e-06 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:58.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214056+0000", 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3529999999999997e-06 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214153+0000", 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6780999999999994e-05 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214321+0000", 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167465 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:02:58.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214530+0000", 2024-05-07T14:02:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020887299999999999 2024-05-07T14:02:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.216352+0000", 2024-05-07T14:02:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018223169999999999 2024-05-07T14:02:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.218036+0000", 2024-05-07T14:02:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016841580000000001 2024-05-07T14:02:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.218137+0000", 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010143499999999999 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.218202+0000", 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4525999999999999e-05 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:58.519 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:58.521 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:02:58.521 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:58.532+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:58.622 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:58.632+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:58.692 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:58.692 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:02:58.692 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:58.706 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:02:58.723 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:58.732+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:58.824 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:58.836+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:58.868 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:58.868 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:02:58.868 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:02:58.869 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:02:58.869 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:58.882 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:02:58.882 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:02:58.928 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:58.940+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:59.026 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:59.036+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:59.026 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:02:59.027 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:02:59.043 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:02:59.043 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:02:59.045 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:02:59.046 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:02:59.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:02:59.046 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:02:59.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.046 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:02:59.046 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:02:59.046 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.04354701600001, 2024-05-07T14:02:59.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058205720000000004, 2024-05-07T14:02:59.047 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.047 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.047 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.047 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.047 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 205 2024-05-07T14:02:59.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.047 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:02:59.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:02:59.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012373+0000", 2024-05-07T14:02:59.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.07e-06 2024-05-07T14:02:59.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012397+0000", 2024-05-07T14:02:59.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3697e-05 2024-05-07T14:02:59.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012450+0000", 2024-05-07T14:02:59.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2539e-05 2024-05-07T14:02:59.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012477+0000", 2024-05-07T14:02:59.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7457000000000002e-05 2024-05-07T14:02:59.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012735+0000", 2024-05-07T14:02:59.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025820800000000001 2024-05-07T14:02:59.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013057+0000", 2024-05-07T14:02:59.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000321727 2024-05-07T14:02:59.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:59.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013752+0000", 2024-05-07T14:02:59.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069509499999999996 2024-05-07T14:02:59.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.017093+0000", 2024-05-07T14:02:59.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033404340000000002 2024-05-07T14:02:59.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018024+0000", 2024-05-07T14:02:59.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00093108600000000002 2024-05-07T14:02:59.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018113+0000", 2024-05-07T14:02:59.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9752000000000004e-05 2024-05-07T14:02:59.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018190+0000", 2024-05-07T14:02:59.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6507000000000005e-05 2024-05-07T14:02:59.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.053 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.053 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:59.053 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:02:59.053 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.97329602799999, 2024-05-07T14:02:59.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052341489999999996, 2024-05-07T14:02:59.054 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.054 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.054 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.054 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.054 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.054 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.054 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 220 2024-05-07T14:02:59.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.054 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:02:59.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:02:59.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082623+0000", 2024-05-07T14:02:59.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8370000000000001e-06 2024-05-07T14:02:59.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082636+0000", 2024-05-07T14:02:59.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2316e-05 2024-05-07T14:02:59.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082667+0000", 2024-05-07T14:02:59.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1139999999999997e-05 2024-05-07T14:02:59.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082681+0000", 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4816e-05 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082825+0000", 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014377899999999999 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083051+0000", 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022549500000000001 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:59.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083453+0000", 2024-05-07T14:02:59.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000401944 2024-05-07T14:02:59.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.085929+0000", 2024-05-07T14:02:59.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024763369999999999 2024-05-07T14:02:59.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087649+0000", 2024-05-07T14:02:59.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001719747 2024-05-07T14:02:59.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087735+0000", 2024-05-07T14:02:59.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6415999999999994e-05 2024-05-07T14:02:59.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087855+0000", 2024-05-07T14:02:59.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011932199999999999 2024-05-07T14:02:59.059 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.059 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.059 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.060 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:59.060 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:02:59.060 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.960876297, 2024-05-07T14:02:59.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00342407, 2024-05-07T14:02:59.060 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.060 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.060 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.060 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.060 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.060 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.060 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 223 2024-05-07T14:02:59.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.061 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:02:59.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:02:59.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095042+0000", 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1799999999999999e-06 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095054+0000", 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1817000000000001e-05 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095084+0000", 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0018999999999998e-05 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095099+0000", 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.537e-05 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095209+0000", 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010943299999999999 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095457+0000", 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247941 2024-05-07T14:02:59.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:59.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095879+0000", 2024-05-07T14:02:59.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042171299999999999 2024-05-07T14:02:59.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.097290+0000", 2024-05-07T14:02:59.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014118519999999999 2024-05-07T14:02:59.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098196+0000", 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00090603700000000005 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098348+0000", 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151879 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098464+0000", 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011582900000000001 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.065 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.066 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:59.066 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:02:59.066 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.901357324, 2024-05-07T14:02:59.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035934819999999998, 2024-05-07T14:02:59.066 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.066 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.066 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.066 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.066 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.066 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.066 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 271 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154562+0000", 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154578+0000", 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6667000000000002e-05 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154612+0000", 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3120000000000001e-05 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154632+0000", 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0769999999999999e-05 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154774+0000", 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141805 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155004+0000", 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022938200000000001 2024-05-07T14:02:59.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:59.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155372+0000", 2024-05-07T14:02:59.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036889300000000002 2024-05-07T14:02:59.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156948+0000", 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015755750000000001 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.157903+0000", 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095453499999999995 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158050+0000", 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147279 2024-05-07T14:02:59.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158153+0000", 2024-05-07T14:02:59.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102729 2024-05-07T14:02:59.072 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.072 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.072 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.072 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:415 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:59.072 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:02:59.073 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.855578963, 2024-05-07T14:02:59.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065364059999999998, 2024-05-07T14:02:59.073 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.073 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.073 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.073 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.073 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.073 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.073 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 415 2024-05-07T14:02:59.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.074 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:02:59.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:02:59.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200339+0000", 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.826e-06 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200348+0000", 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0669999999999998e-06 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200378+0000", 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.968e-05 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200393+0000", 2024-05-07T14:02:59.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5109999999999999e-05 2024-05-07T14:02:59.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200515+0000", 2024-05-07T14:02:59.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121449 2024-05-07T14:02:59.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200658+0000", 2024-05-07T14:02:59.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014362199999999999 2024-05-07T14:02:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200958+0000", 2024-05-07T14:02:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030029699999999999 2024-05-07T14:02:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202106+0000", 2024-05-07T14:02:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011475050000000001 2024-05-07T14:02:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206707+0000", 2024-05-07T14:02:59.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046009980000000002 2024-05-07T14:02:59.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206791+0000", 2024-05-07T14:02:59.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4118999999999999e-05 2024-05-07T14:02:59.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206874+0000", 2024-05-07T14:02:59.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2732999999999995e-05 2024-05-07T14:02:59.079 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.079 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.079 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.079 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:417 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:59.079 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:02:59.079 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.85308087200001, 2024-05-07T14:02:59.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034776160000000002, 2024-05-07T14:02:59.080 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.080 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.080 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.080 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.080 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.080 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.080 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 417 2024-05-07T14:02:59.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.080 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:02:59.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:02:59.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202838+0000", 2024-05-07T14:02:59.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3760000000000002e-06 2024-05-07T14:02:59.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202872+0000", 2024-05-07T14:02:59.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4379999999999999e-05 2024-05-07T14:02:59.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202900+0000", 2024-05-07T14:02:59.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8180000000000001e-05 2024-05-07T14:02:59.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202915+0000", 2024-05-07T14:02:59.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.486e-05 2024-05-07T14:02:59.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203063+0000", 2024-05-07T14:02:59.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014788799999999999 2024-05-07T14:02:59.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203423+0000", 2024-05-07T14:02:59.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035942400000000001 2024-05-07T14:02:59.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:59.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.204005+0000", 2024-05-07T14:02:59.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058227599999999995 2024-05-07T14:02:59.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205280+0000", 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012753 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206135+0000", 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00085444999999999998 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206234+0000", 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9088999999999999e-05 2024-05-07T14:02:59.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206313+0000", 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9393000000000004e-05 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:420 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.85074445399999, 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042372210000000002, 2024-05-07T14:02:59.086 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 420 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:02:59.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205174+0000", 2024-05-07T14:02:59.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1100000000000001e-06 2024-05-07T14:02:59.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205186+0000", 2024-05-07T14:02:59.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.169e-05 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205218+0000", 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2617000000000003e-05 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205240+0000", 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1331999999999998e-05 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205356+0000", 2024-05-07T14:02:59.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011655 2024-05-07T14:02:59.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205623+0000", 2024-05-07T14:02:59.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026669399999999999 2024-05-07T14:02:59.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:59.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206029+0000", 2024-05-07T14:02:59.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040652 2024-05-07T14:02:59.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.208187+0000", 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021578439999999999 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209226+0000", 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001039058 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209305+0000", 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8650000000000001e-05 2024-05-07T14:02:59.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209409+0000", 2024-05-07T14:02:59.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104156 2024-05-07T14:02:59.092 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.092 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.092 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.092 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:429 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:59.092 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:02:59.092 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.845713413, 2024-05-07T14:02:59.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040139620000000003, 2024-05-07T14:02:59.093 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.093 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.093 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.093 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.093 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.093 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.093 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 429 2024-05-07T14:02:59.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.093 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210205+0000", 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.66e-06 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210228+0000", 2024-05-07T14:02:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-05-07T14:02:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210244+0000", 2024-05-07T14:02:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6339999999999999e-05 2024-05-07T14:02:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210256+0000", 2024-05-07T14:02:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1949e-05 2024-05-07T14:02:59.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210472+0000", 2024-05-07T14:02:59.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215529 2024-05-07T14:02:59.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210681+0000", 2024-05-07T14:02:59.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000208982 2024-05-07T14:02:59.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:59.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211154+0000", 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047321599999999999 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212660+0000", 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001506098 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214071+0000", 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014107429999999999 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214153+0000", 2024-05-07T14:02:59.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1889000000000002e-05 2024-05-07T14:02:59.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214217+0000", 2024-05-07T14:02:59.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4336000000000002e-05 2024-05-07T14:02:59.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.098 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.098 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:430 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.845367649, 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066752119999999998, 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 430 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:02:59.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:02:59.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210551+0000", 2024-05-07T14:02:59.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:02:59.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210562+0000", 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0237e-05 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210586+0000", 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4066e-05 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210603+0000", 2024-05-07T14:02:59.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.713e-05 2024-05-07T14:02:59.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211799+0000", 2024-05-07T14:02:59.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001196127 2024-05-07T14:02:59.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211931+0000", 2024-05-07T14:02:59.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131629 2024-05-07T14:02:59.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212211+0000", 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028005100000000002 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.213288+0000", 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010772760000000001 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217047+0000", 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037586569999999999 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217127+0000", 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0270000000000002e-05 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217224+0000", 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7139000000000006e-05 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.104 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.83859037400001, 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003780107, 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 436 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:02:59.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:02:59.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217328+0000", 2024-05-07T14:02:59.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:02:59.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217356+0000", 2024-05-07T14:02:59.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8158999999999999e-05 2024-05-07T14:02:59.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217377+0000", 2024-05-07T14:02:59.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1356999999999999e-05 2024-05-07T14:02:59.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217393+0000", 2024-05-07T14:02:59.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5569e-05 2024-05-07T14:02:59.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217882+0000", 2024-05-07T14:02:59.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00048937000000000004 2024-05-07T14:02:59.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218099+0000", 2024-05-07T14:02:59.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021691899999999999 2024-05-07T14:02:59.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:59.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218390+0000", 2024-05-07T14:02:59.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029041800000000002 2024-05-07T14:02:59.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220013+0000", 2024-05-07T14:02:59.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016236169999999999 2024-05-07T14:02:59.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220889+0000", 2024-05-07T14:02:59.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087619599999999998 2024-05-07T14:02:59.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221005+0000", 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011569 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221106+0000", 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101122 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:442 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:59.111 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:02:59.112 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.83496850900001, 2024-05-07T14:02:59.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003357184, 2024-05-07T14:02:59.112 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.112 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.112 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.112 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.112 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.112 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.112 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 442 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220950+0000", 2024-05-07T14:02:59.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:02:59.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220958+0000", 2024-05-07T14:02:59.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8429999999999999e-06 2024-05-07T14:02:59.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220979+0000", 2024-05-07T14:02:59.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0387e-05 2024-05-07T14:02:59.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220991+0000", 2024-05-07T14:02:59.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.181e-05 2024-05-07T14:02:59.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221218+0000", 2024-05-07T14:02:59.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022694100000000001 2024-05-07T14:02:59.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221362+0000", 2024-05-07T14:02:59.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014482899999999999 2024-05-07T14:02:59.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:02:59.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221628+0000", 2024-05-07T14:02:59.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026559799999999997 2024-05-07T14:02:59.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.223915+0000", 2024-05-07T14:02:59.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022864819999999998 2024-05-07T14:02:59.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224031+0000", 2024-05-07T14:02:59.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116759 2024-05-07T14:02:59.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224173+0000", 2024-05-07T14:02:59.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014127599999999999 2024-05-07T14:02:59.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224305+0000", 2024-05-07T14:02:59.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000132519 2024-05-07T14:02:59.118 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.118 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.118 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.119 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:482 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:59.119 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:02:59.119 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.812738061, 2024-05-07T14:02:59.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035275459999999999, 2024-05-07T14:02:59.119 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.119 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.119 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.119 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.119 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.119 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.119 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 482 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243181+0000", 2024-05-07T14:02:59.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:02:59.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243194+0000", 2024-05-07T14:02:59.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3087e-05 2024-05-07T14:02:59.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243224+0000", 2024-05-07T14:02:59.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0546000000000002e-05 2024-05-07T14:02:59.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243240+0000", 2024-05-07T14:02:59.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5339999999999999e-05 2024-05-07T14:02:59.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243379+0000", 2024-05-07T14:02:59.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139646 2024-05-07T14:02:59.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243576+0000", 2024-05-07T14:02:59.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019638300000000001 2024-05-07T14:02:59.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:59.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243838+0000", 2024-05-07T14:02:59.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026234300000000001 2024-05-07T14:02:59.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.244908+0000", 2024-05-07T14:02:59.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010696289999999999 2024-05-07T14:02:59.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246477+0000", 2024-05-07T14:02:59.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001569471 2024-05-07T14:02:59.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246596+0000", 2024-05-07T14:02:59.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118892 2024-05-07T14:02:59.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246706+0000", 2024-05-07T14:02:59.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109899 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:877 6.19 6:98c4c580:::obj_delete_at_hint.0000000100:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 111.26404305600001, 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033601709999999999, 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.125 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 877 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791875+0000", 2024-05-07T14:02:59.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9e-06 2024-05-07T14:02:59.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791884+0000", 2024-05-07T14:02:59.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7069999999999998e-06 2024-05-07T14:02:59.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791907+0000", 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2682999999999999e-05 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791919+0000", 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2763e-05 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792073+0000", 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153509 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792439+0000", 2024-05-07T14:02:59.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000366141 2024-05-07T14:02:59.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:59.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792989+0000", 2024-05-07T14:02:59.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055016899999999998 2024-05-07T14:02:59.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.794288+0000", 2024-05-07T14:02:59.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00129885 2024-05-07T14:02:59.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795070+0000", 2024-05-07T14:02:59.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000781557 2024-05-07T14:02:59.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795155+0000", 2024-05-07T14:02:59.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5723000000000006e-05 2024-05-07T14:02:59.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795234+0000", 2024-05-07T14:02:59.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8169000000000003e-05 2024-05-07T14:02:59.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.131 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.131 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1482 3.30 3:0f9854c6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10MBfile1:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:59.131 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:02:59.131 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.6868083980000002, 2024-05-07T14:02:59.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060631510000000001, 2024-05-07T14:02:59.131 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.131 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.131 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1482 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:02:59.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369111+0000", 2024-05-07T14:02:59.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2830000000000002e-06 2024-05-07T14:02:59.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369126+0000", 2024-05-07T14:02:59.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4693e-05 2024-05-07T14:02:59.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369160+0000", 2024-05-07T14:02:59.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4282999999999997e-05 2024-05-07T14:02:59.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369178+0000", 2024-05-07T14:02:59.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8153000000000001e-05 2024-05-07T14:02:59.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369385+0000", 2024-05-07T14:02:59.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020658699999999999 2024-05-07T14:02:59.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:02:59.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369396+0000", 2024-05-07T14:02:59.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0616e-05 2024-05-07T14:02:59.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.374884+0000", 2024-05-07T14:02:59.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005488461 2024-05-07T14:02:59.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.375171+0000", 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028707500000000003 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5165.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94404812942592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.147307+0000", 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.9086095470000002, 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055399280000000004, 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.137 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.138 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.138 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5165", 2024-05-07T14:02:59.138 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3551621939", 2024-05-07T14:02:59.138 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 47 2024-05-07T14:02:59.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.138 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147307+0000", 2024-05-07T14:02:59.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147307+0000", 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147310+0000", 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7839999999999999e-06 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147323+0000", 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.296e-05 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147358+0000", 2024-05-07T14:02:59.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5345999999999997e-05 2024-05-07T14:02:59.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147379+0000", 2024-05-07T14:02:59.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1103000000000001e-05 2024-05-07T14:02:59.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147531+0000", 2024-05-07T14:02:59.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015150799999999999 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147769+0000", 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000238216 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.148185+0000", 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041623300000000001 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.149369+0000", 2024-05-07T14:02:59.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001183602 2024-05-07T14:02:59.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152656+0000", 2024-05-07T14:02:59.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003287051 2024-05-07T14:02:59.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152729+0000", 2024-05-07T14:02:59.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3393999999999996e-05 2024-05-07T14:02:59.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152847+0000", 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117731 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5535.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94838971684432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.304693+0000", 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.7512232760000002, 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051189349999999998, 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.143 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.144 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.144 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.144 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5535", 2024-05-07T14:02:59.144 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/4024516518", 2024-05-07T14:02:59.144 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 47 2024-05-07T14:02:59.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.144 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304693+0000", 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304693+0000", 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304695+0000", 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9360000000000002e-06 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304704+0000", 2024-05-07T14:02:59.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7229999999999993e-06 2024-05-07T14:02:59.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304735+0000", 2024-05-07T14:02:59.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1393000000000003e-05 2024-05-07T14:02:59.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304755+0000", 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9927000000000001e-05 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304880+0000", 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000124898 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.305106+0000", 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022584600000000001 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:02:59.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.305530+0000", 2024-05-07T14:02:59.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042447600000000002 2024-05-07T14:02:59.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.307084+0000", 2024-05-07T14:02:59.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015533960000000001 2024-05-07T14:02:59.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309544+0000", 2024-05-07T14:02:59.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024601409999999999 2024-05-07T14:02:59.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309667+0000", 2024-05-07T14:02:59.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123289 2024-05-07T14:02:59.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309812+0000", 2024-05-07T14:02:59.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014490999999999999 2024-05-07T14:02:59.149 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1611 3.30 3:0c405120:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.6367063640000001, 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021446044000000001, 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.150 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.151 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1611 2024-05-07T14:02:59.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.151 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:02:59.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419212+0000", 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3769999999999999e-06 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425005+0000", 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057928390000000001 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425049+0000", 2024-05-07T14:02:59.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3569999999999998e-05 2024-05-07T14:02:59.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425068+0000", 2024-05-07T14:02:59.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9582e-05 2024-05-07T14:02:59.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425273+0000", 2024-05-07T14:02:59.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020503000000000001 2024-05-07T14:02:59.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425505+0000", 2024-05-07T14:02:59.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023136000000000001 2024-05-07T14:02:59.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:02:59.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425719+0000", 2024-05-07T14:02:59.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021418000000000001 2024-05-07T14:02:59.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.439395+0000", 2024-05-07T14:02:59.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013675768 2024-05-07T14:02:59.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440495+0000", 2024-05-07T14:02:59.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00109987 2024-05-07T14:02:59.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440588+0000", 2024-05-07T14:02:59.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3429000000000003e-05 2024-05-07T14:02:59.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440656+0000", 2024-05-07T14:02:59.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8039000000000004e-05 2024-05-07T14:02:59.157 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.157 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.157 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.158 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1614 3.1d 3:baaad814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:59.158 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:02:59.158 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.6118480640000001, 2024-05-07T14:02:59.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024991276999999999, 2024-05-07T14:02:59.158 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.158 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.158 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.158 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.158 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.158 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.158 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1614 2024-05-07T14:02:59.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.159 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:02:59.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:02:59.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444071+0000", 2024-05-07T14:02:59.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6900000000000001e-06 2024-05-07T14:02:59.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448527+0000", 2024-05-07T14:02:59.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044560870000000001 2024-05-07T14:02:59.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448562+0000", 2024-05-07T14:02:59.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4576000000000002e-05 2024-05-07T14:02:59.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448578+0000", 2024-05-07T14:02:59.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6209e-05 2024-05-07T14:02:59.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448766+0000", 2024-05-07T14:02:59.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018828700000000001 2024-05-07T14:02:59.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.449033+0000", 2024-05-07T14:02:59.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026696599999999999 2024-05-07T14:02:59.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:02:59.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.449872+0000", 2024-05-07T14:02:59.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083849399999999996 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.465016+0000", 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015144061 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.468867+0000", 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003851246 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.468987+0000", 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011982899999999999 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.469060+0000", 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2831999999999997e-05 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1914 4.15 4:aaab215b:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:54.396110+0000", 2024-05-07T14:02:59.164 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.6598068250000004, 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058079580000000002, 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1914 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396110+0000", 2024-05-07T14:02:59.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396110+0000", 2024-05-07T14:02:59.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396111+0000", 2024-05-07T14:02:59.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.237e-06 2024-05-07T14:02:59.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396116+0000", 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3839999999999996e-06 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396132+0000", 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5483999999999999e-05 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396141+0000", 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7829999999999993e-06 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396704+0000", 2024-05-07T14:02:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00056300499999999999 2024-05-07T14:02:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396795+0000", 2024-05-07T14:02:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0860999999999996e-05 2024-05-07T14:02:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396926+0000", 2024-05-07T14:02:59.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013037300000000001 2024-05-07T14:02:59.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.398201+0000", 2024-05-07T14:02:59.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001275675 2024-05-07T14:02:59.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.401816+0000", 2024-05-07T14:02:59.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036148780000000002 2024-05-07T14:02:59.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.401874+0000", 2024-05-07T14:02:59.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7385e-05 2024-05-07T14:02:59.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.401918+0000", 2024-05-07T14:02:59.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3893000000000001e-05 2024-05-07T14:02:59.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.170 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.170 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1923 4.25 4:a6940f24:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:02:59.171 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:54.396650+0000", 2024-05-07T14:02:59.171 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.6592661690000003, 2024-05-07T14:02:59.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052698620000000002, 2024-05-07T14:02:59.171 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:02:59.171 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:02:59.171 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:02:59.171 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:02:59.171 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:02:59.171 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:02:59.171 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1923 2024-05-07T14:02:59.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.171 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:02:59.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396650+0000", 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396650+0000", 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396651+0000", 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.029e-06 2024-05-07T14:02:59.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396657+0000", 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.823e-06 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396681+0000", 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4111e-05 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396691+0000", 2024-05-07T14:02:59.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.022e-05 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.397227+0000", 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053586499999999995 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.397321+0000", 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3389999999999999e-05 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:02:59.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.397431+0000", 2024-05-07T14:02:59.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110208 2024-05-07T14:02:59.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:02:59.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.400606+0000", 2024-05-07T14:02:59.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031755249999999998 2024-05-07T14:02:59.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:02:59.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.401844+0000", 2024-05-07T14:02:59.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012376310000000001 2024-05-07T14:02:59.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:02:59.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.401887+0000", 2024-05-07T14:02:59.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3319999999999999e-05 2024-05-07T14:02:59.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:02:59.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:02:59.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:02:59.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.401920+0000", 2024-05-07T14:02:59.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2740000000000002e-05 2024-05-07T14:02:59.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.176 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:02:59.176 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:02:59.177 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:02:59.178 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:02:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:02:59.179 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:02:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:02:59.179 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:02:59.180 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:02:59.180 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:02:59.181 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:02:59.181 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:02:59.181 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:02:59.182 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:02:59.182 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:02:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:02:59.183 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:02:59.188+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:02:59.279 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:02:59.288+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:02:59.350 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:59.350 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:59.364 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:02:59.408 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:59.420+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:59.480 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:02:59.492+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:02:59.482 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:59.482 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:59.496 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:02:59.584 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:02:59.596+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:02:59.662 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:59.662 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:59.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:02:59.720 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:02:59.732+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:02:59.782 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:02:59.792+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:02:59.841 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:59.841 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:59.855 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:02:59.900 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:59.912+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:59.977 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:02:59.977 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:02:59.985 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:02:59.996+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:02:59.992 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:00.086 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:00.096+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:00.162 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:00.162 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:00.176 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:00.220 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:00.232+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:00.288 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:00.300+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:00.303 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:00.303 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:00.316 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:00.355 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:03:00.389 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:00.400+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:00.431 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:00.431 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:00.445 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:00.490 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:00.500+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:00.556 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:00.556 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:00.569 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:00.591 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:00.600+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:00.643 INFO:tasks.workunit.client.0.smithi106.stdout:quota enabled for the bucket: buck_2024_04_7_14_02_56 2024-05-07T14:03:00.643 INFO:tasks.workunit.client.0.smithi106.stdout:adding file to bucket: 2Gb. 2024-05-07T14:03:00.644 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:03:00.644 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - set max size and ensure that objects upload beyond max size is not entertained 2024-05-07T14:03:00.644 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:03:00.644 INFO:tasks.workunit.client.0.smithi106.stdout:delete objects successful 2024-05-07T14:03:00.692 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:00.700+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:00.741 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:00.741 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:00.759 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:00.800 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:00.812+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:00.894 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:00.904+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:00.920 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:00.920 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:00.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:01.024 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:01.036+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:01.096 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:01.104+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:01.097 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:01.098 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:01.113 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:01.184 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:03:01.197 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:01.208+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:01.272 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:01.272 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:01.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:01.298 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:01.308+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:01.304 INFO:tasks.workunit.client.0.smithi106.stderr:100+0 records in 2024-05-07T14:03:01.304 INFO:tasks.workunit.client.0.smithi106.stderr:100+0 records out 2024-05-07T14:03:01.304 INFO:tasks.workunit.client.0.smithi106.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 0.658898 s, 1.6 GB/s 2024-05-07T14:03:01.337 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:03:01.357 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:01.358 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:01.376 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:01.376 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:01.393 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:01.394 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:01.398 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:01.408+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:01.405 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:01.405 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:01.405 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:01.405 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:01.405 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:01.414 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:01.414 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:01.417 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:01.438 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:01.438 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:01.458 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:01.458 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:01.480 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:01.480 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:01.544 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:01.556+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:01.557 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:03:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 114.42141981499999, 2024-05-07T14:03:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003252455, 2024-05-07T14:03:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 236 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145312+0000", 2024-05-07T14:03:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145315+0000", 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9170000000000002e-06 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145328+0000", 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3142999999999999e-05 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145362+0000", 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3803999999999997e-05 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145377+0000", 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5173e-05 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145504+0000", 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012702899999999999 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145728+0000", 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022421499999999999 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.146170+0000", 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000442003 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.147770+0000", 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016003479999999999 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148421+0000", 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065072100000000005 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148502+0000", 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0717000000000007e-05 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.148564+0000", 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2385000000000007e-05 2024-05-07T14:03:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 114.409000874, 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:03:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:03:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:309 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 114.40512115200001, 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033245509999999998, 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 309 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161610+0000", 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161611+0000", 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9599999999999998e-07 2024-05-07T14:03:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161616+0000", 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3369999999999999e-06 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161629+0000", 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2524000000000001e-05 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161636+0000", 2024-05-07T14:03:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5749999999999997e-06 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161679+0000", 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3572999999999998e-05 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161741+0000", 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1384999999999996e-05 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161864+0000", 2024-05-07T14:03:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012332399999999999 2024-05-07T14:03:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.162432+0000", 2024-05-07T14:03:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056811100000000005 2024-05-07T14:03:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164864+0000", 2024-05-07T14:03:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024318590000000002 2024-05-07T14:03:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164900+0000", 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6463e-05 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.164935+0000", 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4604000000000003e-05 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 114.27446564900001, 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:03:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:561 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 114.26729832700001, 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032539119999999999, 2024-05-07T14:03:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 561 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299433+0000", 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299435+0000", 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.323e-06 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299447+0000", 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1534e-05 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299475+0000", 2024-05-07T14:03:01.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7546e-05 2024-05-07T14:03:01.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299490+0000", 2024-05-07T14:03:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5147000000000001e-05 2024-05-07T14:03:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299562+0000", 2024-05-07T14:03:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2644000000000004e-05 2024-05-07T14:03:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299615+0000", 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2478999999999997e-05 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.299725+0000", 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010996499999999999 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.300514+0000", 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078952500000000001 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302632+0000", 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021174259999999999 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302664+0000", 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1767999999999998e-05 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.302687+0000", 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3555000000000001e-05 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 113.97676563900001, 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:03:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 113.842518008, 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003055402, 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 849 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724213+0000", 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724215+0000", 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.886e-06 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724226+0000", 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0693000000000001e-05 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724257+0000", 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0982999999999998e-05 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724271+0000", 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724452+0000", 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018067499999999999 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724592+0000", 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014028599999999999 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.724853+0000", 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026110800000000002 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.726000+0000", 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001146834 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727116+0000", 2024-05-07T14:03:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001115268 2024-05-07T14:03:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727207+0000", 2024-05-07T14:03:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1879000000000006e-05 2024-05-07T14:03:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.727269+0000", 2024-05-07T14:03:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1433000000000006e-05 2024-05-07T14:03:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 113.796804612, 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:03:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:03:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 113.79052787400001, 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029542180000000002, 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 870 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:03:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776204+0000", 2024-05-07T14:03:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776206+0000", 2024-05-07T14:03:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.894e-06 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776216+0000", 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0166000000000001e-05 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776247+0000", 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0840000000000003e-05 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776261+0000", 2024-05-07T14:03:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4633e-05 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776389+0000", 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012820299999999999 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.776623+0000", 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023393099999999999 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.777102+0000", 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00047913300000000002 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.778479+0000", 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013764129999999999 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779015+0000", 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053604599999999998 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779092+0000", 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6919e-05 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.779158+0000", 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6039999999999998e-05 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 113.605436668, 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032055949999999999, 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 949 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961295+0000", 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961297+0000", 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4329999999999998e-06 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961310+0000", 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.243e-05 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961342+0000", 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2255999999999997e-05 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961357+0000", 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5043e-05 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961509+0000", 2024-05-07T14:03:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015163899999999999 2024-05-07T14:03:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.961878+0000", 2024-05-07T14:03:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036960399999999999 2024-05-07T14:03:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.962444+0000", 2024-05-07T14:03:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056559899999999996 2024-05-07T14:03:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.963695+0000", 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00125092 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964348+0000", 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065308800000000002 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964434+0000", 2024-05-07T14:03:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6093000000000004e-05 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.964500+0000", 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6489999999999995e-05 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5099.0:56 7.14 e80/29 7:2b04a3e9:::notify.6:head v 80'36, mlcod=80'34)", 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.3868756009999998, 2024-05-07T14:03:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046522059999999999, 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1399999999999997e-07 2024-05-07T14:03:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179862+0000", 2024-05-07T14:03:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4330000000000003e-06 2024-05-07T14:03:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179873+0000", 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0838e-05 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179879+0000", 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3099999999999997e-06 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179934+0000", 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4625e-05 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179955+0000", 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-05 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184469+0000", 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045139150000000003 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184508+0000", 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9001000000000001e-05 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5117.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94838143561296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.490856+0000", 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.0758750740000007, 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034216759999999998, 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5117", 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/62727776", 2024-05-07T14:03:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 51 2024-05-07T14:03:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490856+0000", 2024-05-07T14:03:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490856+0000", 2024-05-07T14:03:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490857+0000", 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490862+0000", 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3419999999999998e-06 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490871+0000", 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.089e-06 2024-05-07T14:03:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490875+0000", 2024-05-07T14:03:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8300000000000003e-06 2024-05-07T14:03:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490910+0000", 2024-05-07T14:03:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4856e-05 2024-05-07T14:03:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490955+0000", 2024-05-07T14:03:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5181e-05 2024-05-07T14:03:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.491035+0000", 2024-05-07T14:03:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9542999999999994e-05 2024-05-07T14:03:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.492688+0000", 2024-05-07T14:03:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016531130000000001 2024-05-07T14:03:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.494187+0000", 2024-05-07T14:03:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014991099999999999 2024-05-07T14:03:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.494233+0000", 2024-05-07T14:03:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5676000000000001e-05 2024-05-07T14:03:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.494278+0000", 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5192999999999999e-05 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5117.0:56 7.14 e81/29 7:2b04a3e9:::notify.6:head v 81'39, mlcod=80'37)", 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.0702797610000001, 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078436700000000005, 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.34e-07 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496456+0000", 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5410000000000001e-06 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496463+0000", 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7689999999999996e-06 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496468+0000", 2024-05-07T14:03:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1969999999999998e-06 2024-05-07T14:03:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496518+0000", 2024-05-07T14:03:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0793e-05 2024-05-07T14:03:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496538+0000", 2024-05-07T14:03:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0000000000000002e-05 2024-05-07T14:03:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504267+0000", 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077288419999999997 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504295+0000", 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8093999999999999e-05 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1585 4.2d 4:b60c161e:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897371+0000", 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.6693605310000006, 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035527139999999998, 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1585 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897371+0000", 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897371+0000", 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897373+0000", 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2680000000000001e-06 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897382+0000", 2024-05-07T14:03:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.85e-06 2024-05-07T14:03:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897402+0000", 2024-05-07T14:03:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9732999999999999e-05 2024-05-07T14:03:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897412+0000", 2024-05-07T14:03:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0292000000000001e-05 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897477+0000", 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4639000000000002e-05 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897597+0000", 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120727 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897756+0000", 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015853500000000001 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898973+0000", 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012173780000000001 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900839+0000", 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00186578 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900890+0000", 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0991e-05 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900924+0000", 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3521e-05 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5165.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94404812949152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.152665+0000", 2024-05-07T14:03:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.4140661940000001, 2024-05-07T14:03:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031931310000000001, 2024-05-07T14:03:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5165", 2024-05-07T14:03:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/3551621939", 2024-05-07T14:03:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 51 2024-05-07T14:03:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152665+0000", 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152665+0000", 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152666+0000", 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9800000000000002e-07 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152670+0000", 2024-05-07T14:03:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1219999999999997e-06 2024-05-07T14:03:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152684+0000", 2024-05-07T14:03:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3198e-05 2024-05-07T14:03:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152689+0000", 2024-05-07T14:03:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4909999999999996e-06 2024-05-07T14:03:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152730+0000", 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0772999999999997e-05 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152791+0000", 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1629000000000002e-05 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.152873+0000", 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2097999999999999e-05 2024-05-07T14:03:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.154257+0000", 2024-05-07T14:03:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013832479999999999 2024-05-07T14:03:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.155746+0000", 2024-05-07T14:03:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014890249999999999 2024-05-07T14:03:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.155793+0000", 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7617000000000002e-05 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.155858+0000", 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5031999999999997e-05 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:56 7.14 e81/29 7:2b04a3e9:::notify.6:head v 81'48, mlcod=81'46)", 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:03:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.4065399210000002, 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039243350000000001, 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:03:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6199999999999999e-07 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160195+0000", 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3569999999999998e-06 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160202+0000", 2024-05-07T14:03:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8120000000000002e-06 2024-05-07T14:03:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160207+0000", 2024-05-07T14:03:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5390000000000001e-06 2024-05-07T14:03:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160259+0000", 2024-05-07T14:03:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2578999999999999e-05 2024-05-07T14:03:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160279+0000", 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9599999999999999e-05 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164086+0000", 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038071979999999999 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164116+0000", 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9887999999999999e-05 2024-05-07T14:03:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1720 4.1c 4:397a1514:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.5.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.6444563470000002, 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041467209999999999, 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1720 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922276+0000", 2024-05-07T14:03:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4799999999999998e-07 2024-05-07T14:03:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922280+0000", 2024-05-07T14:03:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4839999999999998e-06 2024-05-07T14:03:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922288+0000", 2024-05-07T14:03:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9610000000000005e-06 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922300+0000", 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1365e-05 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922369+0000", 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9758999999999994e-05 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922491+0000", 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121383 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922642+0000", 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015127200000000001 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.923617+0000", 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097548299999999997 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926352+0000", 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027348170000000001 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926382+0000", 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9808e-05 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926422+0000", 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9740999999999998e-05 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1825 4.d e81/23 4:b33fbda9:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.4:head v 81'3, mlcod=80'1)", 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.215002+0000", 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.3517297389999996, 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029443249999999998, 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215002+0000", 2024-05-07T14:03:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215002+0000", 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215002+0000", 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3799999999999997e-07 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215007+0000", 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4129999999999999e-06 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215016+0000", 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0350000000000007e-06 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215022+0000", 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6200000000000001e-06 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215091+0000", 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8244000000000006e-05 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.215109+0000", 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8338999999999998e-05 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.217910+0000", 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028009950000000001 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.217946+0000", 2024-05-07T14:03:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6140999999999998e-05 2024-05-07T14:03:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1919 4.19 e81/23 4:9aff226f:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.5:head v 81'3, mlcod=81'1)", 2024-05-07T14:03:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.397819+0000", 2024-05-07T14:03:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.1689127539999999, 2024-05-07T14:03:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029787220000000001, 2024-05-07T14:03:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397819+0000", 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397819+0000", 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397819+0000", 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1900000000000002e-07 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397825+0000", 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9170000000000003e-06 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397835+0000", 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0093e-05 2024-05-07T14:03:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397845+0000", 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7769999999999997e-06 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397914+0000", 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8621000000000006e-05 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397933+0000", 2024-05-07T14:03:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8902e-05 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.400745+0000", 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028122080000000001 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.400797+0000", 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2485000000000003e-05 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1922 4.19 e81/23 4:9849ed33:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.8:head v 81'4, mlcod=81'1)", 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.1688665570000003, 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005911655, 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8200000000000001e-07 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397869+0000", 2024-05-07T14:03:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5209999999999998e-06 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397875+0000", 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6599999999999998e-06 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397881+0000", 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1240000000000004e-06 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398179+0000", 2024-05-07T14:03:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029815899999999999 2024-05-07T14:03:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398197+0000", 2024-05-07T14:03:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8133000000000001e-05 2024-05-07T14:03:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403738+0000", 2024-05-07T14:03:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055410950000000002 2024-05-07T14:03:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403777+0000", 2024-05-07T14:03:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8581000000000002e-05 2024-05-07T14:03:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:01.667 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:01.668 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:01.669 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:01.680+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:01.769 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:01.780+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:01.828 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:01.829 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:01.829 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:01.829 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:01.841 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:01.870 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:01.880+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:01.949 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:01.950 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:01.950 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:01.950 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:01.950 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:01.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:02.008 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:02.020+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:02.072 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:02.080+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:02.090 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:03:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 120.099532752, 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:03:02.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:03:02.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:03:02.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.095 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.095 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.095 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:03:02.095 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 115.079128932, 2024-05-07T14:03:02.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:03:02.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:03:02.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:03:02.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:03:02.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:03:02.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.101 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.102 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:415 6.7 e33/27 6:e622f76a:gc::gc.20:head v 33'6, mlcod=33'4)", 2024-05-07T14:03:02.102 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:03:02.102 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 114.900201279, 2024-05-07T14:03:02.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044669840000000002, 2024-05-07T14:03:02.102 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.102 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.102 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.102 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201809+0000", 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1799999999999995e-07 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201814+0000", 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4170000000000002e-06 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201824+0000", 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0217999999999999e-05 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201838+0000", 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3723000000000001e-05 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201890+0000", 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2320000000000001e-05 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.201906+0000", 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5894999999999999e-05 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206242+0000", 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043366489999999997 2024-05-07T14:03:02.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.206276+0000", 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:432 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 114.88895569899999, 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045128019999999998, 2024-05-07T14:03:02.106 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 432 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213054+0000", 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213055+0000", 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7000000000000005e-07 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213058+0000", 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0369999999999999e-06 2024-05-07T14:03:02.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213066+0000", 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3680000000000002e-06 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213084+0000", 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7946999999999999e-05 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213127+0000", 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2673999999999998e-05 2024-05-07T14:03:02.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213222+0000", 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5488000000000005e-05 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213412+0000", 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000189307 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.214754+0000", 2024-05-07T14:03:02.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001342069 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217447+0000", 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026931250000000002 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217521+0000", 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3997000000000003e-05 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217567+0000", 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6220000000000001e-05 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:430 6.7 e33/27 6:e1cdb60d:reshard::reshard.0000000008:head v 33'9, mlcod=33'6)", 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 114.888909216, 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043702330000000003, 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.112 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213101+0000", 2024-05-07T14:03:02.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0400000000000005e-07 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213107+0000", 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5740000000000003e-06 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213117+0000", 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8349999999999999e-06 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213122+0000", 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5140000000000001e-06 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213169+0000", 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6551000000000002e-05 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.213198+0000", 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217415+0000", 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042171090000000001 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.217471+0000", 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5766000000000001e-05 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:480 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:03:02.116 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 114.86044506099999, 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052104459999999997, 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 480 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:03:02.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:03:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:03:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6199999999999997e-07 2024-05-07T14:03:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241570+0000", 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2479999999999998e-06 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241580+0000", 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8719999999999997e-06 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241584+0000", 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7210000000000002e-06 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241629+0000", 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4465000000000002e-05 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241671+0000", 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2370999999999998e-05 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241772+0000", 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101048 2024-05-07T14:03:02.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.243876+0000", 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021036789999999998 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246710+0000", 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028339060000000002 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246747+0000", 2024-05-07T14:03:02.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7061000000000003e-05 2024-05-07T14:03:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246775+0000", 2024-05-07T14:03:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8413000000000001e-05 2024-05-07T14:03:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:499 6.13 6:cedbb205:::obj_delete_at_hint.0000000017:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:03:02.122 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 114.84956434, 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050166450000000001, 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 499 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:03:02.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252446+0000", 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4300000000000002e-07 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252451+0000", 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1290000000000004e-06 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252463+0000", 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1238e-05 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252470+0000", 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2019999999999998e-06 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252534+0000", 2024-05-07T14:03:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4178999999999997e-05 2024-05-07T14:03:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252706+0000", 2024-05-07T14:03:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017197 2024-05-07T14:03:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252871+0000", 2024-05-07T14:03:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016508199999999999 2024-05-07T14:03:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254444+0000", 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001573112 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257407+0000", 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029630989999999999 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257437+0000", 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0009999999999999e-05 2024-05-07T14:03:02.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257462+0000", 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4780999999999999e-05 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:500 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 114.84927823699999, 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046354220000000002, 2024-05-07T14:03:02.128 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 500 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252732+0000", 2024-05-07T14:03:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252733+0000", 2024-05-07T14:03:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9399999999999993e-07 2024-05-07T14:03:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252738+0000", 2024-05-07T14:03:02.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6779999999999997e-06 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252750+0000", 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1882000000000001e-05 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252758+0000", 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0649999999999999e-06 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252811+0000", 2024-05-07T14:03:02.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2859000000000003e-05 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252870+0000", 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8956000000000003e-05 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.252992+0000", 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122275 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.254326+0000", 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013334449999999999 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257254+0000", 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029284039999999999 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257316+0000", 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1348999999999998e-05 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.257367+0000", 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1514999999999997e-05 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:686 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 114.69943135299999, 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046254349999999998, 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.134 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 686 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402579+0000", 2024-05-07T14:03:02.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402581+0000", 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2529999999999999e-06 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402592+0000", 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0984e-05 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402619+0000", 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7583e-05 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402633+0000", 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3553000000000001e-05 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402699+0000", 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6013000000000006e-05 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402792+0000", 2024-05-07T14:03:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3455999999999994e-05 2024-05-07T14:03:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.402928+0000", 2024-05-07T14:03:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013596800000000001 2024-05-07T14:03:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.403918+0000", 2024-05-07T14:03:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00099017000000000007 2024-05-07T14:03:02.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407144+0000", 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032257449999999999 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407180+0000", 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5462e-05 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.407204+0000", 2024-05-07T14:03:02.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4247999999999999e-05 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5099.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.9226447409999992, 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053287550000000001, 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5099", 2024-05-07T14:03:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2788980923", 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179366+0000", 2024-05-07T14:03:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7299999999999996e-07 2024-05-07T14:03:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179368+0000", 2024-05-07T14:03:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7879999999999998e-06 2024-05-07T14:03:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179378+0000", 2024-05-07T14:03:02.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8870000000000004e-06 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179384+0000", 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3009999999999997e-06 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179438+0000", 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4731000000000002e-05 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179515+0000", 2024-05-07T14:03:02.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6817999999999995e-05 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179637+0000", 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122197 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.181699+0000", 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020617000000000001 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184620+0000", 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029204999999999999 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184651+0000", 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1267999999999999e-05 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184694+0000", 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2991999999999998e-05 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.145 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1477 3.18 3:1a16f065:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.8165274090000008, 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017437234999999999, 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1477 2024-05-07T14:03:02.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285485+0000", 2024-05-07T14:03:02.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.148e-06 2024-05-07T14:03:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287428+0000", 2024-05-07T14:03:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001943391 2024-05-07T14:03:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287451+0000", 2024-05-07T14:03:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2912e-05 2024-05-07T14:03:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287464+0000", 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2758000000000001e-05 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287530+0000", 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6544999999999994e-05 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287643+0000", 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011307900000000001 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287732+0000", 2024-05-07T14:03:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8640999999999994e-05 2024-05-07T14:03:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.300987+0000", 2024-05-07T14:03:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013255052999999999 2024-05-07T14:03:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302819+0000", 2024-05-07T14:03:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001831533 2024-05-07T14:03:02.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302874+0000", 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5946000000000003e-05 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302920+0000", 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5228999999999997e-05 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.7972653439999995, 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:03:02.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:03:02.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:02.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.156 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5117.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:03:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.606022458, 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008462018, 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5117", 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/62727776", 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:03:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495988+0000", 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999999e-07 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495990+0000", 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.765e-06 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495995+0000", 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3499999999999996e-06 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495998+0000", 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3739999999999998e-06 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496050+0000", 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2015999999999998e-05 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496120+0000", 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9373000000000001e-05 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496224+0000", 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010395699999999999 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.501395+0000", 2024-05-07T14:03:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051715090000000003 2024-05-07T14:03:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504399+0000", 2024-05-07T14:03:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030035930000000001 2024-05-07T14:03:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504428+0000", 2024-05-07T14:03:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504449+0000", 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1608e-05 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1485 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=14b,call rgw.obj_remove in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.4812836279999999, 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056592079999999998, 2024-05-07T14:03:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1485 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620728+0000", 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.457e-06 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620734+0000", 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0460000000000002e-06 2024-05-07T14:03:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620749+0000", 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5067e-05 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620758+0000", 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6989999999999992e-06 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620819+0000", 2024-05-07T14:03:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1496999999999998e-05 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620880+0000", 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0908e-05 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.621007+0000", 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000127551 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.622196+0000", 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001188391 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626306+0000", 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041097779999999997 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626357+0000", 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0936999999999997e-05 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626385+0000", 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8877000000000002e-05 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1487 6.13 6:c8333aab:gc::gc.11:head [call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_enqueue in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.626573+0000", 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.4754365729999996, 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043998559999999997, 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1487 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626573+0000", 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626573+0000", 2024-05-07T14:03:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626574+0000", 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.066e-06 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626579+0000", 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7879999999999997e-06 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626590+0000", 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0705e-05 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626598+0000", 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6899999999999992e-06 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626660+0000", 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2623e-05 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626757+0000", 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6368999999999998e-05 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.627049+0000", 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029227700000000002 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.627919+0000", 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00087008300000000001 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.630896+0000", 2024-05-07T14:03:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002976767 2024-05-07T14:03:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.630930+0000", 2024-05-07T14:03:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3847000000000003e-05 2024-05-07T14:03:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.630973+0000", 2024-05-07T14:03:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3640999999999998e-05 2024-05-07T14:03:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5165.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.159929+0000", 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.9420806230000007, 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043657139999999997, 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5165", 2024-05-07T14:03:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/3551621939", 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159929+0000", 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159929+0000", 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159930+0000", 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9299999999999998e-07 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159932+0000", 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5730000000000002e-06 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159946+0000", 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3685e-05 2024-05-07T14:03:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159952+0000", 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7150000000000003e-06 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.159998+0000", 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6771999999999999e-05 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160045+0000", 2024-05-07T14:03:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6520999999999997e-05 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160107+0000", 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1790000000000003e-05 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.161190+0000", 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010833489999999999 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164211+0000", 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030213499999999999 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164261+0000", 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9521000000000002e-05 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164295+0000", 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3945000000000001e-05 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1919 4.19 4:9aff226f:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396299+0000", 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.7057105249999998, 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0047192270000000003, 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1919 2024-05-07T14:03:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396299+0000", 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396299+0000", 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396300+0000", 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6400000000000002e-07 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396303+0000", 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.751e-06 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396319+0000", 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6320999999999998e-05 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396325+0000", 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4250000000000003e-06 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396394+0000", 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8934000000000001e-05 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396471+0000", 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6638999999999996e-05 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396572+0000", 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101217 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397664+0000", 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0010920599999999999 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.400932+0000", 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032676659999999998 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.400987+0000", 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5315000000000001e-05 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401019+0000", 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1334999999999997e-05 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.186 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1920 4.0 4:03a7a160:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.7056541450000005, 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055799400000000002, 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1920 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.89e-07 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396360+0000", 2024-05-07T14:03:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.284e-06 2024-05-07T14:03:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396368+0000", 2024-05-07T14:03:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8769999999999993e-06 2024-05-07T14:03:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396374+0000", 2024-05-07T14:03:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2480000000000004e-06 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396652+0000", 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027788900000000002 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396724+0000", 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2391000000000005e-05 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397033+0000", 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030929299999999998 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398442+0000", 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001409062 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401881+0000", 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034388639999999998 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401909+0000", 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7716e-05 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401936+0000", 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6826999999999999e-05 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1922 4.19 4:9849ed33:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.192 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.7056194820000004, 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0075306310000000003, 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1922 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396391+0000", 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.46e-07 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396393+0000", 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3250000000000002e-06 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396400+0000", 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9190000000000002e-06 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396405+0000", 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2839999999999997e-06 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396919+0000", 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00051340499999999998 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396988+0000", 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8775999999999993e-05 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397099+0000", 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111239 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398350+0000", 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001250735 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403874+0000", 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005524307 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403900+0000", 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6499000000000002e-05 2024-05-07T14:03:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403921+0000", 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0696e-05 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1924 4.29 4:9770b4a5:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396413+0000", 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.7055970169999997, 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046902610000000003, 2024-05-07T14:03:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1924 2024-05-07T14:03:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396413+0000", 2024-05-07T14:03:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396413+0000", 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396413+0000", 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7999999999999996e-07 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396415+0000", 2024-05-07T14:03:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1090000000000001e-06 2024-05-07T14:03:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396422+0000", 2024-05-07T14:03:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3690000000000003e-06 2024-05-07T14:03:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396426+0000", 2024-05-07T14:03:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6410000000000001e-06 2024-05-07T14:03:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396992+0000", 2024-05-07T14:03:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00056546899999999998 2024-05-07T14:03:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397495+0000", 2024-05-07T14:03:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00050259000000000002 2024-05-07T14:03:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397589+0000", 2024-05-07T14:03:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4291999999999998e-05 2024-05-07T14:03:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398620+0000", 2024-05-07T14:03:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001031283 2024-05-07T14:03:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401034+0000", 2024-05-07T14:03:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024134999999999998 2024-05-07T14:03:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401073+0000", 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9437999999999997e-05 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401103+0000", 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0090000000000002e-05 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:02.208 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:02.209 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:02.210 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:02.220+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:02.310 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:02.320+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:02.341 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:02.386 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:02.387 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:02.387 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:02.388 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:02.412 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:02.420+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:02.522 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:02.523 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:02.524 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:02.524 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:02.524 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:02.525 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:02.536+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:02.538 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:02.624 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:02.624+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:02.715 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 120.72983347100001, 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070064749999999999, 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 43 2024-05-07T14:03:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:03:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:03:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994274+0000", 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7170000000000002e-06 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994292+0000", 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7819999999999999e-05 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994338+0000", 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6625999999999997e-05 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994362+0000", 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4063e-05 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994576+0000", 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021319500000000001 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994598+0000", 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2325999999999999e-05 2024-05-07T14:03:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001023+0000", 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00642546 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001277+0000", 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025326800000000002 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:03:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 115.674204045, 2024-05-07T14:03:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033678110000000001, 2024-05-07T14:03:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 211 2024-05-07T14:03:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:03:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049900+0000", 2024-05-07T14:03:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049903+0000", 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.963e-06 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049917+0000", 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049950+0000", 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3328999999999999e-05 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.049966+0000", 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6333000000000001e-05 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050100+0000", 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013305599999999999 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050363+0000", 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026392100000000002 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.050827+0000", 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00046316 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.052269+0000", 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014428760000000001 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053111+0000", 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084168999999999997 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053198+0000", 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6666e-05 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.053267+0000", 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9503000000000002e-05 2024-05-07T14:03:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 115.59574935000001, 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032702809999999999, 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 232 2024-05-07T14:03:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:03:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128354+0000", 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128357+0000", 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1530000000000001e-06 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128369+0000", 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1823e-05 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128401+0000", 2024-05-07T14:03:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2073000000000003e-05 2024-05-07T14:03:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128416+0000", 2024-05-07T14:03:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4997000000000001e-05 2024-05-07T14:03:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128538+0000", 2024-05-07T14:03:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121406 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.128773+0000", 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235121 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.129230+0000", 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00045679999999999999 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.130836+0000", 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001606484 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131454+0000", 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061747199999999999 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131550+0000", 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6636000000000001e-05 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.131624+0000", 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4315999999999998e-05 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:301 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 115.564172384, 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037043950000000001, 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 301 2024-05-07T14:03:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:03:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159931+0000", 2024-05-07T14:03:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159933+0000", 2024-05-07T14:03:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6670000000000001e-06 2024-05-07T14:03:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159943+0000", 2024-05-07T14:03:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0176e-05 2024-05-07T14:03:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159965+0000", 2024-05-07T14:03:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2243e-05 2024-05-07T14:03:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.159980+0000", 2024-05-07T14:03:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4747e-05 2024-05-07T14:03:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160332+0000", 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000352004 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.160574+0000", 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241838 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.161045+0000", 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000471526 2024-05-07T14:03:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.162322+0000", 2024-05-07T14:03:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001276241 2024-05-07T14:03:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163376+0000", 2024-05-07T14:03:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010539449999999999 2024-05-07T14:03:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163516+0000", 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014034599999999999 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.163636+0000", 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011966199999999999 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:376 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:03:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 115.548057105, 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038557209999999999, 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 376 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:03:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176046+0000", 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176049+0000", 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7659999999999999e-06 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176064+0000", 2024-05-07T14:03:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.451e-05 2024-05-07T14:03:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176101+0000", 2024-05-07T14:03:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000003e-05 2024-05-07T14:03:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176126+0000", 2024-05-07T14:03:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-05-07T14:03:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176272+0000", 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014592899999999999 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176402+0000", 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000129512 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.176725+0000", 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032289800000000001 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.177826+0000", 2024-05-07T14:03:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011017620000000001 2024-05-07T14:03:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179617+0000", 2024-05-07T14:03:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001791193 2024-05-07T14:03:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179781+0000", 2024-05-07T14:03:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016336899999999999 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.179902+0000", 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012131899999999999 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:397 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 115.535560015, 2024-05-07T14:03:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034388040000000002, 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 397 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188544+0000", 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188546+0000", 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2000000000000001e-06 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188556+0000", 2024-05-07T14:03:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0557000000000001e-05 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188590+0000", 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3626e-05 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188625+0000", 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5095999999999997e-05 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.188768+0000", 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014279900000000001 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189124+0000", 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035646799999999998 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.189633+0000", 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000508903 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.190638+0000", 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001004465 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191712+0000", 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001074759 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191871+0000", 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835900000000001 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.191982+0000", 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011157199999999999 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:403 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 115.531417237, 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004923172, 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 403 2024-05-07T14:03:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:03:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192686+0000", 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192688+0000", 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4640000000000001e-06 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192696+0000", 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9330000000000001e-06 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192715+0000", 2024-05-07T14:03:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9746999999999999e-05 2024-05-07T14:03:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192726+0000", 2024-05-07T14:03:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.026e-05 2024-05-07T14:03:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192824+0000", 2024-05-07T14:03:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8139000000000003e-05 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.192971+0000", 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014717199999999999 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.193232+0000", 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000260518 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.196090+0000", 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002858598 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197464+0000", 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001373399 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197549+0000", 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5261999999999998e-05 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.197609+0000", 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0680000000000002e-05 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:472 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 115.48711472399999, 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044650219999999999, 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 472 2024-05-07T14:03:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:03:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236989+0000", 2024-05-07T14:03:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.236991+0000", 2024-05-07T14:03:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8589999999999999e-06 2024-05-07T14:03:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237001+0000", 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0465999999999999e-05 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237019+0000", 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7666999999999999e-05 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237030+0000", 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0917000000000001e-05 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237184+0000", 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015438499999999999 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237427+0000", 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024296499999999999 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.237900+0000", 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047292599999999998 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.239253+0000", 2024-05-07T14:03:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013527770000000001 2024-05-07T14:03:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241246+0000", 2024-05-07T14:03:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019933249999999998 2024-05-07T14:03:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241370+0000", 2024-05-07T14:03:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012385599999999999 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.241454+0000", 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3879000000000001e-05 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:509 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 115.466226586, 2024-05-07T14:03:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003433874, 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 509 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257877+0000", 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257878+0000", 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.528e-06 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257886+0000", 2024-05-07T14:03:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2180000000000002e-06 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257903+0000", 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7484999999999999e-05 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.257912+0000", 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0189999999999995e-06 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258007+0000", 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4627000000000001e-05 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258124+0000", 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116836 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.258381+0000", 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025690899999999999 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.259428+0000", 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047177 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261154+0000", 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017262180000000001 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261224+0000", 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9913000000000006e-05 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.261311+0000", 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6944e-05 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:625 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 115.37880692500001, 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039276240000000002, 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 625 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345297+0000", 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345300+0000", 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.067e-06 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345315+0000", 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4857e-05 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345344+0000", 2024-05-07T14:03:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9070000000000001e-05 2024-05-07T14:03:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345359+0000", 2024-05-07T14:03:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5656000000000001e-05 2024-05-07T14:03:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345512+0000", 2024-05-07T14:03:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015229600000000001 2024-05-07T14:03:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.345764+0000", 2024-05-07T14:03:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025252100000000002 2024-05-07T14:03:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.346269+0000", 2024-05-07T14:03:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000504613 2024-05-07T14:03:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.347487+0000", 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001218317 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349071+0000", 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015844279999999999 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349156+0000", 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4958999999999998e-05 2024-05-07T14:03:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.349224+0000", 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7840000000000001e-05 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1565 4.d 4:b05a54d0:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672774+0000", 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.051329669999999, 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052824339999999999, 2024-05-07T14:03:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1565 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672774+0000", 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672774+0000", 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672776+0000", 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0700000000000001e-06 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672787+0000", 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0823e-05 2024-05-07T14:03:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672818+0000", 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1676e-05 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672840+0000", 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1759999999999998e-05 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673009+0000", 2024-05-07T14:03:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016833700000000001 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673279+0000", 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027011899999999998 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673560+0000", 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028097000000000002 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.676617+0000", 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030573150000000001 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677839+0000", 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012222240000000001 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677943+0000", 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103838 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678056+0000", 2024-05-07T14:03:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011330199999999999 2024-05-07T14:03:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1566 4.13 4:cabacdb3:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:03:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.051215185, 2024-05-07T14:03:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057730890000000003, 2024-05-07T14:03:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1566 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672890+0000", 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.606e-06 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672898+0000", 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-06 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672924+0000", 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5599999999999999e-05 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672942+0000", 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7799999999999999e-05 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673078+0000", 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013645399999999999 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673280+0000", 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020144999999999999 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673597+0000", 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031715200000000002 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.675496+0000", 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018996830000000001 2024-05-07T14:03:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678466+0000", 2024-05-07T14:03:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029693639999999999 2024-05-07T14:03:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678562+0000", 2024-05-07T14:03:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6614999999999996e-05 2024-05-07T14:03:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678661+0000", 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9024999999999995e-05 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1568 4.3d 4:bd9d380d:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.051120143, 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059901989999999999, 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1568 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:03:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672985+0000", 2024-05-07T14:03:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-05-07T14:03:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672992+0000", 2024-05-07T14:03:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7229999999999998e-06 2024-05-07T14:03:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673011+0000", 2024-05-07T14:03:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9700000000000001e-05 2024-05-07T14:03:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673026+0000", 2024-05-07T14:03:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4506e-05 2024-05-07T14:03:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674436+0000", 2024-05-07T14:03:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001410445 2024-05-07T14:03:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674635+0000", 2024-05-07T14:03:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019898299999999999 2024-05-07T14:03:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674957+0000", 2024-05-07T14:03:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032126499999999999 2024-05-07T14:03:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.676898+0000", 2024-05-07T14:03:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019413989999999999 2024-05-07T14:03:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678780+0000", 2024-05-07T14:03:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018816880000000001 2024-05-07T14:03:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678912+0000", 2024-05-07T14:03:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013280799999999999 2024-05-07T14:03:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678974+0000", 2024-05-07T14:03:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1192000000000006e-05 2024-05-07T14:03:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1570 4.1b 4:db659863:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:03:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.051054543999999, 2024-05-07T14:03:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059406459999999999, 2024-05-07T14:03:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1570 2024-05-07T14:03:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:03:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:03:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673050+0000", 2024-05-07T14:03:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1230000000000001e-06 2024-05-07T14:03:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673056+0000", 2024-05-07T14:03:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5639999999999996e-06 2024-05-07T14:03:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673073+0000", 2024-05-07T14:03:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7751999999999999e-05 2024-05-07T14:03:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673086+0000", 2024-05-07T14:03:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2656999999999999e-05 2024-05-07T14:03:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674276+0000", 2024-05-07T14:03:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011896350000000001 2024-05-07T14:03:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674479+0000", 2024-05-07T14:03:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020363600000000001 2024-05-07T14:03:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:02.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674757+0000", 2024-05-07T14:03:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027776599999999998 2024-05-07T14:03:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677473+0000", 2024-05-07T14:03:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027157739999999998 2024-05-07T14:03:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678813+0000", 2024-05-07T14:03:02.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013401120000000001 2024-05-07T14:03:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678931+0000", 2024-05-07T14:03:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118322 2024-05-07T14:03:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678990+0000", 2024-05-07T14:03:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8304999999999998e-05 2024-05-07T14:03:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1572 4.13 4:c90a81ac:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:03:02.809 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.050998558, 2024-05-07T14:03:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062582080000000003, 2024-05-07T14:03:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.810 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.811 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.812 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1572 2024-05-07T14:03:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:03:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:03:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673106+0000", 2024-05-07T14:03:02.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0729999999999999e-06 2024-05-07T14:03:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673111+0000", 2024-05-07T14:03:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3070000000000002e-06 2024-05-07T14:03:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673129+0000", 2024-05-07T14:03:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:03:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673143+0000", 2024-05-07T14:03:02.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3579e-05 2024-05-07T14:03:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674380+0000", 2024-05-07T14:03:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001237908 2024-05-07T14:03:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674578+0000", 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000197617 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674864+0000", 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028589499999999999 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678694+0000", 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038299900000000001 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679226+0000", 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053176199999999997 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679299+0000", 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3658000000000005e-05 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679363+0000", 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3816e-05 2024-05-07T14:03:02.824 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1579 4.e 4:70198fec:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.1:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.897263+0000", 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.8268407379999996, 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004814881, 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.825 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1579 2024-05-07T14:03:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897263+0000", 2024-05-07T14:03:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897263+0000", 2024-05-07T14:03:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897266+0000", 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897279+0000", 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3029e-05 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:03:02.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2225999999999999e-05 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897364+0000", 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2726000000000003e-05 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897563+0000", 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019917700000000001 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897900+0000", 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000337175 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.898374+0000", 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000474229 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.901318+0000", 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029436499999999999 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.901935+0000", 2024-05-07T14:03:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061724700000000002 2024-05-07T14:03:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.902014+0000", 2024-05-07T14:03:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8949000000000006e-05 2024-05-07T14:03:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.902078+0000", 2024-05-07T14:03:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3726000000000006e-05 2024-05-07T14:03:02.830 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1587 4.1b 4:d97b2c21:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.897446+0000", 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.826657548, 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033670710000000001, 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.831 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1587 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897446+0000", 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897446+0000", 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897448+0000", 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0600000000000002e-06 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897464+0000", 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5840000000000001e-05 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897498+0000", 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4569000000000001e-05 2024-05-07T14:03:02.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897516+0000", 2024-05-07T14:03:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7697e-05 2024-05-07T14:03:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897642+0000", 2024-05-07T14:03:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012585499999999999 2024-05-07T14:03:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.897980+0000", 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000337478 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.898385+0000", 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000405356 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.900329+0000", 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001943923 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.900368+0000", 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9332999999999998e-05 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.900624+0000", 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000255436 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.900813+0000", 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000189524 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.836 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1612 3.3 3:c1191b65:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.3012133939999995, 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013953758, 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.837 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1612 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422894+0000", 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3400000000000002e-06 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426732+0000", 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386760000000001 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426772+0000", 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9740000000000002e-05 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426791+0000", 2024-05-07T14:03:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:03:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426935+0000", 2024-05-07T14:03:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144368 2024-05-07T14:03:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.427196+0000", 2024-05-07T14:03:02.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026091599999999998 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.427426+0000", 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022962899999999999 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.434735+0000", 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073090990000000003 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436629+0000", 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018938640000000001 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436721+0000", 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1943999999999999e-05 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436844+0000", 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012338900000000001 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1614 3.1d e81/21 3:baaad814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4_10Mb.:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.2739640950000002, 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013565693, 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:03:02.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450142+0000", 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3970000000000001e-06 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453081+0000", 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029395100000000002 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453123+0000", 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1356000000000002e-05 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453142+0000", 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453311+0000", 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016885700000000001 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453349+0000", 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8033e-05 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.463599+0000", 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010250011 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.463705+0000", 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000105839 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1825 4.d 4:b33fbda9:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:54.214034+0000", 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.5100691319999999, 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041675660000000002, 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:02.847 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1825 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214034+0000", 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:02.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214034+0000", 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214035+0000", 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7599999999999996e-07 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214040+0000", 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3579999999999996e-06 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:02.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214049+0000", 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5240000000000006e-06 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214056+0000", 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3529999999999997e-06 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214153+0000", 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6780999999999994e-05 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214321+0000", 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000167465 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.214530+0000", 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020887299999999999 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.216352+0000", 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018223169999999999 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.218036+0000", 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016841580000000001 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.218137+0000", 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010143499999999999 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.218202+0000", 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4525999999999999e-05 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.852 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:02.853 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:02.853 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:02.853 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:02.724+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:02.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:02.856 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:02.864+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:02.957 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:02.968+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:03.026 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:03.027 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:03.027 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:03.027 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:03.039 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:03.080 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:03.092+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:03.159 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:03.168+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:03.204 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:03.205 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:03.205 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:03.205 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:03.205 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:03.218 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:03:03.260 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:03.268+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:03.361 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:03.372+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:03.369 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:03.370 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:03.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:03.370 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:03.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.370 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-05-07T14:03:03.370 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:03:03.370 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.368017825, 2024-05-07T14:03:03.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058205720000000004, 2024-05-07T14:03:03.370 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.370 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.370 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.371 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.371 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.371 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.371 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 205 2024-05-07T14:03:03.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.371 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:03:03.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012369+0000", 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012373+0000", 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.07e-06 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012397+0000", 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3697e-05 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012450+0000", 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2539e-05 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012477+0000", 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7457000000000002e-05 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.012735+0000", 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025820800000000001 2024-05-07T14:03:03.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013057+0000", 2024-05-07T14:03:03.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000321727 2024-05-07T14:03:03.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:03.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.013752+0000", 2024-05-07T14:03:03.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069509499999999996 2024-05-07T14:03:03.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.017093+0000", 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033404340000000002 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018024+0000", 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00093108600000000002 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018113+0000", 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9752000000000004e-05 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.018190+0000", 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6507000000000005e-05 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.297766837, 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052341489999999996, 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.376 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 220 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082620+0000", 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082623+0000", 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8370000000000001e-06 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082636+0000", 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2316e-05 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082667+0000", 2024-05-07T14:03:03.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1139999999999997e-05 2024-05-07T14:03:03.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082681+0000", 2024-05-07T14:03:03.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4816e-05 2024-05-07T14:03:03.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.082825+0000", 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014377899999999999 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083051+0000", 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022549500000000001 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.083453+0000", 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000401944 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.085929+0000", 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024763369999999999 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087649+0000", 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001719747 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087735+0000", 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6415999999999994e-05 2024-05-07T14:03:03.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.087855+0000", 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011932199999999999 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.285347106, 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00342407, 2024-05-07T14:03:03.382 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 223 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095040+0000", 2024-05-07T14:03:03.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095042+0000", 2024-05-07T14:03:03.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1799999999999999e-06 2024-05-07T14:03:03.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095054+0000", 2024-05-07T14:03:03.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1817000000000001e-05 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095084+0000", 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0018999999999998e-05 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095099+0000", 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.537e-05 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095209+0000", 2024-05-07T14:03:03.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010943299999999999 2024-05-07T14:03:03.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095457+0000", 2024-05-07T14:03:03.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247941 2024-05-07T14:03:03.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:03.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.095879+0000", 2024-05-07T14:03:03.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042171299999999999 2024-05-07T14:03:03.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.097290+0000", 2024-05-07T14:03:03.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014118519999999999 2024-05-07T14:03:03.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098196+0000", 2024-05-07T14:03:03.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00090603700000000005 2024-05-07T14:03:03.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098348+0000", 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151879 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.098464+0000", 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011582900000000001 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:271 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:03.388 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:03:03.389 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.22582813299999, 2024-05-07T14:03:03.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035934819999999998, 2024-05-07T14:03:03.389 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.389 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.389 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.389 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.389 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.389 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.389 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 271 2024-05-07T14:03:03.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.389 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154559+0000", 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154562+0000", 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7269999999999999e-06 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154578+0000", 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6667000000000002e-05 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154612+0000", 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3120000000000001e-05 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154632+0000", 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0769999999999999e-05 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.154774+0000", 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141805 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155004+0000", 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022938200000000001 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.155372+0000", 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00036889300000000002 2024-05-07T14:03:03.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.156948+0000", 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015755750000000001 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.157903+0000", 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00095453499999999995 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158050+0000", 2024-05-07T14:03:03.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147279 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.158153+0000", 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102729 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:415 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.180049772, 2024-05-07T14:03:03.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065364059999999998, 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 415 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200339+0000", 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.826e-06 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200348+0000", 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0669999999999998e-06 2024-05-07T14:03:03.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200378+0000", 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.968e-05 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200393+0000", 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5109999999999999e-05 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200515+0000", 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121449 2024-05-07T14:03:03.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200658+0000", 2024-05-07T14:03:03.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014362199999999999 2024-05-07T14:03:03.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:03.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200958+0000", 2024-05-07T14:03:03.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030029699999999999 2024-05-07T14:03:03.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202106+0000", 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011475050000000001 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206707+0000", 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046009980000000002 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206791+0000", 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4118999999999999e-05 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206874+0000", 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2732999999999995e-05 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:417 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.177551681, 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0034776160000000002, 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.400 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 417 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202836+0000", 2024-05-07T14:03:03.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202838+0000", 2024-05-07T14:03:03.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3760000000000002e-06 2024-05-07T14:03:03.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202872+0000", 2024-05-07T14:03:03.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4379999999999999e-05 2024-05-07T14:03:03.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202900+0000", 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8180000000000001e-05 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202915+0000", 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.486e-05 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203063+0000", 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014788799999999999 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.203423+0000", 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035942400000000001 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.204005+0000", 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058227599999999995 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205280+0000", 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012753 2024-05-07T14:03:03.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206135+0000", 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00085444999999999998 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206234+0000", 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9088999999999999e-05 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206313+0000", 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9393000000000004e-05 2024-05-07T14:03:03.405 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:420 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.175215263, 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042372210000000002, 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.406 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 420 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205172+0000", 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205174+0000", 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1100000000000001e-06 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205186+0000", 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.169e-05 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205218+0000", 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2617000000000003e-05 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205240+0000", 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1331999999999998e-05 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205356+0000", 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011655 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.205623+0000", 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026669399999999999 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206029+0000", 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040652 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.208187+0000", 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0021578439999999999 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209226+0000", 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001039058 2024-05-07T14:03:03.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209305+0000", 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8650000000000001e-05 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.209409+0000", 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104156 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:429 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.170184222, 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040139620000000003, 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 429 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210203+0000", 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210205+0000", 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.66e-06 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210228+0000", 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3220000000000001e-05 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210244+0000", 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6339999999999999e-05 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210256+0000", 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1949e-05 2024-05-07T14:03:03.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210472+0000", 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000215529 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210681+0000", 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000208982 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211154+0000", 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047321599999999999 2024-05-07T14:03:03.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212660+0000", 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001506098 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214071+0000", 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014107429999999999 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214153+0000", 2024-05-07T14:03:03.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1889000000000002e-05 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.214217+0000", 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4336000000000002e-05 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:430 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.169838458, 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066752119999999998, 2024-05-07T14:03:03.417 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 430 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210551+0000", 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210562+0000", 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0237e-05 2024-05-07T14:03:03.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210586+0000", 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4066e-05 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210603+0000", 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.713e-05 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211799+0000", 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001196127 2024-05-07T14:03:03.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211931+0000", 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131629 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212211+0000", 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028005100000000002 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.213288+0000", 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010772760000000001 2024-05-07T14:03:03.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217047+0000", 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037586569999999999 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217127+0000", 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0270000000000002e-05 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217224+0000", 2024-05-07T14:03:03.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7139000000000006e-05 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:436 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.163061183, 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003780107, 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.423 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 436 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217326+0000", 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217328+0000", 2024-05-07T14:03:03.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:03:03.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217356+0000", 2024-05-07T14:03:03.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8158999999999999e-05 2024-05-07T14:03:03.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217377+0000", 2024-05-07T14:03:03.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1356999999999999e-05 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217393+0000", 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5569e-05 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217882+0000", 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00048937000000000004 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218099+0000", 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021691899999999999 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.218390+0000", 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029041800000000002 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220013+0000", 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016236169999999999 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220889+0000", 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00087619599999999998 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221005+0000", 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011569 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221106+0000", 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101122 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.428 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:442 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.159439318, 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003357184, 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 442 2024-05-07T14:03:03.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220948+0000", 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220950+0000", 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7400000000000001e-06 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220958+0000", 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8429999999999999e-06 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220979+0000", 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0387e-05 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.220991+0000", 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.181e-05 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221218+0000", 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022694100000000001 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221362+0000", 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014482899999999999 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.221628+0000", 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026559799999999997 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.223915+0000", 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022864819999999998 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224031+0000", 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116759 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224173+0000", 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014127599999999999 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.224305+0000", 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000132519 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.434 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:482 6.d 6:b3052b9f:reshard::reshard.0000000013:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.13720886999999, 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035275459999999999, 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 482 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243178+0000", 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243181+0000", 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243194+0000", 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3087e-05 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243224+0000", 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0546000000000002e-05 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243240+0000", 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5339999999999999e-05 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243379+0000", 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139646 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243576+0000", 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019638300000000001 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.243838+0000", 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026234300000000001 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.244908+0000", 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010696289999999999 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246477+0000", 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001569471 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246596+0000", 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118892 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.246706+0000", 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109899 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:877 6.19 6:98c4c580:::obj_delete_at_hint.0000000100:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 115.588513865, 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033601709999999999, 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.440 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 877 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791873+0000", 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791875+0000", 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9e-06 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791884+0000", 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7069999999999998e-06 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791907+0000", 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2682999999999999e-05 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.791919+0000", 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2763e-05 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792073+0000", 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000153509 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792439+0000", 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000366141 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.792989+0000", 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055016899999999998 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.794288+0000", 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00129885 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795070+0000", 2024-05-07T14:03:03.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000781557 2024-05-07T14:03:03.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795155+0000", 2024-05-07T14:03:03.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5723000000000006e-05 2024-05-07T14:03:03.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.795234+0000", 2024-05-07T14:03:03.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8169000000000003e-05 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1482 3.30 3:0f9854c6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10MBfile1:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.011279206999999, 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060631510000000001, 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.446 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1482 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369111+0000", 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2830000000000002e-06 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369126+0000", 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4693e-05 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369160+0000", 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4282999999999997e-05 2024-05-07T14:03:03.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369178+0000", 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8153000000000001e-05 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369385+0000", 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020658699999999999 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369396+0000", 2024-05-07T14:03:03.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0616e-05 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.374884+0000", 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005488461 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.375171+0000", 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028707500000000003 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5165.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94404812942592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.147307+0000", 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.233080356, 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055399280000000004, 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5165", 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3551621939", 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 47 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147307+0000", 2024-05-07T14:03:03.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147307+0000", 2024-05-07T14:03:03.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147310+0000", 2024-05-07T14:03:03.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7839999999999999e-06 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147323+0000", 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.296e-05 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147358+0000", 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5345999999999997e-05 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147379+0000", 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1103000000000001e-05 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147531+0000", 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015150799999999999 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.147769+0000", 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000238216 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.148185+0000", 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041623300000000001 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.149369+0000", 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001183602 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152656+0000", 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003287051 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152729+0000", 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3393999999999996e-05 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152847+0000", 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117731 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5535.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94838971684432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:03.456 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.304693+0000", 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.075694085, 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051189349999999998, 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5535", 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/4024516518", 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 47 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304693+0000", 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304693+0000", 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304695+0000", 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9360000000000002e-06 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304704+0000", 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7229999999999993e-06 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304735+0000", 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1393000000000003e-05 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304755+0000", 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9927000000000001e-05 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.304880+0000", 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000124898 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.305106+0000", 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022584600000000001 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.305530+0000", 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042447600000000002 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.307084+0000", 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0015533960000000001 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309544+0000", 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024601409999999999 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309667+0000", 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000123289 2024-05-07T14:03:03.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309812+0000", 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014490999999999999 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1611 3.30 3:0c405120:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.9611771729999994, 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021446044000000001, 2024-05-07T14:03:03.462 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1611 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419212+0000", 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3769999999999999e-06 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425005+0000", 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057928390000000001 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425049+0000", 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3569999999999998e-05 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425068+0000", 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9582e-05 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425273+0000", 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020503000000000001 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425505+0000", 2024-05-07T14:03:03.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023136000000000001 2024-05-07T14:03:03.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:03.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425719+0000", 2024-05-07T14:03:03.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021418000000000001 2024-05-07T14:03:03.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.439395+0000", 2024-05-07T14:03:03.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013675768 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440495+0000", 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00109987 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440588+0000", 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3429000000000003e-05 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440656+0000", 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8039000000000004e-05 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1614 3.1d 3:baaad814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.9363188729999994, 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024991276999999999, 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.468 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1614 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:03.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444071+0000", 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6900000000000001e-06 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448527+0000", 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044560870000000001 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448562+0000", 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4576000000000002e-05 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448578+0000", 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6209e-05 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448766+0000", 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018828700000000001 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.449033+0000", 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026696599999999999 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.449872+0000", 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083849399999999996 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.465016+0000", 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015144061 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.468867+0000", 2024-05-07T14:03:03.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003851246 2024-05-07T14:03:03.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.468987+0000", 2024-05-07T14:03:03.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011982899999999999 2024-05-07T14:03:03.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.469060+0000", 2024-05-07T14:03:03.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2831999999999997e-05 2024-05-07T14:03:03.474 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.474 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.474 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.474 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1914 4.15 4:aaab215b:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:03.474 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:54.396110+0000", 2024-05-07T14:03:03.474 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.9842776339999997, 2024-05-07T14:03:03.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058079580000000002, 2024-05-07T14:03:03.474 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.474 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.474 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.474 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1914 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396110+0000", 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396110+0000", 2024-05-07T14:03:03.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396111+0000", 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.237e-06 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396116+0000", 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3839999999999996e-06 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396132+0000", 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5483999999999999e-05 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396141+0000", 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7829999999999993e-06 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396704+0000", 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00056300499999999999 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396795+0000", 2024-05-07T14:03:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0860999999999996e-05 2024-05-07T14:03:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396926+0000", 2024-05-07T14:03:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013037300000000001 2024-05-07T14:03:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.398201+0000", 2024-05-07T14:03:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001275675 2024-05-07T14:03:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.401816+0000", 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036148780000000002 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.401874+0000", 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7385e-05 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.401918+0000", 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3893000000000001e-05 2024-05-07T14:03:03.479 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1923 4.25 4:a6940f24:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:54.396650+0000", 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.9837369779999996, 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052698620000000002, 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:03.480 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:03.481 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1923 2024-05-07T14:03:03.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.481 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:03.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:03.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396650+0000", 2024-05-07T14:03:03.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:03.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396650+0000", 2024-05-07T14:03:03.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396651+0000", 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.029e-06 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396657+0000", 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.823e-06 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:03.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396681+0000", 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4111e-05 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.396691+0000", 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.022e-05 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.397227+0000", 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053586499999999995 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.397321+0000", 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3389999999999999e-05 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.397431+0000", 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110208 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.400606+0000", 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031755249999999998 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.401844+0000", 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012376310000000001 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.401887+0000", 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3319999999999999e-05 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:54.401920+0000", 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2740000000000002e-05 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.485 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:03.486 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:03.486 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:03.486 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:03:03.487 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:03:03.488 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:03.500+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:03.498 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:03:03.590 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:03.600+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:03.667 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:03.667 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:03.667 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:03.667 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:03.686 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:03:03.689 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:03.700+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:03.715 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:03.715 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:03.738 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:03.738 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:03.771 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:03.791 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:03.800+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:03.795 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:03.795 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:03.823 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:03.823 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:03.823 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:03.823 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:03.823 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:03.824 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:03.824 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:03.843 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:03:03.844 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:03.868 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:03.868 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:03.892 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:03.900+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:03.901 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:03.901 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:03.990 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:03.990 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:03.992 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:04.004+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:04.009 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:03:04.096 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:04.108+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:04.191 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:04.191 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:04.194 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:04.204+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:04.209 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:03:04.296 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:04.308+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:04.351 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:03:04.387 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:04.387 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:04.396 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:04.408+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:04.401 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:04.498 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:04.508+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:04.584 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:04.585 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:04.600 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:04.608+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:04.600 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:04.700 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:04.708+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:04.745 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:04.745 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:04.763 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:04.804 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:04.816+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:04.902 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:04.912+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:04.991 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:04.992 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:05.003 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:05.012+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:05.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:05.104 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:05.112+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:05.166 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:05.166 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:05.186 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:05.236 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:05.248+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:05.306 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:05.316+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:05.337 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:05.338 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:05.358 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:05.406 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:05.416+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:05.507 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:05.516+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:05.538 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:05.538 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:05.559 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:05.608 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:05.620+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:05.699 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:05.699 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:05.700 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-07T14:03:05.700 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-07T14:03:05.700 INFO:tasks.thrashosds.thrasher:Reweighting osd 1 to 0.5340054880707115 2024-05-07T14:03:05.700 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 0.5340054880707115 2024-05-07T14:03:05.709 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:05.720+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:05.722 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:05.809 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:05.820+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:05.909 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:05.909 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:05.910 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:05.920+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:05.928 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:03:05.930 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:06.011 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:06.020+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:06.112 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:06.120+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:06.120 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:06.120 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:06.138 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:06.142 INFO:tasks.workunit.client.0.smithi106.stdout:adding file to bucket: 1Gb. 2024-05-07T14:03:06.142 INFO:tasks.workunit.client.0.smithi106.stdout:upload file successful 2024-05-07T14:03:06.142 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:03:06.142 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - set max size and ensure that the max size is in effect 2024-05-07T14:03:06.142 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:03:06.146 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:06.146 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:06.163 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:06.163 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:06.181 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:06.213 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:06.213 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:06.213 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:06.224+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:06.234 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:06.258 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:06.258 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:06.275 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:06.275 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:06.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:06.276 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:06.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.276 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:283 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:06.276 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:03:06.276 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 119.13039652499999, 2024-05-07T14:03:06.276 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384878, 2024-05-07T14:03:06.276 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.276 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.276 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.277 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.277 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.277 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.277 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 283 2024-05-07T14:03:06.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.277 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.277 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.277 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:03:06.277 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.278 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.278 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157731+0000", 2024-05-07T14:03:06.278 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.278 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.278 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157732+0000", 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9500000000000001e-07 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157745+0000", 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3343000000000001e-05 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157759+0000", 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3715e-05 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.279 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157765+0000", 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6390000000000003e-06 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157820+0000", 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5238999999999997e-05 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.157916+0000", 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5173999999999994e-05 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158078+0000", 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016192299999999999 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.158685+0000", 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00060699799999999998 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161050+0000", 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002365636 2024-05-07T14:03:06.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161087+0000", 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7270000000000001e-05 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.161115+0000", 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8045999999999999e-05 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.283 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:06.283 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:03:06.283 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 118.9958613, 2024-05-07T14:03:06.283 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:03:06.283 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.283 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.283 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.283 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.283 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.283 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.283 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.284 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.286 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:03:06.286 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:03:06.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.286 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.286 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:03:06.286 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:03:06.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.286 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.286 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:03:06.286 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:03:06.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:03:06.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.288 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 118.69816129, 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.290 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:03:06.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.290 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:03:06.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:03:06.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:03:06.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:03:06.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:03:06.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:03:06.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:03:06.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:03:06.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:03:06.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:03:06.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:03:06.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:03:06.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:06.294 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:03:06.294 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 118.518200263, 2024-05-07T14:03:06.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:03:06.294 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.294 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.294 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.294 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.294 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.294 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.294 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:03:06.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.294 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:03:06.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:03:06.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:03:06.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:03:06.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:03:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:03:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:03:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:03:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5099.0:56 7.14 e80/29 7:2b04a3e9:::notify.6:head v 80'36, mlcod=80'34)", 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.108271252, 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046522059999999999, 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1399999999999997e-07 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179862+0000", 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4330000000000003e-06 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179873+0000", 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0838e-05 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179879+0000", 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3099999999999997e-06 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179934+0000", 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4625e-05 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179955+0000", 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-05 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184469+0000", 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045139150000000003 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184508+0000", 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9001000000000001e-05 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5117.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94838143561296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.490856+0000", 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.797270725000001, 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034216759999999998, 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5117", 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/62727776", 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 51 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490856+0000", 2024-05-07T14:03:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490856+0000", 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490857+0000", 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490862+0000", 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3419999999999998e-06 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490871+0000", 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.089e-06 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490875+0000", 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8300000000000003e-06 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490910+0000", 2024-05-07T14:03:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4856e-05 2024-05-07T14:03:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.490955+0000", 2024-05-07T14:03:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5181e-05 2024-05-07T14:03:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.491035+0000", 2024-05-07T14:03:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9542999999999994e-05 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.492688+0000", 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016531130000000001 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.494187+0000", 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014991099999999999 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.494233+0000", 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5676000000000001e-05 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.494278+0000", 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5192999999999999e-05 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5117.0:56 7.14 e81/29 7:2b04a3e9:::notify.6:head v 81'39, mlcod=80'37)", 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.791675412, 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078436700000000005, 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.34e-07 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496456+0000", 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5410000000000001e-06 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496463+0000", 2024-05-07T14:03:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7689999999999996e-06 2024-05-07T14:03:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496468+0000", 2024-05-07T14:03:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1969999999999998e-06 2024-05-07T14:03:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496518+0000", 2024-05-07T14:03:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0793e-05 2024-05-07T14:03:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496538+0000", 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0000000000000002e-05 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504267+0000", 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077288419999999997 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504295+0000", 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8093999999999999e-05 2024-05-07T14:03:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1585 4.2d 4:b60c161e:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897371+0000", 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.390756182000001, 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035527139999999998, 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1585 2024-05-07T14:03:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897371+0000", 2024-05-07T14:03:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897371+0000", 2024-05-07T14:03:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897373+0000", 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2680000000000001e-06 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897382+0000", 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.85e-06 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897402+0000", 2024-05-07T14:03:06.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9732999999999999e-05 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897412+0000", 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0292000000000001e-05 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897477+0000", 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4639000000000002e-05 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897597+0000", 2024-05-07T14:03:06.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120727 2024-05-07T14:03:06.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:06.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897756+0000", 2024-05-07T14:03:06.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015853500000000001 2024-05-07T14:03:06.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898973+0000", 2024-05-07T14:03:06.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012173780000000001 2024-05-07T14:03:06.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900839+0000", 2024-05-07T14:03:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00186578 2024-05-07T14:03:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900890+0000", 2024-05-07T14:03:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0991e-05 2024-05-07T14:03:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900924+0000", 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3521e-05 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:56 7.14 e81/29 7:2b04a3e9:::notify.6:head v 81'48, mlcod=81'46)", 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.127935572, 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039243350000000001, 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6199999999999999e-07 2024-05-07T14:03:06.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160195+0000", 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3569999999999998e-06 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160202+0000", 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8120000000000002e-06 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160207+0000", 2024-05-07T14:03:06.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5390000000000001e-06 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160259+0000", 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2578999999999999e-05 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160279+0000", 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9599999999999999e-05 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164086+0000", 2024-05-07T14:03:06.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038071979999999999 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164116+0000", 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9887999999999999e-05 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1720 4.1c 4:397a1514:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.5.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.365851998, 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041467209999999999, 2024-05-07T14:03:06.328 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1720 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922276+0000", 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4799999999999998e-07 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922280+0000", 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4839999999999998e-06 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922288+0000", 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9610000000000005e-06 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922300+0000", 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1365e-05 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922369+0000", 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9758999999999994e-05 2024-05-07T14:03:06.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922491+0000", 2024-05-07T14:03:06.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121383 2024-05-07T14:03:06.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:06.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922642+0000", 2024-05-07T14:03:06.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015127200000000001 2024-05-07T14:03:06.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.923617+0000", 2024-05-07T14:03:06.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097548299999999997 2024-05-07T14:03:06.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926352+0000", 2024-05-07T14:03:06.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027348170000000001 2024-05-07T14:03:06.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926382+0000", 2024-05-07T14:03:06.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9808e-05 2024-05-07T14:03:06.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926422+0000", 2024-05-07T14:03:06.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9740999999999998e-05 2024-05-07T14:03:06.334 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.334 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.334 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.334 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1922 4.19 e81/23 4:9849ed33:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.8:head v 81'4, mlcod=81'1)", 2024-05-07T14:03:06.334 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:06.334 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 11.890262207999999, 2024-05-07T14:03:06.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005911655, 2024-05-07T14:03:06.334 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8200000000000001e-07 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397869+0000", 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5209999999999998e-06 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397875+0000", 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6599999999999998e-06 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397881+0000", 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1240000000000004e-06 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398179+0000", 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029815899999999999 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398197+0000", 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8133000000000001e-05 2024-05-07T14:03:06.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403738+0000", 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055410950000000002 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403777+0000", 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8581000000000002e-05 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2202 3.0 e84/21 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.0014540379999999, 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020120560999999999, 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286676+0000", 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.57e-06 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291894+0000", 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052185740000000001 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291939+0000", 2024-05-07T14:03:06.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4676999999999999e-05 2024-05-07T14:03:06.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291959+0000", 2024-05-07T14:03:06.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0115999999999998e-05 2024-05-07T14:03:06.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292128+0000", 2024-05-07T14:03:06.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168758 2024-05-07T14:03:06.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292188+0000", 2024-05-07T14:03:06.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0565e-05 2024-05-07T14:03:06.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306607+0000", 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014418733 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306794+0000", 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018656799999999999 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.343 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2204 3.3b e84/21 3:df85b00b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_3:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:06.344 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.312700+0000", 2024-05-07T14:03:06.344 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.9754268910000001, 2024-05-07T14:03:06.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015369649000000001, 2024-05-07T14:03:06.344 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.344 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.344 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.344 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.312700+0000", 2024-05-07T14:03:06.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.312700+0000", 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.312702+0000", 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8279999999999999e-06 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319174+0000", 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064721049999999997 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319227+0000", 2024-05-07T14:03:06.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2670000000000002e-05 2024-05-07T14:03:06.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319255+0000", 2024-05-07T14:03:06.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7923e-05 2024-05-07T14:03:06.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319409+0000", 2024-05-07T14:03:06.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015399200000000001 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319455+0000", 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6726e-05 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.327989+0000", 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0085333779999999994 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.328070+0000", 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1026999999999995e-05 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2211 3.13 3:cbf4b364:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.389539+0000", 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.89858832, 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015047895, 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.348 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2211 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.389539+0000", 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.389539+0000", 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.389541+0000", 2024-05-07T14:03:06.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2709999999999999e-06 2024-05-07T14:03:06.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392129+0000", 2024-05-07T14:03:06.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002587719 2024-05-07T14:03:06.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392163+0000", 2024-05-07T14:03:06.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3714999999999998e-05 2024-05-07T14:03:06.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392178+0000", 2024-05-07T14:03:06.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5132e-05 2024-05-07T14:03:06.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392251+0000", 2024-05-07T14:03:06.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3743000000000002e-05 2024-05-07T14:03:06.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392368+0000", 2024-05-07T14:03:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011705 2024-05-07T14:03:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392465+0000", 2024-05-07T14:03:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6836000000000006e-05 2024-05-07T14:03:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.399912+0000", 2024-05-07T14:03:06.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0074468069999999997 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.404505+0000", 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045928840000000002 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.404540+0000", 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5485000000000003e-05 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.404587+0000", 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6252999999999999e-05 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2216 3.21 3:86b25102:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.820023714, 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017498730000000001, 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.354 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2216 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468107+0000", 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5980000000000001e-06 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471311+0000", 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003203811 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471360+0000", 2024-05-07T14:03:06.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9100000000000001e-05 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471383+0000", 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3289e-05 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471551+0000", 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167295 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471932+0000", 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038136799999999998 2024-05-07T14:03:06.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:06.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472296+0000", 2024-05-07T14:03:06.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036396200000000001 2024-05-07T14:03:06.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.481648+0000", 2024-05-07T14:03:06.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093518209999999997 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485379+0000", 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037311919999999999 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485533+0000", 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015429500000000001 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485602+0000", 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8998999999999994e-05 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2217 3.0 e84/21 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.7948072509999999, 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016624692, 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.360 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493322+0000", 2024-05-07T14:03:06.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7290000000000001e-06 2024-05-07T14:03:06.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496239+0000", 2024-05-07T14:03:06.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029177949999999999 2024-05-07T14:03:06.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496292+0000", 2024-05-07T14:03:06.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2769999999999998e-05 2024-05-07T14:03:06.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496318+0000", 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6313e-05 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496471+0000", 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015206799999999999 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496540+0000", 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9598999999999996e-05 2024-05-07T14:03:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509870+0000", 2024-05-07T14:03:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013330322 2024-05-07T14:03:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509945+0000", 2024-05-07T14:03:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4096000000000003e-05 2024-05-07T14:03:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2226 3.4 e84/21 3:20f3de0c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_25:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.625448+0000", 2024-05-07T14:03:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.6626794350000003, 2024-05-07T14:03:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010656673, 2024-05-07T14:03:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625448+0000", 2024-05-07T14:03:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625448+0000", 2024-05-07T14:03:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625450+0000", 2024-05-07T14:03:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8780000000000001e-06 2024-05-07T14:03:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.626982+0000", 2024-05-07T14:03:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015321359999999999 2024-05-07T14:03:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.627007+0000", 2024-05-07T14:03:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4949000000000001e-05 2024-05-07T14:03:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.627019+0000", 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2703e-05 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.627122+0000", 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010307 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.627145+0000", 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2875e-05 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636031+0000", 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088859860000000002 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636104+0000", 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3076000000000003e-05 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2231 3.2e 3:767c3375:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.681942+0000", 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.6061849380000002, 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015025999, 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2231 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.681942+0000", 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.681942+0000", 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.681945+0000", 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0630000000000002e-06 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683651+0000", 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001705694 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683682+0000", 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1288000000000003e-05 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683700+0000", 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7756000000000001e-05 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683790+0000", 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9573000000000005e-05 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683956+0000", 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016630400000000001 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684044+0000", 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8369999999999996e-05 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.688963+0000", 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049188510000000001 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.696874+0000", 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0079104099999999997 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.696918+0000", 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4456000000000003e-05 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.696968+0000", 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0234e-05 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2238 3.2e 3:76550f67:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.757297+0000", 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.5308298540000003, 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01394517, 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2238 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.757297+0000", 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.757297+0000", 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.757299+0000", 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1220000000000002e-06 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759025+0000", 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017252120000000001 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759047+0000", 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2796e-05 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759060+0000", 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3033e-05 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759135+0000", 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4141999999999996e-05 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759245+0000", 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000110404 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759381+0000", 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013557599999999999 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.765117+0000", 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057365130000000004 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.771109+0000", 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005992191 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.771185+0000", 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5972999999999999e-05 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.771242+0000", 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7207999999999998e-05 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5862.0:56 7.14 e85/29 7:2b04a3e9:::notify.6:head v 85'90, mlcod=82'88)", 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.263489+0000", 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.024637791999999999, 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056112230000000003, 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263489+0000", 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263489+0000", 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263490+0000", 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4099999999999999e-07 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263493+0000", 2024-05-07T14:03:06.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0340000000000001e-06 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263499+0000", 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2269999999999998e-06 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263504+0000", 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8010000000000003e-06 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263682+0000", 2024-05-07T14:03:06.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017840999999999999 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263701+0000", 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8870999999999999e-05 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269073+0000", 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053717490000000003 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269101+0000", 2024-05-07T14:03:06.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7690000000000001e-05 2024-05-07T14:03:06.385 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.385 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.385 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.385 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.385 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.385 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:06.385 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:03:06.386 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:06.387 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:06.388 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:06.388 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:06.389 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:06.389 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.1 to 0.534005 (88b4) 2024-05-07T14:03:06.390 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:06.400+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:06.496 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:06.508+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:06.559 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:06.559 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:06.559 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:06.559 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:06.572 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:06.620 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:06.632+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:06.689 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:06.700+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:06.741 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:06.741 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:06.741 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:06.741 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:06.741 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:06.753 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:06.800 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:06.812+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:06.877 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:06.877 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:06.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:06.877 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:06.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.877 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:03:06.877 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:03:06.878 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 124.885387087, 2024-05-07T14:03:06.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:03:06.878 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.878 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.878 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:06.878 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.878 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.878 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.878 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:03:06.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.878 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:03:06.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:03:06.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:03:06.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:06.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:03:06.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:03:06.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:03:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:03:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:03:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:03:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 119.864983267, 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:03:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:03:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:480 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 119.646299396, 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052104459999999997, 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 480 2024-05-07T14:03:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:03:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241565+0000", 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6199999999999997e-07 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241570+0000", 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2479999999999998e-06 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241580+0000", 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8719999999999997e-06 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241584+0000", 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7210000000000002e-06 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241629+0000", 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4465000000000002e-05 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241671+0000", 2024-05-07T14:03:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2370999999999998e-05 2024-05-07T14:03:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.241772+0000", 2024-05-07T14:03:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101048 2024-05-07T14:03:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.243876+0000", 2024-05-07T14:03:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021036789999999998 2024-05-07T14:03:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246710+0000", 2024-05-07T14:03:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028339060000000002 2024-05-07T14:03:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246747+0000", 2024-05-07T14:03:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7061000000000003e-05 2024-05-07T14:03:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.246775+0000", 2024-05-07T14:03:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8413000000000001e-05 2024-05-07T14:03:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5099.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:03:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.708499076000001, 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053287550000000001, 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5099", 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2788980923", 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:03:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179366+0000", 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7299999999999996e-07 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179368+0000", 2024-05-07T14:03:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7879999999999998e-06 2024-05-07T14:03:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179378+0000", 2024-05-07T14:03:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8870000000000004e-06 2024-05-07T14:03:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179384+0000", 2024-05-07T14:03:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3009999999999997e-06 2024-05-07T14:03:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179438+0000", 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4731000000000002e-05 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179515+0000", 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6817999999999995e-05 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179637+0000", 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122197 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.181699+0000", 2024-05-07T14:03:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020617000000000001 2024-05-07T14:03:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184620+0000", 2024-05-07T14:03:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029204999999999999 2024-05-07T14:03:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184651+0000", 2024-05-07T14:03:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1267999999999999e-05 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184694+0000", 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2991999999999998e-05 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1477 3.18 3:1a16f065:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.602381744000001, 2024-05-07T14:03:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017437234999999999, 2024-05-07T14:03:06.902 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.902 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.902 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.902 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.902 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.902 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.902 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1477 2024-05-07T14:03:06.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.902 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:03:06.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285485+0000", 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.148e-06 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287428+0000", 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001943391 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287451+0000", 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2912e-05 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287464+0000", 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2758000000000001e-05 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287530+0000", 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6544999999999994e-05 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287643+0000", 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011307900000000001 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287732+0000", 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8640999999999994e-05 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.300987+0000", 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013255052999999999 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302819+0000", 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001831533 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302874+0000", 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5946000000000003e-05 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302920+0000", 2024-05-07T14:03:06.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5228999999999997e-05 2024-05-07T14:03:06.907 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.907 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.907 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.907 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:06.907 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:06.907 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.583119678999999, 2024-05-07T14:03:06.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:03:06.907 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.908 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.908 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.908 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.908 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.908 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.908 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:03:06.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.908 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:06.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:06.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:03:06.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:03:06.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:03:06.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:03:06.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:03:06.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:03:06.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:03:06.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:03:06.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:03:06.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:03:06.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:03:06.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:03:06.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:03:06.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:03:06.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:03:06.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5117.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.391876793, 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008462018, 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.915 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5117", 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/62727776", 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:03:06.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495988+0000", 2024-05-07T14:03:06.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999999e-07 2024-05-07T14:03:06.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495990+0000", 2024-05-07T14:03:06.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.765e-06 2024-05-07T14:03:06.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495995+0000", 2024-05-07T14:03:06.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3499999999999996e-06 2024-05-07T14:03:06.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495998+0000", 2024-05-07T14:03:06.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3739999999999998e-06 2024-05-07T14:03:06.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496050+0000", 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2015999999999998e-05 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496120+0000", 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9373000000000001e-05 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496224+0000", 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010395699999999999 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.501395+0000", 2024-05-07T14:03:06.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051715090000000003 2024-05-07T14:03:06.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504399+0000", 2024-05-07T14:03:06.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030035930000000001 2024-05-07T14:03:06.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504428+0000", 2024-05-07T14:03:06.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:03:06.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504449+0000", 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1608e-05 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1485 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=14b,call rgw.obj_remove in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.267137963, 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056592079999999998, 2024-05-07T14:03:06.921 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.922 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.922 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.922 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.922 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.922 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.922 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1485 2024-05-07T14:03:06.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.922 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.922 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.922 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:03:06.922 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620728+0000", 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.457e-06 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.923 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620734+0000", 2024-05-07T14:03:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0460000000000002e-06 2024-05-07T14:03:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620749+0000", 2024-05-07T14:03:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5067e-05 2024-05-07T14:03:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620758+0000", 2024-05-07T14:03:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6989999999999992e-06 2024-05-07T14:03:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620819+0000", 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1496999999999998e-05 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620880+0000", 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0908e-05 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.621007+0000", 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000127551 2024-05-07T14:03:06.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.622196+0000", 2024-05-07T14:03:06.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001188391 2024-05-07T14:03:06.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626306+0000", 2024-05-07T14:03:06.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041097779999999997 2024-05-07T14:03:06.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626357+0000", 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0936999999999997e-05 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626385+0000", 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8877000000000002e-05 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1920 4.0 4:03a7a160:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:03:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.49150848, 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055799400000000002, 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1920 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:03:06.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.89e-07 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396360+0000", 2024-05-07T14:03:06.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.284e-06 2024-05-07T14:03:06.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396368+0000", 2024-05-07T14:03:06.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8769999999999993e-06 2024-05-07T14:03:06.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.930 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.930 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396374+0000", 2024-05-07T14:03:06.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2480000000000004e-06 2024-05-07T14:03:06.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396652+0000", 2024-05-07T14:03:06.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027788900000000002 2024-05-07T14:03:06.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396724+0000", 2024-05-07T14:03:06.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2391000000000005e-05 2024-05-07T14:03:06.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.931 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:06.931 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397033+0000", 2024-05-07T14:03:06.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030929299999999998 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398442+0000", 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001409062 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401881+0000", 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034388639999999998 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401909+0000", 2024-05-07T14:03:06.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7716e-05 2024-05-07T14:03:06.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401936+0000", 2024-05-07T14:03:06.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6826999999999999e-05 2024-05-07T14:03:06.933 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.933 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.933 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.933 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1922 4.19 4:9849ed33:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.491473816999999, 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0075306310000000003, 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1922 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:03:06.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:03:06.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396391+0000", 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.46e-07 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396393+0000", 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3250000000000002e-06 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396400+0000", 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9190000000000002e-06 2024-05-07T14:03:06.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396405+0000", 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2839999999999997e-06 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396919+0000", 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00051340499999999998 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396988+0000", 2024-05-07T14:03:06.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8775999999999993e-05 2024-05-07T14:03:06.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:06.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397099+0000", 2024-05-07T14:03:06.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111239 2024-05-07T14:03:06.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398350+0000", 2024-05-07T14:03:06.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001250735 2024-05-07T14:03:06.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403874+0000", 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005524307 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403900+0000", 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6499000000000002e-05 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403921+0000", 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0696e-05 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.939 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2203 3.1e 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.5934033350000001, 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029129142, 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.940 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2203 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294465+0000", 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7699999999999999e-06 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300328+0000", 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058633460000000002 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300384+0000", 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6212999999999999e-05 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300411+0000", 2024-05-07T14:03:06.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7109000000000001e-05 2024-05-07T14:03:06.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300586+0000", 2024-05-07T14:03:06.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017478799999999999 2024-05-07T14:03:06.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300941+0000", 2024-05-07T14:03:06.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035515500000000001 2024-05-07T14:03:06.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301351+0000", 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040996099999999997 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.317495+0000", 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016143462000000001 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323421+0000", 2024-05-07T14:03:06.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059264649999999997 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323498+0000", 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6478999999999997e-05 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323590+0000", 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2393999999999997e-05 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2205 3.28 e84/21 3:177ebb78:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_4:head v 84'4, mlcod=80'2)", 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.327037+0000", 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.5608271760000001, 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014954187000000001, 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.327037+0000", 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.327037+0000", 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.327039+0000", 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333502+0000", 2024-05-07T14:03:06.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064627169999999998 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333536+0000", 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4576000000000002e-05 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333556+0000", 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9911999999999998e-05 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333648+0000", 2024-05-07T14:03:06.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1886999999999996e-05 2024-05-07T14:03:06.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333674+0000", 2024-05-07T14:03:06.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6562000000000001e-05 2024-05-07T14:03:06.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.341878+0000", 2024-05-07T14:03:06.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082039850000000004 2024-05-07T14:03:06.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.341991+0000", 2024-05-07T14:03:06.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112778 2024-05-07T14:03:06.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.950 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.950 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2210 3.28 e84/21 3:157bdd2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_9:head v 84'5, mlcod=80'3)", 2024-05-07T14:03:06.950 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.373804+0000", 2024-05-07T14:03:06.950 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.5140606439999997, 2024-05-07T14:03:06.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010808760000000001, 2024-05-07T14:03:06.950 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.373804+0000", 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.373804+0000", 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.373805+0000", 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5489999999999999e-06 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378137+0000", 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043320640000000001 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378161+0000", 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.34e-05 2024-05-07T14:03:06.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378170+0000", 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4180000000000003e-06 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378234+0000", 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4386000000000003e-05 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378253+0000", 2024-05-07T14:03:06.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8542999999999998e-05 2024-05-07T14:03:06.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.384569+0000", 2024-05-07T14:03:06.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063162670000000004 2024-05-07T14:03:06.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.384612+0000", 2024-05-07T14:03:06.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3133000000000002e-05 2024-05-07T14:03:06.954 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.954 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.954 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2214 3.33 3:cdc86525:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.436823+0000", 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.4510416519999998, 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014331511999999999, 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2214 2024-05-07T14:03:06.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.956 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.436823+0000", 2024-05-07T14:03:06.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.436823+0000", 2024-05-07T14:03:06.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.436826+0000", 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7670000000000001e-06 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.439818+0000", 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029918359999999999 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.439858+0000", 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9830999999999999e-05 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.439874+0000", 2024-05-07T14:03:06.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6328e-05 2024-05-07T14:03:06.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.439978+0000", 2024-05-07T14:03:06.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103491 2024-05-07T14:03:06.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.440163+0000", 2024-05-07T14:03:06.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018528800000000001 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.440321+0000", 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015804099999999999 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.448904+0000", 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0085825020000000005 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.451028+0000", 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002124014 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.451101+0000", 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3802999999999998e-05 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.451154+0000", 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2611000000000002e-05 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2228 3.b 3:d3d17a37:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.649134+0000", 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.2387298910000002, 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012981072, 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2228 2024-05-07T14:03:06.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.649134+0000", 2024-05-07T14:03:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.649134+0000", 2024-05-07T14:03:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.649137+0000", 2024-05-07T14:03:06.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7269999999999999e-06 2024-05-07T14:03:06.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.650871+0000", 2024-05-07T14:03:06.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001733928 2024-05-07T14:03:06.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.650902+0000", 2024-05-07T14:03:06.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1245000000000003e-05 2024-05-07T14:03:06.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.650929+0000", 2024-05-07T14:03:06.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6999999999999999e-05 2024-05-07T14:03:06.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.651003+0000", 2024-05-07T14:03:06.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3860000000000001e-05 2024-05-07T14:03:06.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.651154+0000", 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015102799999999999 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.651272+0000", 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117798 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661672+0000", 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010399920999999999 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.662002+0000", 2024-05-07T14:03:06.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033048099999999998 2024-05-07T14:03:06.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.662066+0000", 2024-05-07T14:03:06.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3663000000000004e-05 2024-05-07T14:03:06.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.662115+0000", 2024-05-07T14:03:06.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9421e-05 2024-05-07T14:03:06.966 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.967 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.967 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.967 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2230 3.b 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:06.967 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:06.967 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.2174966650000001, 2024-05-07T14:03:06.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021351564, 2024-05-07T14:03:06.967 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.967 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.967 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.967 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.967 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2230 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670370+0000", 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5050000000000002e-06 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673214+0000", 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028441260000000002 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673245+0000", 2024-05-07T14:03:06.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0488999999999999e-05 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673259+0000", 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4443e-05 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673356+0000", 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7031e-05 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673531+0000", 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017509099999999999 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673696+0000", 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000164306 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684776+0000", 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011080054000000001 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691578+0000", 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068025849999999999 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691659+0000", 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0976000000000005e-05 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691719+0000", 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9957999999999998e-05 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.972 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2233 3.8 3:11b98425:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.703282+0000", 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.1845820699999998, 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013715266, 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2233 2024-05-07T14:03:06.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.703282+0000", 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.703282+0000", 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.703285+0000", 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4420000000000001e-06 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705019+0000", 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00173413 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705045+0000", 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6553000000000001e-05 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705057+0000", 2024-05-07T14:03:06.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2089000000000001e-05 2024-05-07T14:03:06.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705144+0000", 2024-05-07T14:03:06.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6330999999999997e-05 2024-05-07T14:03:06.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705327+0000", 2024-05-07T14:03:06.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018284400000000001 2024-05-07T14:03:06.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705488+0000", 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161175 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716311+0000", 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010823732000000001 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716869+0000", 2024-05-07T14:03:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00055720900000000002 2024-05-07T14:03:06.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716945+0000", 2024-05-07T14:03:06.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6038000000000006e-05 2024-05-07T14:03:06.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716997+0000", 2024-05-07T14:03:06.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2723000000000003e-05 2024-05-07T14:03:06.978 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.978 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.978 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2234 3.c e84/21 3:313f4c71:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_33:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.719287+0000", 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.168577317, 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010877421999999999, 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.719287+0000", 2024-05-07T14:03:06.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.719287+0000", 2024-05-07T14:03:06.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.719288+0000", 2024-05-07T14:03:06.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4399999999999999e-07 2024-05-07T14:03:06.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723259+0000", 2024-05-07T14:03:06.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039712230000000003 2024-05-07T14:03:06.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723288+0000", 2024-05-07T14:03:06.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9603000000000001e-05 2024-05-07T14:03:06.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723314+0000", 2024-05-07T14:03:06.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5882000000000001e-05 2024-05-07T14:03:06.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723397+0000", 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2337999999999997e-05 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723426+0000", 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663999999999999e-05 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.730114+0000", 2024-05-07T14:03:06.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0066872659999999999 2024-05-07T14:03:06.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.730164+0000", 2024-05-07T14:03:06.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0701999999999997e-05 2024-05-07T14:03:06.983 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.983 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.983 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2241 3.19 e84/21 3:9b9246d1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_40:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.789069+0000", 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.0987956329999999, 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0096171769999999993, 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.789069+0000", 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.789069+0000", 2024-05-07T14:03:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.789070+0000", 2024-05-07T14:03:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.466e-06 2024-05-07T14:03:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790431+0000", 2024-05-07T14:03:06.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013607999999999999 2024-05-07T14:03:06.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790458+0000", 2024-05-07T14:03:06.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6823000000000001e-05 2024-05-07T14:03:06.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790472+0000", 2024-05-07T14:03:06.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4059999999999999e-05 2024-05-07T14:03:06.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790554+0000", 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1839e-05 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790582+0000", 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8388999999999999e-05 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.798616+0000", 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080345199999999999 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.798686+0000", 2024-05-07T14:03:06.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9280000000000001e-05 2024-05-07T14:03:06.988 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.988 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.988 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.988 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5862.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-07T14:03:06.988 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.263138+0000", 2024-05-07T14:03:06.988 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.62472626399999998, 2024-05-07T14:03:06.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061089910000000002, 2024-05-07T14:03:06.988 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5862", 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/3537699870", 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263138+0000", 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:06.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263138+0000", 2024-05-07T14:03:06.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:06.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:06.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263139+0000", 2024-05-07T14:03:06.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9500000000000002e-07 2024-05-07T14:03:06.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:06.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263141+0000", 2024-05-07T14:03:06.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8439999999999998e-06 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263150+0000", 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7700000000000007e-06 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263156+0000", 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8189999999999997e-06 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:06.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263211+0000", 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5340999999999998e-05 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263285+0000", 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3206000000000003e-05 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263402+0000", 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011738100000000001 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.266447+0000", 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030453519999999999 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269193+0000", 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002745571 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269222+0000", 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9329999999999999e-05 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:06.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:06.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269247+0000", 2024-05-07T14:03:06.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4681999999999998e-05 2024-05-07T14:03:06.994 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.994 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.994 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.994 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:06.994 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:06.994 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:06.996 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:06.996 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:07.008+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:07.097 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:07.108+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:07.124 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:07.125 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:07.125 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:07.125 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:07.139 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:07.197 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:07.208+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:07.261 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:07.262 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:07.275 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:07.320 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:07.332+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:07.381 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:03:07.407 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:07.412+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:07.467 INFO:tasks.workunit.client.0.smithi106.stdout:user qa_user deleted 2024-05-07T14:03:07.467 INFO:tasks.workunit.client.0.smithi106.stdout:bucket delete succeeded 2024-05-07T14:03:07.475 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:07.475 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 125.49291284100001, 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070064749999999999, 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 43 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.476 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994274+0000", 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7170000000000002e-06 2024-05-07T14:03:07.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994292+0000", 2024-05-07T14:03:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7819999999999999e-05 2024-05-07T14:03:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994338+0000", 2024-05-07T14:03:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6625999999999997e-05 2024-05-07T14:03:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994362+0000", 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4063e-05 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994576+0000", 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021319500000000001 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994598+0000", 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2325999999999999e-05 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001023+0000", 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00642546 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001277+0000", 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025326800000000002 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1566 4.13 4:cabacdb3:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.814294555, 2024-05-07T14:03:07.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057730890000000003, 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1566 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:03:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672890+0000", 2024-05-07T14:03:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.606e-06 2024-05-07T14:03:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672898+0000", 2024-05-07T14:03:07.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-06 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672924+0000", 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5599999999999999e-05 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672942+0000", 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7799999999999999e-05 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673078+0000", 2024-05-07T14:03:07.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013645399999999999 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673280+0000", 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020144999999999999 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673597+0000", 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031715200000000002 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.675496+0000", 2024-05-07T14:03:07.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018996830000000001 2024-05-07T14:03:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678466+0000", 2024-05-07T14:03:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029693639999999999 2024-05-07T14:03:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678562+0000", 2024-05-07T14:03:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6614999999999996e-05 2024-05-07T14:03:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678661+0000", 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9024999999999995e-05 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1568 4.3d 4:bd9d380d:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.814199513, 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059901989999999999, 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.486 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1568 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:03:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672985+0000", 2024-05-07T14:03:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-05-07T14:03:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672992+0000", 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7229999999999998e-06 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673011+0000", 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9700000000000001e-05 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673026+0000", 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4506e-05 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674436+0000", 2024-05-07T14:03:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001410445 2024-05-07T14:03:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674635+0000", 2024-05-07T14:03:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019898299999999999 2024-05-07T14:03:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674957+0000", 2024-05-07T14:03:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032126499999999999 2024-05-07T14:03:07.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.676898+0000", 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019413989999999999 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678780+0000", 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018816880000000001 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678912+0000", 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013280799999999999 2024-05-07T14:03:07.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678974+0000", 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1192000000000006e-05 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1570 4.1b 4:db659863:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.814133913999999, 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059406459999999999, 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.492 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1570 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:03:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673050+0000", 2024-05-07T14:03:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1230000000000001e-06 2024-05-07T14:03:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673056+0000", 2024-05-07T14:03:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5639999999999996e-06 2024-05-07T14:03:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673073+0000", 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7751999999999999e-05 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673086+0000", 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2656999999999999e-05 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674276+0000", 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011896350000000001 2024-05-07T14:03:07.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674479+0000", 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020363600000000001 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674757+0000", 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027776599999999998 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677473+0000", 2024-05-07T14:03:07.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027157739999999998 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678813+0000", 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013401120000000001 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678931+0000", 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118322 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678990+0000", 2024-05-07T14:03:07.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8304999999999998e-05 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1572 4.13 4:c90a81ac:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.814077928, 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062582080000000003, 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:07.498 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1572 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673106+0000", 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0729999999999999e-06 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673111+0000", 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3070000000000002e-06 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673129+0000", 2024-05-07T14:03:07.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673143+0000", 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3579e-05 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674380+0000", 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001237908 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674578+0000", 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000197617 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674864+0000", 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028589499999999999 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678694+0000", 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038299900000000001 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679226+0000", 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053176199999999997 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679299+0000", 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3658000000000005e-05 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679363+0000", 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3816e-05 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.503 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1612 3.3 3:c1191b65:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.064292763999999, 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013953758, 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:07.504 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1612 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422894+0000", 2024-05-07T14:03:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3400000000000002e-06 2024-05-07T14:03:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426732+0000", 2024-05-07T14:03:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386760000000001 2024-05-07T14:03:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426772+0000", 2024-05-07T14:03:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9740000000000002e-05 2024-05-07T14:03:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426791+0000", 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426935+0000", 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144368 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.427196+0000", 2024-05-07T14:03:07.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026091599999999998 2024-05-07T14:03:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.427426+0000", 2024-05-07T14:03:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022962899999999999 2024-05-07T14:03:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.434735+0000", 2024-05-07T14:03:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073090990000000003 2024-05-07T14:03:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436629+0000", 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018938640000000001 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436721+0000", 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1943999999999999e-05 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436844+0000", 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012338900000000001 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.509 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1614 3.1d e81/21 3:baaad814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4_10Mb.:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.037043465, 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013565693, 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:03:07.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450142+0000", 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3970000000000001e-06 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453081+0000", 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029395100000000002 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453123+0000", 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1356000000000002e-05 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453142+0000", 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453311+0000", 2024-05-07T14:03:07.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016885700000000001 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453349+0000", 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8033e-05 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.463599+0000", 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010250011 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.463705+0000", 2024-05-07T14:03:07.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000105839 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2206 3.f e84/21 3:f1007ae4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_5:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.334366+0000", 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1528169740000003, 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013342471999999999, 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334366+0000", 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334366+0000", 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334368+0000", 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9860000000000001e-06 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337428+0000", 2024-05-07T14:03:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030598969999999998 2024-05-07T14:03:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337456+0000", 2024-05-07T14:03:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8153999999999998e-05 2024-05-07T14:03:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337470+0000", 2024-05-07T14:03:07.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4446e-05 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337559+0000", 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8144000000000002e-05 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337592+0000", 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3284999999999997e-05 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347590+0000", 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0099978580000000001 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347708+0000", 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118702 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2209 3.a e84/21 3:51944b39:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_8:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.362568+0000", 2024-05-07T14:03:07.518 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.1246151160000002, 2024-05-07T14:03:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010524235999999999, 2024-05-07T14:03:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362568+0000", 2024-05-07T14:03:07.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362568+0000", 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362569+0000", 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3e-07 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365334+0000", 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027652950000000001 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365371+0000", 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6946999999999997e-05 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365395+0000", 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4451999999999999e-05 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365495+0000", 2024-05-07T14:03:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100227 2024-05-07T14:03:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365521+0000", 2024-05-07T14:03:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5211999999999998e-05 2024-05-07T14:03:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373033+0000", 2024-05-07T14:03:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0075124399999999996 2024-05-07T14:03:07.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373092+0000", 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8933e-05 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2211 3.13 e84/46 3:cbf4b364:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_10:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.392442+0000", 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.0947409549999998, 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011680088, 2024-05-07T14:03:07.523 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.392442+0000", 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.392442+0000", 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.392444+0000", 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7659999999999999e-06 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396574+0000", 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041300080000000001 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396606+0000", 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2503999999999999e-05 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396619+0000", 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3138e-05 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396720+0000", 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100987 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396749+0000", 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8520000000000001e-05 2024-05-07T14:03:07.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.403988+0000", 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072395979999999999 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.404122+0000", 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013356699999999999 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.527 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2212 3.1a 3:591da10a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.409463+0000", 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.0777198559999999, 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018426962000000002, 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2212 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.409463+0000", 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.409463+0000", 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.409466+0000", 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8569999999999999e-06 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414439+0000", 2024-05-07T14:03:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049734410000000003 2024-05-07T14:03:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414466+0000", 2024-05-07T14:03:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6675000000000001e-05 2024-05-07T14:03:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414479+0000", 2024-05-07T14:03:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3047999999999999e-05 2024-05-07T14:03:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414548+0000", 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8536999999999998e-05 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414652+0000", 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010464800000000001 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414741+0000", 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8438999999999998e-05 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.421987+0000", 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072459000000000004 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427801+0000", 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058140140000000002 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427845+0000", 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3973000000000001e-05 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427890+0000", 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5429999999999997e-05 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2220 3.11 e84/21 3:8b7a5ffd:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_19:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.540816+0000", 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.9463665040000002, 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016537718999999999, 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.533 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.534 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.534 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540816+0000", 2024-05-07T14:03:07.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540816+0000", 2024-05-07T14:03:07.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540818+0000", 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0600000000000002e-06 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.543930+0000", 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031115299999999999 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.543973+0000", 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2932999999999997e-05 2024-05-07T14:03:07.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.543998+0000", 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5372999999999999e-05 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.544132+0000", 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013406799999999999 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.544189+0000", 2024-05-07T14:03:07.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7086000000000002e-05 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557266+0000", 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013076050000000001 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557354+0000", 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8619e-05 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.538 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2221 3.f e84/21 3:f1cd2e50:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_20:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:07.538 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.551236+0000", 2024-05-07T14:03:07.538 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.9359472269999998, 2024-05-07T14:03:07.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018398247, 2024-05-07T14:03:07.538 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.538 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.538 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.538 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551236+0000", 2024-05-07T14:03:07.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551236+0000", 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551239+0000", 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9799999999999998e-06 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555622+0000", 2024-05-07T14:03:07.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043834360000000001 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555671+0000", 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8723000000000001e-05 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555698+0000", 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7569999999999999e-05 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555854+0000", 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015590100000000001 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555910+0000", 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5408999999999998e-05 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.569455+0000", 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013545587 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.569634+0000", 2024-05-07T14:03:07.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000178641 2024-05-07T14:03:07.542 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.542 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.542 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.542 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2223 3.14 3:28bf4dd4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:07.542 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.577681+0000", 2024-05-07T14:03:07.542 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.9095016299999998, 2024-05-07T14:03:07.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020170006000000001, 2024-05-07T14:03:07.542 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2223 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.577681+0000", 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.577681+0000", 2024-05-07T14:03:07.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.577684+0000", 2024-05-07T14:03:07.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0259999999999999e-06 2024-05-07T14:03:07.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582465+0000", 2024-05-07T14:03:07.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047803910000000002 2024-05-07T14:03:07.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582502+0000", 2024-05-07T14:03:07.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6999999999999998e-05 2024-05-07T14:03:07.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582520+0000", 2024-05-07T14:03:07.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8586000000000001e-05 2024-05-07T14:03:07.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582667+0000", 2024-05-07T14:03:07.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014653499999999999 2024-05-07T14:03:07.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582958+0000", 2024-05-07T14:03:07.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029067600000000002 2024-05-07T14:03:07.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:07.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.583255+0000", 2024-05-07T14:03:07.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000297492 2024-05-07T14:03:07.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.593083+0000", 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0098283789999999999 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.597564+0000", 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044806580000000002 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.597727+0000", 2024-05-07T14:03:07.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000163175 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.597851+0000", 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012408800000000001 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2224 3.1a 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.8988390160000002, 2024-05-07T14:03:07.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027796929000000001, 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2224 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588348+0000", 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1629999999999998e-06 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594043+0000", 2024-05-07T14:03:07.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056948950000000002 2024-05-07T14:03:07.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594085+0000", 2024-05-07T14:03:07.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1678999999999999e-05 2024-05-07T14:03:07.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594113+0000", 2024-05-07T14:03:07.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:03:07.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594221+0000", 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107371 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594405+0000", 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018468099999999999 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594570+0000", 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165224 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.603655+0000", 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090846550000000005 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.615968+0000", 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012313199 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616069+0000", 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100309 2024-05-07T14:03:07.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616141+0000", 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2218999999999994e-05 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2227 3.1b e84/21 3:d8b15ce8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_26:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.643694+0000", 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.8434893529999998, 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013539658, 2024-05-07T14:03:07.554 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.643694+0000", 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.643694+0000", 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.643696+0000", 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3800000000000001e-06 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648290+0000", 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045940709999999999 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648329+0000", 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9242999999999997e-05 2024-05-07T14:03:07.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648347+0000", 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7382999999999999e-05 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648486+0000", 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138918 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648526+0000", 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0589000000000001e-05 2024-05-07T14:03:07.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.657101+0000", 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085746859999999998 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.657233+0000", 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013238799999999999 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2229 3.3 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.8275424879999997, 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028304669000000001, 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2229 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659643+0000", 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9129999999999999e-06 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664151+0000", 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045081189999999997 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664198+0000", 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6431999999999999e-05 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664223+0000", 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5369999999999999e-05 2024-05-07T14:03:07.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664313+0000", 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345999999999995e-05 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664428+0000", 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115058 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664566+0000", 2024-05-07T14:03:07.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138598 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.671674+0000", 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071074529999999997 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687772+0000", 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016098359 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687871+0000", 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9098000000000006e-05 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687945+0000", 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3923000000000004e-05 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2232 3.2c e84/21 3:35867d96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_31:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.697707+0000", 2024-05-07T14:03:07.564 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.789476106, 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012234913, 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697707+0000", 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697707+0000", 2024-05-07T14:03:07.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697709+0000", 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0499999999999999e-06 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700047+0000", 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023379669999999998 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700091+0000", 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000003e-05 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700117+0000", 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5666000000000001e-05 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700222+0000", 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010563199999999999 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700249+0000", 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6582000000000001e-05 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.709888+0000", 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096386600000000003 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.709942+0000", 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4206000000000002e-05 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.568 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2235 3.f e84/21 3:f0588e63:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_34:head v 84'3, mlcod=84'1)", 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.729612+0000", 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.7575712480000001, 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011033015, 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.729612+0000", 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.729612+0000", 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.729613+0000", 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5340000000000001e-06 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731461+0000", 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001847301 2024-05-07T14:03:07.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731489+0000", 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8354e-05 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731503+0000", 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4623999999999999e-05 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731593+0000", 2024-05-07T14:03:07.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9098999999999995e-05 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731623+0000", 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0627999999999999e-05 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.740594+0000", 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089709620000000007 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.740645+0000", 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0513000000000002e-05 2024-05-07T14:03:07.572 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2243 3.1a 3:5a1260ab:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.807487+0000", 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.6796954660000001, 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015577779, 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:07.573 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2243 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.807487+0000", 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.807487+0000", 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.807503+0000", 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5214e-05 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811441+0000", 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039383059999999999 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811457+0000", 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6095000000000001e-05 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811466+0000", 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9670000000000007e-06 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811522+0000", 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5461000000000003e-05 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811636+0000", 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011476600000000001 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811733+0000", 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6234000000000001e-05 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.817874+0000", 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061410500000000003 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.822886+0000", 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050127909999999999 2024-05-07T14:03:07.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.822982+0000", 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5681999999999996e-05 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823065+0000", 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3213000000000004e-05 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:07.578 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:07.579 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:07.580 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:07.580 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:07.588+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:07.681 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:07.692+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:07.748 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:07.748 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:07.748 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:07.748 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:07.762 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:07.807 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:07.816+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:07.886 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:07.892+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:07.932 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:07.933 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:07.933 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:07.933 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:07.933 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:07.946 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:03:07.990 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:08.000+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:08.085 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:08.096+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:08.122 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:08.122 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:08.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:08.123 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:08.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.123 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:415 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:08.123 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:08.123 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 120.932346791, 2024-05-07T14:03:08.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065364059999999998, 2024-05-07T14:03:08.123 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.123 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.124 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 415 2024-05-07T14:03:08.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.124 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:08.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:08.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200339+0000", 2024-05-07T14:03:08.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.826e-06 2024-05-07T14:03:08.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200348+0000", 2024-05-07T14:03:08.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0669999999999998e-06 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200378+0000", 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.968e-05 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200393+0000", 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5109999999999999e-05 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200515+0000", 2024-05-07T14:03:08.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121449 2024-05-07T14:03:08.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200658+0000", 2024-05-07T14:03:08.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014362199999999999 2024-05-07T14:03:08.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:08.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200958+0000", 2024-05-07T14:03:08.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030029699999999999 2024-05-07T14:03:08.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:08.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202106+0000", 2024-05-07T14:03:08.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011475050000000001 2024-05-07T14:03:08.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206707+0000", 2024-05-07T14:03:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046009980000000002 2024-05-07T14:03:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206791+0000", 2024-05-07T14:03:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4118999999999999e-05 2024-05-07T14:03:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206874+0000", 2024-05-07T14:03:08.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2732999999999995e-05 2024-05-07T14:03:08.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.130 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.131 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:430 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:08.131 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:08.131 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 120.922135477, 2024-05-07T14:03:08.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066752119999999998, 2024-05-07T14:03:08.131 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.131 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.131 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.131 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.131 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.131 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.131 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 430 2024-05-07T14:03:08.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.132 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:08.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:08.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210551+0000", 2024-05-07T14:03:08.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:03:08.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210562+0000", 2024-05-07T14:03:08.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0237e-05 2024-05-07T14:03:08.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210586+0000", 2024-05-07T14:03:08.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4066e-05 2024-05-07T14:03:08.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210603+0000", 2024-05-07T14:03:08.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.713e-05 2024-05-07T14:03:08.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211799+0000", 2024-05-07T14:03:08.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001196127 2024-05-07T14:03:08.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211931+0000", 2024-05-07T14:03:08.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131629 2024-05-07T14:03:08.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:08.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212211+0000", 2024-05-07T14:03:08.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028005100000000002 2024-05-07T14:03:08.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:08.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.213288+0000", 2024-05-07T14:03:08.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010772760000000001 2024-05-07T14:03:08.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:08.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217047+0000", 2024-05-07T14:03:08.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037586569999999999 2024-05-07T14:03:08.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217127+0000", 2024-05-07T14:03:08.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0270000000000002e-05 2024-05-07T14:03:08.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217224+0000", 2024-05-07T14:03:08.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7139000000000006e-05 2024-05-07T14:03:08.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.138 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.142 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1482 3.30 3:0f9854c6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10MBfile1:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:08.142 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:08.142 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.763576226, 2024-05-07T14:03:08.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060631510000000001, 2024-05-07T14:03:08.143 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.143 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.143 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:03:08.143 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.143 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.143 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.143 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1482 2024-05-07T14:03:08.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.143 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369111+0000", 2024-05-07T14:03:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2830000000000002e-06 2024-05-07T14:03:08.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369126+0000", 2024-05-07T14:03:08.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4693e-05 2024-05-07T14:03:08.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369160+0000", 2024-05-07T14:03:08.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4282999999999997e-05 2024-05-07T14:03:08.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369178+0000", 2024-05-07T14:03:08.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8153000000000001e-05 2024-05-07T14:03:08.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369385+0000", 2024-05-07T14:03:08.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020658699999999999 2024-05-07T14:03:08.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:08.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369396+0000", 2024-05-07T14:03:08.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0616e-05 2024-05-07T14:03:08.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.374884+0000", 2024-05-07T14:03:08.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005488461 2024-05-07T14:03:08.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.375171+0000", 2024-05-07T14:03:08.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028707500000000003 2024-05-07T14:03:08.148 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.148 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.148 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.148 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1611 3.30 3:0c405120:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:08.148 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:08.149 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.713474192, 2024-05-07T14:03:08.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021446044000000001, 2024-05-07T14:03:08.149 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.149 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.149 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.149 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.149 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.149 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.149 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1611 2024-05-07T14:03:08.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.149 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:08.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:08.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419212+0000", 2024-05-07T14:03:08.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3769999999999999e-06 2024-05-07T14:03:08.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425005+0000", 2024-05-07T14:03:08.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057928390000000001 2024-05-07T14:03:08.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425049+0000", 2024-05-07T14:03:08.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3569999999999998e-05 2024-05-07T14:03:08.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425068+0000", 2024-05-07T14:03:08.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9582e-05 2024-05-07T14:03:08.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425273+0000", 2024-05-07T14:03:08.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020503000000000001 2024-05-07T14:03:08.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425505+0000", 2024-05-07T14:03:08.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023136000000000001 2024-05-07T14:03:08.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:08.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425719+0000", 2024-05-07T14:03:08.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021418000000000001 2024-05-07T14:03:08.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:08.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.439395+0000", 2024-05-07T14:03:08.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013675768 2024-05-07T14:03:08.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:08.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440495+0000", 2024-05-07T14:03:08.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00109987 2024-05-07T14:03:08.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440588+0000", 2024-05-07T14:03:08.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3429000000000003e-05 2024-05-07T14:03:08.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440656+0000", 2024-05-07T14:03:08.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8039000000000004e-05 2024-05-07T14:03:08.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.155 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.155 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1614 3.1d 3:baaad814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:08.155 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:08.155 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.688615892, 2024-05-07T14:03:08.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024991276999999999, 2024-05-07T14:03:08.156 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.156 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.156 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.156 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.156 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.156 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.156 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1614 2024-05-07T14:03:08.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.156 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:08.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:08.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444071+0000", 2024-05-07T14:03:08.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6900000000000001e-06 2024-05-07T14:03:08.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448527+0000", 2024-05-07T14:03:08.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044560870000000001 2024-05-07T14:03:08.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448562+0000", 2024-05-07T14:03:08.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4576000000000002e-05 2024-05-07T14:03:08.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448578+0000", 2024-05-07T14:03:08.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6209e-05 2024-05-07T14:03:08.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448766+0000", 2024-05-07T14:03:08.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018828700000000001 2024-05-07T14:03:08.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.449033+0000", 2024-05-07T14:03:08.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026696599999999999 2024-05-07T14:03:08.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:08.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.449872+0000", 2024-05-07T14:03:08.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083849399999999996 2024-05-07T14:03:08.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:08.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.465016+0000", 2024-05-07T14:03:08.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015144061 2024-05-07T14:03:08.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:08.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.468867+0000", 2024-05-07T14:03:08.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003851246 2024-05-07T14:03:08.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.468987+0000", 2024-05-07T14:03:08.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011982899999999999 2024-05-07T14:03:08.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.469060+0000", 2024-05-07T14:03:08.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2831999999999997e-05 2024-05-07T14:03:08.163 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.163 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.163 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.163 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2205 3.28 3:177ebb78:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:08.163 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.319746+0000", 2024-05-07T14:03:08.163 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.812938709, 2024-05-07T14:03:08.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022489056, 2024-05-07T14:03:08.164 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.164 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.164 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.164 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.164 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.164 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2205 2024-05-07T14:03:08.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.164 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.319746+0000", 2024-05-07T14:03:08.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.319746+0000", 2024-05-07T14:03:08.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.319748+0000", 2024-05-07T14:03:08.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5890000000000001e-06 2024-05-07T14:03:08.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326256+0000", 2024-05-07T14:03:08.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065077659999999999 2024-05-07T14:03:08.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326287+0000", 2024-05-07T14:03:08.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1056999999999998e-05 2024-05-07T14:03:08.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326304+0000", 2024-05-07T14:03:08.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6942000000000001e-05 2024-05-07T14:03:08.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326386+0000", 2024-05-07T14:03:08.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2202999999999999e-05 2024-05-07T14:03:08.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326514+0000", 2024-05-07T14:03:08.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000127744 2024-05-07T14:03:08.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:08.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326626+0000", 2024-05-07T14:03:08.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011235600000000001 2024-05-07T14:03:08.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:08.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.335547+0000", 2024-05-07T14:03:08.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089205910000000003 2024-05-07T14:03:08.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:08.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.342079+0000", 2024-05-07T14:03:08.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065326109999999998 2024-05-07T14:03:08.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.342164+0000", 2024-05-07T14:03:08.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4556999999999997e-05 2024-05-07T14:03:08.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.342235+0000", 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0640000000000001e-05 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2208 3.3a 3:5ee07aff:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.347341+0000", 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.7853433189999999, 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024383083, 2024-05-07T14:03:08.171 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.172 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.172 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.172 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.172 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.172 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.172 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2208 2024-05-07T14:03:08.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.172 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347341+0000", 2024-05-07T14:03:08.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347341+0000", 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347346+0000", 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6330000000000004e-06 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351721+0000", 2024-05-07T14:03:08.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043750070000000002 2024-05-07T14:03:08.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351760+0000", 2024-05-07T14:03:08.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9609e-05 2024-05-07T14:03:08.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351780+0000", 2024-05-07T14:03:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9352999999999999e-05 2024-05-07T14:03:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351947+0000", 2024-05-07T14:03:08.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016710800000000001 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.352347+0000", 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040036800000000001 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.352759+0000", 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041211399999999999 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:08.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365687+0000", 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012927776 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.371529+0000", 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058423140000000004 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.371636+0000", 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107011 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.371724+0000", 2024-05-07T14:03:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7789999999999998e-05 2024-05-07T14:03:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2210 3.28 3:157bdd2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.368019+0000", 2024-05-07T14:03:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.7646647389999996, 2024-05-07T14:03:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016829770000000001, 2024-05-07T14:03:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.178 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2210 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.368019+0000", 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.368019+0000", 2024-05-07T14:03:08.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.368023+0000", 2024-05-07T14:03:08.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6679999999999999e-06 2024-05-07T14:03:08.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372491+0000", 2024-05-07T14:03:08.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044678970000000002 2024-05-07T14:03:08.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372538+0000", 2024-05-07T14:03:08.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7092000000000002e-05 2024-05-07T14:03:08.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372568+0000", 2024-05-07T14:03:08.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0046999999999999e-05 2024-05-07T14:03:08.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372692+0000", 2024-05-07T14:03:08.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012425199999999999 2024-05-07T14:03:08.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372957+0000", 2024-05-07T14:03:08.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026447500000000002 2024-05-07T14:03:08.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:08.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373231+0000", 2024-05-07T14:03:08.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027440800000000002 2024-05-07T14:03:08.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:08.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.383355+0000", 2024-05-07T14:03:08.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010123251999999999 2024-05-07T14:03:08.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:08.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.384680+0000", 2024-05-07T14:03:08.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013249410000000001 2024-05-07T14:03:08.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.384762+0000", 2024-05-07T14:03:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2965000000000003e-05 2024-05-07T14:03:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.384849+0000", 2024-05-07T14:03:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6773000000000004e-05 2024-05-07T14:03:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2213 3.d e84/21 3:b01db4c3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_12:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.432192+0000", 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.7004923669999998, 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014503395000000001, 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432192+0000", 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432192+0000", 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432195+0000", 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7970000000000001e-06 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435030+0000", 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002835424 2024-05-07T14:03:08.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435087+0000", 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7120000000000002e-05 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435115+0000", 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8116e-05 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435224+0000", 2024-05-07T14:03:08.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000108719 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435252+0000", 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8130999999999999e-05 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.446622+0000", 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011369719 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.446695+0000", 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3368999999999995e-05 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2215 3.37 e84/21 3:eed806fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_14:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.462684+0000", 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.6700004059999998, 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014112764, 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.194 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462684+0000", 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462684+0000", 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462686+0000", 2024-05-07T14:03:08.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8339999999999999e-06 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465341+0000", 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026557099999999999 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465378+0000", 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6582999999999999e-05 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465395+0000", 2024-05-07T14:03:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6765999999999998e-05 2024-05-07T14:03:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465550+0000", 2024-05-07T14:03:08.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015575800000000001 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465591+0000", 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0886999999999997e-05 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.476683+0000", 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011092061 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.476797+0000", 2024-05-07T14:03:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113165 2024-05-07T14:03:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2218 3.35 e84/21 3:af15427b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_17:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.517584+0000", 2024-05-07T14:03:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.6151001010000003, 2024-05-07T14:03:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013750717000000001, 2024-05-07T14:03:08.200 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.201 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.201 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.201 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517584+0000", 2024-05-07T14:03:08.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517584+0000", 2024-05-07T14:03:08.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517587+0000", 2024-05-07T14:03:08.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8789999999999999e-06 2024-05-07T14:03:08.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521588+0000", 2024-05-07T14:03:08.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040013649999999998 2024-05-07T14:03:08.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521630+0000", 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1632999999999999e-05 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521649+0000", 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8623000000000001e-05 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521801+0000", 2024-05-07T14:03:08.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000152688 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521843+0000", 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1993000000000003e-05 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531239+0000", 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093956779999999993 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531335+0000", 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5858000000000003e-05 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2222 3.2a 3:57d0a4ec:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.567662+0000", 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.5650222889999998, 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020794828000000001, 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.205 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.206 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.206 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.206 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2222 2024-05-07T14:03:08.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.206 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.567662+0000", 2024-05-07T14:03:08.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.567662+0000", 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.567666+0000", 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.58e-06 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571748+0000", 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040822109999999997 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571783+0000", 2024-05-07T14:03:08.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5503000000000002e-05 2024-05-07T14:03:08.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571801+0000", 2024-05-07T14:03:08.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7943000000000001e-05 2024-05-07T14:03:08.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571926+0000", 2024-05-07T14:03:08.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012484799999999999 2024-05-07T14:03:08.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.572168+0000", 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000242041 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.572386+0000", 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021758300000000001 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.587086+0000", 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014700095 2024-05-07T14:03:08.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:08.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588219+0000", 2024-05-07T14:03:08.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011328009999999999 2024-05-07T14:03:08.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588338+0000", 2024-05-07T14:03:08.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118959 2024-05-07T14:03:08.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588457+0000", 2024-05-07T14:03:08.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119264 2024-05-07T14:03:08.212 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.212 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.212 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2234 3.c 3:313f4c71:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.714603+0000", 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.418080732, 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015738496000000001, 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2234 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.213 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.714603+0000", 2024-05-07T14:03:08.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.714603+0000", 2024-05-07T14:03:08.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.714606+0000", 2024-05-07T14:03:08.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4140000000000001e-06 2024-05-07T14:03:08.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718403+0000", 2024-05-07T14:03:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037968720000000002 2024-05-07T14:03:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718431+0000", 2024-05-07T14:03:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8384000000000001e-05 2024-05-07T14:03:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718443+0000", 2024-05-07T14:03:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2167999999999999e-05 2024-05-07T14:03:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718541+0000", 2024-05-07T14:03:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7979000000000005e-05 2024-05-07T14:03:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718737+0000", 2024-05-07T14:03:08.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019563 2024-05-07T14:03:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718943+0000", 2024-05-07T14:03:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000206407 2024-05-07T14:03:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.728383+0000", 2024-05-07T14:03:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094393529999999993 2024-05-07T14:03:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.730203+0000", 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001819827 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.730277+0000", 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.436e-05 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.730342+0000", 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5102000000000001e-05 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.220 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2239 3.36 e84/21 3:6db3e702:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_38:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.771643+0000", 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.3610410499999999, 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011577555, 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771643+0000", 2024-05-07T14:03:08.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771643+0000", 2024-05-07T14:03:08.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771646+0000", 2024-05-07T14:03:08.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5560000000000002e-06 2024-05-07T14:03:08.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773601+0000", 2024-05-07T14:03:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019557239999999998 2024-05-07T14:03:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773627+0000", 2024-05-07T14:03:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5273999999999999e-05 2024-05-07T14:03:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773639+0000", 2024-05-07T14:03:08.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1990999999999999e-05 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773719+0000", 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0181999999999999e-05 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773744+0000", 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5055e-05 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783134+0000", 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093901839999999993 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783221+0000", 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6588999999999994e-05 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2240 3.2f 3:f504276b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.776589+0000", 2024-05-07T14:03:08.225 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.3560956500000003, 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016880398000000001, 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2240 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.776589+0000", 2024-05-07T14:03:08.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.776589+0000", 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.776592+0000", 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0189999999999998e-06 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780426+0000", 2024-05-07T14:03:08.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038339659999999998 2024-05-07T14:03:08.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780446+0000", 2024-05-07T14:03:08.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0237999999999998e-05 2024-05-07T14:03:08.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780457+0000", 2024-05-07T14:03:08.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1103e-05 2024-05-07T14:03:08.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780539+0000", 2024-05-07T14:03:08.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1682999999999997e-05 2024-05-07T14:03:08.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780698+0000", 2024-05-07T14:03:08.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015976299999999999 2024-05-07T14:03:08.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:08.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780827+0000", 2024-05-07T14:03:08.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012860599999999999 2024-05-07T14:03:08.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.792875+0000", 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012047904 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.793367+0000", 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00049221499999999995 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.793418+0000", 2024-05-07T14:03:08.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1023000000000003e-05 2024-05-07T14:03:08.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.793469+0000", 2024-05-07T14:03:08.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0878000000000003e-05 2024-05-07T14:03:08.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.232 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.232 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2242 3.3c 3:3de0b8ca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:08.232 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.796914+0000", 2024-05-07T14:03:08.232 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.3357698659999997, 2024-05-07T14:03:08.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015934625000000001, 2024-05-07T14:03:08.233 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.233 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.233 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.233 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.233 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.233 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.233 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2242 2024-05-07T14:03:08.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.234 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.796914+0000", 2024-05-07T14:03:08.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.796914+0000", 2024-05-07T14:03:08.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.796916+0000", 2024-05-07T14:03:08.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6390000000000001e-06 2024-05-07T14:03:08.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800745+0000", 2024-05-07T14:03:08.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038292000000000001 2024-05-07T14:03:08.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800772+0000", 2024-05-07T14:03:08.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7155e-05 2024-05-07T14:03:08.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800784+0000", 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1963e-05 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800861+0000", 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6936999999999999e-05 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.801007+0000", 2024-05-07T14:03:08.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014580100000000001 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.801126+0000", 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118613 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.807740+0000", 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066147369999999999 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:08.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.812727+0000", 2024-05-07T14:03:08.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049861769999999996 2024-05-07T14:03:08.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.812791+0000", 2024-05-07T14:03:08.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4734999999999996e-05 2024-05-07T14:03:08.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.812849+0000", 2024-05-07T14:03:08.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7667999999999997e-05 2024-05-07T14:03:08.238 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.238 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2244 3.2f 3:f6c20744:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.819427+0000", 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.3132569590000003, 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015548795000000001, 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.239 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2244 2024-05-07T14:03:08.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.240 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.819427+0000", 2024-05-07T14:03:08.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.819427+0000", 2024-05-07T14:03:08.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.819430+0000", 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2350000000000002e-06 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823226+0000", 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037961309999999999 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823247+0000", 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1002999999999999e-05 2024-05-07T14:03:08.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823256+0000", 2024-05-07T14:03:08.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4369999999999996e-06 2024-05-07T14:03:08.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823349+0000", 2024-05-07T14:03:08.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3319000000000006e-05 2024-05-07T14:03:08.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823550+0000", 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020093699999999999 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823751+0000", 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000200466 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834235+0000", 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010483878 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834822+0000", 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058768600000000002 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834912+0000", 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0073000000000003e-05 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834976+0000", 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3629999999999999e-05 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.244 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.245 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.245 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2245 3.d e84/21 3:b06e9c0d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_44:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:08.245 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.834936+0000", 2024-05-07T14:03:08.245 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.297748007, 2024-05-07T14:03:08.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010748073, 2024-05-07T14:03:08.245 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.245 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.245 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:08.245 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834936+0000", 2024-05-07T14:03:08.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834936+0000", 2024-05-07T14:03:08.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834937+0000", 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.99e-07 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.836983+0000", 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002045776 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837005+0000", 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2680999999999998e-05 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837018+0000", 2024-05-07T14:03:08.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2374999999999999e-05 2024-05-07T14:03:08.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837143+0000", 2024-05-07T14:03:08.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012507100000000001 2024-05-07T14:03:08.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837184+0000", 2024-05-07T14:03:08.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1625000000000002e-05 2024-05-07T14:03:08.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:08.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.845599+0000", 2024-05-07T14:03:08.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084150500000000003 2024-05-07T14:03:08.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.845684+0000", 2024-05-07T14:03:08.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4895999999999995e-05 2024-05-07T14:03:08.249 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.250 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.250 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.250 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2498 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:08.250 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:03:08.250 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7377998240000001, 2024-05-07T14:03:08.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.06015305, 2024-05-07T14:03:08.250 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.250 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.250 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:08.250 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.250 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2498 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394887+0000", 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394900+0000", 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3125999999999999e-05 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394940+0000", 2024-05-07T14:03:08.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9579999999999997e-05 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394961+0000", 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1075999999999999e-05 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395122+0000", 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160741 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:08.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395140+0000", 2024-05-07T14:03:08.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:03:08.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430325+0000", 2024-05-07T14:03:08.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.03518512 2024-05-07T14:03:08.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:08.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430355+0000", 2024-05-07T14:03:08.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9181999999999999e-05 2024-05-07T14:03:08.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.445424+0000", 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.015069751 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.446159+0000", 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073452200000000004 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450456+0000", 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042973689999999997 2024-05-07T14:03:08.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450627+0000", 2024-05-07T14:03:08.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017032700000000001 2024-05-07T14:03:08.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455037+0000", 2024-05-07T14:03:08.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044108690000000004 2024-05-07T14:03:08.256 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.256 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.256 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2499 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.737670775, 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.065623158, 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2499 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.257 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395015+0000", 2024-05-07T14:03:08.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.57e-06 2024-05-07T14:03:08.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:08.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395022+0000", 2024-05-07T14:03:08.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1330000000000001e-06 2024-05-07T14:03:08.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:08.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395043+0000", 2024-05-07T14:03:08.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1022999999999998e-05 2024-05-07T14:03:08.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395060+0000", 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6325999999999999e-05 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395199+0000", 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139815 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395215+0000", 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5693e-05 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413112+0000", 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017896860000000001 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413143+0000", 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1609000000000002e-05 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.447430+0000", 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0342867060000001 2024-05-07T14:03:08.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450079+0000", 2024-05-07T14:03:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002648386 2024-05-07T14:03:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455213+0000", 2024-05-07T14:03:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051342749999999998 2024-05-07T14:03:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:08.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455444+0000", 2024-05-07T14:03:08.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023070799999999999 2024-05-07T14:03:08.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:08.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:08.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:08.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.460637+0000", 2024-05-07T14:03:08.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051930539999999999 2024-05-07T14:03:08.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.263 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:08.263 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:08.263 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:08.264 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:03:08.264 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:08.208+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:08.308 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:08.320+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:08.390 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:03:08.394 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:08.394 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:08.399 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:08.408+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:08.408 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:03:08.501 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:08.512+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:08.537 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:08.537 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:08.554 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:08.555 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:08.573 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:08.573 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:08.574 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:08.575 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:08.575 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:08.575 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:08.575 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:08.589 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:03:08.589 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:08.590 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:08.607 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:08.608 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:08.625 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:08.626 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:08.636 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:08.648+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:08.643 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:08.644 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:08.661 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:08.662 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:08.715 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:08.715 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:08.724 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:08.736+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:08.729 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:03:08.803 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:08.812+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:08.896 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:08.896 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:08.905 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:08.912+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:08.910 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:03:09.005 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:09.016+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:09.032 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:09.033 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:09.046 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:09.106 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:09.116+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:09.169 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:09.170 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:09.183 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:09.228 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:09.240+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:09.304 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:09.304 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:09.309 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:09.320+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:09.316 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:09.409 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:09.420+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:09.419 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:03:09.481 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:09.481 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:09.495 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:09.510 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:09.520+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:09.608 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:09.609 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:09.611 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:09.620+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:09.622 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:09.712 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:09.720+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:09.784 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:09.784 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:09.797 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:09.844 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:09.856+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:09.913 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:09.924+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:09.915 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:09.915 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:09.929 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:10.014 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:10.024+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:10.098 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:10.098 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:10.112 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:10.115 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:10.124+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:10.216 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:10.224+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:10.234 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:10.234 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:10.248 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:10.336 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:10.348+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:10.411 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:10.411 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:10.417 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:10.428+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:10.423 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:10.459 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:03:10.532 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:10.544+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:10.578 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:10.578 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:10.591 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:10.632 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:10.644+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:10.681 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:03:10.720 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:10.732+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:10.754 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:10.755 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:10.772 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:10.821 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:10.832+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:10.824 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:10.824 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:10.841 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:10.841 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:10.860 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:10.860 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:10.876 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:10.876 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:10.890 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:10.891 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:10.891 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:10.891 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:10.891 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:10.896 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:10.896 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:10.905 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:10.917 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:10.917 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:10.921 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:10.932+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:10.938 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:10.938 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:10.958 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:10.959 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:11.022 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:11.022 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:11.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:11.022 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:11.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.022 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:03:11.022 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:03:11.022 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 129.03077937500001, 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:03:11.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:03:11.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:03:11.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:03:11.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:03:11.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:03:11.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:11.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:03:11.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:03:11.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:03:11.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:03:11.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:03:11.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:03:11.027 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.027 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.027 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.027 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:11.028 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:03:11.028 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 124.010375555, 2024-05-07T14:03:11.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:03:11.028 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.028 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.028 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.028 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.028 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:11.028 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.029 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:03:11.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.029 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:03:11.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:03:11.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:03:11.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:03:11.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:03:11.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:03:11.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:03:11.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:03:11.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:03:11.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:03:11.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:03:11.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:03:11.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:11.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:03:11.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:03:11.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:03:11.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:03:11.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:03:11.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:03:11.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:03:11.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:03:11.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:03:11.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5099.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.853891363999999, 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053287550000000001, 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.035 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5099", 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2788980923", 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179365+0000", 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179366+0000", 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7299999999999996e-07 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179368+0000", 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7879999999999998e-06 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179378+0000", 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8870000000000004e-06 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179384+0000", 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3009999999999997e-06 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179438+0000", 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4731000000000002e-05 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179515+0000", 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6817999999999995e-05 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179637+0000", 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000122197 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.181699+0000", 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020617000000000001 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184620+0000", 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029204999999999999 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184651+0000", 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1267999999999999e-05 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184694+0000", 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2991999999999998e-05 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.040 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1477 3.18 3:1a16f065:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.747774031999999, 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017437234999999999, 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1477 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:03:11.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:03:11.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285485+0000", 2024-05-07T14:03:11.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.148e-06 2024-05-07T14:03:11.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287428+0000", 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001943391 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287451+0000", 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2912e-05 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287464+0000", 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2758000000000001e-05 2024-05-07T14:03:11.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287530+0000", 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6544999999999994e-05 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287643+0000", 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011307900000000001 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287732+0000", 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8640999999999994e-05 2024-05-07T14:03:11.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.300987+0000", 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013255052999999999 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302819+0000", 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001831533 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302874+0000", 2024-05-07T14:03:11.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5946000000000003e-05 2024-05-07T14:03:11.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302920+0000", 2024-05-07T14:03:11.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5228999999999997e-05 2024-05-07T14:03:11.046 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.046 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.046 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.046 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:11.046 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:11.047 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.728511966999999, 2024-05-07T14:03:11.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:03:11.047 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.047 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.047 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.047 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.047 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:11.047 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.047 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:03:11.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.047 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:03:11.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:03:11.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:03:11.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:03:11.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:03:11.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:03:11.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:03:11.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.052 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5117.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.537269081000002, 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008462018, 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5117", 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/62727776", 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:03:11.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:03:11.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495988+0000", 2024-05-07T14:03:11.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999999e-07 2024-05-07T14:03:11.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495990+0000", 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.765e-06 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495995+0000", 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3499999999999996e-06 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495998+0000", 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3739999999999998e-06 2024-05-07T14:03:11.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496050+0000", 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2015999999999998e-05 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496120+0000", 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9373000000000001e-05 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496224+0000", 2024-05-07T14:03:11.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010395699999999999 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.501395+0000", 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051715090000000003 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504399+0000", 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030035930000000001 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504428+0000", 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504449+0000", 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1608e-05 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1485 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=14b,call rgw.obj_remove in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:03:11.058 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.412530251, 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056592079999999998, 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1485 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:03:11.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620728+0000", 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.457e-06 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620734+0000", 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0460000000000002e-06 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620749+0000", 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5067e-05 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620758+0000", 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6989999999999992e-06 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620819+0000", 2024-05-07T14:03:11.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1496999999999998e-05 2024-05-07T14:03:11.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620880+0000", 2024-05-07T14:03:11.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0908e-05 2024-05-07T14:03:11.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:11.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.621007+0000", 2024-05-07T14:03:11.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000127551 2024-05-07T14:03:11.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.622196+0000", 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001188391 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626306+0000", 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041097779999999997 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626357+0000", 2024-05-07T14:03:11.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0936999999999997e-05 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626385+0000", 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8877000000000002e-05 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1920 4.0 4:03a7a160:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.636900768, 2024-05-07T14:03:11.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055799400000000002, 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1920 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396356+0000", 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.89e-07 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396360+0000", 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.284e-06 2024-05-07T14:03:11.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396368+0000", 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8769999999999993e-06 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396374+0000", 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2480000000000004e-06 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396652+0000", 2024-05-07T14:03:11.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027788900000000002 2024-05-07T14:03:11.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396724+0000", 2024-05-07T14:03:11.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2391000000000005e-05 2024-05-07T14:03:11.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:11.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397033+0000", 2024-05-07T14:03:11.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030929299999999998 2024-05-07T14:03:11.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398442+0000", 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001409062 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401881+0000", 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034388639999999998 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401909+0000", 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7716e-05 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.070 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401936+0000", 2024-05-07T14:03:11.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6826999999999999e-05 2024-05-07T14:03:11.070 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.070 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.070 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.070 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1922 4.19 4:9849ed33:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:11.070 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:03:11.070 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.636866104999999, 2024-05-07T14:03:11.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0075306310000000003, 2024-05-07T14:03:11.070 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.070 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1922 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396391+0000", 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.46e-07 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396393+0000", 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3250000000000002e-06 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396400+0000", 2024-05-07T14:03:11.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9190000000000002e-06 2024-05-07T14:03:11.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396405+0000", 2024-05-07T14:03:11.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2839999999999997e-06 2024-05-07T14:03:11.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396919+0000", 2024-05-07T14:03:11.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00051340499999999998 2024-05-07T14:03:11.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396988+0000", 2024-05-07T14:03:11.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8775999999999993e-05 2024-05-07T14:03:11.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:11.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397099+0000", 2024-05-07T14:03:11.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111239 2024-05-07T14:03:11.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398350+0000", 2024-05-07T14:03:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001250735 2024-05-07T14:03:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403874+0000", 2024-05-07T14:03:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005524307 2024-05-07T14:03:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403900+0000", 2024-05-07T14:03:11.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6499000000000002e-05 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403921+0000", 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0696e-05 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2203 3.1e 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.7387956229999997, 2024-05-07T14:03:11.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029129142, 2024-05-07T14:03:11.079 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.079 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.079 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.079 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.079 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:11.079 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.079 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2203 2024-05-07T14:03:11.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.079 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294465+0000", 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7699999999999999e-06 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300328+0000", 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058633460000000002 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300384+0000", 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6212999999999999e-05 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300411+0000", 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7109000000000001e-05 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300586+0000", 2024-05-07T14:03:11.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017478799999999999 2024-05-07T14:03:11.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300941+0000", 2024-05-07T14:03:11.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035515500000000001 2024-05-07T14:03:11.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:11.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301351+0000", 2024-05-07T14:03:11.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040996099999999997 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.317495+0000", 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016143462000000001 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323421+0000", 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059264649999999997 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323498+0000", 2024-05-07T14:03:11.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6478999999999997e-05 2024-05-07T14:03:11.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323590+0000", 2024-05-07T14:03:11.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2393999999999997e-05 2024-05-07T14:03:11.084 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.084 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.084 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2205 3.28 e84/21 3:177ebb78:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_4:head v 84'4, mlcod=80'2)", 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.327037+0000", 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.7062194640000001, 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014954187000000001, 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.327037+0000", 2024-05-07T14:03:11.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.327037+0000", 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.327039+0000", 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333502+0000", 2024-05-07T14:03:11.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064627169999999998 2024-05-07T14:03:11.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333536+0000", 2024-05-07T14:03:11.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4576000000000002e-05 2024-05-07T14:03:11.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333556+0000", 2024-05-07T14:03:11.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9911999999999998e-05 2024-05-07T14:03:11.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333648+0000", 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1886999999999996e-05 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333674+0000", 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6562000000000001e-05 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.341878+0000", 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082039850000000004 2024-05-07T14:03:11.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.341991+0000", 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112778 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2210 3.28 e84/21 3:157bdd2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_9:head v 84'5, mlcod=80'3)", 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.373804+0000", 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.6594529319999998, 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010808760000000001, 2024-05-07T14:03:11.089 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.090 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.090 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.090 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.373804+0000", 2024-05-07T14:03:11.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.373804+0000", 2024-05-07T14:03:11.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.373805+0000", 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5489999999999999e-06 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378137+0000", 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043320640000000001 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378161+0000", 2024-05-07T14:03:11.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.34e-05 2024-05-07T14:03:11.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378170+0000", 2024-05-07T14:03:11.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4180000000000003e-06 2024-05-07T14:03:11.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378234+0000", 2024-05-07T14:03:11.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4386000000000003e-05 2024-05-07T14:03:11.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378253+0000", 2024-05-07T14:03:11.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8542999999999998e-05 2024-05-07T14:03:11.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.384569+0000", 2024-05-07T14:03:11.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063162670000000004 2024-05-07T14:03:11.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.384612+0000", 2024-05-07T14:03:11.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3133000000000002e-05 2024-05-07T14:03:11.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.094 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.094 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2214 3.33 3:cdc86525:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:11.095 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.436823+0000", 2024-05-07T14:03:11.095 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.5964339399999998, 2024-05-07T14:03:11.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014331511999999999, 2024-05-07T14:03:11.095 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.095 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.095 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:11.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.095 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2214 2024-05-07T14:03:11.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.095 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.436823+0000", 2024-05-07T14:03:11.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.436823+0000", 2024-05-07T14:03:11.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.436826+0000", 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7670000000000001e-06 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.439818+0000", 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029918359999999999 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.439858+0000", 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9830999999999999e-05 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.439874+0000", 2024-05-07T14:03:11.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6328e-05 2024-05-07T14:03:11.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.439978+0000", 2024-05-07T14:03:11.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103491 2024-05-07T14:03:11.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.440163+0000", 2024-05-07T14:03:11.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018528800000000001 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.440321+0000", 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015804099999999999 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.448904+0000", 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0085825020000000005 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.451028+0000", 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002124014 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.451101+0000", 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3802999999999998e-05 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.451154+0000", 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2611000000000002e-05 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2228 3.b 3:d3d17a37:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.649134+0000", 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.3841221790000002, 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012981072, 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2228 2024-05-07T14:03:11.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.102 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.649134+0000", 2024-05-07T14:03:11.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.649134+0000", 2024-05-07T14:03:11.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.649137+0000", 2024-05-07T14:03:11.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7269999999999999e-06 2024-05-07T14:03:11.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.650871+0000", 2024-05-07T14:03:11.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001733928 2024-05-07T14:03:11.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.650902+0000", 2024-05-07T14:03:11.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1245000000000003e-05 2024-05-07T14:03:11.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.650929+0000", 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6999999999999999e-05 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.651003+0000", 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3860000000000001e-05 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.651154+0000", 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015102799999999999 2024-05-07T14:03:11.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:11.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.651272+0000", 2024-05-07T14:03:11.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117798 2024-05-07T14:03:11.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661672+0000", 2024-05-07T14:03:11.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010399920999999999 2024-05-07T14:03:11.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.662002+0000", 2024-05-07T14:03:11.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033048099999999998 2024-05-07T14:03:11.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.662066+0000", 2024-05-07T14:03:11.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3663000000000004e-05 2024-05-07T14:03:11.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.662115+0000", 2024-05-07T14:03:11.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9421e-05 2024-05-07T14:03:11.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.106 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2230 3.b 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.3628889529999997, 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021351564, 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.107 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2230 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670370+0000", 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5050000000000002e-06 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673214+0000", 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028441260000000002 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673245+0000", 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0488999999999999e-05 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673259+0000", 2024-05-07T14:03:11.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4443e-05 2024-05-07T14:03:11.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673356+0000", 2024-05-07T14:03:11.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7031e-05 2024-05-07T14:03:11.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673531+0000", 2024-05-07T14:03:11.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017509099999999999 2024-05-07T14:03:11.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:11.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673696+0000", 2024-05-07T14:03:11.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000164306 2024-05-07T14:03:11.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684776+0000", 2024-05-07T14:03:11.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011080054000000001 2024-05-07T14:03:11.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691578+0000", 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068025849999999999 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691659+0000", 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0976000000000005e-05 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691719+0000", 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9957999999999998e-05 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2233 3.8 3:11b98425:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.703282+0000", 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.3299743580000003, 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013715266, 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2233 2024-05-07T14:03:11.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.114 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.703282+0000", 2024-05-07T14:03:11.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.703282+0000", 2024-05-07T14:03:11.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.703285+0000", 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4420000000000001e-06 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705019+0000", 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00173413 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705045+0000", 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6553000000000001e-05 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705057+0000", 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2089000000000001e-05 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705144+0000", 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6330999999999997e-05 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705327+0000", 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018284400000000001 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705488+0000", 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161175 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716311+0000", 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010823732000000001 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716869+0000", 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00055720900000000002 2024-05-07T14:03:11.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716945+0000", 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6038000000000006e-05 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716997+0000", 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2723000000000003e-05 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2234 3.c e84/21 3:313f4c71:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_33:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.719287+0000", 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.3139696049999996, 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010877421999999999, 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.719287+0000", 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.719287+0000", 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.719288+0000", 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4399999999999999e-07 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723259+0000", 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039712230000000003 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723288+0000", 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9603000000000001e-05 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723314+0000", 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5882000000000001e-05 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723397+0000", 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2337999999999997e-05 2024-05-07T14:03:11.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723426+0000", 2024-05-07T14:03:11.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663999999999999e-05 2024-05-07T14:03:11.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.730114+0000", 2024-05-07T14:03:11.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0066872659999999999 2024-05-07T14:03:11.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.730164+0000", 2024-05-07T14:03:11.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0701999999999997e-05 2024-05-07T14:03:11.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.123 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.123 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2241 3.19 e84/21 3:9b9246d1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_40:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:11.123 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.789069+0000", 2024-05-07T14:03:11.123 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.244187921, 2024-05-07T14:03:11.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0096171769999999993, 2024-05-07T14:03:11.123 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.123 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.123 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.789069+0000", 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.789069+0000", 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.789070+0000", 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.466e-06 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790431+0000", 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013607999999999999 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790458+0000", 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6823000000000001e-05 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790472+0000", 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4059999999999999e-05 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790554+0000", 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1839e-05 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790582+0000", 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8388999999999999e-05 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.798616+0000", 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080345199999999999 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.798686+0000", 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9280000000000001e-05 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.127 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5862.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.263138+0000", 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.7701185519999996, 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061089910000000002, 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5862", 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/3537699870", 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263138+0000", 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263138+0000", 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263139+0000", 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9500000000000002e-07 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263141+0000", 2024-05-07T14:03:11.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8439999999999998e-06 2024-05-07T14:03:11.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263150+0000", 2024-05-07T14:03:11.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7700000000000007e-06 2024-05-07T14:03:11.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263156+0000", 2024-05-07T14:03:11.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8189999999999997e-06 2024-05-07T14:03:11.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263211+0000", 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5340999999999998e-05 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263285+0000", 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3206000000000003e-05 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263402+0000", 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011738100000000001 2024-05-07T14:03:11.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.266447+0000", 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030453519999999999 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269193+0000", 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002745571 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269222+0000", 2024-05-07T14:03:11.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9329999999999999e-05 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269247+0000", 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4681999999999998e-05 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2553 4.19 4:984568f2:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.470659+0000", 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.5625978759999999, 2024-05-07T14:03:11.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052843650000000001, 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2553 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470659+0000", 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470659+0000", 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470660+0000", 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.686e-06 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470673+0000", 2024-05-07T14:03:11.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3081999999999999e-05 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470698+0000", 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4406999999999999e-05 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470714+0000", 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5860000000000001e-05 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:11.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470815+0000", 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101537 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470946+0000", 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130748 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.471074+0000", 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012765699999999999 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.472406+0000", 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013328750000000001 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475819+0000", 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034129619999999999 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475901+0000", 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1259000000000002e-05 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:11.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:11.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:11.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475943+0000", 2024-05-07T14:03:11.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2292000000000001e-05 2024-05-07T14:03:11.139 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.139 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.139 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.139 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:11.139 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:11.139 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:11.141 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:11.141 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:11.152+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:11.242 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:11.252+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:11.271 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:11.271 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:11.271 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:11.271 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:11.285 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:11.373 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:11.384+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:11.444 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:11.456+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:11.447 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:11.447 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:11.447 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:11.447 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:11.447 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:11.461 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:11.545 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:11.556+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:11.627 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:11.627 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:11.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:11.627 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:11.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.627 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:03:11.627 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:03:11.627 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 129.643287574, 2024-05-07T14:03:11.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070064749999999999, 2024-05-07T14:03:11.627 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 43 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994274+0000", 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7170000000000002e-06 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994292+0000", 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7819999999999999e-05 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994338+0000", 2024-05-07T14:03:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6625999999999997e-05 2024-05-07T14:03:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994362+0000", 2024-05-07T14:03:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4063e-05 2024-05-07T14:03:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994576+0000", 2024-05-07T14:03:11.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021319500000000001 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994598+0000", 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2325999999999999e-05 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001023+0000", 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00642546 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001277+0000", 2024-05-07T14:03:11.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025326800000000002 2024-05-07T14:03:11.632 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.632 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.632 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.632 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1566 4.13 4:cabacdb3:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:11.632 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:03:11.632 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.964669288, 2024-05-07T14:03:11.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057730890000000003, 2024-05-07T14:03:11.632 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.632 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1566 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:03:11.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672890+0000", 2024-05-07T14:03:11.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.606e-06 2024-05-07T14:03:11.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672898+0000", 2024-05-07T14:03:11.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-06 2024-05-07T14:03:11.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672924+0000", 2024-05-07T14:03:11.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5599999999999999e-05 2024-05-07T14:03:11.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672942+0000", 2024-05-07T14:03:11.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7799999999999999e-05 2024-05-07T14:03:11.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673078+0000", 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013645399999999999 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673280+0000", 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020144999999999999 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673597+0000", 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031715200000000002 2024-05-07T14:03:11.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.675496+0000", 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018996830000000001 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678466+0000", 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029693639999999999 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678562+0000", 2024-05-07T14:03:11.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6614999999999996e-05 2024-05-07T14:03:11.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678661+0000", 2024-05-07T14:03:11.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9024999999999995e-05 2024-05-07T14:03:11.638 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.638 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.638 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.638 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1568 4.3d 4:bd9d380d:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:11.638 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:03:11.638 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.964574246000002, 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059901989999999999, 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1568 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672985+0000", 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672992+0000", 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7229999999999998e-06 2024-05-07T14:03:11.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673011+0000", 2024-05-07T14:03:11.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9700000000000001e-05 2024-05-07T14:03:11.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673026+0000", 2024-05-07T14:03:11.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4506e-05 2024-05-07T14:03:11.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674436+0000", 2024-05-07T14:03:11.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001410445 2024-05-07T14:03:11.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674635+0000", 2024-05-07T14:03:11.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019898299999999999 2024-05-07T14:03:11.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:11.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674957+0000", 2024-05-07T14:03:11.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032126499999999999 2024-05-07T14:03:11.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.676898+0000", 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019413989999999999 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678780+0000", 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018816880000000001 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678912+0000", 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013280799999999999 2024-05-07T14:03:11.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678974+0000", 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1192000000000006e-05 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1570 4.1b 4:db659863:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.964508646999999, 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059406459999999999, 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.644 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1570 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673050+0000", 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1230000000000001e-06 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673056+0000", 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5639999999999996e-06 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673073+0000", 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7751999999999999e-05 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673086+0000", 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2656999999999999e-05 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674276+0000", 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011896350000000001 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674479+0000", 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020363600000000001 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674757+0000", 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027776599999999998 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677473+0000", 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027157739999999998 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678813+0000", 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013401120000000001 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678931+0000", 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118322 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678990+0000", 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8304999999999998e-05 2024-05-07T14:03:11.649 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1572 4.13 4:c90a81ac:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.964452660999999, 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062582080000000003, 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:11.650 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.651 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1572 2024-05-07T14:03:11.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.651 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:03:11.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:03:11.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673106+0000", 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0729999999999999e-06 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673111+0000", 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3070000000000002e-06 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673129+0000", 2024-05-07T14:03:11.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673143+0000", 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3579e-05 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674380+0000", 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001237908 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674578+0000", 2024-05-07T14:03:11.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000197617 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674864+0000", 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028589499999999999 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678694+0000", 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038299900000000001 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679226+0000", 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053176199999999997 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679299+0000", 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3658000000000005e-05 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679363+0000", 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3816e-05 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.655 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1612 3.3 3:c1191b65:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.214667497000001, 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013953758, 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1612 2024-05-07T14:03:11.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422894+0000", 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3400000000000002e-06 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426732+0000", 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386760000000001 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426772+0000", 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9740000000000002e-05 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426791+0000", 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426935+0000", 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144368 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.427196+0000", 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026091599999999998 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.427426+0000", 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022962899999999999 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.434735+0000", 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073090990000000003 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436629+0000", 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018938640000000001 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436721+0000", 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1943999999999999e-05 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436844+0000", 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012338900000000001 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1614 3.1d e81/21 3:baaad814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4_10Mb.:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:11.661 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.187418198, 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013565693, 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450142+0000", 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3970000000000001e-06 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453081+0000", 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029395100000000002 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453123+0000", 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1356000000000002e-05 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453142+0000", 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453311+0000", 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016885700000000001 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453349+0000", 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8033e-05 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.463599+0000", 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010250011 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.463705+0000", 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000105839 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.665 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2206 3.f e84/21 3:f1007ae4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_5:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.334366+0000", 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.3031917069999999, 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013342471999999999, 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334366+0000", 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334366+0000", 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334368+0000", 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9860000000000001e-06 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337428+0000", 2024-05-07T14:03:11.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030598969999999998 2024-05-07T14:03:11.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337456+0000", 2024-05-07T14:03:11.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8153999999999998e-05 2024-05-07T14:03:11.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337470+0000", 2024-05-07T14:03:11.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4446e-05 2024-05-07T14:03:11.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337559+0000", 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8144000000000002e-05 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337592+0000", 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3284999999999997e-05 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347590+0000", 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0099978580000000001 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347708+0000", 2024-05-07T14:03:11.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118702 2024-05-07T14:03:11.670 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.670 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.670 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.670 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2209 3.a e84/21 3:51944b39:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_8:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:11.670 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.362568+0000", 2024-05-07T14:03:11.670 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.2749898490000007, 2024-05-07T14:03:11.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010524235999999999, 2024-05-07T14:03:11.670 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362568+0000", 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362568+0000", 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362569+0000", 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3e-07 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365334+0000", 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027652950000000001 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365371+0000", 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6946999999999997e-05 2024-05-07T14:03:11.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365395+0000", 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4451999999999999e-05 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365495+0000", 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100227 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365521+0000", 2024-05-07T14:03:11.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5211999999999998e-05 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373033+0000", 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0075124399999999996 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373092+0000", 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8933e-05 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2211 3.13 e84/46 3:cbf4b364:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_10:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.392442+0000", 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.2451156880000003, 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011680088, 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.392442+0000", 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.392442+0000", 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.392444+0000", 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7659999999999999e-06 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396574+0000", 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041300080000000001 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396606+0000", 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2503999999999999e-05 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396619+0000", 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3138e-05 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396720+0000", 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100987 2024-05-07T14:03:11.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396749+0000", 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8520000000000001e-05 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.403988+0000", 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072395979999999999 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.404122+0000", 2024-05-07T14:03:11.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013356699999999999 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2212 3.1a 3:591da10a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.409463+0000", 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.2280945889999995, 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018426962000000002, 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:11.679 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2212 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.409463+0000", 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.409463+0000", 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.409466+0000", 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8569999999999999e-06 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414439+0000", 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049734410000000003 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414466+0000", 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6675000000000001e-05 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414479+0000", 2024-05-07T14:03:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3047999999999999e-05 2024-05-07T14:03:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414548+0000", 2024-05-07T14:03:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8536999999999998e-05 2024-05-07T14:03:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414652+0000", 2024-05-07T14:03:11.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010464800000000001 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414741+0000", 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8438999999999998e-05 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.421987+0000", 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072459000000000004 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427801+0000", 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058140140000000002 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427845+0000", 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3973000000000001e-05 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427890+0000", 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5429999999999997e-05 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2220 3.11 e84/21 3:8b7a5ffd:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_19:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.540816+0000", 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.0967412369999998, 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016537718999999999, 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540816+0000", 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540816+0000", 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540818+0000", 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0600000000000002e-06 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.543930+0000", 2024-05-07T14:03:11.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031115299999999999 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.543973+0000", 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2932999999999997e-05 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.543998+0000", 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5372999999999999e-05 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.544132+0000", 2024-05-07T14:03:11.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013406799999999999 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.544189+0000", 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7086000000000002e-05 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557266+0000", 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013076050000000001 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557354+0000", 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8619e-05 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2221 3.f e84/21 3:f1cd2e50:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_20:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.551236+0000", 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.0863219599999994, 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018398247, 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551236+0000", 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551236+0000", 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551239+0000", 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9799999999999998e-06 2024-05-07T14:03:11.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555622+0000", 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043834360000000001 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555671+0000", 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8723000000000001e-05 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555698+0000", 2024-05-07T14:03:11.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7569999999999999e-05 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555854+0000", 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015590100000000001 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555910+0000", 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5408999999999998e-05 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.569455+0000", 2024-05-07T14:03:11.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013545587 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.569634+0000", 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000178641 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2223 3.14 3:28bf4dd4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.577681+0000", 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.0598763630000008, 2024-05-07T14:03:11.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020170006000000001, 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2223 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.577681+0000", 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.577681+0000", 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.577684+0000", 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0259999999999999e-06 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582465+0000", 2024-05-07T14:03:11.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047803910000000002 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582502+0000", 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6999999999999998e-05 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582520+0000", 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8586000000000001e-05 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582667+0000", 2024-05-07T14:03:11.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014653499999999999 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582958+0000", 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029067600000000002 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.583255+0000", 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000297492 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:11.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.593083+0000", 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0098283789999999999 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.597564+0000", 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044806580000000002 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.597727+0000", 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000163175 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.597851+0000", 2024-05-07T14:03:11.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012408800000000001 2024-05-07T14:03:11.699 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.699 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.699 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.699 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2224 3.1a 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:11.699 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:11.699 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.0492137489999998, 2024-05-07T14:03:11.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027796929000000001, 2024-05-07T14:03:11.699 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.699 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.700 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:11.700 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:11.700 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.700 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2224 2024-05-07T14:03:11.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.700 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:11.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588348+0000", 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1629999999999998e-06 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594043+0000", 2024-05-07T14:03:11.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056948950000000002 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594085+0000", 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1678999999999999e-05 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594113+0000", 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594221+0000", 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107371 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594405+0000", 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018468099999999999 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594570+0000", 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165224 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.603655+0000", 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090846550000000005 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.615968+0000", 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012313199 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616069+0000", 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100309 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616141+0000", 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2218999999999994e-05 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2227 3.1b e84/21 3:d8b15ce8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_26:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.643694+0000", 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.9938640860000003, 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013539658, 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.705 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.643694+0000", 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.643694+0000", 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.643696+0000", 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3800000000000001e-06 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648290+0000", 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045940709999999999 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648329+0000", 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9242999999999997e-05 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648347+0000", 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7382999999999999e-05 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648486+0000", 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138918 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648526+0000", 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0589000000000001e-05 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.657101+0000", 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085746859999999998 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.657233+0000", 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013238799999999999 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2229 3.3 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:11.709 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.9779172210000002, 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028304669000000001, 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2229 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659643+0000", 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9129999999999999e-06 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664151+0000", 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045081189999999997 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664198+0000", 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6431999999999999e-05 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664223+0000", 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5369999999999999e-05 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664313+0000", 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345999999999995e-05 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664428+0000", 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115058 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664566+0000", 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138598 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.671674+0000", 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071074529999999997 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687772+0000", 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016098359 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687871+0000", 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9098000000000006e-05 2024-05-07T14:03:11.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687945+0000", 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3923000000000004e-05 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2232 3.2c e84/21 3:35867d96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_31:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.697707+0000", 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.939850839, 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012234913, 2024-05-07T14:03:11.715 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697707+0000", 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697707+0000", 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697709+0000", 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0499999999999999e-06 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700047+0000", 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023379669999999998 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700091+0000", 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000003e-05 2024-05-07T14:03:11.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700117+0000", 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5666000000000001e-05 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700222+0000", 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010563199999999999 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700249+0000", 2024-05-07T14:03:11.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6582000000000001e-05 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.709888+0000", 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096386600000000003 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.709942+0000", 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4206000000000002e-05 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2235 3.f e84/21 3:f0588e63:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_34:head v 84'3, mlcod=84'1)", 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.729612+0000", 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.9079459810000001, 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011033015, 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.729612+0000", 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.729612+0000", 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.729613+0000", 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5340000000000001e-06 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731461+0000", 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001847301 2024-05-07T14:03:11.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731489+0000", 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8354e-05 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731503+0000", 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4623999999999999e-05 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731593+0000", 2024-05-07T14:03:11.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9098999999999995e-05 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731623+0000", 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0627999999999999e-05 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.740594+0000", 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089709620000000007 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.740645+0000", 2024-05-07T14:03:11.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0513000000000002e-05 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2243 3.1a 3:5a1260ab:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.807487+0000", 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.8300701989999997, 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015577779, 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:11.724 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2243 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.807487+0000", 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.807487+0000", 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:11.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.807503+0000", 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5214e-05 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811441+0000", 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039383059999999999 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811457+0000", 2024-05-07T14:03:11.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6095000000000001e-05 2024-05-07T14:03:11.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:11.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811466+0000", 2024-05-07T14:03:11.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9670000000000007e-06 2024-05-07T14:03:11.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:11.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811522+0000", 2024-05-07T14:03:11.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5461000000000003e-05 2024-05-07T14:03:11.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811636+0000", 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011476600000000001 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811733+0000", 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6234000000000001e-05 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.817874+0000", 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061410500000000003 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.822886+0000", 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050127909999999999 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.822982+0000", 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5681999999999996e-05 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823065+0000", 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3213000000000004e-05 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.729 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.730 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:11.730 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:11.730 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:11.731 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:11.732 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:11.740+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:11.832 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:11.844+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:11.899 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:11.899 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:11.899 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:11.899 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:11.913 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:11.933 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:11.944+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:12.036 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:12.044+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:12.080 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:12.081 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:12.095 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:03:12.136 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:12.148+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:12.237 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:12.248+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:12.265 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:12.266 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:12.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:12.266 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:12.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.266 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:415 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:12.266 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:12.266 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 125.07555829099999, 2024-05-07T14:03:12.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065364059999999998, 2024-05-07T14:03:12.266 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.266 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.266 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.266 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 415 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:12.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200339+0000", 2024-05-07T14:03:12.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.826e-06 2024-05-07T14:03:12.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200348+0000", 2024-05-07T14:03:12.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0669999999999998e-06 2024-05-07T14:03:12.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200378+0000", 2024-05-07T14:03:12.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.968e-05 2024-05-07T14:03:12.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200393+0000", 2024-05-07T14:03:12.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5109999999999999e-05 2024-05-07T14:03:12.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200515+0000", 2024-05-07T14:03:12.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121449 2024-05-07T14:03:12.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200658+0000", 2024-05-07T14:03:12.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014362199999999999 2024-05-07T14:03:12.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:12.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200958+0000", 2024-05-07T14:03:12.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030029699999999999 2024-05-07T14:03:12.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202106+0000", 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011475050000000001 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206707+0000", 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046009980000000002 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206791+0000", 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4118999999999999e-05 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206874+0000", 2024-05-07T14:03:12.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2732999999999995e-05 2024-05-07T14:03:12.272 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.272 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.272 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.272 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:430 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:12.272 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:12.272 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 125.065346977, 2024-05-07T14:03:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066752119999999998, 2024-05-07T14:03:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 430 2024-05-07T14:03:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210551+0000", 2024-05-07T14:03:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:03:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210562+0000", 2024-05-07T14:03:12.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0237e-05 2024-05-07T14:03:12.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210586+0000", 2024-05-07T14:03:12.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4066e-05 2024-05-07T14:03:12.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210603+0000", 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.713e-05 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211799+0000", 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001196127 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211931+0000", 2024-05-07T14:03:12.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131629 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212211+0000", 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028005100000000002 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.213288+0000", 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010772760000000001 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217047+0000", 2024-05-07T14:03:12.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037586569999999999 2024-05-07T14:03:12.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217127+0000", 2024-05-07T14:03:12.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0270000000000002e-05 2024-05-07T14:03:12.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217224+0000", 2024-05-07T14:03:12.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7139000000000006e-05 2024-05-07T14:03:12.278 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.278 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.279 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.279 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1482 3.30 3:0f9854c6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10MBfile1:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:12.279 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:12.279 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.906787726000001, 2024-05-07T14:03:12.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060631510000000001, 2024-05-07T14:03:12.279 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.279 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.279 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:03:12.279 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.279 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.279 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1482 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369111+0000", 2024-05-07T14:03:12.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2830000000000002e-06 2024-05-07T14:03:12.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369126+0000", 2024-05-07T14:03:12.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4693e-05 2024-05-07T14:03:12.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369160+0000", 2024-05-07T14:03:12.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4282999999999997e-05 2024-05-07T14:03:12.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369178+0000", 2024-05-07T14:03:12.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8153000000000001e-05 2024-05-07T14:03:12.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369385+0000", 2024-05-07T14:03:12.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020658699999999999 2024-05-07T14:03:12.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:12.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369396+0000", 2024-05-07T14:03:12.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0616e-05 2024-05-07T14:03:12.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.374884+0000", 2024-05-07T14:03:12.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005488461 2024-05-07T14:03:12.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.375171+0000", 2024-05-07T14:03:12.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028707500000000003 2024-05-07T14:03:12.283 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.284 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.284 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1611 3.30 3:0c405120:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:12.284 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:12.284 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.856685691999999, 2024-05-07T14:03:12.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021446044000000001, 2024-05-07T14:03:12.284 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.284 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.285 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.285 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.285 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.285 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1611 2024-05-07T14:03:12.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.285 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:12.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:12.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419212+0000", 2024-05-07T14:03:12.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3769999999999999e-06 2024-05-07T14:03:12.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425005+0000", 2024-05-07T14:03:12.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057928390000000001 2024-05-07T14:03:12.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425049+0000", 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3569999999999998e-05 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425068+0000", 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9582e-05 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425273+0000", 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020503000000000001 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425505+0000", 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023136000000000001 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425719+0000", 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021418000000000001 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.439395+0000", 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013675768 2024-05-07T14:03:12.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440495+0000", 2024-05-07T14:03:12.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00109987 2024-05-07T14:03:12.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440588+0000", 2024-05-07T14:03:12.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3429000000000003e-05 2024-05-07T14:03:12.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440656+0000", 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8039000000000004e-05 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1614 3.1d 3:baaad814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.831827392000001, 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024991276999999999, 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.291 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1614 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:12.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444071+0000", 2024-05-07T14:03:12.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6900000000000001e-06 2024-05-07T14:03:12.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448527+0000", 2024-05-07T14:03:12.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044560870000000001 2024-05-07T14:03:12.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448562+0000", 2024-05-07T14:03:12.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4576000000000002e-05 2024-05-07T14:03:12.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448578+0000", 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6209e-05 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448766+0000", 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018828700000000001 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.449033+0000", 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026696599999999999 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:12.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.449872+0000", 2024-05-07T14:03:12.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083849399999999996 2024-05-07T14:03:12.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.465016+0000", 2024-05-07T14:03:12.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015144061 2024-05-07T14:03:12.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.468867+0000", 2024-05-07T14:03:12.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003851246 2024-05-07T14:03:12.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.468987+0000", 2024-05-07T14:03:12.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011982899999999999 2024-05-07T14:03:12.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.469060+0000", 2024-05-07T14:03:12.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2831999999999997e-05 2024-05-07T14:03:12.298 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.298 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.298 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.298 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2205 3.28 3:177ebb78:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:12.298 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.319746+0000", 2024-05-07T14:03:12.298 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.9561502090000005, 2024-05-07T14:03:12.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022489056, 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2205 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.319746+0000", 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.319746+0000", 2024-05-07T14:03:12.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.319748+0000", 2024-05-07T14:03:12.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5890000000000001e-06 2024-05-07T14:03:12.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326256+0000", 2024-05-07T14:03:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065077659999999999 2024-05-07T14:03:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326287+0000", 2024-05-07T14:03:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1056999999999998e-05 2024-05-07T14:03:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326304+0000", 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6942000000000001e-05 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326386+0000", 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2202999999999999e-05 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326514+0000", 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000127744 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326626+0000", 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011235600000000001 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.335547+0000", 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089205910000000003 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.342079+0000", 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065326109999999998 2024-05-07T14:03:12.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.342164+0000", 2024-05-07T14:03:12.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4556999999999997e-05 2024-05-07T14:03:12.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.342235+0000", 2024-05-07T14:03:12.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0640000000000001e-05 2024-05-07T14:03:12.304 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.304 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.305 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.305 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2208 3.3a 3:5ee07aff:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:12.305 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.347341+0000", 2024-05-07T14:03:12.305 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.9285548190000004, 2024-05-07T14:03:12.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024383083, 2024-05-07T14:03:12.305 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.305 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.305 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.305 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.305 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.306 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.306 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2208 2024-05-07T14:03:12.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.306 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347341+0000", 2024-05-07T14:03:12.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347341+0000", 2024-05-07T14:03:12.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347346+0000", 2024-05-07T14:03:12.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6330000000000004e-06 2024-05-07T14:03:12.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351721+0000", 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043750070000000002 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351760+0000", 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9609e-05 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351780+0000", 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9352999999999999e-05 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351947+0000", 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016710800000000001 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.352347+0000", 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040036800000000001 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.352759+0000", 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041211399999999999 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365687+0000", 2024-05-07T14:03:12.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012927776 2024-05-07T14:03:12.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.371529+0000", 2024-05-07T14:03:12.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058423140000000004 2024-05-07T14:03:12.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.371636+0000", 2024-05-07T14:03:12.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107011 2024-05-07T14:03:12.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.371724+0000", 2024-05-07T14:03:12.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7789999999999998e-05 2024-05-07T14:03:12.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.311 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.312 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2210 3.28 3:157bdd2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:12.312 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.368019+0000", 2024-05-07T14:03:12.312 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.9078762390000001, 2024-05-07T14:03:12.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016829770000000001, 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2210 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.368019+0000", 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.368019+0000", 2024-05-07T14:03:12.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.368023+0000", 2024-05-07T14:03:12.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6679999999999999e-06 2024-05-07T14:03:12.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372491+0000", 2024-05-07T14:03:12.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044678970000000002 2024-05-07T14:03:12.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372538+0000", 2024-05-07T14:03:12.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7092000000000002e-05 2024-05-07T14:03:12.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372568+0000", 2024-05-07T14:03:12.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0046999999999999e-05 2024-05-07T14:03:12.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372692+0000", 2024-05-07T14:03:12.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012425199999999999 2024-05-07T14:03:12.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372957+0000", 2024-05-07T14:03:12.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026447500000000002 2024-05-07T14:03:12.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:12.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373231+0000", 2024-05-07T14:03:12.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027440800000000002 2024-05-07T14:03:12.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.383355+0000", 2024-05-07T14:03:12.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010123251999999999 2024-05-07T14:03:12.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.384680+0000", 2024-05-07T14:03:12.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013249410000000001 2024-05-07T14:03:12.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.384762+0000", 2024-05-07T14:03:12.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2965000000000003e-05 2024-05-07T14:03:12.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.384849+0000", 2024-05-07T14:03:12.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6773000000000004e-05 2024-05-07T14:03:12.319 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.319 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.319 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.319 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2213 3.d e84/21 3:b01db4c3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_12:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:12.319 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.432192+0000", 2024-05-07T14:03:12.319 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8437038670000003, 2024-05-07T14:03:12.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014503395000000001, 2024-05-07T14:03:12.320 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.320 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.320 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.320 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432192+0000", 2024-05-07T14:03:12.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432192+0000", 2024-05-07T14:03:12.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432195+0000", 2024-05-07T14:03:12.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7970000000000001e-06 2024-05-07T14:03:12.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435030+0000", 2024-05-07T14:03:12.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002835424 2024-05-07T14:03:12.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435087+0000", 2024-05-07T14:03:12.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7120000000000002e-05 2024-05-07T14:03:12.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435115+0000", 2024-05-07T14:03:12.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8116e-05 2024-05-07T14:03:12.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435224+0000", 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000108719 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435252+0000", 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8130999999999999e-05 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.446622+0000", 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011369719 2024-05-07T14:03:12.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.446695+0000", 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3368999999999995e-05 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2215 3.37 e84/21 3:eed806fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_14:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.462684+0000", 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8132119059999994, 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014112764, 2024-05-07T14:03:12.324 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.325 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.325 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.325 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462684+0000", 2024-05-07T14:03:12.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462684+0000", 2024-05-07T14:03:12.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462686+0000", 2024-05-07T14:03:12.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8339999999999999e-06 2024-05-07T14:03:12.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465341+0000", 2024-05-07T14:03:12.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026557099999999999 2024-05-07T14:03:12.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465378+0000", 2024-05-07T14:03:12.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6582999999999999e-05 2024-05-07T14:03:12.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465395+0000", 2024-05-07T14:03:12.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6765999999999998e-05 2024-05-07T14:03:12.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465550+0000", 2024-05-07T14:03:12.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015575800000000001 2024-05-07T14:03:12.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465591+0000", 2024-05-07T14:03:12.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0886999999999997e-05 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.476683+0000", 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011092061 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.476797+0000", 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113165 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.332 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2218 3.35 e84/21 3:af15427b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_17:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:12.332 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.517584+0000", 2024-05-07T14:03:12.332 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7583116009999991, 2024-05-07T14:03:12.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013750717000000001, 2024-05-07T14:03:12.332 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.332 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.332 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.332 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517584+0000", 2024-05-07T14:03:12.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517584+0000", 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517587+0000", 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8789999999999999e-06 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521588+0000", 2024-05-07T14:03:12.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040013649999999998 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521630+0000", 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1632999999999999e-05 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521649+0000", 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8623000000000001e-05 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521801+0000", 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000152688 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521843+0000", 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1993000000000003e-05 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531239+0000", 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093956779999999993 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531335+0000", 2024-05-07T14:03:12.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5858000000000003e-05 2024-05-07T14:03:12.336 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.336 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.336 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.336 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2222 3.2a 3:57d0a4ec:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:12.336 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.567662+0000", 2024-05-07T14:03:12.336 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7082337889999994, 2024-05-07T14:03:12.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020794828000000001, 2024-05-07T14:03:12.336 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.337 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.337 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.337 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.337 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.337 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.337 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2222 2024-05-07T14:03:12.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.337 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.567662+0000", 2024-05-07T14:03:12.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.567662+0000", 2024-05-07T14:03:12.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.567666+0000", 2024-05-07T14:03:12.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.58e-06 2024-05-07T14:03:12.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571748+0000", 2024-05-07T14:03:12.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040822109999999997 2024-05-07T14:03:12.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571783+0000", 2024-05-07T14:03:12.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5503000000000002e-05 2024-05-07T14:03:12.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571801+0000", 2024-05-07T14:03:12.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7943000000000001e-05 2024-05-07T14:03:12.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571926+0000", 2024-05-07T14:03:12.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012484799999999999 2024-05-07T14:03:12.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.572168+0000", 2024-05-07T14:03:12.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000242041 2024-05-07T14:03:12.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:12.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.572386+0000", 2024-05-07T14:03:12.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021758300000000001 2024-05-07T14:03:12.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.587086+0000", 2024-05-07T14:03:12.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014700095 2024-05-07T14:03:12.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588219+0000", 2024-05-07T14:03:12.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011328009999999999 2024-05-07T14:03:12.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588338+0000", 2024-05-07T14:03:12.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118959 2024-05-07T14:03:12.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588457+0000", 2024-05-07T14:03:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119264 2024-05-07T14:03:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.345 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2234 3.c 3:313f4c71:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.714603+0000", 2024-05-07T14:03:12.346 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.5612922319999996, 2024-05-07T14:03:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015738496000000001, 2024-05-07T14:03:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.347 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2234 2024-05-07T14:03:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.714603+0000", 2024-05-07T14:03:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.714603+0000", 2024-05-07T14:03:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.714606+0000", 2024-05-07T14:03:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4140000000000001e-06 2024-05-07T14:03:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718403+0000", 2024-05-07T14:03:12.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037968720000000002 2024-05-07T14:03:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718431+0000", 2024-05-07T14:03:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8384000000000001e-05 2024-05-07T14:03:12.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718443+0000", 2024-05-07T14:03:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2167999999999999e-05 2024-05-07T14:03:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718541+0000", 2024-05-07T14:03:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7979000000000005e-05 2024-05-07T14:03:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718737+0000", 2024-05-07T14:03:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019563 2024-05-07T14:03:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718943+0000", 2024-05-07T14:03:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000206407 2024-05-07T14:03:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.728383+0000", 2024-05-07T14:03:12.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094393529999999993 2024-05-07T14:03:12.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.730203+0000", 2024-05-07T14:03:12.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001819827 2024-05-07T14:03:12.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.730277+0000", 2024-05-07T14:03:12.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.436e-05 2024-05-07T14:03:12.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.730342+0000", 2024-05-07T14:03:12.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5102000000000001e-05 2024-05-07T14:03:12.358 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.359 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.359 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.359 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2239 3.36 e84/21 3:6db3e702:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_38:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:12.360 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.771643+0000", 2024-05-07T14:03:12.360 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.5042525500000004, 2024-05-07T14:03:12.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011577555, 2024-05-07T14:03:12.360 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.360 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.360 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.360 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771643+0000", 2024-05-07T14:03:12.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771643+0000", 2024-05-07T14:03:12.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771646+0000", 2024-05-07T14:03:12.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5560000000000002e-06 2024-05-07T14:03:12.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773601+0000", 2024-05-07T14:03:12.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019557239999999998 2024-05-07T14:03:12.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773627+0000", 2024-05-07T14:03:12.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5273999999999999e-05 2024-05-07T14:03:12.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773639+0000", 2024-05-07T14:03:12.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1990999999999999e-05 2024-05-07T14:03:12.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773719+0000", 2024-05-07T14:03:12.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0181999999999999e-05 2024-05-07T14:03:12.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773744+0000", 2024-05-07T14:03:12.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5055e-05 2024-05-07T14:03:12.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783134+0000", 2024-05-07T14:03:12.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093901839999999993 2024-05-07T14:03:12.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783221+0000", 2024-05-07T14:03:12.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6588999999999994e-05 2024-05-07T14:03:12.367 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.367 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.368 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.368 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2240 3.2f 3:f504276b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:12.368 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.776589+0000", 2024-05-07T14:03:12.368 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.4993071499999999, 2024-05-07T14:03:12.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016880398000000001, 2024-05-07T14:03:12.369 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.369 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.369 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.369 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.369 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.370 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2240 2024-05-07T14:03:12.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.370 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.776589+0000", 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.776589+0000", 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.776592+0000", 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0189999999999998e-06 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780426+0000", 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038339659999999998 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780446+0000", 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0237999999999998e-05 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780457+0000", 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1103e-05 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780539+0000", 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1682999999999997e-05 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780698+0000", 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015976299999999999 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780827+0000", 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012860599999999999 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.792875+0000", 2024-05-07T14:03:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012047904 2024-05-07T14:03:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.793367+0000", 2024-05-07T14:03:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00049221499999999995 2024-05-07T14:03:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.793418+0000", 2024-05-07T14:03:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1023000000000003e-05 2024-05-07T14:03:12.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.793469+0000", 2024-05-07T14:03:12.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0878000000000003e-05 2024-05-07T14:03:12.375 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.375 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.375 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.375 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2242 3.3c 3:3de0b8ca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:12.375 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.796914+0000", 2024-05-07T14:03:12.375 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.4789813659999993, 2024-05-07T14:03:12.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015934625000000001, 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2242 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.796914+0000", 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.796914+0000", 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.796916+0000", 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6390000000000001e-06 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800745+0000", 2024-05-07T14:03:12.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038292000000000001 2024-05-07T14:03:12.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800772+0000", 2024-05-07T14:03:12.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7155e-05 2024-05-07T14:03:12.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800784+0000", 2024-05-07T14:03:12.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1963e-05 2024-05-07T14:03:12.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800861+0000", 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6936999999999999e-05 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.801007+0000", 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014580100000000001 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.801126+0000", 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118613 2024-05-07T14:03:12.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.807740+0000", 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066147369999999999 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.812727+0000", 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049861769999999996 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.812791+0000", 2024-05-07T14:03:12.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4734999999999996e-05 2024-05-07T14:03:12.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.812849+0000", 2024-05-07T14:03:12.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7667999999999997e-05 2024-05-07T14:03:12.381 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.381 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.382 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.382 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2244 3.2f 3:f6c20744:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:12.382 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.819427+0000", 2024-05-07T14:03:12.382 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.4564684589999999, 2024-05-07T14:03:12.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015548795000000001, 2024-05-07T14:03:12.382 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.382 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.382 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.382 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.383 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.383 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.383 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2244 2024-05-07T14:03:12.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.383 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.819427+0000", 2024-05-07T14:03:12.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.819427+0000", 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.819430+0000", 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2350000000000002e-06 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823226+0000", 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037961309999999999 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823247+0000", 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1002999999999999e-05 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823256+0000", 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4369999999999996e-06 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823349+0000", 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3319000000000006e-05 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823550+0000", 2024-05-07T14:03:12.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020093699999999999 2024-05-07T14:03:12.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:12.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823751+0000", 2024-05-07T14:03:12.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000200466 2024-05-07T14:03:12.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834235+0000", 2024-05-07T14:03:12.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010483878 2024-05-07T14:03:12.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834822+0000", 2024-05-07T14:03:12.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058768600000000002 2024-05-07T14:03:12.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834912+0000", 2024-05-07T14:03:12.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0073000000000003e-05 2024-05-07T14:03:12.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834976+0000", 2024-05-07T14:03:12.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3629999999999999e-05 2024-05-07T14:03:12.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.388 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.388 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2245 3.d e84/21 3:b06e9c0d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_44:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:12.388 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.834936+0000", 2024-05-07T14:03:12.388 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.4409595070000005, 2024-05-07T14:03:12.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010748073, 2024-05-07T14:03:12.389 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.389 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.389 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.389 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834936+0000", 2024-05-07T14:03:12.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834936+0000", 2024-05-07T14:03:12.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834937+0000", 2024-05-07T14:03:12.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.99e-07 2024-05-07T14:03:12.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.836983+0000", 2024-05-07T14:03:12.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002045776 2024-05-07T14:03:12.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837005+0000", 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2680999999999998e-05 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837018+0000", 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2374999999999999e-05 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837143+0000", 2024-05-07T14:03:12.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012507100000000001 2024-05-07T14:03:12.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837184+0000", 2024-05-07T14:03:12.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1625000000000002e-05 2024-05-07T14:03:12.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.845599+0000", 2024-05-07T14:03:12.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084150500000000003 2024-05-07T14:03:12.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.845684+0000", 2024-05-07T14:03:12.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4895999999999995e-05 2024-05-07T14:03:12.393 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.393 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.393 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.393 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2498 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:12.393 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:03:12.394 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.8810113240000002, 2024-05-07T14:03:12.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.06015305, 2024-05-07T14:03:12.394 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.394 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.394 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:12.394 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.394 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.394 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.394 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2498 2024-05-07T14:03:12.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.394 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394887+0000", 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:03:12.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394900+0000", 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3125999999999999e-05 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394940+0000", 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9579999999999997e-05 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394961+0000", 2024-05-07T14:03:12.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1075999999999999e-05 2024-05-07T14:03:12.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395122+0000", 2024-05-07T14:03:12.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160741 2024-05-07T14:03:12.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:12.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395140+0000", 2024-05-07T14:03:12.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:03:12.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430325+0000", 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.03518512 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430355+0000", 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9181999999999999e-05 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.445424+0000", 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.015069751 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:12.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.446159+0000", 2024-05-07T14:03:12.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073452200000000004 2024-05-07T14:03:12.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450456+0000", 2024-05-07T14:03:12.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042973689999999997 2024-05-07T14:03:12.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450627+0000", 2024-05-07T14:03:12.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017032700000000001 2024-05-07T14:03:12.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455037+0000", 2024-05-07T14:03:12.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044108690000000004 2024-05-07T14:03:12.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.400 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.400 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2499 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:12.400 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:03:12.401 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.8808822750000003, 2024-05-07T14:03:12.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.065623158, 2024-05-07T14:03:12.401 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.401 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.401 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:12.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.401 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2499 2024-05-07T14:03:12.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.401 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:03:12.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:03:12.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395015+0000", 2024-05-07T14:03:12.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.57e-06 2024-05-07T14:03:12.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395022+0000", 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1330000000000001e-06 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395043+0000", 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1022999999999998e-05 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395060+0000", 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6325999999999999e-05 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395199+0000", 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139815 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395215+0000", 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5693e-05 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413112+0000", 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017896860000000001 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:12.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413143+0000", 2024-05-07T14:03:12.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1609000000000002e-05 2024-05-07T14:03:12.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.447430+0000", 2024-05-07T14:03:12.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0342867060000001 2024-05-07T14:03:12.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:12.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450079+0000", 2024-05-07T14:03:12.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002648386 2024-05-07T14:03:12.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455213+0000", 2024-05-07T14:03:12.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051342749999999998 2024-05-07T14:03:12.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455444+0000", 2024-05-07T14:03:12.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023070799999999999 2024-05-07T14:03:12.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.460637+0000", 2024-05-07T14:03:12.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051930539999999999 2024-05-07T14:03:12.408 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.408 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.408 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.408 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.408 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.408 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:12.410 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:03:12.410 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:12.420+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:12.484 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:03:12.511 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:12.520+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:12.537 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:12.538 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:12.538 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:12.538 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:12.553 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:03:12.611 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:12.620+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:12.712 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:12.724+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:12.720 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:12.720 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:12.720 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:12.721 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:12.721 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:12.734 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:03:12.813 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:12.824+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:12.906 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:12.907 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:12.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:12.907 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:12.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.907 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:03:12.907 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:12.907 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 128.89979009499999, 2024-05-07T14:03:12.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089647730000000005, 2024-05-07T14:03:12.907 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.907 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.907 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.907 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 46 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:12.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017451+0000", 2024-05-07T14:03:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9349999999999999e-06 2024-05-07T14:03:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017460+0000", 2024-05-07T14:03:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-05-07T14:03:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017481+0000", 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0984000000000001e-05 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017499+0000", 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018689+0000", 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001190303 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018945+0000", 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025626799999999998 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022176+0000", 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032308720000000001 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026078+0000", 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039018289999999999 2024-05-07T14:03:12.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026189+0000", 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110775 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026310+0000", 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121023 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026413+0000", 2024-05-07T14:03:12.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103346 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:337 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'5, mlcod=33'3)", 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 125.75033304599999, 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004459658, 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166908+0000", 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2259999999999999e-06 2024-05-07T14:03:12.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166922+0000", 2024-05-07T14:03:12.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4780000000000001e-05 2024-05-07T14:03:12.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166960+0000", 2024-05-07T14:03:12.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8173000000000002e-05 2024-05-07T14:03:12.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166981+0000", 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0440000000000001e-05 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167154+0000", 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017287199999999999 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167207+0000", 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000001e-05 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171283+0000", 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004076278 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171365+0000", 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1588999999999994e-05 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:349 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:12.917 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 125.74945825, 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042886440000000003, 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:12.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167782+0000", 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167797+0000", 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4533e-05 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167828+0000", 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1239999999999999e-05 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167859+0000", 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1007000000000003e-05 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168041+0000", 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181788 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168095+0000", 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3857000000000003e-05 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171961+0000", 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038664160000000001 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172069+0000", 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107793 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.921 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.922 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.922 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1563 4.a 4:50961e27:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:12.922 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:12.922 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.244584217, 2024-05-07T14:03:12.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050212310000000001, 2024-05-07T14:03:12.922 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.922 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.922 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.922 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.922 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.922 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1563 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672655+0000", 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.33e-06 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672662+0000", 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2400000000000004e-06 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672688+0000", 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6483e-05 2024-05-07T14:03:12.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672704+0000", 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6206e-05 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672789+0000", 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4445999999999998e-05 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672917+0000", 2024-05-07T14:03:12.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012805499999999999 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673210+0000", 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029306500000000001 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.675980+0000", 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002770223 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677420+0000", 2024-05-07T14:03:12.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001439397 2024-05-07T14:03:12.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677568+0000", 2024-05-07T14:03:12.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014831800000000001 2024-05-07T14:03:12.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677675+0000", 2024-05-07T14:03:12.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010746799999999999 2024-05-07T14:03:12.927 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.927 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1566 4.13 e81/23 4:cabacdb3:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.4:head v 81'5, mlcod=80'3)", 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.243408528, 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043209989999999998, 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673832+0000", 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1660000000000001e-06 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673850+0000", 2024-05-07T14:03:12.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7880000000000002e-05 2024-05-07T14:03:12.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673881+0000", 2024-05-07T14:03:12.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0883000000000002e-05 2024-05-07T14:03:12.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673900+0000", 2024-05-07T14:03:12.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9015999999999999e-05 2024-05-07T14:03:12.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674119+0000", 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000219113 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674175+0000", 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5962999999999999e-05 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678071+0000", 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003896119 2024-05-07T14:03:12.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678151+0000", 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9858999999999996e-05 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5165.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.764633831000001, 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059914829999999997, 2024-05-07T14:03:12.932 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5165", 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3551621939", 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 52 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:12.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152607+0000", 2024-05-07T14:03:12.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2840000000000001e-06 2024-05-07T14:03:12.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152620+0000", 2024-05-07T14:03:12.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3159999999999999e-05 2024-05-07T14:03:12.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152650+0000", 2024-05-07T14:03:12.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9835000000000001e-05 2024-05-07T14:03:12.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152672+0000", 2024-05-07T14:03:12.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2334e-05 2024-05-07T14:03:12.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152802+0000", 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013009799999999999 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152930+0000", 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012816100000000001 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.153119+0000", 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018862699999999999 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.154156+0000", 2024-05-07T14:03:12.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010365940000000001 2024-05-07T14:03:12.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158442+0000", 2024-05-07T14:03:12.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042868450000000001 2024-05-07T14:03:12.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158532+0000", 2024-05-07T14:03:12.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9135999999999995e-05 2024-05-07T14:03:12.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158596+0000", 2024-05-07T14:03:12.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4408999999999999e-05 2024-05-07T14:03:12.938 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.938 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.938 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5535.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.607785959000001, 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057064799999999999, 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5535", 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/4024516518", 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 52 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.939 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309455+0000", 2024-05-07T14:03:12.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0900000000000001e-06 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309469+0000", 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3013000000000001e-05 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309506+0000", 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7536000000000001e-05 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309523+0000", 2024-05-07T14:03:12.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7450000000000001e-05 2024-05-07T14:03:12.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309683+0000", 2024-05-07T14:03:12.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015954000000000001 2024-05-07T14:03:12.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309915+0000", 2024-05-07T14:03:12.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023159 2024-05-07T14:03:12.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:12.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.310272+0000", 2024-05-07T14:03:12.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035786100000000001 2024-05-07T14:03:12.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.311478+0000", 2024-05-07T14:03:12.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001205888 2024-05-07T14:03:12.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315002+0000", 2024-05-07T14:03:12.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035240419999999998 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315089+0000", 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6975e-05 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315159+0000", 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9494999999999998e-05 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1719 4.a 4:5321cf61:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.5.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.995144667000002, 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041945250000000002, 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1719 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.945 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922096+0000", 2024-05-07T14:03:12.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2800000000000002e-06 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922104+0000", 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.524e-06 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922130+0000", 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5367999999999998e-05 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922142+0000", 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2199e-05 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922238+0000", 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5754999999999994e-05 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922408+0000", 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017003999999999999 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922630+0000", 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221871 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.923677+0000", 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047517 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926214+0000", 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025365650000000002 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926251+0000", 2024-05-07T14:03:12.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7234000000000003e-05 2024-05-07T14:03:12.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926288+0000", 2024-05-07T14:03:12.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7172000000000003e-05 2024-05-07T14:03:12.950 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.950 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.950 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2203 3.1e e84/21 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.6157567549999996, 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021333873, 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301484+0000", 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9139999999999998e-06 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307602+0000", 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061184630000000002 2024-05-07T14:03:12.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307626+0000", 2024-05-07T14:03:12.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3937000000000001e-05 2024-05-07T14:03:12.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307637+0000", 2024-05-07T14:03:12.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1027e-05 2024-05-07T14:03:12.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307724+0000", 2024-05-07T14:03:12.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7435000000000006e-05 2024-05-07T14:03:12.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307759+0000", 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5098000000000002e-05 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322730+0000", 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014970651 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322815+0000", 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5347999999999997e-05 2024-05-07T14:03:12.955 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2207 3.26 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.5786424290000003, 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029257551999999999, 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.956 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2207 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338601+0000", 2024-05-07T14:03:12.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0769999999999998e-06 2024-05-07T14:03:12.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344166+0000", 2024-05-07T14:03:12.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055649139999999998 2024-05-07T14:03:12.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344203+0000", 2024-05-07T14:03:12.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7109e-05 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344221+0000", 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344394+0000", 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000173208 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344788+0000", 2024-05-07T14:03:12.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039418400000000001 2024-05-07T14:03:12.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:12.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345265+0000", 2024-05-07T14:03:12.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047689299999999999 2024-05-07T14:03:12.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365597+0000", 2024-05-07T14:03:12.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020331954999999999 2024-05-07T14:03:12.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367512+0000", 2024-05-07T14:03:12.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001915237 2024-05-07T14:03:12.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367693+0000", 2024-05-07T14:03:12.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018108800000000001 2024-05-07T14:03:12.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367853+0000", 2024-05-07T14:03:12.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016028400000000001 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2209 3.a 3:51944b39:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.5607426180000008, 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021277709999999998, 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.963 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2209 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356500+0000", 2024-05-07T14:03:12.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3499999999999999e-06 2024-05-07T14:03:12.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361252+0000", 2024-05-07T14:03:12.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047518980000000001 2024-05-07T14:03:12.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361291+0000", 2024-05-07T14:03:12.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8546e-05 2024-05-07T14:03:12.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361309+0000", 2024-05-07T14:03:12.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:03:12.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361477+0000", 2024-05-07T14:03:12.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016801399999999999 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361865+0000", 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038800199999999998 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362247+0000", 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038169099999999997 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373964+0000", 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01171701 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377549+0000", 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035850909999999999 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377657+0000", 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107593 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377773+0000", 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011687499999999999 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2214 3.33 e84/21 3:cdc86525:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_13:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.476912446, 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010229887999999999, 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.969 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.970 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:12.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:12.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440329+0000", 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7159999999999999e-06 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444193+0000", 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038645609999999999 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444219+0000", 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6262e-05 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444232+0000", 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2989999999999999e-05 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444307+0000", 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5011000000000004e-05 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444328+0000", 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0418e-05 2024-05-07T14:03:12.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450513+0000", 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061855419999999996 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450556+0000", 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2388000000000001e-05 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.973 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2218 3.35 3:af15427b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:12.974 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:12.974 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.4044574090000008, 2024-05-07T14:03:12.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019068912, 2024-05-07T14:03:12.974 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.974 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.974 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.974 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.974 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.974 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.974 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2218 2024-05-07T14:03:12.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.974 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512784+0000", 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3699999999999999e-06 2024-05-07T14:03:12.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516649+0000", 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003864644 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516684+0000", 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5403e-05 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516702+0000", 2024-05-07T14:03:12.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7346e-05 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516848+0000", 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000146198 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517099+0000", 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025069300000000002 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:12.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517328+0000", 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022939100000000001 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.527840+0000", 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010511786 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531674+0000", 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00383417 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531766+0000", 2024-05-07T14:03:12.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1859000000000003e-05 2024-05-07T14:03:12.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531850+0000", 2024-05-07T14:03:12.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4052000000000001e-05 2024-05-07T14:03:12.979 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.979 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.979 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.979 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2231 3.2e e84/21 3:767c3375:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_30:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.2331609579999991, 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01236056, 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684080+0000", 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5399999999999998e-06 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688628+0000", 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045475969999999996 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688662+0000", 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4919999999999998e-05 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688679+0000", 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6135999999999999e-05 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688793+0000", 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114005 2024-05-07T14:03:12.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688836+0000", 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3176000000000001e-05 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696350+0000", 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007513924 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696438+0000", 2024-05-07T14:03:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8262000000000003e-05 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2232 3.2c 3:35867d96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.2241689470000008, 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017519415, 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.984 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.985 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.985 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2232 2024-05-07T14:03:12.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.985 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:12.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:12.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693086+0000", 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6540000000000001e-05 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696895+0000", 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038088509999999998 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696915+0000", 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9972000000000001e-05 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696927+0000", 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1907e-05 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697040+0000", 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113621 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697286+0000", 2024-05-07T14:03:12.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024593299999999999 2024-05-07T14:03:12.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:12.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697518+0000", 2024-05-07T14:03:12.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023206999999999999 2024-05-07T14:03:12.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710196+0000", 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012677559 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710293+0000", 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559000000000006e-05 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710430+0000", 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137045 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710589+0000", 2024-05-07T14:03:12.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835799999999999 2024-05-07T14:03:12.990 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.990 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.990 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.990 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2238 3.2e e84/21 3:76550f67:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_37:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:12.990 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:12.990 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.1578915920000004, 2024-05-07T14:03:12.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011302262, 2024-05-07T14:03:12.990 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759348+0000", 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5939999999999999e-06 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763299+0000", 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039506139999999999 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763325+0000", 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6366000000000001e-05 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763341+0000", 2024-05-07T14:03:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.535e-05 2024-05-07T14:03:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763432+0000", 2024-05-07T14:03:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1757999999999998e-05 2024-05-07T14:03:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763462+0000", 2024-05-07T14:03:12.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9621e-05 2024-05-07T14:03:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.770571+0000", 2024-05-07T14:03:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071087779999999996 2024-05-07T14:03:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.770649+0000", 2024-05-07T14:03:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8181000000000002e-05 2024-05-07T14:03:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:12.994 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2239 3.36 3:6db3e702:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.1498906140000003, 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016205300999999998, 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2239 2024-05-07T14:03:12.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:12.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767350+0000", 2024-05-07T14:03:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2800000000000002e-06 2024-05-07T14:03:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771179+0000", 2024-05-07T14:03:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038294069999999999 2024-05-07T14:03:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771194+0000", 2024-05-07T14:03:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4103e-05 2024-05-07T14:03:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771204+0000", 2024-05-07T14:03:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0302999999999999e-05 2024-05-07T14:03:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771255+0000", 2024-05-07T14:03:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1483999999999997e-05 2024-05-07T14:03:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771364+0000", 2024-05-07T14:03:12.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010839499999999999 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771466+0000", 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010258499999999999 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.777053+0000", 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005586466 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:12.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783452+0000", 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063994409999999996 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783496+0000", 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3789999999999999e-05 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783553+0000", 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7046999999999998e-05 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2247 3.34 e84/21 3:2da2e766:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_46:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.0588638889999995, 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017996064999999999, 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:13.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858377+0000", 2024-05-07T14:03:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1830000000000001e-06 2024-05-07T14:03:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863640+0000", 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052637309999999998 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863674+0000", 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3142999999999998e-05 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863690+0000", 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6526000000000001e-05 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863787+0000", 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7180000000000001e-05 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863818+0000", 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1254999999999998e-05 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.876302+0000", 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012483449000000001 2024-05-07T14:03:13.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.876371+0000", 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8597999999999996e-05 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2507 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [call rgw.bucket_list in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.5015338910000002, 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.019773713, 2024-05-07T14:03:13.005 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2507 2024-05-07T14:03:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:13.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415708+0000", 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4860000000000002e-06 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415724+0000", 2024-05-07T14:03:13.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.643e-05 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415759+0000", 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4252999999999999e-05 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415783+0000", 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4315999999999999e-05 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:13.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419072+0000", 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032886119999999998 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419099+0000", 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6956000000000001e-05 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435061+0000", 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0159622509999999 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:13.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435231+0000", 2024-05-07T14:03:13.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016978800000000001 2024-05-07T14:03:13.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:13.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435478+0000", 2024-05-07T14:03:13.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024762100000000001 2024-05-07T14:03:13.010 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:13.010 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:13.010 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:13.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.010 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2548 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.4468857560000004, 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051163340000000002, 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2548 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8000000000000005e-07 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470358+0000", 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470372+0000", 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3847e-05 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470380+0000", 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5490000000000006e-06 2024-05-07T14:03:13.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:13.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470458+0000", 2024-05-07T14:03:13.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8267000000000001e-05 2024-05-07T14:03:13.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:13.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470883+0000", 2024-05-07T14:03:13.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042447600000000002 2024-05-07T14:03:13.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:13.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.472791+0000", 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019075889999999999 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.473623+0000", 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083288600000000002 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.473769+0000", 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014536599999999999 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.474681+0000", 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091173000000000003 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475319+0000", 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00063865600000000003 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475376+0000", 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7256000000000002e-05 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:13.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:13.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:13.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475469+0000", 2024-05-07T14:03:13.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2522000000000006e-05 2024-05-07T14:03:13.017 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:13.017 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:13.017 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:13.017 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:13.017 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:13.017 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:13.018 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:03:13.019 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:03:13.019 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:13.028+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:13.119 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:13.128+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:13.172 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:13.172 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:13.188 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:13.188 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:13.189 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:13.189 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:13.203 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:03:13.205 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:13.205 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:13.220 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:13.232+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:13.224 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:13.224 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:13.242 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:13.242 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:13.260 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:13.261 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:13.278 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:13.278 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:13.296 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:13.297 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:13.321 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:13.332+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:13.327 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:13.327 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:13.341 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:13.428 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:13.440+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:13.477 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:03:13.512 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:13.512 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:13.523 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:13.532+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:13.526 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:13.624 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:13.636+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:13.653 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:13.653 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:13.667 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:13.724 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:13.736+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:13.789 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:13.789 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:13.804 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:13.849 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:13.860+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:13.927 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:13.936+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:13.968 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:13.968 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:13.983 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:14.027 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:14.036+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:14.106 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:14.106 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:14.120 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:14.128 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:14.140+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:14.229 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:14.240+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:14.241 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:14.241 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:14.255 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:14.330 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:14.340+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:14.379 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:14.380 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:14.395 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:14.431 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:14.440+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:14.519 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:14.519 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:14.531 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:14.540+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:14.533 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:14.632 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:14.644+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:14.652 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:14.653 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:14.667 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:14.733 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:14.744+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:14.789 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:14.789 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:14.804 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:14.834 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:14.844+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:14.929 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:14.929 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:14.934 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:14.944+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:14.943 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:15.035 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:15.044+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:15.125 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:15.136 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:15.148+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:15.237 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:15.248+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:15.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:15.314 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:03:15.360 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:15.372+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:15.390 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:15.390 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:15.404 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:15.438 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:15.448+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:15.464 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:15.464 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:15.483 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:15.483 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:15.502 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:15.502 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:15.502 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:03:15.518 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:15.519 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:15.526 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:15.526 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:15.539 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:15.539 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:15.539 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:15.548+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:15.540 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:15.557 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:15.557 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:15.576 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:15.577 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:15.595 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:15.595 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:15.641 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:15.652+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:15.666 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:15.666 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:15.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:15.666 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:15.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.666 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 133.68396947799999, 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070064749999999999, 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 43 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994270+0000", 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994274+0000", 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7170000000000002e-06 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994292+0000", 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7819999999999999e-05 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994338+0000", 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6625999999999997e-05 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994362+0000", 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4063e-05 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994576+0000", 2024-05-07T14:03:15.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021319500000000001 2024-05-07T14:03:15.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:15.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:01.994598+0000", 2024-05-07T14:03:15.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2325999999999999e-05 2024-05-07T14:03:15.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001023+0000", 2024-05-07T14:03:15.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00642546 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:02.001277+0000", 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025326800000000002 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1566 4.13 4:cabacdb3:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.005351191999999, 2024-05-07T14:03:15.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057730890000000003, 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1566 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672888+0000", 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672890+0000", 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.606e-06 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672898+0000", 2024-05-07T14:03:15.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-06 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672924+0000", 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5599999999999999e-05 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672942+0000", 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7799999999999999e-05 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673078+0000", 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013645399999999999 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673280+0000", 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020144999999999999 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673597+0000", 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031715200000000002 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.675496+0000", 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018996830000000001 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678466+0000", 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029693639999999999 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678562+0000", 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6614999999999996e-05 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678661+0000", 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9024999999999995e-05 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1568 4.3d 4:bd9d380d:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.005256150000001, 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059901989999999999, 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.677 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1568 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672983+0000", 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672985+0000", 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4899999999999999e-06 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672992+0000", 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7229999999999998e-06 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673011+0000", 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9700000000000001e-05 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673026+0000", 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4506e-05 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674436+0000", 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001410445 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674635+0000", 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019898299999999999 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674957+0000", 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032126499999999999 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.676898+0000", 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019413989999999999 2024-05-07T14:03:15.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678780+0000", 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018816880000000001 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678912+0000", 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013280799999999999 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678974+0000", 2024-05-07T14:03:15.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1192000000000006e-05 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1570 4.1b 4:db659863:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.005190550999998, 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059406459999999999, 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:15.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1570 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673049+0000", 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673050+0000", 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1230000000000001e-06 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673056+0000", 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5639999999999996e-06 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673073+0000", 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7751999999999999e-05 2024-05-07T14:03:15.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673086+0000", 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2656999999999999e-05 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674276+0000", 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011896350000000001 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674479+0000", 2024-05-07T14:03:15.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020363600000000001 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674757+0000", 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027776599999999998 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677473+0000", 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027157739999999998 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678813+0000", 2024-05-07T14:03:15.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013401120000000001 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678931+0000", 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118322 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678990+0000", 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8304999999999998e-05 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1572 4.13 4:c90a81ac:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.005134564999999, 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062582080000000003, 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1572 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673105+0000", 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673106+0000", 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0729999999999999e-06 2024-05-07T14:03:15.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673111+0000", 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3070000000000002e-06 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673129+0000", 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673143+0000", 2024-05-07T14:03:15.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3579e-05 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674380+0000", 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001237908 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674578+0000", 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000197617 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:15.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674864+0000", 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028589499999999999 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678694+0000", 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038299900000000001 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679226+0000", 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053176199999999997 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679299+0000", 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3658000000000005e-05 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.679363+0000", 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3816e-05 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1612 3.3 3:c1191b65:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:15.694 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.255349401, 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013953758, 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1612 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422890+0000", 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.422894+0000", 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3400000000000002e-06 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426732+0000", 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038386760000000001 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426772+0000", 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9740000000000002e-05 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426791+0000", 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8793000000000001e-05 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.426935+0000", 2024-05-07T14:03:15.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144368 2024-05-07T14:03:15.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.427196+0000", 2024-05-07T14:03:15.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026091599999999998 2024-05-07T14:03:15.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:15.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.427426+0000", 2024-05-07T14:03:15.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022962899999999999 2024-05-07T14:03:15.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.434735+0000", 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073090990000000003 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436629+0000", 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018938640000000001 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436721+0000", 2024-05-07T14:03:15.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1943999999999999e-05 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.436844+0000", 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012338900000000001 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1614 3.1d e81/21 3:baaad814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4_10Mb.:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.228100101999999, 2024-05-07T14:03:15.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013565693, 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450139+0000", 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.450142+0000", 2024-05-07T14:03:15.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3970000000000001e-06 2024-05-07T14:03:15.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453081+0000", 2024-05-07T14:03:15.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0029395100000000002 2024-05-07T14:03:15.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453123+0000", 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1356000000000002e-05 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453142+0000", 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453311+0000", 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016885700000000001 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.453349+0000", 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8033e-05 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.463599+0000", 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010250011 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.463705+0000", 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000105839 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.704 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2206 3.f e84/21 3:f1007ae4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_5:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.334366+0000", 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.343873610999999, 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013342471999999999, 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334366+0000", 2024-05-07T14:03:15.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334366+0000", 2024-05-07T14:03:15.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334368+0000", 2024-05-07T14:03:15.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9860000000000001e-06 2024-05-07T14:03:15.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337428+0000", 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0030598969999999998 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337456+0000", 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8153999999999998e-05 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337470+0000", 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4446e-05 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337559+0000", 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8144000000000002e-05 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.337592+0000", 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3284999999999997e-05 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347590+0000", 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0099978580000000001 2024-05-07T14:03:15.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347708+0000", 2024-05-07T14:03:15.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118702 2024-05-07T14:03:15.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.709 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.709 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2209 3.a e84/21 3:51944b39:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_8:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:15.709 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.362568+0000", 2024-05-07T14:03:15.709 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.315671753, 2024-05-07T14:03:15.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010524235999999999, 2024-05-07T14:03:15.710 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.710 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.710 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.710 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362568+0000", 2024-05-07T14:03:15.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362568+0000", 2024-05-07T14:03:15.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362569+0000", 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3e-07 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365334+0000", 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027652950000000001 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365371+0000", 2024-05-07T14:03:15.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6946999999999997e-05 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365395+0000", 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4451999999999999e-05 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365495+0000", 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100227 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365521+0000", 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5211999999999998e-05 2024-05-07T14:03:15.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373033+0000", 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0075124399999999996 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373092+0000", 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8933e-05 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.714 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2211 3.13 e84/46 3:cbf4b364:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_10:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:15.714 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.392442+0000", 2024-05-07T14:03:15.714 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.285797592, 2024-05-07T14:03:15.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011680088, 2024-05-07T14:03:15.714 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.714 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.714 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.714 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.392442+0000", 2024-05-07T14:03:15.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.392442+0000", 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.392444+0000", 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7659999999999999e-06 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396574+0000", 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041300080000000001 2024-05-07T14:03:15.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396606+0000", 2024-05-07T14:03:15.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2503999999999999e-05 2024-05-07T14:03:15.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396619+0000", 2024-05-07T14:03:15.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3138e-05 2024-05-07T14:03:15.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396720+0000", 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100987 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.396749+0000", 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8520000000000001e-05 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.403988+0000", 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072395979999999999 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.404122+0000", 2024-05-07T14:03:15.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013356699999999999 2024-05-07T14:03:15.718 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.718 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.718 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.718 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2212 3.1a 3:591da10a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:15.718 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.409463+0000", 2024-05-07T14:03:15.718 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.268776493000001, 2024-05-07T14:03:15.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018426962000000002, 2024-05-07T14:03:15.718 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.718 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2212 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.409463+0000", 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.409463+0000", 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.409466+0000", 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8569999999999999e-06 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414439+0000", 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049734410000000003 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414466+0000", 2024-05-07T14:03:15.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6675000000000001e-05 2024-05-07T14:03:15.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414479+0000", 2024-05-07T14:03:15.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3047999999999999e-05 2024-05-07T14:03:15.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414548+0000", 2024-05-07T14:03:15.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8536999999999998e-05 2024-05-07T14:03:15.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414652+0000", 2024-05-07T14:03:15.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010464800000000001 2024-05-07T14:03:15.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:15.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.414741+0000", 2024-05-07T14:03:15.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8438999999999998e-05 2024-05-07T14:03:15.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.421987+0000", 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0072459000000000004 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427801+0000", 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058140140000000002 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427845+0000", 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3973000000000001e-05 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427890+0000", 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5429999999999997e-05 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2220 3.11 e84/21 3:8b7a5ffd:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_19:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.540816+0000", 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.137423140999999, 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016537718999999999, 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.724 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540816+0000", 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540816+0000", 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540818+0000", 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0600000000000002e-06 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.543930+0000", 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0031115299999999999 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.543973+0000", 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2932999999999997e-05 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.543998+0000", 2024-05-07T14:03:15.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5372999999999999e-05 2024-05-07T14:03:15.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.544132+0000", 2024-05-07T14:03:15.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013406799999999999 2024-05-07T14:03:15.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.544189+0000", 2024-05-07T14:03:15.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7086000000000002e-05 2024-05-07T14:03:15.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557266+0000", 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013076050000000001 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557354+0000", 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8619e-05 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.729 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2221 3.f e84/21 3:f1cd2e50:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_20:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:15.729 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.551236+0000", 2024-05-07T14:03:15.729 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.127003864000001, 2024-05-07T14:03:15.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018398247, 2024-05-07T14:03:15.729 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.729 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.729 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.729 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551236+0000", 2024-05-07T14:03:15.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551236+0000", 2024-05-07T14:03:15.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551239+0000", 2024-05-07T14:03:15.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9799999999999998e-06 2024-05-07T14:03:15.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555622+0000", 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043834360000000001 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555671+0000", 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8723000000000001e-05 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555698+0000", 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7569999999999999e-05 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555854+0000", 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015590100000000001 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.555910+0000", 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5408999999999998e-05 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.569455+0000", 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013545587 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.569634+0000", 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000178641 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2223 3.14 3:28bf4dd4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.577681+0000", 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.100558267, 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020170006000000001, 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.733 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2223 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.577681+0000", 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.577681+0000", 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.577684+0000", 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0259999999999999e-06 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582465+0000", 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047803910000000002 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582502+0000", 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6999999999999998e-05 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582520+0000", 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8586000000000001e-05 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582667+0000", 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014653499999999999 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.582958+0000", 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029067600000000002 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.583255+0000", 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000297492 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.593083+0000", 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0098283789999999999 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:15.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.597564+0000", 2024-05-07T14:03:15.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044806580000000002 2024-05-07T14:03:15.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.597727+0000", 2024-05-07T14:03:15.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000163175 2024-05-07T14:03:15.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.597851+0000", 2024-05-07T14:03:15.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012408800000000001 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2224 3.1a 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.089895652999999, 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027796929000000001, 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:15.739 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:15.740 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2224 2024-05-07T14:03:15.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.740 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:15.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:15.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588348+0000", 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1629999999999998e-06 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594043+0000", 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056948950000000002 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594085+0000", 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1678999999999999e-05 2024-05-07T14:03:15.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594113+0000", 2024-05-07T14:03:15.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:03:15.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594221+0000", 2024-05-07T14:03:15.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107371 2024-05-07T14:03:15.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594405+0000", 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018468099999999999 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594570+0000", 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165224 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.603655+0000", 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090846550000000005 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.615968+0000", 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012313199 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616069+0000", 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100309 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616141+0000", 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2218999999999994e-05 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.744 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2227 3.1b e84/21 3:d8b15ce8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_26:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.643694+0000", 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.03454599, 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013539658, 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.643694+0000", 2024-05-07T14:03:15.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.643694+0000", 2024-05-07T14:03:15.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.643696+0000", 2024-05-07T14:03:15.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3800000000000001e-06 2024-05-07T14:03:15.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648290+0000", 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045940709999999999 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648329+0000", 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9242999999999997e-05 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648347+0000", 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7382999999999999e-05 2024-05-07T14:03:15.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648486+0000", 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138918 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.648526+0000", 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0589000000000001e-05 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.657101+0000", 2024-05-07T14:03:15.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085746859999999998 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.657233+0000", 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013238799999999999 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2229 3.3 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.018599125, 2024-05-07T14:03:15.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028304669000000001, 2024-05-07T14:03:15.750 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.750 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.750 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.750 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:15.750 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:15.750 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:15.750 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2229 2024-05-07T14:03:15.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.750 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:15.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659643+0000", 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9129999999999999e-06 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664151+0000", 2024-05-07T14:03:15.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045081189999999997 2024-05-07T14:03:15.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664198+0000", 2024-05-07T14:03:15.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6431999999999999e-05 2024-05-07T14:03:15.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664223+0000", 2024-05-07T14:03:15.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5369999999999999e-05 2024-05-07T14:03:15.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664313+0000", 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345999999999995e-05 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664428+0000", 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115058 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664566+0000", 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138598 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:15.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.671674+0000", 2024-05-07T14:03:15.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071074529999999997 2024-05-07T14:03:15.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:15.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687772+0000", 2024-05-07T14:03:15.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016098359 2024-05-07T14:03:15.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687871+0000", 2024-05-07T14:03:15.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9098000000000006e-05 2024-05-07T14:03:15.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687945+0000", 2024-05-07T14:03:15.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3923000000000004e-05 2024-05-07T14:03:15.755 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.755 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.755 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.755 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2232 3.2c e84/21 3:35867d96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_31:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:15.755 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.697707+0000", 2024-05-07T14:03:15.755 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.980532742999999, 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012234913, 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697707+0000", 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697707+0000", 2024-05-07T14:03:15.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697709+0000", 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0499999999999999e-06 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700047+0000", 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0023379669999999998 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700091+0000", 2024-05-07T14:03:15.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4150000000000003e-05 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700117+0000", 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5666000000000001e-05 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700222+0000", 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010563199999999999 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.700249+0000", 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6582000000000001e-05 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.709888+0000", 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096386600000000003 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.709942+0000", 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4206000000000002e-05 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2235 3.f e84/21 3:f0588e63:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_34:head v 84'3, mlcod=84'1)", 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.729612+0000", 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.948627885000001, 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011033015, 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.729612+0000", 2024-05-07T14:03:15.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.729612+0000", 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.729613+0000", 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5340000000000001e-06 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731461+0000", 2024-05-07T14:03:15.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001847301 2024-05-07T14:03:15.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731489+0000", 2024-05-07T14:03:15.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8354e-05 2024-05-07T14:03:15.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731503+0000", 2024-05-07T14:03:15.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4623999999999999e-05 2024-05-07T14:03:15.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731593+0000", 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9098999999999995e-05 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.731623+0000", 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0627999999999999e-05 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.740594+0000", 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089709620000000007 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.740645+0000", 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0513000000000002e-05 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2243 3.1a 3:5a1260ab:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.807487+0000", 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.870752103000001, 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015577779, 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:15.764 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2243 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.807487+0000", 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:15.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.807487+0000", 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.807503+0000", 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5214e-05 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811441+0000", 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039383059999999999 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811457+0000", 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6095000000000001e-05 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811466+0000", 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9670000000000007e-06 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811522+0000", 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5461000000000003e-05 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811636+0000", 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011476600000000001 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.811733+0000", 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6234000000000001e-05 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.817874+0000", 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061410500000000003 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.822886+0000", 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050127909999999999 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.822982+0000", 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5681999999999996e-05 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823065+0000", 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3213000000000004e-05 2024-05-07T14:03:15.769 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.770 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:15.770 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:15.770 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:15.771 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:15.772 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:15.780+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:15.872 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:15.880+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:15.944 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:15.944 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:15.944 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:15.944 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:15.958 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:15.973 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:15.984+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:16.074 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:16.084+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:16.125 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:16.126 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:16.126 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:16.126 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:16.126 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:16.140 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:03:16.175 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:16.184+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:16.260 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.260 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:415 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 129.07042218699999, 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065364059999999998, 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 415 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200339+0000", 2024-05-07T14:03:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.826e-06 2024-05-07T14:03:16.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200348+0000", 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0669999999999998e-06 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200378+0000", 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.968e-05 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200393+0000", 2024-05-07T14:03:16.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5109999999999999e-05 2024-05-07T14:03:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200515+0000", 2024-05-07T14:03:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121449 2024-05-07T14:03:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200658+0000", 2024-05-07T14:03:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014362199999999999 2024-05-07T14:03:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200958+0000", 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030029699999999999 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202106+0000", 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011475050000000001 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206707+0000", 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046009980000000002 2024-05-07T14:03:16.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206791+0000", 2024-05-07T14:03:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4118999999999999e-05 2024-05-07T14:03:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206874+0000", 2024-05-07T14:03:16.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2732999999999995e-05 2024-05-07T14:03:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:430 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 129.06021087299999, 2024-05-07T14:03:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066752119999999998, 2024-05-07T14:03:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.267 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 430 2024-05-07T14:03:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210551+0000", 2024-05-07T14:03:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:03:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210562+0000", 2024-05-07T14:03:16.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0237e-05 2024-05-07T14:03:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210586+0000", 2024-05-07T14:03:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4066e-05 2024-05-07T14:03:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210603+0000", 2024-05-07T14:03:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.713e-05 2024-05-07T14:03:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211799+0000", 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001196127 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211931+0000", 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131629 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212211+0000", 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028005100000000002 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.213288+0000", 2024-05-07T14:03:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010772760000000001 2024-05-07T14:03:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217047+0000", 2024-05-07T14:03:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037586569999999999 2024-05-07T14:03:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217127+0000", 2024-05-07T14:03:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0270000000000002e-05 2024-05-07T14:03:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217224+0000", 2024-05-07T14:03:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7139000000000006e-05 2024-05-07T14:03:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1482 3.30 3:0f9854c6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10MBfile1:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.901651621999999, 2024-05-07T14:03:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060631510000000001, 2024-05-07T14:03:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:03:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1482 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369111+0000", 2024-05-07T14:03:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2830000000000002e-06 2024-05-07T14:03:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369126+0000", 2024-05-07T14:03:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4693e-05 2024-05-07T14:03:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369160+0000", 2024-05-07T14:03:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4282999999999997e-05 2024-05-07T14:03:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369178+0000", 2024-05-07T14:03:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8153000000000001e-05 2024-05-07T14:03:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369385+0000", 2024-05-07T14:03:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020658699999999999 2024-05-07T14:03:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369396+0000", 2024-05-07T14:03:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0616e-05 2024-05-07T14:03:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.374884+0000", 2024-05-07T14:03:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005488461 2024-05-07T14:03:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.375171+0000", 2024-05-07T14:03:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028707500000000003 2024-05-07T14:03:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1611 3.30 3:0c405120:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.851549588000001, 2024-05-07T14:03:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021446044000000001, 2024-05-07T14:03:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1611 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419212+0000", 2024-05-07T14:03:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3769999999999999e-06 2024-05-07T14:03:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425005+0000", 2024-05-07T14:03:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057928390000000001 2024-05-07T14:03:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425049+0000", 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3569999999999998e-05 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425068+0000", 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9582e-05 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425273+0000", 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020503000000000001 2024-05-07T14:03:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425505+0000", 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023136000000000001 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425719+0000", 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021418000000000001 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.439395+0000", 2024-05-07T14:03:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013675768 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440495+0000", 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00109987 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440588+0000", 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3429000000000003e-05 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440656+0000", 2024-05-07T14:03:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8039000000000004e-05 2024-05-07T14:03:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1614 3.1d 3:baaad814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.826691287999999, 2024-05-07T14:03:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024991276999999999, 2024-05-07T14:03:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1614 2024-05-07T14:03:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444071+0000", 2024-05-07T14:03:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6900000000000001e-06 2024-05-07T14:03:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448527+0000", 2024-05-07T14:03:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044560870000000001 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448562+0000", 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4576000000000002e-05 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448578+0000", 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6209e-05 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448766+0000", 2024-05-07T14:03:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018828700000000001 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.449033+0000", 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026696599999999999 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.449872+0000", 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083849399999999996 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.465016+0000", 2024-05-07T14:03:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015144061 2024-05-07T14:03:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.468867+0000", 2024-05-07T14:03:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003851246 2024-05-07T14:03:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.468987+0000", 2024-05-07T14:03:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011982899999999999 2024-05-07T14:03:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.469060+0000", 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2831999999999997e-05 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2205 3.28 3:177ebb78:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.319746+0000", 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.951014105, 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022489056, 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2205 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.319746+0000", 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.319746+0000", 2024-05-07T14:03:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.319748+0000", 2024-05-07T14:03:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5890000000000001e-06 2024-05-07T14:03:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326256+0000", 2024-05-07T14:03:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065077659999999999 2024-05-07T14:03:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326287+0000", 2024-05-07T14:03:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1056999999999998e-05 2024-05-07T14:03:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326304+0000", 2024-05-07T14:03:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6942000000000001e-05 2024-05-07T14:03:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326386+0000", 2024-05-07T14:03:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2202999999999999e-05 2024-05-07T14:03:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326514+0000", 2024-05-07T14:03:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000127744 2024-05-07T14:03:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326626+0000", 2024-05-07T14:03:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011235600000000001 2024-05-07T14:03:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.335547+0000", 2024-05-07T14:03:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089205910000000003 2024-05-07T14:03:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.342079+0000", 2024-05-07T14:03:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065326109999999998 2024-05-07T14:03:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.342164+0000", 2024-05-07T14:03:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4556999999999997e-05 2024-05-07T14:03:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.342235+0000", 2024-05-07T14:03:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0640000000000001e-05 2024-05-07T14:03:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2208 3.3a 3:5ee07aff:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.347341+0000", 2024-05-07T14:03:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.923418715, 2024-05-07T14:03:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024383083, 2024-05-07T14:03:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2208 2024-05-07T14:03:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347341+0000", 2024-05-07T14:03:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347341+0000", 2024-05-07T14:03:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347346+0000", 2024-05-07T14:03:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6330000000000004e-06 2024-05-07T14:03:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351721+0000", 2024-05-07T14:03:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043750070000000002 2024-05-07T14:03:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351760+0000", 2024-05-07T14:03:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9609e-05 2024-05-07T14:03:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351780+0000", 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9352999999999999e-05 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351947+0000", 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016710800000000001 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.352347+0000", 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040036800000000001 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.352759+0000", 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041211399999999999 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365687+0000", 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012927776 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.371529+0000", 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058423140000000004 2024-05-07T14:03:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.371636+0000", 2024-05-07T14:03:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107011 2024-05-07T14:03:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.371724+0000", 2024-05-07T14:03:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7789999999999998e-05 2024-05-07T14:03:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2210 3.28 3:157bdd2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.368019+0000", 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.902740135, 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016829770000000001, 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2210 2024-05-07T14:03:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.368019+0000", 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.368019+0000", 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.368023+0000", 2024-05-07T14:03:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6679999999999999e-06 2024-05-07T14:03:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372491+0000", 2024-05-07T14:03:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044678970000000002 2024-05-07T14:03:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372538+0000", 2024-05-07T14:03:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7092000000000002e-05 2024-05-07T14:03:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372568+0000", 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0046999999999999e-05 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372692+0000", 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012425199999999999 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372957+0000", 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026447500000000002 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373231+0000", 2024-05-07T14:03:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027440800000000002 2024-05-07T14:03:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.383355+0000", 2024-05-07T14:03:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010123251999999999 2024-05-07T14:03:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.384680+0000", 2024-05-07T14:03:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013249410000000001 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.384762+0000", 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2965000000000003e-05 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.384849+0000", 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6773000000000004e-05 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2213 3.d e84/21 3:b01db4c3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_12:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.432192+0000", 2024-05-07T14:03:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.838567763, 2024-05-07T14:03:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014503395000000001, 2024-05-07T14:03:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432192+0000", 2024-05-07T14:03:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432192+0000", 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432195+0000", 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7970000000000001e-06 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435030+0000", 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002835424 2024-05-07T14:03:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435087+0000", 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7120000000000002e-05 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435115+0000", 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8116e-05 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435224+0000", 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000108719 2024-05-07T14:03:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435252+0000", 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8130999999999999e-05 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.446622+0000", 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011369719 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.446695+0000", 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3368999999999995e-05 2024-05-07T14:03:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2215 3.37 e84/21 3:eed806fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_14:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.462684+0000", 2024-05-07T14:03:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.808075801999999, 2024-05-07T14:03:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014112764, 2024-05-07T14:03:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462684+0000", 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462684+0000", 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462686+0000", 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8339999999999999e-06 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465341+0000", 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026557099999999999 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465378+0000", 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6582999999999999e-05 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465395+0000", 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6765999999999998e-05 2024-05-07T14:03:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465550+0000", 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015575800000000001 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465591+0000", 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0886999999999997e-05 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.476683+0000", 2024-05-07T14:03:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011092061 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.476797+0000", 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113165 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2218 3.35 e84/21 3:af15427b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_17:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.517584+0000", 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.753175497000001, 2024-05-07T14:03:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013750717000000001, 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517584+0000", 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517584+0000", 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517587+0000", 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8789999999999999e-06 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521588+0000", 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040013649999999998 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521630+0000", 2024-05-07T14:03:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1632999999999999e-05 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521649+0000", 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8623000000000001e-05 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521801+0000", 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000152688 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521843+0000", 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1993000000000003e-05 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531239+0000", 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093956779999999993 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531335+0000", 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5858000000000003e-05 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2222 3.2a 3:57d0a4ec:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.567662+0000", 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.703097684999999, 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020794828000000001, 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2222 2024-05-07T14:03:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.567662+0000", 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.567662+0000", 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.567666+0000", 2024-05-07T14:03:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.58e-06 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571748+0000", 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040822109999999997 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571783+0000", 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5503000000000002e-05 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571801+0000", 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7943000000000001e-05 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571926+0000", 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012484799999999999 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.572168+0000", 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000242041 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.572386+0000", 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021758300000000001 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.587086+0000", 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014700095 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588219+0000", 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011328009999999999 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588338+0000", 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118959 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588457+0000", 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119264 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2234 3.c 3:313f4c71:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.714603+0000", 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.556156128, 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015738496000000001, 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2234 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.714603+0000", 2024-05-07T14:03:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.714603+0000", 2024-05-07T14:03:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.714606+0000", 2024-05-07T14:03:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4140000000000001e-06 2024-05-07T14:03:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718403+0000", 2024-05-07T14:03:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037968720000000002 2024-05-07T14:03:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718431+0000", 2024-05-07T14:03:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8384000000000001e-05 2024-05-07T14:03:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718443+0000", 2024-05-07T14:03:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2167999999999999e-05 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718541+0000", 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7979000000000005e-05 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718737+0000", 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019563 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718943+0000", 2024-05-07T14:03:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000206407 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.728383+0000", 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094393529999999993 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.730203+0000", 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001819827 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.730277+0000", 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.436e-05 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.730342+0000", 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5102000000000001e-05 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2239 3.36 e84/21 3:6db3e702:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_38:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.771643+0000", 2024-05-07T14:03:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.499116446, 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011577555, 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771643+0000", 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771643+0000", 2024-05-07T14:03:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771646+0000", 2024-05-07T14:03:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5560000000000002e-06 2024-05-07T14:03:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773601+0000", 2024-05-07T14:03:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019557239999999998 2024-05-07T14:03:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773627+0000", 2024-05-07T14:03:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5273999999999999e-05 2024-05-07T14:03:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773639+0000", 2024-05-07T14:03:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1990999999999999e-05 2024-05-07T14:03:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773719+0000", 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0181999999999999e-05 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773744+0000", 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5055e-05 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783134+0000", 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093901839999999993 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783221+0000", 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6588999999999994e-05 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2240 3.2f 3:f504276b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.776589+0000", 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.494171046, 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016880398000000001, 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2240 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.776589+0000", 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.776589+0000", 2024-05-07T14:03:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.776592+0000", 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0189999999999998e-06 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780426+0000", 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038339659999999998 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780446+0000", 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0237999999999998e-05 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780457+0000", 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1103e-05 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780539+0000", 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1682999999999997e-05 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780698+0000", 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015976299999999999 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780827+0000", 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012860599999999999 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.792875+0000", 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012047904 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.793367+0000", 2024-05-07T14:03:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00049221499999999995 2024-05-07T14:03:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.793418+0000", 2024-05-07T14:03:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1023000000000003e-05 2024-05-07T14:03:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.793469+0000", 2024-05-07T14:03:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0878000000000003e-05 2024-05-07T14:03:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2242 3.3c 3:3de0b8ca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.796914+0000", 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.473845261999999, 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015934625000000001, 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2242 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.796914+0000", 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.796914+0000", 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.796916+0000", 2024-05-07T14:03:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6390000000000001e-06 2024-05-07T14:03:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800745+0000", 2024-05-07T14:03:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038292000000000001 2024-05-07T14:03:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800772+0000", 2024-05-07T14:03:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7155e-05 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800784+0000", 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1963e-05 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800861+0000", 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6936999999999999e-05 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.801007+0000", 2024-05-07T14:03:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014580100000000001 2024-05-07T14:03:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.801126+0000", 2024-05-07T14:03:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118613 2024-05-07T14:03:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.807740+0000", 2024-05-07T14:03:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066147369999999999 2024-05-07T14:03:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.812727+0000", 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049861769999999996 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.812791+0000", 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4734999999999996e-05 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.812849+0000", 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7667999999999997e-05 2024-05-07T14:03:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2244 3.2f 3:f6c20744:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.819427+0000", 2024-05-07T14:03:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.451332355, 2024-05-07T14:03:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015548795000000001, 2024-05-07T14:03:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2244 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.819427+0000", 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.819427+0000", 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.819430+0000", 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2350000000000002e-06 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823226+0000", 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037961309999999999 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823247+0000", 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1002999999999999e-05 2024-05-07T14:03:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823256+0000", 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4369999999999996e-06 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823349+0000", 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3319000000000006e-05 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823550+0000", 2024-05-07T14:03:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020093699999999999 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823751+0000", 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000200466 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834235+0000", 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010483878 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834822+0000", 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058768600000000002 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834912+0000", 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0073000000000003e-05 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834976+0000", 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3629999999999999e-05 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2245 3.d e84/21 3:b06e9c0d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_44:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.834936+0000", 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.435823403000001, 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010748073, 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834936+0000", 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834936+0000", 2024-05-07T14:03:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834937+0000", 2024-05-07T14:03:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.99e-07 2024-05-07T14:03:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.836983+0000", 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002045776 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837005+0000", 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2680999999999998e-05 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837018+0000", 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2374999999999999e-05 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837143+0000", 2024-05-07T14:03:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012507100000000001 2024-05-07T14:03:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837184+0000", 2024-05-07T14:03:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1625000000000002e-05 2024-05-07T14:03:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.845599+0000", 2024-05-07T14:03:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084150500000000003 2024-05-07T14:03:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.845684+0000", 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4895999999999995e-05 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2498 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.8758752199999993, 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.06015305, 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2498 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394887+0000", 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394900+0000", 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3125999999999999e-05 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394940+0000", 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9579999999999997e-05 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394961+0000", 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1075999999999999e-05 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395122+0000", 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160741 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395140+0000", 2024-05-07T14:03:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:03:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430325+0000", 2024-05-07T14:03:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.03518512 2024-05-07T14:03:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430355+0000", 2024-05-07T14:03:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9181999999999999e-05 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.445424+0000", 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.015069751 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.446159+0000", 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073452200000000004 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450456+0000", 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042973689999999997 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450627+0000", 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017032700000000001 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455037+0000", 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044108690000000004 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2499 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.8757461709999994, 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.065623158, 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2499 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395015+0000", 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.57e-06 2024-05-07T14:03:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395022+0000", 2024-05-07T14:03:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1330000000000001e-06 2024-05-07T14:03:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395043+0000", 2024-05-07T14:03:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1022999999999998e-05 2024-05-07T14:03:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395060+0000", 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6325999999999999e-05 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395199+0000", 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139815 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395215+0000", 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5693e-05 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413112+0000", 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017896860000000001 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413143+0000", 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1609000000000002e-05 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.447430+0000", 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0342867060000001 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450079+0000", 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002648386 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455213+0000", 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051342749999999998 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455444+0000", 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023070799999999999 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.460637+0000", 2024-05-07T14:03:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051930539999999999 2024-05-07T14:03:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.374 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:16.376 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:03:16.376 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:16.384+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:16.476 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:16.488+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:16.498 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:03:16.550 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:16.550 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:16.550 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:16.550 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:16.564 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:03:16.608 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:16.620+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:16.678 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:16.688+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:16.687 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:16.687 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:16.687 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:16.687 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:16.687 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:16.701 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:03:16.779 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:16.788+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:16.869 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:16.870 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:16.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:16.870 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:16.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.870 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:03:16.870 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:16.870 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 132.86313344499999, 2024-05-07T14:03:16.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089647730000000005, 2024-05-07T14:03:16.870 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.871 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.871 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.871 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.871 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.871 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.871 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 46 2024-05-07T14:03:16.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.871 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:16.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017451+0000", 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9349999999999999e-06 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017460+0000", 2024-05-07T14:03:16.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-05-07T14:03:16.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017481+0000", 2024-05-07T14:03:16.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0984000000000001e-05 2024-05-07T14:03:16.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017499+0000", 2024-05-07T14:03:16.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:03:16.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018689+0000", 2024-05-07T14:03:16.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001190303 2024-05-07T14:03:16.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018945+0000", 2024-05-07T14:03:16.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025626799999999998 2024-05-07T14:03:16.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:16.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022176+0000", 2024-05-07T14:03:16.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032308720000000001 2024-05-07T14:03:16.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026078+0000", 2024-05-07T14:03:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039018289999999999 2024-05-07T14:03:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026189+0000", 2024-05-07T14:03:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110775 2024-05-07T14:03:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026310+0000", 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121023 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026413+0000", 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103346 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.876 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:337 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'5, mlcod=33'3)", 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 129.71367639600001, 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004459658, 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:16.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166908+0000", 2024-05-07T14:03:16.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2259999999999999e-06 2024-05-07T14:03:16.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166922+0000", 2024-05-07T14:03:16.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4780000000000001e-05 2024-05-07T14:03:16.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166960+0000", 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8173000000000002e-05 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166981+0000", 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0440000000000001e-05 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167154+0000", 2024-05-07T14:03:16.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017287199999999999 2024-05-07T14:03:16.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167207+0000", 2024-05-07T14:03:16.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000001e-05 2024-05-07T14:03:16.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171283+0000", 2024-05-07T14:03:16.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004076278 2024-05-07T14:03:16.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171365+0000", 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1588999999999994e-05 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:349 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 129.71280160000001, 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042886440000000003, 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.881 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.882 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:16.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:16.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167782+0000", 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167797+0000", 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4533e-05 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167828+0000", 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1239999999999999e-05 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167859+0000", 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1007000000000003e-05 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168041+0000", 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181788 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168095+0000", 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3857000000000003e-05 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171961+0000", 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038664160000000001 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172069+0000", 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107793 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.885 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1563 4.a 4:50961e27:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:16.886 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:16.886 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.207927566999999, 2024-05-07T14:03:16.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050212310000000001, 2024-05-07T14:03:16.886 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.886 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.886 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.886 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.886 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.886 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.886 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1563 2024-05-07T14:03:16.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.886 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:16.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:16.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672655+0000", 2024-05-07T14:03:16.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.33e-06 2024-05-07T14:03:16.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672662+0000", 2024-05-07T14:03:16.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2400000000000004e-06 2024-05-07T14:03:16.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672688+0000", 2024-05-07T14:03:16.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6483e-05 2024-05-07T14:03:16.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672704+0000", 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6206e-05 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672789+0000", 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4445999999999998e-05 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672917+0000", 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012805499999999999 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:16.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673210+0000", 2024-05-07T14:03:16.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029306500000000001 2024-05-07T14:03:16.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.675980+0000", 2024-05-07T14:03:16.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002770223 2024-05-07T14:03:16.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677420+0000", 2024-05-07T14:03:16.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001439397 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677568+0000", 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014831800000000001 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677675+0000", 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010746799999999999 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1566 4.13 e81/23 4:cabacdb3:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.4:head v 81'5, mlcod=80'3)", 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.206751877999999, 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043209989999999998, 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673832+0000", 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1660000000000001e-06 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673850+0000", 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7880000000000002e-05 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673881+0000", 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0883000000000002e-05 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673900+0000", 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9015999999999999e-05 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674119+0000", 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000219113 2024-05-07T14:03:16.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674175+0000", 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5962999999999999e-05 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678071+0000", 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003896119 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678151+0000", 2024-05-07T14:03:16.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9858999999999996e-05 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5165.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.727977181, 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059914829999999997, 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.896 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5165", 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3551621939", 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 52 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152607+0000", 2024-05-07T14:03:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2840000000000001e-06 2024-05-07T14:03:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152620+0000", 2024-05-07T14:03:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3159999999999999e-05 2024-05-07T14:03:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152650+0000", 2024-05-07T14:03:16.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9835000000000001e-05 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152672+0000", 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2334e-05 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152802+0000", 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013009799999999999 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152930+0000", 2024-05-07T14:03:16.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012816100000000001 2024-05-07T14:03:16.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:16.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.153119+0000", 2024-05-07T14:03:16.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018862699999999999 2024-05-07T14:03:16.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.154156+0000", 2024-05-07T14:03:16.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010365940000000001 2024-05-07T14:03:16.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158442+0000", 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042868450000000001 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158532+0000", 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9135999999999995e-05 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158596+0000", 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4408999999999999e-05 2024-05-07T14:03:16.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.902 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.902 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.902 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5535.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:16.902 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:16.902 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.571129309, 2024-05-07T14:03:16.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057064799999999999, 2024-05-07T14:03:16.902 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.902 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.902 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.902 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.903 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5535", 2024-05-07T14:03:16.903 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/4024516518", 2024-05-07T14:03:16.903 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 52 2024-05-07T14:03:16.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.903 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:16.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309455+0000", 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0900000000000001e-06 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309469+0000", 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3013000000000001e-05 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309506+0000", 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7536000000000001e-05 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309523+0000", 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7450000000000001e-05 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309683+0000", 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015954000000000001 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309915+0000", 2024-05-07T14:03:16.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023159 2024-05-07T14:03:16.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:16.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.310272+0000", 2024-05-07T14:03:16.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035786100000000001 2024-05-07T14:03:16.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.311478+0000", 2024-05-07T14:03:16.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001205888 2024-05-07T14:03:16.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315002+0000", 2024-05-07T14:03:16.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035240419999999998 2024-05-07T14:03:16.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315089+0000", 2024-05-07T14:03:16.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6975e-05 2024-05-07T14:03:16.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315159+0000", 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9494999999999998e-05 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1719 4.a 4:5321cf61:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.5.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.958488017000001, 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041945250000000002, 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.908 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.909 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.909 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.909 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.909 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1719 2024-05-07T14:03:16.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.909 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:16.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:16.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922096+0000", 2024-05-07T14:03:16.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2800000000000002e-06 2024-05-07T14:03:16.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922104+0000", 2024-05-07T14:03:16.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.524e-06 2024-05-07T14:03:16.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922130+0000", 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5367999999999998e-05 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922142+0000", 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2199e-05 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922238+0000", 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5754999999999994e-05 2024-05-07T14:03:16.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922408+0000", 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017003999999999999 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922630+0000", 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221871 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.923677+0000", 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047517 2024-05-07T14:03:16.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926214+0000", 2024-05-07T14:03:16.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025365650000000002 2024-05-07T14:03:16.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926251+0000", 2024-05-07T14:03:16.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7234000000000003e-05 2024-05-07T14:03:16.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926288+0000", 2024-05-07T14:03:16.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7172000000000003e-05 2024-05-07T14:03:16.914 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.914 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.914 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.914 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2203 3.1e e84/21 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:16.914 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:16.914 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.579100105, 2024-05-07T14:03:16.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021333873, 2024-05-07T14:03:16.914 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.914 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301484+0000", 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9139999999999998e-06 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307602+0000", 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061184630000000002 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307626+0000", 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3937000000000001e-05 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307637+0000", 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1027e-05 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307724+0000", 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7435000000000006e-05 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307759+0000", 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5098000000000002e-05 2024-05-07T14:03:16.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322730+0000", 2024-05-07T14:03:16.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014970651 2024-05-07T14:03:16.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322815+0000", 2024-05-07T14:03:16.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5347999999999997e-05 2024-05-07T14:03:16.918 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.918 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.918 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2207 3.26 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.541985779000001, 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029257551999999999, 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2207 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.919 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338601+0000", 2024-05-07T14:03:16.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0769999999999998e-06 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344166+0000", 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055649139999999998 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344203+0000", 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7109e-05 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344221+0000", 2024-05-07T14:03:16.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:03:16.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344394+0000", 2024-05-07T14:03:16.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000173208 2024-05-07T14:03:16.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344788+0000", 2024-05-07T14:03:16.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039418400000000001 2024-05-07T14:03:16.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345265+0000", 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047689299999999999 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365597+0000", 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020331954999999999 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367512+0000", 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001915237 2024-05-07T14:03:16.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367693+0000", 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018108800000000001 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367853+0000", 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016028400000000001 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.924 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2209 3.a 3:51944b39:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:16.925 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:16.925 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.524085968, 2024-05-07T14:03:16.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021277709999999998, 2024-05-07T14:03:16.925 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.925 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.925 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.925 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.925 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.925 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.925 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2209 2024-05-07T14:03:16.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.925 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:16.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:16.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356500+0000", 2024-05-07T14:03:16.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3499999999999999e-06 2024-05-07T14:03:16.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361252+0000", 2024-05-07T14:03:16.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047518980000000001 2024-05-07T14:03:16.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361291+0000", 2024-05-07T14:03:16.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8546e-05 2024-05-07T14:03:16.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361309+0000", 2024-05-07T14:03:16.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:03:16.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361477+0000", 2024-05-07T14:03:16.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016801399999999999 2024-05-07T14:03:16.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361865+0000", 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038800199999999998 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362247+0000", 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038169099999999997 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373964+0000", 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01171701 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377549+0000", 2024-05-07T14:03:16.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035850909999999999 2024-05-07T14:03:16.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377657+0000", 2024-05-07T14:03:16.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107593 2024-05-07T14:03:16.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377773+0000", 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011687499999999999 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2214 3.33 e84/21 3:cdc86525:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_13:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.440255796000001, 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010229887999999999, 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.931 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440329+0000", 2024-05-07T14:03:16.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7159999999999999e-06 2024-05-07T14:03:16.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444193+0000", 2024-05-07T14:03:16.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038645609999999999 2024-05-07T14:03:16.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444219+0000", 2024-05-07T14:03:16.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6262e-05 2024-05-07T14:03:16.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444232+0000", 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2989999999999999e-05 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444307+0000", 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5011000000000004e-05 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444328+0000", 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0418e-05 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450513+0000", 2024-05-07T14:03:16.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061855419999999996 2024-05-07T14:03:16.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450556+0000", 2024-05-07T14:03:16.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2388000000000001e-05 2024-05-07T14:03:16.935 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.935 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.935 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2218 3.35 3:af15427b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.367800759, 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019068912, 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2218 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512784+0000", 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3699999999999999e-06 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516649+0000", 2024-05-07T14:03:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003864644 2024-05-07T14:03:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516684+0000", 2024-05-07T14:03:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5403e-05 2024-05-07T14:03:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516702+0000", 2024-05-07T14:03:16.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7346e-05 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516848+0000", 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000146198 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517099+0000", 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025069300000000002 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:16.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517328+0000", 2024-05-07T14:03:16.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022939100000000001 2024-05-07T14:03:16.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.527840+0000", 2024-05-07T14:03:16.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010511786 2024-05-07T14:03:16.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531674+0000", 2024-05-07T14:03:16.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00383417 2024-05-07T14:03:16.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531766+0000", 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1859000000000003e-05 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531850+0000", 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4052000000000001e-05 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.941 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2231 3.2e e84/21 3:767c3375:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_30:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.196504308, 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01236056, 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684080+0000", 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5399999999999998e-06 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688628+0000", 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045475969999999996 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688662+0000", 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4919999999999998e-05 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688679+0000", 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6135999999999999e-05 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688793+0000", 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114005 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688836+0000", 2024-05-07T14:03:16.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3176000000000001e-05 2024-05-07T14:03:16.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696350+0000", 2024-05-07T14:03:16.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007513924 2024-05-07T14:03:16.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696438+0000", 2024-05-07T14:03:16.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8262000000000003e-05 2024-05-07T14:03:16.945 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.946 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.946 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.946 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2232 3.2c 3:35867d96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:16.946 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:16.946 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.187512297, 2024-05-07T14:03:16.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017519415, 2024-05-07T14:03:16.946 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.946 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.946 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.946 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.946 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2232 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693086+0000", 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6540000000000001e-05 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696895+0000", 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038088509999999998 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696915+0000", 2024-05-07T14:03:16.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9972000000000001e-05 2024-05-07T14:03:16.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696927+0000", 2024-05-07T14:03:16.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1907e-05 2024-05-07T14:03:16.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697040+0000", 2024-05-07T14:03:16.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113621 2024-05-07T14:03:16.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697286+0000", 2024-05-07T14:03:16.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024593299999999999 2024-05-07T14:03:16.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:16.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697518+0000", 2024-05-07T14:03:16.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023206999999999999 2024-05-07T14:03:16.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710196+0000", 2024-05-07T14:03:16.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012677559 2024-05-07T14:03:16.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710293+0000", 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559000000000006e-05 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710430+0000", 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137045 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710589+0000", 2024-05-07T14:03:16.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835799999999999 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2238 3.2e e84/21 3:76550f67:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_37:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.121234941999999, 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011302262, 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759348+0000", 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5939999999999999e-06 2024-05-07T14:03:16.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763299+0000", 2024-05-07T14:03:16.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039506139999999999 2024-05-07T14:03:16.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763325+0000", 2024-05-07T14:03:16.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6366000000000001e-05 2024-05-07T14:03:16.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763341+0000", 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.535e-05 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763432+0000", 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1757999999999998e-05 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763462+0000", 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9621e-05 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.770571+0000", 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071087779999999996 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.770649+0000", 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8181000000000002e-05 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.956 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2239 3.36 3:6db3e702:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.113233964000001, 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016205300999999998, 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2239 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767350+0000", 2024-05-07T14:03:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2800000000000002e-06 2024-05-07T14:03:16.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771179+0000", 2024-05-07T14:03:16.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038294069999999999 2024-05-07T14:03:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771194+0000", 2024-05-07T14:03:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4103e-05 2024-05-07T14:03:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771204+0000", 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0302999999999999e-05 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771255+0000", 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1483999999999997e-05 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771364+0000", 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010839499999999999 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771466+0000", 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010258499999999999 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.777053+0000", 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005586466 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783452+0000", 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063994409999999996 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783496+0000", 2024-05-07T14:03:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3789999999999999e-05 2024-05-07T14:03:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783553+0000", 2024-05-07T14:03:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7046999999999998e-05 2024-05-07T14:03:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2247 3.34 e84/21 3:2da2e766:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_46:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.022207239, 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017996064999999999, 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858377+0000", 2024-05-07T14:03:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1830000000000001e-06 2024-05-07T14:03:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863640+0000", 2024-05-07T14:03:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052637309999999998 2024-05-07T14:03:16.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863674+0000", 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3142999999999998e-05 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863690+0000", 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6526000000000001e-05 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863787+0000", 2024-05-07T14:03:16.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7180000000000001e-05 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863818+0000", 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1254999999999998e-05 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.876302+0000", 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012483449000000001 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.876371+0000", 2024-05-07T14:03:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8597999999999996e-05 2024-05-07T14:03:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2507 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [call rgw.bucket_list in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.464877241, 2024-05-07T14:03:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.019773713, 2024-05-07T14:03:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.969 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2507 2024-05-07T14:03:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415708+0000", 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4860000000000002e-06 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415724+0000", 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.643e-05 2024-05-07T14:03:16.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415759+0000", 2024-05-07T14:03:16.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4252999999999999e-05 2024-05-07T14:03:16.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415783+0000", 2024-05-07T14:03:16.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4315999999999999e-05 2024-05-07T14:03:16.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419072+0000", 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032886119999999998 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419099+0000", 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6956000000000001e-05 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435061+0000", 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0159622509999999 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435231+0000", 2024-05-07T14:03:16.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016978800000000001 2024-05-07T14:03:16.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435478+0000", 2024-05-07T14:03:16.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024762100000000001 2024-05-07T14:03:16.974 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.974 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.974 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.974 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2548 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.4102291059999992, 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051163340000000002, 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2548 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:16.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8000000000000005e-07 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470358+0000", 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470372+0000", 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3847e-05 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470380+0000", 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5490000000000006e-06 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470458+0000", 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8267000000000001e-05 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470883+0000", 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042447600000000002 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.472791+0000", 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019075889999999999 2024-05-07T14:03:16.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.473623+0000", 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083288600000000002 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.473769+0000", 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014536599999999999 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.474681+0000", 2024-05-07T14:03:16.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091173000000000003 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475319+0000", 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00063865600000000003 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475376+0000", 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7256000000000002e-05 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475469+0000", 2024-05-07T14:03:16.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2522000000000006e-05 2024-05-07T14:03:16.981 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.981 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.981 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.981 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:16.981 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:16.981 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:16.983 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:03:16.983 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:16.996+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:17.083 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:17.092+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:17.150 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:17.150 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:17.150 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:17.150 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:17.165 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:03:17.185 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:17.196+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:17.286 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:17.300+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:17.326 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:17.326 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:17.339 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:17.387 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:17.396+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:17.462 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 152.64477065700001, 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63420480000000001, 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827477+0000", 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827491+0000", 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3923999999999999e-05 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827514+0000", 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2796e-05 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827531+0000", 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7520000000000002e-05 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827677+0000", 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145408 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827703+0000", 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6704e-05 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.458662+0000", 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63095893199999997 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459006+0000", 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034329 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459320+0000", 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031472100000000001 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.460665+0000", 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001344633 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461508+0000", 2024-05-07T14:03:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084310400000000001 2024-05-07T14:03:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461608+0000", 2024-05-07T14:03:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9481999999999994e-05 2024-05-07T14:03:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461680+0000", 2024-05-07T14:03:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1976000000000003e-05 2024-05-07T14:03:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 151.661220262, 2024-05-07T14:03:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017650448999999999, 2024-05-07T14:03:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 111 2024-05-07T14:03:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811026+0000", 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5300000000000004e-07 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811031+0000", 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0329999999999999e-06 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811043+0000", 2024-05-07T14:03:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2543e-05 2024-05-07T14:03:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811050+0000", 2024-05-07T14:03:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8000000000000001e-06 2024-05-07T14:03:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823676+0000", 2024-05-07T14:03:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012626052 2024-05-07T14:03:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823904+0000", 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227562 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.824349+0000", 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044484 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826371+0000", 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020221380000000001 2024-05-07T14:03:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828408+0000", 2024-05-07T14:03:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020372369999999999 2024-05-07T14:03:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828540+0000", 2024-05-07T14:03:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013213600000000001 2024-05-07T14:03:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828676+0000", 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013545500000000001 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 151.661158847, 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021330954999999999, 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 112 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-07 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811224+0000", 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653499999999999 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811237+0000", 2024-05-07T14:03:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.271e-05 2024-05-07T14:03:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811245+0000", 2024-05-07T14:03:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6400000000000003e-06 2024-05-07T14:03:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826483+0000", 2024-05-07T14:03:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015237456 2024-05-07T14:03:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826705+0000", 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022216799999999999 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.827081+0000", 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037659800000000002 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.831960+0000", 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048788779999999997 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832167+0000", 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020690500000000001 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832305+0000", 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013801899999999999 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832418+0000", 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112212 2024-05-07T14:03:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 151.66098533799999, 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021403628000000001, 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 113 2024-05-07T14:03:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811261+0000", 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0400000000000005e-07 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811267+0000", 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6099999999999997e-06 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811276+0000", 2024-05-07T14:03:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4029999999999996e-06 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811283+0000", 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828825+0000", 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017541853999999999 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829061+0000", 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235861 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829418+0000", 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035766800000000001 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832130+0000", 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027118120000000001 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832442+0000", 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000311611 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832565+0000", 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012284199999999999 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832664+0000", 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8982999999999997e-05 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 151.660951348, 2024-05-07T14:03:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023518260999999999, 2024-05-07T14:03:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 114 2024-05-07T14:03:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811295+0000", 2024-05-07T14:03:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:03:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811301+0000", 2024-05-07T14:03:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8599999999999998e-06 2024-05-07T14:03:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811310+0000", 2024-05-07T14:03:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0299999999999999e-06 2024-05-07T14:03:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811320+0000", 2024-05-07T14:03:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023e-05 2024-05-07T14:03:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830314+0000", 2024-05-07T14:03:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018994385999999999 2024-05-07T14:03:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830552+0000", 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023815500000000001 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830971+0000", 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041934300000000003 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834620+0000", 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036481389999999999 2024-05-07T14:03:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834666+0000", 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6266000000000001e-05 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834742+0000", 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6069000000000006e-05 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834812+0000", 2024-05-07T14:03:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0372999999999999e-05 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 151.66091078900001, 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027863941999999999, 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 115 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2699999999999999e-07 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811469+0000", 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133332 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811502+0000", 2024-05-07T14:03:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3027000000000001e-05 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811511+0000", 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.713e-06 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832759+0000", 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021248185999999999 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832917+0000", 2024-05-07T14:03:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157825 2024-05-07T14:03:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.833269+0000", 2024-05-07T14:03:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035184099999999998 2024-05-07T14:03:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838250+0000", 2024-05-07T14:03:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004980712 2024-05-07T14:03:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838941+0000", 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069081399999999999 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839091+0000", 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149903 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839199+0000", 2024-05-07T14:03:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010796199999999999 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 151.66071692599999, 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028128562999999999, 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 116 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811529+0000", 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811546+0000", 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7113e-05 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811570+0000", 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.406e-05 2024-05-07T14:03:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811578+0000", 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8660000000000006e-06 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834997+0000", 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023418799000000001 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835317+0000", 2024-05-07T14:03:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031991799999999998 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835662+0000", 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034544399999999998 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839220+0000", 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035576959999999999 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839374+0000", 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015427600000000001 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839540+0000", 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016534500000000001 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839657+0000", 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117243 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 151.66065391399999, 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02858051, 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 117 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811592+0000", 2024-05-07T14:03:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:03:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811601+0000", 2024-05-07T14:03:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1269999999999992e-06 2024-05-07T14:03:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811611+0000", 2024-05-07T14:03:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6900000000000004e-06 2024-05-07T14:03:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811618+0000", 2024-05-07T14:03:17.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0770000000000002e-06 2024-05-07T14:03:17.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836766+0000", 2024-05-07T14:03:17.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025147966000000001 2024-05-07T14:03:17.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836982+0000", 2024-05-07T14:03:17.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021640400000000001 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.837283+0000", 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030005800000000002 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839885+0000", 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002602937 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839925+0000", 2024-05-07T14:03:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9446000000000001e-05 2024-05-07T14:03:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840061+0000", 2024-05-07T14:03:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136043 2024-05-07T14:03:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840172+0000", 2024-05-07T14:03:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111019 2024-05-07T14:03:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:03:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 151.172915327, 2024-05-07T14:03:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019781539000000001, 2024-05-07T14:03:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 140 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-07 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299398+0000", 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7822000000000002e-05 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299404+0000", 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2369999999999997e-06 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299409+0000", 2024-05-07T14:03:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2069999999999997e-06 2024-05-07T14:03:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311355+0000", 2024-05-07T14:03:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011946082 2024-05-07T14:03:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311493+0000", 2024-05-07T14:03:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013830900000000001 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311709+0000", 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021606899999999999 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314528+0000", 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028193839999999999 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319001+0000", 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004472218 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319063+0000", 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1940000000000007e-05 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319112+0000", 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8964000000000001e-05 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 151.17282896200001, 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019944718, 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 141 2024-05-07T14:03:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299417+0000", 2024-05-07T14:03:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7099999999999997e-07 2024-05-07T14:03:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299420+0000", 2024-05-07T14:03:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8629999999999999e-06 2024-05-07T14:03:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299424+0000", 2024-05-07T14:03:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4830000000000001e-06 2024-05-07T14:03:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299429+0000", 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6609999999999999e-06 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312813+0000", 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013384330999999999 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312948+0000", 2024-05-07T14:03:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000135239 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313163+0000", 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000214718 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314534+0000", 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013704430000000001 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319185+0000", 2024-05-07T14:03:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046516839999999997 2024-05-07T14:03:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319281+0000", 2024-05-07T14:03:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5645999999999999e-05 2024-05-07T14:03:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319361+0000", 2024-05-07T14:03:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0278999999999995e-05 2024-05-07T14:03:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1480 3.7 e80/21 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head v 80'1, mlcod=0'0)", 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.165532111000001, 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026214482000000001, 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306719+0000", 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9669999999999998e-06 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315882+0000", 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091624629999999992 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315923+0000", 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0995999999999998e-05 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315945+0000", 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2665999999999999e-05 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.316100+0000", 2024-05-07T14:03:17.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015487399999999999 2024-05-07T14:03:17.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.316140+0000", 2024-05-07T14:03:17.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9582999999999997e-05 2024-05-07T14:03:17.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.332710+0000", 2024-05-07T14:03:17.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016570412999999999 2024-05-07T14:03:17.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.332928+0000", 2024-05-07T14:03:17.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021751999999999999 2024-05-07T14:03:17.527 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.527 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.527 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.527 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2204 3.3b 3:df85b00b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:17.527 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:17.527 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.164894306000001, 2024-05-07T14:03:17.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02108792, 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2204 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307354+0000", 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3730000000000001e-06 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.311997+0000", 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046420480000000002 2024-05-07T14:03:17.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312024+0000", 2024-05-07T14:03:17.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7586e-05 2024-05-07T14:03:17.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312036+0000", 2024-05-07T14:03:17.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2103000000000001e-05 2024-05-07T14:03:17.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312106+0000", 2024-05-07T14:03:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9808000000000007e-05 2024-05-07T14:03:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312224+0000", 2024-05-07T14:03:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117926 2024-05-07T14:03:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312320+0000", 2024-05-07T14:03:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5642000000000003e-05 2024-05-07T14:03:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322866+0000", 2024-05-07T14:03:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010546181 2024-05-07T14:03:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328215+0000", 2024-05-07T14:03:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053494379999999998 2024-05-07T14:03:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328351+0000", 2024-05-07T14:03:17.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013558 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328439+0000", 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8234999999999998e-05 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2206 3.f 3:f1007ae4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.142141212, 2024-05-07T14:03:17.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018268163, 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2206 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330106+0000", 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2730000000000001e-06 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333445+0000", 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033386409999999998 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333474+0000", 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8617999999999999e-05 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333487+0000", 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3716e-05 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333644+0000", 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000156914 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333966+0000", 2024-05-07T14:03:17.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032135600000000002 2024-05-07T14:03:17.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:17.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334209+0000", 2024-05-07T14:03:17.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024347600000000001 2024-05-07T14:03:17.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.346821+0000", 2024-05-07T14:03:17.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012612046999999999 2024-05-07T14:03:17.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348105+0000", 2024-05-07T14:03:17.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012841020000000001 2024-05-07T14:03:17.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348253+0000", 2024-05-07T14:03:17.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147412 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348372+0000", 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119608 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2207 3.26 e84/21 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.126733813, 2024-05-07T14:03:17.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021638324, 2024-05-07T14:03:17.540 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.540 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.540 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.540 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:17.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:17.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345513+0000", 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.313e-06 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349394+0000", 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003881481 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349425+0000", 2024-05-07T14:03:17.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0329e-05 2024-05-07T14:03:17.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349440+0000", 2024-05-07T14:03:17.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4905999999999999e-05 2024-05-07T14:03:17.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349531+0000", 2024-05-07T14:03:17.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0907000000000002e-05 2024-05-07T14:03:17.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349555+0000", 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4097999999999999e-05 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367060+0000", 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017505314000000001 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367150+0000", 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.543 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2213 3.d 3:b01db4c3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.044530107, 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022630872999999999, 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2213 2024-05-07T14:03:17.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.545 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:17.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:17.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427719+0000", 2024-05-07T14:03:17.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.703e-06 2024-05-07T14:03:17.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431417+0000", 2024-05-07T14:03:17.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036980110000000002 2024-05-07T14:03:17.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431441+0000", 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4380999999999999e-05 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431451+0000", 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9890000000000004e-06 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431567+0000", 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115136 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431816+0000", 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024989700000000001 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432033+0000", 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021664300000000001 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.447025+0000", 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014991473 2024-05-07T14:03:17.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450138+0000", 2024-05-07T14:03:17.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003113429 2024-05-07T14:03:17.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450234+0000", 2024-05-07T14:03:17.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6519000000000002e-05 2024-05-07T14:03:17.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450346+0000", 2024-05-07T14:03:17.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111692 2024-05-07T14:03:17.550 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.550 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.550 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.550 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2215 3.37 3:eed806fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:17.550 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:17.550 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.014659247000001, 2024-05-07T14:03:17.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019726679, 2024-05-07T14:03:17.550 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.550 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.550 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2215 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457589+0000", 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1e-06 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461583+0000", 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039941919999999997 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461615+0000", 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1835999999999998e-05 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461630+0000", 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4766000000000001e-05 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461782+0000", 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015214800000000001 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462139+0000", 2024-05-07T14:03:17.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035658499999999997 2024-05-07T14:03:17.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:17.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462489+0000", 2024-05-07T14:03:17.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034982900000000001 2024-05-07T14:03:17.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.476308+0000", 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013819761 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477139+0000", 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083034199999999997 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477226+0000", 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7517999999999998e-05 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477313+0000", 2024-05-07T14:03:17.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6601999999999995e-05 2024-05-07T14:03:17.556 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.556 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.556 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.556 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2220 3.11 3:8b7a5ffd:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:17.556 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:17.556 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.936688332999999, 2024-05-07T14:03:17.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022329020000000002, 2024-05-07T14:03:17.557 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.557 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.557 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.557 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.557 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:17.557 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:17.557 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2220 2024-05-07T14:03:17.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.557 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:17.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:17.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535561+0000", 2024-05-07T14:03:17.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.546e-06 2024-05-07T14:03:17.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.539966+0000", 2024-05-07T14:03:17.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044058270000000002 2024-05-07T14:03:17.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540002+0000", 2024-05-07T14:03:17.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5435999999999998e-05 2024-05-07T14:03:17.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540019+0000", 2024-05-07T14:03:17.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7003e-05 2024-05-07T14:03:17.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540153+0000", 2024-05-07T14:03:17.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133721 2024-05-07T14:03:17.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540396+0000", 2024-05-07T14:03:17.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024384400000000001 2024-05-07T14:03:17.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:17.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540605+0000", 2024-05-07T14:03:17.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020872999999999999 2024-05-07T14:03:17.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.556698+0000", 2024-05-07T14:03:17.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016093028999999998 2024-05-07T14:03:17.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557670+0000", 2024-05-07T14:03:17.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000971477 2024-05-07T14:03:17.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557779+0000", 2024-05-07T14:03:17.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010969800000000001 2024-05-07T14:03:17.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557886+0000", 2024-05-07T14:03:17.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106709 2024-05-07T14:03:17.563 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.563 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.563 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.564 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2221 3.f 3:f1cd2e50:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:17.564 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:17.564 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.926022156, 2024-05-07T14:03:17.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024790956999999999, 2024-05-07T14:03:17.564 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.564 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.564 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.564 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.564 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:17.564 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2221 2024-05-07T14:03:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546227+0000", 2024-05-07T14:03:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.27e-06 2024-05-07T14:03:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550241+0000", 2024-05-07T14:03:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040139950000000002 2024-05-07T14:03:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550273+0000", 2024-05-07T14:03:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2741999999999999e-05 2024-05-07T14:03:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550298+0000", 2024-05-07T14:03:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4484000000000001e-05 2024-05-07T14:03:17.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550463+0000", 2024-05-07T14:03:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165274 2024-05-07T14:03:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550736+0000", 2024-05-07T14:03:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027265299999999998 2024-05-07T14:03:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:17.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551015+0000", 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027935900000000002 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.569950+0000", 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018935469999999999 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.570807+0000", 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00085676600000000002 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.570928+0000", 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120568 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571014+0000", 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6376000000000001e-05 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2250 3.11 3:8ab50290:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:17.570 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.58438422, 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025202414999999999, 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2250 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887864+0000", 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9299999999999999e-06 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892840+0000", 2024-05-07T14:03:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049758420000000003 2024-05-07T14:03:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892883+0000", 2024-05-07T14:03:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2568999999999998e-05 2024-05-07T14:03:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892902+0000", 2024-05-07T14:03:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9667e-05 2024-05-07T14:03:17.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893027+0000", 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012506799999999999 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893232+0000", 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020444199999999999 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893445+0000", 2024-05-07T14:03:17.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021324199999999999 2024-05-07T14:03:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.911638+0000", 2024-05-07T14:03:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018193343000000001 2024-05-07T14:03:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.912977+0000", 2024-05-07T14:03:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001338802 2024-05-07T14:03:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.913026+0000", 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8862000000000001e-05 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.913064+0000", 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7648000000000003e-05 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2500 7.15 7:a93a5511:::notify.2:head [watch reconnect cookie 94397682175232 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:17.576 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.077355538999999, 2024-05-07T14:03:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0539674379999999, 2024-05-07T14:03:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2500 2024-05-07T14:03:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:17.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394893+0000", 2024-05-07T14:03:17.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8830000000000002e-06 2024-05-07T14:03:17.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:17.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394909+0000", 2024-05-07T14:03:17.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5840000000000001e-05 2024-05-07T14:03:17.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:17.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394951+0000", 2024-05-07T14:03:17.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2175999999999997e-05 2024-05-07T14:03:17.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:17.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394973+0000", 2024-05-07T14:03:17.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2679000000000001e-05 2024-05-07T14:03:17.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395138+0000", 2024-05-07T14:03:17.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000164895 2024-05-07T14:03:17.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:17.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395156+0000", 2024-05-07T14:03:17.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7237000000000001e-05 2024-05-07T14:03:17.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415064+0000", 2024-05-07T14:03:17.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019908478 2024-05-07T14:03:17.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:17.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415089+0000", 2024-05-07T14:03:17.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4916e-05 2024-05-07T14:03:17.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.425843+0000", 2024-05-07T14:03:17.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.010754116 2024-05-07T14:03:17.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:17.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.427029+0000", 2024-05-07T14:03:17.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011857700000000001 2024-05-07T14:03:17.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:17.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.436255+0000", 2024-05-07T14:03:17.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092263629999999996 2024-05-07T14:03:17.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:17.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.436391+0000", 2024-05-07T14:03:17.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136117 2024-05-07T14:03:17.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:17.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:17.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:17.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.448857+0000", 2024-05-07T14:03:17.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012465967999999999 2024-05-07T14:03:17.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.585 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.585 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.585 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:17.585 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:17.585 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:17.587 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:17.596+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:17.587 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:17.613 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:03:17.687 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:17.696+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:17.720 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:17.720 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:17.720 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:17.721 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:17.735 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:17.778 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:17.779 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:17.788 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:17.800+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:17.795 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:17.795 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:17.812 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:17.812 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:17.828 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:17.829 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:17.849 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:17.865 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:17.865 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:17.870 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:17.870 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:17.879 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:17.891 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:17.892 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:17.892 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:17.900+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:17.912 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:17.913 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:17.991 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:18.000+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:18.006 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:18.007 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:18.021 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:18.108 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:18.120+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:18.186 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:18.186 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:18.193 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:18.204+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:18.200 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:18.302 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:18.312+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:18.378 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:18.378 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:18.391 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:18.437 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:18.448+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:18.497 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:18.508+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:18.527 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:03:18.560 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:18.560 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:18.575 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:18.598 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:18.608+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:18.699 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:18.708+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:18.737 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:18.737 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:18.751 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:18.800 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:18.812+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:18.901 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:18.912+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:18.913 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:18.913 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:18.927 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:19.016 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:19.028+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:19.095 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:19.095 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:19.103 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:19.112+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:19.109 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:19.203 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:19.212+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:19.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:19.332 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:19.344+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:19.405 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:19.416+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:19.451 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:19.451 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:19.466 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:19.506 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:19.516+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:19.511 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:03:19.607 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:19.616+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:19.633 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:19.633 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:19.647 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:19.708 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:19.720+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:19.781 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:19.781 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:19.795 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:19.809 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:19.820+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:19.910 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:19.924+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:19.932 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:03:19.960 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:19.960 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:19.975 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:20.020 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:20.032+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:20.088 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:20.088 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:20.101 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:20.101 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:20.104 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:20.104 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:20.111 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:20.120+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:20.115 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:20.120 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:20.120 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:20.136 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:20.136 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:20.156 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:20.156 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:20.175 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:20.175 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:20.195 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:20.195 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:20.212 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:20.220+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:20.213 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:20.213 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:20.285 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:20.285 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:20.285 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:20.285 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:20.299 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:20.344 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:20.356+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:20.414 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:20.424+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:20.420 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:20.420 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:20.420 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:20.420 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:20.420 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:20.435 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:03:20.515 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:20.524+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:20.603 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:20.603 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:20.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:20.603 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:20.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.603 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:415 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:20.603 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 133.41318482599999, 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065364059999999998, 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 415 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200337+0000", 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200339+0000", 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.826e-06 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200348+0000", 2024-05-07T14:03:20.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0669999999999998e-06 2024-05-07T14:03:20.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200378+0000", 2024-05-07T14:03:20.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.968e-05 2024-05-07T14:03:20.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200393+0000", 2024-05-07T14:03:20.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5109999999999999e-05 2024-05-07T14:03:20.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200515+0000", 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121449 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200658+0000", 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014362199999999999 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.200958+0000", 2024-05-07T14:03:20.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030029699999999999 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.202106+0000", 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011475050000000001 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206707+0000", 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046009980000000002 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206791+0000", 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4118999999999999e-05 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.206874+0000", 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2732999999999995e-05 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:430 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:20.609 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 133.40297351199999, 2024-05-07T14:03:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066752119999999998, 2024-05-07T14:03:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 430 2024-05-07T14:03:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210549+0000", 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210551+0000", 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210562+0000", 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0237e-05 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210586+0000", 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4066e-05 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.210603+0000", 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.713e-05 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211799+0000", 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001196127 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.211931+0000", 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000131629 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.212211+0000", 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028005100000000002 2024-05-07T14:03:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.213288+0000", 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010772760000000001 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217047+0000", 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037586569999999999 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217127+0000", 2024-05-07T14:03:20.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0270000000000002e-05 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.217224+0000", 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7139000000000006e-05 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1482 3.30 3:0f9854c6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10MBfile1:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.244414260999999, 2024-05-07T14:03:20.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060631510000000001, 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1482 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369108+0000", 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369111+0000", 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2830000000000002e-06 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369126+0000", 2024-05-07T14:03:20.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4693e-05 2024-05-07T14:03:20.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369160+0000", 2024-05-07T14:03:20.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4282999999999997e-05 2024-05-07T14:03:20.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369178+0000", 2024-05-07T14:03:20.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8153000000000001e-05 2024-05-07T14:03:20.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369385+0000", 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020658699999999999 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.369396+0000", 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0616e-05 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.374884+0000", 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005488461 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.375171+0000", 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028707500000000003 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1611 3.30 3:0c405120:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.194312227000001, 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021446044000000001, 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.620 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1611 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419210+0000", 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.419212+0000", 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3769999999999999e-06 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425005+0000", 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057928390000000001 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425049+0000", 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3569999999999998e-05 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425068+0000", 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9582e-05 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425273+0000", 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020503000000000001 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425505+0000", 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023136000000000001 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.425719+0000", 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021418000000000001 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.439395+0000", 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013675768 2024-05-07T14:03:20.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440495+0000", 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00109987 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440588+0000", 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3429000000000003e-05 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.440656+0000", 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8039000000000004e-05 2024-05-07T14:03:20.625 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1614 3.1d 3:baaad814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4_10Mb.:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.169453926999999, 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024991276999999999, 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.626 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1614 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444068+0000", 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.444071+0000", 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6900000000000001e-06 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448527+0000", 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044560870000000001 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448562+0000", 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4576000000000002e-05 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448578+0000", 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6209e-05 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.448766+0000", 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018828700000000001 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.449033+0000", 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026696599999999999 2024-05-07T14:03:20.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.449872+0000", 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083849399999999996 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.465016+0000", 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015144061 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.468867+0000", 2024-05-07T14:03:20.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003851246 2024-05-07T14:03:20.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.468987+0000", 2024-05-07T14:03:20.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011982899999999999 2024-05-07T14:03:20.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.469060+0000", 2024-05-07T14:03:20.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2831999999999997e-05 2024-05-07T14:03:20.631 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.631 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.632 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.632 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2205 3.28 3:177ebb78:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:20.632 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.319746+0000", 2024-05-07T14:03:20.632 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.293776743999999, 2024-05-07T14:03:20.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022489056, 2024-05-07T14:03:20.632 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.632 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.632 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.633 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.633 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.633 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.633 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2205 2024-05-07T14:03:20.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.633 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.319746+0000", 2024-05-07T14:03:20.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.319746+0000", 2024-05-07T14:03:20.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.319748+0000", 2024-05-07T14:03:20.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5890000000000001e-06 2024-05-07T14:03:20.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326256+0000", 2024-05-07T14:03:20.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065077659999999999 2024-05-07T14:03:20.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326287+0000", 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1056999999999998e-05 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326304+0000", 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6942000000000001e-05 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326386+0000", 2024-05-07T14:03:20.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2202999999999999e-05 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326514+0000", 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000127744 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.326626+0000", 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011235600000000001 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.335547+0000", 2024-05-07T14:03:20.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089205910000000003 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.342079+0000", 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065326109999999998 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.342164+0000", 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4556999999999997e-05 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.342235+0000", 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0640000000000001e-05 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2208 3.3a 3:5ee07aff:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.347341+0000", 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.266181354, 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024383083, 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.638 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2208 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347341+0000", 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347341+0000", 2024-05-07T14:03:20.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.347346+0000", 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6330000000000004e-06 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351721+0000", 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043750070000000002 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351760+0000", 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9609e-05 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351780+0000", 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9352999999999999e-05 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.351947+0000", 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016710800000000001 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.352347+0000", 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040036800000000001 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.352759+0000", 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041211399999999999 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365687+0000", 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012927776 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.371529+0000", 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058423140000000004 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.371636+0000", 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107011 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.371724+0000", 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7789999999999998e-05 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.643 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2210 3.28 3:157bdd2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.368019+0000", 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.245502773999998, 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016829770000000001, 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.644 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2210 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.368019+0000", 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.368019+0000", 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.368023+0000", 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6679999999999999e-06 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372491+0000", 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044678970000000002 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372538+0000", 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7092000000000002e-05 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372568+0000", 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0046999999999999e-05 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372692+0000", 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012425199999999999 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.372957+0000", 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026447500000000002 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373231+0000", 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027440800000000002 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.383355+0000", 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010123251999999999 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.384680+0000", 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013249410000000001 2024-05-07T14:03:20.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.384762+0000", 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2965000000000003e-05 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.384849+0000", 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6773000000000004e-05 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.649 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2213 3.d e84/21 3:b01db4c3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_12:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.432192+0000", 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.181330402, 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014503395000000001, 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432192+0000", 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432192+0000", 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432195+0000", 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7970000000000001e-06 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435030+0000", 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002835424 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435087+0000", 2024-05-07T14:03:20.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7120000000000002e-05 2024-05-07T14:03:20.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435115+0000", 2024-05-07T14:03:20.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8116e-05 2024-05-07T14:03:20.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435224+0000", 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000108719 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.435252+0000", 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8130999999999999e-05 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.446622+0000", 2024-05-07T14:03:20.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011369719 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.446695+0000", 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3368999999999995e-05 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2215 3.37 e84/21 3:eed806fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_14:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.462684+0000", 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.150838441000001, 2024-05-07T14:03:20.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014112764, 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462684+0000", 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462684+0000", 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462686+0000", 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8339999999999999e-06 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465341+0000", 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0026557099999999999 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465378+0000", 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6582999999999999e-05 2024-05-07T14:03:20.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465395+0000", 2024-05-07T14:03:20.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6765999999999998e-05 2024-05-07T14:03:20.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465550+0000", 2024-05-07T14:03:20.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015575800000000001 2024-05-07T14:03:20.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.465591+0000", 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0886999999999997e-05 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.476683+0000", 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011092061 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.476797+0000", 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113165 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.659 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2218 3.35 e84/21 3:af15427b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_17:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.517584+0000", 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.095938136000001, 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013750717000000001, 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517584+0000", 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517584+0000", 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517587+0000", 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8789999999999999e-06 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521588+0000", 2024-05-07T14:03:20.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040013649999999998 2024-05-07T14:03:20.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521630+0000", 2024-05-07T14:03:20.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1632999999999999e-05 2024-05-07T14:03:20.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521649+0000", 2024-05-07T14:03:20.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8623000000000001e-05 2024-05-07T14:03:20.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521801+0000", 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000152688 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.521843+0000", 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1993000000000003e-05 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531239+0000", 2024-05-07T14:03:20.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093956779999999993 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531335+0000", 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5858000000000003e-05 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2222 3.2a 3:57d0a4ec:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.567662+0000", 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.045860324, 2024-05-07T14:03:20.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020794828000000001, 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2222 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.567662+0000", 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.567662+0000", 2024-05-07T14:03:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.567666+0000", 2024-05-07T14:03:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.58e-06 2024-05-07T14:03:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571748+0000", 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040822109999999997 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571783+0000", 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5503000000000002e-05 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571801+0000", 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7943000000000001e-05 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571926+0000", 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012484799999999999 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.572168+0000", 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000242041 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.572386+0000", 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021758300000000001 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.587086+0000", 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014700095 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588219+0000", 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011328009999999999 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588338+0000", 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118959 2024-05-07T14:03:20.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588457+0000", 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119264 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2234 3.c 3:313f4c71:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.714603+0000", 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.898918767000001, 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015738496000000001, 2024-05-07T14:03:20.670 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2234 2024-05-07T14:03:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.714603+0000", 2024-05-07T14:03:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.714603+0000", 2024-05-07T14:03:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.714606+0000", 2024-05-07T14:03:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4140000000000001e-06 2024-05-07T14:03:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718403+0000", 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037968720000000002 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718431+0000", 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8384000000000001e-05 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718443+0000", 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2167999999999999e-05 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718541+0000", 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7979000000000005e-05 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718737+0000", 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019563 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.718943+0000", 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000206407 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:20.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.728383+0000", 2024-05-07T14:03:20.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094393529999999993 2024-05-07T14:03:20.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:20.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.730203+0000", 2024-05-07T14:03:20.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001819827 2024-05-07T14:03:20.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.730277+0000", 2024-05-07T14:03:20.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.436e-05 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.730342+0000", 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5102000000000001e-05 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2239 3.36 e84/21 3:6db3e702:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_38:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.771643+0000", 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.841879084999999, 2024-05-07T14:03:20.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011577555, 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771643+0000", 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771643+0000", 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771646+0000", 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5560000000000002e-06 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773601+0000", 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019557239999999998 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773627+0000", 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5273999999999999e-05 2024-05-07T14:03:20.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773639+0000", 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1990999999999999e-05 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773719+0000", 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0181999999999999e-05 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.773744+0000", 2024-05-07T14:03:20.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5055e-05 2024-05-07T14:03:20.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783134+0000", 2024-05-07T14:03:20.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093901839999999993 2024-05-07T14:03:20.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783221+0000", 2024-05-07T14:03:20.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6588999999999994e-05 2024-05-07T14:03:20.680 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.680 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2240 3.2f 3:f504276b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.776589+0000", 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.836933684999998, 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016880398000000001, 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.681 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2240 2024-05-07T14:03:20.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.682 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.776589+0000", 2024-05-07T14:03:20.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.776589+0000", 2024-05-07T14:03:20.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.776592+0000", 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0189999999999998e-06 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780426+0000", 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038339659999999998 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780446+0000", 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0237999999999998e-05 2024-05-07T14:03:20.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780457+0000", 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1103e-05 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780539+0000", 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1682999999999997e-05 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780698+0000", 2024-05-07T14:03:20.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015976299999999999 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.780827+0000", 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012860599999999999 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.792875+0000", 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012047904 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:20.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.793367+0000", 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00049221499999999995 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.793418+0000", 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1023000000000003e-05 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.793469+0000", 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0878000000000003e-05 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.686 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2242 3.3c 3:3de0b8ca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.796914+0000", 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.816607901000001, 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015934625000000001, 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2242 2024-05-07T14:03:20.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.796914+0000", 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.796914+0000", 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.796916+0000", 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6390000000000001e-06 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800745+0000", 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038292000000000001 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800772+0000", 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7155e-05 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800784+0000", 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1963e-05 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.800861+0000", 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6936999999999999e-05 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.801007+0000", 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014580100000000001 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.801126+0000", 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118613 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.807740+0000", 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066147369999999999 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.812727+0000", 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049861769999999996 2024-05-07T14:03:20.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.812791+0000", 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4734999999999996e-05 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.812849+0000", 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7667999999999997e-05 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2244 3.2f 3:f6c20744:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.819427+0000", 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.794094994000002, 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015548795000000001, 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2244 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.819427+0000", 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.819427+0000", 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.819430+0000", 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2350000000000002e-06 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823226+0000", 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0037961309999999999 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823247+0000", 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1002999999999999e-05 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823256+0000", 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4369999999999996e-06 2024-05-07T14:03:20.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823349+0000", 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3319000000000006e-05 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823550+0000", 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020093699999999999 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.823751+0000", 2024-05-07T14:03:20.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000200466 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834235+0000", 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010483878 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834822+0000", 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058768600000000002 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834912+0000", 2024-05-07T14:03:20.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0073000000000003e-05 2024-05-07T14:03:20.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834976+0000", 2024-05-07T14:03:20.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3629999999999999e-05 2024-05-07T14:03:20.698 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.698 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.698 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.698 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2245 3.d e84/21 3:b06e9c0d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_44:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:20.698 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.834936+0000", 2024-05-07T14:03:20.698 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.778586042000001, 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010748073, 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834936+0000", 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834936+0000", 2024-05-07T14:03:20.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.834937+0000", 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.99e-07 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.836983+0000", 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002045776 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837005+0000", 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2680999999999998e-05 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837018+0000", 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2374999999999999e-05 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837143+0000", 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012507100000000001 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.837184+0000", 2024-05-07T14:03:20.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1625000000000002e-05 2024-05-07T14:03:20.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:20.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.845599+0000", 2024-05-07T14:03:20.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084150500000000003 2024-05-07T14:03:20.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.845684+0000", 2024-05-07T14:03:20.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4895999999999995e-05 2024-05-07T14:03:20.702 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2498 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.218637858999999, 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.06015305, 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.703 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2498 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394887+0000", 2024-05-07T14:03:20.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:03:20.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394900+0000", 2024-05-07T14:03:20.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3125999999999999e-05 2024-05-07T14:03:20.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394940+0000", 2024-05-07T14:03:20.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9579999999999997e-05 2024-05-07T14:03:20.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394961+0000", 2024-05-07T14:03:20.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1075999999999999e-05 2024-05-07T14:03:20.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395122+0000", 2024-05-07T14:03:20.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160741 2024-05-07T14:03:20.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395140+0000", 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430325+0000", 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.03518512 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430355+0000", 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9181999999999999e-05 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.445424+0000", 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.015069751 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.446159+0000", 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073452200000000004 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450456+0000", 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042973689999999997 2024-05-07T14:03:20.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450627+0000", 2024-05-07T14:03:20.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017032700000000001 2024-05-07T14:03:20.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455037+0000", 2024-05-07T14:03:20.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044108690000000004 2024-05-07T14:03:20.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.709 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2499 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.218508809999999, 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.065623158, 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2499 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.710 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395015+0000", 2024-05-07T14:03:20.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.57e-06 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395022+0000", 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1330000000000001e-06 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395043+0000", 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1022999999999998e-05 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:20.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395060+0000", 2024-05-07T14:03:20.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6325999999999999e-05 2024-05-07T14:03:20.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395199+0000", 2024-05-07T14:03:20.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139815 2024-05-07T14:03:20.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:20.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395215+0000", 2024-05-07T14:03:20.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5693e-05 2024-05-07T14:03:20.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413112+0000", 2024-05-07T14:03:20.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017896860000000001 2024-05-07T14:03:20.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:20.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413143+0000", 2024-05-07T14:03:20.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1609000000000002e-05 2024-05-07T14:03:20.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.447430+0000", 2024-05-07T14:03:20.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0342867060000001 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450079+0000", 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002648386 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455213+0000", 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051342749999999998 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455444+0000", 2024-05-07T14:03:20.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023070799999999999 2024-05-07T14:03:20.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:20.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:20.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:20.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.460637+0000", 2024-05-07T14:03:20.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051930539999999999 2024-05-07T14:03:20.716 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.716 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.716 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.716 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:20.716 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:20.716 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:20.718 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:03:20.718 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:20.728+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:20.819 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:20.828+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:20.887 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:20.887 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:20.887 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:20.888 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:20.901 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:03:20.919 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:20.928+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:21.020 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:21.032+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:21.026 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:21.026 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:21.026 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:21.039 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:03:21.122 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:21.132+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:21.165 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:21.165 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:21.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:21.165 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:21.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.166 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:03:21.166 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:21.166 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 137.15859423200001, 2024-05-07T14:03:21.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089647730000000005, 2024-05-07T14:03:21.166 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.166 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.166 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.167 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.167 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 46 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017451+0000", 2024-05-07T14:03:21.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9349999999999999e-06 2024-05-07T14:03:21.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017460+0000", 2024-05-07T14:03:21.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-05-07T14:03:21.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017481+0000", 2024-05-07T14:03:21.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0984000000000001e-05 2024-05-07T14:03:21.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017499+0000", 2024-05-07T14:03:21.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:03:21.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018689+0000", 2024-05-07T14:03:21.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001190303 2024-05-07T14:03:21.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018945+0000", 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025626799999999998 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022176+0000", 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032308720000000001 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026078+0000", 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039018289999999999 2024-05-07T14:03:21.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026189+0000", 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110775 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026310+0000", 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121023 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026413+0000", 2024-05-07T14:03:21.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103346 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:337 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'5, mlcod=33'3)", 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 134.00913718300001, 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004459658, 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:21.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:21.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166908+0000", 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2259999999999999e-06 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166922+0000", 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4780000000000001e-05 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166960+0000", 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8173000000000002e-05 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166981+0000", 2024-05-07T14:03:21.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0440000000000001e-05 2024-05-07T14:03:21.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167154+0000", 2024-05-07T14:03:21.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017287199999999999 2024-05-07T14:03:21.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167207+0000", 2024-05-07T14:03:21.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000001e-05 2024-05-07T14:03:21.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171283+0000", 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004076278 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171365+0000", 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1588999999999994e-05 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.178 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:349 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-07T14:03:21.178 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:21.178 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 134.008262387, 2024-05-07T14:03:21.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042886440000000003, 2024-05-07T14:03:21.178 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.178 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.178 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.178 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:21.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167782+0000", 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167797+0000", 2024-05-07T14:03:21.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4533e-05 2024-05-07T14:03:21.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167828+0000", 2024-05-07T14:03:21.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1239999999999999e-05 2024-05-07T14:03:21.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167859+0000", 2024-05-07T14:03:21.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1007000000000003e-05 2024-05-07T14:03:21.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168041+0000", 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181788 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168095+0000", 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3857000000000003e-05 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171961+0000", 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038664160000000001 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172069+0000", 2024-05-07T14:03:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107793 2024-05-07T14:03:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1563 4.a 4:50961e27:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.503388353999998, 2024-05-07T14:03:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050212310000000001, 2024-05-07T14:03:21.182 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.183 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.183 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.183 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.183 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.183 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.183 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1563 2024-05-07T14:03:21.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.183 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:21.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672655+0000", 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.33e-06 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672662+0000", 2024-05-07T14:03:21.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2400000000000004e-06 2024-05-07T14:03:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672688+0000", 2024-05-07T14:03:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6483e-05 2024-05-07T14:03:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672704+0000", 2024-05-07T14:03:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6206e-05 2024-05-07T14:03:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672789+0000", 2024-05-07T14:03:21.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4445999999999998e-05 2024-05-07T14:03:21.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672917+0000", 2024-05-07T14:03:21.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012805499999999999 2024-05-07T14:03:21.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:21.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673210+0000", 2024-05-07T14:03:21.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029306500000000001 2024-05-07T14:03:21.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.675980+0000", 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002770223 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677420+0000", 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001439397 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677568+0000", 2024-05-07T14:03:21.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014831800000000001 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677675+0000", 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010746799999999999 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1566 4.13 e81/23 4:cabacdb3:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.4:head v 81'5, mlcod=80'3)", 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.502212664999998, 2024-05-07T14:03:21.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043209989999999998, 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673832+0000", 2024-05-07T14:03:21.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1660000000000001e-06 2024-05-07T14:03:21.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673850+0000", 2024-05-07T14:03:21.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7880000000000002e-05 2024-05-07T14:03:21.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673881+0000", 2024-05-07T14:03:21.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0883000000000002e-05 2024-05-07T14:03:21.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673900+0000", 2024-05-07T14:03:21.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9015999999999999e-05 2024-05-07T14:03:21.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674119+0000", 2024-05-07T14:03:21.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000219113 2024-05-07T14:03:21.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674175+0000", 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5962999999999999e-05 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678071+0000", 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003896119 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678151+0000", 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9858999999999996e-05 2024-05-07T14:03:21.192 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5165.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.023437968, 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059914829999999997, 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5165", 2024-05-07T14:03:21.193 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3551621939", 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 52 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152607+0000", 2024-05-07T14:03:21.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2840000000000001e-06 2024-05-07T14:03:21.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152620+0000", 2024-05-07T14:03:21.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3159999999999999e-05 2024-05-07T14:03:21.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152650+0000", 2024-05-07T14:03:21.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9835000000000001e-05 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152672+0000", 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2334e-05 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152802+0000", 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013009799999999999 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152930+0000", 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012816100000000001 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.153119+0000", 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018862699999999999 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.154156+0000", 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010365940000000001 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158442+0000", 2024-05-07T14:03:21.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042868450000000001 2024-05-07T14:03:21.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158532+0000", 2024-05-07T14:03:21.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9135999999999995e-05 2024-05-07T14:03:21.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158596+0000", 2024-05-07T14:03:21.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4408999999999999e-05 2024-05-07T14:03:21.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5535.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.866590095999999, 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057064799999999999, 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5535", 2024-05-07T14:03:21.199 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/4024516518", 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 52 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309455+0000", 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0900000000000001e-06 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309469+0000", 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3013000000000001e-05 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309506+0000", 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7536000000000001e-05 2024-05-07T14:03:21.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309523+0000", 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7450000000000001e-05 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309683+0000", 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015954000000000001 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309915+0000", 2024-05-07T14:03:21.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023159 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.310272+0000", 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035786100000000001 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.311478+0000", 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001205888 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315002+0000", 2024-05-07T14:03:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035240419999999998 2024-05-07T14:03:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315089+0000", 2024-05-07T14:03:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6975e-05 2024-05-07T14:03:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315159+0000", 2024-05-07T14:03:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9494999999999998e-05 2024-05-07T14:03:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.204 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1719 4.a 4:5321cf61:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.5.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.253948804, 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041945250000000002, 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.205 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1719 2024-05-07T14:03:21.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.206 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:21.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:21.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922096+0000", 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2800000000000002e-06 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922104+0000", 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.524e-06 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922130+0000", 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5367999999999998e-05 2024-05-07T14:03:21.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922142+0000", 2024-05-07T14:03:21.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2199e-05 2024-05-07T14:03:21.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922238+0000", 2024-05-07T14:03:21.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5754999999999994e-05 2024-05-07T14:03:21.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922408+0000", 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017003999999999999 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922630+0000", 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221871 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.923677+0000", 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047517 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926214+0000", 2024-05-07T14:03:21.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025365650000000002 2024-05-07T14:03:21.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926251+0000", 2024-05-07T14:03:21.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7234000000000003e-05 2024-05-07T14:03:21.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926288+0000", 2024-05-07T14:03:21.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7172000000000003e-05 2024-05-07T14:03:21.210 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2203 3.1e e84/21 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.874560892000002, 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021333873, 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301484+0000", 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9139999999999998e-06 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307602+0000", 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061184630000000002 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307626+0000", 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3937000000000001e-05 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307637+0000", 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1027e-05 2024-05-07T14:03:21.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307724+0000", 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7435000000000006e-05 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307759+0000", 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5098000000000002e-05 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322730+0000", 2024-05-07T14:03:21.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014970651 2024-05-07T14:03:21.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322815+0000", 2024-05-07T14:03:21.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5347999999999997e-05 2024-05-07T14:03:21.215 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.215 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.215 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.215 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2207 3.26 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:21.215 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:21.215 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.837446566000001, 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029257551999999999, 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2207 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:21.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338601+0000", 2024-05-07T14:03:21.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0769999999999998e-06 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344166+0000", 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055649139999999998 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344203+0000", 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7109e-05 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344221+0000", 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344394+0000", 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000173208 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344788+0000", 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039418400000000001 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345265+0000", 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047689299999999999 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365597+0000", 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020331954999999999 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367512+0000", 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001915237 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367693+0000", 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018108800000000001 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367853+0000", 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016028400000000001 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.221 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2209 3.a 3:51944b39:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:21.222 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:21.222 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.819546755000001, 2024-05-07T14:03:21.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021277709999999998, 2024-05-07T14:03:21.222 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.222 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.222 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.222 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.222 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.222 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.222 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2209 2024-05-07T14:03:21.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.222 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356500+0000", 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3499999999999999e-06 2024-05-07T14:03:21.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361252+0000", 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047518980000000001 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361291+0000", 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8546e-05 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361309+0000", 2024-05-07T14:03:21.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361477+0000", 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016801399999999999 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361865+0000", 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038800199999999998 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:21.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362247+0000", 2024-05-07T14:03:21.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038169099999999997 2024-05-07T14:03:21.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373964+0000", 2024-05-07T14:03:21.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01171701 2024-05-07T14:03:21.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377549+0000", 2024-05-07T14:03:21.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035850909999999999 2024-05-07T14:03:21.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377657+0000", 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107593 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377773+0000", 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011687499999999999 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.227 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2214 3.33 e84/21 3:cdc86525:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_13:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.735716582999999, 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010229887999999999, 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440329+0000", 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7159999999999999e-06 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444193+0000", 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038645609999999999 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444219+0000", 2024-05-07T14:03:21.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6262e-05 2024-05-07T14:03:21.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444232+0000", 2024-05-07T14:03:21.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2989999999999999e-05 2024-05-07T14:03:21.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444307+0000", 2024-05-07T14:03:21.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5011000000000004e-05 2024-05-07T14:03:21.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444328+0000", 2024-05-07T14:03:21.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0418e-05 2024-05-07T14:03:21.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450513+0000", 2024-05-07T14:03:21.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061855419999999996 2024-05-07T14:03:21.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450556+0000", 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2388000000000001e-05 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2218 3.35 3:af15427b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.663261546000001, 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019068912, 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.232 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.233 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.233 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.233 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.233 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.233 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2218 2024-05-07T14:03:21.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.233 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:21.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512784+0000", 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3699999999999999e-06 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516649+0000", 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003864644 2024-05-07T14:03:21.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516684+0000", 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5403e-05 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516702+0000", 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7346e-05 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516848+0000", 2024-05-07T14:03:21.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000146198 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517099+0000", 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025069300000000002 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517328+0000", 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022939100000000001 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.527840+0000", 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010511786 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531674+0000", 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00383417 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531766+0000", 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1859000000000003e-05 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531850+0000", 2024-05-07T14:03:21.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4052000000000001e-05 2024-05-07T14:03:21.238 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.238 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.238 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.238 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2231 3.2e e84/21 3:767c3375:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_30:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:21.238 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:21.238 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.491965095000001, 2024-05-07T14:03:21.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01236056, 2024-05-07T14:03:21.238 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.238 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684080+0000", 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5399999999999998e-06 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688628+0000", 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045475969999999996 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688662+0000", 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4919999999999998e-05 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688679+0000", 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6135999999999999e-05 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688793+0000", 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114005 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688836+0000", 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3176000000000001e-05 2024-05-07T14:03:21.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696350+0000", 2024-05-07T14:03:21.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007513924 2024-05-07T14:03:21.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696438+0000", 2024-05-07T14:03:21.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8262000000000003e-05 2024-05-07T14:03:21.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.242 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2232 3.2c 3:35867d96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.482973084000001, 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017519415, 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2232 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.243 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693086+0000", 2024-05-07T14:03:21.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6540000000000001e-05 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696895+0000", 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038088509999999998 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696915+0000", 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9972000000000001e-05 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696927+0000", 2024-05-07T14:03:21.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1907e-05 2024-05-07T14:03:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697040+0000", 2024-05-07T14:03:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113621 2024-05-07T14:03:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697286+0000", 2024-05-07T14:03:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024593299999999999 2024-05-07T14:03:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697518+0000", 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023206999999999999 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710196+0000", 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012677559 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710293+0000", 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559000000000006e-05 2024-05-07T14:03:21.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710430+0000", 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137045 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710589+0000", 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835799999999999 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.248 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2238 3.2e e84/21 3:76550f67:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_37:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.416695729000001, 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011302262, 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:21.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759348+0000", 2024-05-07T14:03:21.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5939999999999999e-06 2024-05-07T14:03:21.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763299+0000", 2024-05-07T14:03:21.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039506139999999999 2024-05-07T14:03:21.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763325+0000", 2024-05-07T14:03:21.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6366000000000001e-05 2024-05-07T14:03:21.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763341+0000", 2024-05-07T14:03:21.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.535e-05 2024-05-07T14:03:21.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763432+0000", 2024-05-07T14:03:21.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1757999999999998e-05 2024-05-07T14:03:21.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763462+0000", 2024-05-07T14:03:21.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9621e-05 2024-05-07T14:03:21.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.770571+0000", 2024-05-07T14:03:21.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071087779999999996 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.770649+0000", 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8181000000000002e-05 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2239 3.36 3:6db3e702:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.408694750999999, 2024-05-07T14:03:21.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016205300999999998, 2024-05-07T14:03:21.254 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.254 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.254 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.254 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.254 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.254 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.254 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2239 2024-05-07T14:03:21.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.254 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:21.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767350+0000", 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2800000000000002e-06 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771179+0000", 2024-05-07T14:03:21.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038294069999999999 2024-05-07T14:03:21.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771194+0000", 2024-05-07T14:03:21.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4103e-05 2024-05-07T14:03:21.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771204+0000", 2024-05-07T14:03:21.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0302999999999999e-05 2024-05-07T14:03:21.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771255+0000", 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1483999999999997e-05 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771364+0000", 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010839499999999999 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771466+0000", 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010258499999999999 2024-05-07T14:03:21.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.777053+0000", 2024-05-07T14:03:21.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005586466 2024-05-07T14:03:21.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783452+0000", 2024-05-07T14:03:21.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063994409999999996 2024-05-07T14:03:21.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783496+0000", 2024-05-07T14:03:21.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3789999999999999e-05 2024-05-07T14:03:21.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783553+0000", 2024-05-07T14:03:21.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7046999999999998e-05 2024-05-07T14:03:21.259 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.259 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.259 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.259 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2247 3.34 e84/21 3:2da2e766:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_46:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:21.259 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.317668026, 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017996064999999999, 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:21.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858377+0000", 2024-05-07T14:03:21.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1830000000000001e-06 2024-05-07T14:03:21.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863640+0000", 2024-05-07T14:03:21.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052637309999999998 2024-05-07T14:03:21.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863674+0000", 2024-05-07T14:03:21.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3142999999999998e-05 2024-05-07T14:03:21.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863690+0000", 2024-05-07T14:03:21.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6526000000000001e-05 2024-05-07T14:03:21.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863787+0000", 2024-05-07T14:03:21.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7180000000000001e-05 2024-05-07T14:03:21.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863818+0000", 2024-05-07T14:03:21.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1254999999999998e-05 2024-05-07T14:03:21.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.876302+0000", 2024-05-07T14:03:21.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012483449000000001 2024-05-07T14:03:21.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.876371+0000", 2024-05-07T14:03:21.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8597999999999996e-05 2024-05-07T14:03:21.264 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.264 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.264 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.264 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2507 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [call rgw.bucket_list in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:21.264 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:21.264 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.760338028, 2024-05-07T14:03:21.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.019773713, 2024-05-07T14:03:21.264 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2507 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415708+0000", 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4860000000000002e-06 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415724+0000", 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.643e-05 2024-05-07T14:03:21.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415759+0000", 2024-05-07T14:03:21.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4252999999999999e-05 2024-05-07T14:03:21.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415783+0000", 2024-05-07T14:03:21.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4315999999999999e-05 2024-05-07T14:03:21.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419072+0000", 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032886119999999998 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419099+0000", 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6956000000000001e-05 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435061+0000", 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0159622509999999 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435231+0000", 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016978800000000001 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435478+0000", 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024762100000000001 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2548 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:21.269 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.705689893000001, 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051163340000000002, 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2548 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:21.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:21.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:21.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8000000000000005e-07 2024-05-07T14:03:21.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470358+0000", 2024-05-07T14:03:21.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-05-07T14:03:21.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470372+0000", 2024-05-07T14:03:21.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3847e-05 2024-05-07T14:03:21.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470380+0000", 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5490000000000006e-06 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470458+0000", 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8267000000000001e-05 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470883+0000", 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042447600000000002 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.472791+0000", 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019075889999999999 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.473623+0000", 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083288600000000002 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.473769+0000", 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014536599999999999 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.474681+0000", 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091173000000000003 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475319+0000", 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00063865600000000003 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475376+0000", 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7256000000000002e-05 2024-05-07T14:03:21.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475469+0000", 2024-05-07T14:03:21.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2522000000000006e-05 2024-05-07T14:03:21.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.276 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.276 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.276 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:21.278 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:03:21.278 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:21.292+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:21.379 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:21.388+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:21.446 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:21.446 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:21.447 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:21.447 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:21.460 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:03:21.504 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:21.516+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:21.537 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:03:21.578 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:21.578 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:21.580 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:21.592+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:21.592 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:21.684 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:21.696+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:21.765 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 156.94861312, 2024-05-07T14:03:21.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63420480000000001, 2024-05-07T14:03:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1 2024-05-07T14:03:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:21.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:21.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827477+0000", 2024-05-07T14:03:21.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:03:21.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827491+0000", 2024-05-07T14:03:21.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3923999999999999e-05 2024-05-07T14:03:21.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827514+0000", 2024-05-07T14:03:21.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2796e-05 2024-05-07T14:03:21.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827531+0000", 2024-05-07T14:03:21.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7520000000000002e-05 2024-05-07T14:03:21.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827677+0000", 2024-05-07T14:03:21.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145408 2024-05-07T14:03:21.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:21.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827703+0000", 2024-05-07T14:03:21.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6704e-05 2024-05-07T14:03:21.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.458662+0000", 2024-05-07T14:03:21.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63095893199999997 2024-05-07T14:03:21.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459006+0000", 2024-05-07T14:03:21.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034329 2024-05-07T14:03:21.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:21.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459320+0000", 2024-05-07T14:03:21.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031472100000000001 2024-05-07T14:03:21.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.460665+0000", 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001344633 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461508+0000", 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084310400000000001 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461608+0000", 2024-05-07T14:03:21.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9481999999999994e-05 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461680+0000", 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1976000000000003e-05 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 155.965062725, 2024-05-07T14:03:21.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017650448999999999, 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 111 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811026+0000", 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5300000000000004e-07 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811031+0000", 2024-05-07T14:03:21.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0329999999999999e-06 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811043+0000", 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2543e-05 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811050+0000", 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8000000000000001e-06 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823676+0000", 2024-05-07T14:03:21.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012626052 2024-05-07T14:03:21.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823904+0000", 2024-05-07T14:03:21.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227562 2024-05-07T14:03:21.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:21.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.824349+0000", 2024-05-07T14:03:21.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044484 2024-05-07T14:03:21.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826371+0000", 2024-05-07T14:03:21.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020221380000000001 2024-05-07T14:03:21.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828408+0000", 2024-05-07T14:03:21.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020372369999999999 2024-05-07T14:03:21.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828540+0000", 2024-05-07T14:03:21.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013213600000000001 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828676+0000", 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013545500000000001 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 155.96500130999999, 2024-05-07T14:03:21.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021330954999999999, 2024-05-07T14:03:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 112 2024-05-07T14:03:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:21.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-07 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811224+0000", 2024-05-07T14:03:21.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653499999999999 2024-05-07T14:03:21.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811237+0000", 2024-05-07T14:03:21.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.271e-05 2024-05-07T14:03:21.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811245+0000", 2024-05-07T14:03:21.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6400000000000003e-06 2024-05-07T14:03:21.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826483+0000", 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015237456 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826705+0000", 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022216799999999999 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.827081+0000", 2024-05-07T14:03:21.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037659800000000002 2024-05-07T14:03:21.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.831960+0000", 2024-05-07T14:03:21.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048788779999999997 2024-05-07T14:03:21.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832167+0000", 2024-05-07T14:03:21.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020690500000000001 2024-05-07T14:03:21.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832305+0000", 2024-05-07T14:03:21.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013801899999999999 2024-05-07T14:03:21.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832418+0000", 2024-05-07T14:03:21.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112212 2024-05-07T14:03:21.786 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.786 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.786 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 155.96482780100001, 2024-05-07T14:03:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021403628000000001, 2024-05-07T14:03:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 113 2024-05-07T14:03:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.788 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:21.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:21.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811261+0000", 2024-05-07T14:03:21.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0400000000000005e-07 2024-05-07T14:03:21.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811267+0000", 2024-05-07T14:03:21.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6099999999999997e-06 2024-05-07T14:03:21.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811276+0000", 2024-05-07T14:03:21.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4029999999999996e-06 2024-05-07T14:03:21.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811283+0000", 2024-05-07T14:03:21.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:03:21.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828825+0000", 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017541853999999999 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829061+0000", 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235861 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829418+0000", 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035766800000000001 2024-05-07T14:03:21.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832130+0000", 2024-05-07T14:03:21.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027118120000000001 2024-05-07T14:03:21.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832442+0000", 2024-05-07T14:03:21.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000311611 2024-05-07T14:03:21.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832565+0000", 2024-05-07T14:03:21.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012284199999999999 2024-05-07T14:03:21.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832664+0000", 2024-05-07T14:03:21.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8982999999999997e-05 2024-05-07T14:03:21.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.793 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.794 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:21.794 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:21.794 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 155.96479381099999, 2024-05-07T14:03:21.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023518260999999999, 2024-05-07T14:03:21.794 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.794 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.794 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.794 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.795 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:21.795 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:21.795 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 114 2024-05-07T14:03:21.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.795 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:21.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:21.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811295+0000", 2024-05-07T14:03:21.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:03:21.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811301+0000", 2024-05-07T14:03:21.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8599999999999998e-06 2024-05-07T14:03:21.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811310+0000", 2024-05-07T14:03:21.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0299999999999999e-06 2024-05-07T14:03:21.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811320+0000", 2024-05-07T14:03:21.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023e-05 2024-05-07T14:03:21.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830314+0000", 2024-05-07T14:03:21.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018994385999999999 2024-05-07T14:03:21.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830552+0000", 2024-05-07T14:03:21.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023815500000000001 2024-05-07T14:03:21.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:21.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830971+0000", 2024-05-07T14:03:21.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041934300000000003 2024-05-07T14:03:21.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834620+0000", 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036481389999999999 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834666+0000", 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6266000000000001e-05 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834742+0000", 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6069000000000006e-05 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834812+0000", 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0372999999999999e-05 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 155.96475325200001, 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027863941999999999, 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.801 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.802 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.802 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:21.802 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:21.802 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 115 2024-05-07T14:03:21.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.802 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:21.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:21.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:21.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2699999999999999e-07 2024-05-07T14:03:21.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811469+0000", 2024-05-07T14:03:21.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133332 2024-05-07T14:03:21.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811502+0000", 2024-05-07T14:03:21.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3027000000000001e-05 2024-05-07T14:03:21.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811511+0000", 2024-05-07T14:03:21.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.713e-06 2024-05-07T14:03:21.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832759+0000", 2024-05-07T14:03:21.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021248185999999999 2024-05-07T14:03:21.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832917+0000", 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157825 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.833269+0000", 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035184099999999998 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838250+0000", 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004980712 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838941+0000", 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069081399999999999 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839091+0000", 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149903 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839199+0000", 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010796199999999999 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.807 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 155.96455938899999, 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028128562999999999, 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:21.808 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 116 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811529+0000", 2024-05-07T14:03:21.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:03:21.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811546+0000", 2024-05-07T14:03:21.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7113e-05 2024-05-07T14:03:21.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811570+0000", 2024-05-07T14:03:21.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.406e-05 2024-05-07T14:03:21.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811578+0000", 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8660000000000006e-06 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834997+0000", 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023418799000000001 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835317+0000", 2024-05-07T14:03:21.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031991799999999998 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835662+0000", 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034544399999999998 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839220+0000", 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035576959999999999 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839374+0000", 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015427600000000001 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839540+0000", 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016534500000000001 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839657+0000", 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117243 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.813 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 155.96449637699999, 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02858051, 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 117 2024-05-07T14:03:21.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.815 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:21.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:21.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811592+0000", 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811601+0000", 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1269999999999992e-06 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811611+0000", 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6900000000000004e-06 2024-05-07T14:03:21.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811618+0000", 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0770000000000002e-06 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836766+0000", 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025147966000000001 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836982+0000", 2024-05-07T14:03:21.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021640400000000001 2024-05-07T14:03:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.837283+0000", 2024-05-07T14:03:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030005800000000002 2024-05-07T14:03:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839885+0000", 2024-05-07T14:03:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002602937 2024-05-07T14:03:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839925+0000", 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9446000000000001e-05 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840061+0000", 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136043 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840172+0000", 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111019 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.819 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 155.47675778999999, 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019781539000000001, 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 140 2024-05-07T14:03:21.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.821 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:21.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:21.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:21.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-07 2024-05-07T14:03:21.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299398+0000", 2024-05-07T14:03:21.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7822000000000002e-05 2024-05-07T14:03:21.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299404+0000", 2024-05-07T14:03:21.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2369999999999997e-06 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299409+0000", 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2069999999999997e-06 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311355+0000", 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011946082 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311493+0000", 2024-05-07T14:03:21.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013830900000000001 2024-05-07T14:03:21.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:21.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311709+0000", 2024-05-07T14:03:21.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021606899999999999 2024-05-07T14:03:21.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314528+0000", 2024-05-07T14:03:21.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028193839999999999 2024-05-07T14:03:21.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319001+0000", 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004472218 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319063+0000", 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1940000000000007e-05 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319112+0000", 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8964000000000001e-05 2024-05-07T14:03:21.825 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 155.47667142500001, 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019944718, 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:21.826 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 141 2024-05-07T14:03:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299417+0000", 2024-05-07T14:03:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7099999999999997e-07 2024-05-07T14:03:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299420+0000", 2024-05-07T14:03:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8629999999999999e-06 2024-05-07T14:03:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299424+0000", 2024-05-07T14:03:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4830000000000001e-06 2024-05-07T14:03:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299429+0000", 2024-05-07T14:03:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6609999999999999e-06 2024-05-07T14:03:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312813+0000", 2024-05-07T14:03:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013384330999999999 2024-05-07T14:03:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312948+0000", 2024-05-07T14:03:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000135239 2024-05-07T14:03:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313163+0000", 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000214718 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314534+0000", 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013704430000000001 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319185+0000", 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046516839999999997 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319281+0000", 2024-05-07T14:03:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5645999999999999e-05 2024-05-07T14:03:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319361+0000", 2024-05-07T14:03:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0278999999999995e-05 2024-05-07T14:03:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1480 3.7 e80/21 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head v 80'1, mlcod=0'0)", 2024-05-07T14:03:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.469374574, 2024-05-07T14:03:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026214482000000001, 2024-05-07T14:03:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306719+0000", 2024-05-07T14:03:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9669999999999998e-06 2024-05-07T14:03:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315882+0000", 2024-05-07T14:03:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091624629999999992 2024-05-07T14:03:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315923+0000", 2024-05-07T14:03:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0995999999999998e-05 2024-05-07T14:03:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315945+0000", 2024-05-07T14:03:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2665999999999999e-05 2024-05-07T14:03:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.316100+0000", 2024-05-07T14:03:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015487399999999999 2024-05-07T14:03:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.316140+0000", 2024-05-07T14:03:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9582999999999997e-05 2024-05-07T14:03:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.332710+0000", 2024-05-07T14:03:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016570412999999999 2024-05-07T14:03:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.332928+0000", 2024-05-07T14:03:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021751999999999999 2024-05-07T14:03:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2204 3.3b 3:df85b00b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.468736768999999, 2024-05-07T14:03:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02108792, 2024-05-07T14:03:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2204 2024-05-07T14:03:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307354+0000", 2024-05-07T14:03:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3730000000000001e-06 2024-05-07T14:03:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.311997+0000", 2024-05-07T14:03:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046420480000000002 2024-05-07T14:03:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312024+0000", 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7586e-05 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312036+0000", 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2103000000000001e-05 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312106+0000", 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9808000000000007e-05 2024-05-07T14:03:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312224+0000", 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117926 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312320+0000", 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5642000000000003e-05 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322866+0000", 2024-05-07T14:03:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010546181 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328215+0000", 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053494379999999998 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328351+0000", 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013558 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328439+0000", 2024-05-07T14:03:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8234999999999998e-05 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2206 3.f 3:f1007ae4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.445983675000001, 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018268163, 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2206 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330106+0000", 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2730000000000001e-06 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333445+0000", 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033386409999999998 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333474+0000", 2024-05-07T14:03:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8617999999999999e-05 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333487+0000", 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3716e-05 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333644+0000", 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000156914 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333966+0000", 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032135600000000002 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334209+0000", 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024347600000000001 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.346821+0000", 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012612046999999999 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348105+0000", 2024-05-07T14:03:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012841020000000001 2024-05-07T14:03:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348253+0000", 2024-05-07T14:03:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147412 2024-05-07T14:03:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348372+0000", 2024-05-07T14:03:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119608 2024-05-07T14:03:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2207 3.26 e84/21 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.430576276, 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021638324, 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345513+0000", 2024-05-07T14:03:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.313e-06 2024-05-07T14:03:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349394+0000", 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003881481 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349425+0000", 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0329e-05 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349440+0000", 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4905999999999999e-05 2024-05-07T14:03:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349531+0000", 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0907000000000002e-05 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349555+0000", 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4097999999999999e-05 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367060+0000", 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017505314000000001 2024-05-07T14:03:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367150+0000", 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2213 3.d 3:b01db4c3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.348372569999999, 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022630872999999999, 2024-05-07T14:03:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2213 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427719+0000", 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.703e-06 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431417+0000", 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036980110000000002 2024-05-07T14:03:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431441+0000", 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4380999999999999e-05 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431451+0000", 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9890000000000004e-06 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431567+0000", 2024-05-07T14:03:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115136 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431816+0000", 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024989700000000001 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432033+0000", 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021664300000000001 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.447025+0000", 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014991473 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450138+0000", 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003113429 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450234+0000", 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6519000000000002e-05 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450346+0000", 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111692 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2215 3.37 3:eed806fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.31850171, 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019726679, 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2215 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457589+0000", 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1e-06 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461583+0000", 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039941919999999997 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461615+0000", 2024-05-07T14:03:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1835999999999998e-05 2024-05-07T14:03:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461630+0000", 2024-05-07T14:03:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4766000000000001e-05 2024-05-07T14:03:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461782+0000", 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015214800000000001 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462139+0000", 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035658499999999997 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462489+0000", 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034982900000000001 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.476308+0000", 2024-05-07T14:03:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013819761 2024-05-07T14:03:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477139+0000", 2024-05-07T14:03:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083034199999999997 2024-05-07T14:03:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477226+0000", 2024-05-07T14:03:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7517999999999998e-05 2024-05-07T14:03:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477313+0000", 2024-05-07T14:03:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6601999999999995e-05 2024-05-07T14:03:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2220 3.11 3:8b7a5ffd:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.240530796000002, 2024-05-07T14:03:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022329020000000002, 2024-05-07T14:03:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2220 2024-05-07T14:03:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535561+0000", 2024-05-07T14:03:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.546e-06 2024-05-07T14:03:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.539966+0000", 2024-05-07T14:03:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044058270000000002 2024-05-07T14:03:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540002+0000", 2024-05-07T14:03:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5435999999999998e-05 2024-05-07T14:03:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540019+0000", 2024-05-07T14:03:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7003e-05 2024-05-07T14:03:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540153+0000", 2024-05-07T14:03:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133721 2024-05-07T14:03:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540396+0000", 2024-05-07T14:03:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024384400000000001 2024-05-07T14:03:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540605+0000", 2024-05-07T14:03:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020872999999999999 2024-05-07T14:03:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.556698+0000", 2024-05-07T14:03:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016093028999999998 2024-05-07T14:03:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557670+0000", 2024-05-07T14:03:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000971477 2024-05-07T14:03:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557779+0000", 2024-05-07T14:03:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010969800000000001 2024-05-07T14:03:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557886+0000", 2024-05-07T14:03:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106709 2024-05-07T14:03:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2221 3.f 3:f1cd2e50:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.229864619000001, 2024-05-07T14:03:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024790956999999999, 2024-05-07T14:03:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2221 2024-05-07T14:03:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546227+0000", 2024-05-07T14:03:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.27e-06 2024-05-07T14:03:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550241+0000", 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040139950000000002 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550273+0000", 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2741999999999999e-05 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550298+0000", 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4484000000000001e-05 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550463+0000", 2024-05-07T14:03:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165274 2024-05-07T14:03:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550736+0000", 2024-05-07T14:03:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027265299999999998 2024-05-07T14:03:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551015+0000", 2024-05-07T14:03:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027935900000000002 2024-05-07T14:03:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.569950+0000", 2024-05-07T14:03:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018935469999999999 2024-05-07T14:03:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.570807+0000", 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00085676600000000002 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.570928+0000", 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120568 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571014+0000", 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6376000000000001e-05 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2250 3.11 3:8ab50290:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.888226682999999, 2024-05-07T14:03:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025202414999999999, 2024-05-07T14:03:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2250 2024-05-07T14:03:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887864+0000", 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9299999999999999e-06 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892840+0000", 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049758420000000003 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892883+0000", 2024-05-07T14:03:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2568999999999998e-05 2024-05-07T14:03:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892902+0000", 2024-05-07T14:03:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9667e-05 2024-05-07T14:03:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893027+0000", 2024-05-07T14:03:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012506799999999999 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893232+0000", 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020444199999999999 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893445+0000", 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021324199999999999 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.911638+0000", 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018193343000000001 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.912977+0000", 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001338802 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.913026+0000", 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8862000000000001e-05 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.913064+0000", 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7648000000000003e-05 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2500 7.15 7:a93a5511:::notify.2:head [watch reconnect cookie 94397682175232 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.381198002, 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0539674379999999, 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2500 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394893+0000", 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8830000000000002e-06 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394909+0000", 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5840000000000001e-05 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394951+0000", 2024-05-07T14:03:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2175999999999997e-05 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394973+0000", 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2679000000000001e-05 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395138+0000", 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000164895 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395156+0000", 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7237000000000001e-05 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415064+0000", 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019908478 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415089+0000", 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4916e-05 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.425843+0000", 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.010754116 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.427029+0000", 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011857700000000001 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.436255+0000", 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092263629999999996 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.436391+0000", 2024-05-07T14:03:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136117 2024-05-07T14:03:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.448857+0000", 2024-05-07T14:03:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012465967999999999 2024-05-07T14:03:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:21.895 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:21.897 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:21.908+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:21.897 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:21.997 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:22.008+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:22.024 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:22.024 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:22.024 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:22.024 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:22.037 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:22.099 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:22.108+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:22.155 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:22.156 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:22.156 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:22.156 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:22.156 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:22.169 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:22.216 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:22.228+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:22.231 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:03:22.290 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:22.291 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:22.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:22.291 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:22.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.291 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:03:22.291 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:22.291 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 155.99101694500001, 2024-05-07T14:03:22.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:03:22.291 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:03:22.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:03:22.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:03:22.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:03:22.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:03:22.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:03:22.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:03:22.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:03:22.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:03:22.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:03:22.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:03:22.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:03:22.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:03:22.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:03:22.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:03:22.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:03:22.296 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.296 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.296 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.296 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:03:22.296 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:22.297 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 155.99011054900001, 2024-05-07T14:03:22.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:03:22.297 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.297 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.297 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.297 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.297 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.297 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:22.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.298 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.298 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:22.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.298 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.298 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:03:22.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:03:22.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:03:22.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:03:22.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:03:22.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:03:22.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:03:22.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:03:22.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:03:22.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:03:22.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:03:22.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:03:22.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:03:22.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:03:22.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:03:22.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:03:22.302 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.302 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.302 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.302 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:03:22.302 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:22.302 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 155.98869793, 2024-05-07T14:03:22.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:03:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:03:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:03:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:03:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:03:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:03:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:03:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:03:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:03:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:03:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:03:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 135.16302744800001, 2024-05-07T14:03:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:03:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:03:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:03:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:03:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:03:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:03:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:03:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:03:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:03:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 135.12991679000001, 2024-05-07T14:03:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:03:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:03:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:03:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:03:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:03:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:03:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:03:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:03:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:03:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:03:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:03:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:03:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:03:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:03:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:03:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:03:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:03:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:03:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:03:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1477 3.18 e80/21 3:1a16f065:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_1:head v 80'1, mlcod=0'0)", 2024-05-07T14:03:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.014763532, 2024-05-07T14:03:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014861011, 2024-05-07T14:03:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287825+0000", 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290411+0000", 2024-05-07T14:03:22.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025854430000000002 2024-05-07T14:03:22.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290433+0000", 2024-05-07T14:03:22.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.264e-05 2024-05-07T14:03:22.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290443+0000", 2024-05-07T14:03:22.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7189999999999996e-06 2024-05-07T14:03:22.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290521+0000", 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8164000000000006e-05 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290546+0000", 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4533e-05 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302655+0000", 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012108898999999999 2024-05-07T14:03:22.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302684+0000", 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9624e-05 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1478 3.12 3:4bdcf7a4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.013323693, 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013141795, 2024-05-07T14:03:22.325 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.326 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.326 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.326 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:22.326 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:22.326 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:22.326 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1478 2024-05-07T14:03:22.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.326 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:22.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:22.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289265+0000", 2024-05-07T14:03:22.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.001e-06 2024-05-07T14:03:22.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290501+0000", 2024-05-07T14:03:22.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001235487 2024-05-07T14:03:22.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290514+0000", 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.358e-05 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290521+0000", 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8889999999999996e-06 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290588+0000", 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.7218000000000006e-05 2024-05-07T14:03:22.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290762+0000", 2024-05-07T14:03:22.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017409200000000001 2024-05-07T14:03:22.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:22.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290904+0000", 2024-05-07T14:03:22.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000141963 2024-05-07T14:03:22.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:22.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.301956+0000", 2024-05-07T14:03:22.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011051640999999999 2024-05-07T14:03:22.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:22.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302315+0000", 2024-05-07T14:03:22.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000358876 2024-05-07T14:03:22.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302353+0000", 2024-05-07T14:03:22.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8003999999999997e-05 2024-05-07T14:03:22.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302405+0000", 2024-05-07T14:03:22.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2043999999999998e-05 2024-05-07T14:03:22.332 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.332 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.332 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.333 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1481 4.b 4:d1744c9b:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.0:head [stat,call rgw.guard_bucket_resharding in=26b,call rgw.bucket_complete_op in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:22.333 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:22.333 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 29.968897761000001, 2024-05-07T14:03:22.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099753589999999996, 2024-05-07T14:03:22.333 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.333 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.333 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.333 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:22.333 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:22.333 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:22.334 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1481 2024-05-07T14:03:22.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.334 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:22.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:22.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333691+0000", 2024-05-07T14:03:22.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8920000000000001e-06 2024-05-07T14:03:22.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333699+0000", 2024-05-07T14:03:22.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1089999999999998e-06 2024-05-07T14:03:22.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333715+0000", 2024-05-07T14:03:22.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6260999999999999e-05 2024-05-07T14:03:22.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333723+0000", 2024-05-07T14:03:22.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1579999999999999e-06 2024-05-07T14:03:22.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333800+0000", 2024-05-07T14:03:22.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7000000000000001e-05 2024-05-07T14:03:22.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:22.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333807+0000", 2024-05-07T14:03:22.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.498e-06 2024-05-07T14:03:22.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339421+0000", 2024-05-07T14:03:22.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056137909999999999 2024-05-07T14:03:22.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339536+0000", 2024-05-07T14:03:22.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115297 2024-05-07T14:03:22.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:22.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339894+0000", 2024-05-07T14:03:22.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035790799999999999 2024-05-07T14:03:22.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:22.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343340+0000", 2024-05-07T14:03:22.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034459120000000002 2024-05-07T14:03:22.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:22.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343547+0000", 2024-05-07T14:03:22.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020692799999999999 2024-05-07T14:03:22.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343613+0000", 2024-05-07T14:03:22.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6166000000000003e-05 2024-05-07T14:03:22.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343664+0000", 2024-05-07T14:03:22.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1439e-05 2024-05-07T14:03:22.341 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.341 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.341 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.341 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1611 3.30 e81/21 3:0c405120:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_1:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:22.341 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:22.342 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.876443001999998, 2024-05-07T14:03:22.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013061969999999999, 2024-05-07T14:03:22.342 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.342 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.342 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.342 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:22.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:22.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426145+0000", 2024-05-07T14:03:22.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5990000000000001e-06 2024-05-07T14:03:22.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.433982+0000", 2024-05-07T14:03:22.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078361190000000008 2024-05-07T14:03:22.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434000+0000", 2024-05-07T14:03:22.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.806e-05 2024-05-07T14:03:22.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434011+0000", 2024-05-07T14:03:22.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1615e-05 2024-05-07T14:03:22.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434085+0000", 2024-05-07T14:03:22.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3819000000000006e-05 2024-05-07T14:03:22.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434100+0000", 2024-05-07T14:03:22.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4973999999999999e-05 2024-05-07T14:03:22.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.439168+0000", 2024-05-07T14:03:22.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050674350000000003 2024-05-07T14:03:22.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.439206+0000", 2024-05-07T14:03:22.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8349000000000002e-05 2024-05-07T14:03:22.347 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.347 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.347 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.347 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1612 3.3 e81/21 3:c1191b65:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_2:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:22.347 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:22.347 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.874807954000001, 2024-05-07T14:03:22.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086703990000000005, 2024-05-07T14:03:22.347 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.347 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.347 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427780+0000", 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1699999999999997e-07 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431380+0000", 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600378 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431413+0000", 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3056000000000003e-05 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431430+0000", 2024-05-07T14:03:22.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6986999999999998e-05 2024-05-07T14:03:22.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431508+0000", 2024-05-07T14:03:22.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8177999999999996e-05 2024-05-07T14:03:22.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431526+0000", 2024-05-07T14:03:22.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7333000000000002e-05 2024-05-07T14:03:22.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.436392+0000", 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0048665100000000001 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.436449+0000", 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7040000000000003e-05 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.351 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1915 4.1e 4:7a3b9b37:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.906352841, 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051237260000000003, 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1915 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396235+0000", 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.33e-06 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396241+0000", 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.699e-06 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396257+0000", 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5432000000000001e-05 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396265+0000", 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6009999999999995e-06 2024-05-07T14:03:22.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396336+0000", 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1045999999999997e-05 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396431+0000", 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5126999999999999e-05 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396547+0000", 2024-05-07T14:03:22.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115339 2024-05-07T14:03:22.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:22.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397910+0000", 2024-05-07T14:03:22.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013629720000000001 2024-05-07T14:03:22.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:22.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401294+0000", 2024-05-07T14:03:22.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384504 2024-05-07T14:03:22.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401329+0000", 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5179000000000003e-05 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401358+0000", 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8496999999999998e-05 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2208 3.3a e84/21 3:5ee07aff:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_7:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:22.357 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:22.358 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.949372416999999, 2024-05-07T14:03:22.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017943191000000001, 2024-05-07T14:03:22.358 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.358 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.358 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.358 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:22.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353217+0000", 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3920000000000001e-06 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363741+0000", 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010524586000000001 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363773+0000", 2024-05-07T14:03:22.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362000000000002e-05 2024-05-07T14:03:22.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363793+0000", 2024-05-07T14:03:22.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9743999999999999e-05 2024-05-07T14:03:22.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363870+0000", 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7610999999999999e-05 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363888+0000", 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.785e-05 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.371098+0000", 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072103100000000002 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.371158+0000", 2024-05-07T14:03:22.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9336000000000002e-05 2024-05-07T14:03:22.362 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.362 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.362 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.362 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2219 3.32 3:4d615ce3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:22.362 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:22.362 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.777570087000001, 2024-05-07T14:03:22.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016879689999999999, 2024-05-07T14:03:22.362 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.362 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.363 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.363 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:22.363 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:22.363 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:22.363 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2219 2024-05-07T14:03:22.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.363 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:22.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:22.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525020+0000", 2024-05-07T14:03:22.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.751e-06 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528212+0000", 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031922080000000002 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528240+0000", 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7911000000000001e-05 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528254+0000", 2024-05-07T14:03:22.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4457999999999999e-05 2024-05-07T14:03:22.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528333+0000", 2024-05-07T14:03:22.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9136999999999998e-05 2024-05-07T14:03:22.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528460+0000", 2024-05-07T14:03:22.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012715799999999999 2024-05-07T14:03:22.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528572+0000", 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011162099999999999 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541359+0000", 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012787023 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541810+0000", 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045134299999999999 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541859+0000", 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8934999999999998e-05 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541896+0000", 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7144999999999998e-05 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2225 3.1f 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:22.368 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:22.369 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.703840328999998, 2024-05-07T14:03:22.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020378113, 2024-05-07T14:03:22.369 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.369 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.369 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.369 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:22.369 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:22.369 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:22.369 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2225 2024-05-07T14:03:22.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.370 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:22.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:22.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598750+0000", 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8859999999999997e-06 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602351+0000", 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600195 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602470+0000", 2024-05-07T14:03:22.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119608 2024-05-07T14:03:22.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602494+0000", 2024-05-07T14:03:22.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.376e-05 2024-05-07T14:03:22.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602590+0000", 2024-05-07T14:03:22.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6399999999999999e-05 2024-05-07T14:03:22.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602740+0000", 2024-05-07T14:03:22.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014951 2024-05-07T14:03:22.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:22.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602884+0000", 2024-05-07T14:03:22.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000143616 2024-05-07T14:03:22.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:22.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618629+0000", 2024-05-07T14:03:22.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015745420999999999 2024-05-07T14:03:22.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:22.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619008+0000", 2024-05-07T14:03:22.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037870699999999999 2024-05-07T14:03:22.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619069+0000", 2024-05-07T14:03:22.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1617000000000003e-05 2024-05-07T14:03:22.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619125+0000", 2024-05-07T14:03:22.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5393000000000003e-05 2024-05-07T14:03:22.375 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.375 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.375 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.375 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2227 3.1b 3:d8b15ce8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:22.375 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:22.375 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.662054087000001, 2024-05-07T14:03:22.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017300908, 2024-05-07T14:03:22.375 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.376 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.376 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.376 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:22.376 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:22.376 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:22.376 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2227 2024-05-07T14:03:22.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.376 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:22.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:22.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640536+0000", 2024-05-07T14:03:22.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9809999999999999e-06 2024-05-07T14:03:22.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643182+0000", 2024-05-07T14:03:22.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026464769999999999 2024-05-07T14:03:22.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643207+0000", 2024-05-07T14:03:22.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5077999999999999e-05 2024-05-07T14:03:22.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643220+0000", 2024-05-07T14:03:22.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2866e-05 2024-05-07T14:03:22.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643329+0000", 2024-05-07T14:03:22.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108467 2024-05-07T14:03:22.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643499+0000", 2024-05-07T14:03:22.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017020199999999999 2024-05-07T14:03:22.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:22.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643652+0000", 2024-05-07T14:03:22.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152993 2024-05-07T14:03:22.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:22.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.648361+0000", 2024-05-07T14:03:22.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0047089530000000001 2024-05-07T14:03:22.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657709+0000", 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093483360000000005 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657779+0000", 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9375999999999994e-05 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657834+0000", 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5179000000000001e-05 2024-05-07T14:03:22.381 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.382 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.382 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.382 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2228 3.b e84/21 3:d3d17a37:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_27:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:22.382 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:22.382 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.650095529000001, 2024-05-07T14:03:22.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093032859999999992, 2024-05-07T14:03:22.382 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.382 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.382 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.382 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652493+0000", 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7269999999999999e-06 2024-05-07T14:03:22.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653476+0000", 2024-05-07T14:03:22.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098271300000000008 2024-05-07T14:03:22.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653501+0000", 2024-05-07T14:03:22.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5012e-05 2024-05-07T14:03:22.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653511+0000", 2024-05-07T14:03:22.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0009e-05 2024-05-07T14:03:22.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653607+0000", 2024-05-07T14:03:22.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5975000000000002e-05 2024-05-07T14:03:22.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653635+0000", 2024-05-07T14:03:22.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8010000000000001e-05 2024-05-07T14:03:22.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661728+0000", 2024-05-07T14:03:22.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080929339999999995 2024-05-07T14:03:22.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661795+0000", 2024-05-07T14:03:22.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6905999999999999e-05 2024-05-07T14:03:22.386 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.386 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.387 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.387 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2229 3.3 e84/21 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:22.387 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:22.387 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.637629286999999, 2024-05-07T14:03:22.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022534413, 2024-05-07T14:03:22.387 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.387 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.387 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.387 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:22.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:22.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664960+0000", 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0109999999999999e-06 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670334+0000", 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005374635 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3374999999999998e-05 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670385+0000", 2024-05-07T14:03:22.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7512000000000001e-05 2024-05-07T14:03:22.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670515+0000", 2024-05-07T14:03:22.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012940900000000001 2024-05-07T14:03:22.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670543+0000", 2024-05-07T14:03:22.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8157000000000002e-05 2024-05-07T14:03:22.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687374+0000", 2024-05-07T14:03:22.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016831793000000001 2024-05-07T14:03:22.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687492+0000", 2024-05-07T14:03:22.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117521 2024-05-07T14:03:22.391 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.391 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.391 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2230 3.b e84/21 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.627624116, 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016432748, 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:22.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674964+0000", 2024-05-07T14:03:22.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5409999999999999e-06 2024-05-07T14:03:22.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677117+0000", 2024-05-07T14:03:22.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002153154 2024-05-07T14:03:22.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677136+0000", 2024-05-07T14:03:22.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8691000000000001e-05 2024-05-07T14:03:22.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677148+0000", 2024-05-07T14:03:22.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2291e-05 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677217+0000", 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8880000000000005e-05 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677249+0000", 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1664e-05 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:22.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691337+0000", 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014087926000000001 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691396+0000", 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8600999999999997e-05 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2497 7.9 7:93e5b521:::notify.7:head [watch reconnect cookie 94397682177536 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 15.907645865999999, 2024-05-07T14:03:22.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0512951690000001, 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2497 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394942+0000", 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9100000000000002e-07 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394946+0000", 2024-05-07T14:03:22.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2239999999999997e-06 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394960+0000", 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3419e-05 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394966+0000", 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3620000000000002e-06 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395019+0000", 2024-05-07T14:03:22.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3099000000000001e-05 2024-05-07T14:03:22.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:22.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395023+0000", 2024-05-07T14:03:22.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0879999999999997e-06 2024-05-07T14:03:22.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400981+0000", 2024-05-07T14:03:22.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059580520000000001 2024-05-07T14:03:22.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400990+0000", 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0880000000000001e-06 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438550+0000", 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.037559288 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.439512+0000", 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000962154 2024-05-07T14:03:22.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442920+0000", 2024-05-07T14:03:22.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034085109999999999 2024-05-07T14:03:22.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:22.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442966+0000", 2024-05-07T14:03:22.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5509000000000001e-05 2024-05-07T14:03:22.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.446236+0000", 2024-05-07T14:03:22.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032704840000000002 2024-05-07T14:03:22.403 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.403 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.403 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.403 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "MOSDPGPushReply(3.3e 87/86 [PushReplyOp(3:7fbbdcd7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_108:head)])", 2024-05-07T14:03:22.403 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:22.403 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.842093094999999, 2024-05-07T14:03:22.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055859079999999997, 2024-05-07T14:03:22.403 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:22.403 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:22.404 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:22.404 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:22.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:22.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:22.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:22.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:22.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:22.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460495+0000", 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4499999999999996e-07 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460501+0000", 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.212e-06 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460514+0000", 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3183000000000001e-05 2024-05-07T14:03:22.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460523+0000", 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4450000000000002e-06 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460615+0000", 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1693000000000005e-05 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.466080+0000", 2024-05-07T14:03:22.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054645300000000004 2024-05-07T14:03:22.407 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.407 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.407 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.407 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:22.407 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:22.407 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:22.408 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:22.409 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:22.409 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:22.409 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:22.410 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:22.410 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:22.410 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:22.411 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:22.420+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:22.427 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:22.427 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:22.447 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:22.448 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:22.468 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:22.488 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:22.489 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:22.509 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:22.509 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:22.509 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:22.520+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:22.524 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:22.524 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:22.524 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:03:22.552 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:22.644 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:22.656+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:22.711 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:22.720+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:22.712 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:22.712 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:22.725 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:22.816 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:22.828+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:22.889 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:22.889 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:22.903 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:22.944 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:22.956+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:23.015 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:23.028+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:23.060 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:23.060 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:23.073 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:23.120 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:23.132+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:23.195 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:23.196 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:23.210 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:23.216 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:23.228+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:23.323 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:23.336+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:23.378 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:23.378 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:23.392 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:23.424 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:23.436+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:23.515 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:23.515 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:23.526 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:23.536+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:23.531 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:23.628 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:23.636+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:23.652 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:23.652 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:23.666 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:23.731 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:23.740+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:23.832 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:23.840+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:23.835 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:23.835 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:23.849 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:23.932 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:23.944+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:23.980 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:23.981 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:23.996 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:24.040 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:24.052+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:24.134 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:24.144+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:24.163 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:24.163 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:24.178 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:24.236 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:24.244+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:24.295 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:24.295 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:24.309 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:24.336 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:24.348+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:24.439 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:24.448+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:24.477 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:24.478 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:24.492 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:24.529 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:03:24.554 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:03:24.576 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:24.588+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:24.611 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:24.612 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:24.626 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:03:24.641 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:24.652+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:24.684 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:24.684 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:24.702 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:24.703 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:24.720 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:24.720 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:24.736 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:24.737 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:24.741 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:24.742 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:24.742 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:24.752+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:24.756 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:03:24.757 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:24.757 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:24.778 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:24.778 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:24.796 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:24.796 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:24.817 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:24.817 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:24.852 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:24.860+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:24.927 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:24.928 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:24.928 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:24.928 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:24.942 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:03:24.984 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:24.996+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:25.044 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:25.056+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:25.110 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:25.110 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:25.110 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:25.110 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:25.110 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:25.124 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:03:25.168 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:25.180+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:25.247 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:25.256+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:25.298 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:25.299 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:25.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:25.299 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:25.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.299 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:03:25.299 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:25.299 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 141.29205093100001, 2024-05-07T14:03:25.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089647730000000005, 2024-05-07T14:03:25.299 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.299 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.299 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.299 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.299 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.300 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.300 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 46 2024-05-07T14:03:25.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.300 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:25.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:25.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017451+0000", 2024-05-07T14:03:25.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9349999999999999e-06 2024-05-07T14:03:25.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017460+0000", 2024-05-07T14:03:25.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-05-07T14:03:25.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017481+0000", 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0984000000000001e-05 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017499+0000", 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018689+0000", 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001190303 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018945+0000", 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025626799999999998 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022176+0000", 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032308720000000001 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026078+0000", 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039018289999999999 2024-05-07T14:03:25.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026189+0000", 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110775 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026310+0000", 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121023 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026413+0000", 2024-05-07T14:03:25.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103346 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:337 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'5, mlcod=33'3)", 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 138.142593882, 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004459658, 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:25.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:25.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166908+0000", 2024-05-07T14:03:25.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2259999999999999e-06 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166922+0000", 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4780000000000001e-05 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166960+0000", 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8173000000000002e-05 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166981+0000", 2024-05-07T14:03:25.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0440000000000001e-05 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167154+0000", 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017287199999999999 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167207+0000", 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000001e-05 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171283+0000", 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004076278 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171365+0000", 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1588999999999994e-05 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:349 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:25.309 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 138.14171908599999, 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042886440000000003, 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:25.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167782+0000", 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167797+0000", 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4533e-05 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167828+0000", 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1239999999999999e-05 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167859+0000", 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1007000000000003e-05 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168041+0000", 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181788 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168095+0000", 2024-05-07T14:03:25.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3857000000000003e-05 2024-05-07T14:03:25.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171961+0000", 2024-05-07T14:03:25.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038664160000000001 2024-05-07T14:03:25.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172069+0000", 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107793 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1563 4.a 4:50961e27:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.636845053000002, 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050212310000000001, 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.314 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1563 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:25.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672655+0000", 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.33e-06 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672662+0000", 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2400000000000004e-06 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672688+0000", 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6483e-05 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672704+0000", 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6206e-05 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672789+0000", 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4445999999999998e-05 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672917+0000", 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012805499999999999 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673210+0000", 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029306500000000001 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.675980+0000", 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002770223 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677420+0000", 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001439397 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677568+0000", 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014831800000000001 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677675+0000", 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010746799999999999 2024-05-07T14:03:25.319 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1566 4.13 e81/23 4:cabacdb3:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.4:head v 81'5, mlcod=80'3)", 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.635669364000002, 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043209989999999998, 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673832+0000", 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1660000000000001e-06 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673850+0000", 2024-05-07T14:03:25.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7880000000000002e-05 2024-05-07T14:03:25.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673881+0000", 2024-05-07T14:03:25.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0883000000000002e-05 2024-05-07T14:03:25.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673900+0000", 2024-05-07T14:03:25.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9015999999999999e-05 2024-05-07T14:03:25.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674119+0000", 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000219113 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674175+0000", 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5962999999999999e-05 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678071+0000", 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003896119 2024-05-07T14:03:25.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678151+0000", 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9858999999999996e-05 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5165.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.156894667000003, 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059914829999999997, 2024-05-07T14:03:25.324 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5165", 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3551621939", 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 52 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152607+0000", 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2840000000000001e-06 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152620+0000", 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3159999999999999e-05 2024-05-07T14:03:25.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152650+0000", 2024-05-07T14:03:25.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9835000000000001e-05 2024-05-07T14:03:25.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152672+0000", 2024-05-07T14:03:25.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2334e-05 2024-05-07T14:03:25.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152802+0000", 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013009799999999999 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152930+0000", 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012816100000000001 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.153119+0000", 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018862699999999999 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.154156+0000", 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010365940000000001 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158442+0000", 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042868450000000001 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158532+0000", 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9135999999999995e-05 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158596+0000", 2024-05-07T14:03:25.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4408999999999999e-05 2024-05-07T14:03:25.330 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.330 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.330 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.330 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5535.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:25.330 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:25.330 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.000046795000003, 2024-05-07T14:03:25.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057064799999999999, 2024-05-07T14:03:25.330 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5535", 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/4024516518", 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 52 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309455+0000", 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0900000000000001e-06 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309469+0000", 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3013000000000001e-05 2024-05-07T14:03:25.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309506+0000", 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7536000000000001e-05 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309523+0000", 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7450000000000001e-05 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309683+0000", 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015954000000000001 2024-05-07T14:03:25.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309915+0000", 2024-05-07T14:03:25.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023159 2024-05-07T14:03:25.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:25.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.310272+0000", 2024-05-07T14:03:25.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035786100000000001 2024-05-07T14:03:25.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.311478+0000", 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001205888 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315002+0000", 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035240419999999998 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315089+0000", 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6975e-05 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315159+0000", 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9494999999999998e-05 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1719 4.a 4:5321cf61:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.5.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.387405503, 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041945250000000002, 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.336 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1719 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922096+0000", 2024-05-07T14:03:25.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2800000000000002e-06 2024-05-07T14:03:25.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922104+0000", 2024-05-07T14:03:25.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.524e-06 2024-05-07T14:03:25.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922130+0000", 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5367999999999998e-05 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922142+0000", 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2199e-05 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922238+0000", 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5754999999999994e-05 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922408+0000", 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017003999999999999 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922630+0000", 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221871 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.923677+0000", 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047517 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926214+0000", 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025365650000000002 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926251+0000", 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7234000000000003e-05 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926288+0000", 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7172000000000003e-05 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.341 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.342 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.342 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2203 3.1e e84/21 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:25.342 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:25.342 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.008017591000002, 2024-05-07T14:03:25.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021333873, 2024-05-07T14:03:25.342 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.342 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.342 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.342 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301484+0000", 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9139999999999998e-06 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307602+0000", 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061184630000000002 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307626+0000", 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3937000000000001e-05 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307637+0000", 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1027e-05 2024-05-07T14:03:25.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307724+0000", 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7435000000000006e-05 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307759+0000", 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5098000000000002e-05 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322730+0000", 2024-05-07T14:03:25.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014970651 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322815+0000", 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5347999999999997e-05 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2207 3.26 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.970903265, 2024-05-07T14:03:25.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029257551999999999, 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2207 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338601+0000", 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0769999999999998e-06 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344166+0000", 2024-05-07T14:03:25.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055649139999999998 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344203+0000", 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7109e-05 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344221+0000", 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344394+0000", 2024-05-07T14:03:25.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000173208 2024-05-07T14:03:25.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344788+0000", 2024-05-07T14:03:25.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039418400000000001 2024-05-07T14:03:25.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:25.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345265+0000", 2024-05-07T14:03:25.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047689299999999999 2024-05-07T14:03:25.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365597+0000", 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020331954999999999 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367512+0000", 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001915237 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367693+0000", 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018108800000000001 2024-05-07T14:03:25.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367853+0000", 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016028400000000001 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2209 3.a 3:51944b39:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.953003454000001, 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021277709999999998, 2024-05-07T14:03:25.352 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2209 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:25.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356500+0000", 2024-05-07T14:03:25.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3499999999999999e-06 2024-05-07T14:03:25.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361252+0000", 2024-05-07T14:03:25.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047518980000000001 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361291+0000", 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8546e-05 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361309+0000", 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361477+0000", 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016801399999999999 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361865+0000", 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038800199999999998 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362247+0000", 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038169099999999997 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373964+0000", 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01171701 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377549+0000", 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035850909999999999 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377657+0000", 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107593 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377773+0000", 2024-05-07T14:03:25.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011687499999999999 2024-05-07T14:03:25.358 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.358 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.358 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.358 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2214 3.33 e84/21 3:cdc86525:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_13:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:25.358 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:25.358 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.869173281999998, 2024-05-07T14:03:25.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010229887999999999, 2024-05-07T14:03:25.358 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.358 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.359 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.359 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:25.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:25.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440329+0000", 2024-05-07T14:03:25.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7159999999999999e-06 2024-05-07T14:03:25.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444193+0000", 2024-05-07T14:03:25.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038645609999999999 2024-05-07T14:03:25.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444219+0000", 2024-05-07T14:03:25.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6262e-05 2024-05-07T14:03:25.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444232+0000", 2024-05-07T14:03:25.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2989999999999999e-05 2024-05-07T14:03:25.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444307+0000", 2024-05-07T14:03:25.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5011000000000004e-05 2024-05-07T14:03:25.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444328+0000", 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0418e-05 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450513+0000", 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061855419999999996 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450556+0000", 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2388000000000001e-05 2024-05-07T14:03:25.362 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.363 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.363 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.363 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2218 3.35 3:af15427b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:25.363 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:25.363 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.796718245000001, 2024-05-07T14:03:25.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019068912, 2024-05-07T14:03:25.363 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.363 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.363 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.363 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.363 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2218 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512784+0000", 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3699999999999999e-06 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516649+0000", 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003864644 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516684+0000", 2024-05-07T14:03:25.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5403e-05 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516702+0000", 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7346e-05 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516848+0000", 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000146198 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517099+0000", 2024-05-07T14:03:25.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025069300000000002 2024-05-07T14:03:25.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:25.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517328+0000", 2024-05-07T14:03:25.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022939100000000001 2024-05-07T14:03:25.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.527840+0000", 2024-05-07T14:03:25.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010511786 2024-05-07T14:03:25.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531674+0000", 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00383417 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531766+0000", 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1859000000000003e-05 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531850+0000", 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4052000000000001e-05 2024-05-07T14:03:25.368 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2231 3.2e e84/21 3:767c3375:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_30:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.625421794000001, 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01236056, 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:25.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:25.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684080+0000", 2024-05-07T14:03:25.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5399999999999998e-06 2024-05-07T14:03:25.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688628+0000", 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045475969999999996 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688662+0000", 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4919999999999998e-05 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688679+0000", 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6135999999999999e-05 2024-05-07T14:03:25.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688793+0000", 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114005 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688836+0000", 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3176000000000001e-05 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696350+0000", 2024-05-07T14:03:25.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007513924 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696438+0000", 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8262000000000003e-05 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2232 3.2c 3:35867d96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.616429783000001, 2024-05-07T14:03:25.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017519415, 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2232 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693086+0000", 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6540000000000001e-05 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696895+0000", 2024-05-07T14:03:25.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038088509999999998 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696915+0000", 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9972000000000001e-05 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696927+0000", 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1907e-05 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697040+0000", 2024-05-07T14:03:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113621 2024-05-07T14:03:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697286+0000", 2024-05-07T14:03:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024593299999999999 2024-05-07T14:03:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697518+0000", 2024-05-07T14:03:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023206999999999999 2024-05-07T14:03:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710196+0000", 2024-05-07T14:03:25.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012677559 2024-05-07T14:03:25.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710293+0000", 2024-05-07T14:03:25.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559000000000006e-05 2024-05-07T14:03:25.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710430+0000", 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137045 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710589+0000", 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835799999999999 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2238 3.2e e84/21 3:76550f67:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_37:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.550152428000001, 2024-05-07T14:03:25.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011302262, 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759348+0000", 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5939999999999999e-06 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763299+0000", 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039506139999999999 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763325+0000", 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6366000000000001e-05 2024-05-07T14:03:25.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763341+0000", 2024-05-07T14:03:25.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.535e-05 2024-05-07T14:03:25.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763432+0000", 2024-05-07T14:03:25.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1757999999999998e-05 2024-05-07T14:03:25.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763462+0000", 2024-05-07T14:03:25.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9621e-05 2024-05-07T14:03:25.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.770571+0000", 2024-05-07T14:03:25.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071087779999999996 2024-05-07T14:03:25.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.770649+0000", 2024-05-07T14:03:25.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8181000000000002e-05 2024-05-07T14:03:25.383 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.383 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2239 3.36 3:6db3e702:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.542151449999999, 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016205300999999998, 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.384 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2239 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767350+0000", 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2800000000000002e-06 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771179+0000", 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038294069999999999 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771194+0000", 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4103e-05 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771204+0000", 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0302999999999999e-05 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771255+0000", 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1483999999999997e-05 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771364+0000", 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010839499999999999 2024-05-07T14:03:25.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771466+0000", 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010258499999999999 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.777053+0000", 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005586466 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783452+0000", 2024-05-07T14:03:25.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063994409999999996 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783496+0000", 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3789999999999999e-05 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783553+0000", 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7046999999999998e-05 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2247 3.34 e84/21 3:2da2e766:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_46:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.451124725, 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017996064999999999, 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858377+0000", 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1830000000000001e-06 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863640+0000", 2024-05-07T14:03:25.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052637309999999998 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863674+0000", 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3142999999999998e-05 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863690+0000", 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6526000000000001e-05 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863787+0000", 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7180000000000001e-05 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863818+0000", 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1254999999999998e-05 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.876302+0000", 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012483449000000001 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.876371+0000", 2024-05-07T14:03:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8597999999999996e-05 2024-05-07T14:03:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2507 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [call rgw.bucket_list in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.893794727, 2024-05-07T14:03:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.019773713, 2024-05-07T14:03:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.394 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2507 2024-05-07T14:03:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415708+0000", 2024-05-07T14:03:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4860000000000002e-06 2024-05-07T14:03:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415724+0000", 2024-05-07T14:03:25.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.643e-05 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415759+0000", 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4252999999999999e-05 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415783+0000", 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4315999999999999e-05 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419072+0000", 2024-05-07T14:03:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032886119999999998 2024-05-07T14:03:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419099+0000", 2024-05-07T14:03:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6956000000000001e-05 2024-05-07T14:03:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435061+0000", 2024-05-07T14:03:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0159622509999999 2024-05-07T14:03:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435231+0000", 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016978800000000001 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435478+0000", 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024762100000000001 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2548 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:25.399 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.839146591999999, 2024-05-07T14:03:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051163340000000002, 2024-05-07T14:03:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2548 2024-05-07T14:03:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8000000000000005e-07 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470358+0000", 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470372+0000", 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3847e-05 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470380+0000", 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5490000000000006e-06 2024-05-07T14:03:25.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470458+0000", 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8267000000000001e-05 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470883+0000", 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042447600000000002 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.472791+0000", 2024-05-07T14:03:25.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019075889999999999 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.473623+0000", 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083288600000000002 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.473769+0000", 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014536599999999999 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.474681+0000", 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091173000000000003 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475319+0000", 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00063865600000000003 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475376+0000", 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7256000000000002e-05 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475469+0000", 2024-05-07T14:03:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2522000000000006e-05 2024-05-07T14:03:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.406 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.406 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:25.407 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:03:25.408 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:25.416+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:25.509 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:25.520+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:25.535 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:25.535 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:25.535 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:25.535 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:25.543 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:03:25.553 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:03:25.620 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:25.632+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:25.674 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:25.675 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:25.675 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:25.675 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:25.675 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:25.688 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:25.711 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:25.720+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:25.812 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:25.824+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:25.816 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:25.816 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:25.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:25.816 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:25.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.817 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:25.817 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:25.817 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 160.999736824, 2024-05-07T14:03:25.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63420480000000001, 2024-05-07T14:03:25.817 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.817 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.817 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.817 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.817 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:25.817 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:25.817 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1 2024-05-07T14:03:25.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.818 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:25.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:25.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827477+0000", 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827491+0000", 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3923999999999999e-05 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827514+0000", 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2796e-05 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827531+0000", 2024-05-07T14:03:25.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7520000000000002e-05 2024-05-07T14:03:25.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827677+0000", 2024-05-07T14:03:25.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145408 2024-05-07T14:03:25.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:25.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827703+0000", 2024-05-07T14:03:25.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6704e-05 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.458662+0000", 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63095893199999997 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459006+0000", 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034329 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:25.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459320+0000", 2024-05-07T14:03:25.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031472100000000001 2024-05-07T14:03:25.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.460665+0000", 2024-05-07T14:03:25.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001344633 2024-05-07T14:03:25.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461508+0000", 2024-05-07T14:03:25.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084310400000000001 2024-05-07T14:03:25.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461608+0000", 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9481999999999994e-05 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461680+0000", 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1976000000000003e-05 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.823 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 160.01618642899999, 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017650448999999999, 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 111 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811026+0000", 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5300000000000004e-07 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811031+0000", 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0329999999999999e-06 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811043+0000", 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2543e-05 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811050+0000", 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8000000000000001e-06 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823676+0000", 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012626052 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823904+0000", 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227562 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.824349+0000", 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044484 2024-05-07T14:03:25.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826371+0000", 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020221380000000001 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828408+0000", 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020372369999999999 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828540+0000", 2024-05-07T14:03:25.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013213600000000001 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828676+0000", 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013545500000000001 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 160.01612501400001, 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021330954999999999, 2024-05-07T14:03:25.829 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.830 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.830 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.830 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.830 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:25.830 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:25.830 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 112 2024-05-07T14:03:25.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.830 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:25.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-07 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811224+0000", 2024-05-07T14:03:25.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653499999999999 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811237+0000", 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.271e-05 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811245+0000", 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6400000000000003e-06 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826483+0000", 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015237456 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826705+0000", 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022216799999999999 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.827081+0000", 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037659800000000002 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.831960+0000", 2024-05-07T14:03:25.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048788779999999997 2024-05-07T14:03:25.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832167+0000", 2024-05-07T14:03:25.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020690500000000001 2024-05-07T14:03:25.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832305+0000", 2024-05-07T14:03:25.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013801899999999999 2024-05-07T14:03:25.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832418+0000", 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112212 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 160.015951505, 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021403628000000001, 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.835 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 113 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811261+0000", 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0400000000000005e-07 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811267+0000", 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6099999999999997e-06 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811276+0000", 2024-05-07T14:03:25.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4029999999999996e-06 2024-05-07T14:03:25.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811283+0000", 2024-05-07T14:03:25.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:03:25.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828825+0000", 2024-05-07T14:03:25.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017541853999999999 2024-05-07T14:03:25.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829061+0000", 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235861 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829418+0000", 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035766800000000001 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832130+0000", 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027118120000000001 2024-05-07T14:03:25.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832442+0000", 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000311611 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832565+0000", 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012284199999999999 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832664+0000", 2024-05-07T14:03:25.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8982999999999997e-05 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 160.01591751500001, 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023518260999999999, 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.841 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 114 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811295+0000", 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811301+0000", 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8599999999999998e-06 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811310+0000", 2024-05-07T14:03:25.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0299999999999999e-06 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811320+0000", 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023e-05 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830314+0000", 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018994385999999999 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830552+0000", 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023815500000000001 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830971+0000", 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041934300000000003 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834620+0000", 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036481389999999999 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834666+0000", 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6266000000000001e-05 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834742+0000", 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6069000000000006e-05 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834812+0000", 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0372999999999999e-05 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.846 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 160.015876956, 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027863941999999999, 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:25.847 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 115 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2699999999999999e-07 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811469+0000", 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133332 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811502+0000", 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3027000000000001e-05 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811511+0000", 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.713e-06 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832759+0000", 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021248185999999999 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832917+0000", 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157825 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.833269+0000", 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035184099999999998 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838250+0000", 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004980712 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838941+0000", 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069081399999999999 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839091+0000", 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149903 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839199+0000", 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010796199999999999 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.852 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 160.01568309300001, 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028128562999999999, 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 116 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811529+0000", 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811546+0000", 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7113e-05 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811570+0000", 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.406e-05 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811578+0000", 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8660000000000006e-06 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834997+0000", 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023418799000000001 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835317+0000", 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031991799999999998 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835662+0000", 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034544399999999998 2024-05-07T14:03:25.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839220+0000", 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035576959999999999 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839374+0000", 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015427600000000001 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839540+0000", 2024-05-07T14:03:25.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016534500000000001 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839657+0000", 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117243 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 160.01562008100001, 2024-05-07T14:03:25.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02858051, 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 117 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811592+0000", 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811601+0000", 2024-05-07T14:03:25.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1269999999999992e-06 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811611+0000", 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6900000000000004e-06 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811618+0000", 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0770000000000002e-06 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836766+0000", 2024-05-07T14:03:25.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025147966000000001 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836982+0000", 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021640400000000001 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.837283+0000", 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030005800000000002 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839885+0000", 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002602937 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839925+0000", 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9446000000000001e-05 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840061+0000", 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136043 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840172+0000", 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111019 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 159.52788149400001, 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019781539000000001, 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.864 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 140 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:25.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-07 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299398+0000", 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7822000000000002e-05 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299404+0000", 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2369999999999997e-06 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299409+0000", 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2069999999999997e-06 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311355+0000", 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011946082 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311493+0000", 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013830900000000001 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311709+0000", 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021606899999999999 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314528+0000", 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028193839999999999 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319001+0000", 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004472218 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319063+0000", 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1940000000000007e-05 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319112+0000", 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8964000000000001e-05 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:03:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 159.527795129, 2024-05-07T14:03:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019944718, 2024-05-07T14:03:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:25.870 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 141 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299417+0000", 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7099999999999997e-07 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299420+0000", 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8629999999999999e-06 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299424+0000", 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4830000000000001e-06 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299429+0000", 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6609999999999999e-06 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312813+0000", 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013384330999999999 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312948+0000", 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000135239 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313163+0000", 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000214718 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314534+0000", 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013704430000000001 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319185+0000", 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046516839999999997 2024-05-07T14:03:25.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319281+0000", 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5645999999999999e-05 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319361+0000", 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0278999999999995e-05 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1480 3.7 e80/21 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head v 80'1, mlcod=0'0)", 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.520498277999998, 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026214482000000001, 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306719+0000", 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9669999999999998e-06 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315882+0000", 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091624629999999992 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315923+0000", 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0995999999999998e-05 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315945+0000", 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2665999999999999e-05 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.316100+0000", 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015487399999999999 2024-05-07T14:03:25.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.316140+0000", 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9582999999999997e-05 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.332710+0000", 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016570412999999999 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.332928+0000", 2024-05-07T14:03:25.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021751999999999999 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2204 3.3b 3:df85b00b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.519860473000001, 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02108792, 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.880 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2204 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307354+0000", 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3730000000000001e-06 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.311997+0000", 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046420480000000002 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312024+0000", 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7586e-05 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312036+0000", 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2103000000000001e-05 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312106+0000", 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9808000000000007e-05 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312224+0000", 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117926 2024-05-07T14:03:25.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312320+0000", 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5642000000000003e-05 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322866+0000", 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010546181 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328215+0000", 2024-05-07T14:03:25.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053494379999999998 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328351+0000", 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013558 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328439+0000", 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8234999999999998e-05 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2206 3.f 3:f1007ae4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.497107378999999, 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018268163, 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2206 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.886 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330106+0000", 2024-05-07T14:03:25.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2730000000000001e-06 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333445+0000", 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033386409999999998 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333474+0000", 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8617999999999999e-05 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333487+0000", 2024-05-07T14:03:25.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3716e-05 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333644+0000", 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000156914 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333966+0000", 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032135600000000002 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:25.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334209+0000", 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024347600000000001 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.346821+0000", 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012612046999999999 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348105+0000", 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012841020000000001 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348253+0000", 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147412 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348372+0000", 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119608 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2207 3.26 e84/21 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:25.891 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.481699979999998, 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021638324, 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:25.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345513+0000", 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.313e-06 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349394+0000", 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003881481 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349425+0000", 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0329e-05 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349440+0000", 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4905999999999999e-05 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349531+0000", 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0907000000000002e-05 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349555+0000", 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4097999999999999e-05 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367060+0000", 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017505314000000001 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367150+0000", 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2213 3.d 3:b01db4c3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.399496274000001, 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022630872999999999, 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2213 2024-05-07T14:03:25.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427719+0000", 2024-05-07T14:03:25.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.703e-06 2024-05-07T14:03:25.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431417+0000", 2024-05-07T14:03:25.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036980110000000002 2024-05-07T14:03:25.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431441+0000", 2024-05-07T14:03:25.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4380999999999999e-05 2024-05-07T14:03:25.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431451+0000", 2024-05-07T14:03:25.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9890000000000004e-06 2024-05-07T14:03:25.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431567+0000", 2024-05-07T14:03:25.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115136 2024-05-07T14:03:25.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431816+0000", 2024-05-07T14:03:25.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024989700000000001 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432033+0000", 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021664300000000001 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.447025+0000", 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014991473 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450138+0000", 2024-05-07T14:03:25.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003113429 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450234+0000", 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6519000000000002e-05 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450346+0000", 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111692 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.902 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2215 3.37 3:eed806fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:25.902 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:25.902 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.369625414000001, 2024-05-07T14:03:25.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019726679, 2024-05-07T14:03:25.902 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.902 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.902 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.902 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.902 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.902 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.902 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2215 2024-05-07T14:03:25.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457589+0000", 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1e-06 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461583+0000", 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039941919999999997 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461615+0000", 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1835999999999998e-05 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461630+0000", 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4766000000000001e-05 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461782+0000", 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015214800000000001 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462139+0000", 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035658499999999997 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462489+0000", 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034982900000000001 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.476308+0000", 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013819761 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477139+0000", 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083034199999999997 2024-05-07T14:03:25.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477226+0000", 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7517999999999998e-05 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477313+0000", 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6601999999999995e-05 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2220 3.11 3:8b7a5ffd:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.2916545, 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022329020000000002, 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2220 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535561+0000", 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.546e-06 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.539966+0000", 2024-05-07T14:03:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044058270000000002 2024-05-07T14:03:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540002+0000", 2024-05-07T14:03:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5435999999999998e-05 2024-05-07T14:03:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540019+0000", 2024-05-07T14:03:25.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7003e-05 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540153+0000", 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133721 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540396+0000", 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024384400000000001 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:25.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540605+0000", 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020872999999999999 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.556698+0000", 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016093028999999998 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557670+0000", 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000971477 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557779+0000", 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010969800000000001 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557886+0000", 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106709 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2221 3.f 3:f1cd2e50:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:25.913 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.280988322999999, 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024790956999999999, 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2221 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:25.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546227+0000", 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.27e-06 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550241+0000", 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040139950000000002 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550273+0000", 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2741999999999999e-05 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550298+0000", 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4484000000000001e-05 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550463+0000", 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165274 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550736+0000", 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027265299999999998 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551015+0000", 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027935900000000002 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.569950+0000", 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018935469999999999 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.570807+0000", 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00085676600000000002 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.570928+0000", 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120568 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571014+0000", 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6376000000000001e-05 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2250 3.11 3:8ab50290:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.939350387000001, 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025202414999999999, 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.919 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2250 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887864+0000", 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9299999999999999e-06 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892840+0000", 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049758420000000003 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892883+0000", 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2568999999999998e-05 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892902+0000", 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9667e-05 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893027+0000", 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012506799999999999 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893232+0000", 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020444199999999999 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893445+0000", 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021324199999999999 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.911638+0000", 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018193343000000001 2024-05-07T14:03:25.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.912977+0000", 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001338802 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.913026+0000", 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8862000000000001e-05 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.913064+0000", 2024-05-07T14:03:25.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7648000000000003e-05 2024-05-07T14:03:25.925 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.925 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.925 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.925 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2500 7.15 7:a93a5511:::notify.2:head [watch reconnect cookie 94397682175232 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:25.925 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:25.925 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.432321706, 2024-05-07T14:03:25.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0539674379999999, 2024-05-07T14:03:25.925 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:25.925 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:25.925 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:25.925 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2500 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:25.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394893+0000", 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8830000000000002e-06 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394909+0000", 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5840000000000001e-05 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394951+0000", 2024-05-07T14:03:25.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2175999999999997e-05 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394973+0000", 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2679000000000001e-05 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395138+0000", 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000164895 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:25.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395156+0000", 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7237000000000001e-05 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415064+0000", 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019908478 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415089+0000", 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4916e-05 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.425843+0000", 2024-05-07T14:03:25.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.010754116 2024-05-07T14:03:25.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:25.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.427029+0000", 2024-05-07T14:03:25.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011857700000000001 2024-05-07T14:03:25.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:25.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.436255+0000", 2024-05-07T14:03:25.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092263629999999996 2024-05-07T14:03:25.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.436391+0000", 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136117 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.448857+0000", 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012465967999999999 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:25.931 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:25.933 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:25.934 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:25.944+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:26.035 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:26.044+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:26.067 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:26.067 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:26.067 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:26.067 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:26.081 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:26.136 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:26.148+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:26.199 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:26.199 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:26.199 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:26.199 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:26.199 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:26.213 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:26.237 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:26.248+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:26.338 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:26.352+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:26.385 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:26.385 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:26.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:26.386 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:26.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.386 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:03:26.386 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:26.386 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 160.08522964799999, 2024-05-07T14:03:26.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:03:26.386 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.386 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.386 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.386 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:03:26.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:03:26.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:03:26.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:03:26.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:03:26.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:03:26.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:03:26.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.390 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 160.08432325199999, 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:03:26.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:03:26.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:03:26.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:03:26.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 160.08291063300001, 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.395 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:26.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:26.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:03:26.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:03:26.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:03:26.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:03:26.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:03:26.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:03:26.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:03:26.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:03:26.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:03:26.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:03:26.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:03:26.401 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.401 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.401 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.401 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:26.401 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:26.401 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 139.25724015099999, 2024-05-07T14:03:26.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:03:26.402 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.402 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.402 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.402 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.402 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.402 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.402 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:03:26.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.402 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:26.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:26.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:03:26.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:03:26.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:03:26.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:03:26.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:03:26.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:03:26.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:03:26.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:03:26.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:03:26.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:03:26.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:03:26.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:03:26.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:26.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:03:26.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:03:26.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:26.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:03:26.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:03:26.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:26.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:03:26.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:03:26.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 139.22412949299999, 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:26.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:26.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:03:26.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:26.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:03:26.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:03:26.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:26.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:03:26.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:03:26.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.414 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.415 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.415 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1477 3.18 e80/21 3:1a16f065:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_1:head v 80'1, mlcod=0'0)", 2024-05-07T14:03:26.415 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:26.415 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.108976235, 2024-05-07T14:03:26.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014861011, 2024-05-07T14:03:26.415 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.415 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.415 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.415 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:26.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:26.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287825+0000", 2024-05-07T14:03:26.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:03:26.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290411+0000", 2024-05-07T14:03:26.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025854430000000002 2024-05-07T14:03:26.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290433+0000", 2024-05-07T14:03:26.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.264e-05 2024-05-07T14:03:26.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290443+0000", 2024-05-07T14:03:26.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7189999999999996e-06 2024-05-07T14:03:26.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290521+0000", 2024-05-07T14:03:26.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8164000000000006e-05 2024-05-07T14:03:26.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290546+0000", 2024-05-07T14:03:26.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4533e-05 2024-05-07T14:03:26.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302655+0000", 2024-05-07T14:03:26.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012108898999999999 2024-05-07T14:03:26.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302684+0000", 2024-05-07T14:03:26.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9624e-05 2024-05-07T14:03:26.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.421 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.421 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1478 3.12 3:4bdcf7a4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:26.421 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:26.421 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.107536396, 2024-05-07T14:03:26.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013141795, 2024-05-07T14:03:26.422 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.422 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.422 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.422 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.422 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.422 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.422 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1478 2024-05-07T14:03:26.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.422 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:26.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:26.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289265+0000", 2024-05-07T14:03:26.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.001e-06 2024-05-07T14:03:26.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290501+0000", 2024-05-07T14:03:26.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001235487 2024-05-07T14:03:26.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290514+0000", 2024-05-07T14:03:26.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.358e-05 2024-05-07T14:03:26.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290521+0000", 2024-05-07T14:03:26.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8889999999999996e-06 2024-05-07T14:03:26.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290588+0000", 2024-05-07T14:03:26.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.7218000000000006e-05 2024-05-07T14:03:26.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290762+0000", 2024-05-07T14:03:26.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017409200000000001 2024-05-07T14:03:26.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:26.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290904+0000", 2024-05-07T14:03:26.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000141963 2024-05-07T14:03:26.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:26.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.301956+0000", 2024-05-07T14:03:26.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011051640999999999 2024-05-07T14:03:26.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:26.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302315+0000", 2024-05-07T14:03:26.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000358876 2024-05-07T14:03:26.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302353+0000", 2024-05-07T14:03:26.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8003999999999997e-05 2024-05-07T14:03:26.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302405+0000", 2024-05-07T14:03:26.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2043999999999998e-05 2024-05-07T14:03:26.428 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.428 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.428 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.429 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1481 4.b 4:d1744c9b:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.0:head [stat,call rgw.guard_bucket_resharding in=26b,call rgw.bucket_complete_op in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:26.429 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:26.429 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.063110463999998, 2024-05-07T14:03:26.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099753589999999996, 2024-05-07T14:03:26.429 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.429 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.429 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.429 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.429 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.429 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.429 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1481 2024-05-07T14:03:26.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.430 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:26.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:26.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333691+0000", 2024-05-07T14:03:26.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8920000000000001e-06 2024-05-07T14:03:26.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333699+0000", 2024-05-07T14:03:26.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1089999999999998e-06 2024-05-07T14:03:26.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333715+0000", 2024-05-07T14:03:26.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6260999999999999e-05 2024-05-07T14:03:26.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333723+0000", 2024-05-07T14:03:26.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1579999999999999e-06 2024-05-07T14:03:26.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333800+0000", 2024-05-07T14:03:26.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7000000000000001e-05 2024-05-07T14:03:26.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:26.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333807+0000", 2024-05-07T14:03:26.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.498e-06 2024-05-07T14:03:26.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339421+0000", 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056137909999999999 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339536+0000", 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115297 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339894+0000", 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035790799999999999 2024-05-07T14:03:26.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343340+0000", 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034459120000000002 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343547+0000", 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020692799999999999 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343613+0000", 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6166000000000003e-05 2024-05-07T14:03:26.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343664+0000", 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1439e-05 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1611 3.30 e81/21 3:0c405120:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_1:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.970655704999999, 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013061969999999999, 2024-05-07T14:03:26.436 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426145+0000", 2024-05-07T14:03:26.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5990000000000001e-06 2024-05-07T14:03:26.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.433982+0000", 2024-05-07T14:03:26.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078361190000000008 2024-05-07T14:03:26.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434000+0000", 2024-05-07T14:03:26.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.806e-05 2024-05-07T14:03:26.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434011+0000", 2024-05-07T14:03:26.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1615e-05 2024-05-07T14:03:26.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434085+0000", 2024-05-07T14:03:26.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3819000000000006e-05 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434100+0000", 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4973999999999999e-05 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.439168+0000", 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050674350000000003 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.439206+0000", 2024-05-07T14:03:26.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8349000000000002e-05 2024-05-07T14:03:26.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.441 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.441 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1612 3.3 e81/21 3:c1191b65:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_2:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:26.441 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:26.441 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.969020657000002, 2024-05-07T14:03:26.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086703990000000005, 2024-05-07T14:03:26.441 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.441 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.441 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427780+0000", 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1699999999999997e-07 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431380+0000", 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600378 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431413+0000", 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3056000000000003e-05 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431430+0000", 2024-05-07T14:03:26.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6986999999999998e-05 2024-05-07T14:03:26.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431508+0000", 2024-05-07T14:03:26.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8177999999999996e-05 2024-05-07T14:03:26.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431526+0000", 2024-05-07T14:03:26.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7333000000000002e-05 2024-05-07T14:03:26.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.436392+0000", 2024-05-07T14:03:26.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0048665100000000001 2024-05-07T14:03:26.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.436449+0000", 2024-05-07T14:03:26.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7040000000000003e-05 2024-05-07T14:03:26.446 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.446 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.446 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.446 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1915 4.1e 4:7a3b9b37:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:26.446 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:26.446 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.000565543999997, 2024-05-07T14:03:26.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051237260000000003, 2024-05-07T14:03:26.446 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.446 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.447 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.447 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.447 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.447 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.447 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1915 2024-05-07T14:03:26.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.447 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:26.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:26.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396235+0000", 2024-05-07T14:03:26.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.33e-06 2024-05-07T14:03:26.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396241+0000", 2024-05-07T14:03:26.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.699e-06 2024-05-07T14:03:26.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396257+0000", 2024-05-07T14:03:26.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5432000000000001e-05 2024-05-07T14:03:26.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396265+0000", 2024-05-07T14:03:26.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6009999999999995e-06 2024-05-07T14:03:26.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396336+0000", 2024-05-07T14:03:26.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1045999999999997e-05 2024-05-07T14:03:26.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396431+0000", 2024-05-07T14:03:26.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5126999999999999e-05 2024-05-07T14:03:26.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:26.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396547+0000", 2024-05-07T14:03:26.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115339 2024-05-07T14:03:26.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:26.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397910+0000", 2024-05-07T14:03:26.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013629720000000001 2024-05-07T14:03:26.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:26.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401294+0000", 2024-05-07T14:03:26.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384504 2024-05-07T14:03:26.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401329+0000", 2024-05-07T14:03:26.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5179000000000003e-05 2024-05-07T14:03:26.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401358+0000", 2024-05-07T14:03:26.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8496999999999998e-05 2024-05-07T14:03:26.453 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.453 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.453 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.454 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2208 3.3a e84/21 3:5ee07aff:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_7:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:26.454 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:26.454 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.043585119999999, 2024-05-07T14:03:26.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017943191000000001, 2024-05-07T14:03:26.454 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.454 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.454 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.454 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:26.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:26.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353217+0000", 2024-05-07T14:03:26.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3920000000000001e-06 2024-05-07T14:03:26.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363741+0000", 2024-05-07T14:03:26.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010524586000000001 2024-05-07T14:03:26.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363773+0000", 2024-05-07T14:03:26.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362000000000002e-05 2024-05-07T14:03:26.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363793+0000", 2024-05-07T14:03:26.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9743999999999999e-05 2024-05-07T14:03:26.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363870+0000", 2024-05-07T14:03:26.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7610999999999999e-05 2024-05-07T14:03:26.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363888+0000", 2024-05-07T14:03:26.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.785e-05 2024-05-07T14:03:26.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.371098+0000", 2024-05-07T14:03:26.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072103100000000002 2024-05-07T14:03:26.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.371158+0000", 2024-05-07T14:03:26.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9336000000000002e-05 2024-05-07T14:03:26.459 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2219 3.32 3:4d615ce3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.871782790000001, 2024-05-07T14:03:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016879689999999999, 2024-05-07T14:03:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.460 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.461 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.461 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2219 2024-05-07T14:03:26.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.461 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:26.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525020+0000", 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.751e-06 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528212+0000", 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031922080000000002 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528240+0000", 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7911000000000001e-05 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528254+0000", 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4457999999999999e-05 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528333+0000", 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9136999999999998e-05 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528460+0000", 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012715799999999999 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528572+0000", 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011162099999999999 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541359+0000", 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012787023 2024-05-07T14:03:26.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541810+0000", 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045134299999999999 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541859+0000", 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8934999999999998e-05 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541896+0000", 2024-05-07T14:03:26.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7144999999999998e-05 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2225 3.1f 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.798053031999999, 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020378113, 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.466 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.467 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.467 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2225 2024-05-07T14:03:26.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.467 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:26.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:26.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598750+0000", 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8859999999999997e-06 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602351+0000", 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600195 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602470+0000", 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119608 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602494+0000", 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.376e-05 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602590+0000", 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6399999999999999e-05 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602740+0000", 2024-05-07T14:03:26.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014951 2024-05-07T14:03:26.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:26.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602884+0000", 2024-05-07T14:03:26.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000143616 2024-05-07T14:03:26.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:26.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618629+0000", 2024-05-07T14:03:26.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015745420999999999 2024-05-07T14:03:26.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:26.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619008+0000", 2024-05-07T14:03:26.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037870699999999999 2024-05-07T14:03:26.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619069+0000", 2024-05-07T14:03:26.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1617000000000003e-05 2024-05-07T14:03:26.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619125+0000", 2024-05-07T14:03:26.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5393000000000003e-05 2024-05-07T14:03:26.472 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.472 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.472 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.472 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2227 3.1b 3:d8b15ce8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:26.472 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:26.472 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.756266790000002, 2024-05-07T14:03:26.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017300908, 2024-05-07T14:03:26.472 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.473 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.473 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.473 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.473 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.473 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.473 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2227 2024-05-07T14:03:26.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.473 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:26.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:26.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640536+0000", 2024-05-07T14:03:26.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9809999999999999e-06 2024-05-07T14:03:26.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643182+0000", 2024-05-07T14:03:26.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026464769999999999 2024-05-07T14:03:26.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643207+0000", 2024-05-07T14:03:26.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5077999999999999e-05 2024-05-07T14:03:26.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643220+0000", 2024-05-07T14:03:26.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2866e-05 2024-05-07T14:03:26.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643329+0000", 2024-05-07T14:03:26.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108467 2024-05-07T14:03:26.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643499+0000", 2024-05-07T14:03:26.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017020199999999999 2024-05-07T14:03:26.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:26.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643652+0000", 2024-05-07T14:03:26.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152993 2024-05-07T14:03:26.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:26.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.648361+0000", 2024-05-07T14:03:26.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0047089530000000001 2024-05-07T14:03:26.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:26.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657709+0000", 2024-05-07T14:03:26.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093483360000000005 2024-05-07T14:03:26.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657779+0000", 2024-05-07T14:03:26.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9375999999999994e-05 2024-05-07T14:03:26.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657834+0000", 2024-05-07T14:03:26.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5179000000000001e-05 2024-05-07T14:03:26.479 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.479 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.479 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.479 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2228 3.b e84/21 3:d3d17a37:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_27:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:26.479 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:26.479 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.744308232000002, 2024-05-07T14:03:26.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093032859999999992, 2024-05-07T14:03:26.480 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.480 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.480 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.480 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:26.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:26.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652493+0000", 2024-05-07T14:03:26.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7269999999999999e-06 2024-05-07T14:03:26.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653476+0000", 2024-05-07T14:03:26.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098271300000000008 2024-05-07T14:03:26.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.482 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.482 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653501+0000", 2024-05-07T14:03:26.482 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5012e-05 2024-05-07T14:03:26.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.482 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.482 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653511+0000", 2024-05-07T14:03:26.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0009e-05 2024-05-07T14:03:26.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653607+0000", 2024-05-07T14:03:26.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5975000000000002e-05 2024-05-07T14:03:26.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653635+0000", 2024-05-07T14:03:26.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8010000000000001e-05 2024-05-07T14:03:26.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661728+0000", 2024-05-07T14:03:26.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080929339999999995 2024-05-07T14:03:26.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661795+0000", 2024-05-07T14:03:26.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6905999999999999e-05 2024-05-07T14:03:26.485 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.485 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.485 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.485 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2229 3.3 e84/21 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:26.485 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:26.485 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.731841989999999, 2024-05-07T14:03:26.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022534413, 2024-05-07T14:03:26.485 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.485 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.485 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.486 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:26.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:26.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664960+0000", 2024-05-07T14:03:26.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0109999999999999e-06 2024-05-07T14:03:26.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670334+0000", 2024-05-07T14:03:26.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005374635 2024-05-07T14:03:26.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:26.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3374999999999998e-05 2024-05-07T14:03:26.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.488 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670385+0000", 2024-05-07T14:03:26.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7512000000000001e-05 2024-05-07T14:03:26.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.488 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.488 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670515+0000", 2024-05-07T14:03:26.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012940900000000001 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670543+0000", 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8157000000000002e-05 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687374+0000", 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016831793000000001 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687492+0000", 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117521 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2230 3.b e84/21 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.721836819, 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016432748, 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.490 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674964+0000", 2024-05-07T14:03:26.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5409999999999999e-06 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677117+0000", 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002153154 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677136+0000", 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8691000000000001e-05 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677148+0000", 2024-05-07T14:03:26.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2291e-05 2024-05-07T14:03:26.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677217+0000", 2024-05-07T14:03:26.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8880000000000005e-05 2024-05-07T14:03:26.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677249+0000", 2024-05-07T14:03:26.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1664e-05 2024-05-07T14:03:26.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691337+0000", 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014087926000000001 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691396+0000", 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8600999999999997e-05 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.494 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2497 7.9 7:93e5b521:::notify.7:head [watch reconnect cookie 94397682177536 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:26.495 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:26.495 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.001858568999999, 2024-05-07T14:03:26.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0512951690000001, 2024-05-07T14:03:26.495 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.495 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.495 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:26.495 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.495 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.495 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.496 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2497 2024-05-07T14:03:26.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.496 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:26.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:26.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394942+0000", 2024-05-07T14:03:26.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9100000000000002e-07 2024-05-07T14:03:26.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394946+0000", 2024-05-07T14:03:26.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2239999999999997e-06 2024-05-07T14:03:26.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394960+0000", 2024-05-07T14:03:26.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3419e-05 2024-05-07T14:03:26.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394966+0000", 2024-05-07T14:03:26.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3620000000000002e-06 2024-05-07T14:03:26.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395019+0000", 2024-05-07T14:03:26.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3099000000000001e-05 2024-05-07T14:03:26.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:26.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395023+0000", 2024-05-07T14:03:26.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0879999999999997e-06 2024-05-07T14:03:26.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400981+0000", 2024-05-07T14:03:26.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059580520000000001 2024-05-07T14:03:26.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:26.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400990+0000", 2024-05-07T14:03:26.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0880000000000001e-06 2024-05-07T14:03:26.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438550+0000", 2024-05-07T14:03:26.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.037559288 2024-05-07T14:03:26.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:26.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.439512+0000", 2024-05-07T14:03:26.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000962154 2024-05-07T14:03:26.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442920+0000", 2024-05-07T14:03:26.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034085109999999999 2024-05-07T14:03:26.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442966+0000", 2024-05-07T14:03:26.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5509000000000001e-05 2024-05-07T14:03:26.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.446236+0000", 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032704840000000002 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "MOSDPGPushReply(3.3e 87/86 [PushReplyOp(3:7fbbdcd7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_108:head)])", 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.936305797999999, 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055859079999999997, 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.503 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460495+0000", 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4499999999999996e-07 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460501+0000", 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.212e-06 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460514+0000", 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3183000000000001e-05 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460523+0000", 2024-05-07T14:03:26.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4450000000000002e-06 2024-05-07T14:03:26.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460615+0000", 2024-05-07T14:03:26.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1693000000000005e-05 2024-05-07T14:03:26.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.466080+0000", 2024-05-07T14:03:26.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054645300000000004 2024-05-07T14:03:26.507 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.507 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.507 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.507 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.507 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.507 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:26.509 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:26.509 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:26.520+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:26.609 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:26.620+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:26.636 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:26.637 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:26.637 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:26.637 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:26.650 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:26.710 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:26.720+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:26.773 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:26.773 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:26.773 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:26.773 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:26.773 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:26.789 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:26.812 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:26.824+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:26.835 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:03:26.912 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:26.924+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:26.959 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:26.959 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:26.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:26.959 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:26.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.959 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:03:26.959 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:26.959 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 146.986147797, 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:26.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:03:26.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:03:26.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:03:26.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:03:26.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:03:26.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:03:26.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:03:26.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:03:26.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:03:26.964 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.964 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.964 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.964 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:26.964 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:03:26.964 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 139.803044505, 2024-05-07T14:03:26.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:03:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:03:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:03:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:03:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:03:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:26.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 139.667424536, 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.970 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:03:26.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:03:26.975 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1571 4.24 4:26e499bb:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.298251395000001, 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063870100000000003, 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.976 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1571 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2800000000000002e-07 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672852+0000", 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6599999999999999e-06 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672866+0000", 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3648999999999999e-05 2024-05-07T14:03:26.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672871+0000", 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672926+0000", 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4299999999999998e-05 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673007+0000", 2024-05-07T14:03:26.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1429999999999998e-05 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673097+0000", 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0272000000000006e-05 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673822+0000", 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072425300000000001 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:26.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679164+0000", 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005341943 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679209+0000", 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5738000000000002e-05 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679236+0000", 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6633000000000001e-05 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.981 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1578 4.27 4:e7c87c96:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.073789255000001, 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046530510000000001, 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1578 2024-05-07T14:03:26.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897314+0000", 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7250000000000002e-06 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897328+0000", 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4e-05 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897352+0000", 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4576999999999999e-05 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897366+0000", 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3173000000000001e-05 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897473+0000", 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010762100000000001 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897601+0000", 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012757099999999999 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897754+0000", 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152807 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900001+0000", 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002247686 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901868+0000", 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018669940000000001 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901924+0000", 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5383999999999997e-05 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901964+0000", 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0513000000000003e-05 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.987 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1582 4.27 4:e6cd56b0:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:26.988 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:03:26.988 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.073642903, 2024-05-07T14:03:26.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046596959999999996, 2024-05-07T14:03:26.988 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.988 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.988 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.988 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:26.988 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:26.988 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:26.988 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1582 2024-05-07T14:03:26.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.988 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897458+0000", 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5700000000000002e-07 2024-05-07T14:03:26.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897462+0000", 2024-05-07T14:03:26.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0690000000000003e-06 2024-05-07T14:03:26.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897469+0000", 2024-05-07T14:03:26.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0079999999999996e-06 2024-05-07T14:03:26.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897474+0000", 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9420000000000003e-06 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898643+0000", 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011688709999999999 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898756+0000", 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113522 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:26.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898961+0000", 2024-05-07T14:03:26.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020425799999999999 2024-05-07T14:03:26.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:26.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900212+0000", 2024-05-07T14:03:26.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012512860000000001 2024-05-07T14:03:26.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:26.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902014+0000", 2024-05-07T14:03:26.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018024029999999999 2024-05-07T14:03:26.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902075+0000", 2024-05-07T14:03:26.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0509e-05 2024-05-07T14:03:26.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902117+0000", 2024-05-07T14:03:26.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2271000000000002e-05 2024-05-07T14:03:26.993 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.993 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.993 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:49 7.15 e81/29 7:a93a5511:::notify.2:head v 81'49, mlcod=81'47)", 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.820120793000001, 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0070782700000000002, 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:03:26.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150981+0000", 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2899999999999999e-06 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:26.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150990+0000", 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3959999999999995e-06 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151011+0000", 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.105e-05 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151023+0000", 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151122+0000", 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9351999999999993e-05 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151155+0000", 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2459000000000002e-05 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158027+0000", 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.006871785 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158058+0000", 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1315000000000001e-05 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:52 7.d e81/29 7:b4812045:::notify.4:head v 81'48, mlcod=81'46)", 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.817674381000003, 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0048232429999999996, 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:26.998 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:26.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153427+0000", 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6499999999999999e-07 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153432+0000", 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9579999999999998e-06 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153441+0000", 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.662e-06 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153446+0000", 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7530000000000001e-06 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153492+0000", 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5853999999999998e-05 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153505+0000", 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3288000000000001e-05 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:27.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158230+0000", 2024-05-07T14:03:27.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0047249170000000004 2024-05-07T14:03:27.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:27.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158249+0000", 2024-05-07T14:03:27.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9145999999999999e-05 2024-05-07T14:03:27.002 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.002 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.002 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2202 3.0 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.691130418, 2024-05-07T14:03:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027191908000000001, 2024-05-07T14:03:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2202 2024-05-07T14:03:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.003 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279975+0000", 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0130000000000001e-06 2024-05-07T14:03:27.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285489+0000", 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055143570000000001 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285531+0000", 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1504000000000001e-05 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285550+0000", 2024-05-07T14:03:27.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9256e-05 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285747+0000", 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196777 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286120+0000", 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037285900000000002 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:27.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286489+0000", 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036951099999999999 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301589+0000", 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015099728999999999 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307085+0000", 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054963340000000003 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307127+0000", 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1977999999999997e-05 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307162+0000", 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4589999999999999e-05 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2212 3.1a e84/21 3:591da10a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_11:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:27.008 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.555962078, 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012581199, 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:27.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415141+0000", 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.52e-06 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421260+0000", 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061196169999999999 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421304+0000", 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3293e-05 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421324+0000", 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0341000000000001e-05 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421401+0000", 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6773999999999994e-05 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:27.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421418+0000", 2024-05-07T14:03:27.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6827e-05 2024-05-07T14:03:27.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:27.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.427656+0000", 2024-05-07T14:03:27.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0062381010000000002 2024-05-07T14:03:27.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:27.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.427720+0000", 2024-05-07T14:03:27.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3726000000000006e-05 2024-05-07T14:03:27.014 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.014 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.014 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.014 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2216 3.21 e84/46 3:86b25102:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_15:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:27.014 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:27.014 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.498603165999999, 2024-05-07T14:03:27.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012554667, 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:27.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472500+0000", 2024-05-07T14:03:27.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6630000000000002e-06 2024-05-07T14:03:27.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:27.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475359+0000", 2024-05-07T14:03:27.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028594409999999999 2024-05-07T14:03:27.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:27.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475407+0000", 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7868999999999999e-05 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475431+0000", 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3873999999999999e-05 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475528+0000", 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7163999999999993e-05 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475556+0000", 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7594999999999999e-05 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485009+0000", 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0094531149999999998 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485052+0000", 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2945999999999998e-05 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.018 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.019 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.019 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2217 3.0 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:27.019 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:27.019 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.480803850000001, 2024-05-07T14:03:27.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019983529, 2024-05-07T14:03:27.019 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:27.019 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:27.019 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:27.019 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:27.019 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:27.019 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2217 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490299+0000", 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492337+0000", 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020384489999999999 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492391+0000", 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3702000000000002e-05 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:27.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492415+0000", 2024-05-07T14:03:27.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3373000000000001e-05 2024-05-07T14:03:27.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:27.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492567+0000", 2024-05-07T14:03:27.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152788 2024-05-07T14:03:27.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492843+0000", 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027568999999999998 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493123+0000", 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028014899999999999 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509840+0000", 2024-05-07T14:03:27.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016716871000000001 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510203+0000", 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036252499999999999 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510250+0000", 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7231000000000002e-05 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:27.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510280+0000", 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0270999999999999e-05 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2219 3.32 e84/21 3:4d615ce3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_18:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.442383818, 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012848995, 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:27.025 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528718+0000", 2024-05-07T14:03:27.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.86e-06 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531113+0000", 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002394958 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531141+0000", 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7543e-05 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531154+0000", 2024-05-07T14:03:27.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3355e-05 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531232+0000", 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7608000000000006e-05 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531259+0000", 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6656e-05 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:27.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541473+0000", 2024-05-07T14:03:27.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010214101999999999 2024-05-07T14:03:27.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:27.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541566+0000", 2024-05-07T14:03:27.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2912999999999996e-05 2024-05-07T14:03:27.029 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.029 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.029 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.029 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2224 3.1a e84/21 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:27.029 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:27.030 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.375860183, 2024-05-07T14:03:27.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020623257999999998, 2024-05-07T14:03:27.030 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:27.030 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:27.030 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:27.030 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:27.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:27.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:27.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:27.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:27.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:27.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595243+0000", 2024-05-07T14:03:27.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6800000000000002e-06 2024-05-07T14:03:27.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:27.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.601988+0000", 2024-05-07T14:03:27.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0067452479999999997 2024-05-07T14:03:27.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602044+0000", 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5884999999999998e-05 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602070+0000", 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6359999999999998e-05 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602183+0000", 2024-05-07T14:03:27.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112761 2024-05-07T14:03:27.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:27.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602210+0000", 2024-05-07T14:03:27.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6882000000000001e-05 2024-05-07T14:03:27.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:27.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615811+0000", 2024-05-07T14:03:27.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01360132 2024-05-07T14:03:27.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:27.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615863+0000", 2024-05-07T14:03:27.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2122e-05 2024-05-07T14:03:27.034 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.034 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.034 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.034 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2225 3.1f e84/46 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:27.034 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:27.034 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.366432326000002, 2024-05-07T14:03:27.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014189089, 2024-05-07T14:03:27.034 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:27.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604671+0000", 2024-05-07T14:03:27.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6070000000000002e-06 2024-05-07T14:03:27.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:27.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607720+0000", 2024-05-07T14:03:27.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030496849999999999 2024-05-07T14:03:27.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:27.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607763+0000", 2024-05-07T14:03:27.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3044999999999999e-05 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607787+0000", 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3264e-05 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607878+0000", 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1650000000000005e-05 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:27.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607905+0000", 2024-05-07T14:03:27.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7090999999999999e-05 2024-05-07T14:03:27.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:27.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618733+0000", 2024-05-07T14:03:27.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010827582000000001 2024-05-07T14:03:27.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:27.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618857+0000", 2024-05-07T14:03:27.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000124165 2024-05-07T14:03:27.038 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.038 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.039 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.039 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2226 3.4 3:20f3de0c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:27.039 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:27.039 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.349123912, 2024-05-07T14:03:27.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014369191, 2024-05-07T14:03:27.039 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:27.039 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:27.039 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:27.039 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:27.039 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:27.039 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:27.040 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2226 2024-05-07T14:03:27.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.040 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:27.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:27.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:27.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:27.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:27.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621979+0000", 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.272e-06 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624873+0000", 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028946390000000001 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624904+0000", 2024-05-07T14:03:27.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0446e-05 2024-05-07T14:03:27.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:27.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624918+0000", 2024-05-07T14:03:27.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4263e-05 2024-05-07T14:03:27.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:27.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625007+0000", 2024-05-07T14:03:27.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8850000000000005e-05 2024-05-07T14:03:27.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625174+0000", 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167314 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625327+0000", 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152433 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.633342+0000", 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080152699999999997 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:27.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636260+0000", 2024-05-07T14:03:27.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029179060000000001 2024-05-07T14:03:27.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:27.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636297+0000", 2024-05-07T14:03:27.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7543000000000003e-05 2024-05-07T14:03:27.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:27.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636346+0000", 2024-05-07T14:03:27.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8254999999999998e-05 2024-05-07T14:03:27.044 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2233 3.8 e84/21 3:11b98425:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_32:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.705600+0000", 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.265500557999999, 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011076903000000001, 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:27.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705600+0000", 2024-05-07T14:03:27.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:27.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705600+0000", 2024-05-07T14:03:27.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:27.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705601+0000", 2024-05-07T14:03:27.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.375e-06 2024-05-07T14:03:27.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707534+0000", 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019330199999999999 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707561+0000", 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6979999999999999e-05 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707574+0000", 2024-05-07T14:03:27.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.328e-05 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707703+0000", 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012801500000000001 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707729+0000", 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6585999999999999e-05 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716608+0000", 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088793480000000004 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716677+0000", 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8299000000000005e-05 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2236 3.32 e84/21 3:4d7a89ea:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_35:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.737366+0000", 2024-05-07T14:03:27.049 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.23373428, 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01010346, 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.737366+0000", 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.737366+0000", 2024-05-07T14:03:27.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.737368+0000", 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.623e-06 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739037+0000", 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016693109999999999 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:27.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739061+0000", 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4280000000000001e-05 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739077+0000", 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5568000000000001e-05 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739194+0000", 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011736899999999999 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739227+0000", 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2268999999999999e-05 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.747401+0000", 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008174354 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.747470+0000", 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8685999999999999e-05 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.053 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2545 8.1 8:84e82796:root::.bucket.meta.buck_2024_04_7_14_02_56%3ac956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9:head [call version.check_conds in=18b,call version.inc in=10b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.464507+0000", 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 19.506592975, 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049738009999999999, 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:27.054 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2545 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464507+0000", 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464507+0000", 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464509+0000", 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0339999999999999e-06 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464522+0000", 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2088e-05 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464555+0000", 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3317e-05 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464574+0000", 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8885999999999998e-05 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464643+0000", 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9548000000000006e-05 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464737+0000", 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3839999999999996e-05 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464953+0000", 2024-05-07T14:03:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021561200000000001 2024-05-07T14:03:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.468765+0000", 2024-05-07T14:03:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038126850000000001 2024-05-07T14:03:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.469424+0000", 2024-05-07T14:03:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065884699999999995 2024-05-07T14:03:27.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:27.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.469457+0000", 2024-05-07T14:03:27.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3213999999999997e-05 2024-05-07T14:03:27.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:27.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.469481+0000", 2024-05-07T14:03:27.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3730000000000001e-05 2024-05-07T14:03:27.059 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.059 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.059 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2558 4.f 4:f3381da8:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.470708+0000", 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 19.500392795, 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050104470000000003, 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2558 2024-05-07T14:03:27.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.061 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:27.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:27.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470708+0000", 2024-05-07T14:03:27.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:27.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470708+0000", 2024-05-07T14:03:27.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:27.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470709+0000", 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8479999999999999e-06 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470717+0000", 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.824e-06 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470746+0000", 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8799999999999999e-05 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:27.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470761+0000", 2024-05-07T14:03:27.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5366000000000002e-05 2024-05-07T14:03:27.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:27.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470828+0000", 2024-05-07T14:03:27.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6654000000000003e-05 2024-05-07T14:03:27.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:27.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470917+0000", 2024-05-07T14:03:27.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9178999999999994e-05 2024-05-07T14:03:27.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:27.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.471014+0000", 2024-05-07T14:03:27.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6237999999999996e-05 2024-05-07T14:03:27.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:27.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.474388+0000", 2024-05-07T14:03:27.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033746990000000001 2024-05-07T14:03:27.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475630+0000", 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012418139999999999 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475680+0000", 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0118999999999999e-05 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475718+0000", 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7905999999999999e-05 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.065 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.066 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:27.066 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:27.066 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:27.067 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:27.068 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:27.068 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:27.069 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:27.069 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:27.069 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:27.070 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:27.070 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:27.070 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:27.071 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:27.076+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:27.090 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:27.090 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:27.111 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:27.111 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:27.131 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:27.131 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:27.152 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:27.152 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:27.168 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:27.180+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:27.185 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:27.185 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:27.199 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:27.268 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:27.280+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:27.355 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:27.355 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:27.369 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:27.370 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:27.380+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:27.470 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:27.480+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:27.487 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:27.487 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:27.501 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:27.571 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:27.580+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:27.574 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:03:27.624 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:27.625 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:27.639 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:27.684 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:27.696+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:27.760 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:27.760 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:27.774 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:27.775 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:27.788+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:27.875 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:27.884+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:27.939 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:27.939 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:27.952 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:27.996 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:28.008+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:28.077 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:28.088+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:28.103 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:28.103 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:28.117 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:28.178 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:28.188+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:28.279 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:28.288+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:28.280 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:28.280 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:28.295 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:28.380 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:28.392+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:28.457 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:28.458 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:28.471 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:28.516 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:28.528+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:28.552 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:03:28.624 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:28.636+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:28.642 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:28.643 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:28.656 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:28.704 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:28.716+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:28.777 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:28.777 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:28.784 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:28.796+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:28.791 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:03:28.885 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:28.896+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:28.955 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:28.955 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:28.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:03:28.986 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:28.996+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:29.087 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:29.096+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:29.136 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:29.137 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:29.150 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:03:29.170 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:03:29.192 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:29.204+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:29.289 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:29.300+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:29.315 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:29.315 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:29.325 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:29.325 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:29.329 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:03:29.341 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:29.341 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:29.359 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:29.359 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:29.376 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:29.377 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:29.390 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:29.400+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:29.396 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:29.396 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:29.415 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:29.416 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:29.436 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:29.436 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:29.454 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:29.455 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:29.456 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-05-07T14:03:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 145.4495719, 2024-05-07T14:03:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089647730000000005, 2024-05-07T14:03:29.456 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 46 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017448+0000", 2024-05-07T14:03:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017451+0000", 2024-05-07T14:03:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9349999999999999e-06 2024-05-07T14:03:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017460+0000", 2024-05-07T14:03:29.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3599999999999996e-06 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017481+0000", 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0984000000000001e-05 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.017499+0000", 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018689+0000", 2024-05-07T14:03:29.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001190303 2024-05-07T14:03:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.018945+0000", 2024-05-07T14:03:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025626799999999998 2024-05-07T14:03:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.022176+0000", 2024-05-07T14:03:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032308720000000001 2024-05-07T14:03:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026078+0000", 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039018289999999999 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026189+0000", 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110775 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026310+0000", 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000121023 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:04.026413+0000", 2024-05-07T14:03:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103346 2024-05-07T14:03:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:337 6.3 e33/27 6:c623b173:gc::gc.16:head v 33'5, mlcod=33'3)", 2024-05-07T14:03:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 142.30011485099999, 2024-05-07T14:03:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004459658, 2024-05-07T14:03:29.462 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166905+0000", 2024-05-07T14:03:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166908+0000", 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2259999999999999e-06 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166922+0000", 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4780000000000001e-05 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166960+0000", 2024-05-07T14:03:29.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8173000000000002e-05 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.166981+0000", 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0440000000000001e-05 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167154+0000", 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017287199999999999 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167207+0000", 2024-05-07T14:03:29.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3300000000000001e-05 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171283+0000", 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004076278 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171365+0000", 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1588999999999994e-05 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:349 6.1 e33/27 6:856b9b26:reshard::reshard.0000000002:head v 33'2, mlcod=0'0)", 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 142.29924005500001, 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042886440000000003, 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167780+0000", 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167782+0000", 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0099999999999998e-06 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167797+0000", 2024-05-07T14:03:29.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4533e-05 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167828+0000", 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1239999999999999e-05 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.167859+0000", 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1007000000000003e-05 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168041+0000", 2024-05-07T14:03:29.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181788 2024-05-07T14:03:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.168095+0000", 2024-05-07T14:03:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3857000000000003e-05 2024-05-07T14:03:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.171961+0000", 2024-05-07T14:03:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038664160000000001 2024-05-07T14:03:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:01:07.172069+0000", 2024-05-07T14:03:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107793 2024-05-07T14:03:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1563 4.a 4:50961e27:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.794366021999998, 2024-05-07T14:03:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050212310000000001, 2024-05-07T14:03:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.473 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.474 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.474 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:29.474 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:29.474 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:29.474 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1563 2024-05-07T14:03:29.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.474 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:29.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672654+0000", 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672655+0000", 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.33e-06 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672662+0000", 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2400000000000004e-06 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672688+0000", 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6483e-05 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672704+0000", 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6206e-05 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672789+0000", 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4445999999999998e-05 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.672917+0000", 2024-05-07T14:03:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012805499999999999 2024-05-07T14:03:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673210+0000", 2024-05-07T14:03:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029306500000000001 2024-05-07T14:03:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.675980+0000", 2024-05-07T14:03:29.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002770223 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677420+0000", 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001439397 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677568+0000", 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014831800000000001 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.677675+0000", 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010746799999999999 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1566 4.13 e81/23 4:cabacdb3:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.4:head v 81'5, mlcod=80'3)", 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.793190332999998, 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043209989999999998, 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.479 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673830+0000", 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673832+0000", 2024-05-07T14:03:29.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1660000000000001e-06 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673850+0000", 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7880000000000002e-05 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673881+0000", 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0883000000000002e-05 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.673900+0000", 2024-05-07T14:03:29.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9015999999999999e-05 2024-05-07T14:03:29.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674119+0000", 2024-05-07T14:03:29.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000219113 2024-05-07T14:03:29.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.674175+0000", 2024-05-07T14:03:29.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5962999999999999e-05 2024-05-07T14:03:29.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678071+0000", 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003896119 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.678151+0000", 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9858999999999996e-05 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5165.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:29.483 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.314415636, 2024-05-07T14:03:29.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059914829999999997, 2024-05-07T14:03:29.484 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.484 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.484 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.484 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:29.484 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5165", 2024-05-07T14:03:29.484 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3551621939", 2024-05-07T14:03:29.484 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 52 2024-05-07T14:03:29.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.484 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152605+0000", 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152607+0000", 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2840000000000001e-06 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152620+0000", 2024-05-07T14:03:29.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3159999999999999e-05 2024-05-07T14:03:29.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152650+0000", 2024-05-07T14:03:29.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9835000000000001e-05 2024-05-07T14:03:29.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152672+0000", 2024-05-07T14:03:29.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2334e-05 2024-05-07T14:03:29.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152802+0000", 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013009799999999999 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.152930+0000", 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012816100000000001 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.153119+0000", 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018862699999999999 2024-05-07T14:03:29.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.154156+0000", 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010365940000000001 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158442+0000", 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042868450000000001 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158532+0000", 2024-05-07T14:03:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9135999999999995e-05 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.158596+0000", 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4408999999999999e-05 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.5535.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.157567763999999, 2024-05-07T14:03:29.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057064799999999999, 2024-05-07T14:03:29.490 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.490 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.490 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.490 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:29.490 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.5535", 2024-05-07T14:03:29.490 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/4024516518", 2024-05-07T14:03:29.490 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 52 2024-05-07T14:03:29.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.490 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:29.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309452+0000", 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309455+0000", 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0900000000000001e-06 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309469+0000", 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3013000000000001e-05 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309506+0000", 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7536000000000001e-05 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309523+0000", 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7450000000000001e-05 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309683+0000", 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015954000000000001 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.309915+0000", 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023159 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.310272+0000", 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035786100000000001 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:29.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.311478+0000", 2024-05-07T14:03:29.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001205888 2024-05-07T14:03:29.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:29.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315002+0000", 2024-05-07T14:03:29.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035240419999999998 2024-05-07T14:03:29.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315089+0000", 2024-05-07T14:03:29.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6975e-05 2024-05-07T14:03:29.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.315159+0000", 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9494999999999998e-05 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:1719 4.a 4:5321cf61:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.5.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.544926472, 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041945250000000002, 2024-05-07T14:03:29.495 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1719 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922094+0000", 2024-05-07T14:03:29.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922096+0000", 2024-05-07T14:03:29.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2800000000000002e-06 2024-05-07T14:03:29.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922104+0000", 2024-05-07T14:03:29.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.524e-06 2024-05-07T14:03:29.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922130+0000", 2024-05-07T14:03:29.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5367999999999998e-05 2024-05-07T14:03:29.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922142+0000", 2024-05-07T14:03:29.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2199e-05 2024-05-07T14:03:29.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922238+0000", 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5754999999999994e-05 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922408+0000", 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017003999999999999 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.922630+0000", 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221871 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:29.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.923677+0000", 2024-05-07T14:03:29.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001047517 2024-05-07T14:03:29.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:29.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926214+0000", 2024-05-07T14:03:29.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025365650000000002 2024-05-07T14:03:29.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926251+0000", 2024-05-07T14:03:29.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7234000000000003e-05 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:53.926288+0000", 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7172000000000003e-05 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2203 3.1e e84/21 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.165538560000002, 2024-05-07T14:03:29.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021333873, 2024-05-07T14:03:29.502 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.502 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.502 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.502 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:29.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301482+0000", 2024-05-07T14:03:29.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.301484+0000", 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9139999999999998e-06 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307602+0000", 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061184630000000002 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307626+0000", 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3937000000000001e-05 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307637+0000", 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1027e-05 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307724+0000", 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7435000000000006e-05 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307759+0000", 2024-05-07T14:03:29.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5098000000000002e-05 2024-05-07T14:03:29.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322730+0000", 2024-05-07T14:03:29.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014970651 2024-05-07T14:03:29.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322815+0000", 2024-05-07T14:03:29.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5347999999999997e-05 2024-05-07T14:03:29.505 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2207 3.26 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.128424234000001, 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029257551999999999, 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:29.506 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2207 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338601+0000", 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0769999999999998e-06 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344166+0000", 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055649139999999998 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344203+0000", 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7109e-05 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344221+0000", 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344394+0000", 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000173208 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344788+0000", 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039418400000000001 2024-05-07T14:03:29.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:29.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345265+0000", 2024-05-07T14:03:29.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047689299999999999 2024-05-07T14:03:29.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:29.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365597+0000", 2024-05-07T14:03:29.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020331954999999999 2024-05-07T14:03:29.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:29.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367512+0000", 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001915237 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367693+0000", 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018108800000000001 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367853+0000", 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016028400000000001 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2209 3.a 3:51944b39:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.110524423000001, 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021277709999999998, 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2209 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356496+0000", 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.356500+0000", 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3499999999999999e-06 2024-05-07T14:03:29.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361252+0000", 2024-05-07T14:03:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047518980000000001 2024-05-07T14:03:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361291+0000", 2024-05-07T14:03:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8546e-05 2024-05-07T14:03:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361309+0000", 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361477+0000", 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016801399999999999 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.361865+0000", 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038800199999999998 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.362247+0000", 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038169099999999997 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.373964+0000", 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01171701 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377549+0000", 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035850909999999999 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377657+0000", 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107593 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.377773+0000", 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011687499999999999 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2214 3.33 e84/21 3:cdc86525:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_13:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:29.517 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.026694250999999, 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010229887999999999, 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440326+0000", 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.440329+0000", 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7159999999999999e-06 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444193+0000", 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038645609999999999 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444219+0000", 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6262e-05 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444232+0000", 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2989999999999999e-05 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444307+0000", 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5011000000000004e-05 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.444328+0000", 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0418e-05 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450513+0000", 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061855419999999996 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450556+0000", 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2388000000000001e-05 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.521 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2218 3.35 3:af15427b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.954239214000001, 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019068912, 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:29.522 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2218 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512781+0000", 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.512784+0000", 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3699999999999999e-06 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516649+0000", 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003864644 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516684+0000", 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5403e-05 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516702+0000", 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7346e-05 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.516848+0000", 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000146198 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517099+0000", 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025069300000000002 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.517328+0000", 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022939100000000001 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.527840+0000", 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010511786 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531674+0000", 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00383417 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531766+0000", 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1859000000000003e-05 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.531850+0000", 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4052000000000001e-05 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.527 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2231 3.2e e84/21 3:767c3375:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_30:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.782942763000001, 2024-05-07T14:03:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01236056, 2024-05-07T14:03:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684077+0000", 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.684080+0000", 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5399999999999998e-06 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688628+0000", 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045475969999999996 2024-05-07T14:03:29.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688662+0000", 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4919999999999998e-05 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688679+0000", 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6135999999999999e-05 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688793+0000", 2024-05-07T14:03:29.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114005 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.688836+0000", 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3176000000000001e-05 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696350+0000", 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007513924 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696438+0000", 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8262000000000003e-05 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2232 3.2c 3:35867d96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.773950752000001, 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017519415, 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:29.532 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2232 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693069+0000", 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.693086+0000", 2024-05-07T14:03:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6540000000000001e-05 2024-05-07T14:03:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696895+0000", 2024-05-07T14:03:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038088509999999998 2024-05-07T14:03:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696915+0000", 2024-05-07T14:03:29.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9972000000000001e-05 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.696927+0000", 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1907e-05 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697040+0000", 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113621 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697286+0000", 2024-05-07T14:03:29.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024593299999999999 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.697518+0000", 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023206999999999999 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710196+0000", 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012677559 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:29.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710293+0000", 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7559000000000006e-05 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710430+0000", 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137045 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.710589+0000", 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015835799999999999 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2238 3.2e e84/21 3:76550f67:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_37:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.707673397000001, 2024-05-07T14:03:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011302262, 2024-05-07T14:03:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759347+0000", 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.759348+0000", 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5939999999999999e-06 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763299+0000", 2024-05-07T14:03:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039506139999999999 2024-05-07T14:03:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763325+0000", 2024-05-07T14:03:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6366000000000001e-05 2024-05-07T14:03:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763341+0000", 2024-05-07T14:03:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.535e-05 2024-05-07T14:03:29.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763432+0000", 2024-05-07T14:03:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1757999999999998e-05 2024-05-07T14:03:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.763462+0000", 2024-05-07T14:03:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9621e-05 2024-05-07T14:03:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.770571+0000", 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071087779999999996 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.770649+0000", 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8181000000000002e-05 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2239 3.36 3:6db3e702:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:29.542 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.699672418999999, 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016205300999999998, 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2239 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767348+0000", 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.767350+0000", 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2800000000000002e-06 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771179+0000", 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038294069999999999 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771194+0000", 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4103e-05 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771204+0000", 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0302999999999999e-05 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771255+0000", 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1483999999999997e-05 2024-05-07T14:03:29.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771364+0000", 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010839499999999999 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.771466+0000", 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010258499999999999 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.777053+0000", 2024-05-07T14:03:29.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005586466 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783452+0000", 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063994409999999996 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783496+0000", 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3789999999999999e-05 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.783553+0000", 2024-05-07T14:03:29.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7046999999999998e-05 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2247 3.34 e84/21 3:2da2e766:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_46:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.608645694, 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017996064999999999, 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858374+0000", 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.858377+0000", 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1830000000000001e-06 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863640+0000", 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052637309999999998 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863674+0000", 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3142999999999998e-05 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863690+0000", 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6526000000000001e-05 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863787+0000", 2024-05-07T14:03:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7180000000000001e-05 2024-05-07T14:03:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.863818+0000", 2024-05-07T14:03:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1254999999999998e-05 2024-05-07T14:03:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.876302+0000", 2024-05-07T14:03:29.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012483449000000001 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.876371+0000", 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8597999999999996e-05 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2507 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [call rgw.bucket_list in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.051315696, 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.019773713, 2024-05-07T14:03:29.552 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2507 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:03:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415708+0000", 2024-05-07T14:03:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4860000000000002e-06 2024-05-07T14:03:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415724+0000", 2024-05-07T14:03:29.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.643e-05 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415759+0000", 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4252999999999999e-05 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415783+0000", 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4315999999999999e-05 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419072+0000", 2024-05-07T14:03:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032886119999999998 2024-05-07T14:03:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419099+0000", 2024-05-07T14:03:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6956000000000001e-05 2024-05-07T14:03:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435061+0000", 2024-05-07T14:03:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0159622509999999 2024-05-07T14:03:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435231+0000", 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016978800000000001 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435478+0000", 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024762100000000001 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2548 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:29.557 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 21.996667560999999, 2024-05-07T14:03:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051163340000000002, 2024-05-07T14:03:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2548 2024-05-07T14:03:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470353+0000", 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8000000000000005e-07 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470358+0000", 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4100000000000001e-06 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470372+0000", 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3847e-05 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470380+0000", 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5490000000000006e-06 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470458+0000", 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8267000000000001e-05 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.470883+0000", 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042447600000000002 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.472791+0000", 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019075889999999999 2024-05-07T14:03:29.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.473623+0000", 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083288600000000002 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.473769+0000", 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014536599999999999 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.474681+0000", 2024-05-07T14:03:29.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00091173000000000003 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475319+0000", 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00063865600000000003 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475376+0000", 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7256000000000002e-05 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:29.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.475469+0000", 2024-05-07T14:03:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2522000000000006e-05 2024-05-07T14:03:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:29.564 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:29.566 INFO:tasks.workunit.client.0.smithi106.stderr:200+0 records in 2024-05-07T14:03:29.566 INFO:tasks.workunit.client.0.smithi106.stderr:200+0 records out 2024-05-07T14:03:29.566 INFO:tasks.workunit.client.0.smithi106.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 21.7995 s, 96.2 MB/s 2024-05-07T14:03:29.566 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:03:29.567 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:29.576+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:29.666 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:29.676+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:29.701 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:29.701 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:29.701 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:29.701 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:29.711 INFO:tasks.workunit.client.0.smithi106.stdout:Bucket Created: buck_2024_04_7_14_03_29 2024-05-07T14:03:29.717 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:03:29.767 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:29.776+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:29.845 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:29.845 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:29.859 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:29.867 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:29.876+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:29.968 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:29.980+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:29.987 INFO:tasks.workunit.client.0.smithi106.stdout:bucket quota max size set for the given user: buck_2024_04_7_14_03_29 2024-05-07T14:03:30.041 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:30.041 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:30.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:30.041 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:30.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.041 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:30.041 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:30.041 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 165.22387163100001, 2024-05-07T14:03:30.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63420480000000001, 2024-05-07T14:03:30.041 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.041 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.041 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827477+0000", 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827491+0000", 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3923999999999999e-05 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827514+0000", 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2796e-05 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827531+0000", 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7520000000000002e-05 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827677+0000", 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145408 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827703+0000", 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6704e-05 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.458662+0000", 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63095893199999997 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459006+0000", 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034329 2024-05-07T14:03:30.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459320+0000", 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031472100000000001 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.460665+0000", 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001344633 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461508+0000", 2024-05-07T14:03:30.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084310400000000001 2024-05-07T14:03:30.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461608+0000", 2024-05-07T14:03:30.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9481999999999994e-05 2024-05-07T14:03:30.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461680+0000", 2024-05-07T14:03:30.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1976000000000003e-05 2024-05-07T14:03:30.049 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.049 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.049 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.049 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:30.049 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:30.049 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 164.240321236, 2024-05-07T14:03:30.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017650448999999999, 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 111 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811026+0000", 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5300000000000004e-07 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811031+0000", 2024-05-07T14:03:30.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0329999999999999e-06 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811043+0000", 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2543e-05 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811050+0000", 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8000000000000001e-06 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823676+0000", 2024-05-07T14:03:30.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012626052 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823904+0000", 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227562 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.824349+0000", 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044484 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826371+0000", 2024-05-07T14:03:30.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020221380000000001 2024-05-07T14:03:30.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828408+0000", 2024-05-07T14:03:30.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020372369999999999 2024-05-07T14:03:30.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828540+0000", 2024-05-07T14:03:30.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013213600000000001 2024-05-07T14:03:30.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828676+0000", 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013545500000000001 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 164.240259821, 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021330954999999999, 2024-05-07T14:03:30.055 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.056 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.056 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.056 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.056 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:30.056 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:30.056 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 112 2024-05-07T14:03:30.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.056 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:30.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-07 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811224+0000", 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653499999999999 2024-05-07T14:03:30.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811237+0000", 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.271e-05 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811245+0000", 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6400000000000003e-06 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826483+0000", 2024-05-07T14:03:30.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015237456 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826705+0000", 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022216799999999999 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.827081+0000", 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037659800000000002 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.831960+0000", 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048788779999999997 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832167+0000", 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020690500000000001 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832305+0000", 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013801899999999999 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832418+0000", 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112212 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 164.24008631199999, 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021403628000000001, 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.061 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 113 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811261+0000", 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0400000000000005e-07 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811267+0000", 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6099999999999997e-06 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811276+0000", 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4029999999999996e-06 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811283+0000", 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828825+0000", 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017541853999999999 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829061+0000", 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235861 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829418+0000", 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035766800000000001 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832130+0000", 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027118120000000001 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832442+0000", 2024-05-07T14:03:30.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000311611 2024-05-07T14:03:30.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832565+0000", 2024-05-07T14:03:30.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012284199999999999 2024-05-07T14:03:30.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832664+0000", 2024-05-07T14:03:30.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8982999999999997e-05 2024-05-07T14:03:30.066 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 164.240052322, 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023518260999999999, 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:30.067 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 114 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811295+0000", 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811301+0000", 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8599999999999998e-06 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811310+0000", 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0299999999999999e-06 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811320+0000", 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023e-05 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830314+0000", 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018994385999999999 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830552+0000", 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023815500000000001 2024-05-07T14:03:30.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830971+0000", 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041934300000000003 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834620+0000", 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036481389999999999 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834666+0000", 2024-05-07T14:03:30.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6266000000000001e-05 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834742+0000", 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6069000000000006e-05 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834812+0000", 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0372999999999999e-05 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 164.24001176300001, 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027863941999999999, 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 115 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.073 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2699999999999999e-07 2024-05-07T14:03:30.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811469+0000", 2024-05-07T14:03:30.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133332 2024-05-07T14:03:30.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811502+0000", 2024-05-07T14:03:30.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3027000000000001e-05 2024-05-07T14:03:30.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811511+0000", 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.713e-06 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832759+0000", 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021248185999999999 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832917+0000", 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157825 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.833269+0000", 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035184099999999998 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838250+0000", 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004980712 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838941+0000", 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069081399999999999 2024-05-07T14:03:30.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839091+0000", 2024-05-07T14:03:30.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149903 2024-05-07T14:03:30.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839199+0000", 2024-05-07T14:03:30.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010796199999999999 2024-05-07T14:03:30.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.080 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 164.23981789999999, 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028128562999999999, 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 116 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.081 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811529+0000", 2024-05-07T14:03:30.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:03:30.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811546+0000", 2024-05-07T14:03:30.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7113e-05 2024-05-07T14:03:30.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811570+0000", 2024-05-07T14:03:30.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.406e-05 2024-05-07T14:03:30.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811578+0000", 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8660000000000006e-06 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834997+0000", 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023418799000000001 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835317+0000", 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031991799999999998 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:30.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835662+0000", 2024-05-07T14:03:30.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034544399999999998 2024-05-07T14:03:30.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839220+0000", 2024-05-07T14:03:30.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035576959999999999 2024-05-07T14:03:30.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839374+0000", 2024-05-07T14:03:30.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015427600000000001 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839540+0000", 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016534500000000001 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839657+0000", 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117243 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 164.23975488799999, 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02858051, 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 117 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.087 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811592+0000", 2024-05-07T14:03:30.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811601+0000", 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1269999999999992e-06 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811611+0000", 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6900000000000004e-06 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811618+0000", 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0770000000000002e-06 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836766+0000", 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025147966000000001 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836982+0000", 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021640400000000001 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.837283+0000", 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030005800000000002 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839885+0000", 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002602937 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839925+0000", 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9446000000000001e-05 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840061+0000", 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136043 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840172+0000", 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111019 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:03:30.092 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 163.752016301, 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019781539000000001, 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 140 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-07 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299398+0000", 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7822000000000002e-05 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299404+0000", 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2369999999999997e-06 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299409+0000", 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2069999999999997e-06 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311355+0000", 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011946082 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311493+0000", 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013830900000000001 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311709+0000", 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021606899999999999 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314528+0000", 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028193839999999999 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319001+0000", 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004472218 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319063+0000", 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1940000000000007e-05 2024-05-07T14:03:30.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319112+0000", 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8964000000000001e-05 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 163.75192993600001, 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019944718, 2024-05-07T14:03:30.098 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 141 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299417+0000", 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7099999999999997e-07 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299420+0000", 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8629999999999999e-06 2024-05-07T14:03:30.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299424+0000", 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4830000000000001e-06 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299429+0000", 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6609999999999999e-06 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312813+0000", 2024-05-07T14:03:30.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013384330999999999 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312948+0000", 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000135239 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313163+0000", 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000214718 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314534+0000", 2024-05-07T14:03:30.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013704430000000001 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319185+0000", 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046516839999999997 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319281+0000", 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5645999999999999e-05 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319361+0000", 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0278999999999995e-05 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1480 3.7 e80/21 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head v 80'1, mlcod=0'0)", 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.744633084999997, 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026214482000000001, 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.104 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306719+0000", 2024-05-07T14:03:30.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9669999999999998e-06 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315882+0000", 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091624629999999992 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315923+0000", 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0995999999999998e-05 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315945+0000", 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2665999999999999e-05 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.316100+0000", 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015487399999999999 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.316140+0000", 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9582999999999997e-05 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.332710+0000", 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016570412999999999 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.332928+0000", 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021751999999999999 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2204 3.3b 3:df85b00b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:30.108 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.74399528, 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02108792, 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2204 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307354+0000", 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3730000000000001e-06 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.311997+0000", 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046420480000000002 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312024+0000", 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7586e-05 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312036+0000", 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2103000000000001e-05 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312106+0000", 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9808000000000007e-05 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312224+0000", 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117926 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312320+0000", 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5642000000000003e-05 2024-05-07T14:03:30.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322866+0000", 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010546181 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328215+0000", 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053494379999999998 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328351+0000", 2024-05-07T14:03:30.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013558 2024-05-07T14:03:30.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328439+0000", 2024-05-07T14:03:30.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8234999999999998e-05 2024-05-07T14:03:30.114 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.114 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.114 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.114 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2206 3.f 3:f1007ae4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:30.114 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:30.114 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.721242186000001, 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018268163, 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2206 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:30.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330106+0000", 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2730000000000001e-06 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333445+0000", 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033386409999999998 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333474+0000", 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8617999999999999e-05 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333487+0000", 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3716e-05 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333644+0000", 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000156914 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333966+0000", 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032135600000000002 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334209+0000", 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024347600000000001 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.346821+0000", 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012612046999999999 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348105+0000", 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012841020000000001 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348253+0000", 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147412 2024-05-07T14:03:30.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348372+0000", 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119608 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2207 3.26 e84/21 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.705834787000001, 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021638324, 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.120 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345513+0000", 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.313e-06 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349394+0000", 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003881481 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349425+0000", 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0329e-05 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349440+0000", 2024-05-07T14:03:30.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4905999999999999e-05 2024-05-07T14:03:30.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349531+0000", 2024-05-07T14:03:30.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0907000000000002e-05 2024-05-07T14:03:30.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349555+0000", 2024-05-07T14:03:30.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4097999999999999e-05 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367060+0000", 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017505314000000001 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367150+0000", 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2213 3.d 3:b01db4c3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.623631080999999, 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022630872999999999, 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2213 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.125 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427719+0000", 2024-05-07T14:03:30.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.703e-06 2024-05-07T14:03:30.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431417+0000", 2024-05-07T14:03:30.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036980110000000002 2024-05-07T14:03:30.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431441+0000", 2024-05-07T14:03:30.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4380999999999999e-05 2024-05-07T14:03:30.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431451+0000", 2024-05-07T14:03:30.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9890000000000004e-06 2024-05-07T14:03:30.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431567+0000", 2024-05-07T14:03:30.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115136 2024-05-07T14:03:30.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431816+0000", 2024-05-07T14:03:30.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024989700000000001 2024-05-07T14:03:30.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432033+0000", 2024-05-07T14:03:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021664300000000001 2024-05-07T14:03:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.447025+0000", 2024-05-07T14:03:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014991473 2024-05-07T14:03:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450138+0000", 2024-05-07T14:03:30.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003113429 2024-05-07T14:03:30.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450234+0000", 2024-05-07T14:03:30.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6519000000000002e-05 2024-05-07T14:03:30.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450346+0000", 2024-05-07T14:03:30.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111692 2024-05-07T14:03:30.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.130 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2215 3.37 3:eed806fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.593760221, 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019726679, 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.131 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2215 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457589+0000", 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1e-06 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461583+0000", 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039941919999999997 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461615+0000", 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1835999999999998e-05 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461630+0000", 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4766000000000001e-05 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461782+0000", 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015214800000000001 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462139+0000", 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035658499999999997 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462489+0000", 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034982900000000001 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.476308+0000", 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013819761 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477139+0000", 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083034199999999997 2024-05-07T14:03:30.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477226+0000", 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7517999999999998e-05 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477313+0000", 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6601999999999995e-05 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.136 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2220 3.11 3:8b7a5ffd:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.515789306999999, 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022329020000000002, 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2220 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535561+0000", 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.546e-06 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.539966+0000", 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044058270000000002 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540002+0000", 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5435999999999998e-05 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540019+0000", 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7003e-05 2024-05-07T14:03:30.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540153+0000", 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133721 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540396+0000", 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024384400000000001 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540605+0000", 2024-05-07T14:03:30.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020872999999999999 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.556698+0000", 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016093028999999998 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557670+0000", 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000971477 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557779+0000", 2024-05-07T14:03:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010969800000000001 2024-05-07T14:03:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557886+0000", 2024-05-07T14:03:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106709 2024-05-07T14:03:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2221 3.f 3:f1cd2e50:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:30.142 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.505123130000001, 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024790956999999999, 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2221 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546227+0000", 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.27e-06 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550241+0000", 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040139950000000002 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550273+0000", 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2741999999999999e-05 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550298+0000", 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4484000000000001e-05 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550463+0000", 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165274 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550736+0000", 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027265299999999998 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551015+0000", 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027935900000000002 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.569950+0000", 2024-05-07T14:03:30.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018935469999999999 2024-05-07T14:03:30.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.570807+0000", 2024-05-07T14:03:30.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00085676600000000002 2024-05-07T14:03:30.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.570928+0000", 2024-05-07T14:03:30.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120568 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571014+0000", 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6376000000000001e-05 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2250 3.11 3:8ab50290:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 26.163485194, 2024-05-07T14:03:30.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025202414999999999, 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2250 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887864+0000", 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9299999999999999e-06 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892840+0000", 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049758420000000003 2024-05-07T14:03:30.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892883+0000", 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2568999999999998e-05 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892902+0000", 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9667e-05 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893027+0000", 2024-05-07T14:03:30.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012506799999999999 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893232+0000", 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020444199999999999 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893445+0000", 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021324199999999999 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:30.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.911638+0000", 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018193343000000001 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.912977+0000", 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001338802 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.913026+0000", 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8862000000000001e-05 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.913064+0000", 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7648000000000003e-05 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2500 7.15 7:a93a5511:::notify.2:head [watch reconnect cookie 94397682175232 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.656456512999998, 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0539674379999999, 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:30.154 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:30.155 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:30.155 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:30.155 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.155 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2500 2024-05-07T14:03:30.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.155 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:30.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:30.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:30.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394893+0000", 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8830000000000002e-06 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394909+0000", 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5840000000000001e-05 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394951+0000", 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2175999999999997e-05 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394973+0000", 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2679000000000001e-05 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395138+0000", 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000164895 2024-05-07T14:03:30.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:30.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395156+0000", 2024-05-07T14:03:30.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7237000000000001e-05 2024-05-07T14:03:30.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415064+0000", 2024-05-07T14:03:30.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019908478 2024-05-07T14:03:30.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:30.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415089+0000", 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4916e-05 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.425843+0000", 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.010754116 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.427029+0000", 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011857700000000001 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.436255+0000", 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092263629999999996 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.436391+0000", 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136117 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.448857+0000", 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012465967999999999 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.160 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.161 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:30.161 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:30.161 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:30.162 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:30.172+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:30.163 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:30.263 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:30.276+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:30.283 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:30.283 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:30.283 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:30.283 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:30.298 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:30.363 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:30.372+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:30.408 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:30.408 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:30.421 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:30.465 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:30.476+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:30.565 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:30.576+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:30.578 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:03:30.598 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:30.598 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:30.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:30.598 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:30.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.598 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:03:30.598 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:30.599 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 164.299345749, 2024-05-07T14:03:30.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:03:30.599 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.599 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.599 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.599 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:30.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:03:30.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:03:30.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:03:30.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:03:30.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:03:30.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 164.29843935299999, 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.603 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:03:30.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:03:30.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:03:30.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:03:30.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:03:30.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:03:30.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:03:30.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.607 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 164.29702673400001, 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:03:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:03:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:03:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:03:30.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:03:30.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:03:30.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:03:30.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.612 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.612 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:30.612 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:30.612 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 143.47135625199999, 2024-05-07T14:03:30.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:03:30.612 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.612 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.612 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:30.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:03:30.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:03:30.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:03:30.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:03:30.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:03:30.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:03:30.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:03:30.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:03:30.618 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.618 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.618 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.618 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:30.618 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:30.618 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 143.43824559399999, 2024-05-07T14:03:30.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:03:30.618 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.618 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.618 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:03:30.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:03:30.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:30.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:03:30.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:03:30.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:30.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:03:30.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1477 3.18 e80/21 3:1a16f065:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_1:head v 80'1, mlcod=0'0)", 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.323092336000002, 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014861011, 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.624 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287825+0000", 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:03:30.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290411+0000", 2024-05-07T14:03:30.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025854430000000002 2024-05-07T14:03:30.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290433+0000", 2024-05-07T14:03:30.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.264e-05 2024-05-07T14:03:30.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290443+0000", 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7189999999999996e-06 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290521+0000", 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8164000000000006e-05 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290546+0000", 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4533e-05 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302655+0000", 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012108898999999999 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302684+0000", 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9624e-05 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1478 3.12 3:4bdcf7a4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:30.628 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.321652497000002, 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013141795, 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1478 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289265+0000", 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.001e-06 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290501+0000", 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001235487 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290514+0000", 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.358e-05 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290521+0000", 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8889999999999996e-06 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290588+0000", 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.7218000000000006e-05 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290762+0000", 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017409200000000001 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290904+0000", 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000141963 2024-05-07T14:03:30.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.301956+0000", 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011051640999999999 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302315+0000", 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000358876 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302353+0000", 2024-05-07T14:03:30.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8003999999999997e-05 2024-05-07T14:03:30.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302405+0000", 2024-05-07T14:03:30.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2043999999999998e-05 2024-05-07T14:03:30.634 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.634 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.634 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.634 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1481 4.b 4:d1744c9b:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.0:head [stat,call rgw.guard_bucket_resharding in=26b,call rgw.bucket_complete_op in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:30.634 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:30.634 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.277226564999999, 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099753589999999996, 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1481 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333691+0000", 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8920000000000001e-06 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333699+0000", 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1089999999999998e-06 2024-05-07T14:03:30.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333715+0000", 2024-05-07T14:03:30.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6260999999999999e-05 2024-05-07T14:03:30.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333723+0000", 2024-05-07T14:03:30.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1579999999999999e-06 2024-05-07T14:03:30.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333800+0000", 2024-05-07T14:03:30.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7000000000000001e-05 2024-05-07T14:03:30.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:30.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333807+0000", 2024-05-07T14:03:30.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.498e-06 2024-05-07T14:03:30.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339421+0000", 2024-05-07T14:03:30.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056137909999999999 2024-05-07T14:03:30.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339536+0000", 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115297 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339894+0000", 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035790799999999999 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343340+0000", 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034459120000000002 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343547+0000", 2024-05-07T14:03:30.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020692799999999999 2024-05-07T14:03:30.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343613+0000", 2024-05-07T14:03:30.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6166000000000003e-05 2024-05-07T14:03:30.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343664+0000", 2024-05-07T14:03:30.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1439e-05 2024-05-07T14:03:30.641 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.641 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.641 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.641 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1611 3.30 e81/21 3:0c405120:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_1:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:30.641 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:30.641 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.184771806000001, 2024-05-07T14:03:30.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013061969999999999, 2024-05-07T14:03:30.641 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.641 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.641 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.641 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:30.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:30.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426145+0000", 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5990000000000001e-06 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.433982+0000", 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078361190000000008 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434000+0000", 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.806e-05 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434011+0000", 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1615e-05 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434085+0000", 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3819000000000006e-05 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434100+0000", 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4973999999999999e-05 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.439168+0000", 2024-05-07T14:03:30.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050674350000000003 2024-05-07T14:03:30.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.439206+0000", 2024-05-07T14:03:30.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8349000000000002e-05 2024-05-07T14:03:30.645 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.645 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.645 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1612 3.3 e81/21 3:c1191b65:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_2:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.183136758000003, 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086703990000000005, 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427780+0000", 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1699999999999997e-07 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431380+0000", 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600378 2024-05-07T14:03:30.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431413+0000", 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3056000000000003e-05 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431430+0000", 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6986999999999998e-05 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431508+0000", 2024-05-07T14:03:30.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8177999999999996e-05 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431526+0000", 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7333000000000002e-05 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.436392+0000", 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0048665100000000001 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.436449+0000", 2024-05-07T14:03:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7040000000000003e-05 2024-05-07T14:03:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1915 4.1e 4:7a3b9b37:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.214681644999999, 2024-05-07T14:03:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051237260000000003, 2024-05-07T14:03:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1915 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396235+0000", 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.33e-06 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396241+0000", 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.699e-06 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396257+0000", 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5432000000000001e-05 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396265+0000", 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6009999999999995e-06 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396336+0000", 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1045999999999997e-05 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396431+0000", 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5126999999999999e-05 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396547+0000", 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115339 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397910+0000", 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013629720000000001 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401294+0000", 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384504 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401329+0000", 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5179000000000003e-05 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401358+0000", 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8496999999999998e-05 2024-05-07T14:03:30.655 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.656 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.656 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.656 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2208 3.3a e84/21 3:5ee07aff:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_7:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:30.656 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:30.656 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.257701221000001, 2024-05-07T14:03:30.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017943191000000001, 2024-05-07T14:03:30.656 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.656 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.656 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.656 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353217+0000", 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3920000000000001e-06 2024-05-07T14:03:30.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363741+0000", 2024-05-07T14:03:30.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010524586000000001 2024-05-07T14:03:30.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363773+0000", 2024-05-07T14:03:30.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362000000000002e-05 2024-05-07T14:03:30.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363793+0000", 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9743999999999999e-05 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363870+0000", 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7610999999999999e-05 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363888+0000", 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.785e-05 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.371098+0000", 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072103100000000002 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.371158+0000", 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9336000000000002e-05 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2219 3.32 3:4d615ce3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:30.660 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.085898890999999, 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016879689999999999, 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2219 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:30.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525020+0000", 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.751e-06 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528212+0000", 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031922080000000002 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528240+0000", 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7911000000000001e-05 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528254+0000", 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4457999999999999e-05 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528333+0000", 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9136999999999998e-05 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528460+0000", 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012715799999999999 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528572+0000", 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011162099999999999 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541359+0000", 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012787023 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541810+0000", 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045134299999999999 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541859+0000", 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8934999999999998e-05 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541896+0000", 2024-05-07T14:03:30.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7144999999999998e-05 2024-05-07T14:03:30.666 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.666 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.666 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.666 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2225 3.1f 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:30.666 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:30.666 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.012169133, 2024-05-07T14:03:30.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020378113, 2024-05-07T14:03:30.666 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2225 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598750+0000", 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8859999999999997e-06 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602351+0000", 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600195 2024-05-07T14:03:30.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602470+0000", 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119608 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602494+0000", 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.376e-05 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602590+0000", 2024-05-07T14:03:30.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6399999999999999e-05 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602740+0000", 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014951 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602884+0000", 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000143616 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:30.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618629+0000", 2024-05-07T14:03:30.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015745420999999999 2024-05-07T14:03:30.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619008+0000", 2024-05-07T14:03:30.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037870699999999999 2024-05-07T14:03:30.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619069+0000", 2024-05-07T14:03:30.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1617000000000003e-05 2024-05-07T14:03:30.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619125+0000", 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5393000000000003e-05 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2227 3.1b 3:d8b15ce8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.970382891, 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017300908, 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.672 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2227 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:30.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640536+0000", 2024-05-07T14:03:30.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9809999999999999e-06 2024-05-07T14:03:30.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643182+0000", 2024-05-07T14:03:30.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026464769999999999 2024-05-07T14:03:30.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643207+0000", 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5077999999999999e-05 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643220+0000", 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2866e-05 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643329+0000", 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108467 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643499+0000", 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017020199999999999 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643652+0000", 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152993 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.648361+0000", 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0047089530000000001 2024-05-07T14:03:30.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657709+0000", 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093483360000000005 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657779+0000", 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9375999999999994e-05 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657834+0000", 2024-05-07T14:03:30.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5179000000000001e-05 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2228 3.b e84/21 3:d3d17a37:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_27:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.958424333, 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093032859999999992, 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652493+0000", 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7269999999999999e-06 2024-05-07T14:03:30.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653476+0000", 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098271300000000008 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653501+0000", 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5012e-05 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653511+0000", 2024-05-07T14:03:30.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0009e-05 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653607+0000", 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5975000000000002e-05 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653635+0000", 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8010000000000001e-05 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661728+0000", 2024-05-07T14:03:30.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080929339999999995 2024-05-07T14:03:30.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661795+0000", 2024-05-07T14:03:30.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6905999999999999e-05 2024-05-07T14:03:30.682 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.682 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.682 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.682 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2229 3.3 e84/21 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.945958091000001, 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022534413, 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664960+0000", 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0109999999999999e-06 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670334+0000", 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005374635 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3374999999999998e-05 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670385+0000", 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7512000000000001e-05 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670515+0000", 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012940900000000001 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670543+0000", 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8157000000000002e-05 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687374+0000", 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016831793000000001 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687492+0000", 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117521 2024-05-07T14:03:30.686 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2230 3.b e84/21 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.935952919999998, 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016432748, 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674964+0000", 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5409999999999999e-06 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677117+0000", 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002153154 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677136+0000", 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8691000000000001e-05 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677148+0000", 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2291e-05 2024-05-07T14:03:30.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677217+0000", 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8880000000000005e-05 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677249+0000", 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1664e-05 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691337+0000", 2024-05-07T14:03:30.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014087926000000001 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691396+0000", 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8600999999999997e-05 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2497 7.9 7:93e5b521:::notify.7:head [watch reconnect cookie 94397682177536 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.215974670000001, 2024-05-07T14:03:30.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0512951690000001, 2024-05-07T14:03:30.692 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.693 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.693 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:30.693 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:30.693 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:30.693 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:30.693 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2497 2024-05-07T14:03:30.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.693 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394942+0000", 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9100000000000002e-07 2024-05-07T14:03:30.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394946+0000", 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2239999999999997e-06 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394960+0000", 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3419e-05 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394966+0000", 2024-05-07T14:03:30.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3620000000000002e-06 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395019+0000", 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3099000000000001e-05 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395023+0000", 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0879999999999997e-06 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400981+0000", 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059580520000000001 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400990+0000", 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0880000000000001e-06 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438550+0000", 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.037559288 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.439512+0000", 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000962154 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442920+0000", 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034085109999999999 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442966+0000", 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5509000000000001e-05 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.446236+0000", 2024-05-07T14:03:30.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032704840000000002 2024-05-07T14:03:30.699 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.699 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.699 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.699 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "MOSDPGPushReply(3.3e 87/86 [PushReplyOp(3:7fbbdcd7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_108:head)])", 2024-05-07T14:03:30.699 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:30.699 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.150421899000001, 2024-05-07T14:03:30.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055859079999999997, 2024-05-07T14:03:30.699 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460495+0000", 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4499999999999996e-07 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460501+0000", 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.212e-06 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460514+0000", 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3183000000000001e-05 2024-05-07T14:03:30.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:30.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460523+0000", 2024-05-07T14:03:30.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4450000000000002e-06 2024-05-07T14:03:30.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:30.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460615+0000", 2024-05-07T14:03:30.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1693000000000005e-05 2024-05-07T14:03:30.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:30.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:30.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:30.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.466080+0000", 2024-05-07T14:03:30.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054645300000000004 2024-05-07T14:03:30.703 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.703 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.703 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.703 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:30.703 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:30.703 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:30.704 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:30.705 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:30.716+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:30.805 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:30.816+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:30.861 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:30.861 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:30.861 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:30.861 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:30.874 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:30.906 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:30.916+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:31.007 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:31.016+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:31.031 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:31.032 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:31.045 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:31.108 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:31.120+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:31.165 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:31.165 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:31.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:31.165 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:31.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.166 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:03:31.166 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:31.166 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 151.19348999799999, 2024-05-07T14:03:31.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:03:31.167 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.167 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.167 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:31.167 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:31.167 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:03:31.167 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:03:31.167 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:03:31.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.167 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:31.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:31.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:03:31.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:03:31.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:03:31.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:03:31.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:31.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:03:31.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:03:31.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:03:31.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:03:31.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:03:31.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:03:31.171 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.171 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.171 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.172 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:31.172 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:03:31.172 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 144.01038670599999, 2024-05-07T14:03:31.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:03:31.172 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.172 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.172 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.172 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:31.172 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:31.172 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:31.172 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:03:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:03:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:03:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:03:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:03:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:03:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:03:31.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:03:31.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:03:31.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:03:31.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:03:31.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:03:31.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:03:31.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:03:31.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:03:31.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:03:31.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:03:31.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:03:31.178 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.178 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.179 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.179 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:31.179 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:03:31.179 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 143.87476673699999, 2024-05-07T14:03:31.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:03:31.179 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.179 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.179 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.179 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:31.179 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:31.179 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:03:31.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:03:31.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:03:31.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:03:31.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:03:31.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:03:31.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1571 4.24 4:26e499bb:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.505593595999997, 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063870100000000003, 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1571 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.185 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:31.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:31.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2800000000000002e-07 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672852+0000", 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6599999999999999e-06 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672866+0000", 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3648999999999999e-05 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672871+0000", 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672926+0000", 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4299999999999998e-05 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673007+0000", 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1429999999999998e-05 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:31.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673097+0000", 2024-05-07T14:03:31.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0272000000000006e-05 2024-05-07T14:03:31.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:31.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673822+0000", 2024-05-07T14:03:31.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072425300000000001 2024-05-07T14:03:31.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:31.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679164+0000", 2024-05-07T14:03:31.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005341943 2024-05-07T14:03:31.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679209+0000", 2024-05-07T14:03:31.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5738000000000002e-05 2024-05-07T14:03:31.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679236+0000", 2024-05-07T14:03:31.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6633000000000001e-05 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1578 4.27 4:e7c87c96:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.281131455999997, 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046530510000000001, 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:31.191 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:31.192 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:31.192 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1578 2024-05-07T14:03:31.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.192 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:03:31.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:03:31.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897314+0000", 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7250000000000002e-06 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897328+0000", 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4e-05 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897352+0000", 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4576999999999999e-05 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897366+0000", 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3173000000000001e-05 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897473+0000", 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010762100000000001 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897601+0000", 2024-05-07T14:03:31.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012757099999999999 2024-05-07T14:03:31.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:31.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897754+0000", 2024-05-07T14:03:31.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152807 2024-05-07T14:03:31.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:31.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900001+0000", 2024-05-07T14:03:31.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002247686 2024-05-07T14:03:31.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901868+0000", 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018669940000000001 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901924+0000", 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5383999999999997e-05 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901964+0000", 2024-05-07T14:03:31.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0513000000000003e-05 2024-05-07T14:03:31.197 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.197 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.197 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.197 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1582 4.27 4:e6cd56b0:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:31.197 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:03:31.197 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.280985104000003, 2024-05-07T14:03:31.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046596959999999996, 2024-05-07T14:03:31.197 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.197 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.197 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.197 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:31.198 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:31.198 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:31.198 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1582 2024-05-07T14:03:31.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.198 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:03:31.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897458+0000", 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5700000000000002e-07 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897462+0000", 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0690000000000003e-06 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897469+0000", 2024-05-07T14:03:31.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0079999999999996e-06 2024-05-07T14:03:31.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897474+0000", 2024-05-07T14:03:31.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9420000000000003e-06 2024-05-07T14:03:31.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898643+0000", 2024-05-07T14:03:31.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011688709999999999 2024-05-07T14:03:31.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898756+0000", 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113522 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898961+0000", 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020425799999999999 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900212+0000", 2024-05-07T14:03:31.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012512860000000001 2024-05-07T14:03:31.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:31.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902014+0000", 2024-05-07T14:03:31.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018024029999999999 2024-05-07T14:03:31.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902075+0000", 2024-05-07T14:03:31.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0509e-05 2024-05-07T14:03:31.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902117+0000", 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2271000000000002e-05 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:49 7.15 e81/29 7:a93a5511:::notify.2:head v 81'49, mlcod=81'47)", 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.027462993999997, 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0070782700000000002, 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.203 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150981+0000", 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2899999999999999e-06 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150990+0000", 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3959999999999995e-06 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151011+0000", 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.105e-05 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151023+0000", 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151122+0000", 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9351999999999993e-05 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151155+0000", 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2459000000000002e-05 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158027+0000", 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.006871785 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158058+0000", 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1315000000000001e-05 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.207 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:52 7.d e81/29 7:b4812045:::notify.4:head v 81'48, mlcod=81'46)", 2024-05-07T14:03:31.208 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:03:31.208 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.025016581999999, 2024-05-07T14:03:31.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0048232429999999996, 2024-05-07T14:03:31.208 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.208 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.208 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.208 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:03:31.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153427+0000", 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6499999999999999e-07 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153432+0000", 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9579999999999998e-06 2024-05-07T14:03:31.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153441+0000", 2024-05-07T14:03:31.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.662e-06 2024-05-07T14:03:31.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153446+0000", 2024-05-07T14:03:31.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7530000000000001e-06 2024-05-07T14:03:31.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153492+0000", 2024-05-07T14:03:31.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5853999999999998e-05 2024-05-07T14:03:31.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153505+0000", 2024-05-07T14:03:31.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3288000000000001e-05 2024-05-07T14:03:31.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158230+0000", 2024-05-07T14:03:31.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0047249170000000004 2024-05-07T14:03:31.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158249+0000", 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9145999999999999e-05 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2202 3.0 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.898472619, 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027191908000000001, 2024-05-07T14:03:31.212 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.213 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.213 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.213 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:31.213 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:31.213 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:31.213 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2202 2024-05-07T14:03:31.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.213 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:31.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:31.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279975+0000", 2024-05-07T14:03:31.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0130000000000001e-06 2024-05-07T14:03:31.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285489+0000", 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055143570000000001 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285531+0000", 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1504000000000001e-05 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285550+0000", 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9256e-05 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285747+0000", 2024-05-07T14:03:31.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196777 2024-05-07T14:03:31.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286120+0000", 2024-05-07T14:03:31.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037285900000000002 2024-05-07T14:03:31.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:31.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286489+0000", 2024-05-07T14:03:31.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036951099999999999 2024-05-07T14:03:31.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:31.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301589+0000", 2024-05-07T14:03:31.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015099728999999999 2024-05-07T14:03:31.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:31.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307085+0000", 2024-05-07T14:03:31.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054963340000000003 2024-05-07T14:03:31.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.218 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307127+0000", 2024-05-07T14:03:31.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1977999999999997e-05 2024-05-07T14:03:31.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.218 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.218 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307162+0000", 2024-05-07T14:03:31.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4589999999999999e-05 2024-05-07T14:03:31.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.218 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.218 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2212 3.1a e84/21 3:591da10a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_11:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.763304279, 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012581199, 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415141+0000", 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.52e-06 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421260+0000", 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061196169999999999 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421304+0000", 2024-05-07T14:03:31.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3293e-05 2024-05-07T14:03:31.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421324+0000", 2024-05-07T14:03:31.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0341000000000001e-05 2024-05-07T14:03:31.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421401+0000", 2024-05-07T14:03:31.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6773999999999994e-05 2024-05-07T14:03:31.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.222 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421418+0000", 2024-05-07T14:03:31.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6827e-05 2024-05-07T14:03:31.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.222 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.427656+0000", 2024-05-07T14:03:31.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0062381010000000002 2024-05-07T14:03:31.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.222 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.427720+0000", 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3726000000000006e-05 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2216 3.21 e84/46 3:86b25102:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_15:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.705945366999998, 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012554667, 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.223 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.224 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.224 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:31.224 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.224 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.224 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:31.224 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.224 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.224 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472500+0000", 2024-05-07T14:03:31.225 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6630000000000002e-06 2024-05-07T14:03:31.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.225 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.225 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475359+0000", 2024-05-07T14:03:31.225 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028594409999999999 2024-05-07T14:03:31.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.225 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.226 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475407+0000", 2024-05-07T14:03:31.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7868999999999999e-05 2024-05-07T14:03:31.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.226 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.226 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475431+0000", 2024-05-07T14:03:31.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3873999999999999e-05 2024-05-07T14:03:31.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.226 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.226 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475528+0000", 2024-05-07T14:03:31.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7163999999999993e-05 2024-05-07T14:03:31.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475556+0000", 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7594999999999999e-05 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485009+0000", 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0094531149999999998 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485052+0000", 2024-05-07T14:03:31.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2945999999999998e-05 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2217 3.0 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.688146051, 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019983529, 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:31.228 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2217 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.230 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.230 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.230 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490299+0000", 2024-05-07T14:03:31.230 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:03:31.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.230 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.230 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.230 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492337+0000", 2024-05-07T14:03:31.230 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020384489999999999 2024-05-07T14:03:31.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.230 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.230 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.230 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492391+0000", 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3702000000000002e-05 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492415+0000", 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3373000000000001e-05 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492567+0000", 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152788 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.231 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492843+0000", 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027568999999999998 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493123+0000", 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028014899999999999 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509840+0000", 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016716871000000001 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510203+0000", 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036252499999999999 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510250+0000", 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7231000000000002e-05 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510280+0000", 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0270999999999999e-05 2024-05-07T14:03:31.233 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2219 3.32 e84/21 3:4d615ce3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_18:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.649726018999999, 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012848995, 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.234 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528718+0000", 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.86e-06 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531113+0000", 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002394958 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531141+0000", 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7543e-05 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531154+0000", 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3355e-05 2024-05-07T14:03:31.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531232+0000", 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7608000000000006e-05 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531259+0000", 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6656e-05 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541473+0000", 2024-05-07T14:03:31.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010214101999999999 2024-05-07T14:03:31.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.238 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.238 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541566+0000", 2024-05-07T14:03:31.238 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2912999999999996e-05 2024-05-07T14:03:31.238 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.238 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.238 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.238 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2224 3.1a e84/21 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:31.238 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:31.238 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.583202384, 2024-05-07T14:03:31.239 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020623257999999998, 2024-05-07T14:03:31.239 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.239 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.239 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.239 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.239 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.239 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:31.239 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.239 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.239 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:31.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.240 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.240 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595243+0000", 2024-05-07T14:03:31.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6800000000000002e-06 2024-05-07T14:03:31.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.240 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.240 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.601988+0000", 2024-05-07T14:03:31.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0067452479999999997 2024-05-07T14:03:31.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.241 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602044+0000", 2024-05-07T14:03:31.241 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5884999999999998e-05 2024-05-07T14:03:31.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.241 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602070+0000", 2024-05-07T14:03:31.241 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6359999999999998e-05 2024-05-07T14:03:31.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.241 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602183+0000", 2024-05-07T14:03:31.241 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112761 2024-05-07T14:03:31.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.242 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.242 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602210+0000", 2024-05-07T14:03:31.242 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6882000000000001e-05 2024-05-07T14:03:31.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.242 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.242 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615811+0000", 2024-05-07T14:03:31.242 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01360132 2024-05-07T14:03:31.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.242 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.243 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615863+0000", 2024-05-07T14:03:31.243 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2122e-05 2024-05-07T14:03:31.243 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.243 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.243 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.243 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2225 3.1f e84/46 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:31.243 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:31.243 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.573774527000001, 2024-05-07T14:03:31.243 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014189089, 2024-05-07T14:03:31.243 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.243 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604671+0000", 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6070000000000002e-06 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607720+0000", 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030496849999999999 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607763+0000", 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3044999999999999e-05 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.246 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.246 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607787+0000", 2024-05-07T14:03:31.246 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3264e-05 2024-05-07T14:03:31.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.246 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.246 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607878+0000", 2024-05-07T14:03:31.246 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1650000000000005e-05 2024-05-07T14:03:31.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.246 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.246 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607905+0000", 2024-05-07T14:03:31.246 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7090999999999999e-05 2024-05-07T14:03:31.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.247 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.247 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.247 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618733+0000", 2024-05-07T14:03:31.247 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010827582000000001 2024-05-07T14:03:31.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.247 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.247 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.247 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618857+0000", 2024-05-07T14:03:31.247 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000124165 2024-05-07T14:03:31.247 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.247 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.247 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2226 3.4 3:20f3de0c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.556466112999999, 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014369191, 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2226 2024-05-07T14:03:31.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.249 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.249 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.249 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:31.249 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.249 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.249 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:31.249 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.250 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.250 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621979+0000", 2024-05-07T14:03:31.250 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.272e-06 2024-05-07T14:03:31.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.250 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.250 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624873+0000", 2024-05-07T14:03:31.250 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028946390000000001 2024-05-07T14:03:31.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.250 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.250 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624904+0000", 2024-05-07T14:03:31.250 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0446e-05 2024-05-07T14:03:31.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.251 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.251 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624918+0000", 2024-05-07T14:03:31.251 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4263e-05 2024-05-07T14:03:31.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.251 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.251 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625007+0000", 2024-05-07T14:03:31.251 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8850000000000005e-05 2024-05-07T14:03:31.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.251 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.252 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625174+0000", 2024-05-07T14:03:31.252 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167314 2024-05-07T14:03:31.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.252 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:31.252 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625327+0000", 2024-05-07T14:03:31.252 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152433 2024-05-07T14:03:31.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.252 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:31.252 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.633342+0000", 2024-05-07T14:03:31.252 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080152699999999997 2024-05-07T14:03:31.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.253 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:31.253 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636260+0000", 2024-05-07T14:03:31.253 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029179060000000001 2024-05-07T14:03:31.253 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.253 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.253 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636297+0000", 2024-05-07T14:03:31.253 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7543000000000003e-05 2024-05-07T14:03:31.253 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.253 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.253 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636346+0000", 2024-05-07T14:03:31.254 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8254999999999998e-05 2024-05-07T14:03:31.254 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.254 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.254 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.254 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2233 3.8 e84/21 3:11b98425:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_32:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:31.254 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.705600+0000", 2024-05-07T14:03:31.254 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.472842758999999, 2024-05-07T14:03:31.254 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011076903000000001, 2024-05-07T14:03:31.254 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705600+0000", 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705600+0000", 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705601+0000", 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.375e-06 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707534+0000", 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019330199999999999 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707561+0000", 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6979999999999999e-05 2024-05-07T14:03:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707574+0000", 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.328e-05 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707703+0000", 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012801500000000001 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707729+0000", 2024-05-07T14:03:31.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6585999999999999e-05 2024-05-07T14:03:31.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.258 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.258 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716608+0000", 2024-05-07T14:03:31.258 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088793480000000004 2024-05-07T14:03:31.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.258 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.258 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716677+0000", 2024-05-07T14:03:31.258 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8299000000000005e-05 2024-05-07T14:03:31.258 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.258 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2236 3.32 e84/21 3:4d7a89ea:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_35:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.737366+0000", 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.441076481, 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01010346, 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.259 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.737366+0000", 2024-05-07T14:03:31.260 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.260 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.260 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.737366+0000", 2024-05-07T14:03:31.260 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.260 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.260 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.737368+0000", 2024-05-07T14:03:31.260 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.623e-06 2024-05-07T14:03:31.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739037+0000", 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016693109999999999 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739061+0000", 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4280000000000001e-05 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739077+0000", 2024-05-07T14:03:31.261 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5568000000000001e-05 2024-05-07T14:03:31.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.262 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739194+0000", 2024-05-07T14:03:31.262 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011736899999999999 2024-05-07T14:03:31.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.262 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739227+0000", 2024-05-07T14:03:31.262 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2268999999999999e-05 2024-05-07T14:03:31.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.747401+0000", 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008174354 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.747470+0000", 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8685999999999999e-05 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2545 8.1 8:84e82796:root::.bucket.meta.buck_2024_04_7_14_02_56%3ac956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9:head [call version.check_conds in=18b,call version.inc in=10b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:31.263 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.464507+0000", 2024-05-07T14:03:31.264 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.713935176, 2024-05-07T14:03:31.264 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049738009999999999, 2024-05-07T14:03:31.264 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.264 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.264 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.264 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:31.264 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:31.264 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:31.264 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2545 2024-05-07T14:03:31.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.264 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.264 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.265 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464507+0000", 2024-05-07T14:03:31.265 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.265 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.265 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464507+0000", 2024-05-07T14:03:31.265 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.265 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.265 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464509+0000", 2024-05-07T14:03:31.265 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0339999999999999e-06 2024-05-07T14:03:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464522+0000", 2024-05-07T14:03:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2088e-05 2024-05-07T14:03:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464555+0000", 2024-05-07T14:03:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3317e-05 2024-05-07T14:03:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.266 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464574+0000", 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8885999999999998e-05 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464643+0000", 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9548000000000006e-05 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464737+0000", 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3839999999999996e-05 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464953+0000", 2024-05-07T14:03:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021561200000000001 2024-05-07T14:03:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.468765+0000", 2024-05-07T14:03:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038126850000000001 2024-05-07T14:03:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.469424+0000", 2024-05-07T14:03:31.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065884699999999995 2024-05-07T14:03:31.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.469457+0000", 2024-05-07T14:03:31.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3213999999999997e-05 2024-05-07T14:03:31.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.469481+0000", 2024-05-07T14:03:31.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3730000000000001e-05 2024-05-07T14:03:31.269 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.269 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.269 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.270 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2558 4.f 4:f3381da8:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:31.270 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.470708+0000", 2024-05-07T14:03:31.270 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.707734995999999, 2024-05-07T14:03:31.270 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050104470000000003, 2024-05-07T14:03:31.270 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:31.270 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:31.270 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:31.270 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:31.270 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:31.270 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2558 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470708+0000", 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470708+0000", 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.272 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:31.272 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470709+0000", 2024-05-07T14:03:31.272 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8479999999999999e-06 2024-05-07T14:03:31.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.272 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:31.272 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470717+0000", 2024-05-07T14:03:31.272 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.824e-06 2024-05-07T14:03:31.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.272 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:31.272 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470746+0000", 2024-05-07T14:03:31.272 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8799999999999999e-05 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470761+0000", 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5366000000000002e-05 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470828+0000", 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6654000000000003e-05 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:31.273 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470917+0000", 2024-05-07T14:03:31.274 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9178999999999994e-05 2024-05-07T14:03:31.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.274 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:31.274 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.471014+0000", 2024-05-07T14:03:31.274 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6237999999999996e-05 2024-05-07T14:03:31.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.274 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:31.274 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.474388+0000", 2024-05-07T14:03:31.274 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033746990000000001 2024-05-07T14:03:31.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475630+0000", 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012418139999999999 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475680+0000", 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0118999999999999e-05 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475718+0000", 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7905999999999999e-05 2024-05-07T14:03:31.275 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.276 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.276 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.276 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:31.276 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:31.276 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:31.277 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:31.278 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:31.288+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:31.379 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:31.388+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:31.441 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:31.441 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:31.441 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:31.441 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:31.453 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:31.479 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:31.488+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:31.566 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:03:31.569 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:03:31.580 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:31.592+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:31.621 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:31.621 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:31.621 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:31.621 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:31.621 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:31.635 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:31.713 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:31.714 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:31.714 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:31.724+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:31.736 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:31.736 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:31.753 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:31.754 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:31.781 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:31.792+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:31.786 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:31.786 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:31.811 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:31.811 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:31.821 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:31.821 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:31.826 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:31.841 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:31.842 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:31.861 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:31.862 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:31.882 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:31.882 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:31.882 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:31.892+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:31.953 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:31.954 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:31.967 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:31.983 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:31.992+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:32.079 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:32.079 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:32.084 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:32.092+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:32.093 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:32.185 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:32.195+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:32.208 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:32.208 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:32.222 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:32.286 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:32.295+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:32.351 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:32.352 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:32.366 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:32.412 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:32.424+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:32.487 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:32.496+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:32.488 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:32.488 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:32.502 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:32.588 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:32.599+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:32.669 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:32.669 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:32.684 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:32.732 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:32.744+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:32.791 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:32.800+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:32.803 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:32.803 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:32.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:32.904 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:32.916+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:32.979 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:32.979 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:32.993 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:03:32.994 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:33.004+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:33.094 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:33.103+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:33.161 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:33.161 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:33.176 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:03:33.196 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:33.203+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:33.296 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:33.308+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:33.298 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:33.298 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:33.313 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:03:33.400 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:33.412+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:33.479 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:33.479 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:33.493 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:03:33.499 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:33.507+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:33.590 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:03:34.157 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:03:34.157 INFO:tasks.workunit.client.0.smithi106.stdout:quota enabled for the bucket: buck_2024_04_7_14_03_29 2024-05-07T14:03:34.157 INFO:tasks.workunit.client.0.smithi106.stdout:adding file to bucket: 2Gb. 2024-05-07T14:03:34.158 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:03:34.158 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - set max size for a given user and ensure that objects upload beyond max size is not entertained 2024-05-07T14:03:34.158 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:03:34.158 INFO:tasks.workunit.client.0.smithi106.stdout:delete objects successful 2024-05-07T14:03:34.158 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:34.159 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:34.159 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:03:34.161 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:34.171+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:34.259 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:34.268+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:34.296 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:34.297 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:34.300 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:34.301 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:34.311 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:03:34.319 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:34.319 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:34.336 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:34.352 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:34.352 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:34.359 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:34.367+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:34.372 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:34.372 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:34.390 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:34.391 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:34.409 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:34.409 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:34.426 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:34.427 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:34.490 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:34.499+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:34.490 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:34.491 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:34.491 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:34.491 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:34.491 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:34.505 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:34.561 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:34.572+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:34.575 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:03:34.632 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 169.81477942699999, 2024-05-07T14:03:34.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63420480000000001, 2024-05-07T14:03:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 1 2024-05-07T14:03:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:34.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827475+0000", 2024-05-07T14:03:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827477+0000", 2024-05-07T14:03:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3099999999999999e-06 2024-05-07T14:03:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827491+0000", 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3923999999999999e-05 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827514+0000", 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2796e-05 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827531+0000", 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7520000000000002e-05 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827677+0000", 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145408 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:44.827703+0000", 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6704e-05 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.458662+0000", 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.63095893199999997 2024-05-07T14:03:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459006+0000", 2024-05-07T14:03:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034329 2024-05-07T14:03:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.459320+0000", 2024-05-07T14:03:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031472100000000001 2024-05-07T14:03:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.460665+0000", 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001344633 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461508+0000", 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00084310400000000001 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461608+0000", 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9481999999999994e-05 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.461680+0000", 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1976000000000003e-05 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 168.83122903200001, 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017650448999999999, 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 111 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811025+0000", 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811026+0000", 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5300000000000004e-07 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811031+0000", 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0329999999999999e-06 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811043+0000", 2024-05-07T14:03:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2543e-05 2024-05-07T14:03:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811050+0000", 2024-05-07T14:03:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8000000000000001e-06 2024-05-07T14:03:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823676+0000", 2024-05-07T14:03:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012626052 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.823904+0000", 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227562 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.824349+0000", 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00044484 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826371+0000", 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020221380000000001 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828408+0000", 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0020372369999999999 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828540+0000", 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013213600000000001 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828676+0000", 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013545500000000001 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 168.83116761700001, 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021330954999999999, 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 112 2024-05-07T14:03:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811087+0000", 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3399999999999998e-07 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811224+0000", 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013653499999999999 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811237+0000", 2024-05-07T14:03:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.271e-05 2024-05-07T14:03:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811245+0000", 2024-05-07T14:03:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6400000000000003e-06 2024-05-07T14:03:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826483+0000", 2024-05-07T14:03:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015237456 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.826705+0000", 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022216799999999999 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.827081+0000", 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037659800000000002 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.831960+0000", 2024-05-07T14:03:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048788779999999997 2024-05-07T14:03:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832167+0000", 2024-05-07T14:03:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020690500000000001 2024-05-07T14:03:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832305+0000", 2024-05-07T14:03:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013801899999999999 2024-05-07T14:03:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832418+0000", 2024-05-07T14:03:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000112212 2024-05-07T14:03:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 168.830994108, 2024-05-07T14:03:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021403628000000001, 2024-05-07T14:03:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 113 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811260+0000", 2024-05-07T14:03:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811261+0000", 2024-05-07T14:03:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0400000000000005e-07 2024-05-07T14:03:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811267+0000", 2024-05-07T14:03:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6099999999999997e-06 2024-05-07T14:03:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811276+0000", 2024-05-07T14:03:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4029999999999996e-06 2024-05-07T14:03:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811283+0000", 2024-05-07T14:03:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.08e-06 2024-05-07T14:03:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.828825+0000", 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017541853999999999 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829061+0000", 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000235861 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.829418+0000", 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035766800000000001 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832130+0000", 2024-05-07T14:03:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027118120000000001 2024-05-07T14:03:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832442+0000", 2024-05-07T14:03:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000311611 2024-05-07T14:03:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832565+0000", 2024-05-07T14:03:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012284199999999999 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832664+0000", 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8982999999999997e-05 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 168.83096011800001, 2024-05-07T14:03:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023518260999999999, 2024-05-07T14:03:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 114 2024-05-07T14:03:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811294+0000", 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811295+0000", 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1699999999999998e-07 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811301+0000", 2024-05-07T14:03:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8599999999999998e-06 2024-05-07T14:03:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811310+0000", 2024-05-07T14:03:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0299999999999999e-06 2024-05-07T14:03:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811320+0000", 2024-05-07T14:03:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0023e-05 2024-05-07T14:03:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830314+0000", 2024-05-07T14:03:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018994385999999999 2024-05-07T14:03:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830552+0000", 2024-05-07T14:03:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023815500000000001 2024-05-07T14:03:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.830971+0000", 2024-05-07T14:03:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041934300000000003 2024-05-07T14:03:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834620+0000", 2024-05-07T14:03:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036481389999999999 2024-05-07T14:03:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834666+0000", 2024-05-07T14:03:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6266000000000001e-05 2024-05-07T14:03:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834742+0000", 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6069000000000006e-05 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834812+0000", 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0372999999999999e-05 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 168.83091955899999, 2024-05-07T14:03:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027863941999999999, 2024-05-07T14:03:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 115 2024-05-07T14:03:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811335+0000", 2024-05-07T14:03:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2699999999999999e-07 2024-05-07T14:03:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811469+0000", 2024-05-07T14:03:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133332 2024-05-07T14:03:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811502+0000", 2024-05-07T14:03:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3027000000000001e-05 2024-05-07T14:03:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811511+0000", 2024-05-07T14:03:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.713e-06 2024-05-07T14:03:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832759+0000", 2024-05-07T14:03:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021248185999999999 2024-05-07T14:03:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.832917+0000", 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000157825 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.833269+0000", 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035184099999999998 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838250+0000", 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004980712 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.838941+0000", 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00069081399999999999 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839091+0000", 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149903 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839199+0000", 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010796199999999999 2024-05-07T14:03:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 168.830725696, 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028128562999999999, 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 116 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811528+0000", 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811529+0000", 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0299999999999998e-07 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811546+0000", 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7113e-05 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811570+0000", 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.406e-05 2024-05-07T14:03:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811578+0000", 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8660000000000006e-06 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.834997+0000", 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023418799000000001 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835317+0000", 2024-05-07T14:03:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031991799999999998 2024-05-07T14:03:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.835662+0000", 2024-05-07T14:03:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034544399999999998 2024-05-07T14:03:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839220+0000", 2024-05-07T14:03:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035576959999999999 2024-05-07T14:03:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839374+0000", 2024-05-07T14:03:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015427600000000001 2024-05-07T14:03:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839540+0000", 2024-05-07T14:03:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016534500000000001 2024-05-07T14:03:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839657+0000", 2024-05-07T14:03:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117243 2024-05-07T14:03:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-05-07T14:03:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 168.830662684, 2024-05-07T14:03:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02858051, 2024-05-07T14:03:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 117 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811591+0000", 2024-05-07T14:03:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811592+0000", 2024-05-07T14:03:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4300000000000002e-07 2024-05-07T14:03:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811601+0000", 2024-05-07T14:03:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1269999999999992e-06 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811611+0000", 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6900000000000004e-06 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.811618+0000", 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0770000000000002e-06 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836766+0000", 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025147966000000001 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.836982+0000", 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021640400000000001 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.837283+0000", 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030005800000000002 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839885+0000", 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002602937 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.839925+0000", 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9446000000000001e-05 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840061+0000", 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136043 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:45.840172+0000", 2024-05-07T14:03:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111019 2024-05-07T14:03:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:03:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 168.34292409700001, 2024-05-07T14:03:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019781539000000001, 2024-05-07T14:03:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 140 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299330+0000", 2024-05-07T14:03:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0699999999999998e-07 2024-05-07T14:03:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299398+0000", 2024-05-07T14:03:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7822000000000002e-05 2024-05-07T14:03:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299404+0000", 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2369999999999997e-06 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299409+0000", 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2069999999999997e-06 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311355+0000", 2024-05-07T14:03:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011946082 2024-05-07T14:03:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311493+0000", 2024-05-07T14:03:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013830900000000001 2024-05-07T14:03:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.311709+0000", 2024-05-07T14:03:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021606899999999999 2024-05-07T14:03:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314528+0000", 2024-05-07T14:03:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0028193839999999999 2024-05-07T14:03:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319001+0000", 2024-05-07T14:03:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004472218 2024-05-07T14:03:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319063+0000", 2024-05-07T14:03:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1940000000000007e-05 2024-05-07T14:03:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319112+0000", 2024-05-07T14:03:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8964000000000001e-05 2024-05-07T14:03:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4182.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-05-07T14:03:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 168.34283773199999, 2024-05-07T14:03:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019944718, 2024-05-07T14:03:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4182", 2024-05-07T14:03:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/3846797088", 2024-05-07T14:03:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 141 2024-05-07T14:03:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299416+0000", 2024-05-07T14:03:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299417+0000", 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7099999999999997e-07 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299420+0000", 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8629999999999999e-06 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299424+0000", 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4830000000000001e-06 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.299429+0000", 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6609999999999999e-06 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312813+0000", 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013384330999999999 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.312948+0000", 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000135239 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.313163+0000", 2024-05-07T14:03:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000214718 2024-05-07T14:03:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.314534+0000", 2024-05-07T14:03:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0013704430000000001 2024-05-07T14:03:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319185+0000", 2024-05-07T14:03:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046516839999999997 2024-05-07T14:03:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319281+0000", 2024-05-07T14:03:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5645999999999999e-05 2024-05-07T14:03:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:00:46.319361+0000", 2024-05-07T14:03:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0278999999999995e-05 2024-05-07T14:03:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:1480 3.7 e80/21 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head v 80'1, mlcod=0'0)", 2024-05-07T14:03:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.335540881, 2024-05-07T14:03:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026214482000000001, 2024-05-07T14:03:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306713+0000", 2024-05-07T14:03:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.306719+0000", 2024-05-07T14:03:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9669999999999998e-06 2024-05-07T14:03:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315882+0000", 2024-05-07T14:03:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091624629999999992 2024-05-07T14:03:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315923+0000", 2024-05-07T14:03:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0995999999999998e-05 2024-05-07T14:03:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.315945+0000", 2024-05-07T14:03:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2665999999999999e-05 2024-05-07T14:03:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.316100+0000", 2024-05-07T14:03:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015487399999999999 2024-05-07T14:03:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.316140+0000", 2024-05-07T14:03:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9582999999999997e-05 2024-05-07T14:03:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.332710+0000", 2024-05-07T14:03:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016570412999999999 2024-05-07T14:03:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:02:52.332928+0000", 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021751999999999999 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2204 3.3b 3:df85b00b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.334903076, 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02108792, 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2204 2024-05-07T14:03:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307351+0000", 2024-05-07T14:03:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.307354+0000", 2024-05-07T14:03:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3730000000000001e-06 2024-05-07T14:03:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.311997+0000", 2024-05-07T14:03:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046420480000000002 2024-05-07T14:03:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312024+0000", 2024-05-07T14:03:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7586e-05 2024-05-07T14:03:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312036+0000", 2024-05-07T14:03:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2103000000000001e-05 2024-05-07T14:03:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312106+0000", 2024-05-07T14:03:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9808000000000007e-05 2024-05-07T14:03:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312224+0000", 2024-05-07T14:03:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117926 2024-05-07T14:03:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.312320+0000", 2024-05-07T14:03:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5642000000000003e-05 2024-05-07T14:03:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.322866+0000", 2024-05-07T14:03:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010546181 2024-05-07T14:03:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328215+0000", 2024-05-07T14:03:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053494379999999998 2024-05-07T14:03:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328351+0000", 2024-05-07T14:03:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013558 2024-05-07T14:03:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.328439+0000", 2024-05-07T14:03:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8234999999999998e-05 2024-05-07T14:03:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2206 3.f 3:f1007ae4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.312149982000001, 2024-05-07T14:03:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018268163, 2024-05-07T14:03:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2206 2024-05-07T14:03:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330104+0000", 2024-05-07T14:03:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.330106+0000", 2024-05-07T14:03:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2730000000000001e-06 2024-05-07T14:03:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333445+0000", 2024-05-07T14:03:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033386409999999998 2024-05-07T14:03:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333474+0000", 2024-05-07T14:03:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8617999999999999e-05 2024-05-07T14:03:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333487+0000", 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3716e-05 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333644+0000", 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000156914 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.333966+0000", 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032135600000000002 2024-05-07T14:03:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.334209+0000", 2024-05-07T14:03:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024347600000000001 2024-05-07T14:03:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.346821+0000", 2024-05-07T14:03:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012612046999999999 2024-05-07T14:03:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348105+0000", 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012841020000000001 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348253+0000", 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000147412 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.348372+0000", 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119608 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2207 3.26 e84/21 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.296742583, 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021638324, 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345512+0000", 2024-05-07T14:03:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345513+0000", 2024-05-07T14:03:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.313e-06 2024-05-07T14:03:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349394+0000", 2024-05-07T14:03:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003881481 2024-05-07T14:03:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349425+0000", 2024-05-07T14:03:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0329e-05 2024-05-07T14:03:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349440+0000", 2024-05-07T14:03:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4905999999999999e-05 2024-05-07T14:03:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349531+0000", 2024-05-07T14:03:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0907000000000002e-05 2024-05-07T14:03:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.349555+0000", 2024-05-07T14:03:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4097999999999999e-05 2024-05-07T14:03:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367060+0000", 2024-05-07T14:03:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017505314000000001 2024-05-07T14:03:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367150+0000", 2024-05-07T14:03:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9975999999999994e-05 2024-05-07T14:03:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2213 3.d 3:b01db4c3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.214538876999999, 2024-05-07T14:03:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022630872999999999, 2024-05-07T14:03:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2213 2024-05-07T14:03:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427715+0000", 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.427719+0000", 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.703e-06 2024-05-07T14:03:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431417+0000", 2024-05-07T14:03:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036980110000000002 2024-05-07T14:03:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431441+0000", 2024-05-07T14:03:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4380999999999999e-05 2024-05-07T14:03:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431451+0000", 2024-05-07T14:03:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9890000000000004e-06 2024-05-07T14:03:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431567+0000", 2024-05-07T14:03:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115136 2024-05-07T14:03:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.431816+0000", 2024-05-07T14:03:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024989700000000001 2024-05-07T14:03:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.432033+0000", 2024-05-07T14:03:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021664300000000001 2024-05-07T14:03:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.447025+0000", 2024-05-07T14:03:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014991473 2024-05-07T14:03:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450138+0000", 2024-05-07T14:03:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003113429 2024-05-07T14:03:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450234+0000", 2024-05-07T14:03:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6519000000000002e-05 2024-05-07T14:03:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.450346+0000", 2024-05-07T14:03:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111692 2024-05-07T14:03:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2215 3.37 3:eed806fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.184668017, 2024-05-07T14:03:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019726679, 2024-05-07T14:03:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2215 2024-05-07T14:03:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457586+0000", 2024-05-07T14:03:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.457589+0000", 2024-05-07T14:03:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1e-06 2024-05-07T14:03:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461583+0000", 2024-05-07T14:03:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039941919999999997 2024-05-07T14:03:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461615+0000", 2024-05-07T14:03:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1835999999999998e-05 2024-05-07T14:03:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461630+0000", 2024-05-07T14:03:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4766000000000001e-05 2024-05-07T14:03:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.461782+0000", 2024-05-07T14:03:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015214800000000001 2024-05-07T14:03:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462139+0000", 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035658499999999997 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.462489+0000", 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034982900000000001 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.476308+0000", 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013819761 2024-05-07T14:03:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477139+0000", 2024-05-07T14:03:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00083034199999999997 2024-05-07T14:03:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477226+0000", 2024-05-07T14:03:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7517999999999998e-05 2024-05-07T14:03:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.477313+0000", 2024-05-07T14:03:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6601999999999995e-05 2024-05-07T14:03:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2220 3.11 3:8b7a5ffd:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.106697102999998, 2024-05-07T14:03:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022329020000000002, 2024-05-07T14:03:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2220 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535557+0000", 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.535561+0000", 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.546e-06 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.539966+0000", 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044058270000000002 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540002+0000", 2024-05-07T14:03:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5435999999999998e-05 2024-05-07T14:03:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540019+0000", 2024-05-07T14:03:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7003e-05 2024-05-07T14:03:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540153+0000", 2024-05-07T14:03:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000133721 2024-05-07T14:03:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540396+0000", 2024-05-07T14:03:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024384400000000001 2024-05-07T14:03:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.540605+0000", 2024-05-07T14:03:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020872999999999999 2024-05-07T14:03:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.556698+0000", 2024-05-07T14:03:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016093028999999998 2024-05-07T14:03:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557670+0000", 2024-05-07T14:03:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000971477 2024-05-07T14:03:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557779+0000", 2024-05-07T14:03:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010969800000000001 2024-05-07T14:03:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.557886+0000", 2024-05-07T14:03:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000106709 2024-05-07T14:03:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2221 3.f 3:f1cd2e50:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.096030926000001, 2024-05-07T14:03:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024790956999999999, 2024-05-07T14:03:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2221 2024-05-07T14:03:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546223+0000", 2024-05-07T14:03:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.546227+0000", 2024-05-07T14:03:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.27e-06 2024-05-07T14:03:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550241+0000", 2024-05-07T14:03:34.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040139950000000002 2024-05-07T14:03:34.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550273+0000", 2024-05-07T14:03:34.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2741999999999999e-05 2024-05-07T14:03:34.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550298+0000", 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4484000000000001e-05 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550463+0000", 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165274 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.550736+0000", 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027265299999999998 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:34.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.551015+0000", 2024-05-07T14:03:34.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027935900000000002 2024-05-07T14:03:34.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.569950+0000", 2024-05-07T14:03:34.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018935469999999999 2024-05-07T14:03:34.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.570807+0000", 2024-05-07T14:03:34.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00085676600000000002 2024-05-07T14:03:34.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.570928+0000", 2024-05-07T14:03:34.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120568 2024-05-07T14:03:34.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.571014+0000", 2024-05-07T14:03:34.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6376000000000001e-05 2024-05-07T14:03:34.742 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.742 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.742 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.743 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2250 3.11 3:8ab50290:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:34.743 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:34.743 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.754392989999999, 2024-05-07T14:03:34.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025202414999999999, 2024-05-07T14:03:34.743 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.743 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.743 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:34.743 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.743 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:34.743 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:34.743 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2250 2024-05-07T14:03:34.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.744 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:34.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887861+0000", 2024-05-07T14:03:34.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.887864+0000", 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9299999999999999e-06 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892840+0000", 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049758420000000003 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892883+0000", 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2568999999999998e-05 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.892902+0000", 2024-05-07T14:03:34.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9667e-05 2024-05-07T14:03:34.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893027+0000", 2024-05-07T14:03:34.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012506799999999999 2024-05-07T14:03:34.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893232+0000", 2024-05-07T14:03:34.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020444199999999999 2024-05-07T14:03:34.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:34.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.893445+0000", 2024-05-07T14:03:34.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021324199999999999 2024-05-07T14:03:34.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:34.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.911638+0000", 2024-05-07T14:03:34.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018193343000000001 2024-05-07T14:03:34.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.912977+0000", 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001338802 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.913026+0000", 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8862000000000001e-05 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.913064+0000", 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7648000000000003e-05 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.748 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2500 7.15 7:a93a5511:::notify.2:head [watch reconnect cookie 94397682175232 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.247364309000002, 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0539674379999999, 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:34.749 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2500 2024-05-07T14:03:34.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.750 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:34.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:34.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:34.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:34.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394890+0000", 2024-05-07T14:03:34.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:34.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:34.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394893+0000", 2024-05-07T14:03:34.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8830000000000002e-06 2024-05-07T14:03:34.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:34.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394909+0000", 2024-05-07T14:03:34.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5840000000000001e-05 2024-05-07T14:03:34.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:34.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394951+0000", 2024-05-07T14:03:34.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2175999999999997e-05 2024-05-07T14:03:34.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:34.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394973+0000", 2024-05-07T14:03:34.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2679000000000001e-05 2024-05-07T14:03:34.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395138+0000", 2024-05-07T14:03:34.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000164895 2024-05-07T14:03:34.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:03:34.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395156+0000", 2024-05-07T14:03:34.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7237000000000001e-05 2024-05-07T14:03:34.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415064+0000", 2024-05-07T14:03:34.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019908478 2024-05-07T14:03:34.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:03:34.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415089+0000", 2024-05-07T14:03:34.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4916e-05 2024-05-07T14:03:34.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.425843+0000", 2024-05-07T14:03:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.010754116 2024-05-07T14:03:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.427029+0000", 2024-05-07T14:03:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0011857700000000001 2024-05-07T14:03:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:34.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.436255+0000", 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092263629999999996 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.436391+0000", 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136117 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.448857+0000", 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012465967999999999 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.755 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.756 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:34.756 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:34.756 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:34.757 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:34.758 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:34.768+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:34.858 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:34.867+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:34.861 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:34.861 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:34.861 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:34.861 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:34.874 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:34.959 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:34.968+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:35.033 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:35.033 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:35.034 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:35.034 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:35.034 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:35.046 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:35.096 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:35.107+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:35.161 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:35.172+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:35.165 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:35.165 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:35.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:35.165 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:35.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.165 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:03:35.165 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:35.165 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 168.86491562200001, 2024-05-07T14:03:35.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:03:35.166 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.166 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.166 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.166 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:35.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:35.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:03:35.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:03:35.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:03:35.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:03:35.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:03:35.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:03:35.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:03:35.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:03:35.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:03:35.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:03:35.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:03:35.170 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.170 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.170 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.170 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:03:35.170 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:35.170 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 168.86400922600001, 2024-05-07T14:03:35.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:03:35.170 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.170 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.170 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:03:35.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:03:35.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:03:35.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:03:35.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.174 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 168.862596607, 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:35.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:03:35.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:03:35.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:03:35.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:03:35.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:03:35.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:03:35.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:03:35.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:03:35.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:03:35.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:03:35.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:03:35.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:03:35.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:03:35.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:03:35.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:03:35.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:03:35.179 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.179 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.179 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.179 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:35.180 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:35.180 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 148.03692612500001, 2024-05-07T14:03:35.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:03:35.180 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.180 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.180 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.180 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.180 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.180 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.180 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:03:35.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.180 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:03:35.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:03:35.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:03:35.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:03:35.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:03:35.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:03:35.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:03:35.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:03:35.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:03:35.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:03:35.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:03:35.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:35.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:03:35.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:03:35.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:03:35.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:03:35.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:03:35.185 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 148.00381546700001, 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.186 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:03:35.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:03:35.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:03:35.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:03:35.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:03:35.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:03:35.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:03:35.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:35.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:03:35.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:03:35.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:03:35.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:03:35.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:03:35.191 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.192 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.192 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.192 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1477 3.18 e80/21 3:1a16f065:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_1:head v 80'1, mlcod=0'0)", 2024-05-07T14:03:35.192 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:35.192 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.888662209000003, 2024-05-07T14:03:35.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014861011, 2024-05-07T14:03:35.192 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.192 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.192 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.192 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:35.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:35.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287825+0000", 2024-05-07T14:03:35.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:03:35.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290411+0000", 2024-05-07T14:03:35.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025854430000000002 2024-05-07T14:03:35.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290433+0000", 2024-05-07T14:03:35.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.264e-05 2024-05-07T14:03:35.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290443+0000", 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7189999999999996e-06 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290521+0000", 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8164000000000006e-05 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290546+0000", 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4533e-05 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302655+0000", 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012108898999999999 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302684+0000", 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9624e-05 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.196 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1478 3.12 3:4bdcf7a4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:35.197 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:35.197 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.887222370000003, 2024-05-07T14:03:35.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013141795, 2024-05-07T14:03:35.197 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.197 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.197 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.197 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.197 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.197 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.197 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1478 2024-05-07T14:03:35.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.197 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289265+0000", 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.001e-06 2024-05-07T14:03:35.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290501+0000", 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001235487 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290514+0000", 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.358e-05 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290521+0000", 2024-05-07T14:03:35.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8889999999999996e-06 2024-05-07T14:03:35.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290588+0000", 2024-05-07T14:03:35.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.7218000000000006e-05 2024-05-07T14:03:35.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290762+0000", 2024-05-07T14:03:35.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017409200000000001 2024-05-07T14:03:35.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290904+0000", 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000141963 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.301956+0000", 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011051640999999999 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302315+0000", 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000358876 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302353+0000", 2024-05-07T14:03:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8003999999999997e-05 2024-05-07T14:03:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302405+0000", 2024-05-07T14:03:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2043999999999998e-05 2024-05-07T14:03:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1481 4.b 4:d1744c9b:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.0:head [stat,call rgw.guard_bucket_resharding in=26b,call rgw.bucket_complete_op in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.842796438000001, 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099753589999999996, 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1481 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333691+0000", 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8920000000000001e-06 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333699+0000", 2024-05-07T14:03:35.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1089999999999998e-06 2024-05-07T14:03:35.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333715+0000", 2024-05-07T14:03:35.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6260999999999999e-05 2024-05-07T14:03:35.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333723+0000", 2024-05-07T14:03:35.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1579999999999999e-06 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333800+0000", 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7000000000000001e-05 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333807+0000", 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.498e-06 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339421+0000", 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056137909999999999 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339536+0000", 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115297 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339894+0000", 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035790799999999999 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343340+0000", 2024-05-07T14:03:35.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034459120000000002 2024-05-07T14:03:35.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343547+0000", 2024-05-07T14:03:35.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020692799999999999 2024-05-07T14:03:35.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343613+0000", 2024-05-07T14:03:35.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6166000000000003e-05 2024-05-07T14:03:35.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343664+0000", 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1439e-05 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1611 3.30 e81/21 3:0c405120:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_1:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.750341679000002, 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013061969999999999, 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.209 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426145+0000", 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5990000000000001e-06 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.433982+0000", 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078361190000000008 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434000+0000", 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.806e-05 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434011+0000", 2024-05-07T14:03:35.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1615e-05 2024-05-07T14:03:35.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434085+0000", 2024-05-07T14:03:35.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3819000000000006e-05 2024-05-07T14:03:35.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434100+0000", 2024-05-07T14:03:35.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4973999999999999e-05 2024-05-07T14:03:35.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.439168+0000", 2024-05-07T14:03:35.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050674350000000003 2024-05-07T14:03:35.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.439206+0000", 2024-05-07T14:03:35.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8349000000000002e-05 2024-05-07T14:03:35.213 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.213 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.213 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1612 3.3 e81/21 3:c1191b65:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_2:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.748706630999997, 2024-05-07T14:03:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086703990000000005, 2024-05-07T14:03:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427780+0000", 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1699999999999997e-07 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431380+0000", 2024-05-07T14:03:35.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600378 2024-05-07T14:03:35.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431413+0000", 2024-05-07T14:03:35.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3056000000000003e-05 2024-05-07T14:03:35.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.216 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.216 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431430+0000", 2024-05-07T14:03:35.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6986999999999998e-05 2024-05-07T14:03:35.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431508+0000", 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8177999999999996e-05 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431526+0000", 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7333000000000002e-05 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.436392+0000", 2024-05-07T14:03:35.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0048665100000000001 2024-05-07T14:03:35.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.218 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.218 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.436449+0000", 2024-05-07T14:03:35.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7040000000000003e-05 2024-05-07T14:03:35.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.218 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.218 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1915 4.1e 4:7a3b9b37:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:35.218 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:35.218 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 40.780251518, 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051237260000000003, 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1915 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:35.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:35.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396235+0000", 2024-05-07T14:03:35.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.33e-06 2024-05-07T14:03:35.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396241+0000", 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.699e-06 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396257+0000", 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5432000000000001e-05 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396265+0000", 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6009999999999995e-06 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396336+0000", 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1045999999999997e-05 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396431+0000", 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5126999999999999e-05 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396547+0000", 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115339 2024-05-07T14:03:35.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397910+0000", 2024-05-07T14:03:35.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013629720000000001 2024-05-07T14:03:35.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401294+0000", 2024-05-07T14:03:35.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384504 2024-05-07T14:03:35.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401329+0000", 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5179000000000003e-05 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401358+0000", 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8496999999999998e-05 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2208 3.3a e84/21 3:5ee07aff:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_7:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:35.224 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 31.823271093999999, 2024-05-07T14:03:35.225 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017943191000000001, 2024-05-07T14:03:35.225 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.225 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.225 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.225 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.225 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.225 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:35.225 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.225 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.225 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:35.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.226 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.226 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353217+0000", 2024-05-07T14:03:35.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3920000000000001e-06 2024-05-07T14:03:35.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.226 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.226 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363741+0000", 2024-05-07T14:03:35.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010524586000000001 2024-05-07T14:03:35.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363773+0000", 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362000000000002e-05 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363793+0000", 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9743999999999999e-05 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363870+0000", 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7610999999999999e-05 2024-05-07T14:03:35.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363888+0000", 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.785e-05 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.371098+0000", 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072103100000000002 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.371158+0000", 2024-05-07T14:03:35.228 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9336000000000002e-05 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2219 3.32 3:4d615ce3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 31.651468764000001, 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016879689999999999, 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.229 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.230 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.230 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2219 2024-05-07T14:03:35.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.230 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.230 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.230 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.230 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:35.230 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.230 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.230 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.230 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:35.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.231 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.231 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525020+0000", 2024-05-07T14:03:35.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.751e-06 2024-05-07T14:03:35.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.231 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.231 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528212+0000", 2024-05-07T14:03:35.231 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031922080000000002 2024-05-07T14:03:35.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.232 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528240+0000", 2024-05-07T14:03:35.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7911000000000001e-05 2024-05-07T14:03:35.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.232 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528254+0000", 2024-05-07T14:03:35.232 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4457999999999999e-05 2024-05-07T14:03:35.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.232 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.232 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528333+0000", 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9136999999999998e-05 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528460+0000", 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012715799999999999 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528572+0000", 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011162099999999999 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.233 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541359+0000", 2024-05-07T14:03:35.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012787023 2024-05-07T14:03:35.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.234 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.234 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541810+0000", 2024-05-07T14:03:35.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045134299999999999 2024-05-07T14:03:35.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.234 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.234 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541859+0000", 2024-05-07T14:03:35.234 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8934999999999998e-05 2024-05-07T14:03:35.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541896+0000", 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7144999999999998e-05 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2225 3.1f 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 31.577739006000002, 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020378113, 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.235 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.236 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.236 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.236 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.236 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.236 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2225 2024-05-07T14:03:35.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.236 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.236 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.236 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:35.236 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598750+0000", 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8859999999999997e-06 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602351+0000", 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600195 2024-05-07T14:03:35.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602470+0000", 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119608 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602494+0000", 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.376e-05 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602590+0000", 2024-05-07T14:03:35.238 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6399999999999999e-05 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602740+0000", 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014951 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602884+0000", 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000143616 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.239 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618629+0000", 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015745420999999999 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619008+0000", 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037870699999999999 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619069+0000", 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1617000000000003e-05 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619125+0000", 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5393000000000003e-05 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2227 3.1b 3:d8b15ce8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 31.535952764000001, 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017300908, 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.241 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2227 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.242 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640536+0000", 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9809999999999999e-06 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643182+0000", 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026464769999999999 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.243 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643207+0000", 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5077999999999999e-05 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643220+0000", 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2866e-05 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643329+0000", 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108467 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.244 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643499+0000", 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017020199999999999 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643652+0000", 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152993 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.648361+0000", 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0047089530000000001 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657709+0000", 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093483360000000005 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657779+0000", 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9375999999999994e-05 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657834+0000", 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5179000000000001e-05 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.246 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2228 3.b e84/21 3:d3d17a37:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_27:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 31.523994206000001, 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093032859999999992, 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.247 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652493+0000", 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7269999999999999e-06 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.248 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653476+0000", 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098271300000000008 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653501+0000", 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5012e-05 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653511+0000", 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0009e-05 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653607+0000", 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5975000000000002e-05 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653635+0000", 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8010000000000001e-05 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661728+0000", 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080929339999999995 2024-05-07T14:03:35.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.251 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.251 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661795+0000", 2024-05-07T14:03:35.251 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6905999999999999e-05 2024-05-07T14:03:35.251 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.251 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.251 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.251 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2229 3.3 e84/21 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:35.251 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:35.251 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 31.511527963999999, 2024-05-07T14:03:35.251 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022534413, 2024-05-07T14:03:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664960+0000", 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0109999999999999e-06 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670334+0000", 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005374635 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3374999999999998e-05 2024-05-07T14:03:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670385+0000", 2024-05-07T14:03:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7512000000000001e-05 2024-05-07T14:03:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670515+0000", 2024-05-07T14:03:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012940900000000001 2024-05-07T14:03:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670543+0000", 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8157000000000002e-05 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687374+0000", 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016831793000000001 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687492+0000", 2024-05-07T14:03:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117521 2024-05-07T14:03:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2230 3.b e84/21 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 31.501522792999999, 2024-05-07T14:03:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016432748, 2024-05-07T14:03:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674964+0000", 2024-05-07T14:03:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5409999999999999e-06 2024-05-07T14:03:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677117+0000", 2024-05-07T14:03:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002153154 2024-05-07T14:03:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677136+0000", 2024-05-07T14:03:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8691000000000001e-05 2024-05-07T14:03:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677148+0000", 2024-05-07T14:03:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2291e-05 2024-05-07T14:03:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677217+0000", 2024-05-07T14:03:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8880000000000005e-05 2024-05-07T14:03:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677249+0000", 2024-05-07T14:03:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1664e-05 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691337+0000", 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014087926000000001 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691396+0000", 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8600999999999997e-05 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2497 7.9 7:93e5b521:::notify.7:head [watch reconnect cookie 94397682177536 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.781544542999999, 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0512951690000001, 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2497 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394942+0000", 2024-05-07T14:03:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9100000000000002e-07 2024-05-07T14:03:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394946+0000", 2024-05-07T14:03:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2239999999999997e-06 2024-05-07T14:03:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394960+0000", 2024-05-07T14:03:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3419e-05 2024-05-07T14:03:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394966+0000", 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3620000000000002e-06 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395019+0000", 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3099000000000001e-05 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395023+0000", 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0879999999999997e-06 2024-05-07T14:03:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400981+0000", 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059580520000000001 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400990+0000", 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0880000000000001e-06 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438550+0000", 2024-05-07T14:03:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.037559288 2024-05-07T14:03:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.439512+0000", 2024-05-07T14:03:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000962154 2024-05-07T14:03:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442920+0000", 2024-05-07T14:03:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034085109999999999 2024-05-07T14:03:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442966+0000", 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5509000000000001e-05 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.446236+0000", 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032704840000000002 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "MOSDPGPushReply(3.3e 87/86 [PushReplyOp(3:7fbbdcd7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_108:head)])", 2024-05-07T14:03:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.715991771999999, 2024-05-07T14:03:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055859079999999997, 2024-05-07T14:03:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460495+0000", 2024-05-07T14:03:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4499999999999996e-07 2024-05-07T14:03:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460501+0000", 2024-05-07T14:03:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.212e-06 2024-05-07T14:03:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460514+0000", 2024-05-07T14:03:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3183000000000001e-05 2024-05-07T14:03:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460523+0000", 2024-05-07T14:03:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4450000000000002e-06 2024-05-07T14:03:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460615+0000", 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1693000000000005e-05 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.466080+0000", 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054645300000000004 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.271 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:35.273 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:35.274 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:35.284+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:35.374 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:35.383+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:35.438 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:35.438 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:35.438 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:35.438 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:35.451 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:35.475 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:35.484+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:35.575 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:35.583+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:35.609 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:35.610 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:35.610 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:35.610 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:35.610 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:35.625 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:35.709 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:35.719+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:35.777 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:35.787+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:35.791 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:35.791 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:35.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:35.791 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:35.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.791 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:03:35.791 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:35.791 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 155.81708843800001, 2024-05-07T14:03:35.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:03:35.791 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.791 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:03:35.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:03:35.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:03:35.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:03:35.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:03:35.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 148.63398514599999, 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.796 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:03:35.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:03:35.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:03:35.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:03:35.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:03:35.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:03:35.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:03:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:03:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 148.49836517700001, 2024-05-07T14:03:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:03:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:03:35.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:03:35.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:03:35.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:03:35.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:03:35.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.807 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1571 4.24 4:26e499bb:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.129192035999999, 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063870100000000003, 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.808 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1571 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:35.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2800000000000002e-07 2024-05-07T14:03:35.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672852+0000", 2024-05-07T14:03:35.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6599999999999999e-06 2024-05-07T14:03:35.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672866+0000", 2024-05-07T14:03:35.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3648999999999999e-05 2024-05-07T14:03:35.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672871+0000", 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672926+0000", 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4299999999999998e-05 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673007+0000", 2024-05-07T14:03:35.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1429999999999998e-05 2024-05-07T14:03:35.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:35.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673097+0000", 2024-05-07T14:03:35.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0272000000000006e-05 2024-05-07T14:03:35.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673822+0000", 2024-05-07T14:03:35.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072425300000000001 2024-05-07T14:03:35.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679164+0000", 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005341943 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679209+0000", 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5738000000000002e-05 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679236+0000", 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6633000000000001e-05 2024-05-07T14:03:35.813 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1578 4.27 4:e7c87c96:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.904729895999999, 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046530510000000001, 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.814 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1578 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897314+0000", 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7250000000000002e-06 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897328+0000", 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4e-05 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897352+0000", 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4576999999999999e-05 2024-05-07T14:03:35.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897366+0000", 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3173000000000001e-05 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897473+0000", 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010762100000000001 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897601+0000", 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012757099999999999 2024-05-07T14:03:35.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:35.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897754+0000", 2024-05-07T14:03:35.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152807 2024-05-07T14:03:35.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900001+0000", 2024-05-07T14:03:35.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002247686 2024-05-07T14:03:35.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901868+0000", 2024-05-07T14:03:35.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018669940000000001 2024-05-07T14:03:35.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901924+0000", 2024-05-07T14:03:35.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5383999999999997e-05 2024-05-07T14:03:35.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901964+0000", 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0513000000000003e-05 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1582 4.27 4:e6cd56b0:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.904583543999998, 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046596959999999996, 2024-05-07T14:03:35.820 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1582 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897458+0000", 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5700000000000002e-07 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897462+0000", 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0690000000000003e-06 2024-05-07T14:03:35.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897469+0000", 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0079999999999996e-06 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897474+0000", 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9420000000000003e-06 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898643+0000", 2024-05-07T14:03:35.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011688709999999999 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898756+0000", 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113522 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898961+0000", 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020425799999999999 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900212+0000", 2024-05-07T14:03:35.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012512860000000001 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902014+0000", 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018024029999999999 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902075+0000", 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0509e-05 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902117+0000", 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2271000000000002e-05 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:49 7.15 e81/29 7:a93a5511:::notify.2:head v 81'49, mlcod=81'47)", 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.651061433999999, 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0070782700000000002, 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.826 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150981+0000", 2024-05-07T14:03:35.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2899999999999999e-06 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150990+0000", 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3959999999999995e-06 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151011+0000", 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.105e-05 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151023+0000", 2024-05-07T14:03:35.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151122+0000", 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9351999999999993e-05 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151155+0000", 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2459000000000002e-05 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158027+0000", 2024-05-07T14:03:35.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.006871785 2024-05-07T14:03:35.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158058+0000", 2024-05-07T14:03:35.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1315000000000001e-05 2024-05-07T14:03:35.830 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.830 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.830 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.830 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:52 7.d e81/29 7:b4812045:::notify.4:head v 81'48, mlcod=81'46)", 2024-05-07T14:03:35.830 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.648615022000001, 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0048232429999999996, 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153427+0000", 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6499999999999999e-07 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153432+0000", 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9579999999999998e-06 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153441+0000", 2024-05-07T14:03:35.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.662e-06 2024-05-07T14:03:35.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153446+0000", 2024-05-07T14:03:35.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7530000000000001e-06 2024-05-07T14:03:35.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153492+0000", 2024-05-07T14:03:35.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5853999999999998e-05 2024-05-07T14:03:35.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153505+0000", 2024-05-07T14:03:35.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3288000000000001e-05 2024-05-07T14:03:35.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158230+0000", 2024-05-07T14:03:35.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0047249170000000004 2024-05-07T14:03:35.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158249+0000", 2024-05-07T14:03:35.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9145999999999999e-05 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2202 3.0 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.522071058999998, 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027191908000000001, 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.835 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2202 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279975+0000", 2024-05-07T14:03:35.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0130000000000001e-06 2024-05-07T14:03:35.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285489+0000", 2024-05-07T14:03:35.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055143570000000001 2024-05-07T14:03:35.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285531+0000", 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1504000000000001e-05 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285550+0000", 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9256e-05 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285747+0000", 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196777 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286120+0000", 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037285900000000002 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286489+0000", 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036951099999999999 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301589+0000", 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015099728999999999 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307085+0000", 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054963340000000003 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307127+0000", 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1977999999999997e-05 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307162+0000", 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4589999999999999e-05 2024-05-07T14:03:35.840 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2212 3.1a e84/21 3:591da10a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_11:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.386902718999998, 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012581199, 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:35.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:35.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415141+0000", 2024-05-07T14:03:35.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.52e-06 2024-05-07T14:03:35.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421260+0000", 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061196169999999999 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421304+0000", 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3293e-05 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421324+0000", 2024-05-07T14:03:35.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0341000000000001e-05 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421401+0000", 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6773999999999994e-05 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421418+0000", 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6827e-05 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.427656+0000", 2024-05-07T14:03:35.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0062381010000000002 2024-05-07T14:03:35.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.427720+0000", 2024-05-07T14:03:35.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3726000000000006e-05 2024-05-07T14:03:35.845 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.845 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.845 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.845 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2216 3.21 e84/46 3:86b25102:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_15:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:35.845 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:35.845 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.329543807, 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012554667, 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:35.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472500+0000", 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6630000000000002e-06 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475359+0000", 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028594409999999999 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475407+0000", 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7868999999999999e-05 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475431+0000", 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3873999999999999e-05 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475528+0000", 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7163999999999993e-05 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475556+0000", 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7594999999999999e-05 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485009+0000", 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0094531149999999998 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485052+0000", 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2945999999999998e-05 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.849 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.850 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.850 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2217 3.0 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:35.850 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:35.850 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.311744490999999, 2024-05-07T14:03:35.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019983529, 2024-05-07T14:03:35.850 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.850 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.850 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.850 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.850 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.850 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2217 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490299+0000", 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492337+0000", 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020384489999999999 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492391+0000", 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3702000000000002e-05 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492415+0000", 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3373000000000001e-05 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492567+0000", 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152788 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492843+0000", 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027568999999999998 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493123+0000", 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028014899999999999 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509840+0000", 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016716871000000001 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510203+0000", 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036252499999999999 2024-05-07T14:03:35.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510250+0000", 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7231000000000002e-05 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510280+0000", 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0270999999999999e-05 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.856 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2219 3.32 e84/21 3:4d615ce3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_18:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:35.856 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:35.856 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.273324459000001, 2024-05-07T14:03:35.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012848995, 2024-05-07T14:03:35.856 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.856 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.856 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.856 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:35.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528718+0000", 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.86e-06 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531113+0000", 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002394958 2024-05-07T14:03:35.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531141+0000", 2024-05-07T14:03:35.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7543e-05 2024-05-07T14:03:35.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531154+0000", 2024-05-07T14:03:35.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3355e-05 2024-05-07T14:03:35.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531232+0000", 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7608000000000006e-05 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531259+0000", 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6656e-05 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541473+0000", 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010214101999999999 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541566+0000", 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2912999999999996e-05 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2224 3.1a e84/21 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.206800823999998, 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020623257999999998, 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.860 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595243+0000", 2024-05-07T14:03:35.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6800000000000002e-06 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.601988+0000", 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0067452479999999997 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602044+0000", 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5884999999999998e-05 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602070+0000", 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6359999999999998e-05 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602183+0000", 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112761 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602210+0000", 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6882000000000001e-05 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615811+0000", 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01360132 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615863+0000", 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2122e-05 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2225 3.1f e84/46 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:35.864 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.197372967, 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014189089, 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:35.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604671+0000", 2024-05-07T14:03:35.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6070000000000002e-06 2024-05-07T14:03:35.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607720+0000", 2024-05-07T14:03:35.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030496849999999999 2024-05-07T14:03:35.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607763+0000", 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3044999999999999e-05 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607787+0000", 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3264e-05 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607878+0000", 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1650000000000005e-05 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607905+0000", 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7090999999999999e-05 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618733+0000", 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010827582000000001 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618857+0000", 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000124165 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.868 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2226 3.4 3:20f3de0c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.180064553000001, 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014369191, 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.869 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2226 2024-05-07T14:03:35.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.870 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:35.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:35.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621979+0000", 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.272e-06 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624873+0000", 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028946390000000001 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624904+0000", 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0446e-05 2024-05-07T14:03:35.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624918+0000", 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4263e-05 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625007+0000", 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8850000000000005e-05 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625174+0000", 2024-05-07T14:03:35.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167314 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625327+0000", 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152433 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.633342+0000", 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080152699999999997 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636260+0000", 2024-05-07T14:03:35.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029179060000000001 2024-05-07T14:03:35.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636297+0000", 2024-05-07T14:03:35.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7543000000000003e-05 2024-05-07T14:03:35.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636346+0000", 2024-05-07T14:03:35.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8254999999999998e-05 2024-05-07T14:03:35.874 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.874 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.874 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2233 3.8 e84/21 3:11b98425:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_32:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.705600+0000", 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.096441198999997, 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011076903000000001, 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705600+0000", 2024-05-07T14:03:35.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705600+0000", 2024-05-07T14:03:35.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705601+0000", 2024-05-07T14:03:35.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.375e-06 2024-05-07T14:03:35.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707534+0000", 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019330199999999999 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707561+0000", 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6979999999999999e-05 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707574+0000", 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.328e-05 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707703+0000", 2024-05-07T14:03:35.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012801500000000001 2024-05-07T14:03:35.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707729+0000", 2024-05-07T14:03:35.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6585999999999999e-05 2024-05-07T14:03:35.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716608+0000", 2024-05-07T14:03:35.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088793480000000004 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716677+0000", 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8299000000000005e-05 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2236 3.32 e84/21 3:4d7a89ea:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_35:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.737366+0000", 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.064674920999998, 2024-05-07T14:03:35.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01010346, 2024-05-07T14:03:35.880 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.880 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.880 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.880 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.737366+0000", 2024-05-07T14:03:35.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.737366+0000", 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.737368+0000", 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.623e-06 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739037+0000", 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016693109999999999 2024-05-07T14:03:35.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739061+0000", 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4280000000000001e-05 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739077+0000", 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5568000000000001e-05 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739194+0000", 2024-05-07T14:03:35.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011736899999999999 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739227+0000", 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2268999999999999e-05 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.747401+0000", 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008174354 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.747470+0000", 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8685999999999999e-05 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2545 8.1 8:84e82796:root::.bucket.meta.buck_2024_04_7_14_02_56%3ac956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9:head [call version.check_conds in=18b,call version.inc in=10b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.464507+0000", 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.337533616000002, 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049738009999999999, 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.884 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2545 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464507+0000", 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464507+0000", 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464509+0000", 2024-05-07T14:03:35.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0339999999999999e-06 2024-05-07T14:03:35.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464522+0000", 2024-05-07T14:03:35.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2088e-05 2024-05-07T14:03:35.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464555+0000", 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3317e-05 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464574+0000", 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8885999999999998e-05 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464643+0000", 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9548000000000006e-05 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464737+0000", 2024-05-07T14:03:35.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3839999999999996e-05 2024-05-07T14:03:35.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:35.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464953+0000", 2024-05-07T14:03:35.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021561200000000001 2024-05-07T14:03:35.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.468765+0000", 2024-05-07T14:03:35.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038126850000000001 2024-05-07T14:03:35.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.469424+0000", 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065884699999999995 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.469457+0000", 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3213999999999997e-05 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.469481+0000", 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3730000000000001e-05 2024-05-07T14:03:35.889 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2558 4.f 4:f3381da8:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.470708+0000", 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.331333436000001, 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050104470000000003, 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:35.890 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2558 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470708+0000", 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470708+0000", 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470709+0000", 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8479999999999999e-06 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470717+0000", 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.824e-06 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470746+0000", 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8799999999999999e-05 2024-05-07T14:03:35.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470761+0000", 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5366000000000002e-05 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470828+0000", 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6654000000000003e-05 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470917+0000", 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9178999999999994e-05 2024-05-07T14:03:35.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.471014+0000", 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6237999999999996e-05 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.474388+0000", 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033746990000000001 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475630+0000", 2024-05-07T14:03:35.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012418139999999999 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475680+0000", 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0118999999999999e-05 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475718+0000", 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7905999999999999e-05 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.895 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:35.896 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:35.896 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:35.897 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:35.897 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:35.911+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:35.997 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:36.008+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:36.073 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:36.073 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:36.087 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:36.132 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:36.143+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:36.199 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:36.212+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:36.204 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:36.205 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:36.205 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:36.205 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:36.205 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:36.219 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:36.300 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:36.312+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:36.391 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:36.392 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:36.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:36.392 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:36.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.392 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:36.392 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:03:36.392 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 149.11035288799999, 2024-05-07T14:03:36.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:03:36.393 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.393 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.393 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.393 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:36.393 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:36.393 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:36.393 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:03:36.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.393 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:03:36.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:03:36.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:03:36.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:03:36.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:03:36.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:03:36.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:03:36.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:03:36.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:03:36.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:03:36.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:03:36.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:03:36.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:03:36.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:03:36.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:36.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:03:36.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:03:36.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:36.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:03:36.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:03:36.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:36.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:03:36.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:03:36.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:03:36.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:03:36.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:03:36.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:03:36.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.399 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.399 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:03:36.399 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:03:36.400 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 148.81265287799999, 2024-05-07T14:03:36.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:03:36.400 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.400 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.400 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.400 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:03:36.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:03:36.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:03:36.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:03:36.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:03:36.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:03:36.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:03:36.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:03:36.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:03:36.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:03:36.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:03:36.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:03:36.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:03:36.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:03:36.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:03:36.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:03:36.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:03:36.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:03:36.405 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.406 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.406 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.406 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:36.406 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:03:36.407 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 148.632691851, 2024-05-07T14:03:36.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:03:36.407 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.407 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.407 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.407 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:36.407 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:36.407 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:36.407 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:03:36.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.408 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:03:36.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:03:36.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:03:36.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:03:36.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:03:36.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:03:36.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:03:36.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:03:36.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:03:36.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:03:36.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:03:36.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:03:36.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:03:36.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:03:36.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:36.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:03:36.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:03:36.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:36.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:03:36.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:03:36.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:36.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:03:36.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:03:36.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:03:36.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:03:36.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:03:36.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:03:36.414 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.414 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.415 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.415 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5099.0:56 7.14 e80/29 7:2b04a3e9:::notify.6:head v 80'36, mlcod=80'34)", 2024-05-07T14:03:36.415 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:36.415 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 44.222762840000001, 2024-05-07T14:03:36.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046522059999999999, 2024-05-07T14:03:36.415 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.415 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.415 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.415 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:36.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:36.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:36.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1399999999999997e-07 2024-05-07T14:03:36.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179862+0000", 2024-05-07T14:03:36.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4330000000000003e-06 2024-05-07T14:03:36.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179873+0000", 2024-05-07T14:03:36.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0838e-05 2024-05-07T14:03:36.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179879+0000", 2024-05-07T14:03:36.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3099999999999997e-06 2024-05-07T14:03:36.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179934+0000", 2024-05-07T14:03:36.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4625e-05 2024-05-07T14:03:36.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179955+0000", 2024-05-07T14:03:36.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-05 2024-05-07T14:03:36.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184469+0000", 2024-05-07T14:03:36.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045139150000000003 2024-05-07T14:03:36.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184508+0000", 2024-05-07T14:03:36.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9001000000000001e-05 2024-05-07T14:03:36.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.421 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.421 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5117.0:56 7.14 e81/29 7:2b04a3e9:::notify.6:head v 81'39, mlcod=80'37)", 2024-05-07T14:03:36.421 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:36.421 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.906166999999996, 2024-05-07T14:03:36.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078436700000000005, 2024-05-07T14:03:36.422 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.422 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.422 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.422 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:36.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:36.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:36.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.34e-07 2024-05-07T14:03:36.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496456+0000", 2024-05-07T14:03:36.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5410000000000001e-06 2024-05-07T14:03:36.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496463+0000", 2024-05-07T14:03:36.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7689999999999996e-06 2024-05-07T14:03:36.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496468+0000", 2024-05-07T14:03:36.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1969999999999998e-06 2024-05-07T14:03:36.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496518+0000", 2024-05-07T14:03:36.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0793e-05 2024-05-07T14:03:36.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496538+0000", 2024-05-07T14:03:36.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0000000000000002e-05 2024-05-07T14:03:36.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504267+0000", 2024-05-07T14:03:36.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077288419999999997 2024-05-07T14:03:36.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504295+0000", 2024-05-07T14:03:36.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8093999999999999e-05 2024-05-07T14:03:36.427 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.427 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.427 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.427 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1585 4.2d 4:b60c161e:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:36.427 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897371+0000", 2024-05-07T14:03:36.427 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.505247769999997, 2024-05-07T14:03:36.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035527139999999998, 2024-05-07T14:03:36.427 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.427 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.427 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.428 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:36.428 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:36.428 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:36.428 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1585 2024-05-07T14:03:36.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.428 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897371+0000", 2024-05-07T14:03:36.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897371+0000", 2024-05-07T14:03:36.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897373+0000", 2024-05-07T14:03:36.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2680000000000001e-06 2024-05-07T14:03:36.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897382+0000", 2024-05-07T14:03:36.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.85e-06 2024-05-07T14:03:36.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897402+0000", 2024-05-07T14:03:36.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9732999999999999e-05 2024-05-07T14:03:36.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897412+0000", 2024-05-07T14:03:36.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0292000000000001e-05 2024-05-07T14:03:36.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897477+0000", 2024-05-07T14:03:36.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4639000000000002e-05 2024-05-07T14:03:36.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897597+0000", 2024-05-07T14:03:36.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120727 2024-05-07T14:03:36.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:36.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897756+0000", 2024-05-07T14:03:36.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015853500000000001 2024-05-07T14:03:36.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:36.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898973+0000", 2024-05-07T14:03:36.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012173780000000001 2024-05-07T14:03:36.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:36.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900839+0000", 2024-05-07T14:03:36.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00186578 2024-05-07T14:03:36.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900890+0000", 2024-05-07T14:03:36.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0991e-05 2024-05-07T14:03:36.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900924+0000", 2024-05-07T14:03:36.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3521e-05 2024-05-07T14:03:36.434 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.434 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.434 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.434 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:56 7.14 e81/29 7:2b04a3e9:::notify.6:head v 81'48, mlcod=81'46)", 2024-05-07T14:03:36.434 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:03:36.434 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.242427159999998, 2024-05-07T14:03:36.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039243350000000001, 2024-05-07T14:03:36.434 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.434 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.435 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.435 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:03:36.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:03:36.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160192+0000", 2024-05-07T14:03:36.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6199999999999999e-07 2024-05-07T14:03:36.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160195+0000", 2024-05-07T14:03:36.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3569999999999998e-06 2024-05-07T14:03:36.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160202+0000", 2024-05-07T14:03:36.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8120000000000002e-06 2024-05-07T14:03:36.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160207+0000", 2024-05-07T14:03:36.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5390000000000001e-06 2024-05-07T14:03:36.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160259+0000", 2024-05-07T14:03:36.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2578999999999999e-05 2024-05-07T14:03:36.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.160279+0000", 2024-05-07T14:03:36.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9599999999999999e-05 2024-05-07T14:03:36.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164086+0000", 2024-05-07T14:03:36.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038071979999999999 2024-05-07T14:03:36.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.164116+0000", 2024-05-07T14:03:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9887999999999999e-05 2024-05-07T14:03:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.440 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1720 4.1c 4:397a1514:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.5.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:36.440 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:03:36.441 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.480343585999996, 2024-05-07T14:03:36.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041467209999999999, 2024-05-07T14:03:36.442 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.442 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.442 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.442 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:36.442 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:36.442 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:36.442 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1720 2024-05-07T14:03:36.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.442 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:03:36.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:03:36.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922276+0000", 2024-05-07T14:03:36.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4799999999999998e-07 2024-05-07T14:03:36.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922280+0000", 2024-05-07T14:03:36.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4839999999999998e-06 2024-05-07T14:03:36.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922288+0000", 2024-05-07T14:03:36.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9610000000000005e-06 2024-05-07T14:03:36.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922300+0000", 2024-05-07T14:03:36.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1365e-05 2024-05-07T14:03:36.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922369+0000", 2024-05-07T14:03:36.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9758999999999994e-05 2024-05-07T14:03:36.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922491+0000", 2024-05-07T14:03:36.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121383 2024-05-07T14:03:36.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:36.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922642+0000", 2024-05-07T14:03:36.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015127200000000001 2024-05-07T14:03:36.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:36.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.923617+0000", 2024-05-07T14:03:36.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097548299999999997 2024-05-07T14:03:36.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:36.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926352+0000", 2024-05-07T14:03:36.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027348170000000001 2024-05-07T14:03:36.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926382+0000", 2024-05-07T14:03:36.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9808e-05 2024-05-07T14:03:36.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926422+0000", 2024-05-07T14:03:36.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9740999999999998e-05 2024-05-07T14:03:36.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.449 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.450 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1922 4.19 e81/23 4:9849ed33:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.8:head v 81'4, mlcod=81'1)", 2024-05-07T14:03:36.450 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:36.450 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.004753796000003, 2024-05-07T14:03:36.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005911655, 2024-05-07T14:03:36.450 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.450 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.450 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.450 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:36.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:36.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:36.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8200000000000001e-07 2024-05-07T14:03:36.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397869+0000", 2024-05-07T14:03:36.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5209999999999998e-06 2024-05-07T14:03:36.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397875+0000", 2024-05-07T14:03:36.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6599999999999998e-06 2024-05-07T14:03:36.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397881+0000", 2024-05-07T14:03:36.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1240000000000004e-06 2024-05-07T14:03:36.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398179+0000", 2024-05-07T14:03:36.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029815899999999999 2024-05-07T14:03:36.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398197+0000", 2024-05-07T14:03:36.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8133000000000001e-05 2024-05-07T14:03:36.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403738+0000", 2024-05-07T14:03:36.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055410950000000002 2024-05-07T14:03:36.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403777+0000", 2024-05-07T14:03:36.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8581000000000002e-05 2024-05-07T14:03:36.455 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.455 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.455 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.456 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2202 3.0 e84/21 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:36.456 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:36.456 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.115945625999998, 2024-05-07T14:03:36.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020120560999999999, 2024-05-07T14:03:36.456 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.457 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.457 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.457 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:36.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:36.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286676+0000", 2024-05-07T14:03:36.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.57e-06 2024-05-07T14:03:36.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291894+0000", 2024-05-07T14:03:36.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052185740000000001 2024-05-07T14:03:36.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291939+0000", 2024-05-07T14:03:36.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4676999999999999e-05 2024-05-07T14:03:36.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291959+0000", 2024-05-07T14:03:36.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0115999999999998e-05 2024-05-07T14:03:36.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292128+0000", 2024-05-07T14:03:36.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168758 2024-05-07T14:03:36.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292188+0000", 2024-05-07T14:03:36.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0565e-05 2024-05-07T14:03:36.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306607+0000", 2024-05-07T14:03:36.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014418733 2024-05-07T14:03:36.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306794+0000", 2024-05-07T14:03:36.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018656799999999999 2024-05-07T14:03:36.461 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.461 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.461 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.462 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2204 3.3b e84/21 3:df85b00b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_3:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:36.462 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.312700+0000", 2024-05-07T14:03:36.462 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.089918478999998, 2024-05-07T14:03:36.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015369649000000001, 2024-05-07T14:03:36.462 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.462 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.462 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.462 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.312700+0000", 2024-05-07T14:03:36.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.312700+0000", 2024-05-07T14:03:36.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.312702+0000", 2024-05-07T14:03:36.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8279999999999999e-06 2024-05-07T14:03:36.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319174+0000", 2024-05-07T14:03:36.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064721049999999997 2024-05-07T14:03:36.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319227+0000", 2024-05-07T14:03:36.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2670000000000002e-05 2024-05-07T14:03:36.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319255+0000", 2024-05-07T14:03:36.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7923e-05 2024-05-07T14:03:36.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319409+0000", 2024-05-07T14:03:36.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015399200000000001 2024-05-07T14:03:36.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319455+0000", 2024-05-07T14:03:36.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6726e-05 2024-05-07T14:03:36.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.327989+0000", 2024-05-07T14:03:36.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0085333779999999994 2024-05-07T14:03:36.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.328070+0000", 2024-05-07T14:03:36.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1026999999999995e-05 2024-05-07T14:03:36.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.467 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.467 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.467 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2211 3.13 3:cbf4b364:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:36.467 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.389539+0000", 2024-05-07T14:03:36.467 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.013079908000002, 2024-05-07T14:03:36.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015047895, 2024-05-07T14:03:36.467 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.467 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.467 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.467 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:36.468 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:36.468 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:36.468 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2211 2024-05-07T14:03:36.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.468 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.389539+0000", 2024-05-07T14:03:36.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.389539+0000", 2024-05-07T14:03:36.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.389541+0000", 2024-05-07T14:03:36.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2709999999999999e-06 2024-05-07T14:03:36.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392129+0000", 2024-05-07T14:03:36.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002587719 2024-05-07T14:03:36.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392163+0000", 2024-05-07T14:03:36.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3714999999999998e-05 2024-05-07T14:03:36.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392178+0000", 2024-05-07T14:03:36.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5132e-05 2024-05-07T14:03:36.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392251+0000", 2024-05-07T14:03:36.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3743000000000002e-05 2024-05-07T14:03:36.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392368+0000", 2024-05-07T14:03:36.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011705 2024-05-07T14:03:36.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:36.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392465+0000", 2024-05-07T14:03:36.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6836000000000006e-05 2024-05-07T14:03:36.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:36.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.399912+0000", 2024-05-07T14:03:36.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0074468069999999997 2024-05-07T14:03:36.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:36.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.404505+0000", 2024-05-07T14:03:36.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045928840000000002 2024-05-07T14:03:36.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.404540+0000", 2024-05-07T14:03:36.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5485000000000003e-05 2024-05-07T14:03:36.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.404587+0000", 2024-05-07T14:03:36.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6252999999999999e-05 2024-05-07T14:03:36.473 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.473 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.473 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.474 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2216 3.21 3:86b25102:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:36.474 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:36.474 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.934515302000001, 2024-05-07T14:03:36.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017498730000000001, 2024-05-07T14:03:36.474 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.474 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.474 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.474 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:36.474 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:36.474 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:36.475 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2216 2024-05-07T14:03:36.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.475 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:36.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:36.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468107+0000", 2024-05-07T14:03:36.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5980000000000001e-06 2024-05-07T14:03:36.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.476 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.476 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471311+0000", 2024-05-07T14:03:36.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003203811 2024-05-07T14:03:36.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471360+0000", 2024-05-07T14:03:36.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9100000000000001e-05 2024-05-07T14:03:36.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471383+0000", 2024-05-07T14:03:36.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3289e-05 2024-05-07T14:03:36.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471551+0000", 2024-05-07T14:03:36.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167295 2024-05-07T14:03:36.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471932+0000", 2024-05-07T14:03:36.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038136799999999998 2024-05-07T14:03:36.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:36.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472296+0000", 2024-05-07T14:03:36.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036396200000000001 2024-05-07T14:03:36.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:36.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.481648+0000", 2024-05-07T14:03:36.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093518209999999997 2024-05-07T14:03:36.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:36.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485379+0000", 2024-05-07T14:03:36.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037311919999999999 2024-05-07T14:03:36.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485533+0000", 2024-05-07T14:03:36.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015429500000000001 2024-05-07T14:03:36.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485602+0000", 2024-05-07T14:03:36.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8998999999999994e-05 2024-05-07T14:03:36.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.481 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.481 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2217 3.0 e84/21 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:36.481 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:36.481 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.909298839000002, 2024-05-07T14:03:36.482 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016624692, 2024-05-07T14:03:36.482 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.482 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.482 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.482 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.482 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.482 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:36.482 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:36.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493322+0000", 2024-05-07T14:03:36.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7290000000000001e-06 2024-05-07T14:03:36.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496239+0000", 2024-05-07T14:03:36.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029177949999999999 2024-05-07T14:03:36.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496292+0000", 2024-05-07T14:03:36.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2769999999999998e-05 2024-05-07T14:03:36.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496318+0000", 2024-05-07T14:03:36.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6313e-05 2024-05-07T14:03:36.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496471+0000", 2024-05-07T14:03:36.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015206799999999999 2024-05-07T14:03:36.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496540+0000", 2024-05-07T14:03:36.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9598999999999996e-05 2024-05-07T14:03:36.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509870+0000", 2024-05-07T14:03:36.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013330322 2024-05-07T14:03:36.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509945+0000", 2024-05-07T14:03:36.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4096000000000003e-05 2024-05-07T14:03:36.487 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.488 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.488 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.488 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2226 3.4 e84/21 3:20f3de0c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_25:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:36.488 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.625448+0000", 2024-05-07T14:03:36.488 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.777171023000001, 2024-05-07T14:03:36.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010656673, 2024-05-07T14:03:36.489 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.489 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.489 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.489 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625448+0000", 2024-05-07T14:03:36.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625448+0000", 2024-05-07T14:03:36.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625450+0000", 2024-05-07T14:03:36.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8780000000000001e-06 2024-05-07T14:03:36.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.626982+0000", 2024-05-07T14:03:36.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015321359999999999 2024-05-07T14:03:36.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.627007+0000", 2024-05-07T14:03:36.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4949000000000001e-05 2024-05-07T14:03:36.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.627019+0000", 2024-05-07T14:03:36.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2703e-05 2024-05-07T14:03:36.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.627122+0000", 2024-05-07T14:03:36.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010307 2024-05-07T14:03:36.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.627145+0000", 2024-05-07T14:03:36.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2875e-05 2024-05-07T14:03:36.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636031+0000", 2024-05-07T14:03:36.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088859860000000002 2024-05-07T14:03:36.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636104+0000", 2024-05-07T14:03:36.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3076000000000003e-05 2024-05-07T14:03:36.495 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.495 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.495 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.495 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2231 3.2e 3:767c3375:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:36.495 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.681942+0000", 2024-05-07T14:03:36.495 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.720676525999998, 2024-05-07T14:03:36.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015025999, 2024-05-07T14:03:36.495 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.495 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.496 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.496 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:36.496 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:36.496 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:36.496 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2231 2024-05-07T14:03:36.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.496 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.681942+0000", 2024-05-07T14:03:36.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.681942+0000", 2024-05-07T14:03:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.681945+0000", 2024-05-07T14:03:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0630000000000002e-06 2024-05-07T14:03:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683651+0000", 2024-05-07T14:03:36.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001705694 2024-05-07T14:03:36.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683682+0000", 2024-05-07T14:03:36.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1288000000000003e-05 2024-05-07T14:03:36.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683700+0000", 2024-05-07T14:03:36.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7756000000000001e-05 2024-05-07T14:03:36.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683790+0000", 2024-05-07T14:03:36.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9573000000000005e-05 2024-05-07T14:03:36.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683956+0000", 2024-05-07T14:03:36.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016630400000000001 2024-05-07T14:03:36.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:36.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684044+0000", 2024-05-07T14:03:36.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8369999999999996e-05 2024-05-07T14:03:36.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:36.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.688963+0000", 2024-05-07T14:03:36.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049188510000000001 2024-05-07T14:03:36.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:36.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.696874+0000", 2024-05-07T14:03:36.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0079104099999999997 2024-05-07T14:03:36.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.696918+0000", 2024-05-07T14:03:36.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4456000000000003e-05 2024-05-07T14:03:36.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.696968+0000", 2024-05-07T14:03:36.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0234e-05 2024-05-07T14:03:36.501 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.502 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.502 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.502 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2238 3.2e 3:76550f67:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:36.502 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.757297+0000", 2024-05-07T14:03:36.502 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.645321441999997, 2024-05-07T14:03:36.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01394517, 2024-05-07T14:03:36.502 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.502 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.502 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.502 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:36.503 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:36.503 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:36.503 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2238 2024-05-07T14:03:36.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.503 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.757297+0000", 2024-05-07T14:03:36.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.757297+0000", 2024-05-07T14:03:36.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.757299+0000", 2024-05-07T14:03:36.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1220000000000002e-06 2024-05-07T14:03:36.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759025+0000", 2024-05-07T14:03:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017252120000000001 2024-05-07T14:03:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759047+0000", 2024-05-07T14:03:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2796e-05 2024-05-07T14:03:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759060+0000", 2024-05-07T14:03:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3033e-05 2024-05-07T14:03:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759135+0000", 2024-05-07T14:03:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4141999999999996e-05 2024-05-07T14:03:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759245+0000", 2024-05-07T14:03:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000110404 2024-05-07T14:03:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:36.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759381+0000", 2024-05-07T14:03:36.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013557599999999999 2024-05-07T14:03:36.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:36.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.765117+0000", 2024-05-07T14:03:36.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057365130000000004 2024-05-07T14:03:36.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:36.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.771109+0000", 2024-05-07T14:03:36.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005992191 2024-05-07T14:03:36.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.771185+0000", 2024-05-07T14:03:36.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5972999999999999e-05 2024-05-07T14:03:36.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.771242+0000", 2024-05-07T14:03:36.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7207999999999998e-05 2024-05-07T14:03:36.509 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.509 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.509 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.509 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5862.0:56 7.14 e85/29 7:2b04a3e9:::notify.6:head v 85'90, mlcod=82'88)", 2024-05-07T14:03:36.509 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.263489+0000", 2024-05-07T14:03:36.509 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.13912938, 2024-05-07T14:03:36.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056112230000000003, 2024-05-07T14:03:36.509 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.509 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.509 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.510 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263489+0000", 2024-05-07T14:03:36.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263489+0000", 2024-05-07T14:03:36.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263490+0000", 2024-05-07T14:03:36.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4099999999999999e-07 2024-05-07T14:03:36.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263493+0000", 2024-05-07T14:03:36.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0340000000000001e-06 2024-05-07T14:03:36.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263499+0000", 2024-05-07T14:03:36.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2269999999999998e-06 2024-05-07T14:03:36.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263504+0000", 2024-05-07T14:03:36.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8010000000000003e-06 2024-05-07T14:03:36.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263682+0000", 2024-05-07T14:03:36.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017840999999999999 2024-05-07T14:03:36.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263701+0000", 2024-05-07T14:03:36.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8870999999999999e-05 2024-05-07T14:03:36.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269073+0000", 2024-05-07T14:03:36.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053717490000000003 2024-05-07T14:03:36.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.514 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.514 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269101+0000", 2024-05-07T14:03:36.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7690000000000001e-05 2024-05-07T14:03:36.514 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.514 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.514 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.514 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "pg_update_log_missing(7.15 epoch 87/86 rep_tid 394 entries 87'93 (0'0) error 7:a93a5511:::notify.2:head by client.4464.0:2500 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 85'91)", 2024-05-07T14:03:36.514 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.438458+0000", 2024-05-07T14:03:36.514 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.964161151999999, 2024-05-07T14:03:36.515 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010184736, 2024-05-07T14:03:36.515 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.515 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.515 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:36.515 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.515 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438458+0000", 2024-05-07T14:03:36.515 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438458+0000", 2024-05-07T14:03:36.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438458+0000", 2024-05-07T14:03:36.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9999999999999997e-07 2024-05-07T14:03:36.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438473+0000", 2024-05-07T14:03:36.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.526e-05 2024-05-07T14:03:36.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438512+0000", 2024-05-07T14:03:36.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8915999999999998e-05 2024-05-07T14:03:36.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438552+0000", 2024-05-07T14:03:36.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0105999999999999e-05 2024-05-07T14:03:36.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438686+0000", 2024-05-07T14:03:36.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000133425 2024-05-07T14:03:36.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.448642+0000", 2024-05-07T14:03:36.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099564289999999993 2024-05-07T14:03:36.519 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.519 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.519 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.520 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2554 4.1c 4:3adf8491:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:36.520 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.470670+0000", 2024-05-07T14:03:36.520 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.93194823, 2024-05-07T14:03:36.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051087750000000003, 2024-05-07T14:03:36.520 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:36.520 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:36.520 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:36.520 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:36.520 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:36.521 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:36.521 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2554 2024-05-07T14:03:36.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.521 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:36.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.521 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:36.521 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470670+0000", 2024-05-07T14:03:36.521 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:36.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470670+0000", 2024-05-07T14:03:36.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:36.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:36.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470672+0000", 2024-05-07T14:03:36.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9180000000000001e-06 2024-05-07T14:03:36.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:36.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470679+0000", 2024-05-07T14:03:36.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9249999999999998e-06 2024-05-07T14:03:36.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:36.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470695+0000", 2024-05-07T14:03:36.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6053e-05 2024-05-07T14:03:36.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:36.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470706+0000", 2024-05-07T14:03:36.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0348e-05 2024-05-07T14:03:36.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:36.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470793+0000", 2024-05-07T14:03:36.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7445e-05 2024-05-07T14:03:36.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:36.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470883+0000", 2024-05-07T14:03:36.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9375000000000004e-05 2024-05-07T14:03:36.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.526 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:36.526 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.471014+0000", 2024-05-07T14:03:36.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130949 2024-05-07T14:03:36.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.526 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:36.526 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.474465+0000", 2024-05-07T14:03:36.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034512089999999998 2024-05-07T14:03:36.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:36.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475655+0000", 2024-05-07T14:03:36.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001190305 2024-05-07T14:03:36.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:36.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475722+0000", 2024-05-07T14:03:36.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.7439000000000003e-05 2024-05-07T14:03:36.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:36.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:36.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:36.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475779+0000", 2024-05-07T14:03:36.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6808999999999998e-05 2024-05-07T14:03:36.529 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.529 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.529 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.529 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:36.529 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:36.529 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:36.530 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-07T14:03:36.530 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-07T14:03:36.530 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:03:36.532 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:36.540+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:36.533 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:36.597 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:03:36.632 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:36.640+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:36.732 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:36.732 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:36.732 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:36.744+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:36.751 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:36.751 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:36.763 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:36.764 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:36.769 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:36.769 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:36.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:36.785 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:36.786 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:36.808 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:36.808 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:36.828 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:36.828 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:36.833 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:36.843+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:36.849 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:36.849 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:36.883 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:36.884 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:36.892 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:36.893 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:36.907 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:36.934 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:36.944+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:37.035 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:37.044+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:37.064 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:37.064 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:37.075 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:37.136 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:37.148+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:37.206 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:37.206 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:37.220 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:37.267 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:37.276+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:37.337 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:37.347+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:37.391 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:37.391 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:37.405 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:37.438 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:37.447+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:37.524 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:37.524 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:37.538 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:37.539 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:37.548+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:37.602 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.0 to 1 (10000) 2024-05-07T14:03:37.608 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:03:37.632 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-07T14:03:37.638 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:37.648+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:37.702 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:37.703 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:37.717 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:37.739 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:37.747+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:37.840 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:37.852+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:37.883 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:37.883 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:37.897 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:03:37.941 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:37.952+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:38.041 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:38.051+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:38.063 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:38.063 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:38.079 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:03:38.142 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:38.151+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:38.204 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:38.204 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:38.218 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:03:38.243 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:38.251+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:38.341 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:38.341 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:38.344 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:38.356+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:38.355 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:03:38.445 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:38.456+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:38.518 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:38.519 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:38.532 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:03:38.546 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:38.555+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:38.636 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.1 to 1 (10000) 2024-05-07T14:03:38.647 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:38.656+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:38.672 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-07T14:03:38.702 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:38.702 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:38.716 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:03:38.760 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:38.771+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:38.848 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:38.860+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:38.884 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:38.884 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:38.899 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:38.909 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:03:38.953 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:38.963+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:39.047 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:39.048 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:39.058 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:39.067+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:39.064 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:39.064 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:39.065 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:39.065 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:39.077 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:39.081 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:39.082 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:39.098 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:39.099 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:39.117 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:39.117 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:39.137 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:39.137 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:39.151 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:39.159+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:39.157 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:39.157 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:39.177 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:39.178 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:39.194 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:39.195 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:39.195 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:39.195 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:39.208 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:39.252 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:39.264+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:39.353 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:39.364+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:39.372 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:39.372 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:39.372 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:39.372 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:39.372 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:39.387 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:39.455 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:39.464+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:39.525 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:39.525 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:39.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:39.525 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:39.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.526 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:139 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'97, mlcod=17'93)", 2024-05-07T14:03:39.526 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:39.526 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 173.224104469, 2024-05-07T14:03:39.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052146429999999997, 2024-05-07T14:03:39.526 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.526 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.526 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.527 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:39.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311570+0000", 2024-05-07T14:03:39.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311571+0000", 2024-05-07T14:03:39.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4130000000000001e-06 2024-05-07T14:03:39.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311584+0000", 2024-05-07T14:03:39.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2794e-05 2024-05-07T14:03:39.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311608+0000", 2024-05-07T14:03:39.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4032999999999998e-05 2024-05-07T14:03:39.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311629+0000", 2024-05-07T14:03:39.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0389000000000001e-05 2024-05-07T14:03:39.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311747+0000", 2024-05-07T14:03:39.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118746 2024-05-07T14:03:39.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.311780+0000", 2024-05-07T14:03:39.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2610000000000001e-05 2024-05-07T14:03:39.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316694+0000", 2024-05-07T14:03:39.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049143119999999997 2024-05-07T14:03:39.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.316785+0000", 2024-05-07T14:03:39.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0346000000000005e-05 2024-05-07T14:03:39.531 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.532 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.532 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.532 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:03:39.532 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:39.532 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 173.22319807299999, 2024-05-07T14:03:39.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:03:39.532 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.533 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.533 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.533 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:39.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.534 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:39.534 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.534 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.534 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:03:39.534 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:03:39.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.535 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:03:39.535 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:03:39.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:03:39.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:03:39.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:03:39.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:03:39.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:03:39.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:03:39.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:03:39.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:03:39.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:03:39.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:03:39.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.538 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:03:39.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:03:39.538 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.538 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.538 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.539 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:03:39.539 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:39.539 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 173.22178545400001, 2024-05-07T14:03:39.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:03:39.539 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.539 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.539 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:03:39.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.541 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:03:39.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:03:39.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:03:39.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:03:39.543 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.543 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.543 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.543 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:39.543 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 152.39611497199999, 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:03:39.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:03:39.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 152.36300431399999, 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:03:39.549 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:03:39.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:03:39.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:03:39.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:03:39.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:03:39.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:39.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.554 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1477 3.18 e80/21 3:1a16f065:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_1:head v 80'1, mlcod=0'0)", 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.247851056000002, 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014861011, 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.555 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287825+0000", 2024-05-07T14:03:39.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290411+0000", 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025854430000000002 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290433+0000", 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.264e-05 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290443+0000", 2024-05-07T14:03:39.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7189999999999996e-06 2024-05-07T14:03:39.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290521+0000", 2024-05-07T14:03:39.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8164000000000006e-05 2024-05-07T14:03:39.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290546+0000", 2024-05-07T14:03:39.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4533e-05 2024-05-07T14:03:39.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.559 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.559 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302655+0000", 2024-05-07T14:03:39.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012108898999999999 2024-05-07T14:03:39.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.560 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302684+0000", 2024-05-07T14:03:39.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9624e-05 2024-05-07T14:03:39.560 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.560 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.560 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.560 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1478 3.12 3:4bdcf7a4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:39.560 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:39.560 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.246411217000002, 2024-05-07T14:03:39.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013141795, 2024-05-07T14:03:39.561 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.561 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.561 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.561 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:39.561 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:39.561 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:39.561 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1478 2024-05-07T14:03:39.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.562 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:39.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:39.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289265+0000", 2024-05-07T14:03:39.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.001e-06 2024-05-07T14:03:39.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290501+0000", 2024-05-07T14:03:39.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001235487 2024-05-07T14:03:39.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290514+0000", 2024-05-07T14:03:39.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.358e-05 2024-05-07T14:03:39.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290521+0000", 2024-05-07T14:03:39.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8889999999999996e-06 2024-05-07T14:03:39.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290588+0000", 2024-05-07T14:03:39.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.7218000000000006e-05 2024-05-07T14:03:39.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.566 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290762+0000", 2024-05-07T14:03:39.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017409200000000001 2024-05-07T14:03:39.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.566 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:39.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290904+0000", 2024-05-07T14:03:39.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000141963 2024-05-07T14:03:39.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:39.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.301956+0000", 2024-05-07T14:03:39.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011051640999999999 2024-05-07T14:03:39.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:39.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302315+0000", 2024-05-07T14:03:39.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000358876 2024-05-07T14:03:39.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302353+0000", 2024-05-07T14:03:39.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8003999999999997e-05 2024-05-07T14:03:39.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302405+0000", 2024-05-07T14:03:39.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2043999999999998e-05 2024-05-07T14:03:39.568 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.568 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.569 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.569 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1481 4.b 4:d1744c9b:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.0:head [stat,call rgw.guard_bucket_resharding in=26b,call rgw.bucket_complete_op in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:39.569 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:39.569 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.201985284999999, 2024-05-07T14:03:39.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099753589999999996, 2024-05-07T14:03:39.569 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.569 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.570 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.570 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:39.570 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:39.570 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:39.570 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1481 2024-05-07T14:03:39.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.570 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:39.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:39.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333691+0000", 2024-05-07T14:03:39.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8920000000000001e-06 2024-05-07T14:03:39.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333699+0000", 2024-05-07T14:03:39.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1089999999999998e-06 2024-05-07T14:03:39.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333715+0000", 2024-05-07T14:03:39.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6260999999999999e-05 2024-05-07T14:03:39.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333723+0000", 2024-05-07T14:03:39.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1579999999999999e-06 2024-05-07T14:03:39.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333800+0000", 2024-05-07T14:03:39.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7000000000000001e-05 2024-05-07T14:03:39.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:39.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333807+0000", 2024-05-07T14:03:39.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.498e-06 2024-05-07T14:03:39.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339421+0000", 2024-05-07T14:03:39.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056137909999999999 2024-05-07T14:03:39.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339536+0000", 2024-05-07T14:03:39.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115297 2024-05-07T14:03:39.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:39.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339894+0000", 2024-05-07T14:03:39.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035790799999999999 2024-05-07T14:03:39.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:39.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343340+0000", 2024-05-07T14:03:39.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034459120000000002 2024-05-07T14:03:39.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:39.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343547+0000", 2024-05-07T14:03:39.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020692799999999999 2024-05-07T14:03:39.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343613+0000", 2024-05-07T14:03:39.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6166000000000003e-05 2024-05-07T14:03:39.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343664+0000", 2024-05-07T14:03:39.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1439e-05 2024-05-07T14:03:39.579 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.579 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.579 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.579 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1611 3.30 e81/21 3:0c405120:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_1:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:39.580 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:39.580 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.109530526, 2024-05-07T14:03:39.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013061969999999999, 2024-05-07T14:03:39.580 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.580 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.580 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.580 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:39.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:39.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426145+0000", 2024-05-07T14:03:39.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5990000000000001e-06 2024-05-07T14:03:39.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.433982+0000", 2024-05-07T14:03:39.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078361190000000008 2024-05-07T14:03:39.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434000+0000", 2024-05-07T14:03:39.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.806e-05 2024-05-07T14:03:39.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434011+0000", 2024-05-07T14:03:39.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1615e-05 2024-05-07T14:03:39.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434085+0000", 2024-05-07T14:03:39.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3819000000000006e-05 2024-05-07T14:03:39.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434100+0000", 2024-05-07T14:03:39.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4973999999999999e-05 2024-05-07T14:03:39.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.439168+0000", 2024-05-07T14:03:39.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050674350000000003 2024-05-07T14:03:39.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.585 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.439206+0000", 2024-05-07T14:03:39.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8349000000000002e-05 2024-05-07T14:03:39.585 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.585 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.585 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.586 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1612 3.3 e81/21 3:c1191b65:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_2:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:39.586 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:39.586 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.107895478000003, 2024-05-07T14:03:39.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086703990000000005, 2024-05-07T14:03:39.586 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.586 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.586 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.586 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:39.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:39.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427780+0000", 2024-05-07T14:03:39.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1699999999999997e-07 2024-05-07T14:03:39.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431380+0000", 2024-05-07T14:03:39.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600378 2024-05-07T14:03:39.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431413+0000", 2024-05-07T14:03:39.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3056000000000003e-05 2024-05-07T14:03:39.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431430+0000", 2024-05-07T14:03:39.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6986999999999998e-05 2024-05-07T14:03:39.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431508+0000", 2024-05-07T14:03:39.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8177999999999996e-05 2024-05-07T14:03:39.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431526+0000", 2024-05-07T14:03:39.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7333000000000002e-05 2024-05-07T14:03:39.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.436392+0000", 2024-05-07T14:03:39.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0048665100000000001 2024-05-07T14:03:39.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.436449+0000", 2024-05-07T14:03:39.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7040000000000003e-05 2024-05-07T14:03:39.591 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.591 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.591 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.591 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1915 4.1e 4:7a3b9b37:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:39.591 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:39.591 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.139440364999999, 2024-05-07T14:03:39.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051237260000000003, 2024-05-07T14:03:39.592 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.592 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.592 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.592 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:39.592 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:39.592 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:39.592 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1915 2024-05-07T14:03:39.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.592 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:39.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396234+0000", 2024-05-07T14:03:39.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396235+0000", 2024-05-07T14:03:39.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.33e-06 2024-05-07T14:03:39.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396241+0000", 2024-05-07T14:03:39.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.699e-06 2024-05-07T14:03:39.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396257+0000", 2024-05-07T14:03:39.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5432000000000001e-05 2024-05-07T14:03:39.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396265+0000", 2024-05-07T14:03:39.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6009999999999995e-06 2024-05-07T14:03:39.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396336+0000", 2024-05-07T14:03:39.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1045999999999997e-05 2024-05-07T14:03:39.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396431+0000", 2024-05-07T14:03:39.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5126999999999999e-05 2024-05-07T14:03:39.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:39.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396547+0000", 2024-05-07T14:03:39.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115339 2024-05-07T14:03:39.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:39.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397910+0000", 2024-05-07T14:03:39.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013629720000000001 2024-05-07T14:03:39.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:39.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401294+0000", 2024-05-07T14:03:39.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003384504 2024-05-07T14:03:39.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401329+0000", 2024-05-07T14:03:39.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5179000000000003e-05 2024-05-07T14:03:39.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.401358+0000", 2024-05-07T14:03:39.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8496999999999998e-05 2024-05-07T14:03:39.599 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.599 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.599 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.599 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2208 3.3a e84/21 3:5ee07aff:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_7:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:39.599 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:39.599 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.182459940999998, 2024-05-07T14:03:39.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017943191000000001, 2024-05-07T14:03:39.600 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.600 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.600 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.600 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:39.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:39.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353217+0000", 2024-05-07T14:03:39.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3920000000000001e-06 2024-05-07T14:03:39.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363741+0000", 2024-05-07T14:03:39.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010524586000000001 2024-05-07T14:03:39.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363773+0000", 2024-05-07T14:03:39.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362000000000002e-05 2024-05-07T14:03:39.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363793+0000", 2024-05-07T14:03:39.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9743999999999999e-05 2024-05-07T14:03:39.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363870+0000", 2024-05-07T14:03:39.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7610999999999999e-05 2024-05-07T14:03:39.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363888+0000", 2024-05-07T14:03:39.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.785e-05 2024-05-07T14:03:39.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.371098+0000", 2024-05-07T14:03:39.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072103100000000002 2024-05-07T14:03:39.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.371158+0000", 2024-05-07T14:03:39.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9336000000000002e-05 2024-05-07T14:03:39.604 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2219 3.32 3:4d615ce3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.010657610999999, 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016879689999999999, 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:39.605 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:39.606 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2219 2024-05-07T14:03:39.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.606 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:39.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:39.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525020+0000", 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.751e-06 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528212+0000", 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031922080000000002 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528240+0000", 2024-05-07T14:03:39.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7911000000000001e-05 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528254+0000", 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4457999999999999e-05 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528333+0000", 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9136999999999998e-05 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528460+0000", 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012715799999999999 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528572+0000", 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011162099999999999 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541359+0000", 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012787023 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:39.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541810+0000", 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045134299999999999 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541859+0000", 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8934999999999998e-05 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541896+0000", 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7144999999999998e-05 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.610 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2225 3.1f 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.936927853, 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020378113, 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2225 2024-05-07T14:03:39.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598750+0000", 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8859999999999997e-06 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602351+0000", 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600195 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602470+0000", 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119608 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602494+0000", 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.376e-05 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602590+0000", 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6399999999999999e-05 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602740+0000", 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014951 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:39.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602884+0000", 2024-05-07T14:03:39.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000143616 2024-05-07T14:03:39.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:39.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618629+0000", 2024-05-07T14:03:39.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015745420999999999 2024-05-07T14:03:39.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619008+0000", 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037870699999999999 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619069+0000", 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1617000000000003e-05 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619125+0000", 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5393000000000003e-05 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.616 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2227 3.1b 3:d8b15ce8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.895141611, 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017300908, 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:39.617 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2227 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640536+0000", 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9809999999999999e-06 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643182+0000", 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026464769999999999 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643207+0000", 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5077999999999999e-05 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643220+0000", 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2866e-05 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643329+0000", 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108467 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643499+0000", 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017020199999999999 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643652+0000", 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152993 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.648361+0000", 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0047089530000000001 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657709+0000", 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093483360000000005 2024-05-07T14:03:39.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657779+0000", 2024-05-07T14:03:39.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9375999999999994e-05 2024-05-07T14:03:39.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657834+0000", 2024-05-07T14:03:39.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5179000000000001e-05 2024-05-07T14:03:39.622 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.622 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.622 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2228 3.b e84/21 3:d3d17a37:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_27:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.883183053000003, 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093032859999999992, 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652493+0000", 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7269999999999999e-06 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653476+0000", 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098271300000000008 2024-05-07T14:03:39.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653501+0000", 2024-05-07T14:03:39.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5012e-05 2024-05-07T14:03:39.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653511+0000", 2024-05-07T14:03:39.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0009e-05 2024-05-07T14:03:39.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653607+0000", 2024-05-07T14:03:39.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5975000000000002e-05 2024-05-07T14:03:39.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653635+0000", 2024-05-07T14:03:39.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8010000000000001e-05 2024-05-07T14:03:39.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661728+0000", 2024-05-07T14:03:39.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080929339999999995 2024-05-07T14:03:39.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661795+0000", 2024-05-07T14:03:39.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6905999999999999e-05 2024-05-07T14:03:39.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.627 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.627 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2229 3.3 e84/21 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.870716811000001, 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022534413, 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664960+0000", 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0109999999999999e-06 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670334+0000", 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005374635 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3374999999999998e-05 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670385+0000", 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7512000000000001e-05 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670515+0000", 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012940900000000001 2024-05-07T14:03:39.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670543+0000", 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8157000000000002e-05 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687374+0000", 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016831793000000001 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687492+0000", 2024-05-07T14:03:39.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117521 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2230 3.b e84/21 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.860711639999998, 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016432748, 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674964+0000", 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5409999999999999e-06 2024-05-07T14:03:39.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677117+0000", 2024-05-07T14:03:39.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002153154 2024-05-07T14:03:39.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677136+0000", 2024-05-07T14:03:39.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8691000000000001e-05 2024-05-07T14:03:39.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677148+0000", 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2291e-05 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677217+0000", 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8880000000000005e-05 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677249+0000", 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1664e-05 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:39.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691337+0000", 2024-05-07T14:03:39.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014087926000000001 2024-05-07T14:03:39.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691396+0000", 2024-05-07T14:03:39.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8600999999999997e-05 2024-05-07T14:03:39.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.636 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.636 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2497 7.9 7:93e5b521:::notify.7:head [watch reconnect cookie 94397682177536 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.140733390000001, 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0512951690000001, 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2497 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394942+0000", 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9100000000000002e-07 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394946+0000", 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2239999999999997e-06 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394960+0000", 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3419e-05 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394966+0000", 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3620000000000002e-06 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395019+0000", 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3099000000000001e-05 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395023+0000", 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0879999999999997e-06 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400981+0000", 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059580520000000001 2024-05-07T14:03:39.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400990+0000", 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0880000000000001e-06 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438550+0000", 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.037559288 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.439512+0000", 2024-05-07T14:03:39.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000962154 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442920+0000", 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034085109999999999 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442966+0000", 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5509000000000001e-05 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.446236+0000", 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032704840000000002 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "MOSDPGPushReply(3.3e 87/86 [PushReplyOp(3:7fbbdcd7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_108:head)])", 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.075180619000001, 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055859079999999997, 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:39.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460495+0000", 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4499999999999996e-07 2024-05-07T14:03:39.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460501+0000", 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.212e-06 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460514+0000", 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3183000000000001e-05 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460523+0000", 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4450000000000002e-06 2024-05-07T14:03:39.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:39.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460615+0000", 2024-05-07T14:03:39.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1693000000000005e-05 2024-05-07T14:03:39.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:39.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:39.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:39.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.466080+0000", 2024-05-07T14:03:39.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054645300000000004 2024-05-07T14:03:39.646 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.646 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.646 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.646 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:39.647 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:39.647 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:39.647 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:03:39.649 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:39.649 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.2 to 1 (10000) 2024-05-07T14:03:39.653 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:39.659+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:39.661 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-07T14:03:39.750 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:39.764+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:39.806 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:39.806 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:39.806 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:39.806 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:39.827 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:39.872 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:39.883+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:39.942 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:39.942 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:39.942 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:39.943 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:39.943 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:39.951 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:39.964+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:39.955 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:40.052 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:40.059+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:40.109 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:40.109 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:40.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:40.109 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:40.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.109 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:03:40.109 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:40.109 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 160.13512981400001, 2024-05-07T14:03:40.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:03:40.110 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.110 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.110 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:40.110 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.110 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:03:40.110 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:03:40.110 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:03:40.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.111 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:40.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:40.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:03:40.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:03:40.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:03:40.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:03:40.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:03:40.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:03:40.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:03:40.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:03:40.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:03:40.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:03:40.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:03:40.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:349 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 152.95202652200001, 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049804460000000004, 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.116 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.117 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.117 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 349 2024-05-07T14:03:40.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.117 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:03:40.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168056+0000", 2024-05-07T14:03:40.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168057+0000", 2024-05-07T14:03:40.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.142e-06 2024-05-07T14:03:40.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168063+0000", 2024-05-07T14:03:40.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8499999999999999e-06 2024-05-07T14:03:40.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168075+0000", 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2585999999999999e-05 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168082+0000", 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.827e-06 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168148+0000", 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5685000000000006e-05 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168209+0000", 2024-05-07T14:03:40.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0773000000000002e-05 2024-05-07T14:03:40.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:40.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168337+0000", 2024-05-07T14:03:40.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012855899999999999 2024-05-07T14:03:40.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.168955+0000", 2024-05-07T14:03:40.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000617239 2024-05-07T14:03:40.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172972+0000", 2024-05-07T14:03:40.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040177529999999998 2024-05-07T14:03:40.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173007+0000", 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5139999999999999e-05 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173036+0000", 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8892000000000001e-05 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:565 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 152.81640655300001, 2024-05-07T14:03:40.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046245679999999999, 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 565 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303676+0000", 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303677+0000", 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1519999999999999e-06 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303684+0000", 2024-05-07T14:03:40.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5200000000000003e-06 2024-05-07T14:03:40.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303698+0000", 2024-05-07T14:03:40.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4357e-05 2024-05-07T14:03:40.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303707+0000", 2024-05-07T14:03:40.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2199999999999998e-06 2024-05-07T14:03:40.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303779+0000", 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1684e-05 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303830+0000", 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0949000000000003e-05 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.303950+0000", 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012075599999999999 2024-05-07T14:03:40.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.305681+0000", 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001730005 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308233+0000", 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025527530000000001 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308267+0000", 2024-05-07T14:03:40.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4090000000000001e-05 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.308300+0000", 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3081999999999999e-05 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1571 4.24 4:26e499bb:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.447233412000003, 2024-05-07T14:03:40.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063870100000000003, 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1571 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672849+0000", 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2800000000000002e-07 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672852+0000", 2024-05-07T14:03:40.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6599999999999999e-06 2024-05-07T14:03:40.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672866+0000", 2024-05-07T14:03:40.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3648999999999999e-05 2024-05-07T14:03:40.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672871+0000", 2024-05-07T14:03:40.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7039999999999999e-06 2024-05-07T14:03:40.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.672926+0000", 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4299999999999998e-05 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673007+0000", 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1429999999999998e-05 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673097+0000", 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0272000000000006e-05 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.673822+0000", 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00072425300000000001 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679164+0000", 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005341943 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679209+0000", 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5738000000000002e-05 2024-05-07T14:03:40.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.679236+0000", 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6633000000000001e-05 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1578 4.27 4:e7c87c96:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.222771272000003, 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046530510000000001, 2024-05-07T14:03:40.135 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1578 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897311+0000", 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897314+0000", 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7250000000000002e-06 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897328+0000", 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4e-05 2024-05-07T14:03:40.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897352+0000", 2024-05-07T14:03:40.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4576999999999999e-05 2024-05-07T14:03:40.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897366+0000", 2024-05-07T14:03:40.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3173000000000001e-05 2024-05-07T14:03:40.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897473+0000", 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010762100000000001 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897601+0000", 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012757099999999999 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897754+0000", 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152807 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900001+0000", 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002247686 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901868+0000", 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018669940000000001 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901924+0000", 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5383999999999997e-05 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.901964+0000", 2024-05-07T14:03:40.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0513000000000003e-05 2024-05-07T14:03:40.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.141 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.141 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1582 4.27 4:e6cd56b0:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:40.141 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:03:40.141 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.222624920000001, 2024-05-07T14:03:40.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046596959999999996, 2024-05-07T14:03:40.141 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.141 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1582 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897457+0000", 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897458+0000", 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5700000000000002e-07 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897462+0000", 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0690000000000003e-06 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897469+0000", 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0079999999999996e-06 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.897474+0000", 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9420000000000003e-06 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898643+0000", 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0011688709999999999 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898756+0000", 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113522 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.898961+0000", 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020425799999999999 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.900212+0000", 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012512860000000001 2024-05-07T14:03:40.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902014+0000", 2024-05-07T14:03:40.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018024029999999999 2024-05-07T14:03:40.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902075+0000", 2024-05-07T14:03:40.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0509e-05 2024-05-07T14:03:40.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.902117+0000", 2024-05-07T14:03:40.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2271000000000002e-05 2024-05-07T14:03:40.147 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.147 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.147 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.147 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:49 7.15 e81/29 7:a93a5511:::notify.2:head v 81'49, mlcod=81'47)", 2024-05-07T14:03:40.147 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:03:40.147 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.969102810000003, 2024-05-07T14:03:40.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0070782700000000002, 2024-05-07T14:03:40.147 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150980+0000", 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150981+0000", 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2899999999999999e-06 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.150990+0000", 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3959999999999995e-06 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151011+0000", 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.105e-05 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151023+0000", 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623e-05 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151122+0000", 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9351999999999993e-05 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.151155+0000", 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2459000000000002e-05 2024-05-07T14:03:40.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158027+0000", 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.006871785 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158058+0000", 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1315000000000001e-05 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.151 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5165.0:52 7.d e81/29 7:b4812045:::notify.4:head v 81'48, mlcod=81'46)", 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.966656397999998, 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0048232429999999996, 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153426+0000", 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153427+0000", 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6499999999999999e-07 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153432+0000", 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9579999999999998e-06 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153441+0000", 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.662e-06 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153446+0000", 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7530000000000001e-06 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153492+0000", 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5853999999999998e-05 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.153505+0000", 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3288000000000001e-05 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158230+0000", 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0047249170000000004 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.158249+0000", 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9145999999999999e-05 2024-05-07T14:03:40.155 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.156 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.156 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.156 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2202 3.0 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:40.156 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:40.156 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.840112435000002, 2024-05-07T14:03:40.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027191908000000001, 2024-05-07T14:03:40.156 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.156 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.156 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.156 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.156 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2202 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279975+0000", 2024-05-07T14:03:40.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0130000000000001e-06 2024-05-07T14:03:40.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285489+0000", 2024-05-07T14:03:40.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055143570000000001 2024-05-07T14:03:40.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285531+0000", 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1504000000000001e-05 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285550+0000", 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9256e-05 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285747+0000", 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196777 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286120+0000", 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037285900000000002 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286489+0000", 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036951099999999999 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301589+0000", 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015099728999999999 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307085+0000", 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054963340000000003 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307127+0000", 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1977999999999997e-05 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307162+0000", 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4589999999999999e-05 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.162 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2212 3.1a e84/21 3:591da10a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_11:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:40.162 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:40.162 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.704944095000002, 2024-05-07T14:03:40.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012581199, 2024-05-07T14:03:40.162 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.162 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.162 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.162 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:40.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:40.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415141+0000", 2024-05-07T14:03:40.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.52e-06 2024-05-07T14:03:40.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421260+0000", 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061196169999999999 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421304+0000", 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3293e-05 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421324+0000", 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0341000000000001e-05 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421401+0000", 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6773999999999994e-05 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421418+0000", 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6827e-05 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.427656+0000", 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0062381010000000002 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.427720+0000", 2024-05-07T14:03:40.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3726000000000006e-05 2024-05-07T14:03:40.166 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.166 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.166 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.166 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2216 3.21 e84/46 3:86b25102:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_15:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:40.166 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:40.166 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.647585182999997, 2024-05-07T14:03:40.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012554667, 2024-05-07T14:03:40.166 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472500+0000", 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6630000000000002e-06 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475359+0000", 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028594409999999999 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475407+0000", 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7868999999999999e-05 2024-05-07T14:03:40.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475431+0000", 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3873999999999999e-05 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475528+0000", 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7163999999999993e-05 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475556+0000", 2024-05-07T14:03:40.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7594999999999999e-05 2024-05-07T14:03:40.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485009+0000", 2024-05-07T14:03:40.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0094531149999999998 2024-05-07T14:03:40.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485052+0000", 2024-05-07T14:03:40.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2945999999999998e-05 2024-05-07T14:03:40.170 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.170 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2217 3.0 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.629785867000002, 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019983529, 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.171 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2217 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490299+0000", 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492337+0000", 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020384489999999999 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492391+0000", 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3702000000000002e-05 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492415+0000", 2024-05-07T14:03:40.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3373000000000001e-05 2024-05-07T14:03:40.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492567+0000", 2024-05-07T14:03:40.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152788 2024-05-07T14:03:40.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492843+0000", 2024-05-07T14:03:40.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027568999999999998 2024-05-07T14:03:40.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:40.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493123+0000", 2024-05-07T14:03:40.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028014899999999999 2024-05-07T14:03:40.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509840+0000", 2024-05-07T14:03:40.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016716871000000001 2024-05-07T14:03:40.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510203+0000", 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036252499999999999 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510250+0000", 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7231000000000002e-05 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510280+0000", 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0270999999999999e-05 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.176 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.177 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.177 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2219 3.32 e84/21 3:4d615ce3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_18:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:40.177 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:40.177 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.591365834999998, 2024-05-07T14:03:40.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012848995, 2024-05-07T14:03:40.177 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.177 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.177 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.177 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528718+0000", 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.86e-06 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531113+0000", 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002394958 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531141+0000", 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7543e-05 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531154+0000", 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3355e-05 2024-05-07T14:03:40.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531232+0000", 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7608000000000006e-05 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531259+0000", 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6656e-05 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541473+0000", 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010214101999999999 2024-05-07T14:03:40.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541566+0000", 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2912999999999996e-05 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2224 3.1a e84/21 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.524842200000002, 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020623257999999998, 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.181 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.182 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.182 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:40.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:40.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595243+0000", 2024-05-07T14:03:40.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6800000000000002e-06 2024-05-07T14:03:40.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.601988+0000", 2024-05-07T14:03:40.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0067452479999999997 2024-05-07T14:03:40.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602044+0000", 2024-05-07T14:03:40.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5884999999999998e-05 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602070+0000", 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6359999999999998e-05 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602183+0000", 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112761 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602210+0000", 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6882000000000001e-05 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615811+0000", 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01360132 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615863+0000", 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2122e-05 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.186 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2225 3.1f e84/46 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:40.186 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:40.186 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.515414343000003, 2024-05-07T14:03:40.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014189089, 2024-05-07T14:03:40.186 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.186 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.186 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.186 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:40.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:40.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604671+0000", 2024-05-07T14:03:40.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6070000000000002e-06 2024-05-07T14:03:40.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607720+0000", 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030496849999999999 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607763+0000", 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3044999999999999e-05 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607787+0000", 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3264e-05 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607878+0000", 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1650000000000005e-05 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607905+0000", 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7090999999999999e-05 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618733+0000", 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010827582000000001 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618857+0000", 2024-05-07T14:03:40.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000124165 2024-05-07T14:03:40.190 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.190 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.190 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.190 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2226 3.4 3:20f3de0c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:40.190 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:40.190 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.498105928999998, 2024-05-07T14:03:40.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014369191, 2024-05-07T14:03:40.190 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.190 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2226 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621979+0000", 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.272e-06 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624873+0000", 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028946390000000001 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624904+0000", 2024-05-07T14:03:40.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0446e-05 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624918+0000", 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4263e-05 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625007+0000", 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8850000000000005e-05 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625174+0000", 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167314 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625327+0000", 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152433 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.633342+0000", 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080152699999999997 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636260+0000", 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029179060000000001 2024-05-07T14:03:40.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636297+0000", 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7543000000000003e-05 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636346+0000", 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8254999999999998e-05 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.195 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2233 3.8 e84/21 3:11b98425:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_32:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.705600+0000", 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.414482575000001, 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011076903000000001, 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705600+0000", 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705600+0000", 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705601+0000", 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.375e-06 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707534+0000", 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019330199999999999 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707561+0000", 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6979999999999999e-05 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707574+0000", 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.328e-05 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707703+0000", 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012801500000000001 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.707729+0000", 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6585999999999999e-05 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716608+0000", 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088793480000000004 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716677+0000", 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8299000000000005e-05 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.199 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2236 3.32 e84/21 3:4d7a89ea:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_35:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.737366+0000", 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.382716297000002, 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01010346, 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.737366+0000", 2024-05-07T14:03:40.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.737366+0000", 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.737368+0000", 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.623e-06 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739037+0000", 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016693109999999999 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739061+0000", 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4280000000000001e-05 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739077+0000", 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5568000000000001e-05 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739194+0000", 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011736899999999999 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.739227+0000", 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2268999999999999e-05 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.747401+0000", 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008174354 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.747470+0000", 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8685999999999999e-05 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2545 8.1 8:84e82796:root::.bucket.meta.buck_2024_04_7_14_02_56%3ac956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9:head [call version.check_conds in=18b,call version.inc in=10b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.464507+0000", 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.655574991999998, 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049738009999999999, 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.204 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.205 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.205 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.205 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2545 2024-05-07T14:03:40.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.205 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464507+0000", 2024-05-07T14:03:40.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.205 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464507+0000", 2024-05-07T14:03:40.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464509+0000", 2024-05-07T14:03:40.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0339999999999999e-06 2024-05-07T14:03:40.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464522+0000", 2024-05-07T14:03:40.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2088e-05 2024-05-07T14:03:40.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464555+0000", 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3317e-05 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464574+0000", 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8885999999999998e-05 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464643+0000", 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9548000000000006e-05 2024-05-07T14:03:40.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464737+0000", 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3839999999999996e-05 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.464953+0000", 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021561200000000001 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.468765+0000", 2024-05-07T14:03:40.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038126850000000001 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.469424+0000", 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00065884699999999995 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.469457+0000", 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3213999999999997e-05 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.469481+0000", 2024-05-07T14:03:40.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3730000000000001e-05 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2558 4.f 4:f3381da8:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.470708+0000", 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.649374811999998, 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050104470000000003, 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.210 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2558 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470708+0000", 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470708+0000", 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470709+0000", 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8479999999999999e-06 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470717+0000", 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.824e-06 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470746+0000", 2024-05-07T14:03:40.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8799999999999999e-05 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470761+0000", 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5366000000000002e-05 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470828+0000", 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6654000000000003e-05 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470917+0000", 2024-05-07T14:03:40.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9178999999999994e-05 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.471014+0000", 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6237999999999996e-05 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.474388+0000", 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033746990000000001 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475630+0000", 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012418139999999999 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475680+0000", 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0118999999999999e-05 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475718+0000", 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7905999999999999e-05 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.215 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.216 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.216 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:40.217 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:40.218 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:40.228+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:40.317 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:40.327+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:40.387 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:40.387 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:40.387 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:40.387 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:40.400 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:40.445 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:40.455+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:40.519 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:40.528+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:40.566 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:40.566 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:40.566 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:40.566 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:40.566 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:40.580 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:40.620 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:40.632+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:40.631 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:03:40.633 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.3 to 1 (10000) 2024-05-07T14:03:40.659 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-07T14:03:40.709 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:40.709 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:40.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:40.709 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:40.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.709 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:553 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:40.709 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:03:40.709 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 153.43003255100001, 2024-05-07T14:03:40.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051571860000000002, 2024-05-07T14:03:40.709 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.710 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.710 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.710 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.710 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.710 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.710 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 553 2024-05-07T14:03:40.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.710 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:03:40.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292266+0000", 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292269+0000", 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7539999999999998e-06 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292282+0000", 2024-05-07T14:03:40.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3626e-05 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292315+0000", 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2502999999999997e-05 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292330+0000", 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5463000000000001e-05 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292418+0000", 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7647999999999998e-05 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292516+0000", 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8018999999999998e-05 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.292722+0000", 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206085 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.294674+0000", 2024-05-07T14:03:40.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019517720000000001 2024-05-07T14:03:40.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297350+0000", 2024-05-07T14:03:40.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026762869999999999 2024-05-07T14:03:40.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297387+0000", 2024-05-07T14:03:40.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7292000000000001e-05 2024-05-07T14:03:40.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.297423+0000", 2024-05-07T14:03:40.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5737e-05 2024-05-07T14:03:40.715 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.715 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.715 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.715 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:790 6.12 e33/27 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 33'6, mlcod=33'4)", 2024-05-07T14:03:40.715 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:03:40.715 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 153.13233254100001, 2024-05-07T14:03:40.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003997815, 2024-05-07T14:03:40.715 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589966+0000", 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589967+0000", 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.589981+0000", 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3593e-05 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590008+0000", 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6546999999999998e-05 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590021+0000", 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3346000000000001e-05 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590129+0000", 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108319 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.590168+0000", 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9063999999999997e-05 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593879+0000", 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037111409999999998 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.593964+0000", 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4159000000000005e-05 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.719 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 152.95237151399999, 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049486679999999998, 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 868 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769927+0000", 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769929+0000", 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1770000000000001e-06 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769941+0000", 2024-05-07T14:03:40.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1756000000000001e-05 2024-05-07T14:03:40.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769969+0000", 2024-05-07T14:03:40.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.83e-05 2024-05-07T14:03:40.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.769984+0000", 2024-05-07T14:03:40.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5082999999999999e-05 2024-05-07T14:03:40.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770119+0000", 2024-05-07T14:03:40.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000134583 2024-05-07T14:03:40.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770347+0000", 2024-05-07T14:03:40.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022845400000000001 2024-05-07T14:03:40.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.770659+0000", 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00031154199999999999 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774145+0000", 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003486336 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774586+0000", 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044120900000000002 2024-05-07T14:03:40.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774746+0000", 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015949900000000001 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.774876+0000", 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129729 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5099.0:56 7.14 e80/29 7:2b04a3e9:::notify.6:head v 80'36, mlcod=80'34)", 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 48.542442502999997, 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046522059999999999, 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179856+0000", 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1399999999999997e-07 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179862+0000", 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4330000000000003e-06 2024-05-07T14:03:40.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179873+0000", 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0838e-05 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179879+0000", 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3099999999999997e-06 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179934+0000", 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4625e-05 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.179955+0000", 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-05 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184469+0000", 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045139150000000003 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.184508+0000", 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9001000000000001e-05 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5117.0:56 7.14 e81/29 7:2b04a3e9:::notify.6:head v 81'39, mlcod=80'37)", 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 48.225846662999999, 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078436700000000005, 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496452+0000", 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.34e-07 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496456+0000", 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5410000000000001e-06 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496463+0000", 2024-05-07T14:03:40.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7689999999999996e-06 2024-05-07T14:03:40.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496468+0000", 2024-05-07T14:03:40.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1969999999999998e-06 2024-05-07T14:03:40.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496518+0000", 2024-05-07T14:03:40.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0793e-05 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496538+0000", 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0000000000000002e-05 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504267+0000", 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077288419999999997 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504295+0000", 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8093999999999999e-05 2024-05-07T14:03:40.733 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.734 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.734 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.734 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1720 4.1c 4:397a1514:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.5.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:40.734 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:03:40.734 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.800023248999999, 2024-05-07T14:03:40.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041467209999999999, 2024-05-07T14:03:40.734 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.734 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.734 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.734 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.734 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1720 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922275+0000", 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922276+0000", 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4799999999999998e-07 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922280+0000", 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4839999999999998e-06 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922288+0000", 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9610000000000005e-06 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922300+0000", 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1365e-05 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922369+0000", 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9758999999999994e-05 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922491+0000", 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121383 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:40.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.922642+0000", 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015127200000000001 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.923617+0000", 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00097548299999999997 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926352+0000", 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027348170000000001 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926382+0000", 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9808e-05 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.926422+0000", 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9740999999999998e-05 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1922 4.19 e81/23 4:9849ed33:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.8:head v 81'4, mlcod=81'1)", 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.324433458999998, 2024-05-07T14:03:40.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005911655, 2024-05-07T14:03:40.740 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.740 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.740 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.740 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:40.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:40.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397865+0000", 2024-05-07T14:03:40.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8200000000000001e-07 2024-05-07T14:03:40.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397869+0000", 2024-05-07T14:03:40.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5209999999999998e-06 2024-05-07T14:03:40.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397875+0000", 2024-05-07T14:03:40.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6599999999999998e-06 2024-05-07T14:03:40.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397881+0000", 2024-05-07T14:03:40.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1240000000000004e-06 2024-05-07T14:03:40.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398179+0000", 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00029815899999999999 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398197+0000", 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8133000000000001e-05 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403738+0000", 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055410950000000002 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403777+0000", 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8581000000000002e-05 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2202 3.0 e84/21 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.435625289000001, 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020120560999999999, 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.745 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286676+0000", 2024-05-07T14:03:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.57e-06 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291894+0000", 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052185740000000001 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291939+0000", 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4676999999999999e-05 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291959+0000", 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0115999999999998e-05 2024-05-07T14:03:40.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292128+0000", 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168758 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292188+0000", 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0565e-05 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306607+0000", 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014418733 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306794+0000", 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018656799999999999 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2204 3.3b e84/21 3:df85b00b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_3:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.312700+0000", 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.409598142, 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015369649000000001, 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.749 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.312700+0000", 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.312700+0000", 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.312702+0000", 2024-05-07T14:03:40.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8279999999999999e-06 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319174+0000", 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064721049999999997 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319227+0000", 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2670000000000002e-05 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319255+0000", 2024-05-07T14:03:40.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7923e-05 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319409+0000", 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015399200000000001 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319455+0000", 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6726e-05 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.327989+0000", 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0085333779999999994 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.328070+0000", 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1026999999999995e-05 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2211 3.13 3:cbf4b364:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.389539+0000", 2024-05-07T14:03:40.753 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.332759570999997, 2024-05-07T14:03:40.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015047895, 2024-05-07T14:03:40.754 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.754 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.754 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.754 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.754 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.754 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.754 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2211 2024-05-07T14:03:40.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.754 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.389539+0000", 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.389539+0000", 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.389541+0000", 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2709999999999999e-06 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392129+0000", 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002587719 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392163+0000", 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3714999999999998e-05 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392178+0000", 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5132e-05 2024-05-07T14:03:40.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392251+0000", 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3743000000000002e-05 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392368+0000", 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011705 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392465+0000", 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6836000000000006e-05 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.399912+0000", 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0074468069999999997 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.404505+0000", 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045928840000000002 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.404540+0000", 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5485000000000003e-05 2024-05-07T14:03:40.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.404587+0000", 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6252999999999999e-05 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2216 3.21 3:86b25102:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.254194965000003, 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017498730000000001, 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.759 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2216 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:40.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468107+0000", 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5980000000000001e-06 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471311+0000", 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003203811 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471360+0000", 2024-05-07T14:03:40.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9100000000000001e-05 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471383+0000", 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3289e-05 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471551+0000", 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167295 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471932+0000", 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038136799999999998 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472296+0000", 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036396200000000001 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.481648+0000", 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093518209999999997 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485379+0000", 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037311919999999999 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485533+0000", 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015429500000000001 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485602+0000", 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8998999999999994e-05 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.764 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2217 3.0 e84/21 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.228978501999997, 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016624692, 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493322+0000", 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7290000000000001e-06 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496239+0000", 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029177949999999999 2024-05-07T14:03:40.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496292+0000", 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2769999999999998e-05 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496318+0000", 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6313e-05 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496471+0000", 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015206799999999999 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496540+0000", 2024-05-07T14:03:40.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9598999999999996e-05 2024-05-07T14:03:40.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509870+0000", 2024-05-07T14:03:40.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013330322 2024-05-07T14:03:40.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509945+0000", 2024-05-07T14:03:40.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4096000000000003e-05 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2226 3.4 e84/21 3:20f3de0c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_25:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.625448+0000", 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.096850686000003, 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010656673, 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625448+0000", 2024-05-07T14:03:40.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625448+0000", 2024-05-07T14:03:40.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625450+0000", 2024-05-07T14:03:40.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8780000000000001e-06 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.626982+0000", 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015321359999999999 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.627007+0000", 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4949000000000001e-05 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.627019+0000", 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2703e-05 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.627122+0000", 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010307 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.627145+0000", 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2875e-05 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636031+0000", 2024-05-07T14:03:40.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088859860000000002 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636104+0000", 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3076000000000003e-05 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2231 3.2e 3:767c3375:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.681942+0000", 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.040356189000001, 2024-05-07T14:03:40.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015025999, 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2231 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.681942+0000", 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.681942+0000", 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.681945+0000", 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0630000000000002e-06 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683651+0000", 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001705694 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683682+0000", 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1288000000000003e-05 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683700+0000", 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7756000000000001e-05 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683790+0000", 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9573000000000005e-05 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683956+0000", 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016630400000000001 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684044+0000", 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8369999999999996e-05 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.688963+0000", 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049188510000000001 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.696874+0000", 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0079104099999999997 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.696918+0000", 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4456000000000003e-05 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.696968+0000", 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0234e-05 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.779 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2238 3.2e 3:76550f67:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:40.779 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.757297+0000", 2024-05-07T14:03:40.779 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.965001104999999, 2024-05-07T14:03:40.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01394517, 2024-05-07T14:03:40.779 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.779 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.779 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.779 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2238 2024-05-07T14:03:40.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.780 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.757297+0000", 2024-05-07T14:03:40.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.757297+0000", 2024-05-07T14:03:40.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.757299+0000", 2024-05-07T14:03:40.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1220000000000002e-06 2024-05-07T14:03:40.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759025+0000", 2024-05-07T14:03:40.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017252120000000001 2024-05-07T14:03:40.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759047+0000", 2024-05-07T14:03:40.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2796e-05 2024-05-07T14:03:40.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759060+0000", 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3033e-05 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759135+0000", 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4141999999999996e-05 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759245+0000", 2024-05-07T14:03:40.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000110404 2024-05-07T14:03:40.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:40.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.759381+0000", 2024-05-07T14:03:40.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013557599999999999 2024-05-07T14:03:40.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.765117+0000", 2024-05-07T14:03:40.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057365130000000004 2024-05-07T14:03:40.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.771109+0000", 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005992191 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.771185+0000", 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5972999999999999e-05 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.771242+0000", 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7207999999999998e-05 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.784 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.5862.0:56 7.14 e85/29 7:2b04a3e9:::notify.6:head v 85'90, mlcod=82'88)", 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.263489+0000", 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 34.458809043000002, 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056112230000000003, 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263489+0000", 2024-05-07T14:03:40.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263489+0000", 2024-05-07T14:03:40.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263490+0000", 2024-05-07T14:03:40.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4099999999999999e-07 2024-05-07T14:03:40.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263493+0000", 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0340000000000001e-06 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263499+0000", 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2269999999999998e-06 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263504+0000", 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8010000000000003e-06 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263682+0000", 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017840999999999999 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263701+0000", 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8870999999999999e-05 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269073+0000", 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053717490000000003 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269101+0000", 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7690000000000001e-05 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "pg_update_log_missing(7.15 epoch 87/86 rep_tid 394 entries 87'93 (0'0) error 7:a93a5511:::notify.2:head by client.4464.0:2500 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 85'91)", 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.438458+0000", 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.283840814999998, 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010184736, 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:40.789 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438458+0000", 2024-05-07T14:03:40.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438458+0000", 2024-05-07T14:03:40.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438458+0000", 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9999999999999997e-07 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438473+0000", 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.526e-05 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438512+0000", 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8915999999999998e-05 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438552+0000", 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0105999999999999e-05 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438686+0000", 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000133425 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.448642+0000", 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099564289999999993 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.792 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.793 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2554 4.1c 4:3adf8491:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-05-07T14:03:40.793 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.470670+0000", 2024-05-07T14:03:40.793 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 33.251627892999998, 2024-05-07T14:03:40.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051087750000000003, 2024-05-07T14:03:40.793 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.793 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.793 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:40.793 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:40.793 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:40.793 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:40.793 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2554 2024-05-07T14:03:40.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.794 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470670+0000", 2024-05-07T14:03:40.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470670+0000", 2024-05-07T14:03:40.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470672+0000", 2024-05-07T14:03:40.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9180000000000001e-06 2024-05-07T14:03:40.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470679+0000", 2024-05-07T14:03:40.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9249999999999998e-06 2024-05-07T14:03:40.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470695+0000", 2024-05-07T14:03:40.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6053e-05 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470706+0000", 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0348e-05 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470793+0000", 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7445e-05 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.470883+0000", 2024-05-07T14:03:40.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9375000000000004e-05 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.471014+0000", 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000130949 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.474465+0000", 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034512089999999998 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:40.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475655+0000", 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001190305 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475722+0000", 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.7439000000000003e-05 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.475779+0000", 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6808999999999998e-05 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.798 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "MOSDPGPull(3.25 e100/99 cost 1048576)", 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.715854+0000", 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.006444221, 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046655179999999996, 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.715854+0000", 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.715854+0000", 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.715856+0000", 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.623e-06 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.715870+0000", 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4714e-05 2024-05-07T14:03:40.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.715890+0000", 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9066e-05 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.715899+0000", 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.217e-06 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.715958+0000", 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9132000000000002e-05 2024-05-07T14:03:40.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.720520+0000", 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045617660000000001 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "MOSDPGPull(3.25 e100/99 cost 1048576)", 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.723676+0000", 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.99862227599999998, 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040481090000000003, 2024-05-07T14:03:40.802 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.723676+0000", 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.723676+0000", 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.723678+0000", 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.784e-06 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.723695+0000", 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7374999999999999e-05 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.723712+0000", 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7028e-05 2024-05-07T14:03:40.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.723723+0000", 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0329000000000001e-05 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.723791+0000", 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8782000000000007e-05 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.727724+0000", 2024-05-07T14:03:40.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039328109999999996 2024-05-07T14:03:40.806 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.806 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.806 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.806 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:40.806 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:40.806 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:40.807 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:40.808 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:40.815+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:40.908 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:40.919+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:40.966 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:40.966 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:40.966 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:40.966 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:40.979 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:41.010 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:41.020+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:41.110 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:41.119+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:41.142 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:41.142 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:41.142 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:41.157 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:41.195 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:03:41.211 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:41.220+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:41.312 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:41.323+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:41.322 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:41.322 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:41.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:41.322 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:41.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.322 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-05-07T14:03:41.322 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:03:41.322 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 159.331928291, 2024-05-07T14:03:41.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082880220000000008, 2024-05-07T14:03:41.322 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.322 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.322 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:41.323 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.323 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:41.323 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:41.323 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 44 2024-05-07T14:03:41.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.323 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:03:41.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002477+0000", 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002480+0000", 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002496+0000", 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6007000000000001e-05 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002548+0000", 2024-05-07T14:03:41.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1226e-05 2024-05-07T14:03:41.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.002573+0000", 2024-05-07T14:03:41.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5346000000000001e-05 2024-05-07T14:03:41.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008049+0000", 2024-05-07T14:03:41.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054757640000000002 2024-05-07T14:03:41.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:41.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.008073+0000", 2024-05-07T14:03:41.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3952999999999999e-05 2024-05-07T14:03:41.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010494+0000", 2024-05-07T14:03:41.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024211250000000001 2024-05-07T14:03:41.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:02.010765+0000", 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027132099999999999 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 154.31152447100001, 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011818588999999999, 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.327 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 207 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022881+0000", 2024-05-07T14:03:41.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022886+0000", 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7500000000000003e-06 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022901+0000", 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5075999999999999e-05 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022936+0000", 2024-05-07T14:03:41.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4999999999999997e-05 2024-05-07T14:03:41.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.022956+0000", 2024-05-07T14:03:41.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0007e-05 2024-05-07T14:03:41.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023124+0000", 2024-05-07T14:03:41.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016866200000000001 2024-05-07T14:03:41.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.023144+0000", 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9508999999999999e-05 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.030014+0000", 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068700269999999999 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031549+0000", 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015353680000000001 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.031979+0000", 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000429271 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.033285+0000", 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001306476 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034564+0000", 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012786869999999999 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034645+0000", 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.119e-05 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.034700+0000", 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4565999999999999e-05 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.333 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1477 3.18 3:1a16f065:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:41.334 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:03:41.334 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 49.048922947999998, 2024-05-07T14:03:41.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017437234999999999, 2024-05-07T14:03:41.334 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.334 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.334 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.334 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.334 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:41.334 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:41.334 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1477 2024-05-07T14:03:41.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.334 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285482+0000", 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.285485+0000", 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.148e-06 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287428+0000", 2024-05-07T14:03:41.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001943391 2024-05-07T14:03:41.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287451+0000", 2024-05-07T14:03:41.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2912e-05 2024-05-07T14:03:41.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287464+0000", 2024-05-07T14:03:41.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2758000000000001e-05 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287530+0000", 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6544999999999994e-05 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287643+0000", 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011307900000000001 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287732+0000", 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8640999999999994e-05 2024-05-07T14:03:41.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.300987+0000", 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013255052999999999 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302819+0000", 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001831533 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302874+0000", 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5946000000000003e-05 2024-05-07T14:03:41.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302920+0000", 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5228999999999997e-05 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 49.029660882999998, 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.339 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:03:41.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:03:41.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:03:41.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:03:41.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:03:41.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:03:41.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:03:41.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5117.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 48.838417997000001, 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008462018, 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5117", 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/62727776", 2024-05-07T14:03:41.345 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495987+0000", 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495988+0000", 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9299999999999999e-07 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495990+0000", 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.765e-06 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495995+0000", 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3499999999999996e-06 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.495998+0000", 2024-05-07T14:03:41.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3739999999999998e-06 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496050+0000", 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2015999999999998e-05 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496120+0000", 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9373000000000001e-05 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.496224+0000", 2024-05-07T14:03:41.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010395699999999999 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.501395+0000", 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051715090000000003 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504399+0000", 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030035930000000001 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504428+0000", 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9079999999999999e-05 2024-05-07T14:03:41.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.504449+0000", 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1608e-05 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1485 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=14b,call rgw.obj_remove in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 48.713679167000002, 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056592079999999998, 2024-05-07T14:03:41.350 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1485 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620726+0000", 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620728+0000", 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.457e-06 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620734+0000", 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0460000000000002e-06 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620749+0000", 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5067e-05 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620758+0000", 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6989999999999992e-06 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620819+0000", 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1496999999999998e-05 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.620880+0000", 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0908e-05 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.621007+0000", 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000127551 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.622196+0000", 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001188391 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626306+0000", 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041097779999999997 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626357+0000", 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0936999999999997e-05 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.626385+0000", 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8877000000000002e-05 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.355 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1922 4.19 4:9849ed33:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.6.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.938015020999998, 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0075306310000000003, 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:41.356 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1922 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396390+0000", 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396391+0000", 2024-05-07T14:03:41.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.46e-07 2024-05-07T14:03:41.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396393+0000", 2024-05-07T14:03:41.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3250000000000002e-06 2024-05-07T14:03:41.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396400+0000", 2024-05-07T14:03:41.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9190000000000002e-06 2024-05-07T14:03:41.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396405+0000", 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2839999999999997e-06 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396919+0000", 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00051340499999999998 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.396988+0000", 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8775999999999993e-05 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.397099+0000", 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111239 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.398350+0000", 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001250735 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403874+0000", 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005524307 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403900+0000", 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6499000000000002e-05 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:54.403921+0000", 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0696e-05 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2203 3.1e 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.039944538999997, 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029129142, 2024-05-07T14:03:41.361 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2203 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294465+0000", 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7699999999999999e-06 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300328+0000", 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058633460000000002 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300384+0000", 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6212999999999999e-05 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300411+0000", 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7109000000000001e-05 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300586+0000", 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017478799999999999 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300941+0000", 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035515500000000001 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301351+0000", 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040996099999999997 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.317495+0000", 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016143462000000001 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323421+0000", 2024-05-07T14:03:41.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059264649999999997 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323498+0000", 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6478999999999997e-05 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323590+0000", 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2393999999999997e-05 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2205 3.28 e84/21 3:177ebb78:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_4:head v 84'4, mlcod=80'2)", 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.327037+0000", 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.007368380000003, 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014954187000000001, 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.327037+0000", 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.327037+0000", 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.327039+0000", 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.77e-06 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333502+0000", 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064627169999999998 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333536+0000", 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4576000000000002e-05 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333556+0000", 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9911999999999998e-05 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333648+0000", 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1886999999999996e-05 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.333674+0000", 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6562000000000001e-05 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.341878+0000", 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082039850000000004 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.341991+0000", 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112778 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.370 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2210 3.28 e84/21 3:157bdd2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_9:head v 84'5, mlcod=80'3)", 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.373804+0000", 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.960601848000003, 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010808760000000001, 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.373804+0000", 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.373804+0000", 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.373805+0000", 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5489999999999999e-06 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378137+0000", 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043320640000000001 2024-05-07T14:03:41.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378161+0000", 2024-05-07T14:03:41.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.34e-05 2024-05-07T14:03:41.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378170+0000", 2024-05-07T14:03:41.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4180000000000003e-06 2024-05-07T14:03:41.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378234+0000", 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4386000000000003e-05 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.378253+0000", 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8542999999999998e-05 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.384569+0000", 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063162670000000004 2024-05-07T14:03:41.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.384612+0000", 2024-05-07T14:03:41.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3133000000000002e-05 2024-05-07T14:03:41.375 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.375 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.375 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.375 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2214 3.33 3:cdc86525:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:41.375 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.436823+0000", 2024-05-07T14:03:41.375 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.897582856, 2024-05-07T14:03:41.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014331511999999999, 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2214 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.436823+0000", 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.436823+0000", 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.436826+0000", 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7670000000000001e-06 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.439818+0000", 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029918359999999999 2024-05-07T14:03:41.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.439858+0000", 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9830999999999999e-05 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.439874+0000", 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6328e-05 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.439978+0000", 2024-05-07T14:03:41.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103491 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.440163+0000", 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018528800000000001 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.440321+0000", 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015804099999999999 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.448904+0000", 2024-05-07T14:03:41.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0085825020000000005 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.451028+0000", 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002124014 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.451101+0000", 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3802999999999998e-05 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.451154+0000", 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2611000000000002e-05 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2228 3.b 3:d3d17a37:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.649134+0000", 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.685271094999997, 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012981072, 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.382 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:41.382 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:41.382 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2228 2024-05-07T14:03:41.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.382 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.649134+0000", 2024-05-07T14:03:41.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.649134+0000", 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.649137+0000", 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7269999999999999e-06 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.650871+0000", 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001733928 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.650902+0000", 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1245000000000003e-05 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.650929+0000", 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6999999999999999e-05 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.651003+0000", 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3860000000000001e-05 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.651154+0000", 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015102799999999999 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.651272+0000", 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117798 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661672+0000", 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010399920999999999 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:41.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.662002+0000", 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00033048099999999998 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.662066+0000", 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3663000000000004e-05 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.662115+0000", 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9421e-05 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2230 3.b 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.664037868999998, 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021351564, 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2230 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670370+0000", 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5050000000000002e-06 2024-05-07T14:03:41.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673214+0000", 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028441260000000002 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673245+0000", 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0488999999999999e-05 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673259+0000", 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4443e-05 2024-05-07T14:03:41.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673356+0000", 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7031e-05 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673531+0000", 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017509099999999999 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673696+0000", 2024-05-07T14:03:41.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000164306 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684776+0000", 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011080054000000001 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691578+0000", 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068025849999999999 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691659+0000", 2024-05-07T14:03:41.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0976000000000005e-05 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691719+0000", 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9957999999999998e-05 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2233 3.8 3:11b98425:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.703282+0000", 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.631123273999997, 2024-05-07T14:03:41.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013715266, 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2233 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.703282+0000", 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.703282+0000", 2024-05-07T14:03:41.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.703285+0000", 2024-05-07T14:03:41.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4420000000000001e-06 2024-05-07T14:03:41.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705019+0000", 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00173413 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705045+0000", 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6553000000000001e-05 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705057+0000", 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2089000000000001e-05 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705144+0000", 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6330999999999997e-05 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705327+0000", 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018284400000000001 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.705488+0000", 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161175 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716311+0000", 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010823732000000001 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716869+0000", 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00055720900000000002 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716945+0000", 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6038000000000006e-05 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.716997+0000", 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2723000000000003e-05 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2234 3.c e84/21 3:313f4c71:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_33:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.719287+0000", 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.615118520999999, 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010877421999999999, 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.398 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.719287+0000", 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.719287+0000", 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.719288+0000", 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4399999999999999e-07 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723259+0000", 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039712230000000003 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723288+0000", 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9603000000000001e-05 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723314+0000", 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5882000000000001e-05 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723397+0000", 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2337999999999997e-05 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.723426+0000", 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9663999999999999e-05 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.730114+0000", 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0066872659999999999 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.730164+0000", 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0701999999999997e-05 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2241 3.19 e84/21 3:9b9246d1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_40:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:41.402 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.789069+0000", 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.545336837000001, 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0096171769999999993, 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.789069+0000", 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.789069+0000", 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.789070+0000", 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.466e-06 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790431+0000", 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013607999999999999 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790458+0000", 2024-05-07T14:03:41.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6823000000000001e-05 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790472+0000", 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4059999999999999e-05 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790554+0000", 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1839e-05 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.790582+0000", 2024-05-07T14:03:41.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8388999999999999e-05 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.798616+0000", 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080345199999999999 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.798686+0000", 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9280000000000001e-05 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.5862.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.263138+0000", 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 35.071267468000002, 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061089910000000002, 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.5862", 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/3537699870", 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263138+0000", 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263138+0000", 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263139+0000", 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9500000000000002e-07 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263141+0000", 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8439999999999998e-06 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263150+0000", 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7700000000000007e-06 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263156+0000", 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8189999999999997e-06 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263211+0000", 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5340999999999998e-05 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263285+0000", 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3206000000000003e-05 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.263402+0000", 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011738100000000001 2024-05-07T14:03:41.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:41.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.266447+0000", 2024-05-07T14:03:41.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030453519999999999 2024-05-07T14:03:41.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:41.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269193+0000", 2024-05-07T14:03:41.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002745571 2024-05-07T14:03:41.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:41.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269222+0000", 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9329999999999999e-05 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.269247+0000", 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4681999999999998e-05 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2666 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.682580983, 2024-05-07T14:03:41.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.125351252, 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2666 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:41.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651827+0000", 2024-05-07T14:03:41.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-06 2024-05-07T14:03:41.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651834+0000", 2024-05-07T14:03:41.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7700000000000001e-06 2024-05-07T14:03:41.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651850+0000", 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5755000000000001e-05 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651862+0000", 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.237e-05 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651967+0000", 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010427199999999999 2024-05-07T14:03:41.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651977+0000", 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0743e-05 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657294+0000", 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053168069999999998 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657305+0000", 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0662000000000001e-05 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774211+0000", 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1169060209999999 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774394+0000", 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018268000000000001 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.777176+0000", 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002782025 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.417 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "MOSDPGPushReply(3.8 100/99 [PushReplyOp(3:128e8f27:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_138:head)])", 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.733565+0000", 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.600840381, 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061492739999999997, 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.733565+0000", 2024-05-07T14:03:41.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.733565+0000", 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.733567+0000", 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0049999999999999e-06 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.733577+0000", 2024-05-07T14:03:41.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0003999999999999e-05 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.733600+0000", 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3363999999999999e-05 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.733614+0000", 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4072e-05 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.733722+0000", 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107295 2024-05-07T14:03:41.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.739714+0000", 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059925339999999999 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2673 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.1386477959999999, 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57934507999999996, 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:41.421 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:41.422 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:41.422 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:41.422 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:41.422 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2673 2024-05-07T14:03:41.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.422 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:41.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:41.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:41.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:41.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:41.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:41.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:41.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:41.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9699999999999996e-07 2024-05-07T14:03:41.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:41.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195761+0000", 2024-05-07T14:03:41.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2569999999999999e-06 2024-05-07T14:03:41.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195768+0000", 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.489e-06 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195774+0000", 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7389999999999996e-06 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195866+0000", 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2349000000000006e-05 2024-05-07T14:03:41.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:41.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195878+0000", 2024-05-07T14:03:41.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1838000000000001e-05 2024-05-07T14:03:41.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:41.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774802+0000", 2024-05-07T14:03:41.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.578923945 2024-05-07T14:03:41.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:41.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774906+0000", 2024-05-07T14:03:41.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103991 2024-05-07T14:03:41.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:41.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:41.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:41.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775103+0000", 2024-05-07T14:03:41.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196975 2024-05-07T14:03:41.426 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.426 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.426 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.426 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:41.426 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:41.426 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:41.428 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:41.428 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:41.429 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:41.429 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:41.429 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:41.430 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:41.430 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:41.430 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:41.431 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:41.431 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:41.431 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:41.431 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:41.435+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:41.432 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:41.432 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:41.452 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:41.452 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:41.472 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:41.472 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:41.533 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:41.543+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:41.563 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:41.564 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:41.578 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:41.630 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:41.640+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:41.687 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.4 to 1 (10000) 2024-05-07T14:03:41.708 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:41.709 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:41.717 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-07T14:03:41.723 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:41.761 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:41.771+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:41.808 INFO:tasks.workunit.client.0.smithi106.stderr:100+0 records in 2024-05-07T14:03:41.808 INFO:tasks.workunit.client.0.smithi106.stderr:100+0 records out 2024-05-07T14:03:41.808 INFO:tasks.workunit.client.0.smithi106.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 7.7272 s, 136 MB/s 2024-05-07T14:03:41.831 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:41.840+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:41.881 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:41.882 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:41.895 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:41.932 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:41.943+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:42.033 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:42.043+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:42.057 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:42.057 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:42.071 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:42.134 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:42.144+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:42.194 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:42.195 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:42.208 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:03:42.235 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:42.243+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:42.336 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:42.348+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:42.378 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:42.378 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:42.392 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:03:42.437 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:42.447+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:42.538 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:42.547+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:42.562 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:42.562 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:42.576 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:03:42.639 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:42.647+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:42.658 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:03:42.683 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.5 to 1 (10000) 2024-05-07T14:03:42.704 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:42.704 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:42.707 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-07T14:03:42.719 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:03:42.748 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:42.759+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:42.837 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:42.837 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:42.840 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:42.852+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:42.852 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:03:42.942 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:42.951+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:43.018 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:43.018 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:43.032 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:03:43.076 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:43.088+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:43.144 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:43.156+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:43.149 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:43.149 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:43.164 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:43.244 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:43.255+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:43.335 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:43.335 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:43.345 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:43.356+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:43.349 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:43.446 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:43.456+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:43.467 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:43.467 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:43.480 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:43.490 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:03:43.568 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:43.579+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:43.607 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:43.607 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:43.620 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:43.653 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:43.653 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:43.654 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:43.663+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:43.670 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:43.671 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:43.686 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:43.687 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:43.697 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:03:43.704 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.6 to 1 (10000) 2024-05-07T14:03:43.708 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:43.709 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:43.729 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:43.730 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:43.733 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-07T14:03:43.749 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:43.760+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:43.753 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:43.753 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:43.782 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:43.782 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:43.786 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:140 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'98, mlcod=17'93)", 2024-05-07T14:03:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 177.48578735500001, 2024-05-07T14:03:43.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069126140000000001, 2024-05-07T14:03:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312476+0000", 2024-05-07T14:03:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312478+0000", 2024-05-07T14:03:43.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6899999999999999e-06 2024-05-07T14:03:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312586+0000", 2024-05-07T14:03:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010768300000000001 2024-05-07T14:03:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312607+0000", 2024-05-07T14:03:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.145e-05 2024-05-07T14:03:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312618+0000", 2024-05-07T14:03:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0726e-05 2024-05-07T14:03:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312788+0000", 2024-05-07T14:03:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016996900000000001 2024-05-07T14:03:43.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.312826+0000", 2024-05-07T14:03:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8355999999999997e-05 2024-05-07T14:03:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319287+0000", 2024-05-07T14:03:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064603179999999996 2024-05-07T14:03:43.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319389+0000", 2024-05-07T14:03:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102422 2024-05-07T14:03:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4182.0:141 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'99, mlcod=17'93)", 2024-05-07T14:03:43.793 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 177.48437473600001, 2024-05-07T14:03:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055443080000000004, 2024-05-07T14:03:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313889+0000", 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313891+0000", 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7770000000000001e-06 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313905+0000", 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4416999999999999e-05 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313938+0000", 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2345999999999998e-05 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.313955+0000", 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7646e-05 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314121+0000", 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000165852 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.314153+0000", 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2240000000000003e-05 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319392+0000", 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052391340000000003 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:46.319433+0000", 2024-05-07T14:03:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0896000000000003e-05 2024-05-07T14:03:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 156.65870425400001, 2024-05-07T14:03:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005504531, 2024-05-07T14:03:43.798 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 235 2024-05-07T14:03:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139559+0000", 2024-05-07T14:03:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139562+0000", 2024-05-07T14:03:43.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6000000000000001e-06 2024-05-07T14:03:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139573+0000", 2024-05-07T14:03:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1192999999999999e-05 2024-05-07T14:03:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139603+0000", 2024-05-07T14:03:43.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9312999999999999e-05 2024-05-07T14:03:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139618+0000", 2024-05-07T14:03:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5160000000000001e-05 2024-05-07T14:03:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139739+0000", 2024-05-07T14:03:43.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121616 2024-05-07T14:03:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.139960+0000", 2024-05-07T14:03:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000221108 2024-05-07T14:03:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:43.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.140376+0000", 2024-05-07T14:03:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041515699999999998 2024-05-07T14:03:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.141659+0000", 2024-05-07T14:03:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001283733 2024-05-07T14:03:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:43.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144780+0000", 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031202859999999999 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.144949+0000", 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016983300000000001 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.145064+0000", 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011453199999999999 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:369 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-05-07T14:03:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 156.62559359599999, 2024-05-07T14:03:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054711439999999998, 2024-05-07T14:03:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 369 2024-05-07T14:03:43.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172670+0000", 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172671+0000", 2024-05-07T14:03:43.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2559999999999999e-06 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172680+0000", 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7870000000000007e-06 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172695+0000", 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4575e-05 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172704+0000", 2024-05-07T14:03:43.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1530000000000003e-06 2024-05-07T14:03:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172773+0000", 2024-05-07T14:03:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9101000000000001e-05 2024-05-07T14:03:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.172859+0000", 2024-05-07T14:03:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6143999999999994e-05 2024-05-07T14:03:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173060+0000", 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020105200000000001 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.173650+0000", 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059012500000000005 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178067+0000", 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044162740000000004 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178110+0000", 2024-05-07T14:03:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3281000000000001e-05 2024-05-07T14:03:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:07.178141+0000", 2024-05-07T14:03:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1396000000000002e-05 2024-05-07T14:03:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1477 3.18 e80/21 3:1a16f065:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_1:head v 80'1, mlcod=0'0)", 2024-05-07T14:03:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 51.510440338000002, 2024-05-07T14:03:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014861011, 2024-05-07T14:03:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:43.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287823+0000", 2024-05-07T14:03:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.287825+0000", 2024-05-07T14:03:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9889999999999999e-06 2024-05-07T14:03:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290411+0000", 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025854430000000002 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290433+0000", 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.264e-05 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290443+0000", 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7189999999999996e-06 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290521+0000", 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8164000000000006e-05 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290546+0000", 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4533e-05 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302655+0000", 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012108898999999999 2024-05-07T14:03:43.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302684+0000", 2024-05-07T14:03:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9624e-05 2024-05-07T14:03:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1478 3.12 3:4bdcf7a4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3__shadow_.-gTLkcpBKXTuLinkQCOqak6EXgmpL7b_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 51.509000499000003, 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013141795, 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1478 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289263+0000", 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.289265+0000", 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.001e-06 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290501+0000", 2024-05-07T14:03:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001235487 2024-05-07T14:03:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290514+0000", 2024-05-07T14:03:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.358e-05 2024-05-07T14:03:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290521+0000", 2024-05-07T14:03:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8889999999999996e-06 2024-05-07T14:03:43.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290588+0000", 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.7218000000000006e-05 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290762+0000", 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017409200000000001 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.290904+0000", 2024-05-07T14:03:43.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000141963 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.301956+0000", 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011051640999999999 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302315+0000", 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000358876 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302353+0000", 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8003999999999997e-05 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.302405+0000", 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2043999999999998e-05 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1481 4.b 4:d1744c9b:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3.0:head [stat,call rgw.guard_bucket_resharding in=26b,call rgw.bucket_complete_op in=21b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81)", 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:43.822 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 51.464574567, 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099753589999999996, 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1481 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:43.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333689+0000", 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333691+0000", 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8920000000000001e-06 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333699+0000", 2024-05-07T14:03:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1089999999999998e-06 2024-05-07T14:03:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333715+0000", 2024-05-07T14:03:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6260999999999999e-05 2024-05-07T14:03:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333723+0000", 2024-05-07T14:03:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1579999999999999e-06 2024-05-07T14:03:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333800+0000", 2024-05-07T14:03:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7000000000000001e-05 2024-05-07T14:03:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333807+0000", 2024-05-07T14:03:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.498e-06 2024-05-07T14:03:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339421+0000", 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056137909999999999 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339536+0000", 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115297 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.339894+0000", 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035790799999999999 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343340+0000", 2024-05-07T14:03:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034459120000000002 2024-05-07T14:03:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343547+0000", 2024-05-07T14:03:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020692799999999999 2024-05-07T14:03:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343613+0000", 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6166000000000003e-05 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.343664+0000", 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1439e-05 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.829 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1611 3.30 e81/21 3:0c405120:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_1:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.372119808000001, 2024-05-07T14:03:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013061969999999999, 2024-05-07T14:03:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426144+0000", 2024-05-07T14:03:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.426145+0000", 2024-05-07T14:03:43.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5990000000000001e-06 2024-05-07T14:03:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.433982+0000", 2024-05-07T14:03:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078361190000000008 2024-05-07T14:03:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434000+0000", 2024-05-07T14:03:43.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.806e-05 2024-05-07T14:03:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434011+0000", 2024-05-07T14:03:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1615e-05 2024-05-07T14:03:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434085+0000", 2024-05-07T14:03:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3819000000000006e-05 2024-05-07T14:03:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.434100+0000", 2024-05-07T14:03:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4973999999999999e-05 2024-05-07T14:03:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.439168+0000", 2024-05-07T14:03:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0050674350000000003 2024-05-07T14:03:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.439206+0000", 2024-05-07T14:03:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8349000000000002e-05 2024-05-07T14:03:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.835 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:1612 3.3 e81/21 3:c1191b65:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.4__shadow_.8wWx5TwkuKxfrVHfwVEshc6jrZAa0JH_2:head v 81'1, mlcod=0'0)", 2024-05-07T14:03:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.370484759999997, 2024-05-07T14:03:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086703990000000005, 2024-05-07T14:03:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427779+0000", 2024-05-07T14:03:43.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.427780+0000", 2024-05-07T14:03:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1699999999999997e-07 2024-05-07T14:03:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431380+0000", 2024-05-07T14:03:43.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600378 2024-05-07T14:03:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431413+0000", 2024-05-07T14:03:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3056000000000003e-05 2024-05-07T14:03:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431430+0000", 2024-05-07T14:03:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6986999999999998e-05 2024-05-07T14:03:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431508+0000", 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8177999999999996e-05 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.431526+0000", 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7333000000000002e-05 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.436392+0000", 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0048665100000000001 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:53.436449+0000", 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7040000000000003e-05 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2208 3.3a e84/21 3:5ee07aff:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_7:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 40.445049222999998, 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017943191000000001, 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.841 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353214+0000", 2024-05-07T14:03:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.353217+0000", 2024-05-07T14:03:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3920000000000001e-06 2024-05-07T14:03:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363741+0000", 2024-05-07T14:03:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010524586000000001 2024-05-07T14:03:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363773+0000", 2024-05-07T14:03:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1362000000000002e-05 2024-05-07T14:03:43.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363793+0000", 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9743999999999999e-05 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363870+0000", 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7610999999999999e-05 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.363888+0000", 2024-05-07T14:03:43.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.785e-05 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.371098+0000", 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072103100000000002 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.371158+0000", 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9336000000000002e-05 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2219 3.32 3:4d615ce3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 40.273246893, 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016879689999999999, 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2219 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.846 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525017+0000", 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.525020+0000", 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.751e-06 2024-05-07T14:03:43.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528212+0000", 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031922080000000002 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528240+0000", 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7911000000000001e-05 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528254+0000", 2024-05-07T14:03:43.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4457999999999999e-05 2024-05-07T14:03:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528333+0000", 2024-05-07T14:03:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9136999999999998e-05 2024-05-07T14:03:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528460+0000", 2024-05-07T14:03:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012715799999999999 2024-05-07T14:03:43.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528572+0000", 2024-05-07T14:03:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011162099999999999 2024-05-07T14:03:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541359+0000", 2024-05-07T14:03:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012787023 2024-05-07T14:03:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:43.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541810+0000", 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00045134299999999999 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541859+0000", 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8934999999999998e-05 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541896+0000", 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7144999999999998e-05 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2225 3.1f 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 40.199517135000001, 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020378113, 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2225 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598750+0000", 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8859999999999997e-06 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602351+0000", 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600195 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602470+0000", 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119608 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602494+0000", 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.376e-05 2024-05-07T14:03:43.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602590+0000", 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6399999999999999e-05 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602740+0000", 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014951 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602884+0000", 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000143616 2024-05-07T14:03:43.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618629+0000", 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015745420999999999 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619008+0000", 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037870699999999999 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619069+0000", 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1617000000000003e-05 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619125+0000", 2024-05-07T14:03:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5393000000000003e-05 2024-05-07T14:03:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2227 3.1b 3:d8b15ce8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 40.157730893, 2024-05-07T14:03:43.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017300908, 2024-05-07T14:03:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2227 2024-05-07T14:03:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640533+0000", 2024-05-07T14:03:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.640536+0000", 2024-05-07T14:03:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9809999999999999e-06 2024-05-07T14:03:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643182+0000", 2024-05-07T14:03:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026464769999999999 2024-05-07T14:03:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643207+0000", 2024-05-07T14:03:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5077999999999999e-05 2024-05-07T14:03:43.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643220+0000", 2024-05-07T14:03:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2866e-05 2024-05-07T14:03:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643329+0000", 2024-05-07T14:03:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000108467 2024-05-07T14:03:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643499+0000", 2024-05-07T14:03:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017020199999999999 2024-05-07T14:03:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.643652+0000", 2024-05-07T14:03:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152993 2024-05-07T14:03:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.648361+0000", 2024-05-07T14:03:43.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0047089530000000001 2024-05-07T14:03:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657709+0000", 2024-05-07T14:03:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093483360000000005 2024-05-07T14:03:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657779+0000", 2024-05-07T14:03:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9375999999999994e-05 2024-05-07T14:03:43.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.657834+0000", 2024-05-07T14:03:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5179000000000001e-05 2024-05-07T14:03:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2228 3.b e84/21 3:d3d17a37:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_27:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:43.864 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 40.145772334999997, 2024-05-07T14:03:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093032859999999992, 2024-05-07T14:03:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652491+0000", 2024-05-07T14:03:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.652493+0000", 2024-05-07T14:03:43.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7269999999999999e-06 2024-05-07T14:03:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653476+0000", 2024-05-07T14:03:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00098271300000000008 2024-05-07T14:03:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653501+0000", 2024-05-07T14:03:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5012e-05 2024-05-07T14:03:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653511+0000", 2024-05-07T14:03:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0009e-05 2024-05-07T14:03:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653607+0000", 2024-05-07T14:03:43.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5975000000000002e-05 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.653635+0000", 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8010000000000001e-05 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661728+0000", 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080929339999999995 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.661795+0000", 2024-05-07T14:03:43.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6905999999999999e-05 2024-05-07T14:03:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2229 3.3 e84/21 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 40.133306093000002, 2024-05-07T14:03:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022534413, 2024-05-07T14:03:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.870 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:03:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664960+0000", 2024-05-07T14:03:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0109999999999999e-06 2024-05-07T14:03:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670334+0000", 2024-05-07T14:03:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005374635 2024-05-07T14:03:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3374999999999998e-05 2024-05-07T14:03:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670385+0000", 2024-05-07T14:03:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7512000000000001e-05 2024-05-07T14:03:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670515+0000", 2024-05-07T14:03:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012940900000000001 2024-05-07T14:03:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670543+0000", 2024-05-07T14:03:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8157000000000002e-05 2024-05-07T14:03:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687374+0000", 2024-05-07T14:03:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016831793000000001 2024-05-07T14:03:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687492+0000", 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117521 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2230 3.b e84/21 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 40.123300921999999, 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016432748, 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:43.876 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674963+0000", 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.674964+0000", 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5409999999999999e-06 2024-05-07T14:03:43.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677117+0000", 2024-05-07T14:03:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002153154 2024-05-07T14:03:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677136+0000", 2024-05-07T14:03:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8691000000000001e-05 2024-05-07T14:03:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677148+0000", 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2291e-05 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677217+0000", 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8880000000000005e-05 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.677249+0000", 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1664e-05 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691337+0000", 2024-05-07T14:03:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014087926000000001 2024-05-07T14:03:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691396+0000", 2024-05-07T14:03:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8600999999999997e-05 2024-05-07T14:03:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2497 7.9 7:93e5b521:::notify.7:head [watch reconnect cookie 94397682177536 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.403322672000002, 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0512951690000001, 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2497 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394942+0000", 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9100000000000002e-07 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394946+0000", 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2239999999999997e-06 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394960+0000", 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3419e-05 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394966+0000", 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3620000000000002e-06 2024-05-07T14:03:43.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395019+0000", 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3099000000000001e-05 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395023+0000", 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0879999999999997e-06 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400981+0000", 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059580520000000001 2024-05-07T14:03:43.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400990+0000", 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0880000000000001e-06 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438550+0000", 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.037559288 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for degraded object", 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.439512+0000", 2024-05-07T14:03:43.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000962154 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442920+0000", 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034085109999999999 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442966+0000", 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5509000000000001e-05 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.446236+0000", 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032704840000000002 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "MOSDPGPushReply(3.3e 87/86 [PushReplyOp(3:7fbbdcd7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_108:head)])", 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.337769901000001, 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055859079999999997, 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:43.887 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460494+0000", 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460495+0000", 2024-05-07T14:03:43.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4499999999999996e-07 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460501+0000", 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.212e-06 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460514+0000", 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3183000000000001e-05 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460523+0000", 2024-05-07T14:03:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4450000000000002e-06 2024-05-07T14:03:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.460615+0000", 2024-05-07T14:03:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1693000000000005e-05 2024-05-07T14:03:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.466080+0000", 2024-05-07T14:03:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054645300000000004 2024-05-07T14:03:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.890 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2665 7.9 7:93e5b521:::notify.7:head [watch reconnect cookie 94397682177536 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:03:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.650634+0000", 2024-05-07T14:03:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.1476293980000003, 2024-05-07T14:03:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1256737430000001, 2024-05-07T14:03:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:43.891 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2665 2024-05-07T14:03:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650634+0000", 2024-05-07T14:03:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650634+0000", 2024-05-07T14:03:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650636+0000", 2024-05-07T14:03:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0549999999999998e-06 2024-05-07T14:03:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650644+0000", 2024-05-07T14:03:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1849999999999998e-06 2024-05-07T14:03:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650657+0000", 2024-05-07T14:03:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3839000000000001e-05 2024-05-07T14:03:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650669+0000", 2024-05-07T14:03:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1483e-05 2024-05-07T14:03:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650731+0000", 2024-05-07T14:03:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2327000000000001e-05 2024-05-07T14:03:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650742+0000", 2024-05-07T14:03:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1216999999999999e-05 2024-05-07T14:03:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774923+0000", 2024-05-07T14:03:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.124180213 2024-05-07T14:03:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775019+0000", 2024-05-07T14:03:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5995000000000005e-05 2024-05-07T14:03:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.776308+0000", 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012894289999999999 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2669 7.9 7:93e5b521:::notify.7:head [watch ping cookie 94397682177536 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195592+0000", 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.6026719040000001, 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.58012271999999998, 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:43.898 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2669 2024-05-07T14:03:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195592+0000", 2024-05-07T14:03:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195592+0000", 2024-05-07T14:03:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:43.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195594+0000", 2024-05-07T14:03:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4899999999999999e-06 2024-05-07T14:03:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195605+0000", 2024-05-07T14:03:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.08e-05 2024-05-07T14:03:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195627+0000", 2024-05-07T14:03:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1577999999999999e-05 2024-05-07T14:03:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195637+0000", 2024-05-07T14:03:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0258000000000001e-05 2024-05-07T14:03:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195966+0000", 2024-05-07T14:03:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032875299999999999 2024-05-07T14:03:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.196005+0000", 2024-05-07T14:03:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9662000000000001e-05 2024-05-07T14:03:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775356+0000", 2024-05-07T14:03:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57935019200000004 2024-05-07T14:03:43.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775484+0000", 2024-05-07T14:03:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012866399999999999 2024-05-07T14:03:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775715+0000", 2024-05-07T14:03:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000230323 2024-05-07T14:03:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.904 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.905 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:43.905 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:43.905 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:43.907 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:43.907 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:43.908 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:43.909 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:43.915+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:44.007 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:44.015+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:44.109 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:44.119+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:44.150 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:44.150 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:44.150 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:44.150 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:44.169 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:44.214 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:44.220+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:44.311 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:44.319+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:44.350 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:44.350 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:44.350 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:44.350 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:44.350 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:44.368 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:44.413 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:44.423+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:44.513 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:44.524+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:44.559 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:44.559 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:44.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:44.560 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:44.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.560 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:03:44.560 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:44.560 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 164.585606187, 2024-05-07T14:03:44.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:03:44.560 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.561 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.561 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:44.561 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:44.561 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:03:44.561 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:03:44.561 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:03:44.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.562 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:44.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:44.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:03:44.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:03:44.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:03:44.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:03:44.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:03:44.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:03:44.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:03:44.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:03:44.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:03:44.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:03:44.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:44.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:03:44.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:03:44.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:03:44.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:03:44.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.566 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:03:44.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:03:44.566 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.566 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.566 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.566 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2202 3.0 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:44.566 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:44.566 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.290588808000003, 2024-05-07T14:03:44.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027191908000000001, 2024-05-07T14:03:44.567 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.567 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.567 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.567 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:44.567 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:44.567 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:44.567 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2202 2024-05-07T14:03:44.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.567 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:44.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:44.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279975+0000", 2024-05-07T14:03:44.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0130000000000001e-06 2024-05-07T14:03:44.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285489+0000", 2024-05-07T14:03:44.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055143570000000001 2024-05-07T14:03:44.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285531+0000", 2024-05-07T14:03:44.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1504000000000001e-05 2024-05-07T14:03:44.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285550+0000", 2024-05-07T14:03:44.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9256e-05 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285747+0000", 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196777 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286120+0000", 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037285900000000002 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:44.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286489+0000", 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036951099999999999 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301589+0000", 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015099728999999999 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307085+0000", 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054963340000000003 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307127+0000", 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1977999999999997e-05 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307162+0000", 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4589999999999999e-05 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2212 3.1a e84/21 3:591da10a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_11:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:44.574 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.155420468000003, 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012581199, 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415138+0000", 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.415141+0000", 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.52e-06 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421260+0000", 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061196169999999999 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421304+0000", 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3293e-05 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421324+0000", 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0341000000000001e-05 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421401+0000", 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6773999999999994e-05 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.421418+0000", 2024-05-07T14:03:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6827e-05 2024-05-07T14:03:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.427656+0000", 2024-05-07T14:03:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0062381010000000002 2024-05-07T14:03:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.427720+0000", 2024-05-07T14:03:44.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3726000000000006e-05 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2216 3.21 e84/46 3:86b25102:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_15:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.098061555999998, 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012554667, 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472497+0000", 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472500+0000", 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6630000000000002e-06 2024-05-07T14:03:44.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475359+0000", 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028594409999999999 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475407+0000", 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7868999999999999e-05 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475431+0000", 2024-05-07T14:03:44.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3873999999999999e-05 2024-05-07T14:03:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475528+0000", 2024-05-07T14:03:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7163999999999993e-05 2024-05-07T14:03:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.475556+0000", 2024-05-07T14:03:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7594999999999999e-05 2024-05-07T14:03:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485009+0000", 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0094531149999999998 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485052+0000", 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2945999999999998e-05 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.583 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2217 3.0 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.080262240000003, 2024-05-07T14:03:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019983529, 2024-05-07T14:03:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:44.584 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2217 2024-05-07T14:03:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:44.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490299+0000", 2024-05-07T14:03:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:03:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492337+0000", 2024-05-07T14:03:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020384489999999999 2024-05-07T14:03:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492391+0000", 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3702000000000002e-05 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492415+0000", 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3373000000000001e-05 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492567+0000", 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152788 2024-05-07T14:03:44.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492843+0000", 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027568999999999998 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493123+0000", 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028014899999999999 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509840+0000", 2024-05-07T14:03:44.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016716871000000001 2024-05-07T14:03:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510203+0000", 2024-05-07T14:03:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036252499999999999 2024-05-07T14:03:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510250+0000", 2024-05-07T14:03:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7231000000000002e-05 2024-05-07T14:03:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510280+0000", 2024-05-07T14:03:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0270999999999999e-05 2024-05-07T14:03:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2219 3.32 e84/21 3:4d615ce3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_18:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.041842207999998, 2024-05-07T14:03:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012848995, 2024-05-07T14:03:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528717+0000", 2024-05-07T14:03:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.528718+0000", 2024-05-07T14:03:44.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.86e-06 2024-05-07T14:03:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531113+0000", 2024-05-07T14:03:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002394958 2024-05-07T14:03:44.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531141+0000", 2024-05-07T14:03:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7543e-05 2024-05-07T14:03:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531154+0000", 2024-05-07T14:03:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3355e-05 2024-05-07T14:03:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531232+0000", 2024-05-07T14:03:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7608000000000006e-05 2024-05-07T14:03:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.531259+0000", 2024-05-07T14:03:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6656e-05 2024-05-07T14:03:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541473+0000", 2024-05-07T14:03:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010214101999999999 2024-05-07T14:03:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.541566+0000", 2024-05-07T14:03:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2912999999999996e-05 2024-05-07T14:03:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.597 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2224 3.1a e84/21 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 40.975318573000003, 2024-05-07T14:03:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020623257999999998, 2024-05-07T14:03:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.598 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595243+0000", 2024-05-07T14:03:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6800000000000002e-06 2024-05-07T14:03:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.601988+0000", 2024-05-07T14:03:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0067452479999999997 2024-05-07T14:03:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602044+0000", 2024-05-07T14:03:44.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5884999999999998e-05 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602070+0000", 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6359999999999998e-05 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602183+0000", 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112761 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602210+0000", 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6882000000000001e-05 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615811+0000", 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01360132 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615863+0000", 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2122e-05 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.603 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2225 3.1f e84/46 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 40.965890715999997, 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014189089, 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:44.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604668+0000", 2024-05-07T14:03:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.604671+0000", 2024-05-07T14:03:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6070000000000002e-06 2024-05-07T14:03:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607720+0000", 2024-05-07T14:03:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030496849999999999 2024-05-07T14:03:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607763+0000", 2024-05-07T14:03:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3044999999999999e-05 2024-05-07T14:03:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607787+0000", 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3264e-05 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607878+0000", 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1650000000000005e-05 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.607905+0000", 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7090999999999999e-05 2024-05-07T14:03:44.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618733+0000", 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010827582000000001 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618857+0000", 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000124165 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2226 3.4 3:20f3de0c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 40.948582301999998, 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014369191, 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2226 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621976+0000", 2024-05-07T14:03:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.621979+0000", 2024-05-07T14:03:44.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.272e-06 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624873+0000", 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028946390000000001 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624904+0000", 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0446e-05 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.624918+0000", 2024-05-07T14:03:44.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4263e-05 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625007+0000", 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8850000000000005e-05 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625174+0000", 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167314 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:44.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.625327+0000", 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152433 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.633342+0000", 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080152699999999997 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636260+0000", 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029179060000000001 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636297+0000", 2024-05-07T14:03:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7543000000000003e-05 2024-05-07T14:03:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.636346+0000", 2024-05-07T14:03:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8254999999999998e-05 2024-05-07T14:03:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2690 3.6 e104/21 3:60e291ee:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_7:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:44.614 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.851912+0000", 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.71864655, 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01119154, 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.851912+0000", 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.851912+0000", 2024-05-07T14:03:44.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.851914+0000", 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0420000000000001e-06 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.854621+0000", 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0027065380000000001 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.854655+0000", 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3951000000000001e-05 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.854668+0000", 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2917e-05 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.854747+0000", 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8980999999999995e-05 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.854773+0000", 2024-05-07T14:03:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6444999999999998e-05 2024-05-07T14:03:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.863029+0000", 2024-05-07T14:03:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082557250000000002 2024-05-07T14:03:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.863104+0000", 2024-05-07T14:03:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4941e-05 2024-05-07T14:03:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.618 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2692 3.25 3:a47b73b5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.870822+0000", 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.69973646099999998, 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012533175000000001, 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:44.619 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2692 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.870822+0000", 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.870822+0000", 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.870826+0000", 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2140000000000001e-06 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.872661+0000", 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018358770000000001 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.872691+0000", 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9145999999999998e-05 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.872705+0000", 2024-05-07T14:03:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4188999999999999e-05 2024-05-07T14:03:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.872787+0000", 2024-05-07T14:03:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2571000000000006e-05 2024-05-07T14:03:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.872909+0000", 2024-05-07T14:03:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121797 2024-05-07T14:03:44.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.873056+0000", 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014709400000000001 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.882584+0000", 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0095277000000000001 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.883210+0000", 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00062637000000000001 2024-05-07T14:03:44.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.883283+0000", 2024-05-07T14:03:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3046000000000005e-05 2024-05-07T14:03:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.883355+0000", 2024-05-07T14:03:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2170999999999997e-05 2024-05-07T14:03:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2697 3.19 3:99ab690a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.922861+0000", 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.64769826200000002, 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013360303, 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2697 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.625 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.922861+0000", 2024-05-07T14:03:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.922861+0000", 2024-05-07T14:03:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.922864+0000", 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.988e-06 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.924755+0000", 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001891272 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.924779+0000", 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4065000000000001e-05 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.924792+0000", 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3074000000000001e-05 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.924887+0000", 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5494000000000004e-05 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.925071+0000", 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018352 2024-05-07T14:03:44.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.925246+0000", 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000175005 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.935575+0000", 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010329270999999999 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.936094+0000", 2024-05-07T14:03:44.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00051880299999999997 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.936161+0000", 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6798999999999995e-05 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.936221+0000", 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0012000000000001e-05 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2701 3.19 3:9ba4c095:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:03:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.60775155300000006, 2024-05-07T14:03:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017365756999999999, 2024-05-07T14:03:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2701 2024-05-07T14:03:44.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962810+0000", 2024-05-07T14:03:44.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.43e-06 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964338+0000", 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015288190000000001 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964372+0000", 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3104e-05 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964387+0000", 2024-05-07T14:03:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5226e-05 2024-05-07T14:03:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964473+0000", 2024-05-07T14:03:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6289e-05 2024-05-07T14:03:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964636+0000", 2024-05-07T14:03:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016293899999999999 2024-05-07T14:03:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964792+0000", 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155513 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.979623+0000", 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014831657 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980052+0000", 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042865699999999999 2024-05-07T14:03:44.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980116+0000", 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4592999999999996e-05 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980173+0000", 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6530000000000003e-05 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2704 3.31 3:8c38a608:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.571596204, 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.024434902000000001, 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2704 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998965+0000", 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6809999999999998e-06 2024-05-07T14:03:44.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000686+0000", 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00172109 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000705+0000", 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8879999999999999e-05 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000718+0000", 2024-05-07T14:03:44.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2846e-05 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000794+0000", 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5613999999999998e-05 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000919+0000", 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000124924 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:44.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.001034+0000", 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115158 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.007009+0000", 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059753009999999997 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023250+0000", 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016240477 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023343+0000", 2024-05-07T14:03:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3362000000000005e-05 2024-05-07T14:03:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023397+0000", 2024-05-07T14:03:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4568999999999999e-05 2024-05-07T14:03:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2711 3.3e 3:7c13e116:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:44.642 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.084462+0000", 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.48609695200000003, 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014033208, 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2711 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.084462+0000", 2024-05-07T14:03:44.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.084462+0000", 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.084465+0000", 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.162e-06 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.086098+0000", 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001632793 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.086128+0000", 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.025e-05 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.086141+0000", 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3385e-05 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.086212+0000", 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0310999999999998e-05 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.086341+0000", 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129076 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.086452+0000", 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011094699999999999 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.097937+0000", 2024-05-07T14:03:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011485169999999999 2024-05-07T14:03:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.098377+0000", 2024-05-07T14:03:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00044008600000000001 2024-05-07T14:03:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.098442+0000", 2024-05-07T14:03:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4932999999999996e-05 2024-05-07T14:03:44.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.098495+0000", 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3094999999999999e-05 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2714 3.25 3:a6ff50b7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.120078+0000", 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.45048029000000001, 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012119688, 2024-05-07T14:03:44.648 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2714 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.120078+0000", 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.120078+0000", 2024-05-07T14:03:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.120081+0000", 2024-05-07T14:03:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2809999999999998e-06 2024-05-07T14:03:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.121775+0000", 2024-05-07T14:03:44.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016945319999999999 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.121799+0000", 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3839e-05 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.121812+0000", 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2513e-05 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.121882+0000", 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0807000000000002e-05 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.122031+0000", 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000148935 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.122119+0000", 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7173e-05 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.127094+0000", 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049751539999999999 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.132055+0000", 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049612620000000001 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.132123+0000", 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8127999999999996e-05 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.132198+0000", 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5063999999999998e-05 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2738 3.31 3:8f11b22f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.368415+0000", 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.20214354100000001, 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014754041000000001, 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.654 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2738 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.368415+0000", 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.368415+0000", 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.368418+0000", 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.162e-06 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370172+0000", 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001753533 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370198+0000", 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6458999999999999e-05 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370215+0000", 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6379999999999999e-05 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370304+0000", 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9149999999999999e-05 2024-05-07T14:03:44.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370479+0000", 2024-05-07T14:03:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017554199999999999 2024-05-07T14:03:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370647+0000", 2024-05-07T14:03:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016778799999999999 2024-05-07T14:03:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:44.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.376674+0000", 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0060270109999999997 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.383059+0000", 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063850670000000003 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.383120+0000", 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0730999999999998e-05 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.383169+0000", 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9218000000000002e-05 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2740 3.19 3:99b6803a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.390970+0000", 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.17958863, 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011591252999999999, 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.660 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2740 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.390970+0000", 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.390970+0000", 2024-05-07T14:03:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.390972+0000", 2024-05-07T14:03:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0980000000000001e-06 2024-05-07T14:03:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.392511+0000", 2024-05-07T14:03:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001538434 2024-05-07T14:03:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.392543+0000", 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2738999999999999e-05 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.392559+0000", 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6059999999999999e-05 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.392644+0000", 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4357999999999994e-05 2024-05-07T14:03:44.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.392791+0000", 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014703599999999999 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.392946+0000", 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015491600000000001 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.401849+0000", 2024-05-07T14:03:44.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0089027159999999998 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402446+0000", 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00059711400000000004 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402511+0000", 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5642000000000006e-05 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402561+0000", 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0139999999999998e-05 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2741 3.4 3:22c462fb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.402105+0000", 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.16845374699999999, 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014775256000000001, 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.666 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2741 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402105+0000", 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402105+0000", 2024-05-07T14:03:44.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402108+0000", 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.757e-06 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404192+0000", 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020845389999999998 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404223+0000", 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0790999999999997e-05 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404235+0000", 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2089999999999999e-05 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404302+0000", 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6656999999999996e-05 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404406+0000", 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010458699999999999 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404506+0000", 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9723999999999996e-05 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416118+0000", 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011611593 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416765+0000", 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064727999999999997 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416829+0000", 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4189999999999994e-05 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416880+0000", 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1048000000000003e-05 2024-05-07T14:03:44.671 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2743 3.8 e104/99 3:12ce00a0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_60:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.424088+0000", 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.14647080300000001, 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015852854, 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.424088+0000", 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.424088+0000", 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.424090+0000", 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8959999999999999e-06 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426151+0000", 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020615590000000001 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426175+0000", 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3292999999999999e-05 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426186+0000", 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1630999999999999e-05 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426348+0000", 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161898 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426383+0000", 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4483000000000002e-05 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.439870+0000", 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013486908000000001 2024-05-07T14:03:44.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.439941+0000", 2024-05-07T14:03:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1186000000000006e-05 2024-05-07T14:03:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:44.676 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:44.676 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:44.678 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:44.678 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:44.688+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:44.707 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.7 to 1 (10000) 2024-05-07T14:03:44.739 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-07T14:03:44.739 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:03:44.778 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:44.788+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:44.879 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:44.879 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:44.879 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:44.880 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:44.888+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:44.908 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:44.982 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:44.987+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:45.061 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:45.061 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:45.061 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:45.061 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:45.062 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:45.081 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:45.091+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:45.088 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:45.175 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:03:45.182 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:03:45.184 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:45.192+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:45.211 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-05-07T14:03:44.720354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070220028,"num_objects":468,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":468,"num_whiteouts":0,"num_read":2515,"num_read_kb":2220,"num_write":1410,"num_write_kb":1067588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":71899899,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2190,"ondisk_log_size":2190,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":543,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2349572,"kb_used_data":2100096,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":752625148,"statfs":{"total":773094113280,"available":770688151552,"internally_reserved":0,"allocated":2150498304,"data_stored":2146034460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-1,"num_objects_missing":-1,"num_objects_degraded":-4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-13,"num_read_kb":-13,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":29362813,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.078138"},"pg_stats":[{"pgid":"3.3f","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698514+0000","last_change":"2024-05-07T14:00:55.983744+0000","last_active":"2024-05-07T14:03:41.698514+0000","last_peered":"2024-05-07T14:03:41.698514+0000","last_clean":"2024-05-07T14:03:41.698514+0000","last_became_active":"2024-05-07T14:00:55.982993+0000","last_became_peered":"2024-05-07T14:00:55.982993+0000","last_unstale":"2024-05-07T14:03:41.698514+0000","last_undegraded":"2024-05-07T14:03:41.698514+0000","last_fullsized":"2024-05-07T14:03:41.698514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695581+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:03:41.695581+0000","last_peered":"2024-05-07T14:03:41.695581+0000","last_clean":"2024-05-07T14:03:41.695581+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:03:41.695581+0000","last_undegraded":"2024-05-07T14:03:41.695581+0000","last_fullsized":"2024-05-07T14:03:41.695581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"85'2","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709139+0000","last_change":"2024-05-07T14:03:39.850495+0000","last_active":"2024-05-07T14:03:41.709139+0000","last_peered":"2024-05-07T14:03:41.709139+0000","last_clean":"2024-05-07T14:03:41.709139+0000","last_became_active":"2024-05-07T14:03:39.676092+0000","last_became_peered":"2024-05-07T14:03:39.676092+0000","last_unstale":"2024-05-07T14:03:41.709139+0000","last_undegraded":"2024-05-07T14:03:41.709139+0000","last_fullsized":"2024-05-07T14:03:41.709139+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:00.668304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696652+0000","last_change":"2024-05-07T14:00:57.988092+0000","last_active":"2024-05-07T14:03:41.696652+0000","last_peered":"2024-05-07T14:03:41.696652+0000","last_clean":"2024-05-07T14:03:41.696652+0000","last_became_active":"2024-05-07T14:00:57.987091+0000","last_became_peered":"2024-05-07T14:00:57.987091+0000","last_unstale":"2024-05-07T14:03:41.696652+0000","last_undegraded":"2024-05-07T14:03:41.696652+0000","last_fullsized":"2024-05-07T14:03:41.696652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699224+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:03:41.699224+0000","last_peered":"2024-05-07T14:03:41.699224+0000","last_clean":"2024-05-07T14:03:41.699224+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:03:41.699224+0000","last_undegraded":"2024-05-07T14:03:41.699224+0000","last_fullsized":"2024-05-07T14:03:41.699224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703095+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:03:41.703095+0000","last_peered":"2024-05-07T14:03:41.703095+0000","last_clean":"2024-05-07T14:03:41.703095+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:03:41.703095+0000","last_undegraded":"2024-05-07T14:03:41.703095+0000","last_fullsized":"2024-05-07T14:03:41.703095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697166+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:03:41.697166+0000","last_peered":"2024-05-07T14:03:41.697166+0000","last_clean":"2024-05-07T14:03:41.697166+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:03:41.697166+0000","last_undegraded":"2024-05-07T14:03:41.697166+0000","last_fullsized":"2024-05-07T14:03:41.697166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698562+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:03:41.698562+0000","last_peered":"2024-05-07T14:03:41.698562+0000","last_clean":"2024-05-07T14:03:41.698562+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:03:41.698562+0000","last_undegraded":"2024-05-07T14:03:41.698562+0000","last_fullsized":"2024-05-07T14:03:41.698562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700018+0000","last_change":"2024-05-07T14:00:55.973419+0000","last_active":"2024-05-07T14:03:41.700018+0000","last_peered":"2024-05-07T14:03:41.700018+0000","last_clean":"2024-05-07T14:03:41.700018+0000","last_became_active":"2024-05-07T14:00:55.963467+0000","last_became_peered":"2024-05-07T14:00:55.963467+0000","last_unstale":"2024-05-07T14:03:41.700018+0000","last_undegraded":"2024-05-07T14:03:41.700018+0000","last_fullsized":"2024-05-07T14:03:41.700018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"81'2","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101634+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:03:42.101634+0000","last_peered":"2024-05-07T14:03:42.101634+0000","last_clean":"2024-05-07T14:03:42.101634+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:03:42.101634+0000","last_undegraded":"2024-05-07T14:03:42.101634+0000","last_fullsized":"2024-05-07T14:03:42.101634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"84'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695865+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:03:41.695865+0000","last_peered":"2024-05-07T14:03:41.695865+0000","last_clean":"2024-05-07T14:03:41.695865+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:03:41.695865+0000","last_undegraded":"2024-05-07T14:03:41.695865+0000","last_fullsized":"2024-05-07T14:03:41.695865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"81'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703652+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:03:41.703652+0000","last_peered":"2024-05-07T14:03:41.703652+0000","last_clean":"2024-05-07T14:03:41.703652+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:03:41.703652+0000","last_undegraded":"2024-05-07T14:03:41.703652+0000","last_fullsized":"2024-05-07T14:03:41.703652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"85'2","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697069+0000","last_change":"2024-05-07T14:00:55.962579+0000","last_active":"2024-05-07T14:03:41.697069+0000","last_peered":"2024-05-07T14:03:41.697069+0000","last_clean":"2024-05-07T14:03:41.697069+0000","last_became_active":"2024-05-07T14:00:55.961815+0000","last_became_peered":"2024-05-07T14:00:55.961815+0000","last_unstale":"2024-05-07T14:03:41.697069+0000","last_undegraded":"2024-05-07T14:03:41.697069+0000","last_fullsized":"2024-05-07T14:03:41.697069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697662+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:03:41.697662+0000","last_peered":"2024-05-07T14:03:41.697662+0000","last_clean":"2024-05-07T14:03:41.697662+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:03:41.697662+0000","last_undegraded":"2024-05-07T14:03:41.697662+0000","last_fullsized":"2024-05-07T14:03:41.697662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711126+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:03:41.711126+0000","last_peered":"2024-05-07T14:03:41.711126+0000","last_clean":"2024-05-07T14:03:41.711126+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:03:41.711126+0000","last_undegraded":"2024-05-07T14:03:41.711126+0000","last_fullsized":"2024-05-07T14:03:41.711126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'1","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707908+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:03:41.707908+0000","last_peered":"2024-05-07T14:03:41.707908+0000","last_clean":"2024-05-07T14:03:41.707908+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:03:41.707908+0000","last_undegraded":"2024-05-07T14:03:41.707908+0000","last_fullsized":"2024-05-07T14:03:41.707908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702369+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:03:41.702369+0000","last_peered":"2024-05-07T14:03:41.702369+0000","last_clean":"2024-05-07T14:03:41.702369+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:03:41.702369+0000","last_undegraded":"2024-05-07T14:03:41.702369+0000","last_fullsized":"2024-05-07T14:03:41.702369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698698+0000","last_change":"2024-05-07T14:00:56.003776+0000","last_active":"2024-05-07T14:03:41.698698+0000","last_peered":"2024-05-07T14:03:41.698698+0000","last_clean":"2024-05-07T14:03:41.698698+0000","last_became_active":"2024-05-07T14:00:56.002996+0000","last_became_peered":"2024-05-07T14:00:56.002996+0000","last_unstale":"2024-05-07T14:03:41.698698+0000","last_undegraded":"2024-05-07T14:03:41.698698+0000","last_fullsized":"2024-05-07T14:03:41.698698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:17.583140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696875+0000","last_change":"2024-05-07T14:00:57.987026+0000","last_active":"2024-05-07T14:03:41.696875+0000","last_peered":"2024-05-07T14:03:41.696875+0000","last_clean":"2024-05-07T14:03:41.696875+0000","last_became_active":"2024-05-07T14:00:57.986048+0000","last_became_peered":"2024-05-07T14:00:57.986048+0000","last_unstale":"2024-05-07T14:03:41.696875+0000","last_undegraded":"2024-05-07T14:03:41.696875+0000","last_fullsized":"2024-05-07T14:03:41.696875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101237+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:03:42.101237+0000","last_peered":"2024-05-07T14:03:42.101237+0000","last_clean":"2024-05-07T14:03:42.101237+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:03:42.101237+0000","last_undegraded":"2024-05-07T14:03:42.101237+0000","last_fullsized":"2024-05-07T14:03:42.101237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696308+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:03:41.696308+0000","last_peered":"2024-05-07T14:03:41.696308+0000","last_clean":"2024-05-07T14:03:41.696308+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:03:41.696308+0000","last_undegraded":"2024-05-07T14:03:41.696308+0000","last_fullsized":"2024-05-07T14:03:41.696308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"85'4","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101628+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:03:42.101628+0000","last_peered":"2024-05-07T14:03:42.101628+0000","last_clean":"2024-05-07T14:03:42.101628+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:03:42.101628+0000","last_undegraded":"2024-05-07T14:03:42.101628+0000","last_fullsized":"2024-05-07T14:03:42.101628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"81'8","reported_seq":204,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705740+0000","last_change":"2024-05-07T14:01:37.318563+0000","last_active":"2024-05-07T14:03:41.705740+0000","last_peered":"2024-05-07T14:03:41.705740+0000","last_clean":"2024-05-07T14:03:41.705740+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:03:41.705740+0000","last_undegraded":"2024-05-07T14:03:41.705740+0000","last_fullsized":"2024-05-07T14:03:41.705740+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:27.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702725+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:03:41.702725+0000","last_peered":"2024-05-07T14:03:41.702725+0000","last_clean":"2024-05-07T14:03:41.702725+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:03:41.702725+0000","last_undegraded":"2024-05-07T14:03:41.702725+0000","last_fullsized":"2024-05-07T14:03:41.702725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"94'3","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706201+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:03:41.706201+0000","last_peered":"2024-05-07T14:03:41.706201+0000","last_clean":"2024-05-07T14:03:41.706201+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:03:41.706201+0000","last_undegraded":"2024-05-07T14:03:41.706201+0000","last_fullsized":"2024-05-07T14:03:41.706201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711135+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:03:41.711135+0000","last_peered":"2024-05-07T14:03:41.711135+0000","last_clean":"2024-05-07T14:03:41.711135+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:03:41.711135+0000","last_undegraded":"2024-05-07T14:03:41.711135+0000","last_fullsized":"2024-05-07T14:03:41.711135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"94'1","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703758+0000","last_change":"2024-05-07T14:03:39.848413+0000","last_active":"2024-05-07T14:03:41.703758+0000","last_peered":"2024-05-07T14:03:41.703758+0000","last_clean":"2024-05-07T14:03:41.703758+0000","last_became_active":"2024-05-07T14:03:39.663590+0000","last_became_peered":"2024-05-07T14:03:39.663590+0000","last_unstale":"2024-05-07T14:03:41.703758+0000","last_undegraded":"2024-05-07T14:03:41.703758+0000","last_fullsized":"2024-05-07T14:03:41.703758+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:02.675624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"84'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700741+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:03:41.700741+0000","last_peered":"2024-05-07T14:03:41.700741+0000","last_clean":"2024-05-07T14:03:41.700741+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:03:41.700741+0000","last_undegraded":"2024-05-07T14:03:41.700741+0000","last_fullsized":"2024-05-07T14:03:41.700741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702020+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:03:41.702020+0000","last_peered":"2024-05-07T14:03:41.702020+0000","last_clean":"2024-05-07T14:03:41.702020+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:03:41.702020+0000","last_undegraded":"2024-05-07T14:03:41.702020+0000","last_fullsized":"2024-05-07T14:03:41.702020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"81'2","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711941+0000","last_change":"2024-05-07T14:03:39.857355+0000","last_active":"2024-05-07T14:03:41.711941+0000","last_peered":"2024-05-07T14:03:41.711941+0000","last_clean":"2024-05-07T14:03:41.711941+0000","last_became_active":"2024-05-07T14:03:39.680721+0000","last_became_peered":"2024-05-07T14:03:39.680721+0000","last_unstale":"2024-05-07T14:03:41.711941+0000","last_undegraded":"2024-05-07T14:03:41.711941+0000","last_fullsized":"2024-05-07T14:03:41.711941+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:36.092563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"85'3","reported_seq":122,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705434+0000","last_change":"2024-05-07T14:01:37.311718+0000","last_active":"2024-05-07T14:03:41.705434+0000","last_peered":"2024-05-07T14:03:41.705434+0000","last_clean":"2024-05-07T14:03:41.705434+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:03:41.705434+0000","last_undegraded":"2024-05-07T14:03:41.705434+0000","last_fullsized":"2024-05-07T14:03:41.705434+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:24.211300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696912+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:03:41.696912+0000","last_peered":"2024-05-07T14:03:41.696912+0000","last_clean":"2024-05-07T14:03:41.696912+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:03:41.696912+0000","last_undegraded":"2024-05-07T14:03:41.696912+0000","last_fullsized":"2024-05-07T14:03:41.696912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"85'14","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700862+0000","last_change":"2024-05-07T14:01:01.993679+0000","last_active":"2024-05-07T14:03:41.700862+0000","last_peered":"2024-05-07T14:03:41.700862+0000","last_clean":"2024-05-07T14:03:41.700862+0000","last_became_active":"2024-05-07T14:01:01.993241+0000","last_became_peered":"2024-05-07T14:01:01.993241+0000","last_unstale":"2024-05-07T14:03:41.700862+0000","last_undegraded":"2024-05-07T14:03:41.700862+0000","last_fullsized":"2024-05-07T14:03:41.700862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697732+0000","last_change":"2024-05-07T14:01:04.017472+0000","last_active":"2024-05-07T14:03:41.697732+0000","last_peered":"2024-05-07T14:03:41.697732+0000","last_clean":"2024-05-07T14:03:41.697732+0000","last_became_active":"2024-05-07T14:01:04.016757+0000","last_became_peered":"2024-05-07T14:01:04.016757+0000","last_unstale":"2024-05-07T14:03:41.697732+0000","last_undegraded":"2024-05-07T14:03:41.697732+0000","last_fullsized":"2024-05-07T14:03:41.697732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"94'39","reported_seq":206,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696205+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:03:41.696205+0000","last_peered":"2024-05-07T14:03:41.696205+0000","last_clean":"2024-05-07T14:03:41.696205+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:03:41.696205+0000","last_undegraded":"2024-05-07T14:03:41.696205+0000","last_fullsized":"2024-05-07T14:03:41.696205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":78,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"81'6","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697528+0000","last_change":"2024-05-07T14:00:57.984789+0000","last_active":"2024-05-07T14:03:41.697528+0000","last_peered":"2024-05-07T14:03:41.697528+0000","last_clean":"2024-05-07T14:03:41.697528+0000","last_became_active":"2024-05-07T14:00:57.983524+0000","last_became_peered":"2024-05-07T14:00:57.983524+0000","last_unstale":"2024-05-07T14:03:41.697528+0000","last_undegraded":"2024-05-07T14:03:41.697528+0000","last_fullsized":"2024-05-07T14:03:41.697528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"85'2","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.701078+0000","last_change":"2024-05-07T14:00:55.989797+0000","last_active":"2024-05-07T14:03:41.701078+0000","last_peered":"2024-05-07T14:03:41.701078+0000","last_clean":"2024-05-07T14:03:41.701078+0000","last_became_active":"2024-05-07T14:00:55.989449+0000","last_became_peered":"2024-05-07T14:00:55.989449+0000","last_unstale":"2024-05-07T14:03:41.701078+0000","last_undegraded":"2024-05-07T14:03:41.701078+0000","last_fullsized":"2024-05-07T14:03:41.701078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712162+0000","last_change":"2024-05-07T14:00:59.983880+0000","last_active":"2024-05-07T14:03:41.712162+0000","last_peered":"2024-05-07T14:03:41.712162+0000","last_clean":"2024-05-07T14:03:41.712162+0000","last_became_active":"2024-05-07T14:00:59.983186+0000","last_became_peered":"2024-05-07T14:00:59.983186+0000","last_unstale":"2024-05-07T14:03:41.712162+0000","last_undegraded":"2024-05-07T14:03:41.712162+0000","last_fullsized":"2024-05-07T14:03:41.712162+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:27.067433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"81'7","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703824+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:03:41.703824+0000","last_peered":"2024-05-07T14:03:41.703824+0000","last_clean":"2024-05-07T14:03:41.703824+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:03:41.703824+0000","last_undegraded":"2024-05-07T14:03:41.703824+0000","last_fullsized":"2024-05-07T14:03:41.703824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703701+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:03:41.703701+0000","last_peered":"2024-05-07T14:03:41.703701+0000","last_clean":"2024-05-07T14:03:41.703701+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:03:41.703701+0000","last_undegraded":"2024-05-07T14:03:41.703701+0000","last_fullsized":"2024-05-07T14:03:41.703701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"81'6","reported_seq":159,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700097+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:03:41.700097+0000","last_peered":"2024-05-07T14:03:41.700097+0000","last_clean":"2024-05-07T14:03:41.700097+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:03:41.700097+0000","last_undegraded":"2024-05-07T14:03:41.700097+0000","last_fullsized":"2024-05-07T14:03:41.700097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"81'4","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702846+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:03:41.702846+0000","last_peered":"2024-05-07T14:03:41.702846+0000","last_clean":"2024-05-07T14:03:41.702846+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:03:41.702846+0000","last_undegraded":"2024-05-07T14:03:41.702846+0000","last_fullsized":"2024-05-07T14:03:41.702846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"84'2","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697307+0000","last_change":"2024-05-07T14:00:55.986233+0000","last_active":"2024-05-07T14:03:41.697307+0000","last_peered":"2024-05-07T14:03:41.697307+0000","last_clean":"2024-05-07T14:03:41.697307+0000","last_became_active":"2024-05-07T14:00:55.984927+0000","last_became_peered":"2024-05-07T14:00:55.984927+0000","last_unstale":"2024-05-07T14:03:41.697307+0000","last_undegraded":"2024-05-07T14:03:41.697307+0000","last_fullsized":"2024-05-07T14:03:41.697307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712902+0000","last_change":"2024-05-07T14:03:39.680812+0000","last_active":"2024-05-07T14:03:41.712902+0000","last_peered":"2024-05-07T14:03:41.712902+0000","last_clean":"2024-05-07T14:03:41.712902+0000","last_became_active":"2024-05-07T14:03:39.680482+0000","last_became_peered":"2024-05-07T14:03:39.680482+0000","last_unstale":"2024-05-07T14:03:41.712902+0000","last_undegraded":"2024-05-07T14:03:41.712902+0000","last_fullsized":"2024-05-07T14:03:41.712902+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:07.705255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"81'13","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705975+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:03:41.705975+0000","last_peered":"2024-05-07T14:03:41.705975+0000","last_clean":"2024-05-07T14:03:41.705975+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:03:41.705975+0000","last_undegraded":"2024-05-07T14:03:41.705975+0000","last_fullsized":"2024-05-07T14:03:41.705975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"101'107","reported_seq":308,"reported_epoch":101,"state":"peering","last_fresh":"2024-05-07T14:03:40.794648+0000","last_change":"2024-05-07T14:03:41.697776+0000","last_active":"2024-05-07T14:03:41.697776+0000","last_peered":"2024-05-07T14:03:40.794648+0000","last_clean":"2024-05-07T14:03:37.621532+0000","last_became_active":"2024-05-07T14:03:40.774047+0000","last_became_peered":"2024-05-07T14:03:40.774047+0000","last_unstale":"2024-05-07T14:03:40.794648+0000","last_undegraded":"2024-05-07T14:03:40.794648+0000","last_fullsized":"2024-05-07T14:03:40.650243+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702478+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:03:41.702478+0000","last_peered":"2024-05-07T14:03:41.702478+0000","last_clean":"2024-05-07T14:03:41.702478+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:03:41.702478+0000","last_undegraded":"2024-05-07T14:03:41.702478+0000","last_fullsized":"2024-05-07T14:03:41.702478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"87'16","reported_seq":210,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711369+0000","last_change":"2024-05-07T14:00:57.998824+0000","last_active":"2024-05-07T14:03:41.711369+0000","last_peered":"2024-05-07T14:03:41.711369+0000","last_clean":"2024-05-07T14:03:41.711369+0000","last_became_active":"2024-05-07T14:00:57.998316+0000","last_became_peered":"2024-05-07T14:00:57.998316+0000","last_unstale":"2024-05-07T14:03:41.711369+0000","last_undegraded":"2024-05-07T14:03:41.711369+0000","last_fullsized":"2024-05-07T14:03:41.711369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"85'5","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100817+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:03:42.100817+0000","last_peered":"2024-05-07T14:03:42.100817+0000","last_clean":"2024-05-07T14:03:42.100817+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:03:42.100817+0000","last_undegraded":"2024-05-07T14:03:42.100817+0000","last_fullsized":"2024-05-07T14:03:42.100817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697576+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:03:41.697576+0000","last_peered":"2024-05-07T14:03:41.697576+0000","last_clean":"2024-05-07T14:03:41.697576+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:03:41.697576+0000","last_undegraded":"2024-05-07T14:03:41.697576+0000","last_fullsized":"2024-05-07T14:03:41.697576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"85'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698730+0000","last_change":"2024-05-07T14:01:02.151107+0000","last_active":"2024-05-07T14:03:41.698730+0000","last_peered":"2024-05-07T14:03:41.698730+0000","last_clean":"2024-05-07T14:03:41.698730+0000","last_became_active":"2024-05-07T14:01:02.150351+0000","last_became_peered":"2024-05-07T14:01:02.150351+0000","last_unstale":"2024-05-07T14:03:41.698730+0000","last_undegraded":"2024-05-07T14:03:41.698730+0000","last_fullsized":"2024-05-07T14:03:41.698730+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:28:13.159757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"94'104","reported_seq":291,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712487+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:03:41.712487+0000","last_peered":"2024-05-07T14:03:41.712487+0000","last_clean":"2024-05-07T14:03:41.712487+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:03:41.712487+0000","last_undegraded":"2024-05-07T14:03:41.712487+0000","last_fullsized":"2024-05-07T14:03:41.712487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"81'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696756+0000","last_change":"2024-05-07T14:00:57.979757+0000","last_active":"2024-05-07T14:03:41.696756+0000","last_peered":"2024-05-07T14:03:41.696756+0000","last_clean":"2024-05-07T14:03:41.696756+0000","last_became_active":"2024-05-07T14:00:57.979030+0000","last_became_peered":"2024-05-07T14:00:57.979030+0000","last_unstale":"2024-05-07T14:03:41.696756+0000","last_undegraded":"2024-05-07T14:03:41.696756+0000","last_fullsized":"2024-05-07T14:03:41.696756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"84'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699145+0000","last_change":"2024-05-07T14:00:55.980339+0000","last_active":"2024-05-07T14:03:41.699145+0000","last_peered":"2024-05-07T14:03:41.699145+0000","last_clean":"2024-05-07T14:03:41.699145+0000","last_became_active":"2024-05-07T14:00:55.979609+0000","last_became_peered":"2024-05-07T14:00:55.979609+0000","last_unstale":"2024-05-07T14:03:41.699145+0000","last_undegraded":"2024-05-07T14:03:41.699145+0000","last_fullsized":"2024-05-07T14:03:41.699145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:52.518278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695894+0000","last_change":"2024-05-07T14:00:59.982771+0000","last_active":"2024-05-07T14:03:41.695894+0000","last_peered":"2024-05-07T14:03:41.695894+0000","last_clean":"2024-05-07T14:03:41.695894+0000","last_became_active":"2024-05-07T14:00:59.982018+0000","last_became_peered":"2024-05-07T14:00:59.982018+0000","last_unstale":"2024-05-07T14:03:41.695894+0000","last_undegraded":"2024-05-07T14:03:41.695894+0000","last_fullsized":"2024-05-07T14:03:41.695894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:47.657483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"85'24","reported_seq":195,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695119+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:03:41.695119+0000","last_peered":"2024-05-07T14:03:41.695119+0000","last_clean":"2024-05-07T14:03:41.695119+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:03:41.695119+0000","last_undegraded":"2024-05-07T14:03:41.695119+0000","last_fullsized":"2024-05-07T14:03:41.695119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709481+0000","last_change":"2024-05-07T14:03:39.666526+0000","last_active":"2024-05-07T14:03:41.709481+0000","last_peered":"2024-05-07T14:03:41.709481+0000","last_clean":"2024-05-07T14:03:41.709481+0000","last_became_active":"2024-05-07T14:03:39.666160+0000","last_became_peered":"2024-05-07T14:03:39.666160+0000","last_unstale":"2024-05-07T14:03:41.709481+0000","last_undegraded":"2024-05-07T14:03:41.709481+0000","last_fullsized":"2024-05-07T14:03:41.709481+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:44.560061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696931+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:03:41.696931+0000","last_peered":"2024-05-07T14:03:41.696931+0000","last_clean":"2024-05-07T14:03:41.696931+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:03:41.696931+0000","last_undegraded":"2024-05-07T14:03:41.696931+0000","last_fullsized":"2024-05-07T14:03:41.696931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703320+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:03:41.703320+0000","last_peered":"2024-05-07T14:03:41.703320+0000","last_clean":"2024-05-07T14:03:41.703320+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:03:41.703320+0000","last_undegraded":"2024-05-07T14:03:41.703320+0000","last_fullsized":"2024-05-07T14:03:41.703320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700274+0000","last_change":"2024-05-07T14:00:55.980488+0000","last_active":"2024-05-07T14:03:41.700274+0000","last_peered":"2024-05-07T14:03:41.700274+0000","last_clean":"2024-05-07T14:03:41.700274+0000","last_became_active":"2024-05-07T14:00:55.979688+0000","last_became_peered":"2024-05-07T14:00:55.979688+0000","last_unstale":"2024-05-07T14:03:41.700274+0000","last_undegraded":"2024-05-07T14:03:41.700274+0000","last_fullsized":"2024-05-07T14:03:41.700274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:32.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":232,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705567+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:03:41.705567+0000","last_peered":"2024-05-07T14:03:41.705567+0000","last_clean":"2024-05-07T14:03:41.705567+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:03:41.705567+0000","last_undegraded":"2024-05-07T14:03:41.705567+0000","last_fullsized":"2024-05-07T14:03:41.705567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"85'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.714072+0000","last_change":"2024-05-07T14:01:02.014265+0000","last_active":"2024-05-07T14:03:41.714072+0000","last_peered":"2024-05-07T14:03:41.714072+0000","last_clean":"2024-05-07T14:03:41.714072+0000","last_became_active":"2024-05-07T14:01:02.009335+0000","last_became_peered":"2024-05-07T14:01:02.009335+0000","last_unstale":"2024-05-07T14:03:41.714072+0000","last_undegraded":"2024-05-07T14:03:41.714072+0000","last_fullsized":"2024-05-07T14:03:41.714072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710085+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:03:41.710085+0000","last_peered":"2024-05-07T14:03:41.710085+0000","last_clean":"2024-05-07T14:03:41.710085+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:03:41.710085+0000","last_undegraded":"2024-05-07T14:03:41.710085+0000","last_fullsized":"2024-05-07T14:03:41.710085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100937+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:03:42.100937+0000","last_peered":"2024-05-07T14:03:42.100937+0000","last_clean":"2024-05-07T14:03:42.100937+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:03:42.100937+0000","last_undegraded":"2024-05-07T14:03:42.100937+0000","last_fullsized":"2024-05-07T14:03:42.100937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"81'6","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101300+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:03:42.101300+0000","last_peered":"2024-05-07T14:03:42.101300+0000","last_clean":"2024-05-07T14:03:42.101300+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:03:42.101300+0000","last_undegraded":"2024-05-07T14:03:42.101300+0000","last_fullsized":"2024-05-07T14:03:42.101300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699570+0000","last_change":"2024-05-07T14:00:56.008026+0000","last_active":"2024-05-07T14:03:41.699570+0000","last_peered":"2024-05-07T14:03:41.699570+0000","last_clean":"2024-05-07T14:03:41.699570+0000","last_became_active":"2024-05-07T14:00:56.007374+0000","last_became_peered":"2024-05-07T14:00:56.007374+0000","last_unstale":"2024-05-07T14:03:41.699570+0000","last_undegraded":"2024-05-07T14:03:41.699570+0000","last_fullsized":"2024-05-07T14:03:41.699570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707009+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:03:41.707009+0000","last_peered":"2024-05-07T14:03:41.707009+0000","last_clean":"2024-05-07T14:03:41.707009+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:03:41.707009+0000","last_undegraded":"2024-05-07T14:03:41.707009+0000","last_fullsized":"2024-05-07T14:03:41.707009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"85'20","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697713+0000","last_change":"2024-05-07T14:01:01.997489+0000","last_active":"2024-05-07T14:03:41.697713+0000","last_peered":"2024-05-07T14:03:41.697713+0000","last_clean":"2024-05-07T14:03:41.697713+0000","last_became_active":"2024-05-07T14:01:01.994656+0000","last_became_peered":"2024-05-07T14:01:01.994656+0000","last_unstale":"2024-05-07T14:03:41.697713+0000","last_undegraded":"2024-05-07T14:03:41.697713+0000","last_fullsized":"2024-05-07T14:03:41.697713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:12.091721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"101'107","reported_seq":307,"reported_epoch":101,"state":"peering","last_fresh":"2024-05-07T14:03:40.791852+0000","last_change":"2024-05-07T14:03:41.699155+0000","last_active":"2024-05-07T14:03:41.699155+0000","last_peered":"2024-05-07T14:03:40.791852+0000","last_clean":"2024-05-07T14:03:37.947580+0000","last_became_active":"2024-05-07T14:03:40.773668+0000","last_became_peered":"2024-05-07T14:03:40.773668+0000","last_unstale":"2024-05-07T14:03:40.791852+0000","last_undegraded":"2024-05-07T14:03:40.791852+0000","last_fullsized":"2024-05-07T14:03:40.647524+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.701255+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:03:41.701255+0000","last_peered":"2024-05-07T14:03:41.701255+0000","last_clean":"2024-05-07T14:03:41.701255+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:03:41.701255+0000","last_undegraded":"2024-05-07T14:03:41.701255+0000","last_fullsized":"2024-05-07T14:03:41.701255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"81'8","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700540+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:03:41.700540+0000","last_peered":"2024-05-07T14:03:41.700540+0000","last_clean":"2024-05-07T14:03:41.700540+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:03:41.700540+0000","last_undegraded":"2024-05-07T14:03:41.700540+0000","last_fullsized":"2024-05-07T14:03:41.700540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698973+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:03:41.698973+0000","last_peered":"2024-05-07T14:03:41.698973+0000","last_clean":"2024-05-07T14:03:41.698973+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:03:41.698973+0000","last_undegraded":"2024-05-07T14:03:41.698973+0000","last_fullsized":"2024-05-07T14:03:41.698973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706893+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:03:41.706893+0000","last_peered":"2024-05-07T14:03:41.706893+0000","last_clean":"2024-05-07T14:03:41.706893+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:03:41.706893+0000","last_undegraded":"2024-05-07T14:03:41.706893+0000","last_fullsized":"2024-05-07T14:03:41.706893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"85'22","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698263+0000","last_change":"2024-05-07T14:01:01.995144+0000","last_active":"2024-05-07T14:03:41.698263+0000","last_peered":"2024-05-07T14:03:41.698263+0000","last_clean":"2024-05-07T14:03:41.698263+0000","last_became_active":"2024-05-07T14:01:01.993073+0000","last_became_peered":"2024-05-07T14:01:01.993073+0000","last_unstale":"2024-05-07T14:03:41.698263+0000","last_undegraded":"2024-05-07T14:03:41.698263+0000","last_fullsized":"2024-05-07T14:03:41.698263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:54.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704464+0000","last_change":"2024-05-07T14:01:04.012216+0000","last_active":"2024-05-07T14:03:41.704464+0000","last_peered":"2024-05-07T14:03:41.704464+0000","last_clean":"2024-05-07T14:03:41.704464+0000","last_became_active":"2024-05-07T14:01:04.011476+0000","last_became_peered":"2024-05-07T14:01:04.011476+0000","last_unstale":"2024-05-07T14:03:41.704464+0000","last_undegraded":"2024-05-07T14:03:41.704464+0000","last_fullsized":"2024-05-07T14:03:41.704464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:46.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'4","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708936+0000","last_change":"2024-05-07T14:03:39.802033+0000","last_active":"2024-05-07T14:03:41.708936+0000","last_peered":"2024-05-07T14:03:41.708936+0000","last_clean":"2024-05-07T14:03:41.708936+0000","last_became_active":"2024-05-07T14:03:39.675695+0000","last_became_peered":"2024-05-07T14:03:39.675695+0000","last_unstale":"2024-05-07T14:03:41.708936+0000","last_undegraded":"2024-05-07T14:03:41.708936+0000","last_fullsized":"2024-05-07T14:03:41.708936+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:22:02.594405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"87'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702884+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:03:41.702884+0000","last_peered":"2024-05-07T14:03:41.702884+0000","last_clean":"2024-05-07T14:03:41.702884+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:03:41.702884+0000","last_undegraded":"2024-05-07T14:03:41.702884+0000","last_fullsized":"2024-05-07T14:03:41.702884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710775+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:03:41.710775+0000","last_peered":"2024-05-07T14:03:41.710775+0000","last_clean":"2024-05-07T14:03:41.710775+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:03:41.710775+0000","last_undegraded":"2024-05-07T14:03:41.710775+0000","last_fullsized":"2024-05-07T14:03:41.710775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705310+0000","last_change":"2024-05-07T14:00:59.992897+0000","last_active":"2024-05-07T14:03:41.705310+0000","last_peered":"2024-05-07T14:03:41.705310+0000","last_clean":"2024-05-07T14:03:41.705310+0000","last_became_active":"2024-05-07T14:00:59.992067+0000","last_became_peered":"2024-05-07T14:00:59.992067+0000","last_unstale":"2024-05-07T14:03:41.705310+0000","last_undegraded":"2024-05-07T14:03:41.705310+0000","last_fullsized":"2024-05-07T14:03:41.705310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:19.526884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"85'18","reported_seq":219,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703791+0000","last_change":"2024-05-07T14:03:39.698456+0000","last_active":"2024-05-07T14:03:41.703791+0000","last_peered":"2024-05-07T14:03:41.703791+0000","last_clean":"2024-05-07T14:03:41.703791+0000","last_became_active":"2024-05-07T14:03:39.663223+0000","last_became_peered":"2024-05-07T14:03:39.663223+0000","last_unstale":"2024-05-07T14:03:41.703791+0000","last_undegraded":"2024-05-07T14:03:41.703791+0000","last_fullsized":"2024-05-07T14:03:41.703791+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:58.582121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699535+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:03:41.699535+0000","last_peered":"2024-05-07T14:03:41.699535+0000","last_clean":"2024-05-07T14:03:41.699535+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:03:41.699535+0000","last_undegraded":"2024-05-07T14:03:41.699535+0000","last_fullsized":"2024-05-07T14:03:41.699535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"94'5","reported_seq":159,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712479+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:03:41.712479+0000","last_peered":"2024-05-07T14:03:41.712479+0000","last_clean":"2024-05-07T14:03:41.712479+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:03:41.712479+0000","last_undegraded":"2024-05-07T14:03:41.712479+0000","last_fullsized":"2024-05-07T14:03:41.712479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"94'10","reported_seq":205,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703860+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:03:41.703860+0000","last_peered":"2024-05-07T14:03:41.703860+0000","last_clean":"2024-05-07T14:03:41.703860+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:03:41.703860+0000","last_undegraded":"2024-05-07T14:03:41.703860+0000","last_fullsized":"2024-05-07T14:03:41.703860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101506+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:03:42.101506+0000","last_peered":"2024-05-07T14:03:42.101506+0000","last_clean":"2024-05-07T14:03:42.101506+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:03:42.101506+0000","last_undegraded":"2024-05-07T14:03:42.101506+0000","last_fullsized":"2024-05-07T14:03:42.101506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707587+0000","last_change":"2024-05-07T14:03:39.714297+0000","last_active":"2024-05-07T14:03:41.707587+0000","last_peered":"2024-05-07T14:03:41.707587+0000","last_clean":"2024-05-07T14:03:41.707587+0000","last_became_active":"2024-05-07T14:03:39.663013+0000","last_became_peered":"2024-05-07T14:03:39.663013+0000","last_unstale":"2024-05-07T14:03:41.707587+0000","last_undegraded":"2024-05-07T14:03:41.707587+0000","last_fullsized":"2024-05-07T14:03:41.707587+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:40:56.207747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"85'21","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707504+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:03:41.707504+0000","last_peered":"2024-05-07T14:03:41.707504+0000","last_clean":"2024-05-07T14:03:41.707504+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:03:41.707504+0000","last_undegraded":"2024-05-07T14:03:41.707504+0000","last_fullsized":"2024-05-07T14:03:41.707504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"94'104","reported_seq":302,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705231+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:03:41.705231+0000","last_peered":"2024-05-07T14:03:41.705231+0000","last_clean":"2024-05-07T14:03:41.705231+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:03:41.705231+0000","last_undegraded":"2024-05-07T14:03:41.705231+0000","last_fullsized":"2024-05-07T14:03:41.705231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"87'4","reported_seq":156,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710042+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:03:41.710042+0000","last_peered":"2024-05-07T14:03:41.710042+0000","last_clean":"2024-05-07T14:03:41.710042+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:03:41.710042+0000","last_undegraded":"2024-05-07T14:03:41.710042+0000","last_fullsized":"2024-05-07T14:03:41.710042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"94'7","reported_seq":194,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704217+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:03:41.704217+0000","last_peered":"2024-05-07T14:03:41.704217+0000","last_clean":"2024-05-07T14:03:41.704217+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:03:41.704217+0000","last_undegraded":"2024-05-07T14:03:41.704217+0000","last_fullsized":"2024-05-07T14:03:41.704217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"85'4","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703666+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:03:41.703666+0000","last_peered":"2024-05-07T14:03:41.703666+0000","last_clean":"2024-05-07T14:03:41.703666+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:03:41.703666+0000","last_undegraded":"2024-05-07T14:03:41.703666+0000","last_fullsized":"2024-05-07T14:03:41.703666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":303,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697177+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:03:41.697177+0000","last_peered":"2024-05-07T14:03:41.697177+0000","last_clean":"2024-05-07T14:03:41.697177+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:03:41.697177+0000","last_undegraded":"2024-05-07T14:03:41.697177+0000","last_fullsized":"2024-05-07T14:03:41.697177+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712429+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:03:41.712429+0000","last_peered":"2024-05-07T14:03:41.712429+0000","last_clean":"2024-05-07T14:03:41.712429+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:03:41.712429+0000","last_undegraded":"2024-05-07T14:03:41.712429+0000","last_fullsized":"2024-05-07T14:03:41.712429+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"94'104","reported_seq":293,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101190+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:03:42.101190+0000","last_peered":"2024-05-07T14:03:42.101190+0000","last_clean":"2024-05-07T14:03:42.101190+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:03:42.101190+0000","last_undegraded":"2024-05-07T14:03:42.101190+0000","last_fullsized":"2024-05-07T14:03:42.101190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"87'6","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702966+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:03:41.702966+0000","last_peered":"2024-05-07T14:03:41.702966+0000","last_clean":"2024-05-07T14:03:41.702966+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:03:41.702966+0000","last_undegraded":"2024-05-07T14:03:41.702966+0000","last_fullsized":"2024-05-07T14:03:41.702966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"87'4","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710184+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:03:41.710184+0000","last_peered":"2024-05-07T14:03:41.710184+0000","last_clean":"2024-05-07T14:03:41.710184+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:03:41.710184+0000","last_undegraded":"2024-05-07T14:03:41.710184+0000","last_fullsized":"2024-05-07T14:03:41.710184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"85'5","reported_seq":210,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710874+0000","last_change":"2024-05-07T14:03:39.814768+0000","last_active":"2024-05-07T14:03:41.710874+0000","last_peered":"2024-05-07T14:03:41.710874+0000","last_clean":"2024-05-07T14:03:41.710874+0000","last_became_active":"2024-05-07T14:03:39.666192+0000","last_became_peered":"2024-05-07T14:03:39.666192+0000","last_unstale":"2024-05-07T14:03:41.710874+0000","last_undegraded":"2024-05-07T14:03:41.710874+0000","last_fullsized":"2024-05-07T14:03:41.710874+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:10.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704043+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:03:41.704043+0000","last_peered":"2024-05-07T14:03:41.704043+0000","last_clean":"2024-05-07T14:03:41.704043+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:03:41.704043+0000","last_undegraded":"2024-05-07T14:03:41.704043+0000","last_fullsized":"2024-05-07T14:03:41.704043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"85'22","reported_seq":238,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696798+0000","last_change":"2024-05-07T14:03:39.845058+0000","last_active":"2024-05-07T14:03:41.696798+0000","last_peered":"2024-05-07T14:03:41.696798+0000","last_clean":"2024-05-07T14:03:41.696798+0000","last_became_active":"2024-05-07T14:03:39.673995+0000","last_became_peered":"2024-05-07T14:03:39.673995+0000","last_unstale":"2024-05-07T14:03:41.696798+0000","last_undegraded":"2024-05-07T14:03:41.696798+0000","last_fullsized":"2024-05-07T14:03:41.696798+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:43.919444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101145+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:03:42.101145+0000","last_peered":"2024-05-07T14:03:42.101145+0000","last_clean":"2024-05-07T14:03:42.101145+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:03:42.101145+0000","last_undegraded":"2024-05-07T14:03:42.101145+0000","last_fullsized":"2024-05-07T14:03:42.101145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708622+0000","last_change":"2024-05-07T14:03:39.666268+0000","last_active":"2024-05-07T14:03:41.708622+0000","last_peered":"2024-05-07T14:03:41.708622+0000","last_clean":"2024-05-07T14:03:41.708622+0000","last_became_active":"2024-05-07T14:03:39.665838+0000","last_became_peered":"2024-05-07T14:03:39.665838+0000","last_unstale":"2024-05-07T14:03:41.708622+0000","last_undegraded":"2024-05-07T14:03:41.708622+0000","last_fullsized":"2024-05-07T14:03:41.708622+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:54:00.122392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101420+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:03:42.101420+0000","last_peered":"2024-05-07T14:03:42.101420+0000","last_clean":"2024-05-07T14:03:42.101420+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:03:42.101420+0000","last_undegraded":"2024-05-07T14:03:42.101420+0000","last_fullsized":"2024-05-07T14:03:42.101420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100554+0000","last_change":"2024-05-07T14:02:39.729323+0000","last_active":"2024-05-07T14:03:42.100554+0000","last_peered":"2024-05-07T14:03:42.100554+0000","last_clean":"2024-05-07T14:03:42.100554+0000","last_became_active":"2024-05-07T14:02:39.728189+0000","last_became_peered":"2024-05-07T14:02:39.728189+0000","last_unstale":"2024-05-07T14:03:42.100554+0000","last_undegraded":"2024-05-07T14:03:42.100554+0000","last_fullsized":"2024-05-07T14:03:42.100554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:53:59.368912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697643+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:03:41.697643+0000","last_peered":"2024-05-07T14:03:41.697643+0000","last_clean":"2024-05-07T14:03:41.697643+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:03:41.697643+0000","last_undegraded":"2024-05-07T14:03:41.697643+0000","last_fullsized":"2024-05-07T14:03:41.697643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'4","reported_seq":124,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706333+0000","last_change":"2024-05-07T14:01:37.317794+0000","last_active":"2024-05-07T14:03:41.706333+0000","last_peered":"2024-05-07T14:03:41.706333+0000","last_clean":"2024-05-07T14:03:41.706333+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:03:41.706333+0000","last_undegraded":"2024-05-07T14:03:41.706333+0000","last_fullsized":"2024-05-07T14:03:41.706333+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:17.582561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700564+0000","last_change":"2024-05-07T14:00:59.988489+0000","last_active":"2024-05-07T14:03:41.700564+0000","last_peered":"2024-05-07T14:03:41.700564+0000","last_clean":"2024-05-07T14:03:41.700564+0000","last_became_active":"2024-05-07T14:00:59.987757+0000","last_became_peered":"2024-05-07T14:00:59.987757+0000","last_unstale":"2024-05-07T14:03:41.700564+0000","last_undegraded":"2024-05-07T14:03:41.700564+0000","last_fullsized":"2024-05-07T14:03:41.700564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"87'29","reported_seq":202,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697712+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:03:41.697712+0000","last_peered":"2024-05-07T14:03:41.697712+0000","last_clean":"2024-05-07T14:03:41.697712+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:03:41.697712+0000","last_undegraded":"2024-05-07T14:03:41.697712+0000","last_fullsized":"2024-05-07T14:03:41.697712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.701578+0000","last_change":"2024-05-07T14:01:04.007712+0000","last_active":"2024-05-07T14:03:41.701578+0000","last_peered":"2024-05-07T14:03:41.701578+0000","last_clean":"2024-05-07T14:03:41.701578+0000","last_became_active":"2024-05-07T14:01:04.006934+0000","last_became_peered":"2024-05-07T14:01:04.006934+0000","last_unstale":"2024-05-07T14:03:41.701578+0000","last_undegraded":"2024-05-07T14:03:41.701578+0000","last_fullsized":"2024-05-07T14:03:41.701578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100677+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:03:42.100677+0000","last_peered":"2024-05-07T14:03:42.100677+0000","last_clean":"2024-05-07T14:03:42.100677+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:03:42.100677+0000","last_undegraded":"2024-05-07T14:03:42.100677+0000","last_fullsized":"2024-05-07T14:03:42.100677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'2","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702434+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:03:41.702434+0000","last_peered":"2024-05-07T14:03:41.702434+0000","last_clean":"2024-05-07T14:03:41.702434+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:03:41.702434+0000","last_undegraded":"2024-05-07T14:03:41.702434+0000","last_fullsized":"2024-05-07T14:03:41.702434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695809+0000","last_change":"2024-05-07T14:03:39.661648+0000","last_active":"2024-05-07T14:03:41.695809+0000","last_peered":"2024-05-07T14:03:41.695809+0000","last_clean":"2024-05-07T14:03:41.695809+0000","last_became_active":"2024-05-07T14:03:39.660828+0000","last_became_peered":"2024-05-07T14:03:39.660828+0000","last_unstale":"2024-05-07T14:03:41.695809+0000","last_undegraded":"2024-05-07T14:03:41.695809+0000","last_fullsized":"2024-05-07T14:03:41.695809+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:55:55.161988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":170,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698566+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:03:41.698566+0000","last_peered":"2024-05-07T14:03:41.698566+0000","last_clean":"2024-05-07T14:03:41.698566+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:03:41.698566+0000","last_undegraded":"2024-05-07T14:03:41.698566+0000","last_fullsized":"2024-05-07T14:03:41.698566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698210+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:03:41.698210+0000","last_peered":"2024-05-07T14:03:41.698210+0000","last_clean":"2024-05-07T14:03:41.698210+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:03:41.698210+0000","last_undegraded":"2024-05-07T14:03:41.698210+0000","last_fullsized":"2024-05-07T14:03:41.698210+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"101'110","reported_seq":362,"reported_epoch":102,"state":"peering","last_fresh":"2024-05-07T14:03:40.790413+0000","last_change":"2024-05-07T14:03:42.630857+0000","last_active":"2024-05-07T14:03:42.630857+0000","last_peered":"2024-05-07T14:03:40.790413+0000","last_clean":"2024-05-07T14:03:30.102584+0000","last_became_active":"2024-05-07T14:03:40.773656+0000","last_became_peered":"2024-05-07T14:03:40.773656+0000","last_unstale":"2024-05-07T14:03:40.790413+0000","last_undegraded":"2024-05-07T14:03:40.790413+0000","last_fullsized":"2024-05-07T14:03:40.790413+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5457,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":148,"num_read_kb":136,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698407+0000","last_change":"2024-05-07T14:01:04.012527+0000","last_active":"2024-05-07T14:03:41.698407+0000","last_peered":"2024-05-07T14:03:41.698407+0000","last_clean":"2024-05-07T14:03:41.698407+0000","last_became_active":"2024-05-07T14:01:04.007658+0000","last_became_peered":"2024-05-07T14:01:04.007658+0000","last_unstale":"2024-05-07T14:03:41.698407+0000","last_undegraded":"2024-05-07T14:03:41.698407+0000","last_fullsized":"2024-05-07T14:03:41.698407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"80'4","reported_seq":156,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708582+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:03:41.708582+0000","last_peered":"2024-05-07T14:03:41.708582+0000","last_clean":"2024-05-07T14:03:41.708582+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:03:41.708582+0000","last_undegraded":"2024-05-07T14:03:41.708582+0000","last_fullsized":"2024-05-07T14:03:41.708582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"81'2","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708346+0000","last_change":"2024-05-07T14:03:39.711373+0000","last_active":"2024-05-07T14:03:41.708346+0000","last_peered":"2024-05-07T14:03:41.708346+0000","last_clean":"2024-05-07T14:03:41.708346+0000","last_became_active":"2024-05-07T14:03:39.667130+0000","last_became_peered":"2024-05-07T14:03:39.667130+0000","last_unstale":"2024-05-07T14:03:41.708346+0000","last_undegraded":"2024-05-07T14:03:41.708346+0000","last_fullsized":"2024-05-07T14:03:41.708346+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:36.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705272+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:03:41.705272+0000","last_peered":"2024-05-07T14:03:41.705272+0000","last_clean":"2024-05-07T14:03:41.705272+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:03:41.705272+0000","last_undegraded":"2024-05-07T14:03:41.705272+0000","last_fullsized":"2024-05-07T14:03:41.705272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"85'6","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709743+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:03:41.709743+0000","last_peered":"2024-05-07T14:03:41.709743+0000","last_clean":"2024-05-07T14:03:41.709743+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:03:41.709743+0000","last_undegraded":"2024-05-07T14:03:41.709743+0000","last_fullsized":"2024-05-07T14:03:41.709743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705436+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:03:41.705436+0000","last_peered":"2024-05-07T14:03:41.705436+0000","last_clean":"2024-05-07T14:03:41.705436+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:03:41.705436+0000","last_undegraded":"2024-05-07T14:03:41.705436+0000","last_fullsized":"2024-05-07T14:03:41.705436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":212,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699075+0000","last_change":"2024-05-07T14:01:02.148182+0000","last_active":"2024-05-07T14:03:41.699075+0000","last_peered":"2024-05-07T14:03:41.699075+0000","last_clean":"2024-05-07T14:03:41.699075+0000","last_became_active":"2024-05-07T14:01:02.147442+0000","last_became_peered":"2024-05-07T14:01:02.147442+0000","last_unstale":"2024-05-07T14:03:41.699075+0000","last_undegraded":"2024-05-07T14:03:41.699075+0000","last_fullsized":"2024-05-07T14:03:41.699075+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:24.955989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700363+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:03:41.700363+0000","last_peered":"2024-05-07T14:03:41.700363+0000","last_clean":"2024-05-07T14:03:41.700363+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:03:41.700363+0000","last_undegraded":"2024-05-07T14:03:41.700363+0000","last_fullsized":"2024-05-07T14:03:41.700363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711345+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:03:41.711345+0000","last_peered":"2024-05-07T14:03:41.711345+0000","last_clean":"2024-05-07T14:03:41.711345+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:03:41.711345+0000","last_undegraded":"2024-05-07T14:03:41.711345+0000","last_fullsized":"2024-05-07T14:03:41.711345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"81'4","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707687+0000","last_change":"2024-05-07T14:03:39.687600+0000","last_active":"2024-05-07T14:03:41.707687+0000","last_peered":"2024-05-07T14:03:41.707687+0000","last_clean":"2024-05-07T14:03:41.707687+0000","last_became_active":"2024-05-07T14:03:39.661295+0000","last_became_peered":"2024-05-07T14:03:39.661295+0000","last_unstale":"2024-05-07T14:03:41.707687+0000","last_undegraded":"2024-05-07T14:03:41.707687+0000","last_fullsized":"2024-05-07T14:03:41.707687+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:17:58.416324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697844+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:03:41.697844+0000","last_peered":"2024-05-07T14:03:41.697844+0000","last_clean":"2024-05-07T14:03:41.697844+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:03:41.697844+0000","last_undegraded":"2024-05-07T14:03:41.697844+0000","last_fullsized":"2024-05-07T14:03:41.697844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"85'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702966+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:03:41.702966+0000","last_peered":"2024-05-07T14:03:41.702966+0000","last_clean":"2024-05-07T14:03:41.702966+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:03:41.702966+0000","last_undegraded":"2024-05-07T14:03:41.702966+0000","last_fullsized":"2024-05-07T14:03:41.702966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698782+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:03:41.698782+0000","last_peered":"2024-05-07T14:03:41.698782+0000","last_clean":"2024-05-07T14:03:41.698782+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:03:41.698782+0000","last_undegraded":"2024-05-07T14:03:41.698782+0000","last_fullsized":"2024-05-07T14:03:41.698782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710939+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:03:41.710939+0000","last_peered":"2024-05-07T14:03:41.710939+0000","last_clean":"2024-05-07T14:03:41.710939+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:03:41.710939+0000","last_undegraded":"2024-05-07T14:03:41.710939+0000","last_fullsized":"2024-05-07T14:03:41.710939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101592+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:03:42.101592+0000","last_peered":"2024-05-07T14:03:42.101592+0000","last_clean":"2024-05-07T14:03:42.101592+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:03:42.101592+0000","last_undegraded":"2024-05-07T14:03:42.101592+0000","last_fullsized":"2024-05-07T14:03:42.101592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695342+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:03:41.695342+0000","last_peered":"2024-05-07T14:03:41.695342+0000","last_clean":"2024-05-07T14:03:41.695342+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:03:41.695342+0000","last_undegraded":"2024-05-07T14:03:41.695342+0000","last_fullsized":"2024-05-07T14:03:41.695342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708520+0000","last_change":"2024-05-07T14:03:39.659916+0000","last_active":"2024-05-07T14:03:41.708520+0000","last_peered":"2024-05-07T14:03:41.708520+0000","last_clean":"2024-05-07T14:03:41.708520+0000","last_became_active":"2024-05-07T14:03:39.659515+0000","last_became_peered":"2024-05-07T14:03:39.659515+0000","last_unstale":"2024-05-07T14:03:41.708520+0000","last_undegraded":"2024-05-07T14:03:41.708520+0000","last_fullsized":"2024-05-07T14:03:41.708520+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:49:16.796937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698099+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:03:41.698099+0000","last_peered":"2024-05-07T14:03:41.698099+0000","last_clean":"2024-05-07T14:03:41.698099+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:03:41.698099+0000","last_undegraded":"2024-05-07T14:03:41.698099+0000","last_fullsized":"2024-05-07T14:03:41.698099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708058+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:03:41.708058+0000","last_peered":"2024-05-07T14:03:41.708058+0000","last_clean":"2024-05-07T14:03:41.708058+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:03:41.708058+0000","last_undegraded":"2024-05-07T14:03:41.708058+0000","last_fullsized":"2024-05-07T14:03:41.708058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699109+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:03:41.699109+0000","last_peered":"2024-05-07T14:03:41.699109+0000","last_clean":"2024-05-07T14:03:41.699109+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:03:41.699109+0000","last_undegraded":"2024-05-07T14:03:41.699109+0000","last_fullsized":"2024-05-07T14:03:41.699109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"85'29","reported_seq":201,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698321+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:03:41.698321+0000","last_peered":"2024-05-07T14:03:41.698321+0000","last_clean":"2024-05-07T14:03:41.698321+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:03:41.698321+0000","last_undegraded":"2024-05-07T14:03:41.698321+0000","last_fullsized":"2024-05-07T14:03:41.698321+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702991+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:03:41.702991+0000","last_peered":"2024-05-07T14:03:41.702991+0000","last_clean":"2024-05-07T14:03:41.702991+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:03:41.702991+0000","last_undegraded":"2024-05-07T14:03:41.702991+0000","last_fullsized":"2024-05-07T14:03:41.702991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700362+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:03:41.700362+0000","last_peered":"2024-05-07T14:03:41.700362+0000","last_clean":"2024-05-07T14:03:41.700362+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:03:41.700362+0000","last_undegraded":"2024-05-07T14:03:41.700362+0000","last_fullsized":"2024-05-07T14:03:41.700362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700237+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:03:41.700237+0000","last_peered":"2024-05-07T14:03:41.700237+0000","last_clean":"2024-05-07T14:03:41.700237+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:03:41.700237+0000","last_undegraded":"2024-05-07T14:03:41.700237+0000","last_fullsized":"2024-05-07T14:03:41.700237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707833+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:03:41.707833+0000","last_peered":"2024-05-07T14:03:41.707833+0000","last_clean":"2024-05-07T14:03:41.707833+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:03:41.707833+0000","last_undegraded":"2024-05-07T14:03:41.707833+0000","last_fullsized":"2024-05-07T14:03:41.707833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699867+0000","last_change":"2024-05-07T14:00:49.928907+0000","last_active":"2024-05-07T14:03:41.699867+0000","last_peered":"2024-05-07T14:03:41.699867+0000","last_clean":"2024-05-07T14:03:41.699867+0000","last_became_active":"2024-05-07T14:00:49.928146+0000","last_became_peered":"2024-05-07T14:00:49.928146+0000","last_unstale":"2024-05-07T14:03:41.699867+0000","last_undegraded":"2024-05-07T14:03:41.699867+0000","last_fullsized":"2024-05-07T14:03:41.699867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:07.032835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101098+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:03:42.101098+0000","last_peered":"2024-05-07T14:03:42.101098+0000","last_clean":"2024-05-07T14:03:42.101098+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:03:42.101098+0000","last_undegraded":"2024-05-07T14:03:42.101098+0000","last_fullsized":"2024-05-07T14:03:42.101098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":30,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707747+0000","last_change":"2024-05-07T14:03:39.707679+0000","last_active":"2024-05-07T14:03:41.707747+0000","last_peered":"2024-05-07T14:03:41.707747+0000","last_clean":"2024-05-07T14:03:41.707747+0000","last_became_active":"2024-05-07T14:03:39.664751+0000","last_became_peered":"2024-05-07T14:03:39.664751+0000","last_unstale":"2024-05-07T14:03:41.707747+0000","last_undegraded":"2024-05-07T14:03:41.707747+0000","last_fullsized":"2024-05-07T14:03:41.707747+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:55.535011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"101'107","reported_seq":316,"reported_epoch":101,"state":"peering","last_fresh":"2024-05-07T14:03:40.797550+0000","last_change":"2024-05-07T14:03:41.696412+0000","last_active":"2024-05-07T14:03:41.696412+0000","last_peered":"2024-05-07T14:03:40.797550+0000","last_clean":"2024-05-07T14:03:37.624906+0000","last_became_active":"2024-05-07T14:03:40.773827+0000","last_became_peered":"2024-05-07T14:03:40.773827+0000","last_unstale":"2024-05-07T14:03:40.797550+0000","last_undegraded":"2024-05-07T14:03:40.797550+0000","last_fullsized":"2024-05-07T14:03:40.654026+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711764+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:03:41.711764+0000","last_peered":"2024-05-07T14:03:41.711764+0000","last_clean":"2024-05-07T14:03:41.711764+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:03:41.711764+0000","last_undegraded":"2024-05-07T14:03:41.711764+0000","last_fullsized":"2024-05-07T14:03:41.711764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711403+0000","last_change":"2024-05-07T14:00:57.998539+0000","last_active":"2024-05-07T14:03:41.711403+0000","last_peered":"2024-05-07T14:03:41.711403+0000","last_clean":"2024-05-07T14:03:41.711403+0000","last_became_active":"2024-05-07T14:00:57.998025+0000","last_became_peered":"2024-05-07T14:00:57.998025+0000","last_unstale":"2024-05-07T14:03:41.711403+0000","last_undegraded":"2024-05-07T14:03:41.711403+0000","last_fullsized":"2024-05-07T14:03:41.711403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711068+0000","last_change":"2024-05-07T14:00:55.988508+0000","last_active":"2024-05-07T14:03:41.711068+0000","last_peered":"2024-05-07T14:03:41.711068+0000","last_clean":"2024-05-07T14:03:41.711068+0000","last_became_active":"2024-05-07T14:00:55.988230+0000","last_became_peered":"2024-05-07T14:00:55.988230+0000","last_unstale":"2024-05-07T14:03:41.711068+0000","last_undegraded":"2024-05-07T14:03:41.711068+0000","last_fullsized":"2024-05-07T14:03:41.711068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708834+0000","last_change":"2024-05-07T14:03:39.672724+0000","last_active":"2024-05-07T14:03:41.708834+0000","last_peered":"2024-05-07T14:03:41.708834+0000","last_clean":"2024-05-07T14:03:41.708834+0000","last_became_active":"2024-05-07T14:03:39.671518+0000","last_became_peered":"2024-05-07T14:03:39.671518+0000","last_unstale":"2024-05-07T14:03:41.708834+0000","last_undegraded":"2024-05-07T14:03:41.708834+0000","last_fullsized":"2024-05-07T14:03:41.708834+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:25.485797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703264+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:03:41.703264+0000","last_peered":"2024-05-07T14:03:41.703264+0000","last_clean":"2024-05-07T14:03:41.703264+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:03:41.703264+0000","last_undegraded":"2024-05-07T14:03:41.703264+0000","last_fullsized":"2024-05-07T14:03:41.703264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703164+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:03:41.703164+0000","last_peered":"2024-05-07T14:03:41.703164+0000","last_clean":"2024-05-07T14:03:41.703164+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:03:41.703164+0000","last_undegraded":"2024-05-07T14:03:41.703164+0000","last_fullsized":"2024-05-07T14:03:41.703164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"94'104","reported_seq":329,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.714221+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:03:41.714221+0000","last_peered":"2024-05-07T14:03:41.714221+0000","last_clean":"2024-05-07T14:03:41.714221+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:03:41.714221+0000","last_undegraded":"2024-05-07T14:03:41.714221+0000","last_fullsized":"2024-05-07T14:03:41.714221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"81'3","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700621+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:03:41.700621+0000","last_peered":"2024-05-07T14:03:41.700621+0000","last_clean":"2024-05-07T14:03:41.700621+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:03:41.700621+0000","last_undegraded":"2024-05-07T14:03:41.700621+0000","last_fullsized":"2024-05-07T14:03:41.700621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703477+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:03:41.703477+0000","last_peered":"2024-05-07T14:03:41.703477+0000","last_clean":"2024-05-07T14:03:41.703477+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:03:41.703477+0000","last_undegraded":"2024-05-07T14:03:41.703477+0000","last_fullsized":"2024-05-07T14:03:41.703477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'5","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703093+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:03:41.703093+0000","last_peered":"2024-05-07T14:03:41.703093+0000","last_clean":"2024-05-07T14:03:41.703093+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:03:41.703093+0000","last_undegraded":"2024-05-07T14:03:41.703093+0000","last_fullsized":"2024-05-07T14:03:41.703093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101852+0000","last_change":"2024-05-07T14:00:49.938879+0000","last_active":"2024-05-07T14:03:42.101852+0000","last_peered":"2024-05-07T14:03:42.101852+0000","last_clean":"2024-05-07T14:03:42.101852+0000","last_became_active":"2024-05-07T14:00:49.938066+0000","last_became_peered":"2024-05-07T14:00:49.938066+0000","last_unstale":"2024-05-07T14:03:42.101852+0000","last_undegraded":"2024-05-07T14:03:42.101852+0000","last_fullsized":"2024-05-07T14:03:42.101852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711837+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:03:41.711837+0000","last_peered":"2024-05-07T14:03:41.711837+0000","last_clean":"2024-05-07T14:03:41.711837+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:03:41.711837+0000","last_undegraded":"2024-05-07T14:03:41.711837+0000","last_fullsized":"2024-05-07T14:03:41.711837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"85'35","reported_seq":211,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698987+0000","last_change":"2024-05-07T14:01:02.148095+0000","last_active":"2024-05-07T14:03:41.698987+0000","last_peered":"2024-05-07T14:03:41.698987+0000","last_clean":"2024-05-07T14:03:41.698987+0000","last_became_active":"2024-05-07T14:01:02.147334+0000","last_became_peered":"2024-05-07T14:01:02.147334+0000","last_unstale":"2024-05-07T14:03:41.698987+0000","last_undegraded":"2024-05-07T14:03:41.698987+0000","last_fullsized":"2024-05-07T14:03:41.698987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":165,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710112+0000","last_change":"2024-05-07T14:03:39.665240+0000","last_active":"2024-05-07T14:03:41.710112+0000","last_peered":"2024-05-07T14:03:41.710112+0000","last_clean":"2024-05-07T14:03:41.710112+0000","last_became_active":"2024-05-07T14:03:39.664810+0000","last_became_peered":"2024-05-07T14:03:39.664810+0000","last_unstale":"2024-05-07T14:03:41.710112+0000","last_undegraded":"2024-05-07T14:03:41.710112+0000","last_fullsized":"2024-05-07T14:03:41.710112+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:18:01.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696662+0000","last_change":"2024-05-07T14:01:06.039788+0000","last_active":"2024-05-07T14:03:41.696662+0000","last_peered":"2024-05-07T14:03:41.696662+0000","last_clean":"2024-05-07T14:03:41.696662+0000","last_became_active":"2024-05-07T14:01:06.039050+0000","last_became_peered":"2024-05-07T14:01:06.039050+0000","last_unstale":"2024-05-07T14:03:41.696662+0000","last_undegraded":"2024-05-07T14:03:41.696662+0000","last_fullsized":"2024-05-07T14:03:41.696662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699068+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:03:41.699068+0000","last_peered":"2024-05-07T14:03:41.699068+0000","last_clean":"2024-05-07T14:03:41.699068+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:03:41.699068+0000","last_undegraded":"2024-05-07T14:03:41.699068+0000","last_fullsized":"2024-05-07T14:03:41.699068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'8","reported_seq":203,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702599+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:03:41.702599+0000","last_peered":"2024-05-07T14:03:41.702599+0000","last_clean":"2024-05-07T14:03:41.702599+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:03:41.702599+0000","last_undegraded":"2024-05-07T14:03:41.702599+0000","last_fullsized":"2024-05-07T14:03:41.702599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"85'10","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702672+0000","last_change":"2024-05-07T14:00:55.991934+0000","last_active":"2024-05-07T14:03:41.702672+0000","last_peered":"2024-05-07T14:03:41.702672+0000","last_clean":"2024-05-07T14:03:41.702672+0000","last_became_active":"2024-05-07T14:00:55.991303+0000","last_became_peered":"2024-05-07T14:00:55.991303+0000","last_unstale":"2024-05-07T14:03:41.702672+0000","last_undegraded":"2024-05-07T14:03:41.702672+0000","last_fullsized":"2024-05-07T14:03:41.702672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709713+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:03:41.709713+0000","last_peered":"2024-05-07T14:03:41.709713+0000","last_clean":"2024-05-07T14:03:41.709713+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:03:41.709713+0000","last_undegraded":"2024-05-07T14:03:41.709713+0000","last_fullsized":"2024-05-07T14:03:41.709713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"85'17","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709926+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:03:41.709926+0000","last_peered":"2024-05-07T14:03:41.709926+0000","last_clean":"2024-05-07T14:03:41.709926+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:03:41.709926+0000","last_undegraded":"2024-05-07T14:03:41.709926+0000","last_fullsized":"2024-05-07T14:03:41.709926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712038+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:03:41.712038+0000","last_peered":"2024-05-07T14:03:41.712038+0000","last_clean":"2024-05-07T14:03:41.712038+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:03:41.712038+0000","last_undegraded":"2024-05-07T14:03:41.712038+0000","last_fullsized":"2024-05-07T14:03:41.712038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710700+0000","last_change":"2024-05-07T14:01:06.013974+0000","last_active":"2024-05-07T14:03:41.710700+0000","last_peered":"2024-05-07T14:03:41.710700+0000","last_clean":"2024-05-07T14:03:41.710700+0000","last_became_active":"2024-05-07T14:01:06.013281+0000","last_became_peered":"2024-05-07T14:01:06.013281+0000","last_unstale":"2024-05-07T14:03:41.710700+0000","last_undegraded":"2024-05-07T14:03:41.710700+0000","last_fullsized":"2024-05-07T14:03:41.710700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:46.349394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"94'3","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708331+0000","last_change":"2024-05-07T14:03:39.692877+0000","last_active":"2024-05-07T14:03:41.708331+0000","last_peered":"2024-05-07T14:03:41.708331+0000","last_clean":"2024-05-07T14:03:41.708331+0000","last_became_active":"2024-05-07T14:03:39.663976+0000","last_became_peered":"2024-05-07T14:03:39.663976+0000","last_unstale":"2024-05-07T14:03:41.708331+0000","last_undegraded":"2024-05-07T14:03:41.708331+0000","last_fullsized":"2024-05-07T14:03:41.708331+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:36.548454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699404+0000","last_change":"2024-05-07T14:00:55.968287+0000","last_active":"2024-05-07T14:03:41.699404+0000","last_peered":"2024-05-07T14:03:41.699404+0000","last_clean":"2024-05-07T14:03:41.699404+0000","last_became_active":"2024-05-07T14:00:55.967578+0000","last_became_peered":"2024-05-07T14:00:55.967578+0000","last_unstale":"2024-05-07T14:03:41.699404+0000","last_undegraded":"2024-05-07T14:03:41.699404+0000","last_fullsized":"2024-05-07T14:03:41.699404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711159+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:03:41.711159+0000","last_peered":"2024-05-07T14:03:41.711159+0000","last_clean":"2024-05-07T14:03:41.711159+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:03:41.711159+0000","last_undegraded":"2024-05-07T14:03:41.711159+0000","last_fullsized":"2024-05-07T14:03:41.711159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"97'7","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697842+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:03:41.697842+0000","last_peered":"2024-05-07T14:03:41.697842+0000","last_clean":"2024-05-07T14:03:41.697842+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:03:41.697842+0000","last_undegraded":"2024-05-07T14:03:41.697842+0000","last_fullsized":"2024-05-07T14:03:41.697842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":26,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696436+0000","last_change":"2024-05-07T14:01:04.012628+0000","last_active":"2024-05-07T14:03:41.696436+0000","last_peered":"2024-05-07T14:03:41.696436+0000","last_clean":"2024-05-07T14:03:41.696436+0000","last_became_active":"2024-05-07T14:01:04.011910+0000","last_became_peered":"2024-05-07T14:01:04.011910+0000","last_unstale":"2024-05-07T14:03:41.696436+0000","last_undegraded":"2024-05-07T14:03:41.696436+0000","last_fullsized":"2024-05-07T14:03:41.696436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"94'1","reported_seq":153,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698734+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:03:41.698734+0000","last_peered":"2024-05-07T14:03:41.698734+0000","last_clean":"2024-05-07T14:03:41.698734+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:03:41.698734+0000","last_undegraded":"2024-05-07T14:03:41.698734+0000","last_fullsized":"2024-05-07T14:03:41.698734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"81'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712225+0000","last_change":"2024-05-07T14:00:57.999019+0000","last_active":"2024-05-07T14:03:41.712225+0000","last_peered":"2024-05-07T14:03:41.712225+0000","last_clean":"2024-05-07T14:03:41.712225+0000","last_became_active":"2024-05-07T14:00:57.998526+0000","last_became_peered":"2024-05-07T14:00:57.998526+0000","last_unstale":"2024-05-07T14:03:41.712225+0000","last_undegraded":"2024-05-07T14:03:41.712225+0000","last_fullsized":"2024-05-07T14:03:41.712225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"85'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698007+0000","last_change":"2024-05-07T14:00:55.999548+0000","last_active":"2024-05-07T14:03:41.698007+0000","last_peered":"2024-05-07T14:03:41.698007+0000","last_clean":"2024-05-07T14:03:41.698007+0000","last_became_active":"2024-05-07T14:00:55.995284+0000","last_became_peered":"2024-05-07T14:00:55.995284+0000","last_unstale":"2024-05-07T14:03:41.698007+0000","last_undegraded":"2024-05-07T14:03:41.698007+0000","last_fullsized":"2024-05-07T14:03:41.698007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.694737+0000","last_change":"2024-05-07T14:00:59.996971+0000","last_active":"2024-05-07T14:03:41.694737+0000","last_peered":"2024-05-07T14:03:41.694737+0000","last_clean":"2024-05-07T14:03:41.694737+0000","last_became_active":"2024-05-07T14:00:59.996254+0000","last_became_peered":"2024-05-07T14:00:59.996254+0000","last_unstale":"2024-05-07T14:03:41.694737+0000","last_undegraded":"2024-05-07T14:03:41.694737+0000","last_fullsized":"2024-05-07T14:03:41.694737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"85'17","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710995+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:03:41.710995+0000","last_peered":"2024-05-07T14:03:41.710995+0000","last_clean":"2024-05-07T14:03:41.710995+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:03:41.710995+0000","last_undegraded":"2024-05-07T14:03:41.710995+0000","last_fullsized":"2024-05-07T14:03:41.710995+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100947+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:03:42.100947+0000","last_peered":"2024-05-07T14:03:42.100947+0000","last_clean":"2024-05-07T14:03:42.100947+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:03:42.100947+0000","last_undegraded":"2024-05-07T14:03:42.100947+0000","last_fullsized":"2024-05-07T14:03:42.100947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696828+0000","last_change":"2024-05-07T14:01:06.038138+0000","last_active":"2024-05-07T14:03:41.696828+0000","last_peered":"2024-05-07T14:03:41.696828+0000","last_clean":"2024-05-07T14:03:41.696828+0000","last_became_active":"2024-05-07T14:01:06.030966+0000","last_became_peered":"2024-05-07T14:01:06.030966+0000","last_unstale":"2024-05-07T14:03:41.696828+0000","last_undegraded":"2024-05-07T14:03:41.696828+0000","last_fullsized":"2024-05-07T14:03:41.696828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":31,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695687+0000","last_change":"2024-05-07T14:03:39.677172+0000","last_active":"2024-05-07T14:03:41.695687+0000","last_peered":"2024-05-07T14:03:41.695687+0000","last_clean":"2024-05-07T14:03:41.695687+0000","last_became_active":"2024-05-07T14:03:39.663090+0000","last_became_peered":"2024-05-07T14:03:39.663090+0000","last_unstale":"2024-05-07T14:03:41.695687+0000","last_undegraded":"2024-05-07T14:03:41.695687+0000","last_fullsized":"2024-05-07T14:03:41.695687+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:56.826421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"85'2","reported_seq":121,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707665+0000","last_change":"2024-05-07T14:01:37.318408+0000","last_active":"2024-05-07T14:03:41.707665+0000","last_peered":"2024-05-07T14:03:41.707665+0000","last_clean":"2024-05-07T14:03:41.707665+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:03:41.707665+0000","last_undegraded":"2024-05-07T14:03:41.707665+0000","last_fullsized":"2024-05-07T14:03:41.707665+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:43.643434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100979+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:03:42.100979+0000","last_peered":"2024-05-07T14:03:42.100979+0000","last_clean":"2024-05-07T14:03:42.100979+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:03:42.100979+0000","last_undegraded":"2024-05-07T14:03:42.100979+0000","last_fullsized":"2024-05-07T14:03:42.100979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"85'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696211+0000","last_change":"2024-05-07T14:01:01.995377+0000","last_active":"2024-05-07T14:03:41.696211+0000","last_peered":"2024-05-07T14:03:41.696211+0000","last_clean":"2024-05-07T14:03:41.696211+0000","last_became_active":"2024-05-07T14:01:01.994566+0000","last_became_peered":"2024-05-07T14:01:01.994566+0000","last_unstale":"2024-05-07T14:03:41.696211+0000","last_undegraded":"2024-05-07T14:03:41.696211+0000","last_fullsized":"2024-05-07T14:03:41.696211+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698075+0000","last_change":"2024-05-07T14:01:03.997116+0000","last_active":"2024-05-07T14:03:41.698075+0000","last_peered":"2024-05-07T14:03:41.698075+0000","last_clean":"2024-05-07T14:03:41.698075+0000","last_became_active":"2024-05-07T14:01:03.996555+0000","last_became_peered":"2024-05-07T14:01:03.996555+0000","last_unstale":"2024-05-07T14:03:41.698075+0000","last_undegraded":"2024-05-07T14:03:41.698075+0000","last_fullsized":"2024-05-07T14:03:41.698075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101792+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:03:42.101792+0000","last_peered":"2024-05-07T14:03:42.101792+0000","last_clean":"2024-05-07T14:03:42.101792+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:03:42.101792+0000","last_undegraded":"2024-05-07T14:03:42.101792+0000","last_fullsized":"2024-05-07T14:03:42.101792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'4","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711005+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:03:41.711005+0000","last_peered":"2024-05-07T14:03:41.711005+0000","last_clean":"2024-05-07T14:03:41.711005+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:03:41.711005+0000","last_undegraded":"2024-05-07T14:03:41.711005+0000","last_fullsized":"2024-05-07T14:03:41.711005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.701797+0000","last_change":"2024-05-07T14:00:59.995694+0000","last_active":"2024-05-07T14:03:41.701797+0000","last_peered":"2024-05-07T14:03:41.701797+0000","last_clean":"2024-05-07T14:03:41.701797+0000","last_became_active":"2024-05-07T14:00:59.993899+0000","last_became_peered":"2024-05-07T14:00:59.993899+0000","last_unstale":"2024-05-07T14:03:41.701797+0000","last_undegraded":"2024-05-07T14:03:41.701797+0000","last_fullsized":"2024-05-07T14:03:41.701797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:28.225348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"85'22","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708951+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:03:41.708951+0000","last_peered":"2024-05-07T14:03:41.708951+0000","last_clean":"2024-05-07T14:03:41.708951+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:03:41.708951+0000","last_undegraded":"2024-05-07T14:03:41.708951+0000","last_fullsized":"2024-05-07T14:03:41.708951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697037+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:03:41.697037+0000","last_peered":"2024-05-07T14:03:41.697037+0000","last_clean":"2024-05-07T14:03:41.697037+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:03:41.697037+0000","last_undegraded":"2024-05-07T14:03:41.697037+0000","last_fullsized":"2024-05-07T14:03:41.697037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"81'2","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710468+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:03:41.710468+0000","last_peered":"2024-05-07T14:03:41.710468+0000","last_clean":"2024-05-07T14:03:41.710468+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:03:41.710468+0000","last_undegraded":"2024-05-07T14:03:41.710468+0000","last_fullsized":"2024-05-07T14:03:41.710468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"87'6","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702182+0000","last_change":"2024-05-07T14:00:57.995989+0000","last_active":"2024-05-07T14:03:41.702182+0000","last_peered":"2024-05-07T14:03:41.702182+0000","last_clean":"2024-05-07T14:03:41.702182+0000","last_became_active":"2024-05-07T14:00:57.995721+0000","last_became_peered":"2024-05-07T14:00:57.995721+0000","last_unstale":"2024-05-07T14:03:41.702182+0000","last_undegraded":"2024-05-07T14:03:41.702182+0000","last_fullsized":"2024-05-07T14:03:41.702182+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'2","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710712+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:03:41.710712+0000","last_peered":"2024-05-07T14:03:41.710712+0000","last_clean":"2024-05-07T14:03:41.710712+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:03:41.710712+0000","last_undegraded":"2024-05-07T14:03:41.710712+0000","last_fullsized":"2024-05-07T14:03:41.710712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101681+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:03:42.101681+0000","last_peered":"2024-05-07T14:03:42.101681+0000","last_clean":"2024-05-07T14:03:42.101681+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:03:42.101681+0000","last_undegraded":"2024-05-07T14:03:42.101681+0000","last_fullsized":"2024-05-07T14:03:42.101681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"85'20","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700402+0000","last_change":"2024-05-07T14:01:02.002384+0000","last_active":"2024-05-07T14:03:41.700402+0000","last_peered":"2024-05-07T14:03:41.700402+0000","last_clean":"2024-05-07T14:03:41.700402+0000","last_became_active":"2024-05-07T14:01:02.001676+0000","last_became_peered":"2024-05-07T14:01:02.001676+0000","last_unstale":"2024-05-07T14:03:41.700402+0000","last_undegraded":"2024-05-07T14:03:41.700402+0000","last_fullsized":"2024-05-07T14:03:41.700402+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709218+0000","last_change":"2024-05-07T14:03:39.667564+0000","last_active":"2024-05-07T14:03:41.709218+0000","last_peered":"2024-05-07T14:03:41.709218+0000","last_clean":"2024-05-07T14:03:41.709218+0000","last_became_active":"2024-05-07T14:03:39.666888+0000","last_became_peered":"2024-05-07T14:03:39.666888+0000","last_unstale":"2024-05-07T14:03:41.709218+0000","last_undegraded":"2024-05-07T14:03:41.709218+0000","last_fullsized":"2024-05-07T14:03:41.709218+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:33.367980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100771+0000","last_change":"2024-05-07T14:01:06.025917+0000","last_active":"2024-05-07T14:03:42.100771+0000","last_peered":"2024-05-07T14:03:42.100771+0000","last_clean":"2024-05-07T14:03:42.100771+0000","last_became_active":"2024-05-07T14:01:06.025044+0000","last_became_peered":"2024-05-07T14:01:06.025044+0000","last_unstale":"2024-05-07T14:03:42.100771+0000","last_undegraded":"2024-05-07T14:03:42.100771+0000","last_fullsized":"2024-05-07T14:03:42.100771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:55.419668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"81'4","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710545+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:03:41.710545+0000","last_peered":"2024-05-07T14:03:41.710545+0000","last_clean":"2024-05-07T14:03:41.710545+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:03:41.710545+0000","last_undegraded":"2024-05-07T14:03:41.710545+0000","last_fullsized":"2024-05-07T14:03:41.710545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"85'8","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703505+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:03:41.703505+0000","last_peered":"2024-05-07T14:03:41.703505+0000","last_clean":"2024-05-07T14:03:41.703505+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:03:41.703505+0000","last_undegraded":"2024-05-07T14:03:41.703505+0000","last_fullsized":"2024-05-07T14:03:41.703505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703456+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:03:41.703456+0000","last_peered":"2024-05-07T14:03:41.703456+0000","last_clean":"2024-05-07T14:03:41.703456+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:03:41.703456+0000","last_undegraded":"2024-05-07T14:03:41.703456+0000","last_fullsized":"2024-05-07T14:03:41.703456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"85'16","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712670+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:03:41.712670+0000","last_peered":"2024-05-07T14:03:41.712670+0000","last_clean":"2024-05-07T14:03:41.712670+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:03:41.712670+0000","last_undegraded":"2024-05-07T14:03:41.712670+0000","last_fullsized":"2024-05-07T14:03:41.712670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709246+0000","last_change":"2024-05-07T14:03:39.664184+0000","last_active":"2024-05-07T14:03:41.709246+0000","last_peered":"2024-05-07T14:03:41.709246+0000","last_clean":"2024-05-07T14:03:41.709246+0000","last_became_active":"2024-05-07T14:03:39.663569+0000","last_became_peered":"2024-05-07T14:03:39.663569+0000","last_unstale":"2024-05-07T14:03:41.709246+0000","last_undegraded":"2024-05-07T14:03:41.709246+0000","last_fullsized":"2024-05-07T14:03:41.709246+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:51.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696331+0000","last_change":"2024-05-07T14:01:06.038979+0000","last_active":"2024-05-07T14:03:41.696331+0000","last_peered":"2024-05-07T14:03:41.696331+0000","last_clean":"2024-05-07T14:03:41.696331+0000","last_became_active":"2024-05-07T14:01:06.035737+0000","last_became_peered":"2024-05-07T14:01:06.035737+0000","last_unstale":"2024-05-07T14:03:41.696331+0000","last_undegraded":"2024-05-07T14:03:41.696331+0000","last_fullsized":"2024-05-07T14:03:41.696331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"87'8","reported_seq":201,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706335+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:03:41.706335+0000","last_peered":"2024-05-07T14:03:41.706335+0000","last_clean":"2024-05-07T14:03:41.706335+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:03:41.706335+0000","last_undegraded":"2024-05-07T14:03:41.706335+0000","last_fullsized":"2024-05-07T14:03:41.706335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"85'5","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698263+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:03:41.698263+0000","last_peered":"2024-05-07T14:03:41.698263+0000","last_clean":"2024-05-07T14:03:41.698263+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:03:41.698263+0000","last_undegraded":"2024-05-07T14:03:41.698263+0000","last_fullsized":"2024-05-07T14:03:41.698263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709405+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:03:41.709405+0000","last_peered":"2024-05-07T14:03:41.709405+0000","last_clean":"2024-05-07T14:03:41.709405+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:03:41.709405+0000","last_undegraded":"2024-05-07T14:03:41.709405+0000","last_fullsized":"2024-05-07T14:03:41.709405+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703916+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:03:41.703916+0000","last_peered":"2024-05-07T14:03:41.703916+0000","last_clean":"2024-05-07T14:03:41.703916+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:03:41.703916+0000","last_undegraded":"2024-05-07T14:03:41.703916+0000","last_fullsized":"2024-05-07T14:03:41.703916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"94'104","reported_seq":368,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101355+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:03:42.101355+0000","last_peered":"2024-05-07T14:03:42.101355+0000","last_clean":"2024-05-07T14:03:42.101355+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:03:42.101355+0000","last_undegraded":"2024-05-07T14:03:42.101355+0000","last_fullsized":"2024-05-07T14:03:42.101355+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"81'7","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.694712+0000","last_change":"2024-05-07T14:01:06.037755+0000","last_active":"2024-05-07T14:03:41.694712+0000","last_peered":"2024-05-07T14:03:41.694712+0000","last_clean":"2024-05-07T14:03:41.694712+0000","last_became_active":"2024-05-07T14:01:06.037156+0000","last_became_peered":"2024-05-07T14:01:06.037156+0000","last_unstale":"2024-05-07T14:03:41.694712+0000","last_undegraded":"2024-05-07T14:03:41.694712+0000","last_fullsized":"2024-05-07T14:03:41.694712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:30.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"94'5","reported_seq":187,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702580+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:03:41.702580+0000","last_peered":"2024-05-07T14:03:41.702580+0000","last_clean":"2024-05-07T14:03:41.702580+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:03:41.702580+0000","last_undegraded":"2024-05-07T14:03:41.702580+0000","last_fullsized":"2024-05-07T14:03:41.702580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":171,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697272+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:03:41.697272+0000","last_peered":"2024-05-07T14:03:41.697272+0000","last_clean":"2024-05-07T14:03:41.697272+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:03:41.697272+0000","last_undegraded":"2024-05-07T14:03:41.697272+0000","last_fullsized":"2024-05-07T14:03:41.697272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696319+0000","last_change":"2024-05-07T14:00:59.998197+0000","last_active":"2024-05-07T14:03:41.696319+0000","last_peered":"2024-05-07T14:03:41.696319+0000","last_clean":"2024-05-07T14:03:41.696319+0000","last_became_active":"2024-05-07T14:00:59.997438+0000","last_became_peered":"2024-05-07T14:00:59.997438+0000","last_unstale":"2024-05-07T14:03:41.696319+0000","last_undegraded":"2024-05-07T14:03:41.696319+0000","last_fullsized":"2024-05-07T14:03:41.696319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:29.430229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"85'20","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696519+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:03:41.696519+0000","last_peered":"2024-05-07T14:03:41.696519+0000","last_clean":"2024-05-07T14:03:41.696519+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:03:41.696519+0000","last_undegraded":"2024-05-07T14:03:41.696519+0000","last_fullsized":"2024-05-07T14:03:41.696519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697304+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:03:41.697304+0000","last_peered":"2024-05-07T14:03:41.697304+0000","last_clean":"2024-05-07T14:03:41.697304+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:03:41.697304+0000","last_undegraded":"2024-05-07T14:03:41.697304+0000","last_fullsized":"2024-05-07T14:03:41.697304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"81'3","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699423+0000","last_change":"2024-05-07T14:01:06.025913+0000","last_active":"2024-05-07T14:03:41.699423+0000","last_peered":"2024-05-07T14:03:41.699423+0000","last_clean":"2024-05-07T14:03:41.699423+0000","last_became_active":"2024-05-07T14:01:06.025220+0000","last_became_peered":"2024-05-07T14:01:06.025220+0000","last_unstale":"2024-05-07T14:03:41.699423+0000","last_undegraded":"2024-05-07T14:03:41.699423+0000","last_fullsized":"2024-05-07T14:03:41.699423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:30.164745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703250+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:03:41.703250+0000","last_peered":"2024-05-07T14:03:41.703250+0000","last_clean":"2024-05-07T14:03:41.703250+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:03:41.703250+0000","last_undegraded":"2024-05-07T14:03:41.703250+0000","last_fullsized":"2024-05-07T14:03:41.703250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"85'5","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697829+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:03:41.697829+0000","last_peered":"2024-05-07T14:03:41.697829+0000","last_clean":"2024-05-07T14:03:41.697829+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:03:41.697829+0000","last_undegraded":"2024-05-07T14:03:41.697829+0000","last_fullsized":"2024-05-07T14:03:41.697829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697226+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:03:41.697226+0000","last_peered":"2024-05-07T14:03:41.697226+0000","last_clean":"2024-05-07T14:03:41.697226+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:03:41.697226+0000","last_undegraded":"2024-05-07T14:03:41.697226+0000","last_fullsized":"2024-05-07T14:03:41.697226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"85'14","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697325+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:03:41.697325+0000","last_peered":"2024-05-07T14:03:41.697325+0000","last_clean":"2024-05-07T14:03:41.697325+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:03:41.697325+0000","last_undegraded":"2024-05-07T14:03:41.697325+0000","last_fullsized":"2024-05-07T14:03:41.697325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100752+0000","last_change":"2024-05-07T14:01:04.017099+0000","last_active":"2024-05-07T14:03:42.100752+0000","last_peered":"2024-05-07T14:03:42.100752+0000","last_clean":"2024-05-07T14:03:42.100752+0000","last_became_active":"2024-05-07T14:01:04.011036+0000","last_became_peered":"2024-05-07T14:01:04.011036+0000","last_unstale":"2024-05-07T14:03:42.100752+0000","last_undegraded":"2024-05-07T14:03:42.100752+0000","last_fullsized":"2024-05-07T14:03:42.100752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:32.242974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710778+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:03:41.710778+0000","last_peered":"2024-05-07T14:03:41.710778+0000","last_clean":"2024-05-07T14:03:41.710778+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:03:41.710778+0000","last_undegraded":"2024-05-07T14:03:41.710778+0000","last_fullsized":"2024-05-07T14:03:41.710778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"87'6","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712440+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:03:41.712440+0000","last_peered":"2024-05-07T14:03:41.712440+0000","last_clean":"2024-05-07T14:03:41.712440+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:03:41.712440+0000","last_undegraded":"2024-05-07T14:03:41.712440+0000","last_fullsized":"2024-05-07T14:03:41.712440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.713016+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:03:41.713016+0000","last_peered":"2024-05-07T14:03:41.713016+0000","last_clean":"2024-05-07T14:03:41.713016+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:03:41.713016+0000","last_undegraded":"2024-05-07T14:03:41.713016+0000","last_fullsized":"2024-05-07T14:03:41.713016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702067+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:03:41.702067+0000","last_peered":"2024-05-07T14:03:41.702067+0000","last_clean":"2024-05-07T14:03:41.702067+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:03:41.702067+0000","last_undegraded":"2024-05-07T14:03:41.702067+0000","last_fullsized":"2024-05-07T14:03:41.702067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"85'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.714133+0000","last_change":"2024-05-07T14:01:02.013617+0000","last_active":"2024-05-07T14:03:41.714133+0000","last_peered":"2024-05-07T14:03:41.714133+0000","last_clean":"2024-05-07T14:03:41.714133+0000","last_became_active":"2024-05-07T14:01:02.009243+0000","last_became_peered":"2024-05-07T14:01:02.009243+0000","last_unstale":"2024-05-07T14:03:41.714133+0000","last_undegraded":"2024-05-07T14:03:41.714133+0000","last_fullsized":"2024-05-07T14:03:41.714133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702284+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:03:41.702284+0000","last_peered":"2024-05-07T14:03:41.702284+0000","last_clean":"2024-05-07T14:03:41.702284+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:03:41.702284+0000","last_undegraded":"2024-05-07T14:03:41.702284+0000","last_fullsized":"2024-05-07T14:03:41.702284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"81'8","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698993+0000","last_change":"2024-05-07T14:03:39.823293+0000","last_active":"2024-05-07T14:03:41.698993+0000","last_peered":"2024-05-07T14:03:41.698993+0000","last_clean":"2024-05-07T14:03:41.698993+0000","last_became_active":"2024-05-07T14:03:39.673703+0000","last_became_peered":"2024-05-07T14:03:39.673703+0000","last_unstale":"2024-05-07T14:03:41.698993+0000","last_undegraded":"2024-05-07T14:03:41.698993+0000","last_fullsized":"2024-05-07T14:03:41.698993+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:21.776655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"81'6","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702345+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:03:41.702345+0000","last_peered":"2024-05-07T14:03:41.702345+0000","last_clean":"2024-05-07T14:03:41.702345+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:03:41.702345+0000","last_undegraded":"2024-05-07T14:03:41.702345+0000","last_fullsized":"2024-05-07T14:03:41.702345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"85'2","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700096+0000","last_change":"2024-05-07T14:01:37.554242+0000","last_active":"2024-05-07T14:03:41.700096+0000","last_peered":"2024-05-07T14:03:41.700096+0000","last_clean":"2024-05-07T14:03:41.700096+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:03:41.700096+0000","last_undegraded":"2024-05-07T14:03:41.700096+0000","last_fullsized":"2024-05-07T14:03:41.700096+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:16:22.149514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708033+0000","last_change":"2024-05-07T14:03:39.674947+0000","last_active":"2024-05-07T14:03:41.708033+0000","last_peered":"2024-05-07T14:03:41.708033+0000","last_clean":"2024-05-07T14:03:41.708033+0000","last_became_active":"2024-05-07T14:03:39.659887+0000","last_became_peered":"2024-05-07T14:03:39.659887+0000","last_unstale":"2024-05-07T14:03:41.708033+0000","last_undegraded":"2024-05-07T14:03:41.708033+0000","last_fullsized":"2024-05-07T14:03:41.708033+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:18:06.217561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"85'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702235+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:03:41.702235+0000","last_peered":"2024-05-07T14:03:41.702235+0000","last_clean":"2024-05-07T14:03:41.702235+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:03:41.702235+0000","last_undegraded":"2024-05-07T14:03:41.702235+0000","last_fullsized":"2024-05-07T14:03:41.702235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697792+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:03:41.697792+0000","last_peered":"2024-05-07T14:03:41.697792+0000","last_clean":"2024-05-07T14:03:41.697792+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:03:41.697792+0000","last_undegraded":"2024-05-07T14:03:41.697792+0000","last_fullsized":"2024-05-07T14:03:41.697792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703550+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:03:41.703550+0000","last_peered":"2024-05-07T14:03:41.703550+0000","last_clean":"2024-05-07T14:03:41.703550+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:03:41.703550+0000","last_undegraded":"2024-05-07T14:03:41.703550+0000","last_fullsized":"2024-05-07T14:03:41.703550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"87'16","reported_seq":24,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708646+0000","last_change":"2024-05-07T14:03:39.799013+0000","last_active":"2024-05-07T14:03:41.708646+0000","last_peered":"2024-05-07T14:03:41.708646+0000","last_clean":"2024-05-07T14:03:41.708646+0000","last_became_active":"2024-05-07T14:03:39.671068+0000","last_became_peered":"2024-05-07T14:03:39.671068+0000","last_unstale":"2024-05-07T14:03:41.708646+0000","last_undegraded":"2024-05-07T14:03:41.708646+0000","last_fullsized":"2024-05-07T14:03:41.708646+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:13.746128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"85'6","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100889+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:03:42.100889+0000","last_peered":"2024-05-07T14:03:42.100889+0000","last_clean":"2024-05-07T14:03:42.100889+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:03:42.100889+0000","last_undegraded":"2024-05-07T14:03:42.100889+0000","last_fullsized":"2024-05-07T14:03:42.100889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709023+0000","last_change":"2024-05-07T14:03:39.661724+0000","last_active":"2024-05-07T14:03:41.709023+0000","last_peered":"2024-05-07T14:03:41.709023+0000","last_clean":"2024-05-07T14:03:41.709023+0000","last_became_active":"2024-05-07T14:03:39.661339+0000","last_became_peered":"2024-05-07T14:03:39.661339+0000","last_unstale":"2024-05-07T14:03:41.709023+0000","last_undegraded":"2024-05-07T14:03:41.709023+0000","last_fullsized":"2024-05-07T14:03:41.709023+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:34.633849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"85'3","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704970+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:03:41.704970+0000","last_peered":"2024-05-07T14:03:41.704970+0000","last_clean":"2024-05-07T14:03:41.704970+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:03:41.704970+0000","last_undegraded":"2024-05-07T14:03:41.704970+0000","last_fullsized":"2024-05-07T14:03:41.704970+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:01.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"81'6","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697154+0000","last_change":"2024-05-07T14:00:57.985233+0000","last_active":"2024-05-07T14:03:41.697154+0000","last_peered":"2024-05-07T14:03:41.697154+0000","last_clean":"2024-05-07T14:03:41.697154+0000","last_became_active":"2024-05-07T14:00:57.984523+0000","last_became_peered":"2024-05-07T14:00:57.984523+0000","last_unstale":"2024-05-07T14:03:41.697154+0000","last_undegraded":"2024-05-07T14:03:41.697154+0000","last_fullsized":"2024-05-07T14:03:41.697154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696656+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:03:41.696656+0000","last_peered":"2024-05-07T14:03:41.696656+0000","last_clean":"2024-05-07T14:03:41.696656+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:03:41.696656+0000","last_undegraded":"2024-05-07T14:03:41.696656+0000","last_fullsized":"2024-05-07T14:03:41.696656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"81'2","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708007+0000","last_change":"2024-05-07T14:03:39.791330+0000","last_active":"2024-05-07T14:03:41.708007+0000","last_peered":"2024-05-07T14:03:41.708007+0000","last_clean":"2024-05-07T14:03:41.708007+0000","last_became_active":"2024-05-07T14:03:39.670031+0000","last_became_peered":"2024-05-07T14:03:39.670031+0000","last_unstale":"2024-05-07T14:03:41.708007+0000","last_undegraded":"2024-05-07T14:03:41.708007+0000","last_fullsized":"2024-05-07T14:03:41.708007+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:03.214247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"85'2","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698825+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:03:41.698825+0000","last_peered":"2024-05-07T14:03:41.698825+0000","last_clean":"2024-05-07T14:03:41.698825+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:03:41.698825+0000","last_undegraded":"2024-05-07T14:03:41.698825+0000","last_fullsized":"2024-05-07T14:03:41.698825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.714060+0000","last_change":"2024-05-07T14:00:57.998054+0000","last_active":"2024-05-07T14:03:41.714060+0000","last_peered":"2024-05-07T14:03:41.714060+0000","last_clean":"2024-05-07T14:03:41.714060+0000","last_became_active":"2024-05-07T14:00:57.997750+0000","last_became_peered":"2024-05-07T14:00:57.997750+0000","last_unstale":"2024-05-07T14:03:41.714060+0000","last_undegraded":"2024-05-07T14:03:41.714060+0000","last_fullsized":"2024-05-07T14:03:41.714060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712354+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:03:41.712354+0000","last_peered":"2024-05-07T14:03:41.712354+0000","last_clean":"2024-05-07T14:03:41.712354+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:03:41.712354+0000","last_undegraded":"2024-05-07T14:03:41.712354+0000","last_fullsized":"2024-05-07T14:03:41.712354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703351+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:03:41.703351+0000","last_peered":"2024-05-07T14:03:41.703351+0000","last_clean":"2024-05-07T14:03:41.703351+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:03:41.703351+0000","last_undegraded":"2024-05-07T14:03:41.703351+0000","last_fullsized":"2024-05-07T14:03:41.703351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"85'3","reported_seq":22,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709662+0000","last_change":"2024-05-07T14:03:39.789159+0000","last_active":"2024-05-07T14:03:41.709662+0000","last_peered":"2024-05-07T14:03:41.709662+0000","last_clean":"2024-05-07T14:03:41.709662+0000","last_became_active":"2024-05-07T14:03:39.668790+0000","last_became_peered":"2024-05-07T14:03:39.668790+0000","last_unstale":"2024-05-07T14:03:41.709662+0000","last_undegraded":"2024-05-07T14:03:41.709662+0000","last_fullsized":"2024-05-07T14:03:41.709662+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:14.798045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"81'8","reported_seq":232,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712234+0000","last_change":"2024-05-07T14:03:39.855375+0000","last_active":"2024-05-07T14:03:41.712234+0000","last_peered":"2024-05-07T14:03:41.712234+0000","last_clean":"2024-05-07T14:03:41.712234+0000","last_became_active":"2024-05-07T14:03:39.666451+0000","last_became_peered":"2024-05-07T14:03:39.666451+0000","last_unstale":"2024-05-07T14:03:41.712234+0000","last_undegraded":"2024-05-07T14:03:41.712234+0000","last_fullsized":"2024-05-07T14:03:41.712234+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:37.171990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'6","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101388+0000","last_change":"2024-05-07T14:00:55.997287+0000","last_active":"2024-05-07T14:03:42.101388+0000","last_peered":"2024-05-07T14:03:42.101388+0000","last_clean":"2024-05-07T14:03:42.101388+0000","last_became_active":"2024-05-07T14:00:55.996467+0000","last_became_peered":"2024-05-07T14:00:55.996467+0000","last_unstale":"2024-05-07T14:03:42.101388+0000","last_undegraded":"2024-05-07T14:03:42.101388+0000","last_fullsized":"2024-05-07T14:03:42.101388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100692+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:03:42.100692+0000","last_peered":"2024-05-07T14:03:42.100692+0000","last_clean":"2024-05-07T14:03:42.100692+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:03:42.100692+0000","last_undegraded":"2024-05-07T14:03:42.100692+0000","last_fullsized":"2024-05-07T14:03:42.100692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711422+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:03:41.711422+0000","last_peered":"2024-05-07T14:03:41.711422+0000","last_clean":"2024-05-07T14:03:41.711422+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:03:41.711422+0000","last_undegraded":"2024-05-07T14:03:41.711422+0000","last_fullsized":"2024-05-07T14:03:41.711422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"94'1","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699812+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:03:41.699812+0000","last_peered":"2024-05-07T14:03:41.699812+0000","last_clean":"2024-05-07T14:03:41.699812+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:03:41.699812+0000","last_undegraded":"2024-05-07T14:03:41.699812+0000","last_fullsized":"2024-05-07T14:03:41.699812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"85'7","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697033+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:03:41.697033+0000","last_peered":"2024-05-07T14:03:41.697033+0000","last_clean":"2024-05-07T14:03:41.697033+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:03:41.697033+0000","last_undegraded":"2024-05-07T14:03:41.697033+0000","last_fullsized":"2024-05-07T14:03:41.697033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704144+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:03:41.704144+0000","last_peered":"2024-05-07T14:03:41.704144+0000","last_clean":"2024-05-07T14:03:41.704144+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:03:41.704144+0000","last_undegraded":"2024-05-07T14:03:41.704144+0000","last_fullsized":"2024-05-07T14:03:41.704144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"85'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712521+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:03:41.712521+0000","last_peered":"2024-05-07T14:03:41.712521+0000","last_clean":"2024-05-07T14:03:41.712521+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:03:41.712521+0000","last_undegraded":"2024-05-07T14:03:41.712521+0000","last_fullsized":"2024-05-07T14:03:41.712521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"94'3","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705675+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:03:41.705675+0000","last_peered":"2024-05-07T14:03:41.705675+0000","last_clean":"2024-05-07T14:03:41.705675+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:03:41.705675+0000","last_undegraded":"2024-05-07T14:03:41.705675+0000","last_fullsized":"2024-05-07T14:03:41.705675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696553+0000","last_change":"2024-05-07T14:00:56.001135+0000","last_active":"2024-05-07T14:03:41.696553+0000","last_peered":"2024-05-07T14:03:41.696553+0000","last_clean":"2024-05-07T14:03:41.696553+0000","last_became_active":"2024-05-07T14:00:55.999884+0000","last_became_peered":"2024-05-07T14:00:55.999884+0000","last_unstale":"2024-05-07T14:03:41.696553+0000","last_undegraded":"2024-05-07T14:03:41.696553+0000","last_fullsized":"2024-05-07T14:03:41.696553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703207+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:03:41.703207+0000","last_peered":"2024-05-07T14:03:41.703207+0000","last_clean":"2024-05-07T14:03:41.703207+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:03:41.703207+0000","last_undegraded":"2024-05-07T14:03:41.703207+0000","last_fullsized":"2024-05-07T14:03:41.703207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"85'6","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699371+0000","last_change":"2024-05-07T14:00:55.989670+0000","last_active":"2024-05-07T14:03:41.699371+0000","last_peered":"2024-05-07T14:03:41.699371+0000","last_clean":"2024-05-07T14:03:41.699371+0000","last_became_active":"2024-05-07T14:00:55.989455+0000","last_became_peered":"2024-05-07T14:00:55.989455+0000","last_unstale":"2024-05-07T14:03:41.699371+0000","last_undegraded":"2024-05-07T14:03:41.699371+0000","last_fullsized":"2024-05-07T14:03:41.699371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"81'6","reported_seq":205,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699711+0000","last_change":"2024-05-07T14:03:37.848216+0000","last_active":"2024-05-07T14:03:41.699711+0000","last_peered":"2024-05-07T14:03:41.699711+0000","last_clean":"2024-05-07T14:03:41.699711+0000","last_became_active":"2024-05-07T14:03:37.842132+0000","last_became_peered":"2024-05-07T14:03:37.842132+0000","last_unstale":"2024-05-07T14:03:41.699711+0000","last_undegraded":"2024-05-07T14:03:41.699711+0000","last_fullsized":"2024-05-07T14:03:41.699711+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:16.805365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"85'7","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101781+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:03:42.101781+0000","last_peered":"2024-05-07T14:03:42.101781+0000","last_clean":"2024-05-07T14:03:42.101781+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:03:42.101781+0000","last_undegraded":"2024-05-07T14:03:42.101781+0000","last_fullsized":"2024-05-07T14:03:42.101781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"87'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699843+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:03:41.699843+0000","last_peered":"2024-05-07T14:03:41.699843+0000","last_clean":"2024-05-07T14:03:41.699843+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:03:41.699843+0000","last_undegraded":"2024-05-07T14:03:41.699843+0000","last_fullsized":"2024-05-07T14:03:41.699843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"85'1","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699857+0000","last_change":"2024-05-07T14:00:55.978771+0000","last_active":"2024-05-07T14:03:41.699857+0000","last_peered":"2024-05-07T14:03:41.699857+0000","last_clean":"2024-05-07T14:03:41.699857+0000","last_became_active":"2024-05-07T14:00:55.978000+0000","last_became_peered":"2024-05-07T14:00:55.978000+0000","last_unstale":"2024-05-07T14:03:41.699857+0000","last_undegraded":"2024-05-07T14:03:41.699857+0000","last_fullsized":"2024-05-07T14:03:41.699857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"81'6","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711378+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:03:41.711378+0000","last_peered":"2024-05-07T14:03:41.711378+0000","last_clean":"2024-05-07T14:03:41.711378+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:03:41.711378+0000","last_undegraded":"2024-05-07T14:03:41.711378+0000","last_fullsized":"2024-05-07T14:03:41.711378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"85'7","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706194+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:03:41.706194+0000","last_peered":"2024-05-07T14:03:41.706194+0000","last_clean":"2024-05-07T14:03:41.706194+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:03:41.706194+0000","last_undegraded":"2024-05-07T14:03:41.706194+0000","last_fullsized":"2024-05-07T14:03:41.706194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"87'4","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695244+0000","last_change":"2024-05-07T14:00:57.979073+0000","last_active":"2024-05-07T14:03:41.695244+0000","last_peered":"2024-05-07T14:03:41.695244+0000","last_clean":"2024-05-07T14:03:41.695244+0000","last_became_active":"2024-05-07T14:00:57.978215+0000","last_became_peered":"2024-05-07T14:00:57.978215+0000","last_unstale":"2024-05-07T14:03:41.695244+0000","last_undegraded":"2024-05-07T14:03:41.695244+0000","last_fullsized":"2024-05-07T14:03:41.695244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"85'7","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698352+0000","last_change":"2024-05-07T14:00:56.001199+0000","last_active":"2024-05-07T14:03:41.698352+0000","last_peered":"2024-05-07T14:03:41.698352+0000","last_clean":"2024-05-07T14:03:41.698352+0000","last_became_active":"2024-05-07T14:00:56.000434+0000","last_became_peered":"2024-05-07T14:00:56.000434+0000","last_unstale":"2024-05-07T14:03:41.698352+0000","last_undegraded":"2024-05-07T14:03:41.698352+0000","last_fullsized":"2024-05-07T14:03:41.698352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696888+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:03:41.696888+0000","last_peered":"2024-05-07T14:03:41.696888+0000","last_clean":"2024-05-07T14:03:41.696888+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:03:41.696888+0000","last_undegraded":"2024-05-07T14:03:41.696888+0000","last_fullsized":"2024-05-07T14:03:41.696888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"81'2","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699873+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:03:41.699873+0000","last_peered":"2024-05-07T14:03:41.699873+0000","last_clean":"2024-05-07T14:03:41.699873+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:03:41.699873+0000","last_undegraded":"2024-05-07T14:03:41.699873+0000","last_fullsized":"2024-05-07T14:03:41.699873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711492+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:03:41.711492+0000","last_peered":"2024-05-07T14:03:41.711492+0000","last_clean":"2024-05-07T14:03:41.711492+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:03:41.711492+0000","last_undegraded":"2024-05-07T14:03:41.711492+0000","last_fullsized":"2024-05-07T14:03:41.711492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"94'3","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697844+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:03:41.697844+0000","last_peered":"2024-05-07T14:03:41.697844+0000","last_clean":"2024-05-07T14:03:41.697844+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:03:41.697844+0000","last_undegraded":"2024-05-07T14:03:41.697844+0000","last_fullsized":"2024-05-07T14:03:41.697844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1003,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":250,"num_read_kb":234,"num_write":236,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":841,"ondisk_log_size":841,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":79524,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":810,"num_read_kb":572,"num_write":449,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":4494,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":128631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":634,"ondisk_log_size":634,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1078,"num_read_kb":1058,"num_write":239,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1069547520,"num_objects":257,"num_object_clones":0,"num_object_copies":514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":317,"num_write_kb":1064960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2139095040,"data_stored":2139095040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362152,"kb_used_data":330964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94009688,"statfs":{"total":96636764160,"available":96265920512,"internally_reserved":0,"allocated":338907136,"data_stored":338347051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":278736,"kb_used_data":247552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94093104,"statfs":{"total":96636764160,"available":96351338496,"internally_reserved":0,"allocated":253493248,"data_stored":252953527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339648,"kb_used_data":308464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94032192,"statfs":{"total":96636764160,"available":96288964608,"internally_reserved":0,"allocated":315867136,"data_stored":315280067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347768,"kb_used_data":316588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94024072,"statfs":{"total":96636764160,"available":96280649728,"internally_reserved":0,"allocated":324186112,"data_stored":323659355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":340284,"kb_used_data":309100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94031556,"statfs":{"total":96636764160,"available":96288313344,"internally_reserved":0,"allocated":316518400,"data_stored":315928962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":196232,"kb_used_data":165048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94175608,"statfs":{"total":96636764160,"available":96435822592,"internally_reserved":0,"allocated":169009152,"data_stored":168477088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216752,"kb_used_data":185568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94155088,"statfs":{"total":96636764160,"available":96414810112,"internally_reserved":0,"allocated":190021632,"data_stored":189452096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268000,"kb_used_data":236812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94103840,"statfs":{"total":96636764160,"available":96362332160,"internally_reserved":0,"allocated":242495488,"data_stored":241936314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":241172480,"data_stored":241172480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188743680,"data_stored":188743680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":167772160,"data_stored":167772160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":314572800,"data_stored":314572800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":322961408,"data_stored":322961408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":314572800,"data_stored":314572800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":251658240,"data_stored":251658240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":337641472,"data_stored":337641472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":60890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:03:45.228 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:03:45.281 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:45.281 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:45.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:45.281 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:45.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.282 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2202 3.0 e84/21 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:45.282 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:45.282 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.006377743000002, 2024-05-07T14:03:45.282 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020120560999999999, 2024-05-07T14:03:45.282 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.282 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.282 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.282 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.283 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.283 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:45.283 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.283 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.283 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:45.283 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.284 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.284 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286676+0000", 2024-05-07T14:03:45.284 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.57e-06 2024-05-07T14:03:45.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.284 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.284 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291894+0000", 2024-05-07T14:03:45.284 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052185740000000001 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291939+0000", 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4676999999999999e-05 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291959+0000", 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0115999999999998e-05 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292128+0000", 2024-05-07T14:03:45.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168758 2024-05-07T14:03:45.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.286 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.286 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292188+0000", 2024-05-07T14:03:45.286 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0565e-05 2024-05-07T14:03:45.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.286 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.286 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306607+0000", 2024-05-07T14:03:45.286 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014418733 2024-05-07T14:03:45.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.286 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306794+0000", 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018656799999999999 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2204 3.3b e84/21 3:df85b00b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_3:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.312700+0000", 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.980350596000001, 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015369649000000001, 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.287 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.312700+0000", 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.312700+0000", 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.312702+0000", 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8279999999999999e-06 2024-05-07T14:03:45.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319174+0000", 2024-05-07T14:03:45.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064721049999999997 2024-05-07T14:03:45.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319227+0000", 2024-05-07T14:03:45.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2670000000000002e-05 2024-05-07T14:03:45.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.290 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319255+0000", 2024-05-07T14:03:45.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7923e-05 2024-05-07T14:03:45.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.290 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319409+0000", 2024-05-07T14:03:45.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015399200000000001 2024-05-07T14:03:45.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.290 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.319455+0000", 2024-05-07T14:03:45.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6726e-05 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.327989+0000", 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0085333779999999994 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.328070+0000", 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1026999999999995e-05 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.292 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2211 3.13 3:cbf4b364:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:45.292 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.389539+0000", 2024-05-07T14:03:45.292 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.903512024999998, 2024-05-07T14:03:45.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015047895, 2024-05-07T14:03:45.292 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.292 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.292 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.292 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.292 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.292 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.292 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2211 2024-05-07T14:03:45.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.293 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.389539+0000", 2024-05-07T14:03:45.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.389539+0000", 2024-05-07T14:03:45.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.389541+0000", 2024-05-07T14:03:45.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2709999999999999e-06 2024-05-07T14:03:45.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392129+0000", 2024-05-07T14:03:45.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002587719 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392163+0000", 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3714999999999998e-05 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392178+0000", 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5132e-05 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392251+0000", 2024-05-07T14:03:45.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3743000000000002e-05 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392368+0000", 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011705 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.392465+0000", 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6836000000000006e-05 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.399912+0000", 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0074468069999999997 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.404505+0000", 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045928840000000002 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.404540+0000", 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5485000000000003e-05 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.297 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.298 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.404587+0000", 2024-05-07T14:03:45.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6252999999999999e-05 2024-05-07T14:03:45.298 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.298 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.298 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.298 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2216 3.21 3:86b25102:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:45.298 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:45.298 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.824947418999997, 2024-05-07T14:03:45.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017498730000000001, 2024-05-07T14:03:45.299 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.299 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.299 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.299 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.299 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.299 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.299 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2216 2024-05-07T14:03:45.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.299 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:45.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:45.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468107+0000", 2024-05-07T14:03:45.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5980000000000001e-06 2024-05-07T14:03:45.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471311+0000", 2024-05-07T14:03:45.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003203811 2024-05-07T14:03:45.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471360+0000", 2024-05-07T14:03:45.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9100000000000001e-05 2024-05-07T14:03:45.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471383+0000", 2024-05-07T14:03:45.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3289e-05 2024-05-07T14:03:45.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471551+0000", 2024-05-07T14:03:45.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167295 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471932+0000", 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038136799999999998 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472296+0000", 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036396200000000001 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.481648+0000", 2024-05-07T14:03:45.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093518209999999997 2024-05-07T14:03:45.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485379+0000", 2024-05-07T14:03:45.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037311919999999999 2024-05-07T14:03:45.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485533+0000", 2024-05-07T14:03:45.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015429500000000001 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485602+0000", 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8998999999999994e-05 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2217 3.0 e84/21 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.799730955999998, 2024-05-07T14:03:45.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016624692, 2024-05-07T14:03:45.306 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.306 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.306 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.306 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:45.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:45.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493322+0000", 2024-05-07T14:03:45.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7290000000000001e-06 2024-05-07T14:03:45.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496239+0000", 2024-05-07T14:03:45.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029177949999999999 2024-05-07T14:03:45.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496292+0000", 2024-05-07T14:03:45.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2769999999999998e-05 2024-05-07T14:03:45.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496318+0000", 2024-05-07T14:03:45.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6313e-05 2024-05-07T14:03:45.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496471+0000", 2024-05-07T14:03:45.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015206799999999999 2024-05-07T14:03:45.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496540+0000", 2024-05-07T14:03:45.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9598999999999996e-05 2024-05-07T14:03:45.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509870+0000", 2024-05-07T14:03:45.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013330322 2024-05-07T14:03:45.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509945+0000", 2024-05-07T14:03:45.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4096000000000003e-05 2024-05-07T14:03:45.311 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.311 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.311 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.311 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2231 3.2e 3:767c3375:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_30:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:45.311 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.681942+0000", 2024-05-07T14:03:45.311 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.611108643000001, 2024-05-07T14:03:45.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015025999, 2024-05-07T14:03:45.311 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.311 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.311 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.311 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2231 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.681942+0000", 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.681942+0000", 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.681945+0000", 2024-05-07T14:03:45.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0630000000000002e-06 2024-05-07T14:03:45.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683651+0000", 2024-05-07T14:03:45.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001705694 2024-05-07T14:03:45.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683682+0000", 2024-05-07T14:03:45.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1288000000000003e-05 2024-05-07T14:03:45.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683700+0000", 2024-05-07T14:03:45.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7756000000000001e-05 2024-05-07T14:03:45.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683790+0000", 2024-05-07T14:03:45.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9573000000000005e-05 2024-05-07T14:03:45.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.683956+0000", 2024-05-07T14:03:45.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016630400000000001 2024-05-07T14:03:45.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684044+0000", 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8369999999999996e-05 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.688963+0000", 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049188510000000001 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.696874+0000", 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0079104099999999997 2024-05-07T14:03:45.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.696918+0000", 2024-05-07T14:03:45.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4456000000000003e-05 2024-05-07T14:03:45.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.696968+0000", 2024-05-07T14:03:45.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0234e-05 2024-05-07T14:03:45.317 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.317 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.317 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.318 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2687 3.2 3:43af9208:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:45.318 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:03:45.318 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.474509676, 2024-05-07T14:03:45.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037068531000000002, 2024-05-07T14:03:45.318 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.318 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.318 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.318 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.318 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.319 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.319 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2687 2024-05-07T14:03:45.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.319 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:03:45.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:03:45.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818544+0000", 2024-05-07T14:03:45.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3390000000000001e-06 2024-05-07T14:03:45.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821166+0000", 2024-05-07T14:03:45.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026214250000000001 2024-05-07T14:03:45.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821192+0000", 2024-05-07T14:03:45.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5641999999999999e-05 2024-05-07T14:03:45.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821203+0000", 2024-05-07T14:03:45.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1558e-05 2024-05-07T14:03:45.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821280+0000", 2024-05-07T14:03:45.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7237000000000006e-05 2024-05-07T14:03:45.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:45.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821288+0000", 2024-05-07T14:03:45.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0930000000000003e-06 2024-05-07T14:03:45.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823694+0000", 2024-05-07T14:03:45.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024052850000000001 2024-05-07T14:03:45.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823853+0000", 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015879800000000001 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823991+0000", 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013879100000000001 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.832834+0000", 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088427109999999996 2024-05-07T14:03:45.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855474+0000", 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022640304 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855553+0000", 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8994999999999998e-05 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855610+0000", 2024-05-07T14:03:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6353000000000001e-05 2024-05-07T14:03:45.325 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.325 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.325 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.325 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2707 3.17 3:e87c5034:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:45.325 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:03:45.325 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.2564959689999999, 2024-05-07T14:03:45.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017998984999999999, 2024-05-07T14:03:45.325 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.326 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.326 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.326 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.326 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.326 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.326 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2707 2024-05-07T14:03:45.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.326 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:03:45.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036558+0000", 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8030000000000001e-06 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038073+0000", 2024-05-07T14:03:45.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001514872 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038093+0000", 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0023000000000001e-05 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038102+0000", 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3389999999999999e-06 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038183+0000", 2024-05-07T14:03:45.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1050999999999994e-05 2024-05-07T14:03:45.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038309+0000", 2024-05-07T14:03:45.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012564400000000001 2024-05-07T14:03:45.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:45.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038401+0000", 2024-05-07T14:03:45.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2826999999999997e-05 2024-05-07T14:03:45.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.046066+0000", 2024-05-07T14:03:45.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007664761 2024-05-07T14:03:45.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054423+0000", 2024-05-07T14:03:45.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0083565310000000004 2024-05-07T14:03:45.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054497+0000", 2024-05-07T14:03:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4302999999999997e-05 2024-05-07T14:03:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054554+0000", 2024-05-07T14:03:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6830999999999998e-05 2024-05-07T14:03:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.332 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2717 3.17 3:eb96a854:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:45.332 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:03:45.332 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.138316235, 2024-05-07T14:03:45.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017081168000000001, 2024-05-07T14:03:45.332 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.332 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.332 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.332 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.332 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.332 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.332 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2717 2024-05-07T14:03:45.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.333 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:03:45.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:03:45.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154737+0000", 2024-05-07T14:03:45.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.706e-06 2024-05-07T14:03:45.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156940+0000", 2024-05-07T14:03:45.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022023619999999998 2024-05-07T14:03:45.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156968+0000", 2024-05-07T14:03:45.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:03:45.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156982+0000", 2024-05-07T14:03:45.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3515e-05 2024-05-07T14:03:45.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157066+0000", 2024-05-07T14:03:45.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4746999999999993e-05 2024-05-07T14:03:45.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157241+0000", 2024-05-07T14:03:45.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000174496 2024-05-07T14:03:45.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:45.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157410+0000", 2024-05-07T14:03:45.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016901000000000001 2024-05-07T14:03:45.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.163989+0000", 2024-05-07T14:03:45.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065794249999999999 2024-05-07T14:03:45.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171687+0000", 2024-05-07T14:03:45.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0076973229999999998 2024-05-07T14:03:45.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171760+0000", 2024-05-07T14:03:45.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3617999999999999e-05 2024-05-07T14:03:45.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171816+0000", 2024-05-07T14:03:45.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5432000000000001e-05 2024-05-07T14:03:45.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.338 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.339 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2721 3.3b e104/21 3:dd5ea515:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_38:head v 104'7, mlcod=85'5)", 2024-05-07T14:03:45.339 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:45.339 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.0916860509999999, 2024-05-07T14:03:45.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017497018999999999, 2024-05-07T14:03:45.340 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.340 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.340 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.340 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:45.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:45.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:45.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.27e-07 2024-05-07T14:03:45.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207457+0000", 2024-05-07T14:03:45.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0060918650000000001 2024-05-07T14:03:45.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207482+0000", 2024-05-07T14:03:45.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4765000000000001e-05 2024-05-07T14:03:45.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207496+0000", 2024-05-07T14:03:45.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3983e-05 2024-05-07T14:03:45.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207576+0000", 2024-05-07T14:03:45.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9803999999999997e-05 2024-05-07T14:03:45.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207605+0000", 2024-05-07T14:03:45.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9697e-05 2024-05-07T14:03:45.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.218781+0000", 2024-05-07T14:03:45.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011175681 2024-05-07T14:03:45.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.218862+0000", 2024-05-07T14:03:45.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0797000000000006e-05 2024-05-07T14:03:45.348 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.348 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.348 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.348 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2722 3.2e 3:75db52c2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:45.348 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:03:45.348 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.0872211519999999, 2024-05-07T14:03:45.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019780314, 2024-05-07T14:03:45.348 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.348 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.348 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2722 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:03:45.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205833+0000", 2024-05-07T14:03:45.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3289999999999998e-06 2024-05-07T14:03:45.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207811+0000", 2024-05-07T14:03:45.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019781529999999999 2024-05-07T14:03:45.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207829+0000", 2024-05-07T14:03:45.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7402999999999999e-05 2024-05-07T14:03:45.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207838+0000", 2024-05-07T14:03:45.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0210000000000005e-06 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207902+0000", 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4406000000000006e-05 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208094+0000", 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000191626 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:45.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208250+0000", 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156064 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.219242+0000", 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010992696999999999 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225500+0000", 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.006257182 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225550+0000", 2024-05-07T14:03:45.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0173999999999998e-05 2024-05-07T14:03:45.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225610+0000", 2024-05-07T14:03:45.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0259e-05 2024-05-07T14:03:45.354 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.354 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.354 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.355 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2735 3.2 3:4399fdca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:45.355 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:03:45.355 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.95494540000000006, 2024-05-07T14:03:45.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017836129999999999, 2024-05-07T14:03:45.355 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.355 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.355 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.355 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.355 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.355 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.355 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2735 2024-05-07T14:03:45.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.355 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338108+0000", 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0110000000000001e-06 2024-05-07T14:03:45.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339842+0000", 2024-05-07T14:03:45.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017333330000000001 2024-05-07T14:03:45.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339870+0000", 2024-05-07T14:03:45.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7875999999999999e-05 2024-05-07T14:03:45.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339884+0000", 2024-05-07T14:03:45.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4678000000000001e-05 2024-05-07T14:03:45.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339984+0000", 2024-05-07T14:03:45.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9283999999999993e-05 2024-05-07T14:03:45.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.340096+0000", 2024-05-07T14:03:45.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112272 2024-05-07T14:03:45.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:45.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.340201+0000", 2024-05-07T14:03:45.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010467999999999999 2024-05-07T14:03:45.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.345876+0000", 2024-05-07T14:03:45.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056758260000000001 2024-05-07T14:03:45.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355805+0000", 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099281679999999994 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355883+0000", 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8287000000000004e-05 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355942+0000", 2024-05-07T14:03:45.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8715000000000003e-05 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2742 3.2e 3:77b7f847:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.88107938299999999, 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01669147, 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.361 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.362 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2742 2024-05-07T14:03:45.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.362 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:03:45.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411975+0000", 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.225e-06 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413909+0000", 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001934365 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413938+0000", 2024-05-07T14:03:45.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8753000000000001e-05 2024-05-07T14:03:45.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413953+0000", 2024-05-07T14:03:45.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5631e-05 2024-05-07T14:03:45.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414034+0000", 2024-05-07T14:03:45.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0173000000000006e-05 2024-05-07T14:03:45.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414169+0000", 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013502499999999999 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414303+0000", 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013471800000000001 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.420795+0000", 2024-05-07T14:03:45.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064916050000000001 2024-05-07T14:03:45.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428529+0000", 2024-05-07T14:03:45.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077344129999999999 2024-05-07T14:03:45.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428605+0000", 2024-05-07T14:03:45.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5662999999999997e-05 2024-05-07T14:03:45.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428663+0000", 2024-05-07T14:03:45.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7899000000000002e-05 2024-05-07T14:03:45.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.367 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.368 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2769 3.2e 3:77131cc5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:45.368 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.675311+0000", 2024-05-07T14:03:45.368 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.61773980799999995, 2024-05-07T14:03:45.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014539519000000001, 2024-05-07T14:03:45.368 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.368 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.368 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.368 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.368 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.368 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.368 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2769 2024-05-07T14:03:45.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.369 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.675311+0000", 2024-05-07T14:03:45.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.675311+0000", 2024-05-07T14:03:45.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.675314+0000", 2024-05-07T14:03:45.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1860000000000001e-06 2024-05-07T14:03:45.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.676924+0000", 2024-05-07T14:03:45.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00160951 2024-05-07T14:03:45.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.676948+0000", 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3801000000000001e-05 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.676958+0000", 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0458999999999999e-05 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.677022+0000", 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3706000000000003e-05 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.677163+0000", 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014180700000000001 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.677264+0000", 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100425 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.681098+0000", 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038336210000000002 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.689728+0000", 2024-05-07T14:03:45.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086306760000000003 2024-05-07T14:03:45.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.689798+0000", 2024-05-07T14:03:45.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9867e-05 2024-05-07T14:03:45.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.689851+0000", 2024-05-07T14:03:45.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2460999999999998e-05 2024-05-07T14:03:45.374 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.374 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.374 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.374 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2773 3.17 3:e87231b1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:45.374 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:03:45.374 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.57458948399999998, 2024-05-07T14:03:45.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028454317, 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2773 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718465+0000", 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3680000000000002e-06 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729580+0000", 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011115776000000001 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729608+0000", 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7617e-05 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729622+0000", 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3528e-05 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729694+0000", 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2630000000000001e-05 2024-05-07T14:03:45.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729812+0000", 2024-05-07T14:03:45.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118132 2024-05-07T14:03:45.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:45.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729913+0000", 2024-05-07T14:03:45.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100486 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.744465+0000", 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014551768 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746795+0000", 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023300270000000001 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746865+0000", 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0322999999999997e-05 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746916+0000", 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0661999999999997e-05 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2784 3.17 3:e9b6a230:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:03:45.380 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.44229389600000002, 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027214069, 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2784 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:03:45.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850760+0000", 2024-05-07T14:03:45.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0970000000000002e-06 2024-05-07T14:03:45.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853165+0000", 2024-05-07T14:03:45.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002405309 2024-05-07T14:03:45.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853186+0000", 2024-05-07T14:03:45.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0727999999999999e-05 2024-05-07T14:03:45.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853196+0000", 2024-05-07T14:03:45.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0159e-05 2024-05-07T14:03:45.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853277+0000", 2024-05-07T14:03:45.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0519999999999995e-05 2024-05-07T14:03:45.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853440+0000", 2024-05-07T14:03:45.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016281299999999999 2024-05-07T14:03:45.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:45.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853608+0000", 2024-05-07T14:03:45.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168126 2024-05-07T14:03:45.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.860132+0000", 2024-05-07T14:03:45.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065242379999999999 2024-05-07T14:03:45.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877848+0000", 2024-05-07T14:03:45.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017716251999999998 2024-05-07T14:03:45.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877919+0000", 2024-05-07T14:03:45.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.127e-05 2024-05-07T14:03:45.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877971+0000", 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1557000000000001e-05 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2789 3.2 3:434a8bbf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.38660467900000001, 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025228071000000001, 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.387 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.388 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.388 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.388 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.388 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.388 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2789 2024-05-07T14:03:45.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.388 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:03:45.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:03:45.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906450+0000", 2024-05-07T14:03:45.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5149999999999998e-06 2024-05-07T14:03:45.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908568+0000", 2024-05-07T14:03:45.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021184279999999999 2024-05-07T14:03:45.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908593+0000", 2024-05-07T14:03:45.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5043999999999999e-05 2024-05-07T14:03:45.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908607+0000", 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3716999999999999e-05 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908686+0000", 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9492000000000004e-05 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908818+0000", 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013199199999999999 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:45.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908952+0000", 2024-05-07T14:03:45.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013385400000000001 2024-05-07T14:03:45.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.916238+0000", 2024-05-07T14:03:45.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072861810000000001 2024-05-07T14:03:45.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931560+0000", 2024-05-07T14:03:45.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01532122 2024-05-07T14:03:45.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931620+0000", 2024-05-07T14:03:45.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0448000000000001e-05 2024-05-07T14:03:45.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931674+0000", 2024-05-07T14:03:45.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.418e-05 2024-05-07T14:03:45.393 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.393 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.394 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.394 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2799 3.9 e105/21 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head v 105'7, mlcod=104'5)", 2024-05-07T14:03:45.394 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:45.394 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.27522987900000001, 2024-05-07T14:03:45.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021236735, 2024-05-07T14:03:45.394 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.394 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.394 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.394 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:45.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:45.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:45.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.75e-07 2024-05-07T14:03:45.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024399+0000", 2024-05-07T14:03:45.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065773769999999997 2024-05-07T14:03:45.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024434+0000", 2024-05-07T14:03:45.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4884e-05 2024-05-07T14:03:45.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024450+0000", 2024-05-07T14:03:45.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6181999999999999e-05 2024-05-07T14:03:45.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024523+0000", 2024-05-07T14:03:45.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3054999999999998e-05 2024-05-07T14:03:45.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024550+0000", 2024-05-07T14:03:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6735000000000001e-05 2024-05-07T14:03:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.038754+0000", 2024-05-07T14:03:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014204543 2024-05-07T14:03:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.039058+0000", 2024-05-07T14:03:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030348400000000002 2024-05-07T14:03:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2802 3.13 3:c8761262:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:03:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.249800515, 2024-05-07T14:03:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026174424000000002, 2024-05-07T14:03:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2802 2024-05-07T14:03:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:03:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:03:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043253+0000", 2024-05-07T14:03:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7030000000000002e-06 2024-05-07T14:03:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045330+0000", 2024-05-07T14:03:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020765139999999998 2024-05-07T14:03:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045352+0000", 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2532e-05 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045363+0000", 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0798000000000001e-05 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045446+0000", 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3592999999999997e-05 2024-05-07T14:03:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045641+0000", 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019462900000000001 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045809+0000", 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168312 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.054070+0000", 2024-05-07T14:03:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082602100000000005 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069299+0000", 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015229457 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069371+0000", 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1730000000000006e-05 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069425+0000", 2024-05-07T14:03:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3946000000000002e-05 2024-05-07T14:03:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2803 3.4 e105/21 3:2246d6f5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_120:head v 105'7, mlcod=104'5)", 2024-05-07T14:03:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.056668+0000", 2024-05-07T14:03:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.236383063, 2024-05-07T14:03:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016341735999999999, 2024-05-07T14:03:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056668+0000", 2024-05-07T14:03:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056668+0000", 2024-05-07T14:03:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056669+0000", 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.562e-06 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.058277+0000", 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016076529999999999 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.058307+0000", 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0082000000000001e-05 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.058322+0000", 2024-05-07T14:03:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5157000000000001e-05 2024-05-07T14:03:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.058430+0000", 2024-05-07T14:03:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010771 2024-05-07T14:03:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.058457+0000", 2024-05-07T14:03:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7284000000000002e-05 2024-05-07T14:03:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.072946+0000", 2024-05-07T14:03:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014489093 2024-05-07T14:03:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.073010+0000", 2024-05-07T14:03:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3194999999999994e-05 2024-05-07T14:03:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:45.411 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:45.413 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:45.413 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:45.424+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:45.513 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:45.524+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:45.609 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:45.609 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:45.610 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:45.610 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:45.614 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:45.623+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:45.631 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:45.650 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:03:45.662 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:03:45.682 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-05-07T14:03:45.276031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070220028,"num_objects":468,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":468,"num_whiteouts":0,"num_read":2515,"num_read_kb":2220,"num_write":1410,"num_write_kb":1067588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":71899899,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2190,"ondisk_log_size":2190,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":543,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2349572,"kb_used_data":2100096,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":752625148,"statfs":{"total":773094113280,"available":770688151552,"internally_reserved":0,"allocated":2150498304,"data_stored":2146034460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-1,"num_objects_missing":-1,"num_objects_degraded":-4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-13,"num_read_kb":-13,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":29362813,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001235"},"pg_stats":[{"pgid":"3.3f","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698514+0000","last_change":"2024-05-07T14:00:55.983744+0000","last_active":"2024-05-07T14:03:41.698514+0000","last_peered":"2024-05-07T14:03:41.698514+0000","last_clean":"2024-05-07T14:03:41.698514+0000","last_became_active":"2024-05-07T14:00:55.982993+0000","last_became_peered":"2024-05-07T14:00:55.982993+0000","last_unstale":"2024-05-07T14:03:41.698514+0000","last_undegraded":"2024-05-07T14:03:41.698514+0000","last_fullsized":"2024-05-07T14:03:41.698514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695581+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:03:41.695581+0000","last_peered":"2024-05-07T14:03:41.695581+0000","last_clean":"2024-05-07T14:03:41.695581+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:03:41.695581+0000","last_undegraded":"2024-05-07T14:03:41.695581+0000","last_fullsized":"2024-05-07T14:03:41.695581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"85'2","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709139+0000","last_change":"2024-05-07T14:03:39.850495+0000","last_active":"2024-05-07T14:03:41.709139+0000","last_peered":"2024-05-07T14:03:41.709139+0000","last_clean":"2024-05-07T14:03:41.709139+0000","last_became_active":"2024-05-07T14:03:39.676092+0000","last_became_peered":"2024-05-07T14:03:39.676092+0000","last_unstale":"2024-05-07T14:03:41.709139+0000","last_undegraded":"2024-05-07T14:03:41.709139+0000","last_fullsized":"2024-05-07T14:03:41.709139+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:00.668304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696652+0000","last_change":"2024-05-07T14:00:57.988092+0000","last_active":"2024-05-07T14:03:41.696652+0000","last_peered":"2024-05-07T14:03:41.696652+0000","last_clean":"2024-05-07T14:03:41.696652+0000","last_became_active":"2024-05-07T14:00:57.987091+0000","last_became_peered":"2024-05-07T14:00:57.987091+0000","last_unstale":"2024-05-07T14:03:41.696652+0000","last_undegraded":"2024-05-07T14:03:41.696652+0000","last_fullsized":"2024-05-07T14:03:41.696652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699224+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:03:41.699224+0000","last_peered":"2024-05-07T14:03:41.699224+0000","last_clean":"2024-05-07T14:03:41.699224+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:03:41.699224+0000","last_undegraded":"2024-05-07T14:03:41.699224+0000","last_fullsized":"2024-05-07T14:03:41.699224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703095+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:03:41.703095+0000","last_peered":"2024-05-07T14:03:41.703095+0000","last_clean":"2024-05-07T14:03:41.703095+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:03:41.703095+0000","last_undegraded":"2024-05-07T14:03:41.703095+0000","last_fullsized":"2024-05-07T14:03:41.703095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697166+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:03:41.697166+0000","last_peered":"2024-05-07T14:03:41.697166+0000","last_clean":"2024-05-07T14:03:41.697166+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:03:41.697166+0000","last_undegraded":"2024-05-07T14:03:41.697166+0000","last_fullsized":"2024-05-07T14:03:41.697166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698562+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:03:41.698562+0000","last_peered":"2024-05-07T14:03:41.698562+0000","last_clean":"2024-05-07T14:03:41.698562+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:03:41.698562+0000","last_undegraded":"2024-05-07T14:03:41.698562+0000","last_fullsized":"2024-05-07T14:03:41.698562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700018+0000","last_change":"2024-05-07T14:00:55.973419+0000","last_active":"2024-05-07T14:03:41.700018+0000","last_peered":"2024-05-07T14:03:41.700018+0000","last_clean":"2024-05-07T14:03:41.700018+0000","last_became_active":"2024-05-07T14:00:55.963467+0000","last_became_peered":"2024-05-07T14:00:55.963467+0000","last_unstale":"2024-05-07T14:03:41.700018+0000","last_undegraded":"2024-05-07T14:03:41.700018+0000","last_fullsized":"2024-05-07T14:03:41.700018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"81'2","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101634+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:03:42.101634+0000","last_peered":"2024-05-07T14:03:42.101634+0000","last_clean":"2024-05-07T14:03:42.101634+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:03:42.101634+0000","last_undegraded":"2024-05-07T14:03:42.101634+0000","last_fullsized":"2024-05-07T14:03:42.101634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"84'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695865+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:03:41.695865+0000","last_peered":"2024-05-07T14:03:41.695865+0000","last_clean":"2024-05-07T14:03:41.695865+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:03:41.695865+0000","last_undegraded":"2024-05-07T14:03:41.695865+0000","last_fullsized":"2024-05-07T14:03:41.695865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"81'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703652+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:03:41.703652+0000","last_peered":"2024-05-07T14:03:41.703652+0000","last_clean":"2024-05-07T14:03:41.703652+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:03:41.703652+0000","last_undegraded":"2024-05-07T14:03:41.703652+0000","last_fullsized":"2024-05-07T14:03:41.703652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"85'2","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697069+0000","last_change":"2024-05-07T14:00:55.962579+0000","last_active":"2024-05-07T14:03:41.697069+0000","last_peered":"2024-05-07T14:03:41.697069+0000","last_clean":"2024-05-07T14:03:41.697069+0000","last_became_active":"2024-05-07T14:00:55.961815+0000","last_became_peered":"2024-05-07T14:00:55.961815+0000","last_unstale":"2024-05-07T14:03:41.697069+0000","last_undegraded":"2024-05-07T14:03:41.697069+0000","last_fullsized":"2024-05-07T14:03:41.697069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697662+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:03:41.697662+0000","last_peered":"2024-05-07T14:03:41.697662+0000","last_clean":"2024-05-07T14:03:41.697662+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:03:41.697662+0000","last_undegraded":"2024-05-07T14:03:41.697662+0000","last_fullsized":"2024-05-07T14:03:41.697662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711126+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:03:41.711126+0000","last_peered":"2024-05-07T14:03:41.711126+0000","last_clean":"2024-05-07T14:03:41.711126+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:03:41.711126+0000","last_undegraded":"2024-05-07T14:03:41.711126+0000","last_fullsized":"2024-05-07T14:03:41.711126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'1","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707908+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:03:41.707908+0000","last_peered":"2024-05-07T14:03:41.707908+0000","last_clean":"2024-05-07T14:03:41.707908+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:03:41.707908+0000","last_undegraded":"2024-05-07T14:03:41.707908+0000","last_fullsized":"2024-05-07T14:03:41.707908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702369+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:03:41.702369+0000","last_peered":"2024-05-07T14:03:41.702369+0000","last_clean":"2024-05-07T14:03:41.702369+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:03:41.702369+0000","last_undegraded":"2024-05-07T14:03:41.702369+0000","last_fullsized":"2024-05-07T14:03:41.702369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698698+0000","last_change":"2024-05-07T14:00:56.003776+0000","last_active":"2024-05-07T14:03:41.698698+0000","last_peered":"2024-05-07T14:03:41.698698+0000","last_clean":"2024-05-07T14:03:41.698698+0000","last_became_active":"2024-05-07T14:00:56.002996+0000","last_became_peered":"2024-05-07T14:00:56.002996+0000","last_unstale":"2024-05-07T14:03:41.698698+0000","last_undegraded":"2024-05-07T14:03:41.698698+0000","last_fullsized":"2024-05-07T14:03:41.698698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:17.583140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696875+0000","last_change":"2024-05-07T14:00:57.987026+0000","last_active":"2024-05-07T14:03:41.696875+0000","last_peered":"2024-05-07T14:03:41.696875+0000","last_clean":"2024-05-07T14:03:41.696875+0000","last_became_active":"2024-05-07T14:00:57.986048+0000","last_became_peered":"2024-05-07T14:00:57.986048+0000","last_unstale":"2024-05-07T14:03:41.696875+0000","last_undegraded":"2024-05-07T14:03:41.696875+0000","last_fullsized":"2024-05-07T14:03:41.696875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101237+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:03:42.101237+0000","last_peered":"2024-05-07T14:03:42.101237+0000","last_clean":"2024-05-07T14:03:42.101237+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:03:42.101237+0000","last_undegraded":"2024-05-07T14:03:42.101237+0000","last_fullsized":"2024-05-07T14:03:42.101237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696308+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:03:41.696308+0000","last_peered":"2024-05-07T14:03:41.696308+0000","last_clean":"2024-05-07T14:03:41.696308+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:03:41.696308+0000","last_undegraded":"2024-05-07T14:03:41.696308+0000","last_fullsized":"2024-05-07T14:03:41.696308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"85'4","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101628+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:03:42.101628+0000","last_peered":"2024-05-07T14:03:42.101628+0000","last_clean":"2024-05-07T14:03:42.101628+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:03:42.101628+0000","last_undegraded":"2024-05-07T14:03:42.101628+0000","last_fullsized":"2024-05-07T14:03:42.101628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"81'8","reported_seq":204,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705740+0000","last_change":"2024-05-07T14:01:37.318563+0000","last_active":"2024-05-07T14:03:41.705740+0000","last_peered":"2024-05-07T14:03:41.705740+0000","last_clean":"2024-05-07T14:03:41.705740+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:03:41.705740+0000","last_undegraded":"2024-05-07T14:03:41.705740+0000","last_fullsized":"2024-05-07T14:03:41.705740+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:27.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702725+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:03:41.702725+0000","last_peered":"2024-05-07T14:03:41.702725+0000","last_clean":"2024-05-07T14:03:41.702725+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:03:41.702725+0000","last_undegraded":"2024-05-07T14:03:41.702725+0000","last_fullsized":"2024-05-07T14:03:41.702725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"94'3","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706201+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:03:41.706201+0000","last_peered":"2024-05-07T14:03:41.706201+0000","last_clean":"2024-05-07T14:03:41.706201+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:03:41.706201+0000","last_undegraded":"2024-05-07T14:03:41.706201+0000","last_fullsized":"2024-05-07T14:03:41.706201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711135+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:03:41.711135+0000","last_peered":"2024-05-07T14:03:41.711135+0000","last_clean":"2024-05-07T14:03:41.711135+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:03:41.711135+0000","last_undegraded":"2024-05-07T14:03:41.711135+0000","last_fullsized":"2024-05-07T14:03:41.711135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"94'1","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703758+0000","last_change":"2024-05-07T14:03:39.848413+0000","last_active":"2024-05-07T14:03:41.703758+0000","last_peered":"2024-05-07T14:03:41.703758+0000","last_clean":"2024-05-07T14:03:41.703758+0000","last_became_active":"2024-05-07T14:03:39.663590+0000","last_became_peered":"2024-05-07T14:03:39.663590+0000","last_unstale":"2024-05-07T14:03:41.703758+0000","last_undegraded":"2024-05-07T14:03:41.703758+0000","last_fullsized":"2024-05-07T14:03:41.703758+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:02.675624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"84'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700741+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:03:41.700741+0000","last_peered":"2024-05-07T14:03:41.700741+0000","last_clean":"2024-05-07T14:03:41.700741+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:03:41.700741+0000","last_undegraded":"2024-05-07T14:03:41.700741+0000","last_fullsized":"2024-05-07T14:03:41.700741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702020+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:03:41.702020+0000","last_peered":"2024-05-07T14:03:41.702020+0000","last_clean":"2024-05-07T14:03:41.702020+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:03:41.702020+0000","last_undegraded":"2024-05-07T14:03:41.702020+0000","last_fullsized":"2024-05-07T14:03:41.702020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"81'2","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711941+0000","last_change":"2024-05-07T14:03:39.857355+0000","last_active":"2024-05-07T14:03:41.711941+0000","last_peered":"2024-05-07T14:03:41.711941+0000","last_clean":"2024-05-07T14:03:41.711941+0000","last_became_active":"2024-05-07T14:03:39.680721+0000","last_became_peered":"2024-05-07T14:03:39.680721+0000","last_unstale":"2024-05-07T14:03:41.711941+0000","last_undegraded":"2024-05-07T14:03:41.711941+0000","last_fullsized":"2024-05-07T14:03:41.711941+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:36.092563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"85'3","reported_seq":122,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705434+0000","last_change":"2024-05-07T14:01:37.311718+0000","last_active":"2024-05-07T14:03:41.705434+0000","last_peered":"2024-05-07T14:03:41.705434+0000","last_clean":"2024-05-07T14:03:41.705434+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:03:41.705434+0000","last_undegraded":"2024-05-07T14:03:41.705434+0000","last_fullsized":"2024-05-07T14:03:41.705434+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:24.211300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696912+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:03:41.696912+0000","last_peered":"2024-05-07T14:03:41.696912+0000","last_clean":"2024-05-07T14:03:41.696912+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:03:41.696912+0000","last_undegraded":"2024-05-07T14:03:41.696912+0000","last_fullsized":"2024-05-07T14:03:41.696912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"85'14","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700862+0000","last_change":"2024-05-07T14:01:01.993679+0000","last_active":"2024-05-07T14:03:41.700862+0000","last_peered":"2024-05-07T14:03:41.700862+0000","last_clean":"2024-05-07T14:03:41.700862+0000","last_became_active":"2024-05-07T14:01:01.993241+0000","last_became_peered":"2024-05-07T14:01:01.993241+0000","last_unstale":"2024-05-07T14:03:41.700862+0000","last_undegraded":"2024-05-07T14:03:41.700862+0000","last_fullsized":"2024-05-07T14:03:41.700862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697732+0000","last_change":"2024-05-07T14:01:04.017472+0000","last_active":"2024-05-07T14:03:41.697732+0000","last_peered":"2024-05-07T14:03:41.697732+0000","last_clean":"2024-05-07T14:03:41.697732+0000","last_became_active":"2024-05-07T14:01:04.016757+0000","last_became_peered":"2024-05-07T14:01:04.016757+0000","last_unstale":"2024-05-07T14:03:41.697732+0000","last_undegraded":"2024-05-07T14:03:41.697732+0000","last_fullsized":"2024-05-07T14:03:41.697732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"94'39","reported_seq":206,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696205+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:03:41.696205+0000","last_peered":"2024-05-07T14:03:41.696205+0000","last_clean":"2024-05-07T14:03:41.696205+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:03:41.696205+0000","last_undegraded":"2024-05-07T14:03:41.696205+0000","last_fullsized":"2024-05-07T14:03:41.696205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":78,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"81'6","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697528+0000","last_change":"2024-05-07T14:00:57.984789+0000","last_active":"2024-05-07T14:03:41.697528+0000","last_peered":"2024-05-07T14:03:41.697528+0000","last_clean":"2024-05-07T14:03:41.697528+0000","last_became_active":"2024-05-07T14:00:57.983524+0000","last_became_peered":"2024-05-07T14:00:57.983524+0000","last_unstale":"2024-05-07T14:03:41.697528+0000","last_undegraded":"2024-05-07T14:03:41.697528+0000","last_fullsized":"2024-05-07T14:03:41.697528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"85'2","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.701078+0000","last_change":"2024-05-07T14:00:55.989797+0000","last_active":"2024-05-07T14:03:41.701078+0000","last_peered":"2024-05-07T14:03:41.701078+0000","last_clean":"2024-05-07T14:03:41.701078+0000","last_became_active":"2024-05-07T14:00:55.989449+0000","last_became_peered":"2024-05-07T14:00:55.989449+0000","last_unstale":"2024-05-07T14:03:41.701078+0000","last_undegraded":"2024-05-07T14:03:41.701078+0000","last_fullsized":"2024-05-07T14:03:41.701078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712162+0000","last_change":"2024-05-07T14:00:59.983880+0000","last_active":"2024-05-07T14:03:41.712162+0000","last_peered":"2024-05-07T14:03:41.712162+0000","last_clean":"2024-05-07T14:03:41.712162+0000","last_became_active":"2024-05-07T14:00:59.983186+0000","last_became_peered":"2024-05-07T14:00:59.983186+0000","last_unstale":"2024-05-07T14:03:41.712162+0000","last_undegraded":"2024-05-07T14:03:41.712162+0000","last_fullsized":"2024-05-07T14:03:41.712162+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:27.067433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"81'7","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703824+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:03:41.703824+0000","last_peered":"2024-05-07T14:03:41.703824+0000","last_clean":"2024-05-07T14:03:41.703824+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:03:41.703824+0000","last_undegraded":"2024-05-07T14:03:41.703824+0000","last_fullsized":"2024-05-07T14:03:41.703824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703701+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:03:41.703701+0000","last_peered":"2024-05-07T14:03:41.703701+0000","last_clean":"2024-05-07T14:03:41.703701+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:03:41.703701+0000","last_undegraded":"2024-05-07T14:03:41.703701+0000","last_fullsized":"2024-05-07T14:03:41.703701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"81'6","reported_seq":159,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700097+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:03:41.700097+0000","last_peered":"2024-05-07T14:03:41.700097+0000","last_clean":"2024-05-07T14:03:41.700097+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:03:41.700097+0000","last_undegraded":"2024-05-07T14:03:41.700097+0000","last_fullsized":"2024-05-07T14:03:41.700097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"81'4","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702846+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:03:41.702846+0000","last_peered":"2024-05-07T14:03:41.702846+0000","last_clean":"2024-05-07T14:03:41.702846+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:03:41.702846+0000","last_undegraded":"2024-05-07T14:03:41.702846+0000","last_fullsized":"2024-05-07T14:03:41.702846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"84'2","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697307+0000","last_change":"2024-05-07T14:00:55.986233+0000","last_active":"2024-05-07T14:03:41.697307+0000","last_peered":"2024-05-07T14:03:41.697307+0000","last_clean":"2024-05-07T14:03:41.697307+0000","last_became_active":"2024-05-07T14:00:55.984927+0000","last_became_peered":"2024-05-07T14:00:55.984927+0000","last_unstale":"2024-05-07T14:03:41.697307+0000","last_undegraded":"2024-05-07T14:03:41.697307+0000","last_fullsized":"2024-05-07T14:03:41.697307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712902+0000","last_change":"2024-05-07T14:03:39.680812+0000","last_active":"2024-05-07T14:03:41.712902+0000","last_peered":"2024-05-07T14:03:41.712902+0000","last_clean":"2024-05-07T14:03:41.712902+0000","last_became_active":"2024-05-07T14:03:39.680482+0000","last_became_peered":"2024-05-07T14:03:39.680482+0000","last_unstale":"2024-05-07T14:03:41.712902+0000","last_undegraded":"2024-05-07T14:03:41.712902+0000","last_fullsized":"2024-05-07T14:03:41.712902+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:07.705255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"81'13","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705975+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:03:41.705975+0000","last_peered":"2024-05-07T14:03:41.705975+0000","last_clean":"2024-05-07T14:03:41.705975+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:03:41.705975+0000","last_undegraded":"2024-05-07T14:03:41.705975+0000","last_fullsized":"2024-05-07T14:03:41.705975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"101'107","reported_seq":308,"reported_epoch":101,"state":"peering","last_fresh":"2024-05-07T14:03:40.794648+0000","last_change":"2024-05-07T14:03:41.697776+0000","last_active":"2024-05-07T14:03:41.697776+0000","last_peered":"2024-05-07T14:03:40.794648+0000","last_clean":"2024-05-07T14:03:37.621532+0000","last_became_active":"2024-05-07T14:03:40.774047+0000","last_became_peered":"2024-05-07T14:03:40.774047+0000","last_unstale":"2024-05-07T14:03:40.794648+0000","last_undegraded":"2024-05-07T14:03:40.794648+0000","last_fullsized":"2024-05-07T14:03:40.650243+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702478+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:03:41.702478+0000","last_peered":"2024-05-07T14:03:41.702478+0000","last_clean":"2024-05-07T14:03:41.702478+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:03:41.702478+0000","last_undegraded":"2024-05-07T14:03:41.702478+0000","last_fullsized":"2024-05-07T14:03:41.702478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"87'16","reported_seq":210,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711369+0000","last_change":"2024-05-07T14:00:57.998824+0000","last_active":"2024-05-07T14:03:41.711369+0000","last_peered":"2024-05-07T14:03:41.711369+0000","last_clean":"2024-05-07T14:03:41.711369+0000","last_became_active":"2024-05-07T14:00:57.998316+0000","last_became_peered":"2024-05-07T14:00:57.998316+0000","last_unstale":"2024-05-07T14:03:41.711369+0000","last_undegraded":"2024-05-07T14:03:41.711369+0000","last_fullsized":"2024-05-07T14:03:41.711369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"85'5","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100817+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:03:42.100817+0000","last_peered":"2024-05-07T14:03:42.100817+0000","last_clean":"2024-05-07T14:03:42.100817+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:03:42.100817+0000","last_undegraded":"2024-05-07T14:03:42.100817+0000","last_fullsized":"2024-05-07T14:03:42.100817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697576+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:03:41.697576+0000","last_peered":"2024-05-07T14:03:41.697576+0000","last_clean":"2024-05-07T14:03:41.697576+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:03:41.697576+0000","last_undegraded":"2024-05-07T14:03:41.697576+0000","last_fullsized":"2024-05-07T14:03:41.697576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"85'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698730+0000","last_change":"2024-05-07T14:01:02.151107+0000","last_active":"2024-05-07T14:03:41.698730+0000","last_peered":"2024-05-07T14:03:41.698730+0000","last_clean":"2024-05-07T14:03:41.698730+0000","last_became_active":"2024-05-07T14:01:02.150351+0000","last_became_peered":"2024-05-07T14:01:02.150351+0000","last_unstale":"2024-05-07T14:03:41.698730+0000","last_undegraded":"2024-05-07T14:03:41.698730+0000","last_fullsized":"2024-05-07T14:03:41.698730+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:28:13.159757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"94'104","reported_seq":291,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712487+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:03:41.712487+0000","last_peered":"2024-05-07T14:03:41.712487+0000","last_clean":"2024-05-07T14:03:41.712487+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:03:41.712487+0000","last_undegraded":"2024-05-07T14:03:41.712487+0000","last_fullsized":"2024-05-07T14:03:41.712487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"81'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696756+0000","last_change":"2024-05-07T14:00:57.979757+0000","last_active":"2024-05-07T14:03:41.696756+0000","last_peered":"2024-05-07T14:03:41.696756+0000","last_clean":"2024-05-07T14:03:41.696756+0000","last_became_active":"2024-05-07T14:00:57.979030+0000","last_became_peered":"2024-05-07T14:00:57.979030+0000","last_unstale":"2024-05-07T14:03:41.696756+0000","last_undegraded":"2024-05-07T14:03:41.696756+0000","last_fullsized":"2024-05-07T14:03:41.696756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"84'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699145+0000","last_change":"2024-05-07T14:00:55.980339+0000","last_active":"2024-05-07T14:03:41.699145+0000","last_peered":"2024-05-07T14:03:41.699145+0000","last_clean":"2024-05-07T14:03:41.699145+0000","last_became_active":"2024-05-07T14:00:55.979609+0000","last_became_peered":"2024-05-07T14:00:55.979609+0000","last_unstale":"2024-05-07T14:03:41.699145+0000","last_undegraded":"2024-05-07T14:03:41.699145+0000","last_fullsized":"2024-05-07T14:03:41.699145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:52.518278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695894+0000","last_change":"2024-05-07T14:00:59.982771+0000","last_active":"2024-05-07T14:03:41.695894+0000","last_peered":"2024-05-07T14:03:41.695894+0000","last_clean":"2024-05-07T14:03:41.695894+0000","last_became_active":"2024-05-07T14:00:59.982018+0000","last_became_peered":"2024-05-07T14:00:59.982018+0000","last_unstale":"2024-05-07T14:03:41.695894+0000","last_undegraded":"2024-05-07T14:03:41.695894+0000","last_fullsized":"2024-05-07T14:03:41.695894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:47.657483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"85'24","reported_seq":195,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695119+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:03:41.695119+0000","last_peered":"2024-05-07T14:03:41.695119+0000","last_clean":"2024-05-07T14:03:41.695119+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:03:41.695119+0000","last_undegraded":"2024-05-07T14:03:41.695119+0000","last_fullsized":"2024-05-07T14:03:41.695119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709481+0000","last_change":"2024-05-07T14:03:39.666526+0000","last_active":"2024-05-07T14:03:41.709481+0000","last_peered":"2024-05-07T14:03:41.709481+0000","last_clean":"2024-05-07T14:03:41.709481+0000","last_became_active":"2024-05-07T14:03:39.666160+0000","last_became_peered":"2024-05-07T14:03:39.666160+0000","last_unstale":"2024-05-07T14:03:41.709481+0000","last_undegraded":"2024-05-07T14:03:41.709481+0000","last_fullsized":"2024-05-07T14:03:41.709481+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:44.560061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696931+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:03:41.696931+0000","last_peered":"2024-05-07T14:03:41.696931+0000","last_clean":"2024-05-07T14:03:41.696931+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:03:41.696931+0000","last_undegraded":"2024-05-07T14:03:41.696931+0000","last_fullsized":"2024-05-07T14:03:41.696931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703320+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:03:41.703320+0000","last_peered":"2024-05-07T14:03:41.703320+0000","last_clean":"2024-05-07T14:03:41.703320+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:03:41.703320+0000","last_undegraded":"2024-05-07T14:03:41.703320+0000","last_fullsized":"2024-05-07T14:03:41.703320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700274+0000","last_change":"2024-05-07T14:00:55.980488+0000","last_active":"2024-05-07T14:03:41.700274+0000","last_peered":"2024-05-07T14:03:41.700274+0000","last_clean":"2024-05-07T14:03:41.700274+0000","last_became_active":"2024-05-07T14:00:55.979688+0000","last_became_peered":"2024-05-07T14:00:55.979688+0000","last_unstale":"2024-05-07T14:03:41.700274+0000","last_undegraded":"2024-05-07T14:03:41.700274+0000","last_fullsized":"2024-05-07T14:03:41.700274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:32.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":232,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705567+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:03:41.705567+0000","last_peered":"2024-05-07T14:03:41.705567+0000","last_clean":"2024-05-07T14:03:41.705567+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:03:41.705567+0000","last_undegraded":"2024-05-07T14:03:41.705567+0000","last_fullsized":"2024-05-07T14:03:41.705567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"85'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.714072+0000","last_change":"2024-05-07T14:01:02.014265+0000","last_active":"2024-05-07T14:03:41.714072+0000","last_peered":"2024-05-07T14:03:41.714072+0000","last_clean":"2024-05-07T14:03:41.714072+0000","last_became_active":"2024-05-07T14:01:02.009335+0000","last_became_peered":"2024-05-07T14:01:02.009335+0000","last_unstale":"2024-05-07T14:03:41.714072+0000","last_undegraded":"2024-05-07T14:03:41.714072+0000","last_fullsized":"2024-05-07T14:03:41.714072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710085+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:03:41.710085+0000","last_peered":"2024-05-07T14:03:41.710085+0000","last_clean":"2024-05-07T14:03:41.710085+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:03:41.710085+0000","last_undegraded":"2024-05-07T14:03:41.710085+0000","last_fullsized":"2024-05-07T14:03:41.710085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100937+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:03:42.100937+0000","last_peered":"2024-05-07T14:03:42.100937+0000","last_clean":"2024-05-07T14:03:42.100937+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:03:42.100937+0000","last_undegraded":"2024-05-07T14:03:42.100937+0000","last_fullsized":"2024-05-07T14:03:42.100937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"81'6","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101300+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:03:42.101300+0000","last_peered":"2024-05-07T14:03:42.101300+0000","last_clean":"2024-05-07T14:03:42.101300+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:03:42.101300+0000","last_undegraded":"2024-05-07T14:03:42.101300+0000","last_fullsized":"2024-05-07T14:03:42.101300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699570+0000","last_change":"2024-05-07T14:00:56.008026+0000","last_active":"2024-05-07T14:03:41.699570+0000","last_peered":"2024-05-07T14:03:41.699570+0000","last_clean":"2024-05-07T14:03:41.699570+0000","last_became_active":"2024-05-07T14:00:56.007374+0000","last_became_peered":"2024-05-07T14:00:56.007374+0000","last_unstale":"2024-05-07T14:03:41.699570+0000","last_undegraded":"2024-05-07T14:03:41.699570+0000","last_fullsized":"2024-05-07T14:03:41.699570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707009+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:03:41.707009+0000","last_peered":"2024-05-07T14:03:41.707009+0000","last_clean":"2024-05-07T14:03:41.707009+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:03:41.707009+0000","last_undegraded":"2024-05-07T14:03:41.707009+0000","last_fullsized":"2024-05-07T14:03:41.707009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"85'20","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697713+0000","last_change":"2024-05-07T14:01:01.997489+0000","last_active":"2024-05-07T14:03:41.697713+0000","last_peered":"2024-05-07T14:03:41.697713+0000","last_clean":"2024-05-07T14:03:41.697713+0000","last_became_active":"2024-05-07T14:01:01.994656+0000","last_became_peered":"2024-05-07T14:01:01.994656+0000","last_unstale":"2024-05-07T14:03:41.697713+0000","last_undegraded":"2024-05-07T14:03:41.697713+0000","last_fullsized":"2024-05-07T14:03:41.697713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:12.091721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"101'107","reported_seq":307,"reported_epoch":101,"state":"peering","last_fresh":"2024-05-07T14:03:40.791852+0000","last_change":"2024-05-07T14:03:41.699155+0000","last_active":"2024-05-07T14:03:41.699155+0000","last_peered":"2024-05-07T14:03:40.791852+0000","last_clean":"2024-05-07T14:03:37.947580+0000","last_became_active":"2024-05-07T14:03:40.773668+0000","last_became_peered":"2024-05-07T14:03:40.773668+0000","last_unstale":"2024-05-07T14:03:40.791852+0000","last_undegraded":"2024-05-07T14:03:40.791852+0000","last_fullsized":"2024-05-07T14:03:40.647524+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.701255+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:03:41.701255+0000","last_peered":"2024-05-07T14:03:41.701255+0000","last_clean":"2024-05-07T14:03:41.701255+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:03:41.701255+0000","last_undegraded":"2024-05-07T14:03:41.701255+0000","last_fullsized":"2024-05-07T14:03:41.701255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"81'8","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700540+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:03:41.700540+0000","last_peered":"2024-05-07T14:03:41.700540+0000","last_clean":"2024-05-07T14:03:41.700540+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:03:41.700540+0000","last_undegraded":"2024-05-07T14:03:41.700540+0000","last_fullsized":"2024-05-07T14:03:41.700540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698973+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:03:41.698973+0000","last_peered":"2024-05-07T14:03:41.698973+0000","last_clean":"2024-05-07T14:03:41.698973+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:03:41.698973+0000","last_undegraded":"2024-05-07T14:03:41.698973+0000","last_fullsized":"2024-05-07T14:03:41.698973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706893+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:03:41.706893+0000","last_peered":"2024-05-07T14:03:41.706893+0000","last_clean":"2024-05-07T14:03:41.706893+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:03:41.706893+0000","last_undegraded":"2024-05-07T14:03:41.706893+0000","last_fullsized":"2024-05-07T14:03:41.706893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"85'22","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698263+0000","last_change":"2024-05-07T14:01:01.995144+0000","last_active":"2024-05-07T14:03:41.698263+0000","last_peered":"2024-05-07T14:03:41.698263+0000","last_clean":"2024-05-07T14:03:41.698263+0000","last_became_active":"2024-05-07T14:01:01.993073+0000","last_became_peered":"2024-05-07T14:01:01.993073+0000","last_unstale":"2024-05-07T14:03:41.698263+0000","last_undegraded":"2024-05-07T14:03:41.698263+0000","last_fullsized":"2024-05-07T14:03:41.698263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:54.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704464+0000","last_change":"2024-05-07T14:01:04.012216+0000","last_active":"2024-05-07T14:03:41.704464+0000","last_peered":"2024-05-07T14:03:41.704464+0000","last_clean":"2024-05-07T14:03:41.704464+0000","last_became_active":"2024-05-07T14:01:04.011476+0000","last_became_peered":"2024-05-07T14:01:04.011476+0000","last_unstale":"2024-05-07T14:03:41.704464+0000","last_undegraded":"2024-05-07T14:03:41.704464+0000","last_fullsized":"2024-05-07T14:03:41.704464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:46.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'4","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708936+0000","last_change":"2024-05-07T14:03:39.802033+0000","last_active":"2024-05-07T14:03:41.708936+0000","last_peered":"2024-05-07T14:03:41.708936+0000","last_clean":"2024-05-07T14:03:41.708936+0000","last_became_active":"2024-05-07T14:03:39.675695+0000","last_became_peered":"2024-05-07T14:03:39.675695+0000","last_unstale":"2024-05-07T14:03:41.708936+0000","last_undegraded":"2024-05-07T14:03:41.708936+0000","last_fullsized":"2024-05-07T14:03:41.708936+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:22:02.594405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"87'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702884+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:03:41.702884+0000","last_peered":"2024-05-07T14:03:41.702884+0000","last_clean":"2024-05-07T14:03:41.702884+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:03:41.702884+0000","last_undegraded":"2024-05-07T14:03:41.702884+0000","last_fullsized":"2024-05-07T14:03:41.702884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710775+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:03:41.710775+0000","last_peered":"2024-05-07T14:03:41.710775+0000","last_clean":"2024-05-07T14:03:41.710775+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:03:41.710775+0000","last_undegraded":"2024-05-07T14:03:41.710775+0000","last_fullsized":"2024-05-07T14:03:41.710775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705310+0000","last_change":"2024-05-07T14:00:59.992897+0000","last_active":"2024-05-07T14:03:41.705310+0000","last_peered":"2024-05-07T14:03:41.705310+0000","last_clean":"2024-05-07T14:03:41.705310+0000","last_became_active":"2024-05-07T14:00:59.992067+0000","last_became_peered":"2024-05-07T14:00:59.992067+0000","last_unstale":"2024-05-07T14:03:41.705310+0000","last_undegraded":"2024-05-07T14:03:41.705310+0000","last_fullsized":"2024-05-07T14:03:41.705310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:19.526884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"85'18","reported_seq":219,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703791+0000","last_change":"2024-05-07T14:03:39.698456+0000","last_active":"2024-05-07T14:03:41.703791+0000","last_peered":"2024-05-07T14:03:41.703791+0000","last_clean":"2024-05-07T14:03:41.703791+0000","last_became_active":"2024-05-07T14:03:39.663223+0000","last_became_peered":"2024-05-07T14:03:39.663223+0000","last_unstale":"2024-05-07T14:03:41.703791+0000","last_undegraded":"2024-05-07T14:03:41.703791+0000","last_fullsized":"2024-05-07T14:03:41.703791+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:58.582121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699535+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:03:41.699535+0000","last_peered":"2024-05-07T14:03:41.699535+0000","last_clean":"2024-05-07T14:03:41.699535+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:03:41.699535+0000","last_undegraded":"2024-05-07T14:03:41.699535+0000","last_fullsized":"2024-05-07T14:03:41.699535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"94'5","reported_seq":159,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712479+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:03:41.712479+0000","last_peered":"2024-05-07T14:03:41.712479+0000","last_clean":"2024-05-07T14:03:41.712479+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:03:41.712479+0000","last_undegraded":"2024-05-07T14:03:41.712479+0000","last_fullsized":"2024-05-07T14:03:41.712479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"94'10","reported_seq":205,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703860+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:03:41.703860+0000","last_peered":"2024-05-07T14:03:41.703860+0000","last_clean":"2024-05-07T14:03:41.703860+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:03:41.703860+0000","last_undegraded":"2024-05-07T14:03:41.703860+0000","last_fullsized":"2024-05-07T14:03:41.703860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101506+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:03:42.101506+0000","last_peered":"2024-05-07T14:03:42.101506+0000","last_clean":"2024-05-07T14:03:42.101506+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:03:42.101506+0000","last_undegraded":"2024-05-07T14:03:42.101506+0000","last_fullsized":"2024-05-07T14:03:42.101506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707587+0000","last_change":"2024-05-07T14:03:39.714297+0000","last_active":"2024-05-07T14:03:41.707587+0000","last_peered":"2024-05-07T14:03:41.707587+0000","last_clean":"2024-05-07T14:03:41.707587+0000","last_became_active":"2024-05-07T14:03:39.663013+0000","last_became_peered":"2024-05-07T14:03:39.663013+0000","last_unstale":"2024-05-07T14:03:41.707587+0000","last_undegraded":"2024-05-07T14:03:41.707587+0000","last_fullsized":"2024-05-07T14:03:41.707587+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:40:56.207747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"85'21","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707504+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:03:41.707504+0000","last_peered":"2024-05-07T14:03:41.707504+0000","last_clean":"2024-05-07T14:03:41.707504+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:03:41.707504+0000","last_undegraded":"2024-05-07T14:03:41.707504+0000","last_fullsized":"2024-05-07T14:03:41.707504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"94'104","reported_seq":302,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705231+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:03:41.705231+0000","last_peered":"2024-05-07T14:03:41.705231+0000","last_clean":"2024-05-07T14:03:41.705231+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:03:41.705231+0000","last_undegraded":"2024-05-07T14:03:41.705231+0000","last_fullsized":"2024-05-07T14:03:41.705231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"87'4","reported_seq":156,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710042+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:03:41.710042+0000","last_peered":"2024-05-07T14:03:41.710042+0000","last_clean":"2024-05-07T14:03:41.710042+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:03:41.710042+0000","last_undegraded":"2024-05-07T14:03:41.710042+0000","last_fullsized":"2024-05-07T14:03:41.710042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"94'7","reported_seq":194,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704217+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:03:41.704217+0000","last_peered":"2024-05-07T14:03:41.704217+0000","last_clean":"2024-05-07T14:03:41.704217+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:03:41.704217+0000","last_undegraded":"2024-05-07T14:03:41.704217+0000","last_fullsized":"2024-05-07T14:03:41.704217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"85'4","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703666+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:03:41.703666+0000","last_peered":"2024-05-07T14:03:41.703666+0000","last_clean":"2024-05-07T14:03:41.703666+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:03:41.703666+0000","last_undegraded":"2024-05-07T14:03:41.703666+0000","last_fullsized":"2024-05-07T14:03:41.703666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":303,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697177+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:03:41.697177+0000","last_peered":"2024-05-07T14:03:41.697177+0000","last_clean":"2024-05-07T14:03:41.697177+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:03:41.697177+0000","last_undegraded":"2024-05-07T14:03:41.697177+0000","last_fullsized":"2024-05-07T14:03:41.697177+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712429+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:03:41.712429+0000","last_peered":"2024-05-07T14:03:41.712429+0000","last_clean":"2024-05-07T14:03:41.712429+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:03:41.712429+0000","last_undegraded":"2024-05-07T14:03:41.712429+0000","last_fullsized":"2024-05-07T14:03:41.712429+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"94'104","reported_seq":293,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101190+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:03:42.101190+0000","last_peered":"2024-05-07T14:03:42.101190+0000","last_clean":"2024-05-07T14:03:42.101190+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:03:42.101190+0000","last_undegraded":"2024-05-07T14:03:42.101190+0000","last_fullsized":"2024-05-07T14:03:42.101190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"87'6","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702966+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:03:41.702966+0000","last_peered":"2024-05-07T14:03:41.702966+0000","last_clean":"2024-05-07T14:03:41.702966+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:03:41.702966+0000","last_undegraded":"2024-05-07T14:03:41.702966+0000","last_fullsized":"2024-05-07T14:03:41.702966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"87'4","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710184+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:03:41.710184+0000","last_peered":"2024-05-07T14:03:41.710184+0000","last_clean":"2024-05-07T14:03:41.710184+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:03:41.710184+0000","last_undegraded":"2024-05-07T14:03:41.710184+0000","last_fullsized":"2024-05-07T14:03:41.710184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"85'5","reported_seq":210,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710874+0000","last_change":"2024-05-07T14:03:39.814768+0000","last_active":"2024-05-07T14:03:41.710874+0000","last_peered":"2024-05-07T14:03:41.710874+0000","last_clean":"2024-05-07T14:03:41.710874+0000","last_became_active":"2024-05-07T14:03:39.666192+0000","last_became_peered":"2024-05-07T14:03:39.666192+0000","last_unstale":"2024-05-07T14:03:41.710874+0000","last_undegraded":"2024-05-07T14:03:41.710874+0000","last_fullsized":"2024-05-07T14:03:41.710874+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:10.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704043+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:03:41.704043+0000","last_peered":"2024-05-07T14:03:41.704043+0000","last_clean":"2024-05-07T14:03:41.704043+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:03:41.704043+0000","last_undegraded":"2024-05-07T14:03:41.704043+0000","last_fullsized":"2024-05-07T14:03:41.704043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"85'22","reported_seq":238,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696798+0000","last_change":"2024-05-07T14:03:39.845058+0000","last_active":"2024-05-07T14:03:41.696798+0000","last_peered":"2024-05-07T14:03:41.696798+0000","last_clean":"2024-05-07T14:03:41.696798+0000","last_became_active":"2024-05-07T14:03:39.673995+0000","last_became_peered":"2024-05-07T14:03:39.673995+0000","last_unstale":"2024-05-07T14:03:41.696798+0000","last_undegraded":"2024-05-07T14:03:41.696798+0000","last_fullsized":"2024-05-07T14:03:41.696798+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:43.919444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101145+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:03:42.101145+0000","last_peered":"2024-05-07T14:03:42.101145+0000","last_clean":"2024-05-07T14:03:42.101145+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:03:42.101145+0000","last_undegraded":"2024-05-07T14:03:42.101145+0000","last_fullsized":"2024-05-07T14:03:42.101145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708622+0000","last_change":"2024-05-07T14:03:39.666268+0000","last_active":"2024-05-07T14:03:41.708622+0000","last_peered":"2024-05-07T14:03:41.708622+0000","last_clean":"2024-05-07T14:03:41.708622+0000","last_became_active":"2024-05-07T14:03:39.665838+0000","last_became_peered":"2024-05-07T14:03:39.665838+0000","last_unstale":"2024-05-07T14:03:41.708622+0000","last_undegraded":"2024-05-07T14:03:41.708622+0000","last_fullsized":"2024-05-07T14:03:41.708622+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:54:00.122392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101420+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:03:42.101420+0000","last_peered":"2024-05-07T14:03:42.101420+0000","last_clean":"2024-05-07T14:03:42.101420+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:03:42.101420+0000","last_undegraded":"2024-05-07T14:03:42.101420+0000","last_fullsized":"2024-05-07T14:03:42.101420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100554+0000","last_change":"2024-05-07T14:02:39.729323+0000","last_active":"2024-05-07T14:03:42.100554+0000","last_peered":"2024-05-07T14:03:42.100554+0000","last_clean":"2024-05-07T14:03:42.100554+0000","last_became_active":"2024-05-07T14:02:39.728189+0000","last_became_peered":"2024-05-07T14:02:39.728189+0000","last_unstale":"2024-05-07T14:03:42.100554+0000","last_undegraded":"2024-05-07T14:03:42.100554+0000","last_fullsized":"2024-05-07T14:03:42.100554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:53:59.368912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697643+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:03:41.697643+0000","last_peered":"2024-05-07T14:03:41.697643+0000","last_clean":"2024-05-07T14:03:41.697643+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:03:41.697643+0000","last_undegraded":"2024-05-07T14:03:41.697643+0000","last_fullsized":"2024-05-07T14:03:41.697643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'4","reported_seq":124,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706333+0000","last_change":"2024-05-07T14:01:37.317794+0000","last_active":"2024-05-07T14:03:41.706333+0000","last_peered":"2024-05-07T14:03:41.706333+0000","last_clean":"2024-05-07T14:03:41.706333+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:03:41.706333+0000","last_undegraded":"2024-05-07T14:03:41.706333+0000","last_fullsized":"2024-05-07T14:03:41.706333+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:17.582561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700564+0000","last_change":"2024-05-07T14:00:59.988489+0000","last_active":"2024-05-07T14:03:41.700564+0000","last_peered":"2024-05-07T14:03:41.700564+0000","last_clean":"2024-05-07T14:03:41.700564+0000","last_became_active":"2024-05-07T14:00:59.987757+0000","last_became_peered":"2024-05-07T14:00:59.987757+0000","last_unstale":"2024-05-07T14:03:41.700564+0000","last_undegraded":"2024-05-07T14:03:41.700564+0000","last_fullsized":"2024-05-07T14:03:41.700564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"87'29","reported_seq":202,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697712+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:03:41.697712+0000","last_peered":"2024-05-07T14:03:41.697712+0000","last_clean":"2024-05-07T14:03:41.697712+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:03:41.697712+0000","last_undegraded":"2024-05-07T14:03:41.697712+0000","last_fullsized":"2024-05-07T14:03:41.697712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.701578+0000","last_change":"2024-05-07T14:01:04.007712+0000","last_active":"2024-05-07T14:03:41.701578+0000","last_peered":"2024-05-07T14:03:41.701578+0000","last_clean":"2024-05-07T14:03:41.701578+0000","last_became_active":"2024-05-07T14:01:04.006934+0000","last_became_peered":"2024-05-07T14:01:04.006934+0000","last_unstale":"2024-05-07T14:03:41.701578+0000","last_undegraded":"2024-05-07T14:03:41.701578+0000","last_fullsized":"2024-05-07T14:03:41.701578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100677+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:03:42.100677+0000","last_peered":"2024-05-07T14:03:42.100677+0000","last_clean":"2024-05-07T14:03:42.100677+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:03:42.100677+0000","last_undegraded":"2024-05-07T14:03:42.100677+0000","last_fullsized":"2024-05-07T14:03:42.100677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'2","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702434+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:03:41.702434+0000","last_peered":"2024-05-07T14:03:41.702434+0000","last_clean":"2024-05-07T14:03:41.702434+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:03:41.702434+0000","last_undegraded":"2024-05-07T14:03:41.702434+0000","last_fullsized":"2024-05-07T14:03:41.702434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695809+0000","last_change":"2024-05-07T14:03:39.661648+0000","last_active":"2024-05-07T14:03:41.695809+0000","last_peered":"2024-05-07T14:03:41.695809+0000","last_clean":"2024-05-07T14:03:41.695809+0000","last_became_active":"2024-05-07T14:03:39.660828+0000","last_became_peered":"2024-05-07T14:03:39.660828+0000","last_unstale":"2024-05-07T14:03:41.695809+0000","last_undegraded":"2024-05-07T14:03:41.695809+0000","last_fullsized":"2024-05-07T14:03:41.695809+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:55:55.161988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":170,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698566+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:03:41.698566+0000","last_peered":"2024-05-07T14:03:41.698566+0000","last_clean":"2024-05-07T14:03:41.698566+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:03:41.698566+0000","last_undegraded":"2024-05-07T14:03:41.698566+0000","last_fullsized":"2024-05-07T14:03:41.698566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698210+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:03:41.698210+0000","last_peered":"2024-05-07T14:03:41.698210+0000","last_clean":"2024-05-07T14:03:41.698210+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:03:41.698210+0000","last_undegraded":"2024-05-07T14:03:41.698210+0000","last_fullsized":"2024-05-07T14:03:41.698210+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"101'110","reported_seq":362,"reported_epoch":102,"state":"peering","last_fresh":"2024-05-07T14:03:40.790413+0000","last_change":"2024-05-07T14:03:42.630857+0000","last_active":"2024-05-07T14:03:42.630857+0000","last_peered":"2024-05-07T14:03:40.790413+0000","last_clean":"2024-05-07T14:03:30.102584+0000","last_became_active":"2024-05-07T14:03:40.773656+0000","last_became_peered":"2024-05-07T14:03:40.773656+0000","last_unstale":"2024-05-07T14:03:40.790413+0000","last_undegraded":"2024-05-07T14:03:40.790413+0000","last_fullsized":"2024-05-07T14:03:40.790413+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5457,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":148,"num_read_kb":136,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698407+0000","last_change":"2024-05-07T14:01:04.012527+0000","last_active":"2024-05-07T14:03:41.698407+0000","last_peered":"2024-05-07T14:03:41.698407+0000","last_clean":"2024-05-07T14:03:41.698407+0000","last_became_active":"2024-05-07T14:01:04.007658+0000","last_became_peered":"2024-05-07T14:01:04.007658+0000","last_unstale":"2024-05-07T14:03:41.698407+0000","last_undegraded":"2024-05-07T14:03:41.698407+0000","last_fullsized":"2024-05-07T14:03:41.698407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"80'4","reported_seq":156,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708582+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:03:41.708582+0000","last_peered":"2024-05-07T14:03:41.708582+0000","last_clean":"2024-05-07T14:03:41.708582+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:03:41.708582+0000","last_undegraded":"2024-05-07T14:03:41.708582+0000","last_fullsized":"2024-05-07T14:03:41.708582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"81'2","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708346+0000","last_change":"2024-05-07T14:03:39.711373+0000","last_active":"2024-05-07T14:03:41.708346+0000","last_peered":"2024-05-07T14:03:41.708346+0000","last_clean":"2024-05-07T14:03:41.708346+0000","last_became_active":"2024-05-07T14:03:39.667130+0000","last_became_peered":"2024-05-07T14:03:39.667130+0000","last_unstale":"2024-05-07T14:03:41.708346+0000","last_undegraded":"2024-05-07T14:03:41.708346+0000","last_fullsized":"2024-05-07T14:03:41.708346+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:36.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705272+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:03:41.705272+0000","last_peered":"2024-05-07T14:03:41.705272+0000","last_clean":"2024-05-07T14:03:41.705272+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:03:41.705272+0000","last_undegraded":"2024-05-07T14:03:41.705272+0000","last_fullsized":"2024-05-07T14:03:41.705272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"85'6","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709743+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:03:41.709743+0000","last_peered":"2024-05-07T14:03:41.709743+0000","last_clean":"2024-05-07T14:03:41.709743+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:03:41.709743+0000","last_undegraded":"2024-05-07T14:03:41.709743+0000","last_fullsized":"2024-05-07T14:03:41.709743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705436+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:03:41.705436+0000","last_peered":"2024-05-07T14:03:41.705436+0000","last_clean":"2024-05-07T14:03:41.705436+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:03:41.705436+0000","last_undegraded":"2024-05-07T14:03:41.705436+0000","last_fullsized":"2024-05-07T14:03:41.705436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":212,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699075+0000","last_change":"2024-05-07T14:01:02.148182+0000","last_active":"2024-05-07T14:03:41.699075+0000","last_peered":"2024-05-07T14:03:41.699075+0000","last_clean":"2024-05-07T14:03:41.699075+0000","last_became_active":"2024-05-07T14:01:02.147442+0000","last_became_peered":"2024-05-07T14:01:02.147442+0000","last_unstale":"2024-05-07T14:03:41.699075+0000","last_undegraded":"2024-05-07T14:03:41.699075+0000","last_fullsized":"2024-05-07T14:03:41.699075+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:24.955989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700363+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:03:41.700363+0000","last_peered":"2024-05-07T14:03:41.700363+0000","last_clean":"2024-05-07T14:03:41.700363+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:03:41.700363+0000","last_undegraded":"2024-05-07T14:03:41.700363+0000","last_fullsized":"2024-05-07T14:03:41.700363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711345+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:03:41.711345+0000","last_peered":"2024-05-07T14:03:41.711345+0000","last_clean":"2024-05-07T14:03:41.711345+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:03:41.711345+0000","last_undegraded":"2024-05-07T14:03:41.711345+0000","last_fullsized":"2024-05-07T14:03:41.711345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"81'4","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707687+0000","last_change":"2024-05-07T14:03:39.687600+0000","last_active":"2024-05-07T14:03:41.707687+0000","last_peered":"2024-05-07T14:03:41.707687+0000","last_clean":"2024-05-07T14:03:41.707687+0000","last_became_active":"2024-05-07T14:03:39.661295+0000","last_became_peered":"2024-05-07T14:03:39.661295+0000","last_unstale":"2024-05-07T14:03:41.707687+0000","last_undegraded":"2024-05-07T14:03:41.707687+0000","last_fullsized":"2024-05-07T14:03:41.707687+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:17:58.416324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697844+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:03:41.697844+0000","last_peered":"2024-05-07T14:03:41.697844+0000","last_clean":"2024-05-07T14:03:41.697844+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:03:41.697844+0000","last_undegraded":"2024-05-07T14:03:41.697844+0000","last_fullsized":"2024-05-07T14:03:41.697844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"85'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702966+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:03:41.702966+0000","last_peered":"2024-05-07T14:03:41.702966+0000","last_clean":"2024-05-07T14:03:41.702966+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:03:41.702966+0000","last_undegraded":"2024-05-07T14:03:41.702966+0000","last_fullsized":"2024-05-07T14:03:41.702966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698782+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:03:41.698782+0000","last_peered":"2024-05-07T14:03:41.698782+0000","last_clean":"2024-05-07T14:03:41.698782+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:03:41.698782+0000","last_undegraded":"2024-05-07T14:03:41.698782+0000","last_fullsized":"2024-05-07T14:03:41.698782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710939+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:03:41.710939+0000","last_peered":"2024-05-07T14:03:41.710939+0000","last_clean":"2024-05-07T14:03:41.710939+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:03:41.710939+0000","last_undegraded":"2024-05-07T14:03:41.710939+0000","last_fullsized":"2024-05-07T14:03:41.710939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101592+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:03:42.101592+0000","last_peered":"2024-05-07T14:03:42.101592+0000","last_clean":"2024-05-07T14:03:42.101592+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:03:42.101592+0000","last_undegraded":"2024-05-07T14:03:42.101592+0000","last_fullsized":"2024-05-07T14:03:42.101592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695342+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:03:41.695342+0000","last_peered":"2024-05-07T14:03:41.695342+0000","last_clean":"2024-05-07T14:03:41.695342+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:03:41.695342+0000","last_undegraded":"2024-05-07T14:03:41.695342+0000","last_fullsized":"2024-05-07T14:03:41.695342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708520+0000","last_change":"2024-05-07T14:03:39.659916+0000","last_active":"2024-05-07T14:03:41.708520+0000","last_peered":"2024-05-07T14:03:41.708520+0000","last_clean":"2024-05-07T14:03:41.708520+0000","last_became_active":"2024-05-07T14:03:39.659515+0000","last_became_peered":"2024-05-07T14:03:39.659515+0000","last_unstale":"2024-05-07T14:03:41.708520+0000","last_undegraded":"2024-05-07T14:03:41.708520+0000","last_fullsized":"2024-05-07T14:03:41.708520+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:49:16.796937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698099+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:03:41.698099+0000","last_peered":"2024-05-07T14:03:41.698099+0000","last_clean":"2024-05-07T14:03:41.698099+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:03:41.698099+0000","last_undegraded":"2024-05-07T14:03:41.698099+0000","last_fullsized":"2024-05-07T14:03:41.698099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708058+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:03:41.708058+0000","last_peered":"2024-05-07T14:03:41.708058+0000","last_clean":"2024-05-07T14:03:41.708058+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:03:41.708058+0000","last_undegraded":"2024-05-07T14:03:41.708058+0000","last_fullsized":"2024-05-07T14:03:41.708058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699109+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:03:41.699109+0000","last_peered":"2024-05-07T14:03:41.699109+0000","last_clean":"2024-05-07T14:03:41.699109+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:03:41.699109+0000","last_undegraded":"2024-05-07T14:03:41.699109+0000","last_fullsized":"2024-05-07T14:03:41.699109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"85'29","reported_seq":201,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698321+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:03:41.698321+0000","last_peered":"2024-05-07T14:03:41.698321+0000","last_clean":"2024-05-07T14:03:41.698321+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:03:41.698321+0000","last_undegraded":"2024-05-07T14:03:41.698321+0000","last_fullsized":"2024-05-07T14:03:41.698321+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702991+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:03:41.702991+0000","last_peered":"2024-05-07T14:03:41.702991+0000","last_clean":"2024-05-07T14:03:41.702991+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:03:41.702991+0000","last_undegraded":"2024-05-07T14:03:41.702991+0000","last_fullsized":"2024-05-07T14:03:41.702991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700362+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:03:41.700362+0000","last_peered":"2024-05-07T14:03:41.700362+0000","last_clean":"2024-05-07T14:03:41.700362+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:03:41.700362+0000","last_undegraded":"2024-05-07T14:03:41.700362+0000","last_fullsized":"2024-05-07T14:03:41.700362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700237+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:03:41.700237+0000","last_peered":"2024-05-07T14:03:41.700237+0000","last_clean":"2024-05-07T14:03:41.700237+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:03:41.700237+0000","last_undegraded":"2024-05-07T14:03:41.700237+0000","last_fullsized":"2024-05-07T14:03:41.700237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707833+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:03:41.707833+0000","last_peered":"2024-05-07T14:03:41.707833+0000","last_clean":"2024-05-07T14:03:41.707833+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:03:41.707833+0000","last_undegraded":"2024-05-07T14:03:41.707833+0000","last_fullsized":"2024-05-07T14:03:41.707833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699867+0000","last_change":"2024-05-07T14:00:49.928907+0000","last_active":"2024-05-07T14:03:41.699867+0000","last_peered":"2024-05-07T14:03:41.699867+0000","last_clean":"2024-05-07T14:03:41.699867+0000","last_became_active":"2024-05-07T14:00:49.928146+0000","last_became_peered":"2024-05-07T14:00:49.928146+0000","last_unstale":"2024-05-07T14:03:41.699867+0000","last_undegraded":"2024-05-07T14:03:41.699867+0000","last_fullsized":"2024-05-07T14:03:41.699867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:07.032835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101098+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:03:42.101098+0000","last_peered":"2024-05-07T14:03:42.101098+0000","last_clean":"2024-05-07T14:03:42.101098+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:03:42.101098+0000","last_undegraded":"2024-05-07T14:03:42.101098+0000","last_fullsized":"2024-05-07T14:03:42.101098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":30,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707747+0000","last_change":"2024-05-07T14:03:39.707679+0000","last_active":"2024-05-07T14:03:41.707747+0000","last_peered":"2024-05-07T14:03:41.707747+0000","last_clean":"2024-05-07T14:03:41.707747+0000","last_became_active":"2024-05-07T14:03:39.664751+0000","last_became_peered":"2024-05-07T14:03:39.664751+0000","last_unstale":"2024-05-07T14:03:41.707747+0000","last_undegraded":"2024-05-07T14:03:41.707747+0000","last_fullsized":"2024-05-07T14:03:41.707747+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:55.535011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"101'107","reported_seq":316,"reported_epoch":101,"state":"peering","last_fresh":"2024-05-07T14:03:40.797550+0000","last_change":"2024-05-07T14:03:41.696412+0000","last_active":"2024-05-07T14:03:41.696412+0000","last_peered":"2024-05-07T14:03:40.797550+0000","last_clean":"2024-05-07T14:03:37.624906+0000","last_became_active":"2024-05-07T14:03:40.773827+0000","last_became_peered":"2024-05-07T14:03:40.773827+0000","last_unstale":"2024-05-07T14:03:40.797550+0000","last_undegraded":"2024-05-07T14:03:40.797550+0000","last_fullsized":"2024-05-07T14:03:40.654026+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711764+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:03:41.711764+0000","last_peered":"2024-05-07T14:03:41.711764+0000","last_clean":"2024-05-07T14:03:41.711764+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:03:41.711764+0000","last_undegraded":"2024-05-07T14:03:41.711764+0000","last_fullsized":"2024-05-07T14:03:41.711764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711403+0000","last_change":"2024-05-07T14:00:57.998539+0000","last_active":"2024-05-07T14:03:41.711403+0000","last_peered":"2024-05-07T14:03:41.711403+0000","last_clean":"2024-05-07T14:03:41.711403+0000","last_became_active":"2024-05-07T14:00:57.998025+0000","last_became_peered":"2024-05-07T14:00:57.998025+0000","last_unstale":"2024-05-07T14:03:41.711403+0000","last_undegraded":"2024-05-07T14:03:41.711403+0000","last_fullsized":"2024-05-07T14:03:41.711403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711068+0000","last_change":"2024-05-07T14:00:55.988508+0000","last_active":"2024-05-07T14:03:41.711068+0000","last_peered":"2024-05-07T14:03:41.711068+0000","last_clean":"2024-05-07T14:03:41.711068+0000","last_became_active":"2024-05-07T14:00:55.988230+0000","last_became_peered":"2024-05-07T14:00:55.988230+0000","last_unstale":"2024-05-07T14:03:41.711068+0000","last_undegraded":"2024-05-07T14:03:41.711068+0000","last_fullsized":"2024-05-07T14:03:41.711068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708834+0000","last_change":"2024-05-07T14:03:39.672724+0000","last_active":"2024-05-07T14:03:41.708834+0000","last_peered":"2024-05-07T14:03:41.708834+0000","last_clean":"2024-05-07T14:03:41.708834+0000","last_became_active":"2024-05-07T14:03:39.671518+0000","last_became_peered":"2024-05-07T14:03:39.671518+0000","last_unstale":"2024-05-07T14:03:41.708834+0000","last_undegraded":"2024-05-07T14:03:41.708834+0000","last_fullsized":"2024-05-07T14:03:41.708834+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:25.485797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703264+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:03:41.703264+0000","last_peered":"2024-05-07T14:03:41.703264+0000","last_clean":"2024-05-07T14:03:41.703264+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:03:41.703264+0000","last_undegraded":"2024-05-07T14:03:41.703264+0000","last_fullsized":"2024-05-07T14:03:41.703264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703164+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:03:41.703164+0000","last_peered":"2024-05-07T14:03:41.703164+0000","last_clean":"2024-05-07T14:03:41.703164+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:03:41.703164+0000","last_undegraded":"2024-05-07T14:03:41.703164+0000","last_fullsized":"2024-05-07T14:03:41.703164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"94'104","reported_seq":329,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.714221+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:03:41.714221+0000","last_peered":"2024-05-07T14:03:41.714221+0000","last_clean":"2024-05-07T14:03:41.714221+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:03:41.714221+0000","last_undegraded":"2024-05-07T14:03:41.714221+0000","last_fullsized":"2024-05-07T14:03:41.714221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"81'3","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700621+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:03:41.700621+0000","last_peered":"2024-05-07T14:03:41.700621+0000","last_clean":"2024-05-07T14:03:41.700621+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:03:41.700621+0000","last_undegraded":"2024-05-07T14:03:41.700621+0000","last_fullsized":"2024-05-07T14:03:41.700621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703477+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:03:41.703477+0000","last_peered":"2024-05-07T14:03:41.703477+0000","last_clean":"2024-05-07T14:03:41.703477+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:03:41.703477+0000","last_undegraded":"2024-05-07T14:03:41.703477+0000","last_fullsized":"2024-05-07T14:03:41.703477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'5","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703093+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:03:41.703093+0000","last_peered":"2024-05-07T14:03:41.703093+0000","last_clean":"2024-05-07T14:03:41.703093+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:03:41.703093+0000","last_undegraded":"2024-05-07T14:03:41.703093+0000","last_fullsized":"2024-05-07T14:03:41.703093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101852+0000","last_change":"2024-05-07T14:00:49.938879+0000","last_active":"2024-05-07T14:03:42.101852+0000","last_peered":"2024-05-07T14:03:42.101852+0000","last_clean":"2024-05-07T14:03:42.101852+0000","last_became_active":"2024-05-07T14:00:49.938066+0000","last_became_peered":"2024-05-07T14:00:49.938066+0000","last_unstale":"2024-05-07T14:03:42.101852+0000","last_undegraded":"2024-05-07T14:03:42.101852+0000","last_fullsized":"2024-05-07T14:03:42.101852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711837+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:03:41.711837+0000","last_peered":"2024-05-07T14:03:41.711837+0000","last_clean":"2024-05-07T14:03:41.711837+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:03:41.711837+0000","last_undegraded":"2024-05-07T14:03:41.711837+0000","last_fullsized":"2024-05-07T14:03:41.711837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"85'35","reported_seq":211,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698987+0000","last_change":"2024-05-07T14:01:02.148095+0000","last_active":"2024-05-07T14:03:41.698987+0000","last_peered":"2024-05-07T14:03:41.698987+0000","last_clean":"2024-05-07T14:03:41.698987+0000","last_became_active":"2024-05-07T14:01:02.147334+0000","last_became_peered":"2024-05-07T14:01:02.147334+0000","last_unstale":"2024-05-07T14:03:41.698987+0000","last_undegraded":"2024-05-07T14:03:41.698987+0000","last_fullsized":"2024-05-07T14:03:41.698987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":165,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710112+0000","last_change":"2024-05-07T14:03:39.665240+0000","last_active":"2024-05-07T14:03:41.710112+0000","last_peered":"2024-05-07T14:03:41.710112+0000","last_clean":"2024-05-07T14:03:41.710112+0000","last_became_active":"2024-05-07T14:03:39.664810+0000","last_became_peered":"2024-05-07T14:03:39.664810+0000","last_unstale":"2024-05-07T14:03:41.710112+0000","last_undegraded":"2024-05-07T14:03:41.710112+0000","last_fullsized":"2024-05-07T14:03:41.710112+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:18:01.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696662+0000","last_change":"2024-05-07T14:01:06.039788+0000","last_active":"2024-05-07T14:03:41.696662+0000","last_peered":"2024-05-07T14:03:41.696662+0000","last_clean":"2024-05-07T14:03:41.696662+0000","last_became_active":"2024-05-07T14:01:06.039050+0000","last_became_peered":"2024-05-07T14:01:06.039050+0000","last_unstale":"2024-05-07T14:03:41.696662+0000","last_undegraded":"2024-05-07T14:03:41.696662+0000","last_fullsized":"2024-05-07T14:03:41.696662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699068+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:03:41.699068+0000","last_peered":"2024-05-07T14:03:41.699068+0000","last_clean":"2024-05-07T14:03:41.699068+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:03:41.699068+0000","last_undegraded":"2024-05-07T14:03:41.699068+0000","last_fullsized":"2024-05-07T14:03:41.699068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'8","reported_seq":203,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702599+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:03:41.702599+0000","last_peered":"2024-05-07T14:03:41.702599+0000","last_clean":"2024-05-07T14:03:41.702599+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:03:41.702599+0000","last_undegraded":"2024-05-07T14:03:41.702599+0000","last_fullsized":"2024-05-07T14:03:41.702599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"85'10","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702672+0000","last_change":"2024-05-07T14:00:55.991934+0000","last_active":"2024-05-07T14:03:41.702672+0000","last_peered":"2024-05-07T14:03:41.702672+0000","last_clean":"2024-05-07T14:03:41.702672+0000","last_became_active":"2024-05-07T14:00:55.991303+0000","last_became_peered":"2024-05-07T14:00:55.991303+0000","last_unstale":"2024-05-07T14:03:41.702672+0000","last_undegraded":"2024-05-07T14:03:41.702672+0000","last_fullsized":"2024-05-07T14:03:41.702672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709713+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:03:41.709713+0000","last_peered":"2024-05-07T14:03:41.709713+0000","last_clean":"2024-05-07T14:03:41.709713+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:03:41.709713+0000","last_undegraded":"2024-05-07T14:03:41.709713+0000","last_fullsized":"2024-05-07T14:03:41.709713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"85'17","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709926+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:03:41.709926+0000","last_peered":"2024-05-07T14:03:41.709926+0000","last_clean":"2024-05-07T14:03:41.709926+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:03:41.709926+0000","last_undegraded":"2024-05-07T14:03:41.709926+0000","last_fullsized":"2024-05-07T14:03:41.709926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712038+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:03:41.712038+0000","last_peered":"2024-05-07T14:03:41.712038+0000","last_clean":"2024-05-07T14:03:41.712038+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:03:41.712038+0000","last_undegraded":"2024-05-07T14:03:41.712038+0000","last_fullsized":"2024-05-07T14:03:41.712038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710700+0000","last_change":"2024-05-07T14:01:06.013974+0000","last_active":"2024-05-07T14:03:41.710700+0000","last_peered":"2024-05-07T14:03:41.710700+0000","last_clean":"2024-05-07T14:03:41.710700+0000","last_became_active":"2024-05-07T14:01:06.013281+0000","last_became_peered":"2024-05-07T14:01:06.013281+0000","last_unstale":"2024-05-07T14:03:41.710700+0000","last_undegraded":"2024-05-07T14:03:41.710700+0000","last_fullsized":"2024-05-07T14:03:41.710700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:46.349394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"94'3","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708331+0000","last_change":"2024-05-07T14:03:39.692877+0000","last_active":"2024-05-07T14:03:41.708331+0000","last_peered":"2024-05-07T14:03:41.708331+0000","last_clean":"2024-05-07T14:03:41.708331+0000","last_became_active":"2024-05-07T14:03:39.663976+0000","last_became_peered":"2024-05-07T14:03:39.663976+0000","last_unstale":"2024-05-07T14:03:41.708331+0000","last_undegraded":"2024-05-07T14:03:41.708331+0000","last_fullsized":"2024-05-07T14:03:41.708331+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:36.548454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699404+0000","last_change":"2024-05-07T14:00:55.968287+0000","last_active":"2024-05-07T14:03:41.699404+0000","last_peered":"2024-05-07T14:03:41.699404+0000","last_clean":"2024-05-07T14:03:41.699404+0000","last_became_active":"2024-05-07T14:00:55.967578+0000","last_became_peered":"2024-05-07T14:00:55.967578+0000","last_unstale":"2024-05-07T14:03:41.699404+0000","last_undegraded":"2024-05-07T14:03:41.699404+0000","last_fullsized":"2024-05-07T14:03:41.699404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711159+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:03:41.711159+0000","last_peered":"2024-05-07T14:03:41.711159+0000","last_clean":"2024-05-07T14:03:41.711159+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:03:41.711159+0000","last_undegraded":"2024-05-07T14:03:41.711159+0000","last_fullsized":"2024-05-07T14:03:41.711159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"97'7","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697842+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:03:41.697842+0000","last_peered":"2024-05-07T14:03:41.697842+0000","last_clean":"2024-05-07T14:03:41.697842+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:03:41.697842+0000","last_undegraded":"2024-05-07T14:03:41.697842+0000","last_fullsized":"2024-05-07T14:03:41.697842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":26,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696436+0000","last_change":"2024-05-07T14:01:04.012628+0000","last_active":"2024-05-07T14:03:41.696436+0000","last_peered":"2024-05-07T14:03:41.696436+0000","last_clean":"2024-05-07T14:03:41.696436+0000","last_became_active":"2024-05-07T14:01:04.011910+0000","last_became_peered":"2024-05-07T14:01:04.011910+0000","last_unstale":"2024-05-07T14:03:41.696436+0000","last_undegraded":"2024-05-07T14:03:41.696436+0000","last_fullsized":"2024-05-07T14:03:41.696436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"94'1","reported_seq":153,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698734+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:03:41.698734+0000","last_peered":"2024-05-07T14:03:41.698734+0000","last_clean":"2024-05-07T14:03:41.698734+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:03:41.698734+0000","last_undegraded":"2024-05-07T14:03:41.698734+0000","last_fullsized":"2024-05-07T14:03:41.698734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"81'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712225+0000","last_change":"2024-05-07T14:00:57.999019+0000","last_active":"2024-05-07T14:03:41.712225+0000","last_peered":"2024-05-07T14:03:41.712225+0000","last_clean":"2024-05-07T14:03:41.712225+0000","last_became_active":"2024-05-07T14:00:57.998526+0000","last_became_peered":"2024-05-07T14:00:57.998526+0000","last_unstale":"2024-05-07T14:03:41.712225+0000","last_undegraded":"2024-05-07T14:03:41.712225+0000","last_fullsized":"2024-05-07T14:03:41.712225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"85'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698007+0000","last_change":"2024-05-07T14:00:55.999548+0000","last_active":"2024-05-07T14:03:41.698007+0000","last_peered":"2024-05-07T14:03:41.698007+0000","last_clean":"2024-05-07T14:03:41.698007+0000","last_became_active":"2024-05-07T14:00:55.995284+0000","last_became_peered":"2024-05-07T14:00:55.995284+0000","last_unstale":"2024-05-07T14:03:41.698007+0000","last_undegraded":"2024-05-07T14:03:41.698007+0000","last_fullsized":"2024-05-07T14:03:41.698007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.694737+0000","last_change":"2024-05-07T14:00:59.996971+0000","last_active":"2024-05-07T14:03:41.694737+0000","last_peered":"2024-05-07T14:03:41.694737+0000","last_clean":"2024-05-07T14:03:41.694737+0000","last_became_active":"2024-05-07T14:00:59.996254+0000","last_became_peered":"2024-05-07T14:00:59.996254+0000","last_unstale":"2024-05-07T14:03:41.694737+0000","last_undegraded":"2024-05-07T14:03:41.694737+0000","last_fullsized":"2024-05-07T14:03:41.694737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"85'17","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710995+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:03:41.710995+0000","last_peered":"2024-05-07T14:03:41.710995+0000","last_clean":"2024-05-07T14:03:41.710995+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:03:41.710995+0000","last_undegraded":"2024-05-07T14:03:41.710995+0000","last_fullsized":"2024-05-07T14:03:41.710995+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100947+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:03:42.100947+0000","last_peered":"2024-05-07T14:03:42.100947+0000","last_clean":"2024-05-07T14:03:42.100947+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:03:42.100947+0000","last_undegraded":"2024-05-07T14:03:42.100947+0000","last_fullsized":"2024-05-07T14:03:42.100947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696828+0000","last_change":"2024-05-07T14:01:06.038138+0000","last_active":"2024-05-07T14:03:41.696828+0000","last_peered":"2024-05-07T14:03:41.696828+0000","last_clean":"2024-05-07T14:03:41.696828+0000","last_became_active":"2024-05-07T14:01:06.030966+0000","last_became_peered":"2024-05-07T14:01:06.030966+0000","last_unstale":"2024-05-07T14:03:41.696828+0000","last_undegraded":"2024-05-07T14:03:41.696828+0000","last_fullsized":"2024-05-07T14:03:41.696828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":31,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695687+0000","last_change":"2024-05-07T14:03:39.677172+0000","last_active":"2024-05-07T14:03:41.695687+0000","last_peered":"2024-05-07T14:03:41.695687+0000","last_clean":"2024-05-07T14:03:41.695687+0000","last_became_active":"2024-05-07T14:03:39.663090+0000","last_became_peered":"2024-05-07T14:03:39.663090+0000","last_unstale":"2024-05-07T14:03:41.695687+0000","last_undegraded":"2024-05-07T14:03:41.695687+0000","last_fullsized":"2024-05-07T14:03:41.695687+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:56.826421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"85'2","reported_seq":121,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707665+0000","last_change":"2024-05-07T14:01:37.318408+0000","last_active":"2024-05-07T14:03:41.707665+0000","last_peered":"2024-05-07T14:03:41.707665+0000","last_clean":"2024-05-07T14:03:41.707665+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:03:41.707665+0000","last_undegraded":"2024-05-07T14:03:41.707665+0000","last_fullsized":"2024-05-07T14:03:41.707665+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:43.643434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100979+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:03:42.100979+0000","last_peered":"2024-05-07T14:03:42.100979+0000","last_clean":"2024-05-07T14:03:42.100979+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:03:42.100979+0000","last_undegraded":"2024-05-07T14:03:42.100979+0000","last_fullsized":"2024-05-07T14:03:42.100979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"85'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696211+0000","last_change":"2024-05-07T14:01:01.995377+0000","last_active":"2024-05-07T14:03:41.696211+0000","last_peered":"2024-05-07T14:03:41.696211+0000","last_clean":"2024-05-07T14:03:41.696211+0000","last_became_active":"2024-05-07T14:01:01.994566+0000","last_became_peered":"2024-05-07T14:01:01.994566+0000","last_unstale":"2024-05-07T14:03:41.696211+0000","last_undegraded":"2024-05-07T14:03:41.696211+0000","last_fullsized":"2024-05-07T14:03:41.696211+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698075+0000","last_change":"2024-05-07T14:01:03.997116+0000","last_active":"2024-05-07T14:03:41.698075+0000","last_peered":"2024-05-07T14:03:41.698075+0000","last_clean":"2024-05-07T14:03:41.698075+0000","last_became_active":"2024-05-07T14:01:03.996555+0000","last_became_peered":"2024-05-07T14:01:03.996555+0000","last_unstale":"2024-05-07T14:03:41.698075+0000","last_undegraded":"2024-05-07T14:03:41.698075+0000","last_fullsized":"2024-05-07T14:03:41.698075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101792+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:03:42.101792+0000","last_peered":"2024-05-07T14:03:42.101792+0000","last_clean":"2024-05-07T14:03:42.101792+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:03:42.101792+0000","last_undegraded":"2024-05-07T14:03:42.101792+0000","last_fullsized":"2024-05-07T14:03:42.101792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'4","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711005+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:03:41.711005+0000","last_peered":"2024-05-07T14:03:41.711005+0000","last_clean":"2024-05-07T14:03:41.711005+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:03:41.711005+0000","last_undegraded":"2024-05-07T14:03:41.711005+0000","last_fullsized":"2024-05-07T14:03:41.711005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.701797+0000","last_change":"2024-05-07T14:00:59.995694+0000","last_active":"2024-05-07T14:03:41.701797+0000","last_peered":"2024-05-07T14:03:41.701797+0000","last_clean":"2024-05-07T14:03:41.701797+0000","last_became_active":"2024-05-07T14:00:59.993899+0000","last_became_peered":"2024-05-07T14:00:59.993899+0000","last_unstale":"2024-05-07T14:03:41.701797+0000","last_undegraded":"2024-05-07T14:03:41.701797+0000","last_fullsized":"2024-05-07T14:03:41.701797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:28.225348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"85'22","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708951+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:03:41.708951+0000","last_peered":"2024-05-07T14:03:41.708951+0000","last_clean":"2024-05-07T14:03:41.708951+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:03:41.708951+0000","last_undegraded":"2024-05-07T14:03:41.708951+0000","last_fullsized":"2024-05-07T14:03:41.708951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697037+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:03:41.697037+0000","last_peered":"2024-05-07T14:03:41.697037+0000","last_clean":"2024-05-07T14:03:41.697037+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:03:41.697037+0000","last_undegraded":"2024-05-07T14:03:41.697037+0000","last_fullsized":"2024-05-07T14:03:41.697037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"81'2","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710468+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:03:41.710468+0000","last_peered":"2024-05-07T14:03:41.710468+0000","last_clean":"2024-05-07T14:03:41.710468+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:03:41.710468+0000","last_undegraded":"2024-05-07T14:03:41.710468+0000","last_fullsized":"2024-05-07T14:03:41.710468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"87'6","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702182+0000","last_change":"2024-05-07T14:00:57.995989+0000","last_active":"2024-05-07T14:03:41.702182+0000","last_peered":"2024-05-07T14:03:41.702182+0000","last_clean":"2024-05-07T14:03:41.702182+0000","last_became_active":"2024-05-07T14:00:57.995721+0000","last_became_peered":"2024-05-07T14:00:57.995721+0000","last_unstale":"2024-05-07T14:03:41.702182+0000","last_undegraded":"2024-05-07T14:03:41.702182+0000","last_fullsized":"2024-05-07T14:03:41.702182+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'2","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710712+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:03:41.710712+0000","last_peered":"2024-05-07T14:03:41.710712+0000","last_clean":"2024-05-07T14:03:41.710712+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:03:41.710712+0000","last_undegraded":"2024-05-07T14:03:41.710712+0000","last_fullsized":"2024-05-07T14:03:41.710712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101681+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:03:42.101681+0000","last_peered":"2024-05-07T14:03:42.101681+0000","last_clean":"2024-05-07T14:03:42.101681+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:03:42.101681+0000","last_undegraded":"2024-05-07T14:03:42.101681+0000","last_fullsized":"2024-05-07T14:03:42.101681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"85'20","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700402+0000","last_change":"2024-05-07T14:01:02.002384+0000","last_active":"2024-05-07T14:03:41.700402+0000","last_peered":"2024-05-07T14:03:41.700402+0000","last_clean":"2024-05-07T14:03:41.700402+0000","last_became_active":"2024-05-07T14:01:02.001676+0000","last_became_peered":"2024-05-07T14:01:02.001676+0000","last_unstale":"2024-05-07T14:03:41.700402+0000","last_undegraded":"2024-05-07T14:03:41.700402+0000","last_fullsized":"2024-05-07T14:03:41.700402+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709218+0000","last_change":"2024-05-07T14:03:39.667564+0000","last_active":"2024-05-07T14:03:41.709218+0000","last_peered":"2024-05-07T14:03:41.709218+0000","last_clean":"2024-05-07T14:03:41.709218+0000","last_became_active":"2024-05-07T14:03:39.666888+0000","last_became_peered":"2024-05-07T14:03:39.666888+0000","last_unstale":"2024-05-07T14:03:41.709218+0000","last_undegraded":"2024-05-07T14:03:41.709218+0000","last_fullsized":"2024-05-07T14:03:41.709218+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:33.367980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100771+0000","last_change":"2024-05-07T14:01:06.025917+0000","last_active":"2024-05-07T14:03:42.100771+0000","last_peered":"2024-05-07T14:03:42.100771+0000","last_clean":"2024-05-07T14:03:42.100771+0000","last_became_active":"2024-05-07T14:01:06.025044+0000","last_became_peered":"2024-05-07T14:01:06.025044+0000","last_unstale":"2024-05-07T14:03:42.100771+0000","last_undegraded":"2024-05-07T14:03:42.100771+0000","last_fullsized":"2024-05-07T14:03:42.100771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:55.419668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"81'4","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710545+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:03:41.710545+0000","last_peered":"2024-05-07T14:03:41.710545+0000","last_clean":"2024-05-07T14:03:41.710545+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:03:41.710545+0000","last_undegraded":"2024-05-07T14:03:41.710545+0000","last_fullsized":"2024-05-07T14:03:41.710545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"85'8","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703505+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:03:41.703505+0000","last_peered":"2024-05-07T14:03:41.703505+0000","last_clean":"2024-05-07T14:03:41.703505+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:03:41.703505+0000","last_undegraded":"2024-05-07T14:03:41.703505+0000","last_fullsized":"2024-05-07T14:03:41.703505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703456+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:03:41.703456+0000","last_peered":"2024-05-07T14:03:41.703456+0000","last_clean":"2024-05-07T14:03:41.703456+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:03:41.703456+0000","last_undegraded":"2024-05-07T14:03:41.703456+0000","last_fullsized":"2024-05-07T14:03:41.703456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"85'16","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712670+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:03:41.712670+0000","last_peered":"2024-05-07T14:03:41.712670+0000","last_clean":"2024-05-07T14:03:41.712670+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:03:41.712670+0000","last_undegraded":"2024-05-07T14:03:41.712670+0000","last_fullsized":"2024-05-07T14:03:41.712670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709246+0000","last_change":"2024-05-07T14:03:39.664184+0000","last_active":"2024-05-07T14:03:41.709246+0000","last_peered":"2024-05-07T14:03:41.709246+0000","last_clean":"2024-05-07T14:03:41.709246+0000","last_became_active":"2024-05-07T14:03:39.663569+0000","last_became_peered":"2024-05-07T14:03:39.663569+0000","last_unstale":"2024-05-07T14:03:41.709246+0000","last_undegraded":"2024-05-07T14:03:41.709246+0000","last_fullsized":"2024-05-07T14:03:41.709246+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:51.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696331+0000","last_change":"2024-05-07T14:01:06.038979+0000","last_active":"2024-05-07T14:03:41.696331+0000","last_peered":"2024-05-07T14:03:41.696331+0000","last_clean":"2024-05-07T14:03:41.696331+0000","last_became_active":"2024-05-07T14:01:06.035737+0000","last_became_peered":"2024-05-07T14:01:06.035737+0000","last_unstale":"2024-05-07T14:03:41.696331+0000","last_undegraded":"2024-05-07T14:03:41.696331+0000","last_fullsized":"2024-05-07T14:03:41.696331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"87'8","reported_seq":201,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706335+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:03:41.706335+0000","last_peered":"2024-05-07T14:03:41.706335+0000","last_clean":"2024-05-07T14:03:41.706335+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:03:41.706335+0000","last_undegraded":"2024-05-07T14:03:41.706335+0000","last_fullsized":"2024-05-07T14:03:41.706335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"85'5","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698263+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:03:41.698263+0000","last_peered":"2024-05-07T14:03:41.698263+0000","last_clean":"2024-05-07T14:03:41.698263+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:03:41.698263+0000","last_undegraded":"2024-05-07T14:03:41.698263+0000","last_fullsized":"2024-05-07T14:03:41.698263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709405+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:03:41.709405+0000","last_peered":"2024-05-07T14:03:41.709405+0000","last_clean":"2024-05-07T14:03:41.709405+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:03:41.709405+0000","last_undegraded":"2024-05-07T14:03:41.709405+0000","last_fullsized":"2024-05-07T14:03:41.709405+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703916+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:03:41.703916+0000","last_peered":"2024-05-07T14:03:41.703916+0000","last_clean":"2024-05-07T14:03:41.703916+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:03:41.703916+0000","last_undegraded":"2024-05-07T14:03:41.703916+0000","last_fullsized":"2024-05-07T14:03:41.703916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"94'104","reported_seq":368,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101355+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:03:42.101355+0000","last_peered":"2024-05-07T14:03:42.101355+0000","last_clean":"2024-05-07T14:03:42.101355+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:03:42.101355+0000","last_undegraded":"2024-05-07T14:03:42.101355+0000","last_fullsized":"2024-05-07T14:03:42.101355+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"81'7","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.694712+0000","last_change":"2024-05-07T14:01:06.037755+0000","last_active":"2024-05-07T14:03:41.694712+0000","last_peered":"2024-05-07T14:03:41.694712+0000","last_clean":"2024-05-07T14:03:41.694712+0000","last_became_active":"2024-05-07T14:01:06.037156+0000","last_became_peered":"2024-05-07T14:01:06.037156+0000","last_unstale":"2024-05-07T14:03:41.694712+0000","last_undegraded":"2024-05-07T14:03:41.694712+0000","last_fullsized":"2024-05-07T14:03:41.694712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:30.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"94'5","reported_seq":187,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702580+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:03:41.702580+0000","last_peered":"2024-05-07T14:03:41.702580+0000","last_clean":"2024-05-07T14:03:41.702580+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:03:41.702580+0000","last_undegraded":"2024-05-07T14:03:41.702580+0000","last_fullsized":"2024-05-07T14:03:41.702580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":171,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697272+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:03:41.697272+0000","last_peered":"2024-05-07T14:03:41.697272+0000","last_clean":"2024-05-07T14:03:41.697272+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:03:41.697272+0000","last_undegraded":"2024-05-07T14:03:41.697272+0000","last_fullsized":"2024-05-07T14:03:41.697272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696319+0000","last_change":"2024-05-07T14:00:59.998197+0000","last_active":"2024-05-07T14:03:41.696319+0000","last_peered":"2024-05-07T14:03:41.696319+0000","last_clean":"2024-05-07T14:03:41.696319+0000","last_became_active":"2024-05-07T14:00:59.997438+0000","last_became_peered":"2024-05-07T14:00:59.997438+0000","last_unstale":"2024-05-07T14:03:41.696319+0000","last_undegraded":"2024-05-07T14:03:41.696319+0000","last_fullsized":"2024-05-07T14:03:41.696319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:29.430229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"85'20","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696519+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:03:41.696519+0000","last_peered":"2024-05-07T14:03:41.696519+0000","last_clean":"2024-05-07T14:03:41.696519+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:03:41.696519+0000","last_undegraded":"2024-05-07T14:03:41.696519+0000","last_fullsized":"2024-05-07T14:03:41.696519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697304+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:03:41.697304+0000","last_peered":"2024-05-07T14:03:41.697304+0000","last_clean":"2024-05-07T14:03:41.697304+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:03:41.697304+0000","last_undegraded":"2024-05-07T14:03:41.697304+0000","last_fullsized":"2024-05-07T14:03:41.697304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"81'3","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699423+0000","last_change":"2024-05-07T14:01:06.025913+0000","last_active":"2024-05-07T14:03:41.699423+0000","last_peered":"2024-05-07T14:03:41.699423+0000","last_clean":"2024-05-07T14:03:41.699423+0000","last_became_active":"2024-05-07T14:01:06.025220+0000","last_became_peered":"2024-05-07T14:01:06.025220+0000","last_unstale":"2024-05-07T14:03:41.699423+0000","last_undegraded":"2024-05-07T14:03:41.699423+0000","last_fullsized":"2024-05-07T14:03:41.699423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:30.164745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703250+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:03:41.703250+0000","last_peered":"2024-05-07T14:03:41.703250+0000","last_clean":"2024-05-07T14:03:41.703250+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:03:41.703250+0000","last_undegraded":"2024-05-07T14:03:41.703250+0000","last_fullsized":"2024-05-07T14:03:41.703250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"85'5","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697829+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:03:41.697829+0000","last_peered":"2024-05-07T14:03:41.697829+0000","last_clean":"2024-05-07T14:03:41.697829+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:03:41.697829+0000","last_undegraded":"2024-05-07T14:03:41.697829+0000","last_fullsized":"2024-05-07T14:03:41.697829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697226+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:03:41.697226+0000","last_peered":"2024-05-07T14:03:41.697226+0000","last_clean":"2024-05-07T14:03:41.697226+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:03:41.697226+0000","last_undegraded":"2024-05-07T14:03:41.697226+0000","last_fullsized":"2024-05-07T14:03:41.697226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"85'14","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697325+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:03:41.697325+0000","last_peered":"2024-05-07T14:03:41.697325+0000","last_clean":"2024-05-07T14:03:41.697325+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:03:41.697325+0000","last_undegraded":"2024-05-07T14:03:41.697325+0000","last_fullsized":"2024-05-07T14:03:41.697325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100752+0000","last_change":"2024-05-07T14:01:04.017099+0000","last_active":"2024-05-07T14:03:42.100752+0000","last_peered":"2024-05-07T14:03:42.100752+0000","last_clean":"2024-05-07T14:03:42.100752+0000","last_became_active":"2024-05-07T14:01:04.011036+0000","last_became_peered":"2024-05-07T14:01:04.011036+0000","last_unstale":"2024-05-07T14:03:42.100752+0000","last_undegraded":"2024-05-07T14:03:42.100752+0000","last_fullsized":"2024-05-07T14:03:42.100752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:32.242974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710778+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:03:41.710778+0000","last_peered":"2024-05-07T14:03:41.710778+0000","last_clean":"2024-05-07T14:03:41.710778+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:03:41.710778+0000","last_undegraded":"2024-05-07T14:03:41.710778+0000","last_fullsized":"2024-05-07T14:03:41.710778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"87'6","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712440+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:03:41.712440+0000","last_peered":"2024-05-07T14:03:41.712440+0000","last_clean":"2024-05-07T14:03:41.712440+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:03:41.712440+0000","last_undegraded":"2024-05-07T14:03:41.712440+0000","last_fullsized":"2024-05-07T14:03:41.712440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.713016+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:03:41.713016+0000","last_peered":"2024-05-07T14:03:41.713016+0000","last_clean":"2024-05-07T14:03:41.713016+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:03:41.713016+0000","last_undegraded":"2024-05-07T14:03:41.713016+0000","last_fullsized":"2024-05-07T14:03:41.713016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702067+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:03:41.702067+0000","last_peered":"2024-05-07T14:03:41.702067+0000","last_clean":"2024-05-07T14:03:41.702067+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:03:41.702067+0000","last_undegraded":"2024-05-07T14:03:41.702067+0000","last_fullsized":"2024-05-07T14:03:41.702067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"85'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.714133+0000","last_change":"2024-05-07T14:01:02.013617+0000","last_active":"2024-05-07T14:03:41.714133+0000","last_peered":"2024-05-07T14:03:41.714133+0000","last_clean":"2024-05-07T14:03:41.714133+0000","last_became_active":"2024-05-07T14:01:02.009243+0000","last_became_peered":"2024-05-07T14:01:02.009243+0000","last_unstale":"2024-05-07T14:03:41.714133+0000","last_undegraded":"2024-05-07T14:03:41.714133+0000","last_fullsized":"2024-05-07T14:03:41.714133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702284+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:03:41.702284+0000","last_peered":"2024-05-07T14:03:41.702284+0000","last_clean":"2024-05-07T14:03:41.702284+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:03:41.702284+0000","last_undegraded":"2024-05-07T14:03:41.702284+0000","last_fullsized":"2024-05-07T14:03:41.702284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"81'8","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698993+0000","last_change":"2024-05-07T14:03:39.823293+0000","last_active":"2024-05-07T14:03:41.698993+0000","last_peered":"2024-05-07T14:03:41.698993+0000","last_clean":"2024-05-07T14:03:41.698993+0000","last_became_active":"2024-05-07T14:03:39.673703+0000","last_became_peered":"2024-05-07T14:03:39.673703+0000","last_unstale":"2024-05-07T14:03:41.698993+0000","last_undegraded":"2024-05-07T14:03:41.698993+0000","last_fullsized":"2024-05-07T14:03:41.698993+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:21.776655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"81'6","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702345+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:03:41.702345+0000","last_peered":"2024-05-07T14:03:41.702345+0000","last_clean":"2024-05-07T14:03:41.702345+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:03:41.702345+0000","last_undegraded":"2024-05-07T14:03:41.702345+0000","last_fullsized":"2024-05-07T14:03:41.702345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"85'2","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700096+0000","last_change":"2024-05-07T14:01:37.554242+0000","last_active":"2024-05-07T14:03:41.700096+0000","last_peered":"2024-05-07T14:03:41.700096+0000","last_clean":"2024-05-07T14:03:41.700096+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:03:41.700096+0000","last_undegraded":"2024-05-07T14:03:41.700096+0000","last_fullsized":"2024-05-07T14:03:41.700096+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:16:22.149514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708033+0000","last_change":"2024-05-07T14:03:39.674947+0000","last_active":"2024-05-07T14:03:41.708033+0000","last_peered":"2024-05-07T14:03:41.708033+0000","last_clean":"2024-05-07T14:03:41.708033+0000","last_became_active":"2024-05-07T14:03:39.659887+0000","last_became_peered":"2024-05-07T14:03:39.659887+0000","last_unstale":"2024-05-07T14:03:41.708033+0000","last_undegraded":"2024-05-07T14:03:41.708033+0000","last_fullsized":"2024-05-07T14:03:41.708033+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:18:06.217561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"85'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702235+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:03:41.702235+0000","last_peered":"2024-05-07T14:03:41.702235+0000","last_clean":"2024-05-07T14:03:41.702235+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:03:41.702235+0000","last_undegraded":"2024-05-07T14:03:41.702235+0000","last_fullsized":"2024-05-07T14:03:41.702235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697792+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:03:41.697792+0000","last_peered":"2024-05-07T14:03:41.697792+0000","last_clean":"2024-05-07T14:03:41.697792+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:03:41.697792+0000","last_undegraded":"2024-05-07T14:03:41.697792+0000","last_fullsized":"2024-05-07T14:03:41.697792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703550+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:03:41.703550+0000","last_peered":"2024-05-07T14:03:41.703550+0000","last_clean":"2024-05-07T14:03:41.703550+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:03:41.703550+0000","last_undegraded":"2024-05-07T14:03:41.703550+0000","last_fullsized":"2024-05-07T14:03:41.703550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"87'16","reported_seq":24,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708646+0000","last_change":"2024-05-07T14:03:39.799013+0000","last_active":"2024-05-07T14:03:41.708646+0000","last_peered":"2024-05-07T14:03:41.708646+0000","last_clean":"2024-05-07T14:03:41.708646+0000","last_became_active":"2024-05-07T14:03:39.671068+0000","last_became_peered":"2024-05-07T14:03:39.671068+0000","last_unstale":"2024-05-07T14:03:41.708646+0000","last_undegraded":"2024-05-07T14:03:41.708646+0000","last_fullsized":"2024-05-07T14:03:41.708646+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:13.746128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"85'6","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100889+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:03:42.100889+0000","last_peered":"2024-05-07T14:03:42.100889+0000","last_clean":"2024-05-07T14:03:42.100889+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:03:42.100889+0000","last_undegraded":"2024-05-07T14:03:42.100889+0000","last_fullsized":"2024-05-07T14:03:42.100889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709023+0000","last_change":"2024-05-07T14:03:39.661724+0000","last_active":"2024-05-07T14:03:41.709023+0000","last_peered":"2024-05-07T14:03:41.709023+0000","last_clean":"2024-05-07T14:03:41.709023+0000","last_became_active":"2024-05-07T14:03:39.661339+0000","last_became_peered":"2024-05-07T14:03:39.661339+0000","last_unstale":"2024-05-07T14:03:41.709023+0000","last_undegraded":"2024-05-07T14:03:41.709023+0000","last_fullsized":"2024-05-07T14:03:41.709023+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:34.633849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"85'3","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704970+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:03:41.704970+0000","last_peered":"2024-05-07T14:03:41.704970+0000","last_clean":"2024-05-07T14:03:41.704970+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:03:41.704970+0000","last_undegraded":"2024-05-07T14:03:41.704970+0000","last_fullsized":"2024-05-07T14:03:41.704970+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:01.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"81'6","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697154+0000","last_change":"2024-05-07T14:00:57.985233+0000","last_active":"2024-05-07T14:03:41.697154+0000","last_peered":"2024-05-07T14:03:41.697154+0000","last_clean":"2024-05-07T14:03:41.697154+0000","last_became_active":"2024-05-07T14:00:57.984523+0000","last_became_peered":"2024-05-07T14:00:57.984523+0000","last_unstale":"2024-05-07T14:03:41.697154+0000","last_undegraded":"2024-05-07T14:03:41.697154+0000","last_fullsized":"2024-05-07T14:03:41.697154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696656+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:03:41.696656+0000","last_peered":"2024-05-07T14:03:41.696656+0000","last_clean":"2024-05-07T14:03:41.696656+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:03:41.696656+0000","last_undegraded":"2024-05-07T14:03:41.696656+0000","last_fullsized":"2024-05-07T14:03:41.696656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"81'2","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708007+0000","last_change":"2024-05-07T14:03:39.791330+0000","last_active":"2024-05-07T14:03:41.708007+0000","last_peered":"2024-05-07T14:03:41.708007+0000","last_clean":"2024-05-07T14:03:41.708007+0000","last_became_active":"2024-05-07T14:03:39.670031+0000","last_became_peered":"2024-05-07T14:03:39.670031+0000","last_unstale":"2024-05-07T14:03:41.708007+0000","last_undegraded":"2024-05-07T14:03:41.708007+0000","last_fullsized":"2024-05-07T14:03:41.708007+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:03.214247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"85'2","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698825+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:03:41.698825+0000","last_peered":"2024-05-07T14:03:41.698825+0000","last_clean":"2024-05-07T14:03:41.698825+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:03:41.698825+0000","last_undegraded":"2024-05-07T14:03:41.698825+0000","last_fullsized":"2024-05-07T14:03:41.698825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.714060+0000","last_change":"2024-05-07T14:00:57.998054+0000","last_active":"2024-05-07T14:03:41.714060+0000","last_peered":"2024-05-07T14:03:41.714060+0000","last_clean":"2024-05-07T14:03:41.714060+0000","last_became_active":"2024-05-07T14:00:57.997750+0000","last_became_peered":"2024-05-07T14:00:57.997750+0000","last_unstale":"2024-05-07T14:03:41.714060+0000","last_undegraded":"2024-05-07T14:03:41.714060+0000","last_fullsized":"2024-05-07T14:03:41.714060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712354+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:03:41.712354+0000","last_peered":"2024-05-07T14:03:41.712354+0000","last_clean":"2024-05-07T14:03:41.712354+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:03:41.712354+0000","last_undegraded":"2024-05-07T14:03:41.712354+0000","last_fullsized":"2024-05-07T14:03:41.712354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703351+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:03:41.703351+0000","last_peered":"2024-05-07T14:03:41.703351+0000","last_clean":"2024-05-07T14:03:41.703351+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:03:41.703351+0000","last_undegraded":"2024-05-07T14:03:41.703351+0000","last_fullsized":"2024-05-07T14:03:41.703351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"85'3","reported_seq":22,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709662+0000","last_change":"2024-05-07T14:03:39.789159+0000","last_active":"2024-05-07T14:03:41.709662+0000","last_peered":"2024-05-07T14:03:41.709662+0000","last_clean":"2024-05-07T14:03:41.709662+0000","last_became_active":"2024-05-07T14:03:39.668790+0000","last_became_peered":"2024-05-07T14:03:39.668790+0000","last_unstale":"2024-05-07T14:03:41.709662+0000","last_undegraded":"2024-05-07T14:03:41.709662+0000","last_fullsized":"2024-05-07T14:03:41.709662+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:14.798045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"81'8","reported_seq":232,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712234+0000","last_change":"2024-05-07T14:03:39.855375+0000","last_active":"2024-05-07T14:03:41.712234+0000","last_peered":"2024-05-07T14:03:41.712234+0000","last_clean":"2024-05-07T14:03:41.712234+0000","last_became_active":"2024-05-07T14:03:39.666451+0000","last_became_peered":"2024-05-07T14:03:39.666451+0000","last_unstale":"2024-05-07T14:03:41.712234+0000","last_undegraded":"2024-05-07T14:03:41.712234+0000","last_fullsized":"2024-05-07T14:03:41.712234+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:37.171990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'6","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101388+0000","last_change":"2024-05-07T14:00:55.997287+0000","last_active":"2024-05-07T14:03:42.101388+0000","last_peered":"2024-05-07T14:03:42.101388+0000","last_clean":"2024-05-07T14:03:42.101388+0000","last_became_active":"2024-05-07T14:00:55.996467+0000","last_became_peered":"2024-05-07T14:00:55.996467+0000","last_unstale":"2024-05-07T14:03:42.101388+0000","last_undegraded":"2024-05-07T14:03:42.101388+0000","last_fullsized":"2024-05-07T14:03:42.101388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100692+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:03:42.100692+0000","last_peered":"2024-05-07T14:03:42.100692+0000","last_clean":"2024-05-07T14:03:42.100692+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:03:42.100692+0000","last_undegraded":"2024-05-07T14:03:42.100692+0000","last_fullsized":"2024-05-07T14:03:42.100692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711422+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:03:41.711422+0000","last_peered":"2024-05-07T14:03:41.711422+0000","last_clean":"2024-05-07T14:03:41.711422+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:03:41.711422+0000","last_undegraded":"2024-05-07T14:03:41.711422+0000","last_fullsized":"2024-05-07T14:03:41.711422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"94'1","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699812+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:03:41.699812+0000","last_peered":"2024-05-07T14:03:41.699812+0000","last_clean":"2024-05-07T14:03:41.699812+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:03:41.699812+0000","last_undegraded":"2024-05-07T14:03:41.699812+0000","last_fullsized":"2024-05-07T14:03:41.699812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"85'7","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697033+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:03:41.697033+0000","last_peered":"2024-05-07T14:03:41.697033+0000","last_clean":"2024-05-07T14:03:41.697033+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:03:41.697033+0000","last_undegraded":"2024-05-07T14:03:41.697033+0000","last_fullsized":"2024-05-07T14:03:41.697033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704144+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:03:41.704144+0000","last_peered":"2024-05-07T14:03:41.704144+0000","last_clean":"2024-05-07T14:03:41.704144+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:03:41.704144+0000","last_undegraded":"2024-05-07T14:03:41.704144+0000","last_fullsized":"2024-05-07T14:03:41.704144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"85'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712521+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:03:41.712521+0000","last_peered":"2024-05-07T14:03:41.712521+0000","last_clean":"2024-05-07T14:03:41.712521+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:03:41.712521+0000","last_undegraded":"2024-05-07T14:03:41.712521+0000","last_fullsized":"2024-05-07T14:03:41.712521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"94'3","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705675+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:03:41.705675+0000","last_peered":"2024-05-07T14:03:41.705675+0000","last_clean":"2024-05-07T14:03:41.705675+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:03:41.705675+0000","last_undegraded":"2024-05-07T14:03:41.705675+0000","last_fullsized":"2024-05-07T14:03:41.705675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696553+0000","last_change":"2024-05-07T14:00:56.001135+0000","last_active":"2024-05-07T14:03:41.696553+0000","last_peered":"2024-05-07T14:03:41.696553+0000","last_clean":"2024-05-07T14:03:41.696553+0000","last_became_active":"2024-05-07T14:00:55.999884+0000","last_became_peered":"2024-05-07T14:00:55.999884+0000","last_unstale":"2024-05-07T14:03:41.696553+0000","last_undegraded":"2024-05-07T14:03:41.696553+0000","last_fullsized":"2024-05-07T14:03:41.696553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703207+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:03:41.703207+0000","last_peered":"2024-05-07T14:03:41.703207+0000","last_clean":"2024-05-07T14:03:41.703207+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:03:41.703207+0000","last_undegraded":"2024-05-07T14:03:41.703207+0000","last_fullsized":"2024-05-07T14:03:41.703207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"85'6","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699371+0000","last_change":"2024-05-07T14:00:55.989670+0000","last_active":"2024-05-07T14:03:41.699371+0000","last_peered":"2024-05-07T14:03:41.699371+0000","last_clean":"2024-05-07T14:03:41.699371+0000","last_became_active":"2024-05-07T14:00:55.989455+0000","last_became_peered":"2024-05-07T14:00:55.989455+0000","last_unstale":"2024-05-07T14:03:41.699371+0000","last_undegraded":"2024-05-07T14:03:41.699371+0000","last_fullsized":"2024-05-07T14:03:41.699371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"81'6","reported_seq":205,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699711+0000","last_change":"2024-05-07T14:03:37.848216+0000","last_active":"2024-05-07T14:03:41.699711+0000","last_peered":"2024-05-07T14:03:41.699711+0000","last_clean":"2024-05-07T14:03:41.699711+0000","last_became_active":"2024-05-07T14:03:37.842132+0000","last_became_peered":"2024-05-07T14:03:37.842132+0000","last_unstale":"2024-05-07T14:03:41.699711+0000","last_undegraded":"2024-05-07T14:03:41.699711+0000","last_fullsized":"2024-05-07T14:03:41.699711+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:16.805365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"85'7","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101781+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:03:42.101781+0000","last_peered":"2024-05-07T14:03:42.101781+0000","last_clean":"2024-05-07T14:03:42.101781+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:03:42.101781+0000","last_undegraded":"2024-05-07T14:03:42.101781+0000","last_fullsized":"2024-05-07T14:03:42.101781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"87'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699843+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:03:41.699843+0000","last_peered":"2024-05-07T14:03:41.699843+0000","last_clean":"2024-05-07T14:03:41.699843+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:03:41.699843+0000","last_undegraded":"2024-05-07T14:03:41.699843+0000","last_fullsized":"2024-05-07T14:03:41.699843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"85'1","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699857+0000","last_change":"2024-05-07T14:00:55.978771+0000","last_active":"2024-05-07T14:03:41.699857+0000","last_peered":"2024-05-07T14:03:41.699857+0000","last_clean":"2024-05-07T14:03:41.699857+0000","last_became_active":"2024-05-07T14:00:55.978000+0000","last_became_peered":"2024-05-07T14:00:55.978000+0000","last_unstale":"2024-05-07T14:03:41.699857+0000","last_undegraded":"2024-05-07T14:03:41.699857+0000","last_fullsized":"2024-05-07T14:03:41.699857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"81'6","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711378+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:03:41.711378+0000","last_peered":"2024-05-07T14:03:41.711378+0000","last_clean":"2024-05-07T14:03:41.711378+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:03:41.711378+0000","last_undegraded":"2024-05-07T14:03:41.711378+0000","last_fullsized":"2024-05-07T14:03:41.711378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"85'7","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706194+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:03:41.706194+0000","last_peered":"2024-05-07T14:03:41.706194+0000","last_clean":"2024-05-07T14:03:41.706194+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:03:41.706194+0000","last_undegraded":"2024-05-07T14:03:41.706194+0000","last_fullsized":"2024-05-07T14:03:41.706194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"87'4","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695244+0000","last_change":"2024-05-07T14:00:57.979073+0000","last_active":"2024-05-07T14:03:41.695244+0000","last_peered":"2024-05-07T14:03:41.695244+0000","last_clean":"2024-05-07T14:03:41.695244+0000","last_became_active":"2024-05-07T14:00:57.978215+0000","last_became_peered":"2024-05-07T14:00:57.978215+0000","last_unstale":"2024-05-07T14:03:41.695244+0000","last_undegraded":"2024-05-07T14:03:41.695244+0000","last_fullsized":"2024-05-07T14:03:41.695244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"85'7","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698352+0000","last_change":"2024-05-07T14:00:56.001199+0000","last_active":"2024-05-07T14:03:41.698352+0000","last_peered":"2024-05-07T14:03:41.698352+0000","last_clean":"2024-05-07T14:03:41.698352+0000","last_became_active":"2024-05-07T14:00:56.000434+0000","last_became_peered":"2024-05-07T14:00:56.000434+0000","last_unstale":"2024-05-07T14:03:41.698352+0000","last_undegraded":"2024-05-07T14:03:41.698352+0000","last_fullsized":"2024-05-07T14:03:41.698352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696888+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:03:41.696888+0000","last_peered":"2024-05-07T14:03:41.696888+0000","last_clean":"2024-05-07T14:03:41.696888+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:03:41.696888+0000","last_undegraded":"2024-05-07T14:03:41.696888+0000","last_fullsized":"2024-05-07T14:03:41.696888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"81'2","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699873+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:03:41.699873+0000","last_peered":"2024-05-07T14:03:41.699873+0000","last_clean":"2024-05-07T14:03:41.699873+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:03:41.699873+0000","last_undegraded":"2024-05-07T14:03:41.699873+0000","last_fullsized":"2024-05-07T14:03:41.699873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711492+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:03:41.711492+0000","last_peered":"2024-05-07T14:03:41.711492+0000","last_clean":"2024-05-07T14:03:41.711492+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:03:41.711492+0000","last_undegraded":"2024-05-07T14:03:41.711492+0000","last_fullsized":"2024-05-07T14:03:41.711492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"94'3","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697844+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:03:41.697844+0000","last_peered":"2024-05-07T14:03:41.697844+0000","last_clean":"2024-05-07T14:03:41.697844+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:03:41.697844+0000","last_undegraded":"2024-05-07T14:03:41.697844+0000","last_fullsized":"2024-05-07T14:03:41.697844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1003,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":250,"num_read_kb":234,"num_write":236,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":841,"ondisk_log_size":841,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":79524,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":810,"num_read_kb":572,"num_write":449,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":4494,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":128631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":634,"ondisk_log_size":634,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1078,"num_read_kb":1058,"num_write":239,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1069547520,"num_objects":257,"num_object_clones":0,"num_object_copies":514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":317,"num_write_kb":1064960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2139095040,"data_stored":2139095040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362152,"kb_used_data":330964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94009688,"statfs":{"total":96636764160,"available":96265920512,"internally_reserved":0,"allocated":338907136,"data_stored":338347051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":278736,"kb_used_data":247552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94093104,"statfs":{"total":96636764160,"available":96351338496,"internally_reserved":0,"allocated":253493248,"data_stored":252953527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339648,"kb_used_data":308464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94032192,"statfs":{"total":96636764160,"available":96288964608,"internally_reserved":0,"allocated":315867136,"data_stored":315280067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347768,"kb_used_data":316588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94024072,"statfs":{"total":96636764160,"available":96280649728,"internally_reserved":0,"allocated":324186112,"data_stored":323659355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":340284,"kb_used_data":309100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94031556,"statfs":{"total":96636764160,"available":96288313344,"internally_reserved":0,"allocated":316518400,"data_stored":315928962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":196232,"kb_used_data":165048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94175608,"statfs":{"total":96636764160,"available":96435822592,"internally_reserved":0,"allocated":169009152,"data_stored":168477088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216752,"kb_used_data":185568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94155088,"statfs":{"total":96636764160,"available":96414810112,"internally_reserved":0,"allocated":190021632,"data_stored":189452096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268000,"kb_used_data":236812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94103840,"statfs":{"total":96636764160,"available":96362332160,"internally_reserved":0,"allocated":242495488,"data_stored":241936314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":241172480,"data_stored":241172480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188743680,"data_stored":188743680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":167772160,"data_stored":167772160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":314572800,"data_stored":314572800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":322961408,"data_stored":322961408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":314572800,"data_stored":314572800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":251658240,"data_stored":251658240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":337641472,"data_stored":337641472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":60890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:03:45.692 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-07T14:03:45.722 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:03:45.728 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:45.739+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:45.795 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:45.795 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:45.795 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:45.795 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:45.795 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:45.817 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:45.828+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:45.820 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:45.910 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:03:45.918 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:45.928+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:46.018 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:46.027+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:46.073 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 53.779744227999998, 2024-05-07T14:03:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:03:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.074 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:46.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:03:46.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:03:46.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:03:46.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:03:46.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:03:46.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:03:46.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:03:46.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:03:46.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:03:46.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:03:46.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:03:46.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:03:46.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:46.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:03:46.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:03:46.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:03:46.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:03:46.080 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.080 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.080 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.080 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2203 3.1e 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:46.080 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:46.080 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.790027883999997, 2024-05-07T14:03:46.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029129142, 2024-05-07T14:03:46.080 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.080 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2203 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:46.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294465+0000", 2024-05-07T14:03:46.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7699999999999999e-06 2024-05-07T14:03:46.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300328+0000", 2024-05-07T14:03:46.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058633460000000002 2024-05-07T14:03:46.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300384+0000", 2024-05-07T14:03:46.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6212999999999999e-05 2024-05-07T14:03:46.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300411+0000", 2024-05-07T14:03:46.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7109000000000001e-05 2024-05-07T14:03:46.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300586+0000", 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017478799999999999 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300941+0000", 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035515500000000001 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301351+0000", 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040996099999999997 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.317495+0000", 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016143462000000001 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323421+0000", 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059264649999999997 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323498+0000", 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6478999999999997e-05 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323590+0000", 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2393999999999997e-05 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2230 3.b 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.414121213999998, 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021351564, 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.086 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.087 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.087 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.087 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.087 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2230 2024-05-07T14:03:46.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.087 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:46.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670370+0000", 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5050000000000002e-06 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673214+0000", 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028441260000000002 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673245+0000", 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0488999999999999e-05 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673259+0000", 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4443e-05 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673356+0000", 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7031e-05 2024-05-07T14:03:46.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673531+0000", 2024-05-07T14:03:46.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017509099999999999 2024-05-07T14:03:46.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:46.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673696+0000", 2024-05-07T14:03:46.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000164306 2024-05-07T14:03:46.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684776+0000", 2024-05-07T14:03:46.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011080054000000001 2024-05-07T14:03:46.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691578+0000", 2024-05-07T14:03:46.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068025849999999999 2024-05-07T14:03:46.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691659+0000", 2024-05-07T14:03:46.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0976000000000005e-05 2024-05-07T14:03:46.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691719+0000", 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9957999999999998e-05 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2666 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 6.4326643279999995, 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.125351252, 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2666 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651827+0000", 2024-05-07T14:03:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-06 2024-05-07T14:03:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651834+0000", 2024-05-07T14:03:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7700000000000001e-06 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651850+0000", 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5755000000000001e-05 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651862+0000", 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.237e-05 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651967+0000", 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010427199999999999 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651977+0000", 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0743e-05 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657294+0000", 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053168069999999998 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657305+0000", 2024-05-07T14:03:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0662000000000001e-05 2024-05-07T14:03:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774211+0000", 2024-05-07T14:03:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1169060209999999 2024-05-07T14:03:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774394+0000", 2024-05-07T14:03:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018268000000000001 2024-05-07T14:03:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.777176+0000", 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002782025 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2673 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.8887311410000001, 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57934507999999996, 2024-05-07T14:03:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2673 2024-05-07T14:03:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9699999999999996e-07 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195761+0000", 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2569999999999999e-06 2024-05-07T14:03:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195768+0000", 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.489e-06 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195774+0000", 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7389999999999996e-06 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195866+0000", 2024-05-07T14:03:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2349000000000006e-05 2024-05-07T14:03:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195878+0000", 2024-05-07T14:03:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1838000000000001e-05 2024-05-07T14:03:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774802+0000", 2024-05-07T14:03:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.578923945 2024-05-07T14:03:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774906+0000", 2024-05-07T14:03:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103991 2024-05-07T14:03:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775103+0000", 2024-05-07T14:03:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196975 2024-05-07T14:03:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2684 3.24 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.2983702300000002, 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.040396402999999997, 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2684 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786122+0000", 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0929999999999999e-06 2024-05-07T14:03:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788626+0000", 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025042720000000001 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788659+0000", 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2824999999999998e-05 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788673+0000", 2024-05-07T14:03:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4721e-05 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788768+0000", 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4178999999999994e-05 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788776+0000", 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2400000000000007e-06 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798002+0000", 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092262230000000004 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798163+0000", 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161077 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798305+0000", 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014162499999999999 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.807567+0000", 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092618869999999999 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826429+0000", 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018862824 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826470+0000", 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1010999999999997e-05 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826515+0000", 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4425999999999998e-05 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2700 3.c e104/21 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.1245235839999999, 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022078321000000001, 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9299999999999999e-07 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966313+0000", 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063471889999999996 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966340+0000", 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7514000000000001e-05 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966354+0000", 2024-05-07T14:03:46.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4053000000000001e-05 2024-05-07T14:03:46.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966434+0000", 2024-05-07T14:03:46.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0273999999999997e-05 2024-05-07T14:03:46.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966464+0000", 2024-05-07T14:03:46.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.953e-05 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.981968+0000", 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0155037 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.982043+0000", 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5767999999999997e-05 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.115 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2710 3.29 3:9701fed0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:46.115 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:03:46.115 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.0126975969999998, 2024-05-07T14:03:46.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020865083, 2024-05-07T14:03:46.115 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.115 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.115 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.115 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.115 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.115 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.115 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2710 2024-05-07T14:03:46.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071794+0000", 2024-05-07T14:03:46.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.565e-06 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073899+0000", 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002104809 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073925+0000", 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6125000000000001e-05 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073936+0000", 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0878e-05 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074018+0000", 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2391000000000004e-05 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074144+0000", 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012578599999999999 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074241+0000", 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7547999999999995e-05 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.082159+0000", 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0079176720000000006 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092527+0000", 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010368004 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092600+0000", 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3491000000000005e-05 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092656+0000", 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5813999999999998e-05 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.120 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2712 3.15 e104/21 3:a83036f0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_29:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.981133781, 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021527713, 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103357+0000", 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7260000000000001e-06 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107529+0000", 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041726999999999997 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107551+0000", 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1854000000000001e-05 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107563+0000", 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1362999999999999e-05 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107633+0000", 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0432999999999995e-05 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107652+0000", 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9250999999999999e-05 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124797+0000", 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017144626 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124883+0000", 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5760000000000006e-05 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.124 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2726 3.24 3:2710602c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.840805397, 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020082965000000001, 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.125 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2726 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243686+0000", 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8420000000000001e-06 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245745+0000", 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020592890000000002 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245765+0000", 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9505e-05 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245777+0000", 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2282e-05 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245842+0000", 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4682000000000002e-05 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245956+0000", 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113875 2024-05-07T14:03:46.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:46.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.246056+0000", 2024-05-07T14:03:46.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100238 2024-05-07T14:03:46.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.249971+0000", 2024-05-07T14:03:46.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039145179999999996 2024-05-07T14:03:46.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263656+0000", 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013685246999999999 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263718+0000", 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1704000000000004e-05 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263766+0000", 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8782999999999997e-05 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.130 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2781 3.7 3:e2214ce4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.811687+0000", 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.27280199, 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018853179000000001, 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.131 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2781 2024-05-07T14:03:46.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.132 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.811687+0000", 2024-05-07T14:03:46.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.811687+0000", 2024-05-07T14:03:46.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.811690+0000", 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5049999999999999e-06 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.813534+0000", 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00184396 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.813570+0000", 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5627999999999998e-05 2024-05-07T14:03:46.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.813586+0000", 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5775000000000001e-05 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.813677+0000", 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1619000000000005e-05 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.813810+0000", 2024-05-07T14:03:46.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013261800000000001 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.813909+0000", 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8999000000000005e-05 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.820938+0000", 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0070287190000000001 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.830423+0000", 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0094854959999999995 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.830489+0000", 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6128000000000001e-05 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.830540+0000", 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0732000000000001e-05 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.137 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2791 3.27 3:e46b1707:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:46.137 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:03:46.137 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.1552352379999999, 2024-05-07T14:03:46.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022300529999999999, 2024-05-07T14:03:46.137 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.137 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.137 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.137 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.137 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.137 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.137 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2791 2024-05-07T14:03:46.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.138 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:03:46.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:03:46.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929257+0000", 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.281e-06 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931305+0000", 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020483020000000001 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931328+0000", 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2722e-05 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931341+0000", 2024-05-07T14:03:46.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3529e-05 2024-05-07T14:03:46.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931415+0000", 2024-05-07T14:03:46.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3597999999999996e-05 2024-05-07T14:03:46.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931614+0000", 2024-05-07T14:03:46.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019859000000000001 2024-05-07T14:03:46.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:46.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931758+0000", 2024-05-07T14:03:46.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014481699999999999 2024-05-07T14:03:46.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.939706+0000", 2024-05-07T14:03:46.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007948063 2024-05-07T14:03:46.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951424+0000", 2024-05-07T14:03:46.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011717708 2024-05-07T14:03:46.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951500+0000", 2024-05-07T14:03:46.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5831e-05 2024-05-07T14:03:46.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951554+0000", 2024-05-07T14:03:46.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4088999999999997e-05 2024-05-07T14:03:46.143 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.143 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.143 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.143 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2796 3.18 3:1b781814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:46.143 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:03:46.143 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.1019865, 2024-05-07T14:03:46.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019854381000000001, 2024-05-07T14:03:46.143 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.143 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.143 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.144 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.144 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.144 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.144 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2796 2024-05-07T14:03:46.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.144 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:03:46.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:03:46.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982505+0000", 2024-05-07T14:03:46.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6070000000000002e-06 2024-05-07T14:03:46.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984438+0000", 2024-05-07T14:03:46.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019332609999999999 2024-05-07T14:03:46.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984463+0000", 2024-05-07T14:03:46.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4569000000000001e-05 2024-05-07T14:03:46.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984473+0000", 2024-05-07T14:03:46.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8910000000000007e-06 2024-05-07T14:03:46.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984549+0000", 2024-05-07T14:03:46.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6446999999999995e-05 2024-05-07T14:03:46.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984737+0000", 2024-05-07T14:03:46.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018843399999999999 2024-05-07T14:03:46.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:46.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984832+0000", 2024-05-07T14:03:46.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4069999999999999e-05 2024-05-07T14:03:46.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.999695+0000", 2024-05-07T14:03:46.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01486345 2024-05-07T14:03:46.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002219+0000", 2024-05-07T14:03:46.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002523792 2024-05-07T14:03:46.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002299+0000", 2024-05-07T14:03:46.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0360999999999999e-05 2024-05-07T14:03:46.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.149 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.149 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002357+0000", 2024-05-07T14:03:46.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7499e-05 2024-05-07T14:03:46.149 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.149 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.149 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.150 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2800 3.18 3:1851862d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:46.150 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:03:46.150 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 1.062082172, 2024-05-07T14:03:46.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020357577000000002, 2024-05-07T14:03:46.150 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.150 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.150 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.150 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.150 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.150 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.150 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2800 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022410+0000", 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0079999999999998e-06 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024625+0000", 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022156350000000001 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024652+0000", 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6715000000000001e-05 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024698+0000", 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6470000000000001e-05 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024776+0000", 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7960000000000006e-05 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024944+0000", 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016757400000000001 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:46.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.025106+0000", 2024-05-07T14:03:46.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016191 2024-05-07T14:03:46.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.041855+0000", 2024-05-07T14:03:46.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016748939000000001 2024-05-07T14:03:46.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042642+0000", 2024-05-07T14:03:46.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078695000000000002 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042712+0000", 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0154999999999995e-05 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042764+0000", 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2261e-05 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2817 3.24 3:24a9723e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:03:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.889469442, 2024-05-07T14:03:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020083441, 2024-05-07T14:03:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2817 2024-05-07T14:03:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.156 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195022+0000", 2024-05-07T14:03:46.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4399999999999999e-06 2024-05-07T14:03:46.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197097+0000", 2024-05-07T14:03:46.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002075173 2024-05-07T14:03:46.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197131+0000", 2024-05-07T14:03:46.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3952999999999998e-05 2024-05-07T14:03:46.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197148+0000", 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6648000000000001e-05 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197230+0000", 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2341000000000003e-05 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197399+0000", 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168782 2024-05-07T14:03:46.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197549+0000", 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000150311 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.210524+0000", 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012974930000000001 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215027+0000", 2024-05-07T14:03:46.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045034979999999999 2024-05-07T14:03:46.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215068+0000", 2024-05-07T14:03:46.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0846000000000002e-05 2024-05-07T14:03:46.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.161 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.161 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215103+0000", 2024-05-07T14:03:46.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4518999999999999e-05 2024-05-07T14:03:46.161 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.161 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.161 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2861 3.22 e105/21 3:479e234a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_168:head v 105'7, mlcod=104'5)", 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.54040524199999995, 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021170174999999999, 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:03:46.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544085+0000", 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.815e-06 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548101+0000", 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040158920000000001 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548121+0000", 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9899e-05 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548132+0000", 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0464e-05 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548210+0000", 2024-05-07T14:03:46.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8176000000000005e-05 2024-05-07T14:03:46.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548229+0000", 2024-05-07T14:03:46.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9701999999999999e-05 2024-05-07T14:03:46.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.565217+0000", 2024-05-07T14:03:46.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016987777999999999 2024-05-07T14:03:46.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.565254+0000", 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6449000000000003e-05 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2864 3.29 3:97632e4b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.509481607, 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021723981, 2024-05-07T14:03:46.166 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2864 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575010+0000", 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5660000000000001e-06 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576737+0000", 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017271599999999999 2024-05-07T14:03:46.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576768+0000", 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1424000000000003e-05 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576783+0000", 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4656e-05 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576880+0000", 2024-05-07T14:03:46.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6576999999999994e-05 2024-05-07T14:03:46.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577067+0000", 2024-05-07T14:03:46.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018795800000000001 2024-05-07T14:03:46.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:46.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577285+0000", 2024-05-07T14:03:46.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021768499999999999 2024-05-07T14:03:46.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.587487+0000", 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010202289 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596612+0000", 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0091244440000000007 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596681+0000", 2024-05-07T14:03:46.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9025999999999999e-05 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596731+0000", 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0195999999999998e-05 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2865 3.38 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.50186394899999998, 2024-05-07T14:03:46.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.035746371999999998, 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2865 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:03:46.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582627+0000", 2024-05-07T14:03:46.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:03:46.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584611+0000", 2024-05-07T14:03:46.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019836350000000001 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584636+0000", 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4943000000000002e-05 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584652+0000", 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5586e-05 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.175 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584733+0000", 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0987000000000002e-05 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584881+0000", 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014805800000000001 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584972+0000", 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1218999999999995e-05 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.591149+0000", 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061766939999999999 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618207+0000", 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027058260000000001 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618319+0000", 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011267700000000001 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618371+0000", 2024-05-07T14:03:46.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1683e-05 2024-05-07T14:03:46.178 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.178 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.178 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.178 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2872 3.15 e105/21 3:ab0c6c4f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_179:head v 105'7, mlcod=104'5)", 2024-05-07T14:03:46.178 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:03:46.178 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.42254313999999998, 2024-05-07T14:03:46.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020080595999999999, 2024-05-07T14:03:46.178 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.178 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661947+0000", 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5099999999999999e-06 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667621+0000", 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056736269999999997 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667649+0000", 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8093e-05 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667661+0000", 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2554999999999999e-05 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667745+0000", 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3301999999999996e-05 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667771+0000", 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6135999999999998e-05 2024-05-07T14:03:46.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.681960+0000", 2024-05-07T14:03:46.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014189301 2024-05-07T14:03:46.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.182 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.182 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.682026+0000", 2024-05-07T14:03:46.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6072e-05 2024-05-07T14:03:46.182 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.182 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.182 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2883 3.29 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.306700311, 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025309511999999999, 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2883 2024-05-07T14:03:46.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:46.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777791+0000", 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.289e-06 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779027+0000", 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001236411 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779063+0000", 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5658999999999999e-05 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779076+0000", 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3128e-05 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779166+0000", 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9818e-05 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779398+0000", 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023189400000000001 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779577+0000", 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000179276 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.786782+0000", 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072052740000000002 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.802960+0000", 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016177490999999999 2024-05-07T14:03:46.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803047+0000", 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6912999999999999e-05 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803098+0000", 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1359000000000001e-05 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:46.188 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:46.189 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:46.190 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:46.191 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:46.191 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:46.191 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:46.191 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:46.192 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:46.192 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:46.192 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:46.199+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:46.205 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:46.205 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:46.227 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:03:46.227 INFO:teuthology.orchestra.run.smithi106.stdout:{"fsid":"0d349e2f-0c2b-4aab-8a22-181c69b40dbb","health":{"status":"HEALTH_WARN","checks":{"OSDMAP_FLAGS":{"severity":"HEALTH_WARN","summary":{"message":"noscrub,nodeep-scrub flag(s) set","count":20},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":195,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":105,"num_osds":8,"num_up_osds":8,"osd_up_since":1715090441,"num_in_osds":8,"osd_in_since":1715090432,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":261},{"state_name":"peering","count":4}],"num_pgs":265,"num_pools":8,"num_objects":468,"data_bytes":1070220028,"bytes_used":2405961728,"bytes_avail":770688151552,"bytes_total":773094113280,"inactive_pgs_ratio":0.015094339847564697,"recovering_objects_per_sec":13,"recovering_bytes_per_sec":7338437,"recovering_keys_per_sec":0,"num_objects_recovered":56,"num_bytes_recovered":29362813,"num_keys_recovered":0},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-05-07T14:01:43.234775+0000","services":{"rgw":{"daemons":{"summary":"","4464":{"start_epoch":2,"start_stamp":"2024-05-07T14:01:07.217018+0000","gid":4464,"addr":"172.21.15.106:0/364235150","metadata":{"arch":"x86_64","ceph_release":"squid","ceph_version":"ceph version 19.0.0-2521-g1dfb479e (1dfb479e40144c07778a01ea762def8ca56f6eee) squid (dev)","ceph_version_short":"19.0.0-2521-g1dfb479e","cpu":"Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz","distro":"ubuntu","distro_description":"Ubuntu 22.04.1 LTS","distro_version":"22.04","frontend_config#0":"beast port=80","frontend_type#0":"beast","hostname":"smithi106","id":"0","kernel_description":"#116-Ubuntu SMP Wed Apr 17 09:17:56 UTC 2024","kernel_version":"5.15.0-106-generic","mem_swap_kb":"2097148","mem_total_kb":"32746864","num_handles":"1","os":"Linux","pid":"31974","realm_id":"","realm_name":"","zone_id":"c956e04a-d9ee-4a74-8bac-922bf2eb8512","zone_name":"default","zonegroup_id":"7881bf19-2c91-49be-82bb-722579314d1c","zonegroup_name":"default"},"task_status":{}}}}}},"progress_events":{}} 2024-05-07T14:03:46.233 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:46.233 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:46.254 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-05-07T14:03:46.254 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:03:46.261 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:46.261 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:46.294 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:46.295 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:46.296 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:46.303+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:46.334 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:46.334 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:46.337 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:46.337 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:46.357 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:46.400 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:46.411+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:46.490 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:46.490 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:46.492 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:46.503+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:46.506 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:46.540 INFO:tasks.workunit.client.0.smithi106.stdout:adding file to bucket: 1Gb. 2024-05-07T14:03:46.540 INFO:tasks.workunit.client.0.smithi106.stdout:upload file successful 2024-05-07T14:03:46.540 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:03:46.540 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - set max size for a given user and ensure that the max size is in effect 2024-05-07T14:03:46.540 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:03:46.593 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:46.603+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:46.611 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:03:46.617 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:03:46.623 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:46.623 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:46.627 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-05-07T14:03:45.276031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1070220028,"num_objects":468,"num_object_clones":0,"num_object_copies":936,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":468,"num_whiteouts":0,"num_read":2515,"num_read_kb":2220,"num_write":1410,"num_write_kb":1067588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":71899899,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2190,"ondisk_log_size":2190,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":543,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2349572,"kb_used_data":2100096,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":752625148,"statfs":{"total":773094113280,"available":770688151552,"internally_reserved":0,"allocated":2150498304,"data_stored":2146034460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-1,"num_objects_missing":-1,"num_objects_degraded":-4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-13,"num_read_kb":-13,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":29362813,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001235"},"pg_stats":[{"pgid":"3.3f","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698514+0000","last_change":"2024-05-07T14:00:55.983744+0000","last_active":"2024-05-07T14:03:41.698514+0000","last_peered":"2024-05-07T14:03:41.698514+0000","last_clean":"2024-05-07T14:03:41.698514+0000","last_became_active":"2024-05-07T14:00:55.982993+0000","last_became_peered":"2024-05-07T14:00:55.982993+0000","last_unstale":"2024-05-07T14:03:41.698514+0000","last_undegraded":"2024-05-07T14:03:41.698514+0000","last_fullsized":"2024-05-07T14:03:41.698514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695581+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:03:41.695581+0000","last_peered":"2024-05-07T14:03:41.695581+0000","last_clean":"2024-05-07T14:03:41.695581+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:03:41.695581+0000","last_undegraded":"2024-05-07T14:03:41.695581+0000","last_fullsized":"2024-05-07T14:03:41.695581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"85'2","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709139+0000","last_change":"2024-05-07T14:03:39.850495+0000","last_active":"2024-05-07T14:03:41.709139+0000","last_peered":"2024-05-07T14:03:41.709139+0000","last_clean":"2024-05-07T14:03:41.709139+0000","last_became_active":"2024-05-07T14:03:39.676092+0000","last_became_peered":"2024-05-07T14:03:39.676092+0000","last_unstale":"2024-05-07T14:03:41.709139+0000","last_undegraded":"2024-05-07T14:03:41.709139+0000","last_fullsized":"2024-05-07T14:03:41.709139+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:00.668304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696652+0000","last_change":"2024-05-07T14:00:57.988092+0000","last_active":"2024-05-07T14:03:41.696652+0000","last_peered":"2024-05-07T14:03:41.696652+0000","last_clean":"2024-05-07T14:03:41.696652+0000","last_became_active":"2024-05-07T14:00:57.987091+0000","last_became_peered":"2024-05-07T14:00:57.987091+0000","last_unstale":"2024-05-07T14:03:41.696652+0000","last_undegraded":"2024-05-07T14:03:41.696652+0000","last_fullsized":"2024-05-07T14:03:41.696652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699224+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:03:41.699224+0000","last_peered":"2024-05-07T14:03:41.699224+0000","last_clean":"2024-05-07T14:03:41.699224+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:03:41.699224+0000","last_undegraded":"2024-05-07T14:03:41.699224+0000","last_fullsized":"2024-05-07T14:03:41.699224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703095+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:03:41.703095+0000","last_peered":"2024-05-07T14:03:41.703095+0000","last_clean":"2024-05-07T14:03:41.703095+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:03:41.703095+0000","last_undegraded":"2024-05-07T14:03:41.703095+0000","last_fullsized":"2024-05-07T14:03:41.703095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697166+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:03:41.697166+0000","last_peered":"2024-05-07T14:03:41.697166+0000","last_clean":"2024-05-07T14:03:41.697166+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:03:41.697166+0000","last_undegraded":"2024-05-07T14:03:41.697166+0000","last_fullsized":"2024-05-07T14:03:41.697166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698562+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:03:41.698562+0000","last_peered":"2024-05-07T14:03:41.698562+0000","last_clean":"2024-05-07T14:03:41.698562+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:03:41.698562+0000","last_undegraded":"2024-05-07T14:03:41.698562+0000","last_fullsized":"2024-05-07T14:03:41.698562+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700018+0000","last_change":"2024-05-07T14:00:55.973419+0000","last_active":"2024-05-07T14:03:41.700018+0000","last_peered":"2024-05-07T14:03:41.700018+0000","last_clean":"2024-05-07T14:03:41.700018+0000","last_became_active":"2024-05-07T14:00:55.963467+0000","last_became_peered":"2024-05-07T14:00:55.963467+0000","last_unstale":"2024-05-07T14:03:41.700018+0000","last_undegraded":"2024-05-07T14:03:41.700018+0000","last_fullsized":"2024-05-07T14:03:41.700018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"81'2","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101634+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:03:42.101634+0000","last_peered":"2024-05-07T14:03:42.101634+0000","last_clean":"2024-05-07T14:03:42.101634+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:03:42.101634+0000","last_undegraded":"2024-05-07T14:03:42.101634+0000","last_fullsized":"2024-05-07T14:03:42.101634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"84'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695865+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:03:41.695865+0000","last_peered":"2024-05-07T14:03:41.695865+0000","last_clean":"2024-05-07T14:03:41.695865+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:03:41.695865+0000","last_undegraded":"2024-05-07T14:03:41.695865+0000","last_fullsized":"2024-05-07T14:03:41.695865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"81'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703652+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:03:41.703652+0000","last_peered":"2024-05-07T14:03:41.703652+0000","last_clean":"2024-05-07T14:03:41.703652+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:03:41.703652+0000","last_undegraded":"2024-05-07T14:03:41.703652+0000","last_fullsized":"2024-05-07T14:03:41.703652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"85'2","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697069+0000","last_change":"2024-05-07T14:00:55.962579+0000","last_active":"2024-05-07T14:03:41.697069+0000","last_peered":"2024-05-07T14:03:41.697069+0000","last_clean":"2024-05-07T14:03:41.697069+0000","last_became_active":"2024-05-07T14:00:55.961815+0000","last_became_peered":"2024-05-07T14:00:55.961815+0000","last_unstale":"2024-05-07T14:03:41.697069+0000","last_undegraded":"2024-05-07T14:03:41.697069+0000","last_fullsized":"2024-05-07T14:03:41.697069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697662+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:03:41.697662+0000","last_peered":"2024-05-07T14:03:41.697662+0000","last_clean":"2024-05-07T14:03:41.697662+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:03:41.697662+0000","last_undegraded":"2024-05-07T14:03:41.697662+0000","last_fullsized":"2024-05-07T14:03:41.697662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711126+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:03:41.711126+0000","last_peered":"2024-05-07T14:03:41.711126+0000","last_clean":"2024-05-07T14:03:41.711126+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:03:41.711126+0000","last_undegraded":"2024-05-07T14:03:41.711126+0000","last_fullsized":"2024-05-07T14:03:41.711126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"94'1","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707908+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:03:41.707908+0000","last_peered":"2024-05-07T14:03:41.707908+0000","last_clean":"2024-05-07T14:03:41.707908+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:03:41.707908+0000","last_undegraded":"2024-05-07T14:03:41.707908+0000","last_fullsized":"2024-05-07T14:03:41.707908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702369+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:03:41.702369+0000","last_peered":"2024-05-07T14:03:41.702369+0000","last_clean":"2024-05-07T14:03:41.702369+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:03:41.702369+0000","last_undegraded":"2024-05-07T14:03:41.702369+0000","last_fullsized":"2024-05-07T14:03:41.702369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698698+0000","last_change":"2024-05-07T14:00:56.003776+0000","last_active":"2024-05-07T14:03:41.698698+0000","last_peered":"2024-05-07T14:03:41.698698+0000","last_clean":"2024-05-07T14:03:41.698698+0000","last_became_active":"2024-05-07T14:00:56.002996+0000","last_became_peered":"2024-05-07T14:00:56.002996+0000","last_unstale":"2024-05-07T14:03:41.698698+0000","last_undegraded":"2024-05-07T14:03:41.698698+0000","last_fullsized":"2024-05-07T14:03:41.698698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:17.583140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696875+0000","last_change":"2024-05-07T14:00:57.987026+0000","last_active":"2024-05-07T14:03:41.696875+0000","last_peered":"2024-05-07T14:03:41.696875+0000","last_clean":"2024-05-07T14:03:41.696875+0000","last_became_active":"2024-05-07T14:00:57.986048+0000","last_became_peered":"2024-05-07T14:00:57.986048+0000","last_unstale":"2024-05-07T14:03:41.696875+0000","last_undegraded":"2024-05-07T14:03:41.696875+0000","last_fullsized":"2024-05-07T14:03:41.696875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101237+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:03:42.101237+0000","last_peered":"2024-05-07T14:03:42.101237+0000","last_clean":"2024-05-07T14:03:42.101237+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:03:42.101237+0000","last_undegraded":"2024-05-07T14:03:42.101237+0000","last_fullsized":"2024-05-07T14:03:42.101237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696308+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:03:41.696308+0000","last_peered":"2024-05-07T14:03:41.696308+0000","last_clean":"2024-05-07T14:03:41.696308+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:03:41.696308+0000","last_undegraded":"2024-05-07T14:03:41.696308+0000","last_fullsized":"2024-05-07T14:03:41.696308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"85'4","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101628+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:03:42.101628+0000","last_peered":"2024-05-07T14:03:42.101628+0000","last_clean":"2024-05-07T14:03:42.101628+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:03:42.101628+0000","last_undegraded":"2024-05-07T14:03:42.101628+0000","last_fullsized":"2024-05-07T14:03:42.101628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"81'8","reported_seq":204,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705740+0000","last_change":"2024-05-07T14:01:37.318563+0000","last_active":"2024-05-07T14:03:41.705740+0000","last_peered":"2024-05-07T14:03:41.705740+0000","last_clean":"2024-05-07T14:03:41.705740+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:03:41.705740+0000","last_undegraded":"2024-05-07T14:03:41.705740+0000","last_fullsized":"2024-05-07T14:03:41.705740+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:27.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702725+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:03:41.702725+0000","last_peered":"2024-05-07T14:03:41.702725+0000","last_clean":"2024-05-07T14:03:41.702725+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:03:41.702725+0000","last_undegraded":"2024-05-07T14:03:41.702725+0000","last_fullsized":"2024-05-07T14:03:41.702725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"94'3","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706201+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:03:41.706201+0000","last_peered":"2024-05-07T14:03:41.706201+0000","last_clean":"2024-05-07T14:03:41.706201+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:03:41.706201+0000","last_undegraded":"2024-05-07T14:03:41.706201+0000","last_fullsized":"2024-05-07T14:03:41.706201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711135+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:03:41.711135+0000","last_peered":"2024-05-07T14:03:41.711135+0000","last_clean":"2024-05-07T14:03:41.711135+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:03:41.711135+0000","last_undegraded":"2024-05-07T14:03:41.711135+0000","last_fullsized":"2024-05-07T14:03:41.711135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"94'1","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703758+0000","last_change":"2024-05-07T14:03:39.848413+0000","last_active":"2024-05-07T14:03:41.703758+0000","last_peered":"2024-05-07T14:03:41.703758+0000","last_clean":"2024-05-07T14:03:41.703758+0000","last_became_active":"2024-05-07T14:03:39.663590+0000","last_became_peered":"2024-05-07T14:03:39.663590+0000","last_unstale":"2024-05-07T14:03:41.703758+0000","last_undegraded":"2024-05-07T14:03:41.703758+0000","last_fullsized":"2024-05-07T14:03:41.703758+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:02.675624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"84'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700741+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:03:41.700741+0000","last_peered":"2024-05-07T14:03:41.700741+0000","last_clean":"2024-05-07T14:03:41.700741+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:03:41.700741+0000","last_undegraded":"2024-05-07T14:03:41.700741+0000","last_fullsized":"2024-05-07T14:03:41.700741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702020+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:03:41.702020+0000","last_peered":"2024-05-07T14:03:41.702020+0000","last_clean":"2024-05-07T14:03:41.702020+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:03:41.702020+0000","last_undegraded":"2024-05-07T14:03:41.702020+0000","last_fullsized":"2024-05-07T14:03:41.702020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"81'2","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711941+0000","last_change":"2024-05-07T14:03:39.857355+0000","last_active":"2024-05-07T14:03:41.711941+0000","last_peered":"2024-05-07T14:03:41.711941+0000","last_clean":"2024-05-07T14:03:41.711941+0000","last_became_active":"2024-05-07T14:03:39.680721+0000","last_became_peered":"2024-05-07T14:03:39.680721+0000","last_unstale":"2024-05-07T14:03:41.711941+0000","last_undegraded":"2024-05-07T14:03:41.711941+0000","last_fullsized":"2024-05-07T14:03:41.711941+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:36.092563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"85'3","reported_seq":122,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705434+0000","last_change":"2024-05-07T14:01:37.311718+0000","last_active":"2024-05-07T14:03:41.705434+0000","last_peered":"2024-05-07T14:03:41.705434+0000","last_clean":"2024-05-07T14:03:41.705434+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:03:41.705434+0000","last_undegraded":"2024-05-07T14:03:41.705434+0000","last_fullsized":"2024-05-07T14:03:41.705434+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:24.211300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696912+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:03:41.696912+0000","last_peered":"2024-05-07T14:03:41.696912+0000","last_clean":"2024-05-07T14:03:41.696912+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:03:41.696912+0000","last_undegraded":"2024-05-07T14:03:41.696912+0000","last_fullsized":"2024-05-07T14:03:41.696912+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"85'14","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700862+0000","last_change":"2024-05-07T14:01:01.993679+0000","last_active":"2024-05-07T14:03:41.700862+0000","last_peered":"2024-05-07T14:03:41.700862+0000","last_clean":"2024-05-07T14:03:41.700862+0000","last_became_active":"2024-05-07T14:01:01.993241+0000","last_became_peered":"2024-05-07T14:01:01.993241+0000","last_unstale":"2024-05-07T14:03:41.700862+0000","last_undegraded":"2024-05-07T14:03:41.700862+0000","last_fullsized":"2024-05-07T14:03:41.700862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697732+0000","last_change":"2024-05-07T14:01:04.017472+0000","last_active":"2024-05-07T14:03:41.697732+0000","last_peered":"2024-05-07T14:03:41.697732+0000","last_clean":"2024-05-07T14:03:41.697732+0000","last_became_active":"2024-05-07T14:01:04.016757+0000","last_became_peered":"2024-05-07T14:01:04.016757+0000","last_unstale":"2024-05-07T14:03:41.697732+0000","last_undegraded":"2024-05-07T14:03:41.697732+0000","last_fullsized":"2024-05-07T14:03:41.697732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"94'39","reported_seq":206,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696205+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:03:41.696205+0000","last_peered":"2024-05-07T14:03:41.696205+0000","last_clean":"2024-05-07T14:03:41.696205+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:03:41.696205+0000","last_undegraded":"2024-05-07T14:03:41.696205+0000","last_fullsized":"2024-05-07T14:03:41.696205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":92,"num_write":78,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"81'6","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697528+0000","last_change":"2024-05-07T14:00:57.984789+0000","last_active":"2024-05-07T14:03:41.697528+0000","last_peered":"2024-05-07T14:03:41.697528+0000","last_clean":"2024-05-07T14:03:41.697528+0000","last_became_active":"2024-05-07T14:00:57.983524+0000","last_became_peered":"2024-05-07T14:00:57.983524+0000","last_unstale":"2024-05-07T14:03:41.697528+0000","last_undegraded":"2024-05-07T14:03:41.697528+0000","last_fullsized":"2024-05-07T14:03:41.697528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"85'2","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.701078+0000","last_change":"2024-05-07T14:00:55.989797+0000","last_active":"2024-05-07T14:03:41.701078+0000","last_peered":"2024-05-07T14:03:41.701078+0000","last_clean":"2024-05-07T14:03:41.701078+0000","last_became_active":"2024-05-07T14:00:55.989449+0000","last_became_peered":"2024-05-07T14:00:55.989449+0000","last_unstale":"2024-05-07T14:03:41.701078+0000","last_undegraded":"2024-05-07T14:03:41.701078+0000","last_fullsized":"2024-05-07T14:03:41.701078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712162+0000","last_change":"2024-05-07T14:00:59.983880+0000","last_active":"2024-05-07T14:03:41.712162+0000","last_peered":"2024-05-07T14:03:41.712162+0000","last_clean":"2024-05-07T14:03:41.712162+0000","last_became_active":"2024-05-07T14:00:59.983186+0000","last_became_peered":"2024-05-07T14:00:59.983186+0000","last_unstale":"2024-05-07T14:03:41.712162+0000","last_undegraded":"2024-05-07T14:03:41.712162+0000","last_fullsized":"2024-05-07T14:03:41.712162+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:27.067433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"81'7","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703824+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:03:41.703824+0000","last_peered":"2024-05-07T14:03:41.703824+0000","last_clean":"2024-05-07T14:03:41.703824+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:03:41.703824+0000","last_undegraded":"2024-05-07T14:03:41.703824+0000","last_fullsized":"2024-05-07T14:03:41.703824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703701+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:03:41.703701+0000","last_peered":"2024-05-07T14:03:41.703701+0000","last_clean":"2024-05-07T14:03:41.703701+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:03:41.703701+0000","last_undegraded":"2024-05-07T14:03:41.703701+0000","last_fullsized":"2024-05-07T14:03:41.703701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"81'6","reported_seq":159,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700097+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:03:41.700097+0000","last_peered":"2024-05-07T14:03:41.700097+0000","last_clean":"2024-05-07T14:03:41.700097+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:03:41.700097+0000","last_undegraded":"2024-05-07T14:03:41.700097+0000","last_fullsized":"2024-05-07T14:03:41.700097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"81'4","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702846+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:03:41.702846+0000","last_peered":"2024-05-07T14:03:41.702846+0000","last_clean":"2024-05-07T14:03:41.702846+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:03:41.702846+0000","last_undegraded":"2024-05-07T14:03:41.702846+0000","last_fullsized":"2024-05-07T14:03:41.702846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"84'2","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697307+0000","last_change":"2024-05-07T14:00:55.986233+0000","last_active":"2024-05-07T14:03:41.697307+0000","last_peered":"2024-05-07T14:03:41.697307+0000","last_clean":"2024-05-07T14:03:41.697307+0000","last_became_active":"2024-05-07T14:00:55.984927+0000","last_became_peered":"2024-05-07T14:00:55.984927+0000","last_unstale":"2024-05-07T14:03:41.697307+0000","last_undegraded":"2024-05-07T14:03:41.697307+0000","last_fullsized":"2024-05-07T14:03:41.697307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712902+0000","last_change":"2024-05-07T14:03:39.680812+0000","last_active":"2024-05-07T14:03:41.712902+0000","last_peered":"2024-05-07T14:03:41.712902+0000","last_clean":"2024-05-07T14:03:41.712902+0000","last_became_active":"2024-05-07T14:03:39.680482+0000","last_became_peered":"2024-05-07T14:03:39.680482+0000","last_unstale":"2024-05-07T14:03:41.712902+0000","last_undegraded":"2024-05-07T14:03:41.712902+0000","last_fullsized":"2024-05-07T14:03:41.712902+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:07.705255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"81'13","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705975+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:03:41.705975+0000","last_peered":"2024-05-07T14:03:41.705975+0000","last_clean":"2024-05-07T14:03:41.705975+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:03:41.705975+0000","last_undegraded":"2024-05-07T14:03:41.705975+0000","last_fullsized":"2024-05-07T14:03:41.705975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"101'107","reported_seq":308,"reported_epoch":101,"state":"peering","last_fresh":"2024-05-07T14:03:40.794648+0000","last_change":"2024-05-07T14:03:41.697776+0000","last_active":"2024-05-07T14:03:41.697776+0000","last_peered":"2024-05-07T14:03:40.794648+0000","last_clean":"2024-05-07T14:03:37.621532+0000","last_became_active":"2024-05-07T14:03:40.774047+0000","last_became_peered":"2024-05-07T14:03:40.774047+0000","last_unstale":"2024-05-07T14:03:40.794648+0000","last_undegraded":"2024-05-07T14:03:40.794648+0000","last_fullsized":"2024-05-07T14:03:40.650243+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702478+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:03:41.702478+0000","last_peered":"2024-05-07T14:03:41.702478+0000","last_clean":"2024-05-07T14:03:41.702478+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:03:41.702478+0000","last_undegraded":"2024-05-07T14:03:41.702478+0000","last_fullsized":"2024-05-07T14:03:41.702478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"87'16","reported_seq":210,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711369+0000","last_change":"2024-05-07T14:00:57.998824+0000","last_active":"2024-05-07T14:03:41.711369+0000","last_peered":"2024-05-07T14:03:41.711369+0000","last_clean":"2024-05-07T14:03:41.711369+0000","last_became_active":"2024-05-07T14:00:57.998316+0000","last_became_peered":"2024-05-07T14:00:57.998316+0000","last_unstale":"2024-05-07T14:03:41.711369+0000","last_undegraded":"2024-05-07T14:03:41.711369+0000","last_fullsized":"2024-05-07T14:03:41.711369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"85'5","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100817+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:03:42.100817+0000","last_peered":"2024-05-07T14:03:42.100817+0000","last_clean":"2024-05-07T14:03:42.100817+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:03:42.100817+0000","last_undegraded":"2024-05-07T14:03:42.100817+0000","last_fullsized":"2024-05-07T14:03:42.100817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697576+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:03:41.697576+0000","last_peered":"2024-05-07T14:03:41.697576+0000","last_clean":"2024-05-07T14:03:41.697576+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:03:41.697576+0000","last_undegraded":"2024-05-07T14:03:41.697576+0000","last_fullsized":"2024-05-07T14:03:41.697576+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"85'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698730+0000","last_change":"2024-05-07T14:01:02.151107+0000","last_active":"2024-05-07T14:03:41.698730+0000","last_peered":"2024-05-07T14:03:41.698730+0000","last_clean":"2024-05-07T14:03:41.698730+0000","last_became_active":"2024-05-07T14:01:02.150351+0000","last_became_peered":"2024-05-07T14:01:02.150351+0000","last_unstale":"2024-05-07T14:03:41.698730+0000","last_undegraded":"2024-05-07T14:03:41.698730+0000","last_fullsized":"2024-05-07T14:03:41.698730+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:28:13.159757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"94'104","reported_seq":291,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712487+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:03:41.712487+0000","last_peered":"2024-05-07T14:03:41.712487+0000","last_clean":"2024-05-07T14:03:41.712487+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:03:41.712487+0000","last_undegraded":"2024-05-07T14:03:41.712487+0000","last_fullsized":"2024-05-07T14:03:41.712487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"81'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696756+0000","last_change":"2024-05-07T14:00:57.979757+0000","last_active":"2024-05-07T14:03:41.696756+0000","last_peered":"2024-05-07T14:03:41.696756+0000","last_clean":"2024-05-07T14:03:41.696756+0000","last_became_active":"2024-05-07T14:00:57.979030+0000","last_became_peered":"2024-05-07T14:00:57.979030+0000","last_unstale":"2024-05-07T14:03:41.696756+0000","last_undegraded":"2024-05-07T14:03:41.696756+0000","last_fullsized":"2024-05-07T14:03:41.696756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"84'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699145+0000","last_change":"2024-05-07T14:00:55.980339+0000","last_active":"2024-05-07T14:03:41.699145+0000","last_peered":"2024-05-07T14:03:41.699145+0000","last_clean":"2024-05-07T14:03:41.699145+0000","last_became_active":"2024-05-07T14:00:55.979609+0000","last_became_peered":"2024-05-07T14:00:55.979609+0000","last_unstale":"2024-05-07T14:03:41.699145+0000","last_undegraded":"2024-05-07T14:03:41.699145+0000","last_fullsized":"2024-05-07T14:03:41.699145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:52.518278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695894+0000","last_change":"2024-05-07T14:00:59.982771+0000","last_active":"2024-05-07T14:03:41.695894+0000","last_peered":"2024-05-07T14:03:41.695894+0000","last_clean":"2024-05-07T14:03:41.695894+0000","last_became_active":"2024-05-07T14:00:59.982018+0000","last_became_peered":"2024-05-07T14:00:59.982018+0000","last_unstale":"2024-05-07T14:03:41.695894+0000","last_undegraded":"2024-05-07T14:03:41.695894+0000","last_fullsized":"2024-05-07T14:03:41.695894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:47.657483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"85'24","reported_seq":195,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695119+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:03:41.695119+0000","last_peered":"2024-05-07T14:03:41.695119+0000","last_clean":"2024-05-07T14:03:41.695119+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:03:41.695119+0000","last_undegraded":"2024-05-07T14:03:41.695119+0000","last_fullsized":"2024-05-07T14:03:41.695119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709481+0000","last_change":"2024-05-07T14:03:39.666526+0000","last_active":"2024-05-07T14:03:41.709481+0000","last_peered":"2024-05-07T14:03:41.709481+0000","last_clean":"2024-05-07T14:03:41.709481+0000","last_became_active":"2024-05-07T14:03:39.666160+0000","last_became_peered":"2024-05-07T14:03:39.666160+0000","last_unstale":"2024-05-07T14:03:41.709481+0000","last_undegraded":"2024-05-07T14:03:41.709481+0000","last_fullsized":"2024-05-07T14:03:41.709481+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:44.560061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696931+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:03:41.696931+0000","last_peered":"2024-05-07T14:03:41.696931+0000","last_clean":"2024-05-07T14:03:41.696931+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:03:41.696931+0000","last_undegraded":"2024-05-07T14:03:41.696931+0000","last_fullsized":"2024-05-07T14:03:41.696931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703320+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:03:41.703320+0000","last_peered":"2024-05-07T14:03:41.703320+0000","last_clean":"2024-05-07T14:03:41.703320+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:03:41.703320+0000","last_undegraded":"2024-05-07T14:03:41.703320+0000","last_fullsized":"2024-05-07T14:03:41.703320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700274+0000","last_change":"2024-05-07T14:00:55.980488+0000","last_active":"2024-05-07T14:03:41.700274+0000","last_peered":"2024-05-07T14:03:41.700274+0000","last_clean":"2024-05-07T14:03:41.700274+0000","last_became_active":"2024-05-07T14:00:55.979688+0000","last_became_peered":"2024-05-07T14:00:55.979688+0000","last_unstale":"2024-05-07T14:03:41.700274+0000","last_undegraded":"2024-05-07T14:03:41.700274+0000","last_fullsized":"2024-05-07T14:03:41.700274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:32.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":232,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705567+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:03:41.705567+0000","last_peered":"2024-05-07T14:03:41.705567+0000","last_clean":"2024-05-07T14:03:41.705567+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:03:41.705567+0000","last_undegraded":"2024-05-07T14:03:41.705567+0000","last_fullsized":"2024-05-07T14:03:41.705567+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"85'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.714072+0000","last_change":"2024-05-07T14:01:02.014265+0000","last_active":"2024-05-07T14:03:41.714072+0000","last_peered":"2024-05-07T14:03:41.714072+0000","last_clean":"2024-05-07T14:03:41.714072+0000","last_became_active":"2024-05-07T14:01:02.009335+0000","last_became_peered":"2024-05-07T14:01:02.009335+0000","last_unstale":"2024-05-07T14:03:41.714072+0000","last_undegraded":"2024-05-07T14:03:41.714072+0000","last_fullsized":"2024-05-07T14:03:41.714072+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710085+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:03:41.710085+0000","last_peered":"2024-05-07T14:03:41.710085+0000","last_clean":"2024-05-07T14:03:41.710085+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:03:41.710085+0000","last_undegraded":"2024-05-07T14:03:41.710085+0000","last_fullsized":"2024-05-07T14:03:41.710085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100937+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:03:42.100937+0000","last_peered":"2024-05-07T14:03:42.100937+0000","last_clean":"2024-05-07T14:03:42.100937+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:03:42.100937+0000","last_undegraded":"2024-05-07T14:03:42.100937+0000","last_fullsized":"2024-05-07T14:03:42.100937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"81'6","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101300+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:03:42.101300+0000","last_peered":"2024-05-07T14:03:42.101300+0000","last_clean":"2024-05-07T14:03:42.101300+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:03:42.101300+0000","last_undegraded":"2024-05-07T14:03:42.101300+0000","last_fullsized":"2024-05-07T14:03:42.101300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699570+0000","last_change":"2024-05-07T14:00:56.008026+0000","last_active":"2024-05-07T14:03:41.699570+0000","last_peered":"2024-05-07T14:03:41.699570+0000","last_clean":"2024-05-07T14:03:41.699570+0000","last_became_active":"2024-05-07T14:00:56.007374+0000","last_became_peered":"2024-05-07T14:00:56.007374+0000","last_unstale":"2024-05-07T14:03:41.699570+0000","last_undegraded":"2024-05-07T14:03:41.699570+0000","last_fullsized":"2024-05-07T14:03:41.699570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707009+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:03:41.707009+0000","last_peered":"2024-05-07T14:03:41.707009+0000","last_clean":"2024-05-07T14:03:41.707009+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:03:41.707009+0000","last_undegraded":"2024-05-07T14:03:41.707009+0000","last_fullsized":"2024-05-07T14:03:41.707009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"85'20","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697713+0000","last_change":"2024-05-07T14:01:01.997489+0000","last_active":"2024-05-07T14:03:41.697713+0000","last_peered":"2024-05-07T14:03:41.697713+0000","last_clean":"2024-05-07T14:03:41.697713+0000","last_became_active":"2024-05-07T14:01:01.994656+0000","last_became_peered":"2024-05-07T14:01:01.994656+0000","last_unstale":"2024-05-07T14:03:41.697713+0000","last_undegraded":"2024-05-07T14:03:41.697713+0000","last_fullsized":"2024-05-07T14:03:41.697713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:12.091721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"101'107","reported_seq":307,"reported_epoch":101,"state":"peering","last_fresh":"2024-05-07T14:03:40.791852+0000","last_change":"2024-05-07T14:03:41.699155+0000","last_active":"2024-05-07T14:03:41.699155+0000","last_peered":"2024-05-07T14:03:40.791852+0000","last_clean":"2024-05-07T14:03:37.947580+0000","last_became_active":"2024-05-07T14:03:40.773668+0000","last_became_peered":"2024-05-07T14:03:40.773668+0000","last_unstale":"2024-05-07T14:03:40.791852+0000","last_undegraded":"2024-05-07T14:03:40.791852+0000","last_fullsized":"2024-05-07T14:03:40.647524+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.701255+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:03:41.701255+0000","last_peered":"2024-05-07T14:03:41.701255+0000","last_clean":"2024-05-07T14:03:41.701255+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:03:41.701255+0000","last_undegraded":"2024-05-07T14:03:41.701255+0000","last_fullsized":"2024-05-07T14:03:41.701255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"81'8","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700540+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:03:41.700540+0000","last_peered":"2024-05-07T14:03:41.700540+0000","last_clean":"2024-05-07T14:03:41.700540+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:03:41.700540+0000","last_undegraded":"2024-05-07T14:03:41.700540+0000","last_fullsized":"2024-05-07T14:03:41.700540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698973+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:03:41.698973+0000","last_peered":"2024-05-07T14:03:41.698973+0000","last_clean":"2024-05-07T14:03:41.698973+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:03:41.698973+0000","last_undegraded":"2024-05-07T14:03:41.698973+0000","last_fullsized":"2024-05-07T14:03:41.698973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706893+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:03:41.706893+0000","last_peered":"2024-05-07T14:03:41.706893+0000","last_clean":"2024-05-07T14:03:41.706893+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:03:41.706893+0000","last_undegraded":"2024-05-07T14:03:41.706893+0000","last_fullsized":"2024-05-07T14:03:41.706893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"85'22","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698263+0000","last_change":"2024-05-07T14:01:01.995144+0000","last_active":"2024-05-07T14:03:41.698263+0000","last_peered":"2024-05-07T14:03:41.698263+0000","last_clean":"2024-05-07T14:03:41.698263+0000","last_became_active":"2024-05-07T14:01:01.993073+0000","last_became_peered":"2024-05-07T14:01:01.993073+0000","last_unstale":"2024-05-07T14:03:41.698263+0000","last_undegraded":"2024-05-07T14:03:41.698263+0000","last_fullsized":"2024-05-07T14:03:41.698263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:54.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704464+0000","last_change":"2024-05-07T14:01:04.012216+0000","last_active":"2024-05-07T14:03:41.704464+0000","last_peered":"2024-05-07T14:03:41.704464+0000","last_clean":"2024-05-07T14:03:41.704464+0000","last_became_active":"2024-05-07T14:01:04.011476+0000","last_became_peered":"2024-05-07T14:01:04.011476+0000","last_unstale":"2024-05-07T14:03:41.704464+0000","last_undegraded":"2024-05-07T14:03:41.704464+0000","last_fullsized":"2024-05-07T14:03:41.704464+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:46.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'4","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708936+0000","last_change":"2024-05-07T14:03:39.802033+0000","last_active":"2024-05-07T14:03:41.708936+0000","last_peered":"2024-05-07T14:03:41.708936+0000","last_clean":"2024-05-07T14:03:41.708936+0000","last_became_active":"2024-05-07T14:03:39.675695+0000","last_became_peered":"2024-05-07T14:03:39.675695+0000","last_unstale":"2024-05-07T14:03:41.708936+0000","last_undegraded":"2024-05-07T14:03:41.708936+0000","last_fullsized":"2024-05-07T14:03:41.708936+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:22:02.594405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"87'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702884+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:03:41.702884+0000","last_peered":"2024-05-07T14:03:41.702884+0000","last_clean":"2024-05-07T14:03:41.702884+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:03:41.702884+0000","last_undegraded":"2024-05-07T14:03:41.702884+0000","last_fullsized":"2024-05-07T14:03:41.702884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710775+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:03:41.710775+0000","last_peered":"2024-05-07T14:03:41.710775+0000","last_clean":"2024-05-07T14:03:41.710775+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:03:41.710775+0000","last_undegraded":"2024-05-07T14:03:41.710775+0000","last_fullsized":"2024-05-07T14:03:41.710775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705310+0000","last_change":"2024-05-07T14:00:59.992897+0000","last_active":"2024-05-07T14:03:41.705310+0000","last_peered":"2024-05-07T14:03:41.705310+0000","last_clean":"2024-05-07T14:03:41.705310+0000","last_became_active":"2024-05-07T14:00:59.992067+0000","last_became_peered":"2024-05-07T14:00:59.992067+0000","last_unstale":"2024-05-07T14:03:41.705310+0000","last_undegraded":"2024-05-07T14:03:41.705310+0000","last_fullsized":"2024-05-07T14:03:41.705310+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:19.526884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"85'18","reported_seq":219,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703791+0000","last_change":"2024-05-07T14:03:39.698456+0000","last_active":"2024-05-07T14:03:41.703791+0000","last_peered":"2024-05-07T14:03:41.703791+0000","last_clean":"2024-05-07T14:03:41.703791+0000","last_became_active":"2024-05-07T14:03:39.663223+0000","last_became_peered":"2024-05-07T14:03:39.663223+0000","last_unstale":"2024-05-07T14:03:41.703791+0000","last_undegraded":"2024-05-07T14:03:41.703791+0000","last_fullsized":"2024-05-07T14:03:41.703791+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:58.582121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699535+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:03:41.699535+0000","last_peered":"2024-05-07T14:03:41.699535+0000","last_clean":"2024-05-07T14:03:41.699535+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:03:41.699535+0000","last_undegraded":"2024-05-07T14:03:41.699535+0000","last_fullsized":"2024-05-07T14:03:41.699535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"94'5","reported_seq":159,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712479+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:03:41.712479+0000","last_peered":"2024-05-07T14:03:41.712479+0000","last_clean":"2024-05-07T14:03:41.712479+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:03:41.712479+0000","last_undegraded":"2024-05-07T14:03:41.712479+0000","last_fullsized":"2024-05-07T14:03:41.712479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"94'10","reported_seq":205,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703860+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:03:41.703860+0000","last_peered":"2024-05-07T14:03:41.703860+0000","last_clean":"2024-05-07T14:03:41.703860+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:03:41.703860+0000","last_undegraded":"2024-05-07T14:03:41.703860+0000","last_fullsized":"2024-05-07T14:03:41.703860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101506+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:03:42.101506+0000","last_peered":"2024-05-07T14:03:42.101506+0000","last_clean":"2024-05-07T14:03:42.101506+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:03:42.101506+0000","last_undegraded":"2024-05-07T14:03:42.101506+0000","last_fullsized":"2024-05-07T14:03:42.101506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707587+0000","last_change":"2024-05-07T14:03:39.714297+0000","last_active":"2024-05-07T14:03:41.707587+0000","last_peered":"2024-05-07T14:03:41.707587+0000","last_clean":"2024-05-07T14:03:41.707587+0000","last_became_active":"2024-05-07T14:03:39.663013+0000","last_became_peered":"2024-05-07T14:03:39.663013+0000","last_unstale":"2024-05-07T14:03:41.707587+0000","last_undegraded":"2024-05-07T14:03:41.707587+0000","last_fullsized":"2024-05-07T14:03:41.707587+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:40:56.207747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"85'21","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707504+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:03:41.707504+0000","last_peered":"2024-05-07T14:03:41.707504+0000","last_clean":"2024-05-07T14:03:41.707504+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:03:41.707504+0000","last_undegraded":"2024-05-07T14:03:41.707504+0000","last_fullsized":"2024-05-07T14:03:41.707504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"94'104","reported_seq":302,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705231+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:03:41.705231+0000","last_peered":"2024-05-07T14:03:41.705231+0000","last_clean":"2024-05-07T14:03:41.705231+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:03:41.705231+0000","last_undegraded":"2024-05-07T14:03:41.705231+0000","last_fullsized":"2024-05-07T14:03:41.705231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"87'4","reported_seq":156,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710042+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:03:41.710042+0000","last_peered":"2024-05-07T14:03:41.710042+0000","last_clean":"2024-05-07T14:03:41.710042+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:03:41.710042+0000","last_undegraded":"2024-05-07T14:03:41.710042+0000","last_fullsized":"2024-05-07T14:03:41.710042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"94'7","reported_seq":194,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704217+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:03:41.704217+0000","last_peered":"2024-05-07T14:03:41.704217+0000","last_clean":"2024-05-07T14:03:41.704217+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:03:41.704217+0000","last_undegraded":"2024-05-07T14:03:41.704217+0000","last_fullsized":"2024-05-07T14:03:41.704217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"85'4","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703666+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:03:41.703666+0000","last_peered":"2024-05-07T14:03:41.703666+0000","last_clean":"2024-05-07T14:03:41.703666+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:03:41.703666+0000","last_undegraded":"2024-05-07T14:03:41.703666+0000","last_fullsized":"2024-05-07T14:03:41.703666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":303,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697177+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:03:41.697177+0000","last_peered":"2024-05-07T14:03:41.697177+0000","last_clean":"2024-05-07T14:03:41.697177+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:03:41.697177+0000","last_undegraded":"2024-05-07T14:03:41.697177+0000","last_fullsized":"2024-05-07T14:03:41.697177+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712429+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:03:41.712429+0000","last_peered":"2024-05-07T14:03:41.712429+0000","last_clean":"2024-05-07T14:03:41.712429+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:03:41.712429+0000","last_undegraded":"2024-05-07T14:03:41.712429+0000","last_fullsized":"2024-05-07T14:03:41.712429+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"94'104","reported_seq":293,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101190+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:03:42.101190+0000","last_peered":"2024-05-07T14:03:42.101190+0000","last_clean":"2024-05-07T14:03:42.101190+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:03:42.101190+0000","last_undegraded":"2024-05-07T14:03:42.101190+0000","last_fullsized":"2024-05-07T14:03:42.101190+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"87'6","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702966+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:03:41.702966+0000","last_peered":"2024-05-07T14:03:41.702966+0000","last_clean":"2024-05-07T14:03:41.702966+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:03:41.702966+0000","last_undegraded":"2024-05-07T14:03:41.702966+0000","last_fullsized":"2024-05-07T14:03:41.702966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"87'4","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710184+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:03:41.710184+0000","last_peered":"2024-05-07T14:03:41.710184+0000","last_clean":"2024-05-07T14:03:41.710184+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:03:41.710184+0000","last_undegraded":"2024-05-07T14:03:41.710184+0000","last_fullsized":"2024-05-07T14:03:41.710184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"85'5","reported_seq":210,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710874+0000","last_change":"2024-05-07T14:03:39.814768+0000","last_active":"2024-05-07T14:03:41.710874+0000","last_peered":"2024-05-07T14:03:41.710874+0000","last_clean":"2024-05-07T14:03:41.710874+0000","last_became_active":"2024-05-07T14:03:39.666192+0000","last_became_peered":"2024-05-07T14:03:39.666192+0000","last_unstale":"2024-05-07T14:03:41.710874+0000","last_undegraded":"2024-05-07T14:03:41.710874+0000","last_fullsized":"2024-05-07T14:03:41.710874+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:10.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704043+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:03:41.704043+0000","last_peered":"2024-05-07T14:03:41.704043+0000","last_clean":"2024-05-07T14:03:41.704043+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:03:41.704043+0000","last_undegraded":"2024-05-07T14:03:41.704043+0000","last_fullsized":"2024-05-07T14:03:41.704043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"85'22","reported_seq":238,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696798+0000","last_change":"2024-05-07T14:03:39.845058+0000","last_active":"2024-05-07T14:03:41.696798+0000","last_peered":"2024-05-07T14:03:41.696798+0000","last_clean":"2024-05-07T14:03:41.696798+0000","last_became_active":"2024-05-07T14:03:39.673995+0000","last_became_peered":"2024-05-07T14:03:39.673995+0000","last_unstale":"2024-05-07T14:03:41.696798+0000","last_undegraded":"2024-05-07T14:03:41.696798+0000","last_fullsized":"2024-05-07T14:03:41.696798+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:43.919444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101145+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:03:42.101145+0000","last_peered":"2024-05-07T14:03:42.101145+0000","last_clean":"2024-05-07T14:03:42.101145+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:03:42.101145+0000","last_undegraded":"2024-05-07T14:03:42.101145+0000","last_fullsized":"2024-05-07T14:03:42.101145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708622+0000","last_change":"2024-05-07T14:03:39.666268+0000","last_active":"2024-05-07T14:03:41.708622+0000","last_peered":"2024-05-07T14:03:41.708622+0000","last_clean":"2024-05-07T14:03:41.708622+0000","last_became_active":"2024-05-07T14:03:39.665838+0000","last_became_peered":"2024-05-07T14:03:39.665838+0000","last_unstale":"2024-05-07T14:03:41.708622+0000","last_undegraded":"2024-05-07T14:03:41.708622+0000","last_fullsized":"2024-05-07T14:03:41.708622+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:54:00.122392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101420+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:03:42.101420+0000","last_peered":"2024-05-07T14:03:42.101420+0000","last_clean":"2024-05-07T14:03:42.101420+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:03:42.101420+0000","last_undegraded":"2024-05-07T14:03:42.101420+0000","last_fullsized":"2024-05-07T14:03:42.101420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":226,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100554+0000","last_change":"2024-05-07T14:02:39.729323+0000","last_active":"2024-05-07T14:03:42.100554+0000","last_peered":"2024-05-07T14:03:42.100554+0000","last_clean":"2024-05-07T14:03:42.100554+0000","last_became_active":"2024-05-07T14:02:39.728189+0000","last_became_peered":"2024-05-07T14:02:39.728189+0000","last_unstale":"2024-05-07T14:03:42.100554+0000","last_undegraded":"2024-05-07T14:03:42.100554+0000","last_fullsized":"2024-05-07T14:03:42.100554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:53:59.368912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697643+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:03:41.697643+0000","last_peered":"2024-05-07T14:03:41.697643+0000","last_clean":"2024-05-07T14:03:41.697643+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:03:41.697643+0000","last_undegraded":"2024-05-07T14:03:41.697643+0000","last_fullsized":"2024-05-07T14:03:41.697643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'4","reported_seq":124,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706333+0000","last_change":"2024-05-07T14:01:37.317794+0000","last_active":"2024-05-07T14:03:41.706333+0000","last_peered":"2024-05-07T14:03:41.706333+0000","last_clean":"2024-05-07T14:03:41.706333+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:03:41.706333+0000","last_undegraded":"2024-05-07T14:03:41.706333+0000","last_fullsized":"2024-05-07T14:03:41.706333+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:17.582561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700564+0000","last_change":"2024-05-07T14:00:59.988489+0000","last_active":"2024-05-07T14:03:41.700564+0000","last_peered":"2024-05-07T14:03:41.700564+0000","last_clean":"2024-05-07T14:03:41.700564+0000","last_became_active":"2024-05-07T14:00:59.987757+0000","last_became_peered":"2024-05-07T14:00:59.987757+0000","last_unstale":"2024-05-07T14:03:41.700564+0000","last_undegraded":"2024-05-07T14:03:41.700564+0000","last_fullsized":"2024-05-07T14:03:41.700564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"87'29","reported_seq":202,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697712+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:03:41.697712+0000","last_peered":"2024-05-07T14:03:41.697712+0000","last_clean":"2024-05-07T14:03:41.697712+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:03:41.697712+0000","last_undegraded":"2024-05-07T14:03:41.697712+0000","last_fullsized":"2024-05-07T14:03:41.697712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.701578+0000","last_change":"2024-05-07T14:01:04.007712+0000","last_active":"2024-05-07T14:03:41.701578+0000","last_peered":"2024-05-07T14:03:41.701578+0000","last_clean":"2024-05-07T14:03:41.701578+0000","last_became_active":"2024-05-07T14:01:04.006934+0000","last_became_peered":"2024-05-07T14:01:04.006934+0000","last_unstale":"2024-05-07T14:03:41.701578+0000","last_undegraded":"2024-05-07T14:03:41.701578+0000","last_fullsized":"2024-05-07T14:03:41.701578+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100677+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:03:42.100677+0000","last_peered":"2024-05-07T14:03:42.100677+0000","last_clean":"2024-05-07T14:03:42.100677+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:03:42.100677+0000","last_undegraded":"2024-05-07T14:03:42.100677+0000","last_fullsized":"2024-05-07T14:03:42.100677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'2","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702434+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:03:41.702434+0000","last_peered":"2024-05-07T14:03:41.702434+0000","last_clean":"2024-05-07T14:03:41.702434+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:03:41.702434+0000","last_undegraded":"2024-05-07T14:03:41.702434+0000","last_fullsized":"2024-05-07T14:03:41.702434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695809+0000","last_change":"2024-05-07T14:03:39.661648+0000","last_active":"2024-05-07T14:03:41.695809+0000","last_peered":"2024-05-07T14:03:41.695809+0000","last_clean":"2024-05-07T14:03:41.695809+0000","last_became_active":"2024-05-07T14:03:39.660828+0000","last_became_peered":"2024-05-07T14:03:39.660828+0000","last_unstale":"2024-05-07T14:03:41.695809+0000","last_undegraded":"2024-05-07T14:03:41.695809+0000","last_fullsized":"2024-05-07T14:03:41.695809+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:55:55.161988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":170,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698566+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:03:41.698566+0000","last_peered":"2024-05-07T14:03:41.698566+0000","last_clean":"2024-05-07T14:03:41.698566+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:03:41.698566+0000","last_undegraded":"2024-05-07T14:03:41.698566+0000","last_fullsized":"2024-05-07T14:03:41.698566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698210+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:03:41.698210+0000","last_peered":"2024-05-07T14:03:41.698210+0000","last_clean":"2024-05-07T14:03:41.698210+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:03:41.698210+0000","last_undegraded":"2024-05-07T14:03:41.698210+0000","last_fullsized":"2024-05-07T14:03:41.698210+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"101'110","reported_seq":362,"reported_epoch":102,"state":"peering","last_fresh":"2024-05-07T14:03:40.790413+0000","last_change":"2024-05-07T14:03:42.630857+0000","last_active":"2024-05-07T14:03:42.630857+0000","last_peered":"2024-05-07T14:03:40.790413+0000","last_clean":"2024-05-07T14:03:30.102584+0000","last_became_active":"2024-05-07T14:03:40.773656+0000","last_became_peered":"2024-05-07T14:03:40.773656+0000","last_unstale":"2024-05-07T14:03:40.790413+0000","last_undegraded":"2024-05-07T14:03:40.790413+0000","last_fullsized":"2024-05-07T14:03:40.790413+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5457,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":148,"num_read_kb":136,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698407+0000","last_change":"2024-05-07T14:01:04.012527+0000","last_active":"2024-05-07T14:03:41.698407+0000","last_peered":"2024-05-07T14:03:41.698407+0000","last_clean":"2024-05-07T14:03:41.698407+0000","last_became_active":"2024-05-07T14:01:04.007658+0000","last_became_peered":"2024-05-07T14:01:04.007658+0000","last_unstale":"2024-05-07T14:03:41.698407+0000","last_undegraded":"2024-05-07T14:03:41.698407+0000","last_fullsized":"2024-05-07T14:03:41.698407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"80'4","reported_seq":156,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708582+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:03:41.708582+0000","last_peered":"2024-05-07T14:03:41.708582+0000","last_clean":"2024-05-07T14:03:41.708582+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:03:41.708582+0000","last_undegraded":"2024-05-07T14:03:41.708582+0000","last_fullsized":"2024-05-07T14:03:41.708582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"81'2","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708346+0000","last_change":"2024-05-07T14:03:39.711373+0000","last_active":"2024-05-07T14:03:41.708346+0000","last_peered":"2024-05-07T14:03:41.708346+0000","last_clean":"2024-05-07T14:03:41.708346+0000","last_became_active":"2024-05-07T14:03:39.667130+0000","last_became_peered":"2024-05-07T14:03:39.667130+0000","last_unstale":"2024-05-07T14:03:41.708346+0000","last_undegraded":"2024-05-07T14:03:41.708346+0000","last_fullsized":"2024-05-07T14:03:41.708346+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:36.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705272+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:03:41.705272+0000","last_peered":"2024-05-07T14:03:41.705272+0000","last_clean":"2024-05-07T14:03:41.705272+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:03:41.705272+0000","last_undegraded":"2024-05-07T14:03:41.705272+0000","last_fullsized":"2024-05-07T14:03:41.705272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"85'6","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709743+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:03:41.709743+0000","last_peered":"2024-05-07T14:03:41.709743+0000","last_clean":"2024-05-07T14:03:41.709743+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:03:41.709743+0000","last_undegraded":"2024-05-07T14:03:41.709743+0000","last_fullsized":"2024-05-07T14:03:41.709743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705436+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:03:41.705436+0000","last_peered":"2024-05-07T14:03:41.705436+0000","last_clean":"2024-05-07T14:03:41.705436+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:03:41.705436+0000","last_undegraded":"2024-05-07T14:03:41.705436+0000","last_fullsized":"2024-05-07T14:03:41.705436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":212,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699075+0000","last_change":"2024-05-07T14:01:02.148182+0000","last_active":"2024-05-07T14:03:41.699075+0000","last_peered":"2024-05-07T14:03:41.699075+0000","last_clean":"2024-05-07T14:03:41.699075+0000","last_became_active":"2024-05-07T14:01:02.147442+0000","last_became_peered":"2024-05-07T14:01:02.147442+0000","last_unstale":"2024-05-07T14:03:41.699075+0000","last_undegraded":"2024-05-07T14:03:41.699075+0000","last_fullsized":"2024-05-07T14:03:41.699075+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:24.955989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700363+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:03:41.700363+0000","last_peered":"2024-05-07T14:03:41.700363+0000","last_clean":"2024-05-07T14:03:41.700363+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:03:41.700363+0000","last_undegraded":"2024-05-07T14:03:41.700363+0000","last_fullsized":"2024-05-07T14:03:41.700363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711345+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:03:41.711345+0000","last_peered":"2024-05-07T14:03:41.711345+0000","last_clean":"2024-05-07T14:03:41.711345+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:03:41.711345+0000","last_undegraded":"2024-05-07T14:03:41.711345+0000","last_fullsized":"2024-05-07T14:03:41.711345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"81'4","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707687+0000","last_change":"2024-05-07T14:03:39.687600+0000","last_active":"2024-05-07T14:03:41.707687+0000","last_peered":"2024-05-07T14:03:41.707687+0000","last_clean":"2024-05-07T14:03:41.707687+0000","last_became_active":"2024-05-07T14:03:39.661295+0000","last_became_peered":"2024-05-07T14:03:39.661295+0000","last_unstale":"2024-05-07T14:03:41.707687+0000","last_undegraded":"2024-05-07T14:03:41.707687+0000","last_fullsized":"2024-05-07T14:03:41.707687+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:17:58.416324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697844+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:03:41.697844+0000","last_peered":"2024-05-07T14:03:41.697844+0000","last_clean":"2024-05-07T14:03:41.697844+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:03:41.697844+0000","last_undegraded":"2024-05-07T14:03:41.697844+0000","last_fullsized":"2024-05-07T14:03:41.697844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"85'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702966+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:03:41.702966+0000","last_peered":"2024-05-07T14:03:41.702966+0000","last_clean":"2024-05-07T14:03:41.702966+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:03:41.702966+0000","last_undegraded":"2024-05-07T14:03:41.702966+0000","last_fullsized":"2024-05-07T14:03:41.702966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698782+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:03:41.698782+0000","last_peered":"2024-05-07T14:03:41.698782+0000","last_clean":"2024-05-07T14:03:41.698782+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:03:41.698782+0000","last_undegraded":"2024-05-07T14:03:41.698782+0000","last_fullsized":"2024-05-07T14:03:41.698782+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710939+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:03:41.710939+0000","last_peered":"2024-05-07T14:03:41.710939+0000","last_clean":"2024-05-07T14:03:41.710939+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:03:41.710939+0000","last_undegraded":"2024-05-07T14:03:41.710939+0000","last_fullsized":"2024-05-07T14:03:41.710939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101592+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:03:42.101592+0000","last_peered":"2024-05-07T14:03:42.101592+0000","last_clean":"2024-05-07T14:03:42.101592+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:03:42.101592+0000","last_undegraded":"2024-05-07T14:03:42.101592+0000","last_fullsized":"2024-05-07T14:03:42.101592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695342+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:03:41.695342+0000","last_peered":"2024-05-07T14:03:41.695342+0000","last_clean":"2024-05-07T14:03:41.695342+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:03:41.695342+0000","last_undegraded":"2024-05-07T14:03:41.695342+0000","last_fullsized":"2024-05-07T14:03:41.695342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708520+0000","last_change":"2024-05-07T14:03:39.659916+0000","last_active":"2024-05-07T14:03:41.708520+0000","last_peered":"2024-05-07T14:03:41.708520+0000","last_clean":"2024-05-07T14:03:41.708520+0000","last_became_active":"2024-05-07T14:03:39.659515+0000","last_became_peered":"2024-05-07T14:03:39.659515+0000","last_unstale":"2024-05-07T14:03:41.708520+0000","last_undegraded":"2024-05-07T14:03:41.708520+0000","last_fullsized":"2024-05-07T14:03:41.708520+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:49:16.796937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698099+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:03:41.698099+0000","last_peered":"2024-05-07T14:03:41.698099+0000","last_clean":"2024-05-07T14:03:41.698099+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:03:41.698099+0000","last_undegraded":"2024-05-07T14:03:41.698099+0000","last_fullsized":"2024-05-07T14:03:41.698099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708058+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:03:41.708058+0000","last_peered":"2024-05-07T14:03:41.708058+0000","last_clean":"2024-05-07T14:03:41.708058+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:03:41.708058+0000","last_undegraded":"2024-05-07T14:03:41.708058+0000","last_fullsized":"2024-05-07T14:03:41.708058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699109+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:03:41.699109+0000","last_peered":"2024-05-07T14:03:41.699109+0000","last_clean":"2024-05-07T14:03:41.699109+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:03:41.699109+0000","last_undegraded":"2024-05-07T14:03:41.699109+0000","last_fullsized":"2024-05-07T14:03:41.699109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"85'29","reported_seq":201,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698321+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:03:41.698321+0000","last_peered":"2024-05-07T14:03:41.698321+0000","last_clean":"2024-05-07T14:03:41.698321+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:03:41.698321+0000","last_undegraded":"2024-05-07T14:03:41.698321+0000","last_fullsized":"2024-05-07T14:03:41.698321+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702991+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:03:41.702991+0000","last_peered":"2024-05-07T14:03:41.702991+0000","last_clean":"2024-05-07T14:03:41.702991+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:03:41.702991+0000","last_undegraded":"2024-05-07T14:03:41.702991+0000","last_fullsized":"2024-05-07T14:03:41.702991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700362+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:03:41.700362+0000","last_peered":"2024-05-07T14:03:41.700362+0000","last_clean":"2024-05-07T14:03:41.700362+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:03:41.700362+0000","last_undegraded":"2024-05-07T14:03:41.700362+0000","last_fullsized":"2024-05-07T14:03:41.700362+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700237+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:03:41.700237+0000","last_peered":"2024-05-07T14:03:41.700237+0000","last_clean":"2024-05-07T14:03:41.700237+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:03:41.700237+0000","last_undegraded":"2024-05-07T14:03:41.700237+0000","last_fullsized":"2024-05-07T14:03:41.700237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707833+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:03:41.707833+0000","last_peered":"2024-05-07T14:03:41.707833+0000","last_clean":"2024-05-07T14:03:41.707833+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:03:41.707833+0000","last_undegraded":"2024-05-07T14:03:41.707833+0000","last_fullsized":"2024-05-07T14:03:41.707833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699867+0000","last_change":"2024-05-07T14:00:49.928907+0000","last_active":"2024-05-07T14:03:41.699867+0000","last_peered":"2024-05-07T14:03:41.699867+0000","last_clean":"2024-05-07T14:03:41.699867+0000","last_became_active":"2024-05-07T14:00:49.928146+0000","last_became_peered":"2024-05-07T14:00:49.928146+0000","last_unstale":"2024-05-07T14:03:41.699867+0000","last_undegraded":"2024-05-07T14:03:41.699867+0000","last_fullsized":"2024-05-07T14:03:41.699867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:07.032835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101098+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:03:42.101098+0000","last_peered":"2024-05-07T14:03:42.101098+0000","last_clean":"2024-05-07T14:03:42.101098+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:03:42.101098+0000","last_undegraded":"2024-05-07T14:03:42.101098+0000","last_fullsized":"2024-05-07T14:03:42.101098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":30,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707747+0000","last_change":"2024-05-07T14:03:39.707679+0000","last_active":"2024-05-07T14:03:41.707747+0000","last_peered":"2024-05-07T14:03:41.707747+0000","last_clean":"2024-05-07T14:03:41.707747+0000","last_became_active":"2024-05-07T14:03:39.664751+0000","last_became_peered":"2024-05-07T14:03:39.664751+0000","last_unstale":"2024-05-07T14:03:41.707747+0000","last_undegraded":"2024-05-07T14:03:41.707747+0000","last_fullsized":"2024-05-07T14:03:41.707747+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:55.535011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"101'107","reported_seq":316,"reported_epoch":101,"state":"peering","last_fresh":"2024-05-07T14:03:40.797550+0000","last_change":"2024-05-07T14:03:41.696412+0000","last_active":"2024-05-07T14:03:41.696412+0000","last_peered":"2024-05-07T14:03:40.797550+0000","last_clean":"2024-05-07T14:03:37.624906+0000","last_became_active":"2024-05-07T14:03:40.773827+0000","last_became_peered":"2024-05-07T14:03:40.773827+0000","last_unstale":"2024-05-07T14:03:40.797550+0000","last_undegraded":"2024-05-07T14:03:40.797550+0000","last_fullsized":"2024-05-07T14:03:40.654026+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711764+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:03:41.711764+0000","last_peered":"2024-05-07T14:03:41.711764+0000","last_clean":"2024-05-07T14:03:41.711764+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:03:41.711764+0000","last_undegraded":"2024-05-07T14:03:41.711764+0000","last_fullsized":"2024-05-07T14:03:41.711764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711403+0000","last_change":"2024-05-07T14:00:57.998539+0000","last_active":"2024-05-07T14:03:41.711403+0000","last_peered":"2024-05-07T14:03:41.711403+0000","last_clean":"2024-05-07T14:03:41.711403+0000","last_became_active":"2024-05-07T14:00:57.998025+0000","last_became_peered":"2024-05-07T14:00:57.998025+0000","last_unstale":"2024-05-07T14:03:41.711403+0000","last_undegraded":"2024-05-07T14:03:41.711403+0000","last_fullsized":"2024-05-07T14:03:41.711403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711068+0000","last_change":"2024-05-07T14:00:55.988508+0000","last_active":"2024-05-07T14:03:41.711068+0000","last_peered":"2024-05-07T14:03:41.711068+0000","last_clean":"2024-05-07T14:03:41.711068+0000","last_became_active":"2024-05-07T14:00:55.988230+0000","last_became_peered":"2024-05-07T14:00:55.988230+0000","last_unstale":"2024-05-07T14:03:41.711068+0000","last_undegraded":"2024-05-07T14:03:41.711068+0000","last_fullsized":"2024-05-07T14:03:41.711068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708834+0000","last_change":"2024-05-07T14:03:39.672724+0000","last_active":"2024-05-07T14:03:41.708834+0000","last_peered":"2024-05-07T14:03:41.708834+0000","last_clean":"2024-05-07T14:03:41.708834+0000","last_became_active":"2024-05-07T14:03:39.671518+0000","last_became_peered":"2024-05-07T14:03:39.671518+0000","last_unstale":"2024-05-07T14:03:41.708834+0000","last_undegraded":"2024-05-07T14:03:41.708834+0000","last_fullsized":"2024-05-07T14:03:41.708834+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:25.485797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703264+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:03:41.703264+0000","last_peered":"2024-05-07T14:03:41.703264+0000","last_clean":"2024-05-07T14:03:41.703264+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:03:41.703264+0000","last_undegraded":"2024-05-07T14:03:41.703264+0000","last_fullsized":"2024-05-07T14:03:41.703264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703164+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:03:41.703164+0000","last_peered":"2024-05-07T14:03:41.703164+0000","last_clean":"2024-05-07T14:03:41.703164+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:03:41.703164+0000","last_undegraded":"2024-05-07T14:03:41.703164+0000","last_fullsized":"2024-05-07T14:03:41.703164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"94'104","reported_seq":329,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.714221+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:03:41.714221+0000","last_peered":"2024-05-07T14:03:41.714221+0000","last_clean":"2024-05-07T14:03:41.714221+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:03:41.714221+0000","last_undegraded":"2024-05-07T14:03:41.714221+0000","last_fullsized":"2024-05-07T14:03:41.714221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"81'3","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700621+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:03:41.700621+0000","last_peered":"2024-05-07T14:03:41.700621+0000","last_clean":"2024-05-07T14:03:41.700621+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:03:41.700621+0000","last_undegraded":"2024-05-07T14:03:41.700621+0000","last_fullsized":"2024-05-07T14:03:41.700621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703477+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:03:41.703477+0000","last_peered":"2024-05-07T14:03:41.703477+0000","last_clean":"2024-05-07T14:03:41.703477+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:03:41.703477+0000","last_undegraded":"2024-05-07T14:03:41.703477+0000","last_fullsized":"2024-05-07T14:03:41.703477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'5","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703093+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:03:41.703093+0000","last_peered":"2024-05-07T14:03:41.703093+0000","last_clean":"2024-05-07T14:03:41.703093+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:03:41.703093+0000","last_undegraded":"2024-05-07T14:03:41.703093+0000","last_fullsized":"2024-05-07T14:03:41.703093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101852+0000","last_change":"2024-05-07T14:00:49.938879+0000","last_active":"2024-05-07T14:03:42.101852+0000","last_peered":"2024-05-07T14:03:42.101852+0000","last_clean":"2024-05-07T14:03:42.101852+0000","last_became_active":"2024-05-07T14:00:49.938066+0000","last_became_peered":"2024-05-07T14:00:49.938066+0000","last_unstale":"2024-05-07T14:03:42.101852+0000","last_undegraded":"2024-05-07T14:03:42.101852+0000","last_fullsized":"2024-05-07T14:03:42.101852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711837+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:03:41.711837+0000","last_peered":"2024-05-07T14:03:41.711837+0000","last_clean":"2024-05-07T14:03:41.711837+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:03:41.711837+0000","last_undegraded":"2024-05-07T14:03:41.711837+0000","last_fullsized":"2024-05-07T14:03:41.711837+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"85'35","reported_seq":211,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698987+0000","last_change":"2024-05-07T14:01:02.148095+0000","last_active":"2024-05-07T14:03:41.698987+0000","last_peered":"2024-05-07T14:03:41.698987+0000","last_clean":"2024-05-07T14:03:41.698987+0000","last_became_active":"2024-05-07T14:01:02.147334+0000","last_became_peered":"2024-05-07T14:01:02.147334+0000","last_unstale":"2024-05-07T14:03:41.698987+0000","last_undegraded":"2024-05-07T14:03:41.698987+0000","last_fullsized":"2024-05-07T14:03:41.698987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":165,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710112+0000","last_change":"2024-05-07T14:03:39.665240+0000","last_active":"2024-05-07T14:03:41.710112+0000","last_peered":"2024-05-07T14:03:41.710112+0000","last_clean":"2024-05-07T14:03:41.710112+0000","last_became_active":"2024-05-07T14:03:39.664810+0000","last_became_peered":"2024-05-07T14:03:39.664810+0000","last_unstale":"2024-05-07T14:03:41.710112+0000","last_undegraded":"2024-05-07T14:03:41.710112+0000","last_fullsized":"2024-05-07T14:03:41.710112+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:18:01.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696662+0000","last_change":"2024-05-07T14:01:06.039788+0000","last_active":"2024-05-07T14:03:41.696662+0000","last_peered":"2024-05-07T14:03:41.696662+0000","last_clean":"2024-05-07T14:03:41.696662+0000","last_became_active":"2024-05-07T14:01:06.039050+0000","last_became_peered":"2024-05-07T14:01:06.039050+0000","last_unstale":"2024-05-07T14:03:41.696662+0000","last_undegraded":"2024-05-07T14:03:41.696662+0000","last_fullsized":"2024-05-07T14:03:41.696662+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699068+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:03:41.699068+0000","last_peered":"2024-05-07T14:03:41.699068+0000","last_clean":"2024-05-07T14:03:41.699068+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:03:41.699068+0000","last_undegraded":"2024-05-07T14:03:41.699068+0000","last_fullsized":"2024-05-07T14:03:41.699068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'8","reported_seq":203,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702599+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:03:41.702599+0000","last_peered":"2024-05-07T14:03:41.702599+0000","last_clean":"2024-05-07T14:03:41.702599+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:03:41.702599+0000","last_undegraded":"2024-05-07T14:03:41.702599+0000","last_fullsized":"2024-05-07T14:03:41.702599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"85'10","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702672+0000","last_change":"2024-05-07T14:00:55.991934+0000","last_active":"2024-05-07T14:03:41.702672+0000","last_peered":"2024-05-07T14:03:41.702672+0000","last_clean":"2024-05-07T14:03:41.702672+0000","last_became_active":"2024-05-07T14:00:55.991303+0000","last_became_peered":"2024-05-07T14:00:55.991303+0000","last_unstale":"2024-05-07T14:03:41.702672+0000","last_undegraded":"2024-05-07T14:03:41.702672+0000","last_fullsized":"2024-05-07T14:03:41.702672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709713+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:03:41.709713+0000","last_peered":"2024-05-07T14:03:41.709713+0000","last_clean":"2024-05-07T14:03:41.709713+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:03:41.709713+0000","last_undegraded":"2024-05-07T14:03:41.709713+0000","last_fullsized":"2024-05-07T14:03:41.709713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"85'17","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709926+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:03:41.709926+0000","last_peered":"2024-05-07T14:03:41.709926+0000","last_clean":"2024-05-07T14:03:41.709926+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:03:41.709926+0000","last_undegraded":"2024-05-07T14:03:41.709926+0000","last_fullsized":"2024-05-07T14:03:41.709926+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712038+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:03:41.712038+0000","last_peered":"2024-05-07T14:03:41.712038+0000","last_clean":"2024-05-07T14:03:41.712038+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:03:41.712038+0000","last_undegraded":"2024-05-07T14:03:41.712038+0000","last_fullsized":"2024-05-07T14:03:41.712038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710700+0000","last_change":"2024-05-07T14:01:06.013974+0000","last_active":"2024-05-07T14:03:41.710700+0000","last_peered":"2024-05-07T14:03:41.710700+0000","last_clean":"2024-05-07T14:03:41.710700+0000","last_became_active":"2024-05-07T14:01:06.013281+0000","last_became_peered":"2024-05-07T14:01:06.013281+0000","last_unstale":"2024-05-07T14:03:41.710700+0000","last_undegraded":"2024-05-07T14:03:41.710700+0000","last_fullsized":"2024-05-07T14:03:41.710700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:46.349394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"94'3","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708331+0000","last_change":"2024-05-07T14:03:39.692877+0000","last_active":"2024-05-07T14:03:41.708331+0000","last_peered":"2024-05-07T14:03:41.708331+0000","last_clean":"2024-05-07T14:03:41.708331+0000","last_became_active":"2024-05-07T14:03:39.663976+0000","last_became_peered":"2024-05-07T14:03:39.663976+0000","last_unstale":"2024-05-07T14:03:41.708331+0000","last_undegraded":"2024-05-07T14:03:41.708331+0000","last_fullsized":"2024-05-07T14:03:41.708331+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:36.548454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699404+0000","last_change":"2024-05-07T14:00:55.968287+0000","last_active":"2024-05-07T14:03:41.699404+0000","last_peered":"2024-05-07T14:03:41.699404+0000","last_clean":"2024-05-07T14:03:41.699404+0000","last_became_active":"2024-05-07T14:00:55.967578+0000","last_became_peered":"2024-05-07T14:00:55.967578+0000","last_unstale":"2024-05-07T14:03:41.699404+0000","last_undegraded":"2024-05-07T14:03:41.699404+0000","last_fullsized":"2024-05-07T14:03:41.699404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711159+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:03:41.711159+0000","last_peered":"2024-05-07T14:03:41.711159+0000","last_clean":"2024-05-07T14:03:41.711159+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:03:41.711159+0000","last_undegraded":"2024-05-07T14:03:41.711159+0000","last_fullsized":"2024-05-07T14:03:41.711159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"97'7","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697842+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:03:41.697842+0000","last_peered":"2024-05-07T14:03:41.697842+0000","last_clean":"2024-05-07T14:03:41.697842+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:03:41.697842+0000","last_undegraded":"2024-05-07T14:03:41.697842+0000","last_fullsized":"2024-05-07T14:03:41.697842+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":26,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696436+0000","last_change":"2024-05-07T14:01:04.012628+0000","last_active":"2024-05-07T14:03:41.696436+0000","last_peered":"2024-05-07T14:03:41.696436+0000","last_clean":"2024-05-07T14:03:41.696436+0000","last_became_active":"2024-05-07T14:01:04.011910+0000","last_became_peered":"2024-05-07T14:01:04.011910+0000","last_unstale":"2024-05-07T14:03:41.696436+0000","last_undegraded":"2024-05-07T14:03:41.696436+0000","last_fullsized":"2024-05-07T14:03:41.696436+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"94'1","reported_seq":153,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698734+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:03:41.698734+0000","last_peered":"2024-05-07T14:03:41.698734+0000","last_clean":"2024-05-07T14:03:41.698734+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:03:41.698734+0000","last_undegraded":"2024-05-07T14:03:41.698734+0000","last_fullsized":"2024-05-07T14:03:41.698734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"81'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712225+0000","last_change":"2024-05-07T14:00:57.999019+0000","last_active":"2024-05-07T14:03:41.712225+0000","last_peered":"2024-05-07T14:03:41.712225+0000","last_clean":"2024-05-07T14:03:41.712225+0000","last_became_active":"2024-05-07T14:00:57.998526+0000","last_became_peered":"2024-05-07T14:00:57.998526+0000","last_unstale":"2024-05-07T14:03:41.712225+0000","last_undegraded":"2024-05-07T14:03:41.712225+0000","last_fullsized":"2024-05-07T14:03:41.712225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"85'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698007+0000","last_change":"2024-05-07T14:00:55.999548+0000","last_active":"2024-05-07T14:03:41.698007+0000","last_peered":"2024-05-07T14:03:41.698007+0000","last_clean":"2024-05-07T14:03:41.698007+0000","last_became_active":"2024-05-07T14:00:55.995284+0000","last_became_peered":"2024-05-07T14:00:55.995284+0000","last_unstale":"2024-05-07T14:03:41.698007+0000","last_undegraded":"2024-05-07T14:03:41.698007+0000","last_fullsized":"2024-05-07T14:03:41.698007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.694737+0000","last_change":"2024-05-07T14:00:59.996971+0000","last_active":"2024-05-07T14:03:41.694737+0000","last_peered":"2024-05-07T14:03:41.694737+0000","last_clean":"2024-05-07T14:03:41.694737+0000","last_became_active":"2024-05-07T14:00:59.996254+0000","last_became_peered":"2024-05-07T14:00:59.996254+0000","last_unstale":"2024-05-07T14:03:41.694737+0000","last_undegraded":"2024-05-07T14:03:41.694737+0000","last_fullsized":"2024-05-07T14:03:41.694737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"85'17","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710995+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:03:41.710995+0000","last_peered":"2024-05-07T14:03:41.710995+0000","last_clean":"2024-05-07T14:03:41.710995+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:03:41.710995+0000","last_undegraded":"2024-05-07T14:03:41.710995+0000","last_fullsized":"2024-05-07T14:03:41.710995+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100947+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:03:42.100947+0000","last_peered":"2024-05-07T14:03:42.100947+0000","last_clean":"2024-05-07T14:03:42.100947+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:03:42.100947+0000","last_undegraded":"2024-05-07T14:03:42.100947+0000","last_fullsized":"2024-05-07T14:03:42.100947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696828+0000","last_change":"2024-05-07T14:01:06.038138+0000","last_active":"2024-05-07T14:03:41.696828+0000","last_peered":"2024-05-07T14:03:41.696828+0000","last_clean":"2024-05-07T14:03:41.696828+0000","last_became_active":"2024-05-07T14:01:06.030966+0000","last_became_peered":"2024-05-07T14:01:06.030966+0000","last_unstale":"2024-05-07T14:03:41.696828+0000","last_undegraded":"2024-05-07T14:03:41.696828+0000","last_fullsized":"2024-05-07T14:03:41.696828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":31,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695687+0000","last_change":"2024-05-07T14:03:39.677172+0000","last_active":"2024-05-07T14:03:41.695687+0000","last_peered":"2024-05-07T14:03:41.695687+0000","last_clean":"2024-05-07T14:03:41.695687+0000","last_became_active":"2024-05-07T14:03:39.663090+0000","last_became_peered":"2024-05-07T14:03:39.663090+0000","last_unstale":"2024-05-07T14:03:41.695687+0000","last_undegraded":"2024-05-07T14:03:41.695687+0000","last_fullsized":"2024-05-07T14:03:41.695687+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:56.826421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"85'2","reported_seq":121,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.707665+0000","last_change":"2024-05-07T14:01:37.318408+0000","last_active":"2024-05-07T14:03:41.707665+0000","last_peered":"2024-05-07T14:03:41.707665+0000","last_clean":"2024-05-07T14:03:41.707665+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:03:41.707665+0000","last_undegraded":"2024-05-07T14:03:41.707665+0000","last_fullsized":"2024-05-07T14:03:41.707665+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:43.643434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100979+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:03:42.100979+0000","last_peered":"2024-05-07T14:03:42.100979+0000","last_clean":"2024-05-07T14:03:42.100979+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:03:42.100979+0000","last_undegraded":"2024-05-07T14:03:42.100979+0000","last_fullsized":"2024-05-07T14:03:42.100979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"85'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696211+0000","last_change":"2024-05-07T14:01:01.995377+0000","last_active":"2024-05-07T14:03:41.696211+0000","last_peered":"2024-05-07T14:03:41.696211+0000","last_clean":"2024-05-07T14:03:41.696211+0000","last_became_active":"2024-05-07T14:01:01.994566+0000","last_became_peered":"2024-05-07T14:01:01.994566+0000","last_unstale":"2024-05-07T14:03:41.696211+0000","last_undegraded":"2024-05-07T14:03:41.696211+0000","last_fullsized":"2024-05-07T14:03:41.696211+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698075+0000","last_change":"2024-05-07T14:01:03.997116+0000","last_active":"2024-05-07T14:03:41.698075+0000","last_peered":"2024-05-07T14:03:41.698075+0000","last_clean":"2024-05-07T14:03:41.698075+0000","last_became_active":"2024-05-07T14:01:03.996555+0000","last_became_peered":"2024-05-07T14:01:03.996555+0000","last_unstale":"2024-05-07T14:03:41.698075+0000","last_undegraded":"2024-05-07T14:03:41.698075+0000","last_fullsized":"2024-05-07T14:03:41.698075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101792+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:03:42.101792+0000","last_peered":"2024-05-07T14:03:42.101792+0000","last_clean":"2024-05-07T14:03:42.101792+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:03:42.101792+0000","last_undegraded":"2024-05-07T14:03:42.101792+0000","last_fullsized":"2024-05-07T14:03:42.101792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'4","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711005+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:03:41.711005+0000","last_peered":"2024-05-07T14:03:41.711005+0000","last_clean":"2024-05-07T14:03:41.711005+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:03:41.711005+0000","last_undegraded":"2024-05-07T14:03:41.711005+0000","last_fullsized":"2024-05-07T14:03:41.711005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.701797+0000","last_change":"2024-05-07T14:00:59.995694+0000","last_active":"2024-05-07T14:03:41.701797+0000","last_peered":"2024-05-07T14:03:41.701797+0000","last_clean":"2024-05-07T14:03:41.701797+0000","last_became_active":"2024-05-07T14:00:59.993899+0000","last_became_peered":"2024-05-07T14:00:59.993899+0000","last_unstale":"2024-05-07T14:03:41.701797+0000","last_undegraded":"2024-05-07T14:03:41.701797+0000","last_fullsized":"2024-05-07T14:03:41.701797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:28.225348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"85'22","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708951+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:03:41.708951+0000","last_peered":"2024-05-07T14:03:41.708951+0000","last_clean":"2024-05-07T14:03:41.708951+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:03:41.708951+0000","last_undegraded":"2024-05-07T14:03:41.708951+0000","last_fullsized":"2024-05-07T14:03:41.708951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697037+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:03:41.697037+0000","last_peered":"2024-05-07T14:03:41.697037+0000","last_clean":"2024-05-07T14:03:41.697037+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:03:41.697037+0000","last_undegraded":"2024-05-07T14:03:41.697037+0000","last_fullsized":"2024-05-07T14:03:41.697037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"81'2","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710468+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:03:41.710468+0000","last_peered":"2024-05-07T14:03:41.710468+0000","last_clean":"2024-05-07T14:03:41.710468+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:03:41.710468+0000","last_undegraded":"2024-05-07T14:03:41.710468+0000","last_fullsized":"2024-05-07T14:03:41.710468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"87'6","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702182+0000","last_change":"2024-05-07T14:00:57.995989+0000","last_active":"2024-05-07T14:03:41.702182+0000","last_peered":"2024-05-07T14:03:41.702182+0000","last_clean":"2024-05-07T14:03:41.702182+0000","last_became_active":"2024-05-07T14:00:57.995721+0000","last_became_peered":"2024-05-07T14:00:57.995721+0000","last_unstale":"2024-05-07T14:03:41.702182+0000","last_undegraded":"2024-05-07T14:03:41.702182+0000","last_fullsized":"2024-05-07T14:03:41.702182+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'2","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710712+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:03:41.710712+0000","last_peered":"2024-05-07T14:03:41.710712+0000","last_clean":"2024-05-07T14:03:41.710712+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:03:41.710712+0000","last_undegraded":"2024-05-07T14:03:41.710712+0000","last_fullsized":"2024-05-07T14:03:41.710712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101681+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:03:42.101681+0000","last_peered":"2024-05-07T14:03:42.101681+0000","last_clean":"2024-05-07T14:03:42.101681+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:03:42.101681+0000","last_undegraded":"2024-05-07T14:03:42.101681+0000","last_fullsized":"2024-05-07T14:03:42.101681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"85'20","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700402+0000","last_change":"2024-05-07T14:01:02.002384+0000","last_active":"2024-05-07T14:03:41.700402+0000","last_peered":"2024-05-07T14:03:41.700402+0000","last_clean":"2024-05-07T14:03:41.700402+0000","last_became_active":"2024-05-07T14:01:02.001676+0000","last_became_peered":"2024-05-07T14:01:02.001676+0000","last_unstale":"2024-05-07T14:03:41.700402+0000","last_undegraded":"2024-05-07T14:03:41.700402+0000","last_fullsized":"2024-05-07T14:03:41.700402+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709218+0000","last_change":"2024-05-07T14:03:39.667564+0000","last_active":"2024-05-07T14:03:41.709218+0000","last_peered":"2024-05-07T14:03:41.709218+0000","last_clean":"2024-05-07T14:03:41.709218+0000","last_became_active":"2024-05-07T14:03:39.666888+0000","last_became_peered":"2024-05-07T14:03:39.666888+0000","last_unstale":"2024-05-07T14:03:41.709218+0000","last_undegraded":"2024-05-07T14:03:41.709218+0000","last_fullsized":"2024-05-07T14:03:41.709218+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:33.367980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100771+0000","last_change":"2024-05-07T14:01:06.025917+0000","last_active":"2024-05-07T14:03:42.100771+0000","last_peered":"2024-05-07T14:03:42.100771+0000","last_clean":"2024-05-07T14:03:42.100771+0000","last_became_active":"2024-05-07T14:01:06.025044+0000","last_became_peered":"2024-05-07T14:01:06.025044+0000","last_unstale":"2024-05-07T14:03:42.100771+0000","last_undegraded":"2024-05-07T14:03:42.100771+0000","last_fullsized":"2024-05-07T14:03:42.100771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:55.419668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"81'4","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710545+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:03:41.710545+0000","last_peered":"2024-05-07T14:03:41.710545+0000","last_clean":"2024-05-07T14:03:41.710545+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:03:41.710545+0000","last_undegraded":"2024-05-07T14:03:41.710545+0000","last_fullsized":"2024-05-07T14:03:41.710545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"85'8","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703505+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:03:41.703505+0000","last_peered":"2024-05-07T14:03:41.703505+0000","last_clean":"2024-05-07T14:03:41.703505+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:03:41.703505+0000","last_undegraded":"2024-05-07T14:03:41.703505+0000","last_fullsized":"2024-05-07T14:03:41.703505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703456+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:03:41.703456+0000","last_peered":"2024-05-07T14:03:41.703456+0000","last_clean":"2024-05-07T14:03:41.703456+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:03:41.703456+0000","last_undegraded":"2024-05-07T14:03:41.703456+0000","last_fullsized":"2024-05-07T14:03:41.703456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"85'16","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712670+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:03:41.712670+0000","last_peered":"2024-05-07T14:03:41.712670+0000","last_clean":"2024-05-07T14:03:41.712670+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:03:41.712670+0000","last_undegraded":"2024-05-07T14:03:41.712670+0000","last_fullsized":"2024-05-07T14:03:41.712670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709246+0000","last_change":"2024-05-07T14:03:39.664184+0000","last_active":"2024-05-07T14:03:41.709246+0000","last_peered":"2024-05-07T14:03:41.709246+0000","last_clean":"2024-05-07T14:03:41.709246+0000","last_became_active":"2024-05-07T14:03:39.663569+0000","last_became_peered":"2024-05-07T14:03:39.663569+0000","last_unstale":"2024-05-07T14:03:41.709246+0000","last_undegraded":"2024-05-07T14:03:41.709246+0000","last_fullsized":"2024-05-07T14:03:41.709246+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:51.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696331+0000","last_change":"2024-05-07T14:01:06.038979+0000","last_active":"2024-05-07T14:03:41.696331+0000","last_peered":"2024-05-07T14:03:41.696331+0000","last_clean":"2024-05-07T14:03:41.696331+0000","last_became_active":"2024-05-07T14:01:06.035737+0000","last_became_peered":"2024-05-07T14:01:06.035737+0000","last_unstale":"2024-05-07T14:03:41.696331+0000","last_undegraded":"2024-05-07T14:03:41.696331+0000","last_fullsized":"2024-05-07T14:03:41.696331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"87'8","reported_seq":201,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706335+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:03:41.706335+0000","last_peered":"2024-05-07T14:03:41.706335+0000","last_clean":"2024-05-07T14:03:41.706335+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:03:41.706335+0000","last_undegraded":"2024-05-07T14:03:41.706335+0000","last_fullsized":"2024-05-07T14:03:41.706335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"85'5","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698263+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:03:41.698263+0000","last_peered":"2024-05-07T14:03:41.698263+0000","last_clean":"2024-05-07T14:03:41.698263+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:03:41.698263+0000","last_undegraded":"2024-05-07T14:03:41.698263+0000","last_fullsized":"2024-05-07T14:03:41.698263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709405+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:03:41.709405+0000","last_peered":"2024-05-07T14:03:41.709405+0000","last_clean":"2024-05-07T14:03:41.709405+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:03:41.709405+0000","last_undegraded":"2024-05-07T14:03:41.709405+0000","last_fullsized":"2024-05-07T14:03:41.709405+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703916+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:03:41.703916+0000","last_peered":"2024-05-07T14:03:41.703916+0000","last_clean":"2024-05-07T14:03:41.703916+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:03:41.703916+0000","last_undegraded":"2024-05-07T14:03:41.703916+0000","last_fullsized":"2024-05-07T14:03:41.703916+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"94'104","reported_seq":368,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101355+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:03:42.101355+0000","last_peered":"2024-05-07T14:03:42.101355+0000","last_clean":"2024-05-07T14:03:42.101355+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:03:42.101355+0000","last_undegraded":"2024-05-07T14:03:42.101355+0000","last_fullsized":"2024-05-07T14:03:42.101355+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"81'7","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.694712+0000","last_change":"2024-05-07T14:01:06.037755+0000","last_active":"2024-05-07T14:03:41.694712+0000","last_peered":"2024-05-07T14:03:41.694712+0000","last_clean":"2024-05-07T14:03:41.694712+0000","last_became_active":"2024-05-07T14:01:06.037156+0000","last_became_peered":"2024-05-07T14:01:06.037156+0000","last_unstale":"2024-05-07T14:03:41.694712+0000","last_undegraded":"2024-05-07T14:03:41.694712+0000","last_fullsized":"2024-05-07T14:03:41.694712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:30.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"94'5","reported_seq":187,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702580+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:03:41.702580+0000","last_peered":"2024-05-07T14:03:41.702580+0000","last_clean":"2024-05-07T14:03:41.702580+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:03:41.702580+0000","last_undegraded":"2024-05-07T14:03:41.702580+0000","last_fullsized":"2024-05-07T14:03:41.702580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":171,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697272+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:03:41.697272+0000","last_peered":"2024-05-07T14:03:41.697272+0000","last_clean":"2024-05-07T14:03:41.697272+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:03:41.697272+0000","last_undegraded":"2024-05-07T14:03:41.697272+0000","last_fullsized":"2024-05-07T14:03:41.697272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696319+0000","last_change":"2024-05-07T14:00:59.998197+0000","last_active":"2024-05-07T14:03:41.696319+0000","last_peered":"2024-05-07T14:03:41.696319+0000","last_clean":"2024-05-07T14:03:41.696319+0000","last_became_active":"2024-05-07T14:00:59.997438+0000","last_became_peered":"2024-05-07T14:00:59.997438+0000","last_unstale":"2024-05-07T14:03:41.696319+0000","last_undegraded":"2024-05-07T14:03:41.696319+0000","last_fullsized":"2024-05-07T14:03:41.696319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:29.430229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"85'20","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696519+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:03:41.696519+0000","last_peered":"2024-05-07T14:03:41.696519+0000","last_clean":"2024-05-07T14:03:41.696519+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:03:41.696519+0000","last_undegraded":"2024-05-07T14:03:41.696519+0000","last_fullsized":"2024-05-07T14:03:41.696519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697304+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:03:41.697304+0000","last_peered":"2024-05-07T14:03:41.697304+0000","last_clean":"2024-05-07T14:03:41.697304+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:03:41.697304+0000","last_undegraded":"2024-05-07T14:03:41.697304+0000","last_fullsized":"2024-05-07T14:03:41.697304+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"81'3","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699423+0000","last_change":"2024-05-07T14:01:06.025913+0000","last_active":"2024-05-07T14:03:41.699423+0000","last_peered":"2024-05-07T14:03:41.699423+0000","last_clean":"2024-05-07T14:03:41.699423+0000","last_became_active":"2024-05-07T14:01:06.025220+0000","last_became_peered":"2024-05-07T14:01:06.025220+0000","last_unstale":"2024-05-07T14:03:41.699423+0000","last_undegraded":"2024-05-07T14:03:41.699423+0000","last_fullsized":"2024-05-07T14:03:41.699423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:30.164745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703250+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:03:41.703250+0000","last_peered":"2024-05-07T14:03:41.703250+0000","last_clean":"2024-05-07T14:03:41.703250+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:03:41.703250+0000","last_undegraded":"2024-05-07T14:03:41.703250+0000","last_fullsized":"2024-05-07T14:03:41.703250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"85'5","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697829+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:03:41.697829+0000","last_peered":"2024-05-07T14:03:41.697829+0000","last_clean":"2024-05-07T14:03:41.697829+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:03:41.697829+0000","last_undegraded":"2024-05-07T14:03:41.697829+0000","last_fullsized":"2024-05-07T14:03:41.697829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":15,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697226+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:03:41.697226+0000","last_peered":"2024-05-07T14:03:41.697226+0000","last_clean":"2024-05-07T14:03:41.697226+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:03:41.697226+0000","last_undegraded":"2024-05-07T14:03:41.697226+0000","last_fullsized":"2024-05-07T14:03:41.697226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"85'14","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697325+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:03:41.697325+0000","last_peered":"2024-05-07T14:03:41.697325+0000","last_clean":"2024-05-07T14:03:41.697325+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:03:41.697325+0000","last_undegraded":"2024-05-07T14:03:41.697325+0000","last_fullsized":"2024-05-07T14:03:41.697325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100752+0000","last_change":"2024-05-07T14:01:04.017099+0000","last_active":"2024-05-07T14:03:42.100752+0000","last_peered":"2024-05-07T14:03:42.100752+0000","last_clean":"2024-05-07T14:03:42.100752+0000","last_became_active":"2024-05-07T14:01:04.011036+0000","last_became_peered":"2024-05-07T14:01:04.011036+0000","last_unstale":"2024-05-07T14:03:42.100752+0000","last_undegraded":"2024-05-07T14:03:42.100752+0000","last_fullsized":"2024-05-07T14:03:42.100752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:32.242974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.710778+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:03:41.710778+0000","last_peered":"2024-05-07T14:03:41.710778+0000","last_clean":"2024-05-07T14:03:41.710778+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:03:41.710778+0000","last_undegraded":"2024-05-07T14:03:41.710778+0000","last_fullsized":"2024-05-07T14:03:41.710778+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"87'6","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712440+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:03:41.712440+0000","last_peered":"2024-05-07T14:03:41.712440+0000","last_clean":"2024-05-07T14:03:41.712440+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:03:41.712440+0000","last_undegraded":"2024-05-07T14:03:41.712440+0000","last_fullsized":"2024-05-07T14:03:41.712440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.713016+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:03:41.713016+0000","last_peered":"2024-05-07T14:03:41.713016+0000","last_clean":"2024-05-07T14:03:41.713016+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:03:41.713016+0000","last_undegraded":"2024-05-07T14:03:41.713016+0000","last_fullsized":"2024-05-07T14:03:41.713016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702067+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:03:41.702067+0000","last_peered":"2024-05-07T14:03:41.702067+0000","last_clean":"2024-05-07T14:03:41.702067+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:03:41.702067+0000","last_undegraded":"2024-05-07T14:03:41.702067+0000","last_fullsized":"2024-05-07T14:03:41.702067+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"85'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.714133+0000","last_change":"2024-05-07T14:01:02.013617+0000","last_active":"2024-05-07T14:03:41.714133+0000","last_peered":"2024-05-07T14:03:41.714133+0000","last_clean":"2024-05-07T14:03:41.714133+0000","last_became_active":"2024-05-07T14:01:02.009243+0000","last_became_peered":"2024-05-07T14:01:02.009243+0000","last_unstale":"2024-05-07T14:03:41.714133+0000","last_undegraded":"2024-05-07T14:03:41.714133+0000","last_fullsized":"2024-05-07T14:03:41.714133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702284+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:03:41.702284+0000","last_peered":"2024-05-07T14:03:41.702284+0000","last_clean":"2024-05-07T14:03:41.702284+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:03:41.702284+0000","last_undegraded":"2024-05-07T14:03:41.702284+0000","last_fullsized":"2024-05-07T14:03:41.702284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"81'8","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698993+0000","last_change":"2024-05-07T14:03:39.823293+0000","last_active":"2024-05-07T14:03:41.698993+0000","last_peered":"2024-05-07T14:03:41.698993+0000","last_clean":"2024-05-07T14:03:41.698993+0000","last_became_active":"2024-05-07T14:03:39.673703+0000","last_became_peered":"2024-05-07T14:03:39.673703+0000","last_unstale":"2024-05-07T14:03:41.698993+0000","last_undegraded":"2024-05-07T14:03:41.698993+0000","last_fullsized":"2024-05-07T14:03:41.698993+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:21.776655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"81'6","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702345+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:03:41.702345+0000","last_peered":"2024-05-07T14:03:41.702345+0000","last_clean":"2024-05-07T14:03:41.702345+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:03:41.702345+0000","last_undegraded":"2024-05-07T14:03:41.702345+0000","last_fullsized":"2024-05-07T14:03:41.702345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"85'2","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.700096+0000","last_change":"2024-05-07T14:01:37.554242+0000","last_active":"2024-05-07T14:03:41.700096+0000","last_peered":"2024-05-07T14:03:41.700096+0000","last_clean":"2024-05-07T14:03:41.700096+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:03:41.700096+0000","last_undegraded":"2024-05-07T14:03:41.700096+0000","last_fullsized":"2024-05-07T14:03:41.700096+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:16:22.149514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708033+0000","last_change":"2024-05-07T14:03:39.674947+0000","last_active":"2024-05-07T14:03:41.708033+0000","last_peered":"2024-05-07T14:03:41.708033+0000","last_clean":"2024-05-07T14:03:41.708033+0000","last_became_active":"2024-05-07T14:03:39.659887+0000","last_became_peered":"2024-05-07T14:03:39.659887+0000","last_unstale":"2024-05-07T14:03:41.708033+0000","last_undegraded":"2024-05-07T14:03:41.708033+0000","last_fullsized":"2024-05-07T14:03:41.708033+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:18:06.217561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"85'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.702235+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:03:41.702235+0000","last_peered":"2024-05-07T14:03:41.702235+0000","last_clean":"2024-05-07T14:03:41.702235+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:03:41.702235+0000","last_undegraded":"2024-05-07T14:03:41.702235+0000","last_fullsized":"2024-05-07T14:03:41.702235+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697792+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:03:41.697792+0000","last_peered":"2024-05-07T14:03:41.697792+0000","last_clean":"2024-05-07T14:03:41.697792+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:03:41.697792+0000","last_undegraded":"2024-05-07T14:03:41.697792+0000","last_fullsized":"2024-05-07T14:03:41.697792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703550+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:03:41.703550+0000","last_peered":"2024-05-07T14:03:41.703550+0000","last_clean":"2024-05-07T14:03:41.703550+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:03:41.703550+0000","last_undegraded":"2024-05-07T14:03:41.703550+0000","last_fullsized":"2024-05-07T14:03:41.703550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"87'16","reported_seq":24,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708646+0000","last_change":"2024-05-07T14:03:39.799013+0000","last_active":"2024-05-07T14:03:41.708646+0000","last_peered":"2024-05-07T14:03:41.708646+0000","last_clean":"2024-05-07T14:03:41.708646+0000","last_became_active":"2024-05-07T14:03:39.671068+0000","last_became_peered":"2024-05-07T14:03:39.671068+0000","last_unstale":"2024-05-07T14:03:41.708646+0000","last_undegraded":"2024-05-07T14:03:41.708646+0000","last_fullsized":"2024-05-07T14:03:41.708646+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:13.746128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"85'6","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100889+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:03:42.100889+0000","last_peered":"2024-05-07T14:03:42.100889+0000","last_clean":"2024-05-07T14:03:42.100889+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:03:42.100889+0000","last_undegraded":"2024-05-07T14:03:42.100889+0000","last_fullsized":"2024-05-07T14:03:42.100889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709023+0000","last_change":"2024-05-07T14:03:39.661724+0000","last_active":"2024-05-07T14:03:41.709023+0000","last_peered":"2024-05-07T14:03:41.709023+0000","last_clean":"2024-05-07T14:03:41.709023+0000","last_became_active":"2024-05-07T14:03:39.661339+0000","last_became_peered":"2024-05-07T14:03:39.661339+0000","last_unstale":"2024-05-07T14:03:41.709023+0000","last_undegraded":"2024-05-07T14:03:41.709023+0000","last_fullsized":"2024-05-07T14:03:41.709023+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:34.633849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"85'3","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704970+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:03:41.704970+0000","last_peered":"2024-05-07T14:03:41.704970+0000","last_clean":"2024-05-07T14:03:41.704970+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:03:41.704970+0000","last_undegraded":"2024-05-07T14:03:41.704970+0000","last_fullsized":"2024-05-07T14:03:41.704970+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:01.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"81'6","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697154+0000","last_change":"2024-05-07T14:00:57.985233+0000","last_active":"2024-05-07T14:03:41.697154+0000","last_peered":"2024-05-07T14:03:41.697154+0000","last_clean":"2024-05-07T14:03:41.697154+0000","last_became_active":"2024-05-07T14:00:57.984523+0000","last_became_peered":"2024-05-07T14:00:57.984523+0000","last_unstale":"2024-05-07T14:03:41.697154+0000","last_undegraded":"2024-05-07T14:03:41.697154+0000","last_fullsized":"2024-05-07T14:03:41.697154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"85'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696656+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:03:41.696656+0000","last_peered":"2024-05-07T14:03:41.696656+0000","last_clean":"2024-05-07T14:03:41.696656+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:03:41.696656+0000","last_undegraded":"2024-05-07T14:03:41.696656+0000","last_fullsized":"2024-05-07T14:03:41.696656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"81'2","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.708007+0000","last_change":"2024-05-07T14:03:39.791330+0000","last_active":"2024-05-07T14:03:41.708007+0000","last_peered":"2024-05-07T14:03:41.708007+0000","last_clean":"2024-05-07T14:03:41.708007+0000","last_became_active":"2024-05-07T14:03:39.670031+0000","last_became_peered":"2024-05-07T14:03:39.670031+0000","last_unstale":"2024-05-07T14:03:41.708007+0000","last_undegraded":"2024-05-07T14:03:41.708007+0000","last_fullsized":"2024-05-07T14:03:41.708007+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:03.214247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"85'2","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698825+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:03:41.698825+0000","last_peered":"2024-05-07T14:03:41.698825+0000","last_clean":"2024-05-07T14:03:41.698825+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:03:41.698825+0000","last_undegraded":"2024-05-07T14:03:41.698825+0000","last_fullsized":"2024-05-07T14:03:41.698825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.714060+0000","last_change":"2024-05-07T14:00:57.998054+0000","last_active":"2024-05-07T14:03:41.714060+0000","last_peered":"2024-05-07T14:03:41.714060+0000","last_clean":"2024-05-07T14:03:41.714060+0000","last_became_active":"2024-05-07T14:00:57.997750+0000","last_became_peered":"2024-05-07T14:00:57.997750+0000","last_unstale":"2024-05-07T14:03:41.714060+0000","last_undegraded":"2024-05-07T14:03:41.714060+0000","last_fullsized":"2024-05-07T14:03:41.714060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712354+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:03:41.712354+0000","last_peered":"2024-05-07T14:03:41.712354+0000","last_clean":"2024-05-07T14:03:41.712354+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:03:41.712354+0000","last_undegraded":"2024-05-07T14:03:41.712354+0000","last_fullsized":"2024-05-07T14:03:41.712354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703351+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:03:41.703351+0000","last_peered":"2024-05-07T14:03:41.703351+0000","last_clean":"2024-05-07T14:03:41.703351+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:03:41.703351+0000","last_undegraded":"2024-05-07T14:03:41.703351+0000","last_fullsized":"2024-05-07T14:03:41.703351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"85'3","reported_seq":22,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.709662+0000","last_change":"2024-05-07T14:03:39.789159+0000","last_active":"2024-05-07T14:03:41.709662+0000","last_peered":"2024-05-07T14:03:41.709662+0000","last_clean":"2024-05-07T14:03:41.709662+0000","last_became_active":"2024-05-07T14:03:39.668790+0000","last_became_peered":"2024-05-07T14:03:39.668790+0000","last_unstale":"2024-05-07T14:03:41.709662+0000","last_undegraded":"2024-05-07T14:03:41.709662+0000","last_fullsized":"2024-05-07T14:03:41.709662+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:14.798045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"81'8","reported_seq":232,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712234+0000","last_change":"2024-05-07T14:03:39.855375+0000","last_active":"2024-05-07T14:03:41.712234+0000","last_peered":"2024-05-07T14:03:41.712234+0000","last_clean":"2024-05-07T14:03:41.712234+0000","last_became_active":"2024-05-07T14:03:39.666451+0000","last_became_peered":"2024-05-07T14:03:39.666451+0000","last_unstale":"2024-05-07T14:03:41.712234+0000","last_undegraded":"2024-05-07T14:03:41.712234+0000","last_fullsized":"2024-05-07T14:03:41.712234+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:37.171990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'6","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101388+0000","last_change":"2024-05-07T14:00:55.997287+0000","last_active":"2024-05-07T14:03:42.101388+0000","last_peered":"2024-05-07T14:03:42.101388+0000","last_clean":"2024-05-07T14:03:42.101388+0000","last_became_active":"2024-05-07T14:00:55.996467+0000","last_became_peered":"2024-05-07T14:00:55.996467+0000","last_unstale":"2024-05-07T14:03:42.101388+0000","last_undegraded":"2024-05-07T14:03:42.101388+0000","last_fullsized":"2024-05-07T14:03:42.101388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.100692+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:03:42.100692+0000","last_peered":"2024-05-07T14:03:42.100692+0000","last_clean":"2024-05-07T14:03:42.100692+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:03:42.100692+0000","last_undegraded":"2024-05-07T14:03:42.100692+0000","last_fullsized":"2024-05-07T14:03:42.100692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711422+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:03:41.711422+0000","last_peered":"2024-05-07T14:03:41.711422+0000","last_clean":"2024-05-07T14:03:41.711422+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:03:41.711422+0000","last_undegraded":"2024-05-07T14:03:41.711422+0000","last_fullsized":"2024-05-07T14:03:41.711422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"94'1","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699812+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:03:41.699812+0000","last_peered":"2024-05-07T14:03:41.699812+0000","last_clean":"2024-05-07T14:03:41.699812+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:03:41.699812+0000","last_undegraded":"2024-05-07T14:03:41.699812+0000","last_fullsized":"2024-05-07T14:03:41.699812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"85'7","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697033+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:03:41.697033+0000","last_peered":"2024-05-07T14:03:41.697033+0000","last_clean":"2024-05-07T14:03:41.697033+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:03:41.697033+0000","last_undegraded":"2024-05-07T14:03:41.697033+0000","last_fullsized":"2024-05-07T14:03:41.697033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.704144+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:03:41.704144+0000","last_peered":"2024-05-07T14:03:41.704144+0000","last_clean":"2024-05-07T14:03:41.704144+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:03:41.704144+0000","last_undegraded":"2024-05-07T14:03:41.704144+0000","last_fullsized":"2024-05-07T14:03:41.704144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"85'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.712521+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:03:41.712521+0000","last_peered":"2024-05-07T14:03:41.712521+0000","last_clean":"2024-05-07T14:03:41.712521+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:03:41.712521+0000","last_undegraded":"2024-05-07T14:03:41.712521+0000","last_fullsized":"2024-05-07T14:03:41.712521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"94'3","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.705675+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:03:41.705675+0000","last_peered":"2024-05-07T14:03:41.705675+0000","last_clean":"2024-05-07T14:03:41.705675+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:03:41.705675+0000","last_undegraded":"2024-05-07T14:03:41.705675+0000","last_fullsized":"2024-05-07T14:03:41.705675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"85'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696553+0000","last_change":"2024-05-07T14:00:56.001135+0000","last_active":"2024-05-07T14:03:41.696553+0000","last_peered":"2024-05-07T14:03:41.696553+0000","last_clean":"2024-05-07T14:03:41.696553+0000","last_became_active":"2024-05-07T14:00:55.999884+0000","last_became_peered":"2024-05-07T14:00:55.999884+0000","last_unstale":"2024-05-07T14:03:41.696553+0000","last_undegraded":"2024-05-07T14:03:41.696553+0000","last_fullsized":"2024-05-07T14:03:41.696553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.703207+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:03:41.703207+0000","last_peered":"2024-05-07T14:03:41.703207+0000","last_clean":"2024-05-07T14:03:41.703207+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:03:41.703207+0000","last_undegraded":"2024-05-07T14:03:41.703207+0000","last_fullsized":"2024-05-07T14:03:41.703207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"85'6","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699371+0000","last_change":"2024-05-07T14:00:55.989670+0000","last_active":"2024-05-07T14:03:41.699371+0000","last_peered":"2024-05-07T14:03:41.699371+0000","last_clean":"2024-05-07T14:03:41.699371+0000","last_became_active":"2024-05-07T14:00:55.989455+0000","last_became_peered":"2024-05-07T14:00:55.989455+0000","last_unstale":"2024-05-07T14:03:41.699371+0000","last_undegraded":"2024-05-07T14:03:41.699371+0000","last_fullsized":"2024-05-07T14:03:41.699371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"81'6","reported_seq":205,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699711+0000","last_change":"2024-05-07T14:03:37.848216+0000","last_active":"2024-05-07T14:03:41.699711+0000","last_peered":"2024-05-07T14:03:41.699711+0000","last_clean":"2024-05-07T14:03:41.699711+0000","last_became_active":"2024-05-07T14:03:37.842132+0000","last_became_peered":"2024-05-07T14:03:37.842132+0000","last_unstale":"2024-05-07T14:03:41.699711+0000","last_undegraded":"2024-05-07T14:03:41.699711+0000","last_fullsized":"2024-05-07T14:03:41.699711+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:16.805365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"85'7","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:42.101781+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:03:42.101781+0000","last_peered":"2024-05-07T14:03:42.101781+0000","last_clean":"2024-05-07T14:03:42.101781+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:03:42.101781+0000","last_undegraded":"2024-05-07T14:03:42.101781+0000","last_fullsized":"2024-05-07T14:03:42.101781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"87'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699843+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:03:41.699843+0000","last_peered":"2024-05-07T14:03:41.699843+0000","last_clean":"2024-05-07T14:03:41.699843+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:03:41.699843+0000","last_undegraded":"2024-05-07T14:03:41.699843+0000","last_fullsized":"2024-05-07T14:03:41.699843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"85'1","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699857+0000","last_change":"2024-05-07T14:00:55.978771+0000","last_active":"2024-05-07T14:03:41.699857+0000","last_peered":"2024-05-07T14:03:41.699857+0000","last_clean":"2024-05-07T14:03:41.699857+0000","last_became_active":"2024-05-07T14:00:55.978000+0000","last_became_peered":"2024-05-07T14:00:55.978000+0000","last_unstale":"2024-05-07T14:03:41.699857+0000","last_undegraded":"2024-05-07T14:03:41.699857+0000","last_fullsized":"2024-05-07T14:03:41.699857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"81'6","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711378+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:03:41.711378+0000","last_peered":"2024-05-07T14:03:41.711378+0000","last_clean":"2024-05-07T14:03:41.711378+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:03:41.711378+0000","last_undegraded":"2024-05-07T14:03:41.711378+0000","last_fullsized":"2024-05-07T14:03:41.711378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"85'7","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.706194+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:03:41.706194+0000","last_peered":"2024-05-07T14:03:41.706194+0000","last_clean":"2024-05-07T14:03:41.706194+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:03:41.706194+0000","last_undegraded":"2024-05-07T14:03:41.706194+0000","last_fullsized":"2024-05-07T14:03:41.706194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"87'4","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.695244+0000","last_change":"2024-05-07T14:00:57.979073+0000","last_active":"2024-05-07T14:03:41.695244+0000","last_peered":"2024-05-07T14:03:41.695244+0000","last_clean":"2024-05-07T14:03:41.695244+0000","last_became_active":"2024-05-07T14:00:57.978215+0000","last_became_peered":"2024-05-07T14:00:57.978215+0000","last_unstale":"2024-05-07T14:03:41.695244+0000","last_undegraded":"2024-05-07T14:03:41.695244+0000","last_fullsized":"2024-05-07T14:03:41.695244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"85'7","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.698352+0000","last_change":"2024-05-07T14:00:56.001199+0000","last_active":"2024-05-07T14:03:41.698352+0000","last_peered":"2024-05-07T14:03:41.698352+0000","last_clean":"2024-05-07T14:03:41.698352+0000","last_became_active":"2024-05-07T14:00:56.000434+0000","last_became_peered":"2024-05-07T14:00:56.000434+0000","last_unstale":"2024-05-07T14:03:41.698352+0000","last_undegraded":"2024-05-07T14:03:41.698352+0000","last_fullsized":"2024-05-07T14:03:41.698352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"85'5","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.696888+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:03:41.696888+0000","last_peered":"2024-05-07T14:03:41.696888+0000","last_clean":"2024-05-07T14:03:41.696888+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:03:41.696888+0000","last_undegraded":"2024-05-07T14:03:41.696888+0000","last_fullsized":"2024-05-07T14:03:41.696888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"81'2","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.699873+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:03:41.699873+0000","last_peered":"2024-05-07T14:03:41.699873+0000","last_clean":"2024-05-07T14:03:41.699873+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:03:41.699873+0000","last_undegraded":"2024-05-07T14:03:41.699873+0000","last_fullsized":"2024-05-07T14:03:41.699873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'3","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.711492+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:03:41.711492+0000","last_peered":"2024-05-07T14:03:41.711492+0000","last_clean":"2024-05-07T14:03:41.711492+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:03:41.711492+0000","last_undegraded":"2024-05-07T14:03:41.711492+0000","last_fullsized":"2024-05-07T14:03:41.711492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"94'3","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-07T14:03:41.697844+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:03:41.697844+0000","last_peered":"2024-05-07T14:03:41.697844+0000","last_clean":"2024-05-07T14:03:41.697844+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:03:41.697844+0000","last_undegraded":"2024-05-07T14:03:41.697844+0000","last_fullsized":"2024-05-07T14:03:41.697844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1003,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":250,"num_read_kb":234,"num_write":236,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":841,"ondisk_log_size":841,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":79524,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":810,"num_read_kb":572,"num_write":449,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":4494,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":128631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":634,"ondisk_log_size":634,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1078,"num_read_kb":1058,"num_write":239,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1069547520,"num_objects":257,"num_object_clones":0,"num_object_copies":514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":257,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":317,"num_write_kb":1064960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2139095040,"data_stored":2139095040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362152,"kb_used_data":330964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94009688,"statfs":{"total":96636764160,"available":96265920512,"internally_reserved":0,"allocated":338907136,"data_stored":338347051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":278736,"kb_used_data":247552,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94093104,"statfs":{"total":96636764160,"available":96351338496,"internally_reserved":0,"allocated":253493248,"data_stored":252953527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339648,"kb_used_data":308464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94032192,"statfs":{"total":96636764160,"available":96288964608,"internally_reserved":0,"allocated":315867136,"data_stored":315280067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347768,"kb_used_data":316588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94024072,"statfs":{"total":96636764160,"available":96280649728,"internally_reserved":0,"allocated":324186112,"data_stored":323659355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":340284,"kb_used_data":309100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94031556,"statfs":{"total":96636764160,"available":96288313344,"internally_reserved":0,"allocated":316518400,"data_stored":315928962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":196232,"kb_used_data":165048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94175608,"statfs":{"total":96636764160,"available":96435822592,"internally_reserved":0,"allocated":169009152,"data_stored":168477088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216752,"kb_used_data":185568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94155088,"statfs":{"total":96636764160,"available":96414810112,"internally_reserved":0,"allocated":190021632,"data_stored":189452096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268000,"kb_used_data":236812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94103840,"statfs":{"total":96636764160,"available":96362332160,"internally_reserved":0,"allocated":242495488,"data_stored":241936314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":241172480,"data_stored":241172480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":188743680,"data_stored":188743680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":167772160,"data_stored":167772160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":314572800,"data_stored":314572800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":322961408,"data_stored":322961408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":314572800,"data_stored":314572800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":251658240,"data_stored":251658240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":337641472,"data_stored":337641472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":60890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:03:46.639 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:46.694 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:46.703+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:46.723 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:03:46.778 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:46.778 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:46.781 INFO:tasks.workunit.client.0.smithi106.stdout:user qa_user deleted 2024-05-07T14:03:46.781 INFO:tasks.workunit.client.0.smithi106.stdout:bucket delete succeeded 2024-05-07T14:03:46.793 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:46.795 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:46.803+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:46.896 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:46.907+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:46.960 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:46.961 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:46.974 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:03:46.997 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:47.007+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:47.094 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:47.094 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:47.097 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:47.107+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:47.106 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:03:47.198 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:47.207+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:47.225 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:47.225 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:47.240 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:03:47.299 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:47.307+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:47.358 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:47.358 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:47.372 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:03:47.420 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:47.431+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:47.496 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:47.496 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:47.503 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:47.511+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:47.511 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:03:47.604 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:47.611+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:47.679 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:47.679 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:47.694 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:03:47.707 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:47.715+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:47.808 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:47.819+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:47.816 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:47.817 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:47.831 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:47.909 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:47.919+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:47.953 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:47.953 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:47.967 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:48.013 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:48.023+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:48.097 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:48.097 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:48.112 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:48.119+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:48.118 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:48.213 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:48.223+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:48.286 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:48.286 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:48.302 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:48.345 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:48.355+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:48.359 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:03:48.432 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:48.443+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:48.456 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:48.456 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:48.469 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:48.514 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:48.514 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:48.516 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:48.527+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:48.532 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:48.532 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:48.547 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:48.547 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:48.563 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:48.563 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:48.582 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:48.583 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:48.602 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:48.602 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:48.617 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:48.627+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:48.622 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:48.622 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:48.628 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:48.628 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:48.628 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:48.628 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:48.641 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:48.643 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:48.643 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:48.718 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:48.727+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:48.747 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:03:48.751 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:48.752 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:48.752 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:48.752 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:48.752 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:48.764 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:48.856 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:48.867+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:48.919 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:48.927+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:48.923 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.923 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:03:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 168.950276024, 2024-05-07T14:03:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:03:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:03:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:03:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:03:48.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:48.925 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:03:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:03:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:03:48.926 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:03:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:03:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:03:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:03:48.927 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:03:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:03:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:03:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:48.928 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:03:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:03:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:03:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:03:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:48.929 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:03:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:03:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2202 3.0 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:48.930 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.655258645000004, 2024-05-07T14:03:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027191908000000001, 2024-05-07T14:03:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:48.931 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2202 2024-05-07T14:03:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:48.932 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279975+0000", 2024-05-07T14:03:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0130000000000001e-06 2024-05-07T14:03:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:48.933 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285489+0000", 2024-05-07T14:03:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055143570000000001 2024-05-07T14:03:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285531+0000", 2024-05-07T14:03:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1504000000000001e-05 2024-05-07T14:03:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285550+0000", 2024-05-07T14:03:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9256e-05 2024-05-07T14:03:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285747+0000", 2024-05-07T14:03:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196777 2024-05-07T14:03:48.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286120+0000", 2024-05-07T14:03:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037285900000000002 2024-05-07T14:03:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286489+0000", 2024-05-07T14:03:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036951099999999999 2024-05-07T14:03:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:48.936 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301589+0000", 2024-05-07T14:03:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015099728999999999 2024-05-07T14:03:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307085+0000", 2024-05-07T14:03:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054963340000000003 2024-05-07T14:03:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307127+0000", 2024-05-07T14:03:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1977999999999997e-05 2024-05-07T14:03:48.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307162+0000", 2024-05-07T14:03:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4589999999999999e-05 2024-05-07T14:03:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2217 3.0 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:48.938 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.444932076999997, 2024-05-07T14:03:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019983529, 2024-05-07T14:03:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2217 2024-05-07T14:03:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.939 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490299+0000", 2024-05-07T14:03:48.940 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:03:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492337+0000", 2024-05-07T14:03:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020384489999999999 2024-05-07T14:03:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492391+0000", 2024-05-07T14:03:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3702000000000002e-05 2024-05-07T14:03:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492415+0000", 2024-05-07T14:03:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3373000000000001e-05 2024-05-07T14:03:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492567+0000", 2024-05-07T14:03:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152788 2024-05-07T14:03:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:48.942 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492843+0000", 2024-05-07T14:03:48.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027568999999999998 2024-05-07T14:03:48.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:48.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493123+0000", 2024-05-07T14:03:48.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028014899999999999 2024-05-07T14:03:48.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.943 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:48.943 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509840+0000", 2024-05-07T14:03:48.943 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016716871000000001 2024-05-07T14:03:48.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:48.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510203+0000", 2024-05-07T14:03:48.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036252499999999999 2024-05-07T14:03:48.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:48.944 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510250+0000", 2024-05-07T14:03:48.944 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7231000000000002e-05 2024-05-07T14:03:48.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.944 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:48.945 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510280+0000", 2024-05-07T14:03:48.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0270999999999999e-05 2024-05-07T14:03:48.945 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.945 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:48.945 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.945 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2224 3.1a e84/21 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:48.945 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:48.945 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.339988409999997, 2024-05-07T14:03:48.945 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020623257999999998, 2024-05-07T14:03:48.945 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:48.946 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:48.946 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:48.946 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:48.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:48.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:48.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.946 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:48.946 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:48.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:48.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595243+0000", 2024-05-07T14:03:48.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6800000000000002e-06 2024-05-07T14:03:48.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:48.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.601988+0000", 2024-05-07T14:03:48.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0067452479999999997 2024-05-07T14:03:48.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:48.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602044+0000", 2024-05-07T14:03:48.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5884999999999998e-05 2024-05-07T14:03:48.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:48.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602070+0000", 2024-05-07T14:03:48.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6359999999999998e-05 2024-05-07T14:03:48.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:48.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602183+0000", 2024-05-07T14:03:48.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112761 2024-05-07T14:03:48.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:48.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602210+0000", 2024-05-07T14:03:48.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6882000000000001e-05 2024-05-07T14:03:48.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:48.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615811+0000", 2024-05-07T14:03:48.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01360132 2024-05-07T14:03:48.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:48.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615863+0000", 2024-05-07T14:03:48.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2122e-05 2024-05-07T14:03:48.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.950 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:48.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.951 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2701 3.19 3:9ba4c095:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:48.951 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:03:48.951 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.9724213900000001, 2024-05-07T14:03:48.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017365756999999999, 2024-05-07T14:03:48.951 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:48.951 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:48.951 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:48.951 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:48.951 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:48.951 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:48.952 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2701 2024-05-07T14:03:48.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.952 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:48.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:48.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:03:48.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:48.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:03:48.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:48.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962810+0000", 2024-05-07T14:03:48.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.43e-06 2024-05-07T14:03:48.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:48.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964338+0000", 2024-05-07T14:03:48.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015288190000000001 2024-05-07T14:03:48.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:48.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964372+0000", 2024-05-07T14:03:48.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3104e-05 2024-05-07T14:03:48.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:48.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964387+0000", 2024-05-07T14:03:48.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5226e-05 2024-05-07T14:03:48.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:48.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964473+0000", 2024-05-07T14:03:48.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6289e-05 2024-05-07T14:03:48.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:48.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964636+0000", 2024-05-07T14:03:48.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016293899999999999 2024-05-07T14:03:48.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:48.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964792+0000", 2024-05-07T14:03:48.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155513 2024-05-07T14:03:48.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:48.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.979623+0000", 2024-05-07T14:03:48.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014831657 2024-05-07T14:03:48.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:48.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980052+0000", 2024-05-07T14:03:48.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042865699999999999 2024-05-07T14:03:48.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:48.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980116+0000", 2024-05-07T14:03:48.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4592999999999996e-05 2024-05-07T14:03:48.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:48.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980173+0000", 2024-05-07T14:03:48.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6530000000000003e-05 2024-05-07T14:03:48.958 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.958 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:48.958 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.958 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2704 3.31 3:8c38a608:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:48.958 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:03:48.958 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.9362660409999997, 2024-05-07T14:03:48.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.024434902000000001, 2024-05-07T14:03:48.959 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:48.959 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:48.959 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:48.959 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:48.959 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:48.959 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:48.959 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2704 2024-05-07T14:03:48.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.959 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:48.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:48.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:03:48.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:48.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:03:48.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:48.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998965+0000", 2024-05-07T14:03:48.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6809999999999998e-06 2024-05-07T14:03:48.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:48.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000686+0000", 2024-05-07T14:03:48.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00172109 2024-05-07T14:03:48.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.961 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:48.961 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000705+0000", 2024-05-07T14:03:48.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8879999999999999e-05 2024-05-07T14:03:48.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:48.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000718+0000", 2024-05-07T14:03:48.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2846e-05 2024-05-07T14:03:48.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:48.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000794+0000", 2024-05-07T14:03:48.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5613999999999998e-05 2024-05-07T14:03:48.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:48.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000919+0000", 2024-05-07T14:03:48.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000124924 2024-05-07T14:03:48.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:48.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.001034+0000", 2024-05-07T14:03:48.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115158 2024-05-07T14:03:48.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:48.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.007009+0000", 2024-05-07T14:03:48.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059753009999999997 2024-05-07T14:03:48.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:48.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023250+0000", 2024-05-07T14:03:48.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016240477 2024-05-07T14:03:48.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:48.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023343+0000", 2024-05-07T14:03:48.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3362000000000005e-05 2024-05-07T14:03:48.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:48.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023397+0000", 2024-05-07T14:03:48.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4568999999999999e-05 2024-05-07T14:03:48.966 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.966 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:48.966 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.966 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2738 3.31 3:8f11b22f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:48.966 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.368415+0000", 2024-05-07T14:03:48.966 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.566813378, 2024-05-07T14:03:48.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014754041000000001, 2024-05-07T14:03:48.967 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:48.967 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:48.967 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:48.967 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:48.967 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:48.967 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:48.967 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2738 2024-05-07T14:03:48.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.967 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:48.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:48.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.368415+0000", 2024-05-07T14:03:48.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:48.968 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.368415+0000", 2024-05-07T14:03:48.968 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:48.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.368418+0000", 2024-05-07T14:03:48.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.162e-06 2024-05-07T14:03:48.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:48.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370172+0000", 2024-05-07T14:03:48.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001753533 2024-05-07T14:03:48.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:48.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370198+0000", 2024-05-07T14:03:48.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6458999999999999e-05 2024-05-07T14:03:48.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:48.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370215+0000", 2024-05-07T14:03:48.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6379999999999999e-05 2024-05-07T14:03:48.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:48.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370304+0000", 2024-05-07T14:03:48.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9149999999999999e-05 2024-05-07T14:03:48.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:48.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370479+0000", 2024-05-07T14:03:48.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017554199999999999 2024-05-07T14:03:48.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:48.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370647+0000", 2024-05-07T14:03:48.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016778799999999999 2024-05-07T14:03:48.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:48.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.376674+0000", 2024-05-07T14:03:48.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0060270109999999997 2024-05-07T14:03:48.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:48.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.383059+0000", 2024-05-07T14:03:48.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063850670000000003 2024-05-07T14:03:48.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:48.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.383120+0000", 2024-05-07T14:03:48.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0730999999999998e-05 2024-05-07T14:03:48.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:48.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.383169+0000", 2024-05-07T14:03:48.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9218000000000002e-05 2024-05-07T14:03:48.974 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.974 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:48.974 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.975 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2741 3.4 3:22c462fb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:48.975 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.402105+0000", 2024-05-07T14:03:48.975 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.5331235840000002, 2024-05-07T14:03:48.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014775256000000001, 2024-05-07T14:03:48.975 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:48.975 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:48.975 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:48.975 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:48.975 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:48.975 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:48.975 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2741 2024-05-07T14:03:48.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.976 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:48.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:48.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402105+0000", 2024-05-07T14:03:48.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:48.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402105+0000", 2024-05-07T14:03:48.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:48.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402108+0000", 2024-05-07T14:03:48.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.757e-06 2024-05-07T14:03:48.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:48.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404192+0000", 2024-05-07T14:03:48.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020845389999999998 2024-05-07T14:03:48.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:48.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404223+0000", 2024-05-07T14:03:48.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0790999999999997e-05 2024-05-07T14:03:48.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:48.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404235+0000", 2024-05-07T14:03:48.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2089999999999999e-05 2024-05-07T14:03:48.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:48.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404302+0000", 2024-05-07T14:03:48.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6656999999999996e-05 2024-05-07T14:03:48.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:48.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404406+0000", 2024-05-07T14:03:48.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010458699999999999 2024-05-07T14:03:48.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:48.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404506+0000", 2024-05-07T14:03:48.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9723999999999996e-05 2024-05-07T14:03:48.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:48.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416118+0000", 2024-05-07T14:03:48.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011611593 2024-05-07T14:03:48.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:48.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416765+0000", 2024-05-07T14:03:48.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064727999999999997 2024-05-07T14:03:48.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:48.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416829+0000", 2024-05-07T14:03:48.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4189999999999994e-05 2024-05-07T14:03:48.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:48.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416880+0000", 2024-05-07T14:03:48.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1048000000000003e-05 2024-05-07T14:03:48.981 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.981 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:48.981 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.982 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2743 3.8 e104/99 3:12ce00a0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_60:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:48.982 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.424088+0000", 2024-05-07T14:03:48.982 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.5111406399999998, 2024-05-07T14:03:48.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015852854, 2024-05-07T14:03:48.982 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:48.982 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:48.982 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:48.982 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:48.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:48.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.424088+0000", 2024-05-07T14:03:48.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:48.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.424088+0000", 2024-05-07T14:03:48.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:48.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.424090+0000", 2024-05-07T14:03:48.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8959999999999999e-06 2024-05-07T14:03:48.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:48.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426151+0000", 2024-05-07T14:03:48.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020615590000000001 2024-05-07T14:03:48.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:48.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426175+0000", 2024-05-07T14:03:48.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3292999999999999e-05 2024-05-07T14:03:48.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:48.984 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426186+0000", 2024-05-07T14:03:48.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1630999999999999e-05 2024-05-07T14:03:48.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:48.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426348+0000", 2024-05-07T14:03:48.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161898 2024-05-07T14:03:48.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:48.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426383+0000", 2024-05-07T14:03:48.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4483000000000002e-05 2024-05-07T14:03:48.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:48.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.439870+0000", 2024-05-07T14:03:48.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013486908000000001 2024-05-07T14:03:48.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:48.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.439941+0000", 2024-05-07T14:03:48.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1186000000000006e-05 2024-05-07T14:03:48.987 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.987 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:48.987 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.987 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2774 3.1f e105/46 3:f948718f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_91:head v 105'3, mlcod=84'1)", 2024-05-07T14:03:48.987 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.733903+0000", 2024-05-07T14:03:48.987 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.2013252960000003, 2024-05-07T14:03:48.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016095564999999999, 2024-05-07T14:03:48.988 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:48.988 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:48.988 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:48.988 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:48.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:48.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.733903+0000", 2024-05-07T14:03:48.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:48.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.733903+0000", 2024-05-07T14:03:48.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:48.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.733904+0000", 2024-05-07T14:03:48.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1300000000000001e-07 2024-05-07T14:03:48.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:48.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736457+0000", 2024-05-07T14:03:48.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025533819999999999 2024-05-07T14:03:48.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:48.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736483+0000", 2024-05-07T14:03:48.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6112999999999999e-05 2024-05-07T14:03:48.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:48.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736496+0000", 2024-05-07T14:03:48.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3259e-05 2024-05-07T14:03:48.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:48.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736582+0000", 2024-05-07T14:03:48.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5270000000000002e-05 2024-05-07T14:03:48.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:48.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736610+0000", 2024-05-07T14:03:48.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8393000000000001e-05 2024-05-07T14:03:48.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:48.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.749923+0000", 2024-05-07T14:03:48.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013313319000000001 2024-05-07T14:03:48.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.992 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:48.992 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.749999+0000", 2024-05-07T14:03:48.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5415999999999998e-05 2024-05-07T14:03:48.992 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.992 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:48.992 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:48.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.993 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2795 3.31 3:8c1ef932:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:48.993 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.971318+0000", 2024-05-07T14:03:48.993 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.9639110849999999, 2024-05-07T14:03:48.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015852123999999999, 2024-05-07T14:03:48.993 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:48.993 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:48.993 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:48.993 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:48.993 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:48.994 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:48.994 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2795 2024-05-07T14:03:48.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.994 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:48.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:48.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.971318+0000", 2024-05-07T14:03:48.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:48.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.971318+0000", 2024-05-07T14:03:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.971320+0000", 2024-05-07T14:03:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0930000000000001e-06 2024-05-07T14:03:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973467+0000", 2024-05-07T14:03:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021476799999999999 2024-05-07T14:03:48.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:48.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973490+0000", 2024-05-07T14:03:48.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2591000000000001e-05 2024-05-07T14:03:48.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:48.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973502+0000", 2024-05-07T14:03:48.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2211e-05 2024-05-07T14:03:48.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:48.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973582+0000", 2024-05-07T14:03:48.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9443999999999994e-05 2024-05-07T14:03:48.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:48.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973705+0000", 2024-05-07T14:03:48.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012343799999999999 2024-05-07T14:03:48.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:48.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973817+0000", 2024-05-07T14:03:48.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111597 2024-05-07T14:03:48.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:48.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.980854+0000", 2024-05-07T14:03:48.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0070369209999999998 2024-05-07T14:03:48.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:48.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.987016+0000", 2024-05-07T14:03:48.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061629479999999997 2024-05-07T14:03:48.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:48.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:48.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:48.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.987104+0000", 2024-05-07T14:03:48.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7472999999999994e-05 2024-05-07T14:03:48.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.987170+0000", 2024-05-07T14:03:49.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5728000000000005e-05 2024-05-07T14:03:49.000 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.000 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.000 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.000 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2803 3.4 3:2246d6f5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.001 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:03:49.001 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.8814747020000002, 2024-05-07T14:03:49.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021000333999999999, 2024-05-07T14:03:49.001 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.001 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.001 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.001 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.001 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.001 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.002 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2803 2024-05-07T14:03:49.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.002 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:03:49.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:03:49.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053757+0000", 2024-05-07T14:03:49.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1049999999999999e-06 2024-05-07T14:03:49.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056166+0000", 2024-05-07T14:03:49.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002409039 2024-05-07T14:03:49.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056189+0000", 2024-05-07T14:03:49.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2595e-05 2024-05-07T14:03:49.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056200+0000", 2024-05-07T14:03:49.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1212999999999999e-05 2024-05-07T14:03:49.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056274+0000", 2024-05-07T14:03:49.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4086999999999997e-05 2024-05-07T14:03:49.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056414+0000", 2024-05-07T14:03:49.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000139763 2024-05-07T14:03:49.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:49.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056555+0000", 2024-05-07T14:03:49.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014123900000000001 2024-05-07T14:03:49.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.071326+0000", 2024-05-07T14:03:49.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014771151999999999 2024-05-07T14:03:49.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074566+0000", 2024-05-07T14:03:49.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032398570000000001 2024-05-07T14:03:49.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074699+0000", 2024-05-07T14:03:49.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013297800000000001 2024-05-07T14:03:49.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074754+0000", 2024-05-07T14:03:49.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5306000000000002e-05 2024-05-07T14:03:49.008 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.008 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.008 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.009 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2811 3.25 3:a6013043:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.009 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.134821+0000", 2024-05-07T14:03:49.009 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.8004073460000001, 2024-05-07T14:03:49.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015439613, 2024-05-07T14:03:49.009 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.009 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.009 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.009 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.009 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.009 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.009 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2811 2024-05-07T14:03:49.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.010 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.134821+0000", 2024-05-07T14:03:49.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.134821+0000", 2024-05-07T14:03:49.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.134823+0000", 2024-05-07T14:03:49.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.934e-06 2024-05-07T14:03:49.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136202+0000", 2024-05-07T14:03:49.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013786359999999999 2024-05-07T14:03:49.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136233+0000", 2024-05-07T14:03:49.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1025999999999997e-05 2024-05-07T14:03:49.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136247+0000", 2024-05-07T14:03:49.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4348000000000001e-05 2024-05-07T14:03:49.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136334+0000", 2024-05-07T14:03:49.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6452000000000005e-05 2024-05-07T14:03:49.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136472+0000", 2024-05-07T14:03:49.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013793200000000001 2024-05-07T14:03:49.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:49.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136563+0000", 2024-05-07T14:03:49.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1706999999999995e-05 2024-05-07T14:03:49.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.143623+0000", 2024-05-07T14:03:49.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0070597689999999996 2024-05-07T14:03:49.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.150128+0000", 2024-05-07T14:03:49.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065045119999999996 2024-05-07T14:03:49.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.150192+0000", 2024-05-07T14:03:49.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4391000000000001e-05 2024-05-07T14:03:49.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.150261+0000", 2024-05-07T14:03:49.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8905999999999994e-05 2024-05-07T14:03:49.015 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.016 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.016 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.016 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2832 3.1a e105/21 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head v 105'9, mlcod=85'7)", 2024-05-07T14:03:49.016 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:03:49.016 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.6810112020000001, 2024-05-07T14:03:49.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023326739999999999, 2024-05-07T14:03:49.016 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.017 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.017 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.017 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:03:49.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:03:49.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254219+0000", 2024-05-07T14:03:49.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0059999999999999e-06 2024-05-07T14:03:49.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260033+0000", 2024-05-07T14:03:49.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058134010000000002 2024-05-07T14:03:49.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260063+0000", 2024-05-07T14:03:49.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9762000000000001e-05 2024-05-07T14:03:49.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260085+0000", 2024-05-07T14:03:49.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2157000000000001e-05 2024-05-07T14:03:49.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260165+0000", 2024-05-07T14:03:49.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9909999999999999e-05 2024-05-07T14:03:49.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260195+0000", 2024-05-07T14:03:49.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9935000000000001e-05 2024-05-07T14:03:49.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277464+0000", 2024-05-07T14:03:49.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017269805999999999 2024-05-07T14:03:49.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277544+0000", 2024-05-07T14:03:49.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9763000000000002e-05 2024-05-07T14:03:49.021 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.021 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.021 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.022 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2857 3.32 e105/21 3:4d47cfce:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_164:head v 105'4, mlcod=84'2)", 2024-05-07T14:03:49.022 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.499438+0000", 2024-05-07T14:03:49.022 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.435791, 2024-05-07T14:03:49.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014525326, 2024-05-07T14:03:49.022 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.022 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.022 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.022 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.499438+0000", 2024-05-07T14:03:49.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.499438+0000", 2024-05-07T14:03:49.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.499439+0000", 2024-05-07T14:03:49.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7290000000000001e-06 2024-05-07T14:03:49.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501250+0000", 2024-05-07T14:03:49.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018110229999999999 2024-05-07T14:03:49.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501273+0000", 2024-05-07T14:03:49.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2379999999999999e-05 2024-05-07T14:03:49.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501286+0000", 2024-05-07T14:03:49.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3499999999999999e-05 2024-05-07T14:03:49.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501385+0000", 2024-05-07T14:03:49.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8356999999999994e-05 2024-05-07T14:03:49.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501402+0000", 2024-05-07T14:03:49.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7337999999999999e-05 2024-05-07T14:03:49.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.513916+0000", 2024-05-07T14:03:49.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012514058 2024-05-07T14:03:49.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.513963+0000", 2024-05-07T14:03:49.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6940999999999997e-05 2024-05-07T14:03:49.028 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.028 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.028 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.028 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2860 3.3e 3:7cdd96b9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.028 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:03:49.029 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.4068044799999999, 2024-05-07T14:03:49.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019237982000000001, 2024-05-07T14:03:49.029 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.029 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.029 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.029 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.029 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.029 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.030 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2860 2024-05-07T14:03:49.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.030 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:03:49.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:03:49.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528427+0000", 2024-05-07T14:03:49.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5739999999999998e-06 2024-05-07T14:03:49.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530685+0000", 2024-05-07T14:03:49.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022580009999999999 2024-05-07T14:03:49.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530713+0000", 2024-05-07T14:03:49.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8552e-05 2024-05-07T14:03:49.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530727+0000", 2024-05-07T14:03:49.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4054e-05 2024-05-07T14:03:49.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530808+0000", 2024-05-07T14:03:49.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0741999999999994e-05 2024-05-07T14:03:49.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530954+0000", 2024-05-07T14:03:49.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145494 2024-05-07T14:03:49.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:49.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.531051+0000", 2024-05-07T14:03:49.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7349999999999995e-05 2024-05-07T14:03:49.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.543007+0000", 2024-05-07T14:03:49.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011955873000000001 2024-05-07T14:03:49.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547544+0000", 2024-05-07T14:03:49.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004537091 2024-05-07T14:03:49.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547610+0000", 2024-05-07T14:03:49.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5722000000000005e-05 2024-05-07T14:03:49.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547662+0000", 2024-05-07T14:03:49.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2528999999999998e-05 2024-05-07T14:03:49.035 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.036 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.036 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.036 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2869 3.25 3:a4e7d6f7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.036 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.623671+0000", 2024-05-07T14:03:49.036 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.3115578530000001, 2024-05-07T14:03:49.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015945890000000001, 2024-05-07T14:03:49.036 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.036 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.036 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.036 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.036 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.037 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.037 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2869 2024-05-07T14:03:49.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.037 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.623671+0000", 2024-05-07T14:03:49.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.623671+0000", 2024-05-07T14:03:49.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.623674+0000", 2024-05-07T14:03:49.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7779999999999999e-06 2024-05-07T14:03:49.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625508+0000", 2024-05-07T14:03:49.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018344380000000001 2024-05-07T14:03:49.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625540+0000", 2024-05-07T14:03:49.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1890999999999997e-05 2024-05-07T14:03:49.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625555+0000", 2024-05-07T14:03:49.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4762e-05 2024-05-07T14:03:49.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625629+0000", 2024-05-07T14:03:49.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4673999999999997e-05 2024-05-07T14:03:49.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625737+0000", 2024-05-07T14:03:49.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107421 2024-05-07T14:03:49.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:49.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625840+0000", 2024-05-07T14:03:49.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010359800000000001 2024-05-07T14:03:49.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.639429+0000", 2024-05-07T14:03:49.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013589037 2024-05-07T14:03:49.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.639471+0000", 2024-05-07T14:03:49.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1505999999999999e-05 2024-05-07T14:03:49.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.639551+0000", 2024-05-07T14:03:49.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9783999999999994e-05 2024-05-07T14:03:49.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.639617+0000", 2024-05-07T14:03:49.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6000999999999994e-05 2024-05-07T14:03:49.042 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.042 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.042 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.043 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2878 3.25 3:a61790bb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.043 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.719882+0000", 2024-05-07T14:03:49.043 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.2153468900000002, 2024-05-07T14:03:49.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015143986999999999, 2024-05-07T14:03:49.043 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.043 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.043 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.043 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.043 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.043 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.044 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2878 2024-05-07T14:03:49.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.044 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.719882+0000", 2024-05-07T14:03:49.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.719882+0000", 2024-05-07T14:03:49.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.719884+0000", 2024-05-07T14:03:49.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9420000000000002e-06 2024-05-07T14:03:49.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721527+0000", 2024-05-07T14:03:49.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016435709999999999 2024-05-07T14:03:49.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721558+0000", 2024-05-07T14:03:49.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0582e-05 2024-05-07T14:03:49.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721573+0000", 2024-05-07T14:03:49.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5670000000000001e-05 2024-05-07T14:03:49.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721660+0000", 2024-05-07T14:03:49.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6040999999999998e-05 2024-05-07T14:03:49.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721827+0000", 2024-05-07T14:03:49.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016701500000000001 2024-05-07T14:03:49.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:49.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721984+0000", 2024-05-07T14:03:49.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015734700000000001 2024-05-07T14:03:49.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.731807+0000", 2024-05-07T14:03:49.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.009822641 2024-05-07T14:03:49.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.734912+0000", 2024-05-07T14:03:49.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031051730000000001 2024-05-07T14:03:49.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.734975+0000", 2024-05-07T14:03:49.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3459000000000003e-05 2024-05-07T14:03:49.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.735026+0000", 2024-05-07T14:03:49.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0546e-05 2024-05-07T14:03:49.051 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.051 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.051 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.051 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2880 3.19 3:989dc271:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.051 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:03:49.051 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.1940926680000001, 2024-05-07T14:03:49.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018463578000000001, 2024-05-07T14:03:49.052 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.052 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.052 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.052 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.052 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.052 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.052 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2880 2024-05-07T14:03:49.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.052 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:03:49.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:03:49.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741138+0000", 2024-05-07T14:03:49.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2510000000000001e-06 2024-05-07T14:03:49.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742746+0000", 2024-05-07T14:03:49.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001608195 2024-05-07T14:03:49.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742776+0000", 2024-05-07T14:03:49.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9335999999999998e-05 2024-05-07T14:03:49.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742789+0000", 2024-05-07T14:03:49.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3059e-05 2024-05-07T14:03:49.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742879+0000", 2024-05-07T14:03:49.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0073000000000003e-05 2024-05-07T14:03:49.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.743010+0000", 2024-05-07T14:03:49.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013067999999999999 2024-05-07T14:03:49.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:49.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.743127+0000", 2024-05-07T14:03:49.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117606 2024-05-07T14:03:49.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.752872+0000", 2024-05-07T14:03:49.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0097450880000000007 2024-05-07T14:03:49.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759514+0000", 2024-05-07T14:03:49.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0066419900000000004 2024-05-07T14:03:49.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759554+0000", 2024-05-07T14:03:49.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0070000000000001e-05 2024-05-07T14:03:49.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759600+0000", 2024-05-07T14:03:49.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5229999999999999e-05 2024-05-07T14:03:49.059 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.059 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.059 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.060 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2897 3.19 3:993ae93c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.060 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.945276+0000", 2024-05-07T14:03:49.060 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.9899525159999998, 2024-05-07T14:03:49.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016131030000000001, 2024-05-07T14:03:49.060 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.060 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.060 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.061 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2897 2024-05-07T14:03:49.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.061 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945276+0000", 2024-05-07T14:03:49.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945276+0000", 2024-05-07T14:03:49.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945279+0000", 2024-05-07T14:03:49.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0089999999999999e-06 2024-05-07T14:03:49.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946504+0000", 2024-05-07T14:03:49.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001225346 2024-05-07T14:03:49.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946531+0000", 2024-05-07T14:03:49.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6412999999999999e-05 2024-05-07T14:03:49.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946545+0000", 2024-05-07T14:03:49.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4146e-05 2024-05-07T14:03:49.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946655+0000", 2024-05-07T14:03:49.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010969800000000001 2024-05-07T14:03:49.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946819+0000", 2024-05-07T14:03:49.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016466699999999999 2024-05-07T14:03:49.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:49.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946977+0000", 2024-05-07T14:03:49.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000157899 2024-05-07T14:03:49.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.957118+0000", 2024-05-07T14:03:49.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010140335 2024-05-07T14:03:49.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.961330+0000", 2024-05-07T14:03:49.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042127019999999996 2024-05-07T14:03:49.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.961372+0000", 2024-05-07T14:03:49.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1459999999999999e-05 2024-05-07T14:03:49.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.961407+0000", 2024-05-07T14:03:49.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5355000000000003e-05 2024-05-07T14:03:49.066 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.066 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.066 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.066 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.066 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.066 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:49.068 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:49.069 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:49.079+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:49.169 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:49.179+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:49.226 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:49.227 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:49.227 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:49.227 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:49.239 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:49.270 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:49.279+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:49.371 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:49.379+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:49.394 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:49.395 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:49.395 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:49.407 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:49.472 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:49.479+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:49.528 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:49.529 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:49.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:49.529 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:49.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.529 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2202 3.0 e84/21 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:49.529 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:49.529 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.254373203999997, 2024-05-07T14:03:49.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020120560999999999, 2024-05-07T14:03:49.530 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.530 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.530 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.530 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:49.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:49.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286676+0000", 2024-05-07T14:03:49.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.57e-06 2024-05-07T14:03:49.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291894+0000", 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052185740000000001 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291939+0000", 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4676999999999999e-05 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291959+0000", 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0115999999999998e-05 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292128+0000", 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168758 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292188+0000", 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0565e-05 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306607+0000", 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014418733 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.534 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.534 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306794+0000", 2024-05-07T14:03:49.534 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018656799999999999 2024-05-07T14:03:49.534 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.534 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.534 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.534 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2216 3.21 3:86b25102:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:49.534 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:49.534 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.072942879999999, 2024-05-07T14:03:49.534 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017498730000000001, 2024-05-07T14:03:49.534 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.535 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.535 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.535 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.535 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.535 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.535 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2216 2024-05-07T14:03:49.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.535 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.535 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:49.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:49.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468107+0000", 2024-05-07T14:03:49.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5980000000000001e-06 2024-05-07T14:03:49.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471311+0000", 2024-05-07T14:03:49.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003203811 2024-05-07T14:03:49.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471360+0000", 2024-05-07T14:03:49.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9100000000000001e-05 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471383+0000", 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3289e-05 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471551+0000", 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167295 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471932+0000", 2024-05-07T14:03:49.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038136799999999998 2024-05-07T14:03:49.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.539 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:49.539 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472296+0000", 2024-05-07T14:03:49.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036396200000000001 2024-05-07T14:03:49.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.539 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.539 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.481648+0000", 2024-05-07T14:03:49.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093518209999999997 2024-05-07T14:03:49.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485379+0000", 2024-05-07T14:03:49.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037311919999999999 2024-05-07T14:03:49.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485533+0000", 2024-05-07T14:03:49.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015429500000000001 2024-05-07T14:03:49.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485602+0000", 2024-05-07T14:03:49.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8998999999999994e-05 2024-05-07T14:03:49.541 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.541 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.541 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.541 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2217 3.0 e84/21 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:49.541 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:49.541 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.047726417, 2024-05-07T14:03:49.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016624692, 2024-05-07T14:03:49.541 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.541 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.542 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.542 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:49.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.542 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:49.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493322+0000", 2024-05-07T14:03:49.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7290000000000001e-06 2024-05-07T14:03:49.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496239+0000", 2024-05-07T14:03:49.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029177949999999999 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496292+0000", 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2769999999999998e-05 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496318+0000", 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6313e-05 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496471+0000", 2024-05-07T14:03:49.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015206799999999999 2024-05-07T14:03:49.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496540+0000", 2024-05-07T14:03:49.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9598999999999996e-05 2024-05-07T14:03:49.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509870+0000", 2024-05-07T14:03:49.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013330322 2024-05-07T14:03:49.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509945+0000", 2024-05-07T14:03:49.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4096000000000003e-05 2024-05-07T14:03:49.546 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.546 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.547 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.547 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2687 3.2 3:43af9208:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:49.547 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:03:49.547 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.7225051369999997, 2024-05-07T14:03:49.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037068531000000002, 2024-05-07T14:03:49.547 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.547 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.547 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.547 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.548 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.548 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.548 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2687 2024-05-07T14:03:49.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.548 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.548 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.548 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:03:49.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818544+0000", 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3390000000000001e-06 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821166+0000", 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026214250000000001 2024-05-07T14:03:49.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821192+0000", 2024-05-07T14:03:49.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5641999999999999e-05 2024-05-07T14:03:49.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821203+0000", 2024-05-07T14:03:49.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1558e-05 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821280+0000", 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7237000000000006e-05 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821288+0000", 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0930000000000003e-06 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823694+0000", 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024052850000000001 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823853+0000", 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015879800000000001 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823991+0000", 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013879100000000001 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.832834+0000", 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088427109999999996 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855474+0000", 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022640304 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855553+0000", 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8994999999999998e-05 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.554 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.554 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855610+0000", 2024-05-07T14:03:49.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6353000000000001e-05 2024-05-07T14:03:49.554 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.554 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.554 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.554 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2707 3.17 3:e87c5034:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:49.554 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:03:49.554 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.5044914299999999, 2024-05-07T14:03:49.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017998984999999999, 2024-05-07T14:03:49.554 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.555 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.555 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.555 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.555 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.555 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.555 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2707 2024-05-07T14:03:49.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.555 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:03:49.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:03:49.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036558+0000", 2024-05-07T14:03:49.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8030000000000001e-06 2024-05-07T14:03:49.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038073+0000", 2024-05-07T14:03:49.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001514872 2024-05-07T14:03:49.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038093+0000", 2024-05-07T14:03:49.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0023000000000001e-05 2024-05-07T14:03:49.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038102+0000", 2024-05-07T14:03:49.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3389999999999999e-06 2024-05-07T14:03:49.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038183+0000", 2024-05-07T14:03:49.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1050999999999994e-05 2024-05-07T14:03:49.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038309+0000", 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012564400000000001 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038401+0000", 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2826999999999997e-05 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.046066+0000", 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007664761 2024-05-07T14:03:49.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054423+0000", 2024-05-07T14:03:49.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0083565310000000004 2024-05-07T14:03:49.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054497+0000", 2024-05-07T14:03:49.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4302999999999997e-05 2024-05-07T14:03:49.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054554+0000", 2024-05-07T14:03:49.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6830999999999998e-05 2024-05-07T14:03:49.566 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.566 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.566 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.566 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2717 3.17 3:eb96a854:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:49.566 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:03:49.566 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.3863116959999999, 2024-05-07T14:03:49.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017081168000000001, 2024-05-07T14:03:49.566 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.566 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.567 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.567 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.567 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.567 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.567 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2717 2024-05-07T14:03:49.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.568 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:03:49.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:03:49.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154737+0000", 2024-05-07T14:03:49.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.706e-06 2024-05-07T14:03:49.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156940+0000", 2024-05-07T14:03:49.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022023619999999998 2024-05-07T14:03:49.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156968+0000", 2024-05-07T14:03:49.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:03:49.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156982+0000", 2024-05-07T14:03:49.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3515e-05 2024-05-07T14:03:49.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157066+0000", 2024-05-07T14:03:49.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4746999999999993e-05 2024-05-07T14:03:49.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157241+0000", 2024-05-07T14:03:49.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000174496 2024-05-07T14:03:49.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:49.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157410+0000", 2024-05-07T14:03:49.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016901000000000001 2024-05-07T14:03:49.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.163989+0000", 2024-05-07T14:03:49.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065794249999999999 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171687+0000", 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0076973229999999998 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171760+0000", 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3617999999999999e-05 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171816+0000", 2024-05-07T14:03:49.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5432000000000001e-05 2024-05-07T14:03:49.573 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.573 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.573 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.573 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2721 3.3b e104/21 3:dd5ea515:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_38:head v 104'7, mlcod=85'5)", 2024-05-07T14:03:49.573 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:49.573 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.3396815120000003, 2024-05-07T14:03:49.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017497018999999999, 2024-05-07T14:03:49.573 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.573 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.573 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:49.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.27e-07 2024-05-07T14:03:49.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207457+0000", 2024-05-07T14:03:49.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0060918650000000001 2024-05-07T14:03:49.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207482+0000", 2024-05-07T14:03:49.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4765000000000001e-05 2024-05-07T14:03:49.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207496+0000", 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3983e-05 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207576+0000", 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9803999999999997e-05 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207605+0000", 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9697e-05 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.218781+0000", 2024-05-07T14:03:49.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011175681 2024-05-07T14:03:49.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.218862+0000", 2024-05-07T14:03:49.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0797000000000006e-05 2024-05-07T14:03:49.577 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.577 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.578 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.578 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2722 3.2e 3:75db52c2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:49.578 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:03:49.578 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.3352166130000001, 2024-05-07T14:03:49.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019780314, 2024-05-07T14:03:49.578 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.578 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.578 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.578 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.579 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.579 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.579 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2722 2024-05-07T14:03:49.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.579 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:03:49.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:03:49.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205833+0000", 2024-05-07T14:03:49.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3289999999999998e-06 2024-05-07T14:03:49.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207811+0000", 2024-05-07T14:03:49.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019781529999999999 2024-05-07T14:03:49.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207829+0000", 2024-05-07T14:03:49.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7402999999999999e-05 2024-05-07T14:03:49.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207838+0000", 2024-05-07T14:03:49.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0210000000000005e-06 2024-05-07T14:03:49.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207902+0000", 2024-05-07T14:03:49.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4406000000000006e-05 2024-05-07T14:03:49.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208094+0000", 2024-05-07T14:03:49.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000191626 2024-05-07T14:03:49.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208250+0000", 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156064 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.219242+0000", 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010992696999999999 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225500+0000", 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.006257182 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225550+0000", 2024-05-07T14:03:49.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0173999999999998e-05 2024-05-07T14:03:49.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225610+0000", 2024-05-07T14:03:49.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0259e-05 2024-05-07T14:03:49.584 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.584 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2735 3.2 3:4399fdca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.2029408610000001, 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017836129999999999, 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.585 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2735 2024-05-07T14:03:49.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.586 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:03:49.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:03:49.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338108+0000", 2024-05-07T14:03:49.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0110000000000001e-06 2024-05-07T14:03:49.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339842+0000", 2024-05-07T14:03:49.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017333330000000001 2024-05-07T14:03:49.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339870+0000", 2024-05-07T14:03:49.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7875999999999999e-05 2024-05-07T14:03:49.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339884+0000", 2024-05-07T14:03:49.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4678000000000001e-05 2024-05-07T14:03:49.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339984+0000", 2024-05-07T14:03:49.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9283999999999993e-05 2024-05-07T14:03:49.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.340096+0000", 2024-05-07T14:03:49.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112272 2024-05-07T14:03:49.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:49.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.340201+0000", 2024-05-07T14:03:49.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010467999999999999 2024-05-07T14:03:49.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.345876+0000", 2024-05-07T14:03:49.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056758260000000001 2024-05-07T14:03:49.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355805+0000", 2024-05-07T14:03:49.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099281679999999994 2024-05-07T14:03:49.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355883+0000", 2024-05-07T14:03:49.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8287000000000004e-05 2024-05-07T14:03:49.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355942+0000", 2024-05-07T14:03:49.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8715000000000003e-05 2024-05-07T14:03:49.592 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.592 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.592 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.592 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2742 3.2e 3:77b7f847:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:49.592 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:03:49.593 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.1290748439999998, 2024-05-07T14:03:49.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01669147, 2024-05-07T14:03:49.593 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.593 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.593 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.593 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.593 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.593 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.593 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2742 2024-05-07T14:03:49.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.593 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:03:49.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:03:49.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411975+0000", 2024-05-07T14:03:49.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.225e-06 2024-05-07T14:03:49.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413909+0000", 2024-05-07T14:03:49.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001934365 2024-05-07T14:03:49.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413938+0000", 2024-05-07T14:03:49.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8753000000000001e-05 2024-05-07T14:03:49.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413953+0000", 2024-05-07T14:03:49.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5631e-05 2024-05-07T14:03:49.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414034+0000", 2024-05-07T14:03:49.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0173000000000006e-05 2024-05-07T14:03:49.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414169+0000", 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013502499999999999 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414303+0000", 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013471800000000001 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.420795+0000", 2024-05-07T14:03:49.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064916050000000001 2024-05-07T14:03:49.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428529+0000", 2024-05-07T14:03:49.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077344129999999999 2024-05-07T14:03:49.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428605+0000", 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5662999999999997e-05 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428663+0000", 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7899000000000002e-05 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2773 3.17 3:e87231b1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:49.599 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:03:49.600 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.822584945, 2024-05-07T14:03:49.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028454317, 2024-05-07T14:03:49.600 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.600 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.600 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.600 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.600 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.600 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.600 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2773 2024-05-07T14:03:49.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.600 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718465+0000", 2024-05-07T14:03:49.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3680000000000002e-06 2024-05-07T14:03:49.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729580+0000", 2024-05-07T14:03:49.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011115776000000001 2024-05-07T14:03:49.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729608+0000", 2024-05-07T14:03:49.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7617e-05 2024-05-07T14:03:49.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729622+0000", 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3528e-05 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729694+0000", 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2630000000000001e-05 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729812+0000", 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118132 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729913+0000", 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100486 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.744465+0000", 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014551768 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746795+0000", 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023300270000000001 2024-05-07T14:03:49.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746865+0000", 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0322999999999997e-05 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746916+0000", 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0661999999999997e-05 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.606 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2784 3.17 3:e9b6a230:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.606 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:03:49.606 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.6902893570000002, 2024-05-07T14:03:49.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027214069, 2024-05-07T14:03:49.606 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.606 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.606 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.606 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.606 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.606 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.606 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2784 2024-05-07T14:03:49.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.606 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850760+0000", 2024-05-07T14:03:49.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0970000000000002e-06 2024-05-07T14:03:49.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853165+0000", 2024-05-07T14:03:49.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002405309 2024-05-07T14:03:49.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853186+0000", 2024-05-07T14:03:49.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0727999999999999e-05 2024-05-07T14:03:49.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853196+0000", 2024-05-07T14:03:49.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0159e-05 2024-05-07T14:03:49.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853277+0000", 2024-05-07T14:03:49.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0519999999999995e-05 2024-05-07T14:03:49.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853440+0000", 2024-05-07T14:03:49.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016281299999999999 2024-05-07T14:03:49.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:49.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853608+0000", 2024-05-07T14:03:49.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168126 2024-05-07T14:03:49.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.860132+0000", 2024-05-07T14:03:49.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065242379999999999 2024-05-07T14:03:49.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877848+0000", 2024-05-07T14:03:49.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017716251999999998 2024-05-07T14:03:49.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877919+0000", 2024-05-07T14:03:49.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.127e-05 2024-05-07T14:03:49.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877971+0000", 2024-05-07T14:03:49.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1557000000000001e-05 2024-05-07T14:03:49.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.612 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.613 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2789 3.2 3:434a8bbf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.613 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:03:49.613 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.6346001399999999, 2024-05-07T14:03:49.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025228071000000001, 2024-05-07T14:03:49.613 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.613 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.613 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.613 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.613 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.613 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.613 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2789 2024-05-07T14:03:49.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.614 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:03:49.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:03:49.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906450+0000", 2024-05-07T14:03:49.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5149999999999998e-06 2024-05-07T14:03:49.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908568+0000", 2024-05-07T14:03:49.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021184279999999999 2024-05-07T14:03:49.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908593+0000", 2024-05-07T14:03:49.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5043999999999999e-05 2024-05-07T14:03:49.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908607+0000", 2024-05-07T14:03:49.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3716999999999999e-05 2024-05-07T14:03:49.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908686+0000", 2024-05-07T14:03:49.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9492000000000004e-05 2024-05-07T14:03:49.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908818+0000", 2024-05-07T14:03:49.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013199199999999999 2024-05-07T14:03:49.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:49.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908952+0000", 2024-05-07T14:03:49.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013385400000000001 2024-05-07T14:03:49.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.916238+0000", 2024-05-07T14:03:49.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072861810000000001 2024-05-07T14:03:49.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931560+0000", 2024-05-07T14:03:49.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01532122 2024-05-07T14:03:49.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931620+0000", 2024-05-07T14:03:49.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0448000000000001e-05 2024-05-07T14:03:49.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931674+0000", 2024-05-07T14:03:49.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.418e-05 2024-05-07T14:03:49.620 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.620 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.620 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.620 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2799 3.9 e105/21 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head v 105'7, mlcod=104'5)", 2024-05-07T14:03:49.620 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:49.620 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.5232253399999998, 2024-05-07T14:03:49.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021236735, 2024-05-07T14:03:49.620 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.621 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.621 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.621 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:49.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:49.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:49.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.75e-07 2024-05-07T14:03:49.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024399+0000", 2024-05-07T14:03:49.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065773769999999997 2024-05-07T14:03:49.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024434+0000", 2024-05-07T14:03:49.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4884e-05 2024-05-07T14:03:49.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024450+0000", 2024-05-07T14:03:49.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6181999999999999e-05 2024-05-07T14:03:49.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024523+0000", 2024-05-07T14:03:49.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3054999999999998e-05 2024-05-07T14:03:49.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024550+0000", 2024-05-07T14:03:49.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6735000000000001e-05 2024-05-07T14:03:49.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.038754+0000", 2024-05-07T14:03:49.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014204543 2024-05-07T14:03:49.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.039058+0000", 2024-05-07T14:03:49.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030348400000000002 2024-05-07T14:03:49.625 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.625 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.625 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.626 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2802 3.13 3:c8761262:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.626 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:03:49.626 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.4977959759999999, 2024-05-07T14:03:49.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026174424000000002, 2024-05-07T14:03:49.626 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.626 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.626 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.626 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.626 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2802 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043253+0000", 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7030000000000002e-06 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045330+0000", 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020765139999999998 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045352+0000", 2024-05-07T14:03:49.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2532e-05 2024-05-07T14:03:49.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045363+0000", 2024-05-07T14:03:49.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0798000000000001e-05 2024-05-07T14:03:49.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045446+0000", 2024-05-07T14:03:49.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3592999999999997e-05 2024-05-07T14:03:49.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045641+0000", 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019462900000000001 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045809+0000", 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168312 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.054070+0000", 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082602100000000005 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069299+0000", 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015229457 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069371+0000", 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1730000000000006e-05 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069425+0000", 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3946000000000002e-05 2024-05-07T14:03:49.631 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.632 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.632 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.632 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2814 3.2d e105/21 3:b4f9607c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_131:head v 105'2, mlcod=0'0)", 2024-05-07T14:03:49.632 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:03:49.632 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.3697226630000001, 2024-05-07T14:03:49.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017192623000000001, 2024-05-07T14:03:49.632 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.632 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.632 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.632 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2300000000000002e-07 2024-05-07T14:03:49.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176766+0000", 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054422209999999997 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176788+0000", 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2161e-05 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176802+0000", 2024-05-07T14:03:49.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3341e-05 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176882+0000", 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0622000000000002e-05 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176913+0000", 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0518999999999997e-05 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.188402+0000", 2024-05-07T14:03:49.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011488824999999999 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.188516+0000", 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000114611 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2839 3.17 3:e819508b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.2243066100000002, 2024-05-07T14:03:49.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019836402, 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2839 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316741+0000", 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8029999999999999e-06 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318466+0000", 2024-05-07T14:03:49.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017249959999999999 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318491+0000", 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4876e-05 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318502+0000", 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0421999999999999e-05 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318582+0000", 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0593999999999994e-05 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318717+0000", 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013472199999999999 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318836+0000", 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118996 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.325781+0000", 2024-05-07T14:03:49.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069447809999999997 2024-05-07T14:03:49.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336451+0000", 2024-05-07T14:03:49.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010670416 2024-05-07T14:03:49.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336510+0000", 2024-05-07T14:03:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8408e-05 2024-05-07T14:03:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336576+0000", 2024-05-07T14:03:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6388000000000002e-05 2024-05-07T14:03:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2859 3.17 3:eabb580f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.642 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.519343+0000", 2024-05-07T14:03:49.643 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.0217028240000001, 2024-05-07T14:03:49.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01719621, 2024-05-07T14:03:49.643 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.643 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.643 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.643 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.643 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.643 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.643 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2859 2024-05-07T14:03:49.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.519343+0000", 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.519343+0000", 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.519346+0000", 2024-05-07T14:03:49.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4250000000000001e-06 2024-05-07T14:03:49.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520592+0000", 2024-05-07T14:03:49.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012463979999999999 2024-05-07T14:03:49.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520621+0000", 2024-05-07T14:03:49.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9081000000000002e-05 2024-05-07T14:03:49.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520634+0000", 2024-05-07T14:03:49.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2308e-05 2024-05-07T14:03:49.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520717+0000", 2024-05-07T14:03:49.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3644000000000001e-05 2024-05-07T14:03:49.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520839+0000", 2024-05-07T14:03:49.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012172600000000001 2024-05-07T14:03:49.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:49.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520972+0000", 2024-05-07T14:03:49.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000133423 2024-05-07T14:03:49.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.526747+0000", 2024-05-07T14:03:49.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057745899999999996 2024-05-07T14:03:49.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.536435+0000", 2024-05-07T14:03:49.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0096880590000000006 2024-05-07T14:03:49.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.536487+0000", 2024-05-07T14:03:49.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1925000000000002e-05 2024-05-07T14:03:49.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.536540+0000", 2024-05-07T14:03:49.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2630999999999998e-05 2024-05-07T14:03:49.649 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.649 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.649 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.650 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2888 3.2 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.650 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:03:49.650 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.702437465, 2024-05-07T14:03:49.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037006981000000001, 2024-05-07T14:03:49.650 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.650 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.650 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.650 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.650 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.650 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2888 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838611+0000", 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.441e-06 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840569+0000", 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019573189999999999 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840592+0000", 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3230999999999998e-05 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840605+0000", 2024-05-07T14:03:49.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.295e-05 2024-05-07T14:03:49.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840681+0000", 2024-05-07T14:03:49.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6250999999999999e-05 2024-05-07T14:03:49.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840821+0000", 2024-05-07T14:03:49.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013997700000000001 2024-05-07T14:03:49.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:49.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840966+0000", 2024-05-07T14:03:49.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144735 2024-05-07T14:03:49.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.846709+0000", 2024-05-07T14:03:49.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057430809999999997 2024-05-07T14:03:49.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875496+0000", 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028787366000000002 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875565+0000", 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8460000000000005e-05 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875616+0000", 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.117e-05 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.655 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.656 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2893 3.2 3:40c39b87:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:49.656 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.900696+0000", 2024-05-07T14:03:49.656 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.6403506619999999, 2024-05-07T14:03:49.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016827781, 2024-05-07T14:03:49.656 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:49.656 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:49.656 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:49.656 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:49.656 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:49.657 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:49.657 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2893 2024-05-07T14:03:49.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.657 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:49.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:49.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.900696+0000", 2024-05-07T14:03:49.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:49.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.900696+0000", 2024-05-07T14:03:49.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:49.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:49.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.900699+0000", 2024-05-07T14:03:49.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1970000000000001e-06 2024-05-07T14:03:49.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:49.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902430+0000", 2024-05-07T14:03:49.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017315340000000001 2024-05-07T14:03:49.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:49.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902464+0000", 2024-05-07T14:03:49.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:03:49.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:49.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902479+0000", 2024-05-07T14:03:49.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5006e-05 2024-05-07T14:03:49.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:49.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902553+0000", 2024-05-07T14:03:49.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4771999999999995e-05 2024-05-07T14:03:49.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:49.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902672+0000", 2024-05-07T14:03:49.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118689 2024-05-07T14:03:49.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:49.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902766+0000", 2024-05-07T14:03:49.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3740999999999996e-05 2024-05-07T14:03:49.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:49.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.911985+0000", 2024-05-07T14:03:49.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092191479999999999 2024-05-07T14:03:49.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.917405+0000", 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054204190000000001 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.917474+0000", 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9012999999999998e-05 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.917523+0000", 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9118e-05 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.662 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.663 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.663 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:49.663 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:49.663 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:49.663 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:03:49.664 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:49.675+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:49.665 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:49.734 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:03:49.765 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:49.775+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:49.835 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:49.835 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:49.835 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:49.835 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:49.849 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:49.866 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:49.879+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:49.961 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:49.961 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:49.961 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:49.961 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:49.961 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:49.970 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:49.975+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:49.974 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:50.029 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:03:50.035 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:03:50.044 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-05-07T14:03:49.749516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2114663260,"num_objects":704,"num_object_clones":0,"num_object_copies":1408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":704,"num_whiteouts":0,"num_read":2671,"num_read_kb":2371,"num_write":1700,"num_write_kb":2091651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":121,"num_bytes_recovered":71899899,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2525,"ondisk_log_size":2525,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4389796,"kb_used_data":4140364,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":750584924,"statfs":{"total":773094113280,"available":768598962176,"internally_reserved":0,"allocated":4239732736,"data_stored":4235156991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":52,"apply_latency_ms":52,"commit_latency_ns":52000000,"apply_latency_ns":52000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1044443232,"num_objects":236,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":236,"num_whiteouts":0,"num_read":156,"num_read_kb":151,"num_write":290,"num_write_kb":1024063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.036755"},"pg_stats":[{"pgid":"3.3f","version":"105'8","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.746479+0000","last_change":"2024-05-07T14:00:55.983744+0000","last_active":"2024-05-07T14:03:46.746479+0000","last_peered":"2024-05-07T14:03:46.746479+0000","last_clean":"2024-05-07T14:03:46.746479+0000","last_became_active":"2024-05-07T14:00:55.982993+0000","last_became_peered":"2024-05-07T14:00:55.982993+0000","last_unstale":"2024-05-07T14:03:46.746479+0000","last_undegraded":"2024-05-07T14:03:46.746479+0000","last_fullsized":"2024-05-07T14:03:46.746479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'2","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.759557+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:03:46.759557+0000","last_peered":"2024-05-07T14:03:46.759557+0000","last_clean":"2024-05-07T14:03:46.759557+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:03:46.759557+0000","last_undegraded":"2024-05-07T14:03:46.759557+0000","last_fullsized":"2024-05-07T14:03:46.759557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"105'9","reported_seq":35,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748670+0000","last_change":"2024-05-07T14:03:39.850495+0000","last_active":"2024-05-07T14:03:46.748670+0000","last_peered":"2024-05-07T14:03:46.748670+0000","last_clean":"2024-05-07T14:03:46.748670+0000","last_became_active":"2024-05-07T14:03:39.676092+0000","last_became_peered":"2024-05-07T14:03:39.676092+0000","last_unstale":"2024-05-07T14:03:46.748670+0000","last_undegraded":"2024-05-07T14:03:46.748670+0000","last_fullsized":"2024-05-07T14:03:46.748670+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:00.668304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"80'2","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743908+0000","last_change":"2024-05-07T14:00:57.988092+0000","last_active":"2024-05-07T14:03:46.743908+0000","last_peered":"2024-05-07T14:03:46.743908+0000","last_clean":"2024-05-07T14:03:46.743908+0000","last_became_active":"2024-05-07T14:00:57.987091+0000","last_became_peered":"2024-05-07T14:00:57.987091+0000","last_unstale":"2024-05-07T14:03:46.743908+0000","last_undegraded":"2024-05-07T14:03:46.743908+0000","last_fullsized":"2024-05-07T14:03:46.743908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"105'6","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751602+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:03:46.751602+0000","last_peered":"2024-05-07T14:03:46.751602+0000","last_clean":"2024-05-07T14:03:46.751602+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:03:46.751602+0000","last_undegraded":"2024-05-07T14:03:46.751602+0000","last_fullsized":"2024-05-07T14:03:46.751602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'2","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743185+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:03:46.743185+0000","last_peered":"2024-05-07T14:03:46.743185+0000","last_clean":"2024-05-07T14:03:46.743185+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:03:46.743185+0000","last_undegraded":"2024-05-07T14:03:46.743185+0000","last_fullsized":"2024-05-07T14:03:46.743185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"105'6","reported_seq":185,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.762151+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:03:46.762151+0000","last_peered":"2024-05-07T14:03:46.762151+0000","last_clean":"2024-05-07T14:03:46.762151+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:03:46.762151+0000","last_undegraded":"2024-05-07T14:03:46.762151+0000","last_fullsized":"2024-05-07T14:03:46.762151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"81'2","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.750968+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:03:46.750968+0000","last_peered":"2024-05-07T14:03:46.750968+0000","last_clean":"2024-05-07T14:03:46.750968+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:03:46.750968+0000","last_undegraded":"2024-05-07T14:03:46.750968+0000","last_fullsized":"2024-05-07T14:03:46.750968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"105'10","reported_seq":189,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.745213+0000","last_change":"2024-05-07T14:00:55.973419+0000","last_active":"2024-05-07T14:03:46.745213+0000","last_peered":"2024-05-07T14:03:46.745213+0000","last_clean":"2024-05-07T14:03:46.745213+0000","last_became_active":"2024-05-07T14:00:55.963467+0000","last_became_peered":"2024-05-07T14:00:55.963467+0000","last_unstale":"2024-05-07T14:03:46.745213+0000","last_undegraded":"2024-05-07T14:03:46.745213+0000","last_fullsized":"2024-05-07T14:03:46.745213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"81'2","reported_seq":182,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.790075+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:03:46.790075+0000","last_peered":"2024-05-07T14:03:46.790075+0000","last_clean":"2024-05-07T14:03:46.790075+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:03:46.790075+0000","last_undegraded":"2024-05-07T14:03:46.790075+0000","last_fullsized":"2024-05-07T14:03:46.790075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"105'6","reported_seq":185,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760007+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:03:46.760007+0000","last_peered":"2024-05-07T14:03:46.760007+0000","last_clean":"2024-05-07T14:03:46.760007+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:03:46.760007+0000","last_undegraded":"2024-05-07T14:03:46.760007+0000","last_fullsized":"2024-05-07T14:03:46.760007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"81'2","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742958+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:03:46.742958+0000","last_peered":"2024-05-07T14:03:46.742958+0000","last_clean":"2024-05-07T14:03:46.742958+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:03:46.742958+0000","last_undegraded":"2024-05-07T14:03:46.742958+0000","last_fullsized":"2024-05-07T14:03:46.742958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"105'6","reported_seq":185,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.744144+0000","last_change":"2024-05-07T14:00:55.962579+0000","last_active":"2024-05-07T14:03:46.744144+0000","last_peered":"2024-05-07T14:03:46.744144+0000","last_clean":"2024-05-07T14:03:46.744144+0000","last_became_active":"2024-05-07T14:00:55.961815+0000","last_became_peered":"2024-05-07T14:00:55.961815+0000","last_unstale":"2024-05-07T14:03:46.744144+0000","last_undegraded":"2024-05-07T14:03:46.744144+0000","last_fullsized":"2024-05-07T14:03:46.744144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"81'2","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760680+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:03:46.760680+0000","last_peered":"2024-05-07T14:03:46.760680+0000","last_clean":"2024-05-07T14:03:46.760680+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:03:46.760680+0000","last_undegraded":"2024-05-07T14:03:46.760680+0000","last_fullsized":"2024-05-07T14:03:46.760680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"105'9","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742363+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:03:46.742363+0000","last_peered":"2024-05-07T14:03:46.742363+0000","last_clean":"2024-05-07T14:03:46.742363+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:03:46.742363+0000","last_undegraded":"2024-05-07T14:03:46.742363+0000","last_fullsized":"2024-05-07T14:03:46.742363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"106'2","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.777570+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:03:46.777570+0000","last_peered":"2024-05-07T14:03:46.777570+0000","last_clean":"2024-05-07T14:03:46.777570+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:03:46.777570+0000","last_undegraded":"2024-05-07T14:03:46.777570+0000","last_fullsized":"2024-05-07T14:03:46.777570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742461+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:03:46.742461+0000","last_peered":"2024-05-07T14:03:46.742461+0000","last_clean":"2024-05-07T14:03:46.742461+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:03:46.742461+0000","last_undegraded":"2024-05-07T14:03:46.742461+0000","last_fullsized":"2024-05-07T14:03:46.742461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"105'8","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.746506+0000","last_change":"2024-05-07T14:00:56.003776+0000","last_active":"2024-05-07T14:03:46.746506+0000","last_peered":"2024-05-07T14:03:46.746506+0000","last_clean":"2024-05-07T14:03:46.746506+0000","last_became_active":"2024-05-07T14:00:56.002996+0000","last_became_peered":"2024-05-07T14:00:56.002996+0000","last_unstale":"2024-05-07T14:03:46.746506+0000","last_undegraded":"2024-05-07T14:03:46.746506+0000","last_fullsized":"2024-05-07T14:03:46.746506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:17.583140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":175,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.744039+0000","last_change":"2024-05-07T14:00:57.987026+0000","last_active":"2024-05-07T14:03:46.744039+0000","last_peered":"2024-05-07T14:03:46.744039+0000","last_clean":"2024-05-07T14:03:46.744039+0000","last_became_active":"2024-05-07T14:00:57.986048+0000","last_became_peered":"2024-05-07T14:00:57.986048+0000","last_unstale":"2024-05-07T14:03:46.744039+0000","last_undegraded":"2024-05-07T14:03:46.744039+0000","last_fullsized":"2024-05-07T14:03:46.744039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"105'6","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.790153+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:03:46.790153+0000","last_peered":"2024-05-07T14:03:46.790153+0000","last_clean":"2024-05-07T14:03:46.790153+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:03:46.790153+0000","last_undegraded":"2024-05-07T14:03:46.790153+0000","last_fullsized":"2024-05-07T14:03:46.790153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":175,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760164+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:03:46.760164+0000","last_peered":"2024-05-07T14:03:46.760164+0000","last_clean":"2024-05-07T14:03:46.760164+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:03:46.760164+0000","last_undegraded":"2024-05-07T14:03:46.760164+0000","last_fullsized":"2024-05-07T14:03:46.760164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"105'9","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.790660+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:03:46.790660+0000","last_peered":"2024-05-07T14:03:46.790660+0000","last_clean":"2024-05-07T14:03:46.790660+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:03:46.790660+0000","last_undegraded":"2024-05-07T14:03:46.790660+0000","last_fullsized":"2024-05-07T14:03:46.790660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"81'8","reported_seq":212,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.754241+0000","last_change":"2024-05-07T14:01:37.318563+0000","last_active":"2024-05-07T14:03:46.754241+0000","last_peered":"2024-05-07T14:03:46.754241+0000","last_clean":"2024-05-07T14:03:46.754241+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:03:46.754241+0000","last_undegraded":"2024-05-07T14:03:46.754241+0000","last_fullsized":"2024-05-07T14:03:46.754241+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:27.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"105'9","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742188+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:03:46.742188+0000","last_peered":"2024-05-07T14:03:46.742188+0000","last_clean":"2024-05-07T14:03:46.742188+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:03:46.742188+0000","last_undegraded":"2024-05-07T14:03:46.742188+0000","last_fullsized":"2024-05-07T14:03:46.742188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"106'8","reported_seq":195,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.778608+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:03:46.778608+0000","last_peered":"2024-05-07T14:03:46.778608+0000","last_clean":"2024-05-07T14:03:46.778608+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:03:46.778608+0000","last_undegraded":"2024-05-07T14:03:46.778608+0000","last_fullsized":"2024-05-07T14:03:46.778608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"104'7","reported_seq":186,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742742+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:03:46.742742+0000","last_peered":"2024-05-07T14:03:46.742742+0000","last_clean":"2024-05-07T14:03:46.742742+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:03:46.742742+0000","last_undegraded":"2024-05-07T14:03:46.742742+0000","last_fullsized":"2024-05-07T14:03:46.742742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"106'2","reported_seq":198,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.777034+0000","last_change":"2024-05-07T14:03:39.848413+0000","last_active":"2024-05-07T14:03:46.777034+0000","last_peered":"2024-05-07T14:03:46.777034+0000","last_clean":"2024-05-07T14:03:46.777034+0000","last_became_active":"2024-05-07T14:03:39.663590+0000","last_became_peered":"2024-05-07T14:03:39.663590+0000","last_unstale":"2024-05-07T14:03:46.777034+0000","last_undegraded":"2024-05-07T14:03:46.777034+0000","last_fullsized":"2024-05-07T14:03:46.777034+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:02.675624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"105'4","reported_seq":182,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751065+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:03:46.751065+0000","last_peered":"2024-05-07T14:03:46.751065+0000","last_clean":"2024-05-07T14:03:46.751065+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:03:46.751065+0000","last_undegraded":"2024-05-07T14:03:46.751065+0000","last_fullsized":"2024-05-07T14:03:46.751065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.741659+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:03:46.741659+0000","last_peered":"2024-05-07T14:03:46.741659+0000","last_clean":"2024-05-07T14:03:46.741659+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:03:46.741659+0000","last_undegraded":"2024-05-07T14:03:46.741659+0000","last_fullsized":"2024-05-07T14:03:46.741659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"81'2","reported_seq":201,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743437+0000","last_change":"2024-05-07T14:03:39.857355+0000","last_active":"2024-05-07T14:03:46.743437+0000","last_peered":"2024-05-07T14:03:46.743437+0000","last_clean":"2024-05-07T14:03:46.743437+0000","last_became_active":"2024-05-07T14:03:39.680721+0000","last_became_peered":"2024-05-07T14:03:39.680721+0000","last_unstale":"2024-05-07T14:03:46.743437+0000","last_undegraded":"2024-05-07T14:03:46.743437+0000","last_fullsized":"2024-05-07T14:03:46.743437+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:36.092563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"105'4","reported_seq":131,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.754206+0000","last_change":"2024-05-07T14:01:37.311718+0000","last_active":"2024-05-07T14:03:46.754206+0000","last_peered":"2024-05-07T14:03:46.754206+0000","last_clean":"2024-05-07T14:03:46.754206+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:03:46.754206+0000","last_undegraded":"2024-05-07T14:03:46.754206+0000","last_fullsized":"2024-05-07T14:03:46.754206+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:24.211300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760670+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:03:46.760670+0000","last_peered":"2024-05-07T14:03:46.760670+0000","last_clean":"2024-05-07T14:03:46.760670+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:03:46.760670+0000","last_undegraded":"2024-05-07T14:03:46.760670+0000","last_fullsized":"2024-05-07T14:03:46.760670+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"105'15","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751741+0000","last_change":"2024-05-07T14:01:01.993679+0000","last_active":"2024-05-07T14:03:46.751741+0000","last_peered":"2024-05-07T14:03:46.751741+0000","last_clean":"2024-05-07T14:03:46.751741+0000","last_became_active":"2024-05-07T14:01:01.993241+0000","last_became_peered":"2024-05-07T14:01:01.993241+0000","last_unstale":"2024-05-07T14:03:46.751741+0000","last_undegraded":"2024-05-07T14:03:46.751741+0000","last_fullsized":"2024-05-07T14:03:46.751741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.746027+0000","last_change":"2024-05-07T14:01:04.017472+0000","last_active":"2024-05-07T14:03:46.746027+0000","last_peered":"2024-05-07T14:03:46.746027+0000","last_clean":"2024-05-07T14:03:46.746027+0000","last_became_active":"2024-05-07T14:01:04.016757+0000","last_became_peered":"2024-05-07T14:01:04.016757+0000","last_unstale":"2024-05-07T14:03:46.746027+0000","last_undegraded":"2024-05-07T14:03:46.746027+0000","last_fullsized":"2024-05-07T14:03:46.746027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"106'42","reported_seq":218,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.773854+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:03:46.773854+0000","last_peered":"2024-05-07T14:03:46.773854+0000","last_clean":"2024-05-07T14:03:46.773854+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:03:46.773854+0000","last_undegraded":"2024-05-07T14:03:46.773854+0000","last_fullsized":"2024-05-07T14:03:46.773854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":84,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"81'6","reported_seq":199,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.761846+0000","last_change":"2024-05-07T14:00:57.984789+0000","last_active":"2024-05-07T14:03:46.761846+0000","last_peered":"2024-05-07T14:03:46.761846+0000","last_clean":"2024-05-07T14:03:46.761846+0000","last_became_active":"2024-05-07T14:00:57.983524+0000","last_became_peered":"2024-05-07T14:00:57.983524+0000","last_unstale":"2024-05-07T14:03:46.761846+0000","last_undegraded":"2024-05-07T14:03:46.761846+0000","last_fullsized":"2024-05-07T14:03:46.761846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"105'5","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751072+0000","last_change":"2024-05-07T14:00:55.989797+0000","last_active":"2024-05-07T14:03:46.751072+0000","last_peered":"2024-05-07T14:03:46.751072+0000","last_clean":"2024-05-07T14:03:46.751072+0000","last_became_active":"2024-05-07T14:00:55.989449+0000","last_became_peered":"2024-05-07T14:00:55.989449+0000","last_unstale":"2024-05-07T14:03:46.751072+0000","last_undegraded":"2024-05-07T14:03:46.751072+0000","last_fullsized":"2024-05-07T14:03:46.751072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743566+0000","last_change":"2024-05-07T14:00:59.983880+0000","last_active":"2024-05-07T14:03:46.743566+0000","last_peered":"2024-05-07T14:03:46.743566+0000","last_clean":"2024-05-07T14:03:46.743566+0000","last_became_active":"2024-05-07T14:00:59.983186+0000","last_became_peered":"2024-05-07T14:00:59.983186+0000","last_unstale":"2024-05-07T14:03:46.743566+0000","last_undegraded":"2024-05-07T14:03:46.743566+0000","last_fullsized":"2024-05-07T14:03:46.743566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:27.067433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"81'7","reported_seq":177,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743029+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:03:46.743029+0000","last_peered":"2024-05-07T14:03:46.743029+0000","last_clean":"2024-05-07T14:03:46.743029+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:03:46.743029+0000","last_undegraded":"2024-05-07T14:03:46.743029+0000","last_fullsized":"2024-05-07T14:03:46.743029+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742778+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:03:46.742778+0000","last_peered":"2024-05-07T14:03:46.742778+0000","last_clean":"2024-05-07T14:03:46.742778+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:03:46.742778+0000","last_undegraded":"2024-05-07T14:03:46.742778+0000","last_fullsized":"2024-05-07T14:03:46.742778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"81'6","reported_seq":167,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.750867+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:03:46.750867+0000","last_peered":"2024-05-07T14:03:46.750867+0000","last_clean":"2024-05-07T14:03:46.750867+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:03:46.750867+0000","last_undegraded":"2024-05-07T14:03:46.750867+0000","last_fullsized":"2024-05-07T14:03:46.750867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"81'4","reported_seq":191,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751995+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:03:46.751995+0000","last_peered":"2024-05-07T14:03:46.751995+0000","last_clean":"2024-05-07T14:03:46.751995+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:03:46.751995+0000","last_undegraded":"2024-05-07T14:03:46.751995+0000","last_fullsized":"2024-05-07T14:03:46.751995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"104'4","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.744398+0000","last_change":"2024-05-07T14:00:55.986233+0000","last_active":"2024-05-07T14:03:46.744398+0000","last_peered":"2024-05-07T14:03:46.744398+0000","last_clean":"2024-05-07T14:03:46.744398+0000","last_became_active":"2024-05-07T14:00:55.984927+0000","last_became_peered":"2024-05-07T14:00:55.984927+0000","last_unstale":"2024-05-07T14:03:46.744398+0000","last_undegraded":"2024-05-07T14:03:46.744398+0000","last_fullsized":"2024-05-07T14:03:46.744398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":181,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743755+0000","last_change":"2024-05-07T14:03:39.680812+0000","last_active":"2024-05-07T14:03:46.743755+0000","last_peered":"2024-05-07T14:03:46.743755+0000","last_clean":"2024-05-07T14:03:46.743755+0000","last_became_active":"2024-05-07T14:03:39.680482+0000","last_became_peered":"2024-05-07T14:03:39.680482+0000","last_unstale":"2024-05-07T14:03:46.743755+0000","last_undegraded":"2024-05-07T14:03:46.743755+0000","last_fullsized":"2024-05-07T14:03:46.743755+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:07.705255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"81'13","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.754297+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:03:46.754297+0000","last_peered":"2024-05-07T14:03:46.754297+0000","last_clean":"2024-05-07T14:03:46.754297+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:03:46.754297+0000","last_undegraded":"2024-05-07T14:03:46.754297+0000","last_fullsized":"2024-05-07T14:03:46.754297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"105'111","reported_seq":327,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.745431+0000","last_change":"2024-05-07T14:03:42.705834+0000","last_active":"2024-05-07T14:03:46.745431+0000","last_peered":"2024-05-07T14:03:46.745431+0000","last_clean":"2024-05-07T14:03:46.745431+0000","last_became_active":"2024-05-07T14:03:42.704793+0000","last_became_peered":"2024-05-07T14:03:42.704793+0000","last_unstale":"2024-05-07T14:03:46.745431+0000","last_undegraded":"2024-05-07T14:03:46.745431+0000","last_fullsized":"2024-05-07T14:03:46.745431+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:19:37.967394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743768+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:03:46.743768+0000","last_peered":"2024-05-07T14:03:46.743768+0000","last_clean":"2024-05-07T14:03:46.743768+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:03:46.743768+0000","last_undegraded":"2024-05-07T14:03:46.743768+0000","last_fullsized":"2024-05-07T14:03:46.743768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"87'16","reported_seq":218,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743433+0000","last_change":"2024-05-07T14:00:57.998824+0000","last_active":"2024-05-07T14:03:46.743433+0000","last_peered":"2024-05-07T14:03:46.743433+0000","last_clean":"2024-05-07T14:03:46.743433+0000","last_became_active":"2024-05-07T14:00:57.998316+0000","last_became_peered":"2024-05-07T14:00:57.998316+0000","last_unstale":"2024-05-07T14:03:46.743433+0000","last_undegraded":"2024-05-07T14:03:46.743433+0000","last_fullsized":"2024-05-07T14:03:46.743433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"105'9","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.789336+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:03:46.789336+0000","last_peered":"2024-05-07T14:03:46.789336+0000","last_clean":"2024-05-07T14:03:46.789336+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:03:46.789336+0000","last_undegraded":"2024-05-07T14:03:46.789336+0000","last_fullsized":"2024-05-07T14:03:46.789336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760573+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:03:46.760573+0000","last_peered":"2024-05-07T14:03:46.760573+0000","last_clean":"2024-05-07T14:03:46.760573+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:03:46.760573+0000","last_undegraded":"2024-05-07T14:03:46.760573+0000","last_fullsized":"2024-05-07T14:03:46.760573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"105'15","reported_seq":189,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.745620+0000","last_change":"2024-05-07T14:01:02.151107+0000","last_active":"2024-05-07T14:03:46.745620+0000","last_peered":"2024-05-07T14:03:46.745620+0000","last_clean":"2024-05-07T14:03:46.745620+0000","last_became_active":"2024-05-07T14:01:02.150351+0000","last_became_peered":"2024-05-07T14:01:02.150351+0000","last_unstale":"2024-05-07T14:03:46.745620+0000","last_undegraded":"2024-05-07T14:03:46.745620+0000","last_fullsized":"2024-05-07T14:03:46.745620+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:28:13.159757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"105'107","reported_seq":303,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743788+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:03:46.743788+0000","last_peered":"2024-05-07T14:03:46.743788+0000","last_clean":"2024-05-07T14:03:46.743788+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:03:46.743788+0000","last_undegraded":"2024-05-07T14:03:46.743788+0000","last_fullsized":"2024-05-07T14:03:46.743788+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"81'4","reported_seq":192,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760095+0000","last_change":"2024-05-07T14:00:57.979757+0000","last_active":"2024-05-07T14:03:46.760095+0000","last_peered":"2024-05-07T14:03:46.760095+0000","last_clean":"2024-05-07T14:03:46.760095+0000","last_became_active":"2024-05-07T14:00:57.979030+0000","last_became_peered":"2024-05-07T14:00:57.979030+0000","last_unstale":"2024-05-07T14:03:46.760095+0000","last_undegraded":"2024-05-07T14:03:46.760095+0000","last_fullsized":"2024-05-07T14:03:46.760095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"105'11","reported_seq":190,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.746571+0000","last_change":"2024-05-07T14:00:55.980339+0000","last_active":"2024-05-07T14:03:46.746571+0000","last_peered":"2024-05-07T14:03:46.746571+0000","last_clean":"2024-05-07T14:03:46.746571+0000","last_became_active":"2024-05-07T14:00:55.979609+0000","last_became_peered":"2024-05-07T14:00:55.979609+0000","last_unstale":"2024-05-07T14:03:46.746571+0000","last_undegraded":"2024-05-07T14:03:46.746571+0000","last_fullsized":"2024-05-07T14:03:46.746571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:52.518278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743472+0000","last_change":"2024-05-07T14:00:59.982771+0000","last_active":"2024-05-07T14:03:46.743472+0000","last_peered":"2024-05-07T14:03:46.743472+0000","last_clean":"2024-05-07T14:03:46.743472+0000","last_became_active":"2024-05-07T14:00:59.982018+0000","last_became_peered":"2024-05-07T14:00:59.982018+0000","last_unstale":"2024-05-07T14:03:46.743472+0000","last_undegraded":"2024-05-07T14:03:46.743472+0000","last_fullsized":"2024-05-07T14:03:46.743472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:47.657483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"106'26","reported_seq":205,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.759678+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:03:46.759678+0000","last_peered":"2024-05-07T14:03:46.759678+0000","last_clean":"2024-05-07T14:03:46.759678+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:03:46.759678+0000","last_undegraded":"2024-05-07T14:03:46.759678+0000","last_fullsized":"2024-05-07T14:03:46.759678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.747660+0000","last_change":"2024-05-07T14:03:39.666526+0000","last_active":"2024-05-07T14:03:46.747660+0000","last_peered":"2024-05-07T14:03:46.747660+0000","last_clean":"2024-05-07T14:03:46.747660+0000","last_became_active":"2024-05-07T14:03:39.666160+0000","last_became_peered":"2024-05-07T14:03:39.666160+0000","last_unstale":"2024-05-07T14:03:46.747660+0000","last_undegraded":"2024-05-07T14:03:46.747660+0000","last_fullsized":"2024-05-07T14:03:46.747660+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:44.560061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.762446+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:03:46.762446+0000","last_peered":"2024-05-07T14:03:46.762446+0000","last_clean":"2024-05-07T14:03:46.762446+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:03:46.762446+0000","last_undegraded":"2024-05-07T14:03:46.762446+0000","last_fullsized":"2024-05-07T14:03:46.762446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":175,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.745518+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:03:46.745518+0000","last_peered":"2024-05-07T14:03:46.745518+0000","last_clean":"2024-05-07T14:03:46.745518+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:03:46.745518+0000","last_undegraded":"2024-05-07T14:03:46.745518+0000","last_fullsized":"2024-05-07T14:03:46.745518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"105'12","reported_seq":191,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.746179+0000","last_change":"2024-05-07T14:00:55.980488+0000","last_active":"2024-05-07T14:03:46.746179+0000","last_peered":"2024-05-07T14:03:46.746179+0000","last_clean":"2024-05-07T14:03:46.746179+0000","last_became_active":"2024-05-07T14:00:55.979688+0000","last_became_peered":"2024-05-07T14:00:55.979688+0000","last_unstale":"2024-05-07T14:03:46.746179+0000","last_undegraded":"2024-05-07T14:03:46.746179+0000","last_fullsized":"2024-05-07T14:03:46.746179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:32.453727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":242,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.753822+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:03:46.753822+0000","last_peered":"2024-05-07T14:03:46.753822+0000","last_clean":"2024-05-07T14:03:46.753822+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:03:46.753822+0000","last_undegraded":"2024-05-07T14:03:46.753822+0000","last_fullsized":"2024-05-07T14:03:46.753822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"105'15","reported_seq":189,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742948+0000","last_change":"2024-05-07T14:01:02.014265+0000","last_active":"2024-05-07T14:03:46.742948+0000","last_peered":"2024-05-07T14:03:46.742948+0000","last_clean":"2024-05-07T14:03:46.742948+0000","last_became_active":"2024-05-07T14:01:02.009335+0000","last_became_peered":"2024-05-07T14:01:02.009335+0000","last_unstale":"2024-05-07T14:03:46.742948+0000","last_undegraded":"2024-05-07T14:03:46.742948+0000","last_fullsized":"2024-05-07T14:03:46.742948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742368+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:03:46.742368+0000","last_peered":"2024-05-07T14:03:46.742368+0000","last_clean":"2024-05-07T14:03:46.742368+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:03:46.742368+0000","last_undegraded":"2024-05-07T14:03:46.742368+0000","last_fullsized":"2024-05-07T14:03:46.742368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":158,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.789669+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:03:46.789669+0000","last_peered":"2024-05-07T14:03:46.789669+0000","last_clean":"2024-05-07T14:03:46.789669+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:03:46.789669+0000","last_undegraded":"2024-05-07T14:03:46.789669+0000","last_fullsized":"2024-05-07T14:03:46.789669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"81'6","reported_seq":200,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.790455+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:03:46.790455+0000","last_peered":"2024-05-07T14:03:46.790455+0000","last_clean":"2024-05-07T14:03:46.790455+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:03:46.790455+0000","last_undegraded":"2024-05-07T14:03:46.790455+0000","last_fullsized":"2024-05-07T14:03:46.790455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"105'11","reported_seq":190,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.746087+0000","last_change":"2024-05-07T14:00:56.008026+0000","last_active":"2024-05-07T14:03:46.746087+0000","last_peered":"2024-05-07T14:03:46.746087+0000","last_clean":"2024-05-07T14:03:46.746087+0000","last_became_active":"2024-05-07T14:00:56.007374+0000","last_became_peered":"2024-05-07T14:00:56.007374+0000","last_unstale":"2024-05-07T14:03:46.746087+0000","last_undegraded":"2024-05-07T14:03:46.746087+0000","last_fullsized":"2024-05-07T14:03:46.746087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":170,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.754400+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:03:46.754400+0000","last_peered":"2024-05-07T14:03:46.754400+0000","last_clean":"2024-05-07T14:03:46.754400+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:03:46.754400+0000","last_undegraded":"2024-05-07T14:03:46.754400+0000","last_fullsized":"2024-05-07T14:03:46.754400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"105'21","reported_seq":198,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742596+0000","last_change":"2024-05-07T14:01:01.997489+0000","last_active":"2024-05-07T14:03:46.742596+0000","last_peered":"2024-05-07T14:03:46.742596+0000","last_clean":"2024-05-07T14:03:46.742596+0000","last_became_active":"2024-05-07T14:01:01.994656+0000","last_became_peered":"2024-05-07T14:01:01.994656+0000","last_unstale":"2024-05-07T14:03:46.742596+0000","last_undegraded":"2024-05-07T14:03:46.742596+0000","last_fullsized":"2024-05-07T14:03:46.742596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:44:12.091721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"105'111","reported_seq":326,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.750632+0000","last_change":"2024-05-07T14:03:42.700808+0000","last_active":"2024-05-07T14:03:46.750632+0000","last_peered":"2024-05-07T14:03:46.750632+0000","last_clean":"2024-05-07T14:03:46.750632+0000","last_became_active":"2024-05-07T14:03:42.700324+0000","last_became_peered":"2024-05-07T14:03:42.700324+0000","last_unstale":"2024-05-07T14:03:46.750632+0000","last_undegraded":"2024-05-07T14:03:46.750632+0000","last_fullsized":"2024-05-07T14:03:46.750632+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:47.369543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":158,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751765+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:03:46.751765+0000","last_peered":"2024-05-07T14:03:46.751765+0000","last_clean":"2024-05-07T14:03:46.751765+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:03:46.751765+0000","last_undegraded":"2024-05-07T14:03:46.751765+0000","last_fullsized":"2024-05-07T14:03:46.751765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"81'8","reported_seq":196,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751487+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:03:46.751487+0000","last_peered":"2024-05-07T14:03:46.751487+0000","last_clean":"2024-05-07T14:03:46.751487+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:03:46.751487+0000","last_undegraded":"2024-05-07T14:03:46.751487+0000","last_fullsized":"2024-05-07T14:03:46.751487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"105'11","reported_seq":190,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.762628+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:03:46.762628+0000","last_peered":"2024-05-07T14:03:46.762628+0000","last_clean":"2024-05-07T14:03:46.762628+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:03:46.762628+0000","last_undegraded":"2024-05-07T14:03:46.762628+0000","last_fullsized":"2024-05-07T14:03:46.762628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":170,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.754048+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:03:46.754048+0000","last_peered":"2024-05-07T14:03:46.754048+0000","last_clean":"2024-05-07T14:03:46.754048+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:03:46.754048+0000","last_undegraded":"2024-05-07T14:03:46.754048+0000","last_fullsized":"2024-05-07T14:03:46.754048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"105'25","reported_seq":202,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.750743+0000","last_change":"2024-05-07T14:01:01.995144+0000","last_active":"2024-05-07T14:03:46.750743+0000","last_peered":"2024-05-07T14:03:46.750743+0000","last_clean":"2024-05-07T14:03:46.750743+0000","last_became_active":"2024-05-07T14:01:01.993073+0000","last_became_peered":"2024-05-07T14:01:01.993073+0000","last_unstale":"2024-05-07T14:03:46.750743+0000","last_undegraded":"2024-05-07T14:03:46.750743+0000","last_fullsized":"2024-05-07T14:03:46.750743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:54.795263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.753756+0000","last_change":"2024-05-07T14:01:04.012216+0000","last_active":"2024-05-07T14:03:46.753756+0000","last_peered":"2024-05-07T14:03:46.753756+0000","last_clean":"2024-05-07T14:03:46.753756+0000","last_became_active":"2024-05-07T14:01:04.011476+0000","last_became_peered":"2024-05-07T14:01:04.011476+0000","last_unstale":"2024-05-07T14:03:46.753756+0000","last_undegraded":"2024-05-07T14:03:46.753756+0000","last_fullsized":"2024-05-07T14:03:46.753756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:46.072568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'4","reported_seq":27,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748318+0000","last_change":"2024-05-07T14:03:39.802033+0000","last_active":"2024-05-07T14:03:46.748318+0000","last_peered":"2024-05-07T14:03:46.748318+0000","last_clean":"2024-05-07T14:03:46.748318+0000","last_became_active":"2024-05-07T14:03:39.675695+0000","last_became_peered":"2024-05-07T14:03:39.675695+0000","last_unstale":"2024-05-07T14:03:46.748318+0000","last_undegraded":"2024-05-07T14:03:46.748318+0000","last_fullsized":"2024-05-07T14:03:46.748318+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:22:02.594405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"87'2","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742381+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:03:46.742381+0000","last_peered":"2024-05-07T14:03:46.742381+0000","last_clean":"2024-05-07T14:03:46.742381+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:03:46.742381+0000","last_undegraded":"2024-05-07T14:03:46.742381+0000","last_fullsized":"2024-05-07T14:03:46.742381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"105'11","reported_seq":190,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742430+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:03:46.742430+0000","last_peered":"2024-05-07T14:03:46.742430+0000","last_clean":"2024-05-07T14:03:46.742430+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:03:46.742430+0000","last_undegraded":"2024-05-07T14:03:46.742430+0000","last_fullsized":"2024-05-07T14:03:46.742430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":170,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.754355+0000","last_change":"2024-05-07T14:00:59.992897+0000","last_active":"2024-05-07T14:03:46.754355+0000","last_peered":"2024-05-07T14:03:46.754355+0000","last_clean":"2024-05-07T14:03:46.754355+0000","last_became_active":"2024-05-07T14:00:59.992067+0000","last_became_peered":"2024-05-07T14:00:59.992067+0000","last_unstale":"2024-05-07T14:03:46.754355+0000","last_undegraded":"2024-05-07T14:03:46.754355+0000","last_fullsized":"2024-05-07T14:03:46.754355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:19.526884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"105'19","reported_seq":228,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742883+0000","last_change":"2024-05-07T14:03:39.698456+0000","last_active":"2024-05-07T14:03:46.742883+0000","last_peered":"2024-05-07T14:03:46.742883+0000","last_clean":"2024-05-07T14:03:46.742883+0000","last_became_active":"2024-05-07T14:03:39.663223+0000","last_became_peered":"2024-05-07T14:03:39.663223+0000","last_unstale":"2024-05-07T14:03:46.742883+0000","last_undegraded":"2024-05-07T14:03:46.742883+0000","last_fullsized":"2024-05-07T14:03:46.742883+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:58.582121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751837+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:03:46.751837+0000","last_peered":"2024-05-07T14:03:46.751837+0000","last_clean":"2024-05-07T14:03:46.751837+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:03:46.751837+0000","last_undegraded":"2024-05-07T14:03:46.751837+0000","last_fullsized":"2024-05-07T14:03:46.751837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"106'6","reported_seq":168,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742760+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:03:46.742760+0000","last_peered":"2024-05-07T14:03:46.742760+0000","last_clean":"2024-05-07T14:03:46.742760+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:03:46.742760+0000","last_undegraded":"2024-05-07T14:03:46.742760+0000","last_fullsized":"2024-05-07T14:03:46.742760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"106'12","reported_seq":227,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.786434+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:03:46.786434+0000","last_peered":"2024-05-07T14:03:46.786434+0000","last_clean":"2024-05-07T14:03:46.786434+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:03:46.786434+0000","last_undegraded":"2024-05-07T14:03:46.786434+0000","last_fullsized":"2024-05-07T14:03:46.786434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"104'4","reported_seq":182,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.790772+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:03:46.790772+0000","last_peered":"2024-05-07T14:03:46.790772+0000","last_clean":"2024-05-07T14:03:46.790772+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:03:46.790772+0000","last_undegraded":"2024-05-07T14:03:46.790772+0000","last_fullsized":"2024-05-07T14:03:46.790772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":28,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.747976+0000","last_change":"2024-05-07T14:03:39.714297+0000","last_active":"2024-05-07T14:03:46.747976+0000","last_peered":"2024-05-07T14:03:46.747976+0000","last_clean":"2024-05-07T14:03:46.747976+0000","last_became_active":"2024-05-07T14:03:39.663013+0000","last_became_peered":"2024-05-07T14:03:39.663013+0000","last_unstale":"2024-05-07T14:03:46.747976+0000","last_undegraded":"2024-05-07T14:03:46.747976+0000","last_fullsized":"2024-05-07T14:03:46.747976+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:40:56.207747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"105'22","reported_seq":198,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.754711+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:03:46.754711+0000","last_peered":"2024-05-07T14:03:46.754711+0000","last_clean":"2024-05-07T14:03:46.754711+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:03:46.754711+0000","last_undegraded":"2024-05-07T14:03:46.754711+0000","last_fullsized":"2024-05-07T14:03:46.754711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"105'107","reported_seq":314,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.754485+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:03:46.754485+0000","last_peered":"2024-05-07T14:03:46.754485+0000","last_clean":"2024-05-07T14:03:46.754485+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:03:46.754485+0000","last_undegraded":"2024-05-07T14:03:46.754485+0000","last_fullsized":"2024-05-07T14:03:46.754485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"87'4","reported_seq":164,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.747657+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:03:46.747657+0000","last_peered":"2024-05-07T14:03:46.747657+0000","last_clean":"2024-05-07T14:03:46.747657+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:03:46.747657+0000","last_undegraded":"2024-05-07T14:03:46.747657+0000","last_fullsized":"2024-05-07T14:03:46.747657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"106'8","reported_seq":209,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.774311+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:03:46.774311+0000","last_peered":"2024-05-07T14:03:46.774311+0000","last_clean":"2024-05-07T14:03:46.774311+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:03:46.774311+0000","last_undegraded":"2024-05-07T14:03:46.774311+0000","last_fullsized":"2024-05-07T14:03:46.774311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"105'9","reported_seq":189,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.745301+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:03:46.745301+0000","last_peered":"2024-05-07T14:03:46.745301+0000","last_clean":"2024-05-07T14:03:46.745301+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:03:46.745301+0000","last_undegraded":"2024-05-07T14:03:46.745301+0000","last_fullsized":"2024-05-07T14:03:46.745301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":315,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.761059+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:03:46.761059+0000","last_peered":"2024-05-07T14:03:46.761059+0000","last_clean":"2024-05-07T14:03:46.761059+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:03:46.761059+0000","last_undegraded":"2024-05-07T14:03:46.761059+0000","last_fullsized":"2024-05-07T14:03:46.761059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":142,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":182,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743737+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:03:46.743737+0000","last_peered":"2024-05-07T14:03:46.743737+0000","last_clean":"2024-05-07T14:03:46.743737+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:03:46.743737+0000","last_undegraded":"2024-05-07T14:03:46.743737+0000","last_fullsized":"2024-05-07T14:03:46.743737+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"105'107","reported_seq":305,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.789808+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:03:46.789808+0000","last_peered":"2024-05-07T14:03:46.789808+0000","last_clean":"2024-05-07T14:03:46.789808+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:03:46.789808+0000","last_undegraded":"2024-05-07T14:03:46.789808+0000","last_fullsized":"2024-05-07T14:03:46.789808+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"87'6","reported_seq":169,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743029+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:03:46.743029+0000","last_peered":"2024-05-07T14:03:46.743029+0000","last_clean":"2024-05-07T14:03:46.743029+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:03:46.743029+0000","last_undegraded":"2024-05-07T14:03:46.743029+0000","last_fullsized":"2024-05-07T14:03:46.743029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"87'4","reported_seq":191,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748497+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:03:46.748497+0000","last_peered":"2024-05-07T14:03:46.748497+0000","last_clean":"2024-05-07T14:03:46.748497+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:03:46.748497+0000","last_undegraded":"2024-05-07T14:03:46.748497+0000","last_fullsized":"2024-05-07T14:03:46.748497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"105'10","reported_seq":223,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742218+0000","last_change":"2024-05-07T14:03:39.814768+0000","last_active":"2024-05-07T14:03:46.742218+0000","last_peered":"2024-05-07T14:03:46.742218+0000","last_clean":"2024-05-07T14:03:46.742218+0000","last_became_active":"2024-05-07T14:03:39.666192+0000","last_became_peered":"2024-05-07T14:03:39.666192+0000","last_unstale":"2024-05-07T14:03:46.742218+0000","last_undegraded":"2024-05-07T14:03:46.742218+0000","last_fullsized":"2024-05-07T14:03:46.742218+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:10.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743186+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:03:46.743186+0000","last_peered":"2024-05-07T14:03:46.743186+0000","last_clean":"2024-05-07T14:03:46.743186+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:03:46.743186+0000","last_undegraded":"2024-05-07T14:03:46.743186+0000","last_fullsized":"2024-05-07T14:03:46.743186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"105'23","reported_seq":247,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760402+0000","last_change":"2024-05-07T14:03:39.845058+0000","last_active":"2024-05-07T14:03:46.760402+0000","last_peered":"2024-05-07T14:03:46.760402+0000","last_clean":"2024-05-07T14:03:46.760402+0000","last_became_active":"2024-05-07T14:03:39.673995+0000","last_became_peered":"2024-05-07T14:03:39.673995+0000","last_unstale":"2024-05-07T14:03:46.760402+0000","last_undegraded":"2024-05-07T14:03:46.760402+0000","last_fullsized":"2024-05-07T14:03:46.760402+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:43.919444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.789646+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:03:46.789646+0000","last_peered":"2024-05-07T14:03:46.789646+0000","last_clean":"2024-05-07T14:03:46.789646+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:03:46.789646+0000","last_undegraded":"2024-05-07T14:03:46.789646+0000","last_fullsized":"2024-05-07T14:03:46.789646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":22,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.747865+0000","last_change":"2024-05-07T14:03:39.666268+0000","last_active":"2024-05-07T14:03:46.747865+0000","last_peered":"2024-05-07T14:03:46.747865+0000","last_clean":"2024-05-07T14:03:46.747865+0000","last_became_active":"2024-05-07T14:03:39.665838+0000","last_became_peered":"2024-05-07T14:03:39.665838+0000","last_unstale":"2024-05-07T14:03:46.747865+0000","last_undegraded":"2024-05-07T14:03:46.747865+0000","last_fullsized":"2024-05-07T14:03:46.747865+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:54:00.122392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'2","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.790247+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:03:46.790247+0000","last_peered":"2024-05-07T14:03:46.790247+0000","last_clean":"2024-05-07T14:03:46.790247+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:03:46.790247+0000","last_undegraded":"2024-05-07T14:03:46.790247+0000","last_fullsized":"2024-05-07T14:03:46.790247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":234,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.788319+0000","last_change":"2024-05-07T14:02:39.729323+0000","last_active":"2024-05-07T14:03:46.788319+0000","last_peered":"2024-05-07T14:03:46.788319+0000","last_clean":"2024-05-07T14:03:46.788319+0000","last_became_active":"2024-05-07T14:02:39.728189+0000","last_became_peered":"2024-05-07T14:02:39.728189+0000","last_unstale":"2024-05-07T14:03:46.788319+0000","last_undegraded":"2024-05-07T14:03:46.788319+0000","last_fullsized":"2024-05-07T14:03:46.788319+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:53:59.368912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":185,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760952+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:03:46.760952+0000","last_peered":"2024-05-07T14:03:46.760952+0000","last_clean":"2024-05-07T14:03:46.760952+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:03:46.760952+0000","last_undegraded":"2024-05-07T14:03:46.760952+0000","last_fullsized":"2024-05-07T14:03:46.760952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"105'10","reported_seq":138,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.753881+0000","last_change":"2024-05-07T14:01:37.317794+0000","last_active":"2024-05-07T14:03:46.753881+0000","last_peered":"2024-05-07T14:03:46.753881+0000","last_clean":"2024-05-07T14:03:46.753881+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:03:46.753881+0000","last_undegraded":"2024-05-07T14:03:46.753881+0000","last_fullsized":"2024-05-07T14:03:46.753881+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:17.582561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.745292+0000","last_change":"2024-05-07T14:00:59.988489+0000","last_active":"2024-05-07T14:03:46.745292+0000","last_peered":"2024-05-07T14:03:46.745292+0000","last_clean":"2024-05-07T14:03:46.745292+0000","last_became_active":"2024-05-07T14:00:59.987757+0000","last_became_peered":"2024-05-07T14:00:59.987757+0000","last_unstale":"2024-05-07T14:03:46.745292+0000","last_undegraded":"2024-05-07T14:03:46.745292+0000","last_fullsized":"2024-05-07T14:03:46.745292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"105'32","reported_seq":213,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.761976+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:03:46.761976+0000","last_peered":"2024-05-07T14:03:46.761976+0000","last_clean":"2024-05-07T14:03:46.761976+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:03:46.761976+0000","last_undegraded":"2024-05-07T14:03:46.761976+0000","last_fullsized":"2024-05-07T14:03:46.761976+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751835+0000","last_change":"2024-05-07T14:01:04.007712+0000","last_active":"2024-05-07T14:03:46.751835+0000","last_peered":"2024-05-07T14:03:46.751835+0000","last_clean":"2024-05-07T14:03:46.751835+0000","last_became_active":"2024-05-07T14:01:04.006934+0000","last_became_peered":"2024-05-07T14:01:04.006934+0000","last_unstale":"2024-05-07T14:03:46.751835+0000","last_undegraded":"2024-05-07T14:03:46.751835+0000","last_fullsized":"2024-05-07T14:03:46.751835+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":158,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.788451+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:03:46.788451+0000","last_peered":"2024-05-07T14:03:46.788451+0000","last_clean":"2024-05-07T14:03:46.788451+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:03:46.788451+0000","last_undegraded":"2024-05-07T14:03:46.788451+0000","last_fullsized":"2024-05-07T14:03:46.788451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'2","reported_seq":182,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751983+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:03:46.751983+0000","last_peered":"2024-05-07T14:03:46.751983+0000","last_clean":"2024-05-07T14:03:46.751983+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:03:46.751983+0000","last_undegraded":"2024-05-07T14:03:46.751983+0000","last_fullsized":"2024-05-07T14:03:46.751983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":195,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742121+0000","last_change":"2024-05-07T14:03:39.661648+0000","last_active":"2024-05-07T14:03:46.742121+0000","last_peered":"2024-05-07T14:03:46.742121+0000","last_clean":"2024-05-07T14:03:46.742121+0000","last_became_active":"2024-05-07T14:03:39.660828+0000","last_became_peered":"2024-05-07T14:03:39.660828+0000","last_unstale":"2024-05-07T14:03:46.742121+0000","last_undegraded":"2024-05-07T14:03:46.742121+0000","last_fullsized":"2024-05-07T14:03:46.742121+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:55:55.161988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"105'6","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.750771+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:03:46.750771+0000","last_peered":"2024-05-07T14:03:46.750771+0000","last_clean":"2024-05-07T14:03:46.750771+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:03:46.750771+0000","last_undegraded":"2024-05-07T14:03:46.750771+0000","last_fullsized":"2024-05-07T14:03:46.750771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.762424+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:03:46.762424+0000","last_peered":"2024-05-07T14:03:46.762424+0000","last_clean":"2024-05-07T14:03:46.762424+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:03:46.762424+0000","last_undegraded":"2024-05-07T14:03:46.762424+0000","last_fullsized":"2024-05-07T14:03:46.762424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"105'116","reported_seq":384,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748092+0000","last_change":"2024-05-07T14:03:42.708479+0000","last_active":"2024-05-07T14:03:46.748092+0000","last_peered":"2024-05-07T14:03:46.748092+0000","last_clean":"2024-05-07T14:03:46.748092+0000","last_became_active":"2024-05-07T14:03:42.708117+0000","last_became_peered":"2024-05-07T14:03:42.708117+0000","last_unstale":"2024-05-07T14:03:46.748092+0000","last_undegraded":"2024-05-07T14:03:46.748092+0000","last_fullsized":"2024-05-07T14:03:46.748092+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:19:35.961283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5457,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":151,"num_read_kb":139,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.745529+0000","last_change":"2024-05-07T14:01:04.012527+0000","last_active":"2024-05-07T14:03:46.745529+0000","last_peered":"2024-05-07T14:03:46.745529+0000","last_clean":"2024-05-07T14:03:46.745529+0000","last_became_active":"2024-05-07T14:01:04.007658+0000","last_became_peered":"2024-05-07T14:01:04.007658+0000","last_unstale":"2024-05-07T14:03:46.745529+0000","last_undegraded":"2024-05-07T14:03:46.745529+0000","last_fullsized":"2024-05-07T14:03:46.745529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"80'4","reported_seq":164,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.747767+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:03:46.747767+0000","last_peered":"2024-05-07T14:03:46.747767+0000","last_clean":"2024-05-07T14:03:46.747767+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:03:46.747767+0000","last_undegraded":"2024-05-07T14:03:46.747767+0000","last_fullsized":"2024-05-07T14:03:46.747767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"81'2","reported_seq":26,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748215+0000","last_change":"2024-05-07T14:03:39.711373+0000","last_active":"2024-05-07T14:03:46.748215+0000","last_peered":"2024-05-07T14:03:46.748215+0000","last_clean":"2024-05-07T14:03:46.748215+0000","last_became_active":"2024-05-07T14:03:39.667130+0000","last_became_peered":"2024-05-07T14:03:39.667130+0000","last_unstale":"2024-05-07T14:03:46.748215+0000","last_undegraded":"2024-05-07T14:03:46.748215+0000","last_fullsized":"2024-05-07T14:03:46.748215+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:36.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.753930+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:03:46.753930+0000","last_peered":"2024-05-07T14:03:46.753930+0000","last_clean":"2024-05-07T14:03:46.753930+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:03:46.753930+0000","last_undegraded":"2024-05-07T14:03:46.753930+0000","last_fullsized":"2024-05-07T14:03:46.753930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"104'7","reported_seq":185,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.747612+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:03:46.747612+0000","last_peered":"2024-05-07T14:03:46.747612+0000","last_clean":"2024-05-07T14:03:46.747612+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:03:46.747612+0000","last_undegraded":"2024-05-07T14:03:46.747612+0000","last_fullsized":"2024-05-07T14:03:46.747612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.754493+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:03:46.754493+0000","last_peered":"2024-05-07T14:03:46.754493+0000","last_clean":"2024-05-07T14:03:46.754493+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:03:46.754493+0000","last_undegraded":"2024-05-07T14:03:46.754493+0000","last_fullsized":"2024-05-07T14:03:46.754493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'15","reported_seq":221,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.745738+0000","last_change":"2024-05-07T14:01:02.148182+0000","last_active":"2024-05-07T14:03:46.745738+0000","last_peered":"2024-05-07T14:03:46.745738+0000","last_clean":"2024-05-07T14:03:46.745738+0000","last_became_active":"2024-05-07T14:01:02.147442+0000","last_became_peered":"2024-05-07T14:01:02.147442+0000","last_unstale":"2024-05-07T14:03:46.745738+0000","last_undegraded":"2024-05-07T14:03:46.745738+0000","last_fullsized":"2024-05-07T14:03:46.745738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:30:24.955989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751228+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:03:46.751228+0000","last_peered":"2024-05-07T14:03:46.751228+0000","last_clean":"2024-05-07T14:03:46.751228+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:03:46.751228+0000","last_undegraded":"2024-05-07T14:03:46.751228+0000","last_fullsized":"2024-05-07T14:03:46.751228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742841+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:03:46.742841+0000","last_peered":"2024-05-07T14:03:46.742841+0000","last_clean":"2024-05-07T14:03:46.742841+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:03:46.742841+0000","last_undegraded":"2024-05-07T14:03:46.742841+0000","last_fullsized":"2024-05-07T14:03:46.742841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"81'4","reported_seq":28,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748530+0000","last_change":"2024-05-07T14:03:39.687600+0000","last_active":"2024-05-07T14:03:46.748530+0000","last_peered":"2024-05-07T14:03:46.748530+0000","last_clean":"2024-05-07T14:03:46.748530+0000","last_became_active":"2024-05-07T14:03:39.661295+0000","last_became_peered":"2024-05-07T14:03:39.661295+0000","last_unstale":"2024-05-07T14:03:46.748530+0000","last_undegraded":"2024-05-07T14:03:46.748530+0000","last_fullsized":"2024-05-07T14:03:46.748530+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:17:58.416324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":185,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760871+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:03:46.760871+0000","last_peered":"2024-05-07T14:03:46.760871+0000","last_clean":"2024-05-07T14:03:46.760871+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:03:46.760871+0000","last_undegraded":"2024-05-07T14:03:46.760871+0000","last_fullsized":"2024-05-07T14:03:46.760871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"105'4","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.744639+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:03:46.744639+0000","last_peered":"2024-05-07T14:03:46.744639+0000","last_clean":"2024-05-07T14:03:46.744639+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:03:46.744639+0000","last_undegraded":"2024-05-07T14:03:46.744639+0000","last_fullsized":"2024-05-07T14:03:46.744639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":170,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751278+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:03:46.751278+0000","last_peered":"2024-05-07T14:03:46.751278+0000","last_clean":"2024-05-07T14:03:46.751278+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:03:46.751278+0000","last_undegraded":"2024-05-07T14:03:46.751278+0000","last_fullsized":"2024-05-07T14:03:46.751278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":185,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742882+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:03:46.742882+0000","last_peered":"2024-05-07T14:03:46.742882+0000","last_clean":"2024-05-07T14:03:46.742882+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:03:46.742882+0000","last_undegraded":"2024-05-07T14:03:46.742882+0000","last_fullsized":"2024-05-07T14:03:46.742882+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.790203+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:03:46.790203+0000","last_peered":"2024-05-07T14:03:46.790203+0000","last_clean":"2024-05-07T14:03:46.790203+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:03:46.790203+0000","last_undegraded":"2024-05-07T14:03:46.790203+0000","last_fullsized":"2024-05-07T14:03:46.790203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.759217+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:03:46.759217+0000","last_peered":"2024-05-07T14:03:46.759217+0000","last_clean":"2024-05-07T14:03:46.759217+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:03:46.759217+0000","last_undegraded":"2024-05-07T14:03:46.759217+0000","last_fullsized":"2024-05-07T14:03:46.759217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.747657+0000","last_change":"2024-05-07T14:03:39.659916+0000","last_active":"2024-05-07T14:03:46.747657+0000","last_peered":"2024-05-07T14:03:46.747657+0000","last_clean":"2024-05-07T14:03:46.747657+0000","last_became_active":"2024-05-07T14:03:39.659515+0000","last_became_peered":"2024-05-07T14:03:39.659515+0000","last_unstale":"2024-05-07T14:03:46.747657+0000","last_undegraded":"2024-05-07T14:03:46.747657+0000","last_fullsized":"2024-05-07T14:03:46.747657+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:49:16.796937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"105'8","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.762113+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:03:46.762113+0000","last_peered":"2024-05-07T14:03:46.762113+0000","last_clean":"2024-05-07T14:03:46.762113+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:03:46.762113+0000","last_undegraded":"2024-05-07T14:03:46.762113+0000","last_fullsized":"2024-05-07T14:03:46.762113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748429+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:03:46.748429+0000","last_peered":"2024-05-07T14:03:46.748429+0000","last_clean":"2024-05-07T14:03:46.748429+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:03:46.748429+0000","last_undegraded":"2024-05-07T14:03:46.748429+0000","last_fullsized":"2024-05-07T14:03:46.748429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":170,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751123+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:03:46.751123+0000","last_peered":"2024-05-07T14:03:46.751123+0000","last_clean":"2024-05-07T14:03:46.751123+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:03:46.751123+0000","last_undegraded":"2024-05-07T14:03:46.751123+0000","last_fullsized":"2024-05-07T14:03:46.751123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"105'31","reported_seq":211,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.750854+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:03:46.750854+0000","last_peered":"2024-05-07T14:03:46.750854+0000","last_clean":"2024-05-07T14:03:46.750854+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:03:46.750854+0000","last_undegraded":"2024-05-07T14:03:46.750854+0000","last_fullsized":"2024-05-07T14:03:46.750854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743129+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:03:46.743129+0000","last_peered":"2024-05-07T14:03:46.743129+0000","last_clean":"2024-05-07T14:03:46.743129+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:03:46.743129+0000","last_undegraded":"2024-05-07T14:03:46.743129+0000","last_fullsized":"2024-05-07T14:03:46.743129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751663+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:03:46.751663+0000","last_peered":"2024-05-07T14:03:46.751663+0000","last_clean":"2024-05-07T14:03:46.751663+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:03:46.751663+0000","last_undegraded":"2024-05-07T14:03:46.751663+0000","last_fullsized":"2024-05-07T14:03:46.751663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":174,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751291+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:03:46.751291+0000","last_peered":"2024-05-07T14:03:46.751291+0000","last_clean":"2024-05-07T14:03:46.751291+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:03:46.751291+0000","last_undegraded":"2024-05-07T14:03:46.751291+0000","last_fullsized":"2024-05-07T14:03:46.751291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"105'8","reported_seq":186,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748247+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:03:46.748247+0000","last_peered":"2024-05-07T14:03:46.748247+0000","last_clean":"2024-05-07T14:03:46.748247+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:03:46.748247+0000","last_undegraded":"2024-05-07T14:03:46.748247+0000","last_fullsized":"2024-05-07T14:03:46.748247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":185,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.746417+0000","last_change":"2024-05-07T14:00:49.928907+0000","last_active":"2024-05-07T14:03:46.746417+0000","last_peered":"2024-05-07T14:03:46.746417+0000","last_clean":"2024-05-07T14:03:46.746417+0000","last_became_active":"2024-05-07T14:00:49.928146+0000","last_became_peered":"2024-05-07T14:00:49.928146+0000","last_unstale":"2024-05-07T14:03:46.746417+0000","last_undegraded":"2024-05-07T14:03:46.746417+0000","last_fullsized":"2024-05-07T14:03:46.746417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:07.032835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":170,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.789488+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:03:46.789488+0000","last_peered":"2024-05-07T14:03:46.789488+0000","last_clean":"2024-05-07T14:03:46.789488+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:03:46.789488+0000","last_undegraded":"2024-05-07T14:03:46.789488+0000","last_fullsized":"2024-05-07T14:03:46.789488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":38,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.747473+0000","last_change":"2024-05-07T14:03:39.707679+0000","last_active":"2024-05-07T14:03:46.747473+0000","last_peered":"2024-05-07T14:03:46.747473+0000","last_clean":"2024-05-07T14:03:46.747473+0000","last_became_active":"2024-05-07T14:03:39.664751+0000","last_became_peered":"2024-05-07T14:03:39.664751+0000","last_unstale":"2024-05-07T14:03:46.747473+0000","last_undegraded":"2024-05-07T14:03:46.747473+0000","last_fullsized":"2024-05-07T14:03:46.747473+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:55.535011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"105'111","reported_seq":337,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.783051+0000","last_change":"2024-05-07T14:03:42.707530+0000","last_active":"2024-05-07T14:03:46.783051+0000","last_peered":"2024-05-07T14:03:46.783051+0000","last_clean":"2024-05-07T14:03:46.783051+0000","last_became_active":"2024-05-07T14:03:42.707207+0000","last_became_peered":"2024-05-07T14:03:42.707207+0000","last_unstale":"2024-05-07T14:03:46.783051+0000","last_undegraded":"2024-05-07T14:03:46.783051+0000","last_fullsized":"2024-05-07T14:03:46.783051+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:20:22.698141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743591+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:03:46.743591+0000","last_peered":"2024-05-07T14:03:46.743591+0000","last_clean":"2024-05-07T14:03:46.743591+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:03:46.743591+0000","last_undegraded":"2024-05-07T14:03:46.743591+0000","last_fullsized":"2024-05-07T14:03:46.743591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"81'2","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742464+0000","last_change":"2024-05-07T14:00:57.998539+0000","last_active":"2024-05-07T14:03:46.742464+0000","last_peered":"2024-05-07T14:03:46.742464+0000","last_clean":"2024-05-07T14:03:46.742464+0000","last_became_active":"2024-05-07T14:00:57.998025+0000","last_became_peered":"2024-05-07T14:00:57.998025+0000","last_unstale":"2024-05-07T14:03:46.742464+0000","last_undegraded":"2024-05-07T14:03:46.742464+0000","last_fullsized":"2024-05-07T14:03:46.742464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"105'7","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743284+0000","last_change":"2024-05-07T14:00:55.988508+0000","last_active":"2024-05-07T14:03:46.743284+0000","last_peered":"2024-05-07T14:03:46.743284+0000","last_clean":"2024-05-07T14:03:46.743284+0000","last_became_active":"2024-05-07T14:00:55.988230+0000","last_became_peered":"2024-05-07T14:00:55.988230+0000","last_unstale":"2024-05-07T14:03:46.743284+0000","last_undegraded":"2024-05-07T14:03:46.743284+0000","last_fullsized":"2024-05-07T14:03:46.743284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748407+0000","last_change":"2024-05-07T14:03:39.672724+0000","last_active":"2024-05-07T14:03:46.748407+0000","last_peered":"2024-05-07T14:03:46.748407+0000","last_clean":"2024-05-07T14:03:46.748407+0000","last_became_active":"2024-05-07T14:03:39.671518+0000","last_became_peered":"2024-05-07T14:03:39.671518+0000","last_unstale":"2024-05-07T14:03:46.748407+0000","last_undegraded":"2024-05-07T14:03:46.748407+0000","last_fullsized":"2024-05-07T14:03:46.748407+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:25.485797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743661+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:03:46.743661+0000","last_peered":"2024-05-07T14:03:46.743661+0000","last_clean":"2024-05-07T14:03:46.743661+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:03:46.743661+0000","last_undegraded":"2024-05-07T14:03:46.743661+0000","last_fullsized":"2024-05-07T14:03:46.743661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":182,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743322+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:03:46.743322+0000","last_peered":"2024-05-07T14:03:46.743322+0000","last_clean":"2024-05-07T14:03:46.743322+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:03:46.743322+0000","last_undegraded":"2024-05-07T14:03:46.743322+0000","last_fullsized":"2024-05-07T14:03:46.743322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"105'107","reported_seq":343,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.780608+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:03:46.780608+0000","last_peered":"2024-05-07T14:03:46.780608+0000","last_clean":"2024-05-07T14:03:46.780608+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:03:46.780608+0000","last_undegraded":"2024-05-07T14:03:46.780608+0000","last_fullsized":"2024-05-07T14:03:46.780608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"81'3","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751289+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:03:46.751289+0000","last_peered":"2024-05-07T14:03:46.751289+0000","last_clean":"2024-05-07T14:03:46.751289+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:03:46.751289+0000","last_undegraded":"2024-05-07T14:03:46.751289+0000","last_fullsized":"2024-05-07T14:03:46.751289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"80'2","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.744758+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:03:46.744758+0000","last_peered":"2024-05-07T14:03:46.744758+0000","last_clean":"2024-05-07T14:03:46.744758+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:03:46.744758+0000","last_undegraded":"2024-05-07T14:03:46.744758+0000","last_fullsized":"2024-05-07T14:03:46.744758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"105'8","reported_seq":186,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.752051+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:03:46.752051+0000","last_peered":"2024-05-07T14:03:46.752051+0000","last_clean":"2024-05-07T14:03:46.752051+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:03:46.752051+0000","last_undegraded":"2024-05-07T14:03:46.752051+0000","last_fullsized":"2024-05-07T14:03:46.752051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.791243+0000","last_change":"2024-05-07T14:00:49.938879+0000","last_active":"2024-05-07T14:03:46.791243+0000","last_peered":"2024-05-07T14:03:46.791243+0000","last_clean":"2024-05-07T14:03:46.791243+0000","last_became_active":"2024-05-07T14:00:49.938066+0000","last_became_peered":"2024-05-07T14:00:49.938066+0000","last_unstale":"2024-05-07T14:03:46.791243+0000","last_undegraded":"2024-05-07T14:03:46.791243+0000","last_fullsized":"2024-05-07T14:03:46.791243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742594+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:03:46.742594+0000","last_peered":"2024-05-07T14:03:46.742594+0000","last_clean":"2024-05-07T14:03:46.742594+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:03:46.742594+0000","last_undegraded":"2024-05-07T14:03:46.742594+0000","last_fullsized":"2024-05-07T14:03:46.742594+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"105'38","reported_seq":222,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.744686+0000","last_change":"2024-05-07T14:01:02.148095+0000","last_active":"2024-05-07T14:03:46.744686+0000","last_peered":"2024-05-07T14:03:46.744686+0000","last_clean":"2024-05-07T14:03:46.744686+0000","last_became_active":"2024-05-07T14:01:02.147334+0000","last_became_peered":"2024-05-07T14:01:02.147334+0000","last_unstale":"2024-05-07T14:03:46.744686+0000","last_undegraded":"2024-05-07T14:03:46.744686+0000","last_fullsized":"2024-05-07T14:03:46.744686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":173,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742365+0000","last_change":"2024-05-07T14:03:39.665240+0000","last_active":"2024-05-07T14:03:46.742365+0000","last_peered":"2024-05-07T14:03:46.742365+0000","last_clean":"2024-05-07T14:03:46.742365+0000","last_became_active":"2024-05-07T14:03:39.664810+0000","last_became_peered":"2024-05-07T14:03:39.664810+0000","last_unstale":"2024-05-07T14:03:46.742365+0000","last_undegraded":"2024-05-07T14:03:46.742365+0000","last_fullsized":"2024-05-07T14:03:46.742365+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:18:01.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760333+0000","last_change":"2024-05-07T14:01:06.039788+0000","last_active":"2024-05-07T14:03:46.760333+0000","last_peered":"2024-05-07T14:03:46.760333+0000","last_clean":"2024-05-07T14:03:46.760333+0000","last_became_active":"2024-05-07T14:01:06.039050+0000","last_became_peered":"2024-05-07T14:01:06.039050+0000","last_unstale":"2024-05-07T14:03:46.760333+0000","last_undegraded":"2024-05-07T14:03:46.760333+0000","last_fullsized":"2024-05-07T14:03:46.760333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":158,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751757+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:03:46.751757+0000","last_peered":"2024-05-07T14:03:46.751757+0000","last_clean":"2024-05-07T14:03:46.751757+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:03:46.751757+0000","last_undegraded":"2024-05-07T14:03:46.751757+0000","last_fullsized":"2024-05-07T14:03:46.751757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'8","reported_seq":211,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.744467+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:03:46.744467+0000","last_peered":"2024-05-07T14:03:46.744467+0000","last_clean":"2024-05-07T14:03:46.744467+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:03:46.744467+0000","last_undegraded":"2024-05-07T14:03:46.744467+0000","last_fullsized":"2024-05-07T14:03:46.744467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"104'13","reported_seq":192,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742220+0000","last_change":"2024-05-07T14:00:55.991934+0000","last_active":"2024-05-07T14:03:46.742220+0000","last_peered":"2024-05-07T14:03:46.742220+0000","last_clean":"2024-05-07T14:03:46.742220+0000","last_became_active":"2024-05-07T14:00:55.991303+0000","last_became_peered":"2024-05-07T14:00:55.991303+0000","last_unstale":"2024-05-07T14:03:46.742220+0000","last_undegraded":"2024-05-07T14:03:46.742220+0000","last_fullsized":"2024-05-07T14:03:46.742220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":170,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.747972+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:03:46.747972+0000","last_peered":"2024-05-07T14:03:46.747972+0000","last_clean":"2024-05-07T14:03:46.747972+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:03:46.747972+0000","last_undegraded":"2024-05-07T14:03:46.747972+0000","last_fullsized":"2024-05-07T14:03:46.747972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"105'18","reported_seq":193,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742275+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:03:46.742275+0000","last_peered":"2024-05-07T14:03:46.742275+0000","last_clean":"2024-05-07T14:03:46.742275+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:03:46.742275+0000","last_undegraded":"2024-05-07T14:03:46.742275+0000","last_fullsized":"2024-05-07T14:03:46.742275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742656+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:03:46.742656+0000","last_peered":"2024-05-07T14:03:46.742656+0000","last_clean":"2024-05-07T14:03:46.742656+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:03:46.742656+0000","last_undegraded":"2024-05-07T14:03:46.742656+0000","last_fullsized":"2024-05-07T14:03:46.742656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742793+0000","last_change":"2024-05-07T14:01:06.013974+0000","last_active":"2024-05-07T14:03:46.742793+0000","last_peered":"2024-05-07T14:03:46.742793+0000","last_clean":"2024-05-07T14:03:46.742793+0000","last_became_active":"2024-05-07T14:01:06.013281+0000","last_became_peered":"2024-05-07T14:01:06.013281+0000","last_unstale":"2024-05-07T14:03:46.742793+0000","last_undegraded":"2024-05-07T14:03:46.742793+0000","last_fullsized":"2024-05-07T14:03:46.742793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:46.349394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"106'4","reported_seq":35,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.775434+0000","last_change":"2024-05-07T14:03:39.692877+0000","last_active":"2024-05-07T14:03:46.775434+0000","last_peered":"2024-05-07T14:03:46.775434+0000","last_clean":"2024-05-07T14:03:46.775434+0000","last_became_active":"2024-05-07T14:03:39.663976+0000","last_became_peered":"2024-05-07T14:03:39.663976+0000","last_unstale":"2024-05-07T14:03:46.775434+0000","last_undegraded":"2024-05-07T14:03:46.775434+0000","last_fullsized":"2024-05-07T14:03:46.775434+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:36.548454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"105'7","reported_seq":186,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.745980+0000","last_change":"2024-05-07T14:00:55.968287+0000","last_active":"2024-05-07T14:03:46.745980+0000","last_peered":"2024-05-07T14:03:46.745980+0000","last_clean":"2024-05-07T14:03:46.745980+0000","last_became_active":"2024-05-07T14:00:55.967578+0000","last_became_peered":"2024-05-07T14:00:55.967578+0000","last_unstale":"2024-05-07T14:03:46.745980+0000","last_undegraded":"2024-05-07T14:03:46.745980+0000","last_fullsized":"2024-05-07T14:03:46.745980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742787+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:03:46.742787+0000","last_peered":"2024-05-07T14:03:46.742787+0000","last_clean":"2024-05-07T14:03:46.742787+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:03:46.742787+0000","last_undegraded":"2024-05-07T14:03:46.742787+0000","last_fullsized":"2024-05-07T14:03:46.742787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"97'7","reported_seq":175,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.750741+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:03:46.750741+0000","last_peered":"2024-05-07T14:03:46.750741+0000","last_clean":"2024-05-07T14:03:46.750741+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:03:46.750741+0000","last_undegraded":"2024-05-07T14:03:46.750741+0000","last_fullsized":"2024-05-07T14:03:46.750741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":26,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743828+0000","last_change":"2024-05-07T14:01:04.012628+0000","last_active":"2024-05-07T14:03:46.743828+0000","last_peered":"2024-05-07T14:03:46.743828+0000","last_clean":"2024-05-07T14:03:46.743828+0000","last_became_active":"2024-05-07T14:01:04.011910+0000","last_became_peered":"2024-05-07T14:01:04.011910+0000","last_unstale":"2024-05-07T14:03:46.743828+0000","last_undegraded":"2024-05-07T14:03:46.743828+0000","last_fullsized":"2024-05-07T14:03:46.743828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"106'2","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751438+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:03:46.751438+0000","last_peered":"2024-05-07T14:03:46.751438+0000","last_clean":"2024-05-07T14:03:46.751438+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:03:46.751438+0000","last_undegraded":"2024-05-07T14:03:46.751438+0000","last_fullsized":"2024-05-07T14:03:46.751438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"81'4","reported_seq":192,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742548+0000","last_change":"2024-05-07T14:00:57.999019+0000","last_active":"2024-05-07T14:03:46.742548+0000","last_peered":"2024-05-07T14:03:46.742548+0000","last_clean":"2024-05-07T14:03:46.742548+0000","last_became_active":"2024-05-07T14:00:57.998526+0000","last_became_peered":"2024-05-07T14:00:57.998526+0000","last_unstale":"2024-05-07T14:03:46.742548+0000","last_undegraded":"2024-05-07T14:03:46.742548+0000","last_fullsized":"2024-05-07T14:03:46.742548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:53.708890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"105'4","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760980+0000","last_change":"2024-05-07T14:00:55.999548+0000","last_active":"2024-05-07T14:03:46.760980+0000","last_peered":"2024-05-07T14:03:46.760980+0000","last_clean":"2024-05-07T14:03:46.760980+0000","last_became_active":"2024-05-07T14:00:55.995284+0000","last_became_peered":"2024-05-07T14:00:55.995284+0000","last_unstale":"2024-05-07T14:03:46.760980+0000","last_undegraded":"2024-05-07T14:03:46.760980+0000","last_fullsized":"2024-05-07T14:03:46.760980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.741665+0000","last_change":"2024-05-07T14:00:59.996971+0000","last_active":"2024-05-07T14:03:46.741665+0000","last_peered":"2024-05-07T14:03:46.741665+0000","last_clean":"2024-05-07T14:03:46.741665+0000","last_became_active":"2024-05-07T14:00:59.996254+0000","last_became_peered":"2024-05-07T14:00:59.996254+0000","last_unstale":"2024-05-07T14:03:46.741665+0000","last_undegraded":"2024-05-07T14:03:46.741665+0000","last_fullsized":"2024-05-07T14:03:46.741665+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"105'18","reported_seq":193,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742653+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:03:46.742653+0000","last_peered":"2024-05-07T14:03:46.742653+0000","last_clean":"2024-05-07T14:03:46.742653+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:03:46.742653+0000","last_undegraded":"2024-05-07T14:03:46.742653+0000","last_fullsized":"2024-05-07T14:03:46.742653+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.789265+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:03:46.789265+0000","last_peered":"2024-05-07T14:03:46.789265+0000","last_clean":"2024-05-07T14:03:46.789265+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:03:46.789265+0000","last_undegraded":"2024-05-07T14:03:46.789265+0000","last_fullsized":"2024-05-07T14:03:46.789265+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760157+0000","last_change":"2024-05-07T14:01:06.038138+0000","last_active":"2024-05-07T14:03:46.760157+0000","last_peered":"2024-05-07T14:03:46.760157+0000","last_clean":"2024-05-07T14:03:46.760157+0000","last_became_active":"2024-05-07T14:01:06.030966+0000","last_became_peered":"2024-05-07T14:01:06.030966+0000","last_unstale":"2024-05-07T14:03:46.760157+0000","last_undegraded":"2024-05-07T14:03:46.760157+0000","last_fullsized":"2024-05-07T14:03:46.760157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":39,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.759734+0000","last_change":"2024-05-07T14:03:39.677172+0000","last_active":"2024-05-07T14:03:46.759734+0000","last_peered":"2024-05-07T14:03:46.759734+0000","last_clean":"2024-05-07T14:03:46.759734+0000","last_became_active":"2024-05-07T14:03:39.663090+0000","last_became_peered":"2024-05-07T14:03:39.663090+0000","last_unstale":"2024-05-07T14:03:46.759734+0000","last_undegraded":"2024-05-07T14:03:46.759734+0000","last_fullsized":"2024-05-07T14:03:46.759734+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:31:56.826421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"105'8","reported_seq":135,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.754761+0000","last_change":"2024-05-07T14:01:37.318408+0000","last_active":"2024-05-07T14:03:46.754761+0000","last_peered":"2024-05-07T14:03:46.754761+0000","last_clean":"2024-05-07T14:03:46.754761+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:03:46.754761+0000","last_undegraded":"2024-05-07T14:03:46.754761+0000","last_fullsized":"2024-05-07T14:03:46.754761+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:43.643434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":170,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.788787+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:03:46.788787+0000","last_peered":"2024-05-07T14:03:46.788787+0000","last_clean":"2024-05-07T14:03:46.788787+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:03:46.788787+0000","last_undegraded":"2024-05-07T14:03:46.788787+0000","last_fullsized":"2024-05-07T14:03:46.788787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"105'15","reported_seq":189,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743007+0000","last_change":"2024-05-07T14:01:01.995377+0000","last_active":"2024-05-07T14:03:46.743007+0000","last_peered":"2024-05-07T14:03:46.743007+0000","last_clean":"2024-05-07T14:03:46.743007+0000","last_became_active":"2024-05-07T14:01:01.994566+0000","last_became_peered":"2024-05-07T14:01:01.994566+0000","last_unstale":"2024-05-07T14:03:46.743007+0000","last_undegraded":"2024-05-07T14:03:46.743007+0000","last_fullsized":"2024-05-07T14:03:46.743007+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:59.028621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.750765+0000","last_change":"2024-05-07T14:01:03.997116+0000","last_active":"2024-05-07T14:03:46.750765+0000","last_peered":"2024-05-07T14:03:46.750765+0000","last_clean":"2024-05-07T14:03:46.750765+0000","last_became_active":"2024-05-07T14:01:03.996555+0000","last_became_peered":"2024-05-07T14:01:03.996555+0000","last_unstale":"2024-05-07T14:03:46.750765+0000","last_undegraded":"2024-05-07T14:03:46.750765+0000","last_fullsized":"2024-05-07T14:03:46.750765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":174,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.790827+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:03:46.790827+0000","last_peered":"2024-05-07T14:03:46.790827+0000","last_clean":"2024-05-07T14:03:46.790827+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:03:46.790827+0000","last_undegraded":"2024-05-07T14:03:46.790827+0000","last_fullsized":"2024-05-07T14:03:46.790827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"105'12","reported_seq":192,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742218+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:03:46.742218+0000","last_peered":"2024-05-07T14:03:46.742218+0000","last_clean":"2024-05-07T14:03:46.742218+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:03:46.742218+0000","last_undegraded":"2024-05-07T14:03:46.742218+0000","last_fullsized":"2024-05-07T14:03:46.742218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":170,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751864+0000","last_change":"2024-05-07T14:00:59.995694+0000","last_active":"2024-05-07T14:03:46.751864+0000","last_peered":"2024-05-07T14:03:46.751864+0000","last_clean":"2024-05-07T14:03:46.751864+0000","last_became_active":"2024-05-07T14:00:59.993899+0000","last_became_peered":"2024-05-07T14:00:59.993899+0000","last_unstale":"2024-05-07T14:03:46.751864+0000","last_undegraded":"2024-05-07T14:03:46.751864+0000","last_fullsized":"2024-05-07T14:03:46.751864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:28.225348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"105'24","reported_seq":201,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748101+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:03:46.748101+0000","last_peered":"2024-05-07T14:03:46.748101+0000","last_clean":"2024-05-07T14:03:46.748101+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:03:46.748101+0000","last_undegraded":"2024-05-07T14:03:46.748101+0000","last_fullsized":"2024-05-07T14:03:46.748101+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.761746+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:03:46.761746+0000","last_peered":"2024-05-07T14:03:46.761746+0000","last_clean":"2024-05-07T14:03:46.761746+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:03:46.761746+0000","last_undegraded":"2024-05-07T14:03:46.761746+0000","last_fullsized":"2024-05-07T14:03:46.761746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"81'2","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742548+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:03:46.742548+0000","last_peered":"2024-05-07T14:03:46.742548+0000","last_clean":"2024-05-07T14:03:46.742548+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:03:46.742548+0000","last_undegraded":"2024-05-07T14:03:46.742548+0000","last_fullsized":"2024-05-07T14:03:46.742548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"87'6","reported_seq":200,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751911+0000","last_change":"2024-05-07T14:00:57.995989+0000","last_active":"2024-05-07T14:03:46.751911+0000","last_peered":"2024-05-07T14:03:46.751911+0000","last_clean":"2024-05-07T14:03:46.751911+0000","last_became_active":"2024-05-07T14:00:57.995721+0000","last_became_peered":"2024-05-07T14:00:57.995721+0000","last_unstale":"2024-05-07T14:03:46.751911+0000","last_undegraded":"2024-05-07T14:03:46.751911+0000","last_fullsized":"2024-05-07T14:03:46.751911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"105'7","reported_seq":185,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748005+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:03:46.748005+0000","last_peered":"2024-05-07T14:03:46.748005+0000","last_clean":"2024-05-07T14:03:46.748005+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:03:46.748005+0000","last_undegraded":"2024-05-07T14:03:46.748005+0000","last_fullsized":"2024-05-07T14:03:46.748005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":170,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.790444+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:03:46.790444+0000","last_peered":"2024-05-07T14:03:46.790444+0000","last_clean":"2024-05-07T14:03:46.790444+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:03:46.790444+0000","last_undegraded":"2024-05-07T14:03:46.790444+0000","last_fullsized":"2024-05-07T14:03:46.790444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"105'21","reported_seq":198,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.745240+0000","last_change":"2024-05-07T14:01:02.002384+0000","last_active":"2024-05-07T14:03:46.745240+0000","last_peered":"2024-05-07T14:03:46.745240+0000","last_clean":"2024-05-07T14:03:46.745240+0000","last_became_active":"2024-05-07T14:01:02.001676+0000","last_became_peered":"2024-05-07T14:01:02.001676+0000","last_unstale":"2024-05-07T14:03:46.745240+0000","last_undegraded":"2024-05-07T14:03:46.745240+0000","last_fullsized":"2024-05-07T14:03:46.745240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748212+0000","last_change":"2024-05-07T14:03:39.667564+0000","last_active":"2024-05-07T14:03:46.748212+0000","last_peered":"2024-05-07T14:03:46.748212+0000","last_clean":"2024-05-07T14:03:46.748212+0000","last_became_active":"2024-05-07T14:03:39.666888+0000","last_became_peered":"2024-05-07T14:03:39.666888+0000","last_unstale":"2024-05-07T14:03:46.748212+0000","last_undegraded":"2024-05-07T14:03:46.748212+0000","last_fullsized":"2024-05-07T14:03:46.748212+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:33.367980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":158,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.788900+0000","last_change":"2024-05-07T14:01:06.025917+0000","last_active":"2024-05-07T14:03:46.788900+0000","last_peered":"2024-05-07T14:03:46.788900+0000","last_clean":"2024-05-07T14:03:46.788900+0000","last_became_active":"2024-05-07T14:01:06.025044+0000","last_became_peered":"2024-05-07T14:01:06.025044+0000","last_unstale":"2024-05-07T14:03:46.788900+0000","last_undegraded":"2024-05-07T14:03:46.788900+0000","last_fullsized":"2024-05-07T14:03:46.788900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:55.419668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"81'4","reported_seq":191,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743157+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:03:46.743157+0000","last_peered":"2024-05-07T14:03:46.743157+0000","last_clean":"2024-05-07T14:03:46.743157+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:03:46.743157+0000","last_undegraded":"2024-05-07T14:03:46.743157+0000","last_fullsized":"2024-05-07T14:03:46.743157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"105'12","reported_seq":191,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.744360+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:03:46.744360+0000","last_peered":"2024-05-07T14:03:46.744360+0000","last_clean":"2024-05-07T14:03:46.744360+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:03:46.744360+0000","last_undegraded":"2024-05-07T14:03:46.744360+0000","last_fullsized":"2024-05-07T14:03:46.744360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742691+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:03:46.742691+0000","last_peered":"2024-05-07T14:03:46.742691+0000","last_clean":"2024-05-07T14:03:46.742691+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:03:46.742691+0000","last_undegraded":"2024-05-07T14:03:46.742691+0000","last_fullsized":"2024-05-07T14:03:46.742691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"105'17","reported_seq":192,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743673+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:03:46.743673+0000","last_peered":"2024-05-07T14:03:46.743673+0000","last_clean":"2024-05-07T14:03:46.743673+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:03:46.743673+0000","last_undegraded":"2024-05-07T14:03:46.743673+0000","last_fullsized":"2024-05-07T14:03:46.743673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748748+0000","last_change":"2024-05-07T14:03:39.664184+0000","last_active":"2024-05-07T14:03:46.748748+0000","last_peered":"2024-05-07T14:03:46.748748+0000","last_clean":"2024-05-07T14:03:46.748748+0000","last_became_active":"2024-05-07T14:03:39.663569+0000","last_became_peered":"2024-05-07T14:03:39.663569+0000","last_unstale":"2024-05-07T14:03:46.748748+0000","last_undegraded":"2024-05-07T14:03:46.748748+0000","last_fullsized":"2024-05-07T14:03:46.748748+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:51.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.759522+0000","last_change":"2024-05-07T14:01:06.038979+0000","last_active":"2024-05-07T14:03:46.759522+0000","last_peered":"2024-05-07T14:03:46.759522+0000","last_clean":"2024-05-07T14:03:46.759522+0000","last_became_active":"2024-05-07T14:01:06.035737+0000","last_became_peered":"2024-05-07T14:01:06.035737+0000","last_unstale":"2024-05-07T14:03:46.759522+0000","last_undegraded":"2024-05-07T14:03:46.759522+0000","last_fullsized":"2024-05-07T14:03:46.759522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"87'8","reported_seq":209,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.754466+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:03:46.754466+0000","last_peered":"2024-05-07T14:03:46.754466+0000","last_clean":"2024-05-07T14:03:46.754466+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:03:46.754466+0000","last_undegraded":"2024-05-07T14:03:46.754466+0000","last_fullsized":"2024-05-07T14:03:46.754466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"105'10","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.750860+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:03:46.750860+0000","last_peered":"2024-05-07T14:03:46.750860+0000","last_clean":"2024-05-07T14:03:46.750860+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:03:46.750860+0000","last_undegraded":"2024-05-07T14:03:46.750860+0000","last_fullsized":"2024-05-07T14:03:46.750860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":170,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748308+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:03:46.748308+0000","last_peered":"2024-05-07T14:03:46.748308+0000","last_clean":"2024-05-07T14:03:46.748308+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:03:46.748308+0000","last_undegraded":"2024-05-07T14:03:46.748308+0000","last_fullsized":"2024-05-07T14:03:46.748308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":182,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743096+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:03:46.743096+0000","last_peered":"2024-05-07T14:03:46.743096+0000","last_clean":"2024-05-07T14:03:46.743096+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:03:46.743096+0000","last_undegraded":"2024-05-07T14:03:46.743096+0000","last_fullsized":"2024-05-07T14:03:46.743096+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"105'107","reported_seq":380,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.789925+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:03:46.789925+0000","last_peered":"2024-05-07T14:03:46.789925+0000","last_clean":"2024-05-07T14:03:46.789925+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:03:46.789925+0000","last_undegraded":"2024-05-07T14:03:46.789925+0000","last_fullsized":"2024-05-07T14:03:46.789925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"81'7","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.741696+0000","last_change":"2024-05-07T14:01:06.037755+0000","last_active":"2024-05-07T14:03:46.741696+0000","last_peered":"2024-05-07T14:03:46.741696+0000","last_clean":"2024-05-07T14:03:46.741696+0000","last_became_active":"2024-05-07T14:01:06.037156+0000","last_became_peered":"2024-05-07T14:01:06.037156+0000","last_unstale":"2024-05-07T14:03:46.741696+0000","last_undegraded":"2024-05-07T14:03:46.741696+0000","last_fullsized":"2024-05-07T14:03:46.741696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:30.812423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"106'6","reported_seq":202,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.775854+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:03:46.775854+0000","last_peered":"2024-05-07T14:03:46.775854+0000","last_clean":"2024-05-07T14:03:46.775854+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:03:46.775854+0000","last_undegraded":"2024-05-07T14:03:46.775854+0000","last_fullsized":"2024-05-07T14:03:46.775854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"105'4","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.762302+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:03:46.762302+0000","last_peered":"2024-05-07T14:03:46.762302+0000","last_clean":"2024-05-07T14:03:46.762302+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:03:46.762302+0000","last_undegraded":"2024-05-07T14:03:46.762302+0000","last_fullsized":"2024-05-07T14:03:46.762302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743247+0000","last_change":"2024-05-07T14:00:59.998197+0000","last_active":"2024-05-07T14:03:46.743247+0000","last_peered":"2024-05-07T14:03:46.743247+0000","last_clean":"2024-05-07T14:03:46.743247+0000","last_became_active":"2024-05-07T14:00:59.997438+0000","last_became_peered":"2024-05-07T14:00:59.997438+0000","last_unstale":"2024-05-07T14:03:46.743247+0000","last_undegraded":"2024-05-07T14:03:46.743247+0000","last_fullsized":"2024-05-07T14:03:46.743247+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:29.430229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"105'21","reported_seq":198,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.759583+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:03:46.759583+0000","last_peered":"2024-05-07T14:03:46.759583+0000","last_clean":"2024-05-07T14:03:46.759583+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:03:46.759583+0000","last_undegraded":"2024-05-07T14:03:46.759583+0000","last_fullsized":"2024-05-07T14:03:46.759583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.750549+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:03:46.750549+0000","last_peered":"2024-05-07T14:03:46.750549+0000","last_clean":"2024-05-07T14:03:46.750549+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:03:46.750549+0000","last_undegraded":"2024-05-07T14:03:46.750549+0000","last_fullsized":"2024-05-07T14:03:46.750549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"81'3","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.746597+0000","last_change":"2024-05-07T14:01:06.025913+0000","last_active":"2024-05-07T14:03:46.746597+0000","last_peered":"2024-05-07T14:03:46.746597+0000","last_clean":"2024-05-07T14:03:46.746597+0000","last_became_active":"2024-05-07T14:01:06.025220+0000","last_became_peered":"2024-05-07T14:01:06.025220+0000","last_unstale":"2024-05-07T14:03:46.746597+0000","last_undegraded":"2024-05-07T14:03:46.746597+0000","last_fullsized":"2024-05-07T14:03:46.746597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:03:30.164745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":175,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743439+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:03:46.743439+0000","last_peered":"2024-05-07T14:03:46.743439+0000","last_clean":"2024-05-07T14:03:46.743439+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:03:46.743439+0000","last_undegraded":"2024-05-07T14:03:46.743439+0000","last_fullsized":"2024-05-07T14:03:46.743439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"105'9","reported_seq":189,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.761987+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:03:46.761987+0000","last_peered":"2024-05-07T14:03:46.761987+0000","last_clean":"2024-05-07T14:03:46.761987+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:03:46.761987+0000","last_undegraded":"2024-05-07T14:03:46.761987+0000","last_fullsized":"2024-05-07T14:03:46.761987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760351+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:03:46.760351+0000","last_peered":"2024-05-07T14:03:46.760351+0000","last_clean":"2024-05-07T14:03:46.760351+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:03:46.760351+0000","last_undegraded":"2024-05-07T14:03:46.760351+0000","last_fullsized":"2024-05-07T14:03:46.760351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"105'15","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.750549+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:03:46.750549+0000","last_peered":"2024-05-07T14:03:46.750549+0000","last_clean":"2024-05-07T14:03:46.750549+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:03:46.750549+0000","last_undegraded":"2024-05-07T14:03:46.750549+0000","last_fullsized":"2024-05-07T14:03:46.750549+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.788623+0000","last_change":"2024-05-07T14:01:04.017099+0000","last_active":"2024-05-07T14:03:46.788623+0000","last_peered":"2024-05-07T14:03:46.788623+0000","last_clean":"2024-05-07T14:03:46.788623+0000","last_became_active":"2024-05-07T14:01:04.011036+0000","last_became_peered":"2024-05-07T14:01:04.011036+0000","last_unstale":"2024-05-07T14:03:46.788623+0000","last_undegraded":"2024-05-07T14:03:46.788623+0000","last_fullsized":"2024-05-07T14:03:46.788623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:32.242974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742779+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:03:46.742779+0000","last_peered":"2024-05-07T14:03:46.742779+0000","last_clean":"2024-05-07T14:03:46.742779+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:03:46.742779+0000","last_undegraded":"2024-05-07T14:03:46.742779+0000","last_fullsized":"2024-05-07T14:03:46.742779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"87'6","reported_seq":200,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742648+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:03:46.742648+0000","last_peered":"2024-05-07T14:03:46.742648+0000","last_clean":"2024-05-07T14:03:46.742648+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:03:46.742648+0000","last_undegraded":"2024-05-07T14:03:46.742648+0000","last_fullsized":"2024-05-07T14:03:46.742648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"105'7","reported_seq":186,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743265+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:03:46.743265+0000","last_peered":"2024-05-07T14:03:46.743265+0000","last_clean":"2024-05-07T14:03:46.743265+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:03:46.743265+0000","last_undegraded":"2024-05-07T14:03:46.743265+0000","last_fullsized":"2024-05-07T14:03:46.743265+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.741924+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:03:46.741924+0000","last_peered":"2024-05-07T14:03:46.741924+0000","last_clean":"2024-05-07T14:03:46.741924+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:03:46.741924+0000","last_undegraded":"2024-05-07T14:03:46.741924+0000","last_fullsized":"2024-05-07T14:03:46.741924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"105'11","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743368+0000","last_change":"2024-05-07T14:01:02.013617+0000","last_active":"2024-05-07T14:03:46.743368+0000","last_peered":"2024-05-07T14:03:46.743368+0000","last_clean":"2024-05-07T14:03:46.743368+0000","last_became_active":"2024-05-07T14:01:02.009243+0000","last_became_peered":"2024-05-07T14:01:02.009243+0000","last_unstale":"2024-05-07T14:03:46.743368+0000","last_undegraded":"2024-05-07T14:03:46.743368+0000","last_fullsized":"2024-05-07T14:03:46.743368+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742178+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:03:46.742178+0000","last_peered":"2024-05-07T14:03:46.742178+0000","last_clean":"2024-05-07T14:03:46.742178+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:03:46.742178+0000","last_undegraded":"2024-05-07T14:03:46.742178+0000","last_fullsized":"2024-05-07T14:03:46.742178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"81'8","reported_seq":193,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.746056+0000","last_change":"2024-05-07T14:03:39.823293+0000","last_active":"2024-05-07T14:03:46.746056+0000","last_peered":"2024-05-07T14:03:46.746056+0000","last_clean":"2024-05-07T14:03:46.746056+0000","last_became_active":"2024-05-07T14:03:39.673703+0000","last_became_peered":"2024-05-07T14:03:39.673703+0000","last_unstale":"2024-05-07T14:03:46.746056+0000","last_undegraded":"2024-05-07T14:03:46.746056+0000","last_fullsized":"2024-05-07T14:03:46.746056+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:21.776655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"81'6","reported_seq":199,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742735+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:03:46.742735+0000","last_peered":"2024-05-07T14:03:46.742735+0000","last_clean":"2024-05-07T14:03:46.742735+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:03:46.742735+0000","last_undegraded":"2024-05-07T14:03:46.742735+0000","last_fullsized":"2024-05-07T14:03:46.742735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"105'8","reported_seq":191,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751948+0000","last_change":"2024-05-07T14:01:37.554242+0000","last_active":"2024-05-07T14:03:46.751948+0000","last_peered":"2024-05-07T14:03:46.751948+0000","last_clean":"2024-05-07T14:03:46.751948+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:03:46.751948+0000","last_undegraded":"2024-05-07T14:03:46.751948+0000","last_fullsized":"2024-05-07T14:03:46.751948+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:16:22.149514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":26,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.747484+0000","last_change":"2024-05-07T14:03:39.674947+0000","last_active":"2024-05-07T14:03:46.747484+0000","last_peered":"2024-05-07T14:03:46.747484+0000","last_clean":"2024-05-07T14:03:46.747484+0000","last_became_active":"2024-05-07T14:03:39.659887+0000","last_became_peered":"2024-05-07T14:03:39.659887+0000","last_unstale":"2024-05-07T14:03:46.747484+0000","last_undegraded":"2024-05-07T14:03:46.747484+0000","last_fullsized":"2024-05-07T14:03:46.747484+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:18:06.217561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"105'15","reported_seq":189,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742457+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:03:46.742457+0000","last_peered":"2024-05-07T14:03:46.742457+0000","last_clean":"2024-05-07T14:03:46.742457+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:03:46.742457+0000","last_undegraded":"2024-05-07T14:03:46.742457+0000","last_fullsized":"2024-05-07T14:03:46.742457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.750939+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:03:46.750939+0000","last_peered":"2024-05-07T14:03:46.750939+0000","last_clean":"2024-05-07T14:03:46.750939+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:03:46.750939+0000","last_undegraded":"2024-05-07T14:03:46.750939+0000","last_fullsized":"2024-05-07T14:03:46.750939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742904+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:03:46.742904+0000","last_peered":"2024-05-07T14:03:46.742904+0000","last_clean":"2024-05-07T14:03:46.742904+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:03:46.742904+0000","last_undegraded":"2024-05-07T14:03:46.742904+0000","last_fullsized":"2024-05-07T14:03:46.742904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"87'16","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748313+0000","last_change":"2024-05-07T14:03:39.799013+0000","last_active":"2024-05-07T14:03:46.748313+0000","last_peered":"2024-05-07T14:03:46.748313+0000","last_clean":"2024-05-07T14:03:46.748313+0000","last_became_active":"2024-05-07T14:03:39.671068+0000","last_became_peered":"2024-05-07T14:03:39.671068+0000","last_unstale":"2024-05-07T14:03:46.748313+0000","last_undegraded":"2024-05-07T14:03:46.748313+0000","last_fullsized":"2024-05-07T14:03:46.748313+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:13.746128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"105'8","reported_seq":186,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.789076+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:03:46.789076+0000","last_peered":"2024-05-07T14:03:46.789076+0000","last_clean":"2024-05-07T14:03:46.789076+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:03:46.789076+0000","last_undegraded":"2024-05-07T14:03:46.789076+0000","last_fullsized":"2024-05-07T14:03:46.789076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":22,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748597+0000","last_change":"2024-05-07T14:03:39.661724+0000","last_active":"2024-05-07T14:03:46.748597+0000","last_peered":"2024-05-07T14:03:46.748597+0000","last_clean":"2024-05-07T14:03:46.748597+0000","last_became_active":"2024-05-07T14:03:39.661339+0000","last_became_peered":"2024-05-07T14:03:39.661339+0000","last_unstale":"2024-05-07T14:03:46.748597+0000","last_undegraded":"2024-05-07T14:03:46.748597+0000","last_fullsized":"2024-05-07T14:03:46.748597+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:34.633849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"105'5","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.753831+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:03:46.753831+0000","last_peered":"2024-05-07T14:03:46.753831+0000","last_clean":"2024-05-07T14:03:46.753831+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:03:46.753831+0000","last_undegraded":"2024-05-07T14:03:46.753831+0000","last_fullsized":"2024-05-07T14:03:46.753831+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:01.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"81'6","reported_seq":199,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760907+0000","last_change":"2024-05-07T14:00:57.985233+0000","last_active":"2024-05-07T14:03:46.760907+0000","last_peered":"2024-05-07T14:03:46.760907+0000","last_clean":"2024-05-07T14:03:46.760907+0000","last_became_active":"2024-05-07T14:00:57.984523+0000","last_became_peered":"2024-05-07T14:00:57.984523+0000","last_unstale":"2024-05-07T14:03:46.760907+0000","last_undegraded":"2024-05-07T14:03:46.760907+0000","last_fullsized":"2024-05-07T14:03:46.760907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"105'9","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760584+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:03:46.760584+0000","last_peered":"2024-05-07T14:03:46.760584+0000","last_clean":"2024-05-07T14:03:46.760584+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:03:46.760584+0000","last_undegraded":"2024-05-07T14:03:46.760584+0000","last_fullsized":"2024-05-07T14:03:46.760584+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"81'2","reported_seq":26,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748341+0000","last_change":"2024-05-07T14:03:39.791330+0000","last_active":"2024-05-07T14:03:46.748341+0000","last_peered":"2024-05-07T14:03:46.748341+0000","last_clean":"2024-05-07T14:03:46.748341+0000","last_became_active":"2024-05-07T14:03:39.670031+0000","last_became_peered":"2024-05-07T14:03:39.670031+0000","last_unstale":"2024-05-07T14:03:46.748341+0000","last_undegraded":"2024-05-07T14:03:46.748341+0000","last_fullsized":"2024-05-07T14:03:46.748341+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:56:03.214247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"105'6","reported_seq":185,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751028+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:03:46.751028+0000","last_peered":"2024-05-07T14:03:46.751028+0000","last_clean":"2024-05-07T14:03:46.751028+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:03:46.751028+0000","last_undegraded":"2024-05-07T14:03:46.751028+0000","last_fullsized":"2024-05-07T14:03:46.751028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"81'2","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742944+0000","last_change":"2024-05-07T14:00:57.998054+0000","last_active":"2024-05-07T14:03:46.742944+0000","last_peered":"2024-05-07T14:03:46.742944+0000","last_clean":"2024-05-07T14:03:46.742944+0000","last_became_active":"2024-05-07T14:00:57.997750+0000","last_became_peered":"2024-05-07T14:00:57.997750+0000","last_unstale":"2024-05-07T14:03:46.742944+0000","last_undegraded":"2024-05-07T14:03:46.742944+0000","last_fullsized":"2024-05-07T14:03:46.742944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"105'9","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743684+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:03:46.743684+0000","last_peered":"2024-05-07T14:03:46.743684+0000","last_clean":"2024-05-07T14:03:46.743684+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:03:46.743684+0000","last_undegraded":"2024-05-07T14:03:46.743684+0000","last_fullsized":"2024-05-07T14:03:46.743684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":175,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743669+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:03:46.743669+0000","last_peered":"2024-05-07T14:03:46.743669+0000","last_clean":"2024-05-07T14:03:46.743669+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:03:46.743669+0000","last_undegraded":"2024-05-07T14:03:46.743669+0000","last_fullsized":"2024-05-07T14:03:46.743669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"105'9","reported_seq":36,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.748425+0000","last_change":"2024-05-07T14:03:39.789159+0000","last_active":"2024-05-07T14:03:46.748425+0000","last_peered":"2024-05-07T14:03:46.748425+0000","last_clean":"2024-05-07T14:03:46.748425+0000","last_became_active":"2024-05-07T14:03:39.668790+0000","last_became_peered":"2024-05-07T14:03:39.668790+0000","last_unstale":"2024-05-07T14:03:46.748425+0000","last_undegraded":"2024-05-07T14:03:46.748425+0000","last_fullsized":"2024-05-07T14:03:46.748425+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:14.798045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"81'8","reported_seq":240,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742486+0000","last_change":"2024-05-07T14:03:39.855375+0000","last_active":"2024-05-07T14:03:46.742486+0000","last_peered":"2024-05-07T14:03:46.742486+0000","last_clean":"2024-05-07T14:03:46.742486+0000","last_became_active":"2024-05-07T14:03:39.666451+0000","last_became_peered":"2024-05-07T14:03:39.666451+0000","last_unstale":"2024-05-07T14:03:46.742486+0000","last_undegraded":"2024-05-07T14:03:46.742486+0000","last_fullsized":"2024-05-07T14:03:46.742486+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:37.171990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"105'11","reported_seq":189,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.790248+0000","last_change":"2024-05-07T14:00:55.997287+0000","last_active":"2024-05-07T14:03:46.790248+0000","last_peered":"2024-05-07T14:03:46.790248+0000","last_clean":"2024-05-07T14:03:46.790248+0000","last_became_active":"2024-05-07T14:00:55.996467+0000","last_became_peered":"2024-05-07T14:00:55.996467+0000","last_unstale":"2024-05-07T14:03:46.790248+0000","last_undegraded":"2024-05-07T14:03:46.790248+0000","last_fullsized":"2024-05-07T14:03:46.790248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":174,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.788677+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:03:46.788677+0000","last_peered":"2024-05-07T14:03:46.788677+0000","last_clean":"2024-05-07T14:03:46.788677+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:03:46.788677+0000","last_undegraded":"2024-05-07T14:03:46.788677+0000","last_fullsized":"2024-05-07T14:03:46.788677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"105'8","reported_seq":187,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743530+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:03:46.743530+0000","last_peered":"2024-05-07T14:03:46.743530+0000","last_clean":"2024-05-07T14:03:46.743530+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:03:46.743530+0000","last_undegraded":"2024-05-07T14:03:46.743530+0000","last_fullsized":"2024-05-07T14:03:46.743530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"106'2","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.776476+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:03:46.776476+0000","last_peered":"2024-05-07T14:03:46.776476+0000","last_clean":"2024-05-07T14:03:46.776476+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:03:46.776476+0000","last_undegraded":"2024-05-07T14:03:46.776476+0000","last_fullsized":"2024-05-07T14:03:46.776476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"105'11","reported_seq":191,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760422+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:03:46.760422+0000","last_peered":"2024-05-07T14:03:46.760422+0000","last_clean":"2024-05-07T14:03:46.760422+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:03:46.760422+0000","last_undegraded":"2024-05-07T14:03:46.760422+0000","last_fullsized":"2024-05-07T14:03:46.760422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":191,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.744420+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:03:46.744420+0000","last_peered":"2024-05-07T14:03:46.744420+0000","last_clean":"2024-05-07T14:03:46.744420+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:03:46.744420+0000","last_undegraded":"2024-05-07T14:03:46.744420+0000","last_fullsized":"2024-05-07T14:03:46.744420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"105'7","reported_seq":186,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.743170+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:03:46.743170+0000","last_peered":"2024-05-07T14:03:46.743170+0000","last_clean":"2024-05-07T14:03:46.743170+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:03:46.743170+0000","last_undegraded":"2024-05-07T14:03:46.743170+0000","last_fullsized":"2024-05-07T14:03:46.743170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"106'4","reported_seq":192,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.776779+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:03:46.776779+0000","last_peered":"2024-05-07T14:03:46.776779+0000","last_clean":"2024-05-07T14:03:46.776779+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:03:46.776779+0000","last_undegraded":"2024-05-07T14:03:46.776779+0000","last_fullsized":"2024-05-07T14:03:46.776779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"105'14","reported_seq":193,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760280+0000","last_change":"2024-05-07T14:00:56.001135+0000","last_active":"2024-05-07T14:03:46.760280+0000","last_peered":"2024-05-07T14:03:46.760280+0000","last_clean":"2024-05-07T14:03:46.760280+0000","last_became_active":"2024-05-07T14:00:55.999884+0000","last_became_peered":"2024-05-07T14:00:55.999884+0000","last_unstale":"2024-05-07T14:03:46.760280+0000","last_undegraded":"2024-05-07T14:03:46.760280+0000","last_fullsized":"2024-05-07T14:03:46.760280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":175,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742530+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:03:46.742530+0000","last_peered":"2024-05-07T14:03:46.742530+0000","last_clean":"2024-05-07T14:03:46.742530+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:03:46.742530+0000","last_undegraded":"2024-05-07T14:03:46.742530+0000","last_fullsized":"2024-05-07T14:03:46.742530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"105'10","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751140+0000","last_change":"2024-05-07T14:00:55.989670+0000","last_active":"2024-05-07T14:03:46.751140+0000","last_peered":"2024-05-07T14:03:46.751140+0000","last_clean":"2024-05-07T14:03:46.751140+0000","last_became_active":"2024-05-07T14:00:55.989455+0000","last_became_peered":"2024-05-07T14:00:55.989455+0000","last_unstale":"2024-05-07T14:03:46.751140+0000","last_undegraded":"2024-05-07T14:03:46.751140+0000","last_fullsized":"2024-05-07T14:03:46.751140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"81'6","reported_seq":213,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.744953+0000","last_change":"2024-05-07T14:03:37.848216+0000","last_active":"2024-05-07T14:03:46.744953+0000","last_peered":"2024-05-07T14:03:46.744953+0000","last_clean":"2024-05-07T14:03:46.744953+0000","last_became_active":"2024-05-07T14:03:37.842132+0000","last_became_peered":"2024-05-07T14:03:37.842132+0000","last_unstale":"2024-05-07T14:03:46.744953+0000","last_undegraded":"2024-05-07T14:03:46.744953+0000","last_fullsized":"2024-05-07T14:03:46.744953+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:16.805365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"105'10","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.790321+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:03:46.790321+0000","last_peered":"2024-05-07T14:03:46.790321+0000","last_clean":"2024-05-07T14:03:46.790321+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:03:46.790321+0000","last_undegraded":"2024-05-07T14:03:46.790321+0000","last_fullsized":"2024-05-07T14:03:46.790321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"87'2","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.750800+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:03:46.750800+0000","last_peered":"2024-05-07T14:03:46.750800+0000","last_clean":"2024-05-07T14:03:46.750800+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:03:46.750800+0000","last_undegraded":"2024-05-07T14:03:46.750800+0000","last_fullsized":"2024-05-07T14:03:46.750800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"105'2","reported_seq":181,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.746320+0000","last_change":"2024-05-07T14:00:55.978771+0000","last_active":"2024-05-07T14:03:46.746320+0000","last_peered":"2024-05-07T14:03:46.746320+0000","last_clean":"2024-05-07T14:03:46.746320+0000","last_became_active":"2024-05-07T14:00:55.978000+0000","last_became_peered":"2024-05-07T14:00:55.978000+0000","last_unstale":"2024-05-07T14:03:46.746320+0000","last_undegraded":"2024-05-07T14:03:46.746320+0000","last_fullsized":"2024-05-07T14:03:46.746320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:20.869638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"81'6","reported_seq":201,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.742372+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:03:46.742372+0000","last_peered":"2024-05-07T14:03:46.742372+0000","last_clean":"2024-05-07T14:03:46.742372+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:03:46.742372+0000","last_undegraded":"2024-05-07T14:03:46.742372+0000","last_fullsized":"2024-05-07T14:03:46.742372+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"104'10","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.754652+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:03:46.754652+0000","last_peered":"2024-05-07T14:03:46.754652+0000","last_clean":"2024-05-07T14:03:46.754652+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:03:46.754652+0000","last_undegraded":"2024-05-07T14:03:46.754652+0000","last_fullsized":"2024-05-07T14:03:46.754652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"87'4","reported_seq":193,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.741925+0000","last_change":"2024-05-07T14:00:57.979073+0000","last_active":"2024-05-07T14:03:46.741925+0000","last_peered":"2024-05-07T14:03:46.741925+0000","last_clean":"2024-05-07T14:03:46.741925+0000","last_became_active":"2024-05-07T14:00:57.978215+0000","last_became_peered":"2024-05-07T14:00:57.978215+0000","last_unstale":"2024-05-07T14:03:46.741925+0000","last_undegraded":"2024-05-07T14:03:46.741925+0000","last_fullsized":"2024-05-07T14:03:46.741925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"105'11","reported_seq":190,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.762555+0000","last_change":"2024-05-07T14:00:56.001199+0000","last_active":"2024-05-07T14:03:46.762555+0000","last_peered":"2024-05-07T14:03:46.762555+0000","last_clean":"2024-05-07T14:03:46.762555+0000","last_became_active":"2024-05-07T14:00:56.000434+0000","last_became_peered":"2024-05-07T14:00:56.000434+0000","last_unstale":"2024-05-07T14:03:46.762555+0000","last_undegraded":"2024-05-07T14:03:46.762555+0000","last_fullsized":"2024-05-07T14:03:46.762555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:22:42.808281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"105'9","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.760170+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:03:46.760170+0000","last_peered":"2024-05-07T14:03:46.760170+0000","last_clean":"2024-05-07T14:03:46.760170+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:03:46.760170+0000","last_undegraded":"2024-05-07T14:03:46.760170+0000","last_fullsized":"2024-05-07T14:03:46.760170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"81'2","reported_seq":182,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.751852+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:03:46.751852+0000","last_peered":"2024-05-07T14:03:46.751852+0000","last_clean":"2024-05-07T14:03:46.751852+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:03:46.751852+0000","last_undegraded":"2024-05-07T14:03:46.751852+0000","last_fullsized":"2024-05-07T14:03:46.751852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"105'6","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.747829+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:03:46.747829+0000","last_peered":"2024-05-07T14:03:46.747829+0000","last_clean":"2024-05-07T14:03:46.747829+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:03:46.747829+0000","last_undegraded":"2024-05-07T14:03:46.747829+0000","last_fullsized":"2024-05-07T14:03:46.747829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"106'4","reported_seq":192,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-05-07T14:03:46.778005+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:03:46.778005+0000","last_peered":"2024-05-07T14:03:46.778005+0000","last_clean":"2024-05-07T14:03:46.778005+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:03:46.778005+0000","last_undegraded":"2024-05-07T14:03:46.778005+0000","last_fullsized":"2024-05-07T14:03:46.778005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":263,"num_read_kb":247,"num_write":246,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":141660,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":815,"num_read_kb":577,"num_write":451,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":4494,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":243460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":671,"ondisk_log_size":671,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":251,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1202,"num_read_kb":1178,"num_write":256,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2113929216,"num_objects":506,"num_object_clones":0,"num_object_copies":1012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":506,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":578,"num_write_kb":2088960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4227858432,"data_stored":4227858432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":518,"ondisk_log_size":518,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":653068,"kb_used_data":621888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93718772,"statfs":{"total":96636764160,"available":95968022528,"internally_reserved":0,"allocated":636813312,"data_stored":636232421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":430332,"kb_used_data":399152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93941508,"statfs":{"total":96636764160,"available":96196104192,"internally_reserved":0,"allocated":408731648,"data_stored":408174411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":683752,"kb_used_data":652572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93688088,"statfs":{"total":96636764160,"available":95936602112,"internally_reserved":0,"allocated":668233728,"data_stored":667632832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":630436,"kb_used_data":599260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93741404,"statfs":{"total":96636764160,"available":95991197696,"internally_reserved":0,"allocated":613642240,"data_stored":613098091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":659792,"kb_used_data":628612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712048,"statfs":{"total":96636764160,"available":95961137152,"internally_reserved":0,"allocated":643698688,"data_stored":643114432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347828,"kb_used_data":316648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94024012,"statfs":{"total":96636764160,"available":96280588288,"internally_reserved":0,"allocated":324247552,"data_stored":323697972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413388,"kb_used_data":382212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93958452,"statfs":{"total":96636764160,"available":96213454848,"internally_reserved":0,"allocated":391385088,"data_stored":390802429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":571200,"kb_used_data":540020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93800640,"statfs":{"total":96636764160,"available":96051855360,"internally_reserved":0,"allocated":552980480,"data_stored":552404403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":551550976,"data_stored":551550976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":390070272,"data_stored":390070272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":322961408,"data_stored":322961408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":641728512,"data_stored":641728512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":612368384,"data_stored":612368384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":666894336,"data_stored":666894336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":406847488,"data_stored":406847488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":635437056,"data_stored":635437056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":117239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":59624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:03:50.094 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-07T14:03:50.094 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-07T14:03:50.094 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-05-07T14:03:50.095 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-05-07T14:03:50.096 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:50.107+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:50.101 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:50.101 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:50.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:50.101 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:50.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.101 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:50.101 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:50.102 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 57.80770905, 2024-05-07T14:03:50.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:03:50.102 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.102 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.102 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.102 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.102 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.102 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.102 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:03:50.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.102 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:03:50.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:03:50.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:03:50.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:03:50.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:03:50.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:03:50.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:03:50.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:03:50.107 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.107 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.107 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.108 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2203 3.1e 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:50.108 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:50.108 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.817992705999998, 2024-05-07T14:03:50.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029129142, 2024-05-07T14:03:50.108 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.108 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.108 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.108 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.108 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.108 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.108 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2203 2024-05-07T14:03:50.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.109 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:50.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:50.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294465+0000", 2024-05-07T14:03:50.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7699999999999999e-06 2024-05-07T14:03:50.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300328+0000", 2024-05-07T14:03:50.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058633460000000002 2024-05-07T14:03:50.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300384+0000", 2024-05-07T14:03:50.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6212999999999999e-05 2024-05-07T14:03:50.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300411+0000", 2024-05-07T14:03:50.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7109000000000001e-05 2024-05-07T14:03:50.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300586+0000", 2024-05-07T14:03:50.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017478799999999999 2024-05-07T14:03:50.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300941+0000", 2024-05-07T14:03:50.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035515500000000001 2024-05-07T14:03:50.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:50.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301351+0000", 2024-05-07T14:03:50.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040996099999999997 2024-05-07T14:03:50.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.317495+0000", 2024-05-07T14:03:50.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016143462000000001 2024-05-07T14:03:50.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323421+0000", 2024-05-07T14:03:50.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059264649999999997 2024-05-07T14:03:50.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323498+0000", 2024-05-07T14:03:50.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6478999999999997e-05 2024-05-07T14:03:50.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323590+0000", 2024-05-07T14:03:50.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2393999999999997e-05 2024-05-07T14:03:50.115 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.115 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.115 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.115 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2230 3.b 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:50.115 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:50.115 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.442086035999999, 2024-05-07T14:03:50.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021351564, 2024-05-07T14:03:50.115 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.115 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.115 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.116 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.116 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.116 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.116 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2230 2024-05-07T14:03:50.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.116 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:50.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:50.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670370+0000", 2024-05-07T14:03:50.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5050000000000002e-06 2024-05-07T14:03:50.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673214+0000", 2024-05-07T14:03:50.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028441260000000002 2024-05-07T14:03:50.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673245+0000", 2024-05-07T14:03:50.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0488999999999999e-05 2024-05-07T14:03:50.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673259+0000", 2024-05-07T14:03:50.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4443e-05 2024-05-07T14:03:50.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673356+0000", 2024-05-07T14:03:50.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7031e-05 2024-05-07T14:03:50.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673531+0000", 2024-05-07T14:03:50.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017509099999999999 2024-05-07T14:03:50.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:50.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673696+0000", 2024-05-07T14:03:50.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000164306 2024-05-07T14:03:50.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684776+0000", 2024-05-07T14:03:50.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011080054000000001 2024-05-07T14:03:50.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691578+0000", 2024-05-07T14:03:50.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068025849999999999 2024-05-07T14:03:50.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691659+0000", 2024-05-07T14:03:50.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0976000000000005e-05 2024-05-07T14:03:50.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691719+0000", 2024-05-07T14:03:50.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9957999999999998e-05 2024-05-07T14:03:50.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.122 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.122 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2666 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:03:50.122 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:50.122 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 10.460629150000001, 2024-05-07T14:03:50.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.125351252, 2024-05-07T14:03:50.122 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.123 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.123 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:50.123 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.123 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.123 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.123 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2666 2024-05-07T14:03:50.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.123 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651827+0000", 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-06 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651834+0000", 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7700000000000001e-06 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651850+0000", 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5755000000000001e-05 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651862+0000", 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.237e-05 2024-05-07T14:03:50.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651967+0000", 2024-05-07T14:03:50.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010427199999999999 2024-05-07T14:03:50.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:50.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651977+0000", 2024-05-07T14:03:50.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0743e-05 2024-05-07T14:03:50.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657294+0000", 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053168069999999998 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657305+0000", 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0662000000000001e-05 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774211+0000", 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1169060209999999 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774394+0000", 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018268000000000001 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.777176+0000", 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002782025 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2673 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:03:50.128 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.9166959630000004, 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57934507999999996, 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2673 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9699999999999996e-07 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195761+0000", 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2569999999999999e-06 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195768+0000", 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.489e-06 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195774+0000", 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7389999999999996e-06 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195866+0000", 2024-05-07T14:03:50.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2349000000000006e-05 2024-05-07T14:03:50.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:50.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195878+0000", 2024-05-07T14:03:50.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1838000000000001e-05 2024-05-07T14:03:50.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774802+0000", 2024-05-07T14:03:50.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.578923945 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774906+0000", 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103991 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775103+0000", 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196975 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.134 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2684 3.24 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:50.134 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:03:50.134 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 6.3263350520000001, 2024-05-07T14:03:50.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.040396402999999997, 2024-05-07T14:03:50.134 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.134 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.134 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.134 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.134 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.134 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.134 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2684 2024-05-07T14:03:50.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.135 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:03:50.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:03:50.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786122+0000", 2024-05-07T14:03:50.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0929999999999999e-06 2024-05-07T14:03:50.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788626+0000", 2024-05-07T14:03:50.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025042720000000001 2024-05-07T14:03:50.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788659+0000", 2024-05-07T14:03:50.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2824999999999998e-05 2024-05-07T14:03:50.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788673+0000", 2024-05-07T14:03:50.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4721e-05 2024-05-07T14:03:50.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788768+0000", 2024-05-07T14:03:50.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4178999999999994e-05 2024-05-07T14:03:50.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:50.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788776+0000", 2024-05-07T14:03:50.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2400000000000007e-06 2024-05-07T14:03:50.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798002+0000", 2024-05-07T14:03:50.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092262230000000004 2024-05-07T14:03:50.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798163+0000", 2024-05-07T14:03:50.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161077 2024-05-07T14:03:50.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:50.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798305+0000", 2024-05-07T14:03:50.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014162499999999999 2024-05-07T14:03:50.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.807567+0000", 2024-05-07T14:03:50.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092618869999999999 2024-05-07T14:03:50.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826429+0000", 2024-05-07T14:03:50.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018862824 2024-05-07T14:03:50.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826470+0000", 2024-05-07T14:03:50.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1010999999999997e-05 2024-05-07T14:03:50.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826515+0000", 2024-05-07T14:03:50.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4425999999999998e-05 2024-05-07T14:03:50.142 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.142 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.142 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.142 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2700 3.c e104/21 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:50.143 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:50.143 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 6.1524884059999998, 2024-05-07T14:03:50.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022078321000000001, 2024-05-07T14:03:50.143 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.143 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.143 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.143 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:50.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:50.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.144 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.144 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:50.144 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9299999999999999e-07 2024-05-07T14:03:50.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966313+0000", 2024-05-07T14:03:50.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063471889999999996 2024-05-07T14:03:50.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.145 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.145 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966340+0000", 2024-05-07T14:03:50.145 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7514000000000001e-05 2024-05-07T14:03:50.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966354+0000", 2024-05-07T14:03:50.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4053000000000001e-05 2024-05-07T14:03:50.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.146 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.146 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966434+0000", 2024-05-07T14:03:50.146 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0273999999999997e-05 2024-05-07T14:03:50.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966464+0000", 2024-05-07T14:03:50.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.953e-05 2024-05-07T14:03:50.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.147 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.147 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.981968+0000", 2024-05-07T14:03:50.147 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0155037 2024-05-07T14:03:50.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.148 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.148 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.982043+0000", 2024-05-07T14:03:50.148 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5767999999999997e-05 2024-05-07T14:03:50.148 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.148 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.148 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.148 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2710 3.29 3:9701fed0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:50.148 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:03:50.148 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 6.0406624190000002, 2024-05-07T14:03:50.149 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020865083, 2024-05-07T14:03:50.149 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.149 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.149 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.149 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.149 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.149 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.149 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2710 2024-05-07T14:03:50.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.150 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:03:50.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.150 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.150 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:03:50.150 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071794+0000", 2024-05-07T14:03:50.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.565e-06 2024-05-07T14:03:50.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.151 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.151 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073899+0000", 2024-05-07T14:03:50.151 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002104809 2024-05-07T14:03:50.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073925+0000", 2024-05-07T14:03:50.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6125000000000001e-05 2024-05-07T14:03:50.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.152 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073936+0000", 2024-05-07T14:03:50.152 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0878e-05 2024-05-07T14:03:50.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.152 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074018+0000", 2024-05-07T14:03:50.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2391000000000004e-05 2024-05-07T14:03:50.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074144+0000", 2024-05-07T14:03:50.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012578599999999999 2024-05-07T14:03:50.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.153 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:50.153 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074241+0000", 2024-05-07T14:03:50.153 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7547999999999995e-05 2024-05-07T14:03:50.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.082159+0000", 2024-05-07T14:03:50.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0079176720000000006 2024-05-07T14:03:50.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.154 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.154 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092527+0000", 2024-05-07T14:03:50.154 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010368004 2024-05-07T14:03:50.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092600+0000", 2024-05-07T14:03:50.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3491000000000005e-05 2024-05-07T14:03:50.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.155 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.155 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092656+0000", 2024-05-07T14:03:50.155 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5813999999999998e-05 2024-05-07T14:03:50.155 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.156 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.156 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.156 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2712 3.15 e104/21 3:a83036f0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_29:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:50.156 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:03:50.156 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 6.009098603, 2024-05-07T14:03:50.156 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021527713, 2024-05-07T14:03:50.156 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.156 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.156 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.156 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103357+0000", 2024-05-07T14:03:50.157 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7260000000000001e-06 2024-05-07T14:03:50.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107529+0000", 2024-05-07T14:03:50.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041726999999999997 2024-05-07T14:03:50.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.158 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.158 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107551+0000", 2024-05-07T14:03:50.158 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1854000000000001e-05 2024-05-07T14:03:50.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107563+0000", 2024-05-07T14:03:50.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1362999999999999e-05 2024-05-07T14:03:50.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107633+0000", 2024-05-07T14:03:50.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0432999999999995e-05 2024-05-07T14:03:50.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.159 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.159 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107652+0000", 2024-05-07T14:03:50.159 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9250999999999999e-05 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124797+0000", 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017144626 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124883+0000", 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5760000000000006e-05 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.161 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2726 3.24 3:2710602c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:50.161 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:03:50.161 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.868770219, 2024-05-07T14:03:50.161 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020082965000000001, 2024-05-07T14:03:50.161 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.161 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.161 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.161 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.161 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.161 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.161 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2726 2024-05-07T14:03:50.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.162 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:03:50.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.162 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:03:50.162 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.162 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243686+0000", 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8420000000000001e-06 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245745+0000", 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020592890000000002 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245765+0000", 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9505e-05 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.163 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245777+0000", 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2282e-05 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245842+0000", 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4682000000000002e-05 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245956+0000", 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113875 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.246056+0000", 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100238 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.249971+0000", 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039145179999999996 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263656+0000", 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013685246999999999 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263718+0000", 2024-05-07T14:03:50.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1704000000000004e-05 2024-05-07T14:03:50.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.166 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.166 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263766+0000", 2024-05-07T14:03:50.166 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8782999999999997e-05 2024-05-07T14:03:50.166 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.166 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.166 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.167 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2791 3.27 3:e46b1707:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.167 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:03:50.167 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.1832000599999999, 2024-05-07T14:03:50.167 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022300529999999999, 2024-05-07T14:03:50.167 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.167 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.167 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.167 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.167 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.167 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.167 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2791 2024-05-07T14:03:50.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.168 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:03:50.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.168 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.168 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:03:50.168 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929257+0000", 2024-05-07T14:03:50.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.281e-06 2024-05-07T14:03:50.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.169 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.169 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931305+0000", 2024-05-07T14:03:50.169 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020483020000000001 2024-05-07T14:03:50.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931328+0000", 2024-05-07T14:03:50.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2722e-05 2024-05-07T14:03:50.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.170 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931341+0000", 2024-05-07T14:03:50.170 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3529e-05 2024-05-07T14:03:50.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.170 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931415+0000", 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3597999999999996e-05 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931614+0000", 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019859000000000001 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931758+0000", 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014481699999999999 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.939706+0000", 2024-05-07T14:03:50.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007948063 2024-05-07T14:03:50.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.172 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951424+0000", 2024-05-07T14:03:50.172 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011717708 2024-05-07T14:03:50.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.172 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.173 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951500+0000", 2024-05-07T14:03:50.173 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5831e-05 2024-05-07T14:03:50.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.174 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.174 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951554+0000", 2024-05-07T14:03:50.174 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4088999999999997e-05 2024-05-07T14:03:50.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.174 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.174 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2796 3.18 3:1b781814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.174 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:03:50.175 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.1299513220000001, 2024-05-07T14:03:50.175 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019854381000000001, 2024-05-07T14:03:50.175 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.175 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.175 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.175 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.175 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.175 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.175 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2796 2024-05-07T14:03:50.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.175 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:03:50.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.176 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:03:50.176 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.176 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982505+0000", 2024-05-07T14:03:50.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6070000000000002e-06 2024-05-07T14:03:50.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984438+0000", 2024-05-07T14:03:50.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019332609999999999 2024-05-07T14:03:50.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.177 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.177 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984463+0000", 2024-05-07T14:03:50.177 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4569000000000001e-05 2024-05-07T14:03:50.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984473+0000", 2024-05-07T14:03:50.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8910000000000007e-06 2024-05-07T14:03:50.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.178 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.178 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984549+0000", 2024-05-07T14:03:50.178 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6446999999999995e-05 2024-05-07T14:03:50.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984737+0000", 2024-05-07T14:03:50.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018843399999999999 2024-05-07T14:03:50.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.179 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:50.179 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984832+0000", 2024-05-07T14:03:50.179 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4069999999999999e-05 2024-05-07T14:03:50.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.999695+0000", 2024-05-07T14:03:50.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01486345 2024-05-07T14:03:50.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.180 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.180 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002219+0000", 2024-05-07T14:03:50.180 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002523792 2024-05-07T14:03:50.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002299+0000", 2024-05-07T14:03:50.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0360999999999999e-05 2024-05-07T14:03:50.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.181 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.181 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002357+0000", 2024-05-07T14:03:50.181 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7499e-05 2024-05-07T14:03:50.182 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.182 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.182 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.182 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2800 3.18 3:1851862d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.182 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:03:50.182 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.0900469939999997, 2024-05-07T14:03:50.182 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020357577000000002, 2024-05-07T14:03:50.182 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.183 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.183 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.183 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.183 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.183 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.183 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2800 2024-05-07T14:03:50.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.183 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.183 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.183 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:03:50.183 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022410+0000", 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0079999999999998e-06 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.184 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024625+0000", 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022156350000000001 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024652+0000", 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6715000000000001e-05 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024698+0000", 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6470000000000001e-05 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.185 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024776+0000", 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7960000000000006e-05 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024944+0000", 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016757400000000001 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.025106+0000", 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016191 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.041855+0000", 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016748939000000001 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042642+0000", 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078695000000000002 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042712+0000", 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0154999999999995e-05 2024-05-07T14:03:50.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042764+0000", 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2261e-05 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2817 3.24 3:24a9723e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.9174342639999997, 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020083441, 2024-05-07T14:03:50.188 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2817 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195022+0000", 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4399999999999999e-06 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197097+0000", 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002075173 2024-05-07T14:03:50.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197131+0000", 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3952999999999998e-05 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197148+0000", 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6648000000000001e-05 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197230+0000", 2024-05-07T14:03:50.191 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2341000000000003e-05 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197399+0000", 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168782 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197549+0000", 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000150311 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.192 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.210524+0000", 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012974930000000001 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215027+0000", 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045034979999999999 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215068+0000", 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0846000000000002e-05 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.193 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215103+0000", 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4518999999999999e-05 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2861 3.22 e105/21 3:479e234a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_168:head v 105'7, mlcod=104'5)", 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.5683700639999998, 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021170174999999999, 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.194 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.195 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:03:50.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.195 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:03:50.195 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.195 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544085+0000", 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.815e-06 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548101+0000", 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040158920000000001 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548121+0000", 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9899e-05 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548132+0000", 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0464e-05 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548210+0000", 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8176000000000005e-05 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548229+0000", 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9701999999999999e-05 2024-05-07T14:03:50.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.565217+0000", 2024-05-07T14:03:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016987777999999999 2024-05-07T14:03:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.565254+0000", 2024-05-07T14:03:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6449000000000003e-05 2024-05-07T14:03:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2864 3.29 3:97632e4b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.5374464290000001, 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021723981, 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2864 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575010+0000", 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5660000000000001e-06 2024-05-07T14:03:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576737+0000", 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017271599999999999 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576768+0000", 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1424000000000003e-05 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576783+0000", 2024-05-07T14:03:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4656e-05 2024-05-07T14:03:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576880+0000", 2024-05-07T14:03:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6576999999999994e-05 2024-05-07T14:03:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577067+0000", 2024-05-07T14:03:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018795800000000001 2024-05-07T14:03:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577285+0000", 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021768499999999999 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.587487+0000", 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010202289 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596612+0000", 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0091244440000000007 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596681+0000", 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9025999999999999e-05 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596731+0000", 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0195999999999998e-05 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2865 3.38 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.529828771, 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.035746371999999998, 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2865 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582627+0000", 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584611+0000", 2024-05-07T14:03:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019836350000000001 2024-05-07T14:03:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584636+0000", 2024-05-07T14:03:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4943000000000002e-05 2024-05-07T14:03:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584652+0000", 2024-05-07T14:03:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5586e-05 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584733+0000", 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0987000000000002e-05 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584881+0000", 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014805800000000001 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584972+0000", 2024-05-07T14:03:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1218999999999995e-05 2024-05-07T14:03:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.591149+0000", 2024-05-07T14:03:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061766939999999999 2024-05-07T14:03:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618207+0000", 2024-05-07T14:03:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027058260000000001 2024-05-07T14:03:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618319+0000", 2024-05-07T14:03:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011267700000000001 2024-05-07T14:03:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618371+0000", 2024-05-07T14:03:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1683e-05 2024-05-07T14:03:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2872 3.15 e105/21 3:ab0c6c4f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_179:head v 105'7, mlcod=104'5)", 2024-05-07T14:03:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:03:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.4505079619999997, 2024-05-07T14:03:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020080595999999999, 2024-05-07T14:03:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:03:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:03:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661947+0000", 2024-05-07T14:03:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5099999999999999e-06 2024-05-07T14:03:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667621+0000", 2024-05-07T14:03:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056736269999999997 2024-05-07T14:03:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667649+0000", 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8093e-05 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667661+0000", 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2554999999999999e-05 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667745+0000", 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3301999999999996e-05 2024-05-07T14:03:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667771+0000", 2024-05-07T14:03:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6135999999999998e-05 2024-05-07T14:03:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.681960+0000", 2024-05-07T14:03:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014189301 2024-05-07T14:03:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.682026+0000", 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6072e-05 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2883 3.29 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.3346651329999997, 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025309511999999999, 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2883 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:03:50.217 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.218 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.218 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777791+0000", 2024-05-07T14:03:50.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.289e-06 2024-05-07T14:03:50.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.218 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.218 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779027+0000", 2024-05-07T14:03:50.218 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001236411 2024-05-07T14:03:50.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.218 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779063+0000", 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5658999999999999e-05 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779076+0000", 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3128e-05 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779166+0000", 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9818e-05 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779398+0000", 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023189400000000001 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779577+0000", 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000179276 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.786782+0000", 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072052740000000002 2024-05-07T14:03:50.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.802960+0000", 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016177490999999999 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803047+0000", 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6912999999999999e-05 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803098+0000", 2024-05-07T14:03:50.221 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1359000000000001e-05 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2905 3.1e 3:78954da1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.0612568939999996, 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028568698, 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:50.222 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:50.223 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.223 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2905 2024-05-07T14:03:50.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.223 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:50.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:50.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:03:50.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.223 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:50.223 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:03:50.223 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051199+0000", 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5299999999999999e-06 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055400+0000", 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042009889999999996 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:50.224 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055458+0000", 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.736e-05 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055486+0000", 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8914000000000001e-05 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055574+0000", 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7120999999999995e-05 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.225 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:50.226 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055726+0000", 2024-05-07T14:03:50.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015249600000000001 2024-05-07T14:03:50.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.226 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:50.226 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055884+0000", 2024-05-07T14:03:50.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015788900000000001 2024-05-07T14:03:50.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.226 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:50.226 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.064235+0000", 2024-05-07T14:03:50.226 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008350583 2024-05-07T14:03:50.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078705+0000", 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014470129999999999 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078900+0000", 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019521799999999999 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.079765+0000", 2024-05-07T14:03:50.227 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00086546799999999999 2024-05-07T14:03:50.228 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.228 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.228 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.228 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.228 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.228 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:50.229 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:50.230 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:50.239+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:50.331 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:50.339+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:50.353 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:50.354 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:50.354 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:50.354 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:50.368 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:50.401 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:03:50.401 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:50.401 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 107, 2024-05-07T14:03:50.401 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "0d349e2f-0c2b-4aab-8a22-181c69b40dbb", 2024-05-07T14:03:50.401 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-05-07T14:00:30.482506+0000", 2024-05-07T14:03:50.401 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-05-07T14:03:49.742382+0000", 2024-05-07T14:03:50.401 INFO:teuthology.orchestra.run.smithi106.stdout: "last_up_change": "2024-05-07T14:00:41.658097+0000", 2024-05-07T14:03:50.402 INFO:teuthology.orchestra.run.smithi106.stdout: "last_in_change": "2024-05-07T14:00:32.857383+0000", 2024-05-07T14:03:50.402 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-05-07T14:03:50.402 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_num": 5799936, 2024-05-07T14:03:50.402 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_set": [ 2024-05-07T14:03:50.402 INFO:teuthology.orchestra.run.smithi106.stdout: "pglog_hardlimit", 2024-05-07T14:03:50.402 INFO:teuthology.orchestra.run.smithi106.stdout: "purged_snapdirs", 2024-05-07T14:03:50.402 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_deletes", 2024-05-07T14:03:50.402 INFO:teuthology.orchestra.run.smithi106.stdout: "sortbitwise" 2024-05-07T14:03:50.402 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:03:50.403 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_version": 4, 2024-05-07T14:03:50.403 INFO:teuthology.orchestra.run.smithi106.stdout: "full_ratio": 0.94999998807907104, 2024-05-07T14:03:50.403 INFO:teuthology.orchestra.run.smithi106.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-05-07T14:03:50.403 INFO:teuthology.orchestra.run.smithi106.stdout: "nearfull_ratio": 0.85000002384185791, 2024-05-07T14:03:50.403 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_snapshot": "", 2024-05-07T14:03:50.403 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_max": 8, 2024-05-07T14:03:50.403 INFO:teuthology.orchestra.run.smithi106.stdout: "max_osd": 8, 2024-05-07T14:03:50.403 INFO:teuthology.orchestra.run.smithi106.stdout: "require_min_compat_client": "luminous", 2024-05-07T14:03:50.403 INFO:teuthology.orchestra.run.smithi106.stdout: "min_compat_client": "luminous", 2024-05-07T14:03:50.403 INFO:teuthology.orchestra.run.smithi106.stdout: "require_osd_release": "squid", 2024-05-07T14:03:50.404 INFO:teuthology.orchestra.run.smithi106.stdout: "allow_crimson": false, 2024-05-07T14:03:50.404 INFO:teuthology.orchestra.run.smithi106.stdout: "pools": [ 2024-05-07T14:03:50.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.404 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 1, 2024-05-07T14:03:50.404 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": ".mgr", 2024-05-07T14:03:50.404 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:00:43.291253+0000", 2024-05-07T14:03:50.404 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:03:50.404 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:03:50.404 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:03:50.404 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:03:50.405 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:03:50.405 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:03:50.405 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:03:50.405 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:03:50.405 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:03:50.405 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:03:50.405 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:03:50.405 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:03:50.405 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 1, 2024-05-07T14:03:50.405 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 1, 2024-05-07T14:03:50.405 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 1, 2024-05-07T14:03:50.406 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 1, 2024-05-07T14:03:50.406 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 1, 2024-05-07T14:03:50.406 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:03:50.406 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:03:50.406 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:03:50.406 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:03:50.406 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:03:50.406 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:03:50.406 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:03:50.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.407 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "17", 2024-05-07T14:03:50.407 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:03:50.407 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:03:50.407 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:03:50.407 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:03:50.407 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:03:50.407 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:03:50.407 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:03:50.408 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:03:50.408 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:03:50.408 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:03:50.408 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:03:50.408 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:03:50.408 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:03:50.408 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:03:50.408 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:03:50.408 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:03:50.408 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:03:50.408 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:03:50.408 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:03:50.408 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:03:50.409 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:03:50.410 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:03:50.410 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:03:50.410 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:03:50.410 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:03:50.410 INFO:teuthology.orchestra.run.smithi106.stdout: "options": { 2024-05-07T14:03:50.410 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_max": 32, 2024-05-07T14:03:50.410 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_min": 1 2024-05-07T14:03:50.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.410 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:03:50.410 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": {} 2024-05-07T14:03:50.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.410 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 8, 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 8, 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 0.25, 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 2, 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 2, 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 2, 2024-05-07T14:03:50.411 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": "rbd", 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:00:48.791671+0000", 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:03:50.412 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 8, 2024-05-07T14:03:50.413 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 8, 2024-05-07T14:03:50.413 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 8, 2024-05-07T14:03:50.413 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 8, 2024-05-07T14:03:50.413 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 8, 2024-05-07T14:03:50.413 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:03:50.413 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:03:50.413 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:03:50.413 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:03:50.413 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:03:50.413 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:03:50.413 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:03:50.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.413 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "20", 2024-05-07T14:03:50.414 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:03:50.414 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:03:50.414 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:03:50.414 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:03:50.414 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:03:50.414 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:03:50.414 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:03:50.414 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:03:50.414 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:03:50.414 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:03:50.414 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:03:50.414 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:03:50.415 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:03:50.415 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:03:50.415 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:03:50.415 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:03:50.415 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:03:50.415 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:03:50.415 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:03:50.415 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:03:50.415 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:03:50.415 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:03:50.415 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:03:50.415 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:03:50.415 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:03:50.416 INFO:teuthology.orchestra.run.smithi106.stdout: "options": {}, 2024-05-07T14:03:50.417 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:03:50.417 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd": {} 2024-05-07T14:03:50.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.417 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:03:50.417 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:03:50.417 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 1.9900000095367432, 2024-05-07T14:03:50.417 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 1.9900000095367432, 2024-05-07T14:03:50.417 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 0.87999999523162842, 2024-05-07T14:03:50.417 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 1.75, 2024-05-07T14:03:50.417 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 1.75, 2024-05-07T14:03:50.417 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:03:50.417 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:03:50.417 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:03:50.418 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.418 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 3, 2024-05-07T14:03:50.418 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": "default.rgw.buckets.data", 2024-05-07T14:03:50.418 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:00:54.652419+0000", 2024-05-07T14:03:50.418 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:03:50.418 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:03:50.418 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:03:50.418 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:03:50.418 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:03:50.419 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:03:50.419 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:03:50.419 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:03:50.419 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:03:50.419 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:03:50.419 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:03:50.419 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:03:50.419 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 64, 2024-05-07T14:03:50.419 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 64, 2024-05-07T14:03:50.419 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 64, 2024-05-07T14:03:50.419 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 64, 2024-05-07T14:03:50.419 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 64, 2024-05-07T14:03:50.419 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "23", 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:03:50.420 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:03:50.421 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:03:50.422 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:03:50.422 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:03:50.422 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:03:50.422 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:03:50.422 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:03:50.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.422 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:03:50.422 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:03:50.422 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:03:50.422 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:03:50.422 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: "options": {}, 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw": {} 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 1.5, 2024-05-07T14:03:50.423 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 1.5, 2024-05-07T14:03:50.424 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 1, 2024-05-07T14:03:50.424 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 1.5, 2024-05-07T14:03:50.424 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 1.5, 2024-05-07T14:03:50.424 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:03:50.424 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:03:50.424 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:03:50.424 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.424 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 4, 2024-05-07T14:03:50.425 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": "default.rgw.buckets.index", 2024-05-07T14:03:50.425 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:00:56.328700+0000", 2024-05-07T14:03:50.425 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:03:50.425 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:03:50.425 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:03:50.425 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:03:50.425 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:03:50.425 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:03:50.425 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:03:50.425 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:03:50.425 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:03:50.425 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:03:50.425 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:03:50.426 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:03:50.426 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 64, 2024-05-07T14:03:50.426 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 64, 2024-05-07T14:03:50.426 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 64, 2024-05-07T14:03:50.426 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 64, 2024-05-07T14:03:50.426 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 64, 2024-05-07T14:03:50.426 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:03:50.426 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:03:50.426 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:03:50.426 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:03:50.426 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:03:50.426 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:03:50.427 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:03:50.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.427 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "25", 2024-05-07T14:03:50.427 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:03:50.427 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:03:50.427 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:03:50.427 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:03:50.427 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:03:50.427 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:03:50.427 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:03:50.427 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:03:50.428 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:03:50.429 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:03:50.430 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:03:50.430 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:03:50.430 INFO:teuthology.orchestra.run.smithi106.stdout: "options": {}, 2024-05-07T14:03:50.430 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:03:50.430 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw": {} 2024-05-07T14:03:50.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.430 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:03:50.430 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:03:50.430 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 2, 2024-05-07T14:03:50.430 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 2, 2024-05-07T14:03:50.430 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 1, 2024-05-07T14:03:50.430 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 2, 2024-05-07T14:03:50.431 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 2, 2024-05-07T14:03:50.431 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:03:50.431 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:03:50.431 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:03:50.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.431 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 5, 2024-05-07T14:03:50.431 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": ".rgw.root", 2024-05-07T14:03:50.431 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:00:58.247912+0000", 2024-05-07T14:03:50.431 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:03:50.431 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:03:50.431 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:03:50.432 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:03:50.432 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:03:50.432 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:03:50.432 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:03:50.432 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:03:50.432 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:03:50.432 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:03:50.432 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:03:50.432 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:03:50.432 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 32, 2024-05-07T14:03:50.432 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 32, 2024-05-07T14:03:50.433 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 32, 2024-05-07T14:03:50.433 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 32, 2024-05-07T14:03:50.433 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 32, 2024-05-07T14:03:50.433 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:03:50.433 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:03:50.433 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:03:50.433 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:03:50.433 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:03:50.433 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:03:50.433 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:03:50.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.433 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "27", 2024-05-07T14:03:50.433 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:03:50.434 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:03:50.434 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:03:50.434 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:03:50.434 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:03:50.434 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:03:50.434 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:03:50.434 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:03:50.434 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:03:50.434 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:03:50.434 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:03:50.434 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:03:50.434 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:03:50.434 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:03:50.435 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:03:50.435 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:03:50.435 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:03:50.435 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:03:50.435 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:03:50.435 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:03:50.435 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:03:50.435 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:03:50.435 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:03:50.435 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:03:50.436 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:03:50.436 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:03:50.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.436 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:03:50.436 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:03:50.436 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:03:50.436 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:03:50.436 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:03:50.436 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:03:50.436 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:03:50.436 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:03:50.436 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:03:50.437 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:03:50.437 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:03:50.437 INFO:teuthology.orchestra.run.smithi106.stdout: "options": {}, 2024-05-07T14:03:50.437 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:03:50.437 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw": {} 2024-05-07T14:03:50.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.437 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:03:50.437 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:03:50.437 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 1.25, 2024-05-07T14:03:50.437 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 1.25, 2024-05-07T14:03:50.438 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 1, 2024-05-07T14:03:50.438 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 1.25, 2024-05-07T14:03:50.438 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 1.25, 2024-05-07T14:03:50.438 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:03:50.438 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:03:50.438 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:03:50.438 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.438 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 6, 2024-05-07T14:03:50.439 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": "default.rgw.log", 2024-05-07T14:03:50.439 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:01:00.134259+0000", 2024-05-07T14:03:50.439 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:03:50.439 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:03:50.439 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:03:50.439 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:03:50.439 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:03:50.439 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:03:50.439 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:03:50.439 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:03:50.440 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:03:50.440 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:03:50.440 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:03:50.440 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:03:50.440 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 32, 2024-05-07T14:03:50.440 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 32, 2024-05-07T14:03:50.440 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 32, 2024-05-07T14:03:50.440 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 32, 2024-05-07T14:03:50.440 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 32, 2024-05-07T14:03:50.440 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:03:50.441 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:03:50.441 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:03:50.441 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:03:50.441 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:03:50.441 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:03:50.441 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:03:50.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.441 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "29", 2024-05-07T14:03:50.441 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:03:50.441 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:03:50.441 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:03:50.441 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:03:50.442 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:03:50.442 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:03:50.442 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:03:50.442 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:03:50.442 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:03:50.442 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:03:50.442 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:03:50.442 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:03:50.442 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:03:50.442 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:03:50.442 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:03:50.442 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:03:50.442 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:03:50.443 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "options": {}, 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw": {} 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 1.75, 2024-05-07T14:03:50.444 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 1.75, 2024-05-07T14:03:50.445 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 1, 2024-05-07T14:03:50.445 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 1.75, 2024-05-07T14:03:50.445 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 1.75, 2024-05-07T14:03:50.445 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:03:50.445 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:03:50.445 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:03:50.445 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.445 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 7, 2024-05-07T14:03:50.445 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": "default.rgw.control", 2024-05-07T14:03:50.445 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:01:02.056070+0000", 2024-05-07T14:03:50.445 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:03:50.446 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:03:50.446 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:03:50.446 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:03:50.446 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:03:50.446 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:03:50.446 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:03:50.446 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:03:50.446 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:03:50.446 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:03:50.446 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:03:50.446 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:03:50.446 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 32, 2024-05-07T14:03:50.446 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 32, 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 32, 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 32, 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 32, 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "31", 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:03:50.447 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:03:50.448 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:03:50.449 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:03:50.450 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:03:50.450 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:03:50.450 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:03:50.450 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:03:50.450 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:03:50.450 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:03:50.450 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:03:50.450 INFO:teuthology.orchestra.run.smithi106.stdout: "options": {}, 2024-05-07T14:03:50.450 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:03:50.450 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw": {} 2024-05-07T14:03:50.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.450 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 1.75, 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 1.75, 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 1, 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 1.75, 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 1.75, 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: "pool": 8, 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": "default.rgw.meta", 2024-05-07T14:03:50.451 INFO:teuthology.orchestra.run.smithi106.stdout: "create_time": "2024-05-07T14:01:04.177565+0000", 2024-05-07T14:03:50.452 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2024-05-07T14:03:50.452 INFO:teuthology.orchestra.run.smithi106.stdout: "flags_names": "hashpspool", 2024-05-07T14:03:50.452 INFO:teuthology.orchestra.run.smithi106.stdout: "type": 1, 2024-05-07T14:03:50.452 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 2, 2024-05-07T14:03:50.452 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": 1, 2024-05-07T14:03:50.452 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_rule": 0, 2024-05-07T14:03:50.452 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_count": 0, 2024-05-07T14:03:50.452 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_target": 0, 2024-05-07T14:03:50.452 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_barrier": 0, 2024-05-07T14:03:50.452 INFO:teuthology.orchestra.run.smithi106.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-05-07T14:03:50.452 INFO:teuthology.orchestra.run.smithi106.stdout: "object_hash": 2, 2024-05-07T14:03:50.452 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_mode": "off", 2024-05-07T14:03:50.452 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": 32, 2024-05-07T14:03:50.453 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num": 32, 2024-05-07T14:03:50.453 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_placement_num_target": 32, 2024-05-07T14:03:50.453 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_target": 32, 2024-05-07T14:03:50.453 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num_pending": 32, 2024-05-07T14:03:50.453 INFO:teuthology.orchestra.run.smithi106.stdout: "last_pg_merge_meta": { 2024-05-07T14:03:50.453 INFO:teuthology.orchestra.run.smithi106.stdout: "source_pgid": "0.0", 2024-05-07T14:03:50.453 INFO:teuthology.orchestra.run.smithi106.stdout: "ready_epoch": 0, 2024-05-07T14:03:50.453 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_started": 0, 2024-05-07T14:03:50.453 INFO:teuthology.orchestra.run.smithi106.stdout: "last_epoch_clean": 0, 2024-05-07T14:03:50.453 INFO:teuthology.orchestra.run.smithi106.stdout: "source_version": "0'0", 2024-05-07T14:03:50.453 INFO:teuthology.orchestra.run.smithi106.stdout: "target_version": "0'0" 2024-05-07T14:03:50.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "last_change": "33", 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend": "0", 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_prenautilus": "0", 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "last_force_op_resend_preluminous": "0", 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "auid": 0, 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_mode": "selfmanaged", 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_seq": 0, 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "snap_epoch": 0, 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_snaps": [], 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps": "[]", 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_bytes": 0, 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "quota_max_objects": 0, 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "tiers": [], 2024-05-07T14:03:50.454 INFO:teuthology.orchestra.run.smithi106.stdout: "tier_of": -1, 2024-05-07T14:03:50.455 INFO:teuthology.orchestra.run.smithi106.stdout: "read_tier": -1, 2024-05-07T14:03:50.455 INFO:teuthology.orchestra.run.smithi106.stdout: "write_tier": -1, 2024-05-07T14:03:50.455 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_mode": "none", 2024-05-07T14:03:50.455 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_bytes": 0, 2024-05-07T14:03:50.455 INFO:teuthology.orchestra.run.smithi106.stdout: "target_max_objects": 0, 2024-05-07T14:03:50.455 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-05-07T14:03:50.455 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-05-07T14:03:50.455 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_target_full_ratio_micro": 800000, 2024-05-07T14:03:50.455 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_flush_age": 0, 2024-05-07T14:03:50.455 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_min_evict_age": 0, 2024-05-07T14:03:50.455 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profile": "", 2024-05-07T14:03:50.455 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_params": { 2024-05-07T14:03:50.455 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "none" 2024-05-07T14:03:50.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.456 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_period": 0, 2024-05-07T14:03:50.456 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_count": 0, 2024-05-07T14:03:50.456 INFO:teuthology.orchestra.run.smithi106.stdout: "use_gmt_hitset": true, 2024-05-07T14:03:50.456 INFO:teuthology.orchestra.run.smithi106.stdout: "min_read_recency_for_promote": 0, 2024-05-07T14:03:50.456 INFO:teuthology.orchestra.run.smithi106.stdout: "min_write_recency_for_promote": 0, 2024-05-07T14:03:50.456 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_grade_decay_rate": 0, 2024-05-07T14:03:50.456 INFO:teuthology.orchestra.run.smithi106.stdout: "hit_set_search_last_n": 0, 2024-05-07T14:03:50.456 INFO:teuthology.orchestra.run.smithi106.stdout: "grade_table": [], 2024-05-07T14:03:50.456 INFO:teuthology.orchestra.run.smithi106.stdout: "stripe_width": 0, 2024-05-07T14:03:50.456 INFO:teuthology.orchestra.run.smithi106.stdout: "expected_num_objects": 0, 2024-05-07T14:03:50.456 INFO:teuthology.orchestra.run.smithi106.stdout: "fast_read": false, 2024-05-07T14:03:50.456 INFO:teuthology.orchestra.run.smithi106.stdout: "options": { 2024-05-07T14:03:50.457 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscale_bias": 4 2024-05-07T14:03:50.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.457 INFO:teuthology.orchestra.run.smithi106.stdout: "application_metadata": { 2024-05-07T14:03:50.457 INFO:teuthology.orchestra.run.smithi106.stdout: "rgw": {} 2024-05-07T14:03:50.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.457 INFO:teuthology.orchestra.run.smithi106.stdout: "read_balance": { 2024-05-07T14:03:50.457 INFO:teuthology.orchestra.run.smithi106.stdout: "score_type": "Fair distribution", 2024-05-07T14:03:50.458 INFO:teuthology.orchestra.run.smithi106.stdout: "score_acting": 1.5, 2024-05-07T14:03:50.458 INFO:teuthology.orchestra.run.smithi106.stdout: "score_stable": 1.5, 2024-05-07T14:03:50.458 INFO:teuthology.orchestra.run.smithi106.stdout: "optimal_score": 1, 2024-05-07T14:03:50.458 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_acting": 1.5, 2024-05-07T14:03:50.458 INFO:teuthology.orchestra.run.smithi106.stdout: "raw_score_stable": 1.5, 2024-05-07T14:03:50.458 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity_weighted": 1, 2024-05-07T14:03:50.458 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity": 1, 2024-05-07T14:03:50.458 INFO:teuthology.orchestra.run.smithi106.stdout: "average_primary_affinity_weighted": 1 2024-05-07T14:03:50.458 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.458 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.458 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:03:50.459 INFO:teuthology.orchestra.run.smithi106.stdout: "osds": [ 2024-05-07T14:03:50.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.459 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 0, 2024-05-07T14:03:50.459 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "e76f5d56-1400-488e-b58f-7af657fa63ab", 2024-05-07T14:03:50.459 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:03:50.459 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:03:50.459 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:03:50.459 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:03:50.459 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:03:50.459 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:03:50.459 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:03:50.460 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 102, 2024-05-07T14:03:50.460 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:03:50.460 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:03:50.460 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:03:50.460 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.460 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.460 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6800", 2024-05-07T14:03:50.460 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:03:50.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.461 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.461 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6801", 2024-05-07T14:03:50.461 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:03:50.461 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.461 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.461 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:03:50.461 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.461 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.461 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6802", 2024-05-07T14:03:50.462 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:03:50.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.462 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.462 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6803", 2024-05-07T14:03:50.462 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:03:50.462 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.462 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.462 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:03:50.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.463 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6807", 2024-05-07T14:03:50.463 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:03:50.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.463 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6809", 2024-05-07T14:03:50.463 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:03:50.463 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.463 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6804", 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6805", 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3743893730 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.464 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.465 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6801/3743893730", 2024-05-07T14:03:50.465 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.106:6803/3743893730", 2024-05-07T14:03:50.465 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.106:6809/3743893730", 2024-05-07T14:03:50.465 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.106:6805/3743893730", 2024-05-07T14:03:50.465 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:03:50.465 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:03:50.465 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:03:50.465 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.465 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 1, 2024-05-07T14:03:50.465 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "aad5864b-9a5f-426f-a8fd-15d02590106e", 2024-05-07T14:03:50.466 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:03:50.466 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:03:50.466 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:03:50.466 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:03:50.466 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:03:50.466 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:03:50.466 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:03:50.466 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 102, 2024-05-07T14:03:50.466 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:03:50.466 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:03:50.466 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:03:50.466 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.467 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.467 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6816", 2024-05-07T14:03:50.467 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:03:50.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.467 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.467 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6817", 2024-05-07T14:03:50.467 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:03:50.467 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.467 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.468 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:03:50.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.468 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6818", 2024-05-07T14:03:50.468 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:03:50.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.469 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6819", 2024-05-07T14:03:50.469 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:03:50.469 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.469 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.469 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:03:50.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.470 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.470 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6822", 2024-05-07T14:03:50.470 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:03:50.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.470 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.470 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6823", 2024-05-07T14:03:50.470 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:03:50.470 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.471 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.471 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:03:50.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.471 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6820", 2024-05-07T14:03:50.471 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:03:50.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.471 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6821", 2024-05-07T14:03:50.472 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3901521345 2024-05-07T14:03:50.472 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.472 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.472 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6817/3901521345", 2024-05-07T14:03:50.472 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.106:6819/3901521345", 2024-05-07T14:03:50.472 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.106:6823/3901521345", 2024-05-07T14:03:50.472 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.106:6821/3901521345", 2024-05-07T14:03:50.472 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:03:50.472 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:03:50.473 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:03:50.473 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.473 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 2, 2024-05-07T14:03:50.473 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "eea131cd-e4ca-4360-a8a0-5005a2d827d1", 2024-05-07T14:03:50.473 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:03:50.473 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:03:50.473 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:03:50.473 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:03:50.473 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:03:50.473 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:03:50.474 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:03:50.474 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 86, 2024-05-07T14:03:50.474 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:03:50.474 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:03:50.474 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:03:50.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.474 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6824", 2024-05-07T14:03:50.474 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6825", 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6826", 2024-05-07T14:03:50.475 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6827", 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6830", 2024-05-07T14:03:50.476 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6831", 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6828", 2024-05-07T14:03:50.477 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:03:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6829", 2024-05-07T14:03:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1784825450 2024-05-07T14:03:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6825/1784825450", 2024-05-07T14:03:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.106:6827/1784825450", 2024-05-07T14:03:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.106:6831/1784825450", 2024-05-07T14:03:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.106:6829/1784825450", 2024-05-07T14:03:50.478 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:03:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:03:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:03:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 3, 2024-05-07T14:03:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "bdcb438c-1d40-45a2-8e8a-f29ba9c98909", 2024-05-07T14:03:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:03:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:03:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:03:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:03:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:03:50.479 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:03:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:03:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 101, 2024-05-07T14:03:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:03:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:03:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:03:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6806", 2024-05-07T14:03:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:03:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.480 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6808", 2024-05-07T14:03:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:03:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:03:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6810", 2024-05-07T14:03:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:03:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6811", 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6814", 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6815", 2024-05-07T14:03:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:03:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:03:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6812", 2024-05-07T14:03:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:03:50.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6813", 2024-05-07T14:03:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 123863977 2024-05-07T14:03:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6808/123863977", 2024-05-07T14:03:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.106:6811/123863977", 2024-05-07T14:03:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.106:6815/123863977", 2024-05-07T14:03:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.106:6813/123863977", 2024-05-07T14:03:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:03:50.484 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 4, 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "703f4a52-4283-4395-bc29-4de194d4a4ef", 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:03:50.485 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 99, 2024-05-07T14:03:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:03:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:03:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:03:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6816", 2024-05-07T14:03:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:03:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.486 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6817", 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6818", 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6819", 2024-05-07T14:03:50.487 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:03:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:03:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6822", 2024-05-07T14:03:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:03:50.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6824", 2024-05-07T14:03:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:03:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:03:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6820", 2024-05-07T14:03:50.489 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:03:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6821", 2024-05-07T14:03:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3575310712 2024-05-07T14:03:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.107:6817/3575310712", 2024-05-07T14:03:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.107:6819/3575310712", 2024-05-07T14:03:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.107:6824/3575310712", 2024-05-07T14:03:50.490 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.107:6821/3575310712", 2024-05-07T14:03:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:03:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:03:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:03:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 5, 2024-05-07T14:03:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "8b70f365-8b0d-429e-b3f8-601a37cfb6ac", 2024-05-07T14:03:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:03:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:03:50.491 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:03:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:03:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:03:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:03:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:03:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 102, 2024-05-07T14:03:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:03:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:03:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:03:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.492 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6800", 2024-05-07T14:03:50.493 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:03:50.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.493 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.493 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6801", 2024-05-07T14:03:50.493 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:03:50.493 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.493 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.493 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:03:50.494 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.494 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.494 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6802", 2024-05-07T14:03:50.494 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:03:50.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.494 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.494 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6803", 2024-05-07T14:03:50.494 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:03:50.494 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.494 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6806", 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6807", 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6804", 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6805", 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 2178038050 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.107:6801/2178038050", 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.107:6803/2178038050", 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.107:6807/2178038050", 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.107:6805/2178038050", 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 6, 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "b65085d6-47af-4dfc-91a8-cdc7a6fa937c", 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:03:50.497 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:03:50.498 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:03:50.498 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:03:50.498 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:03:50.498 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:03:50.498 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:03:50.498 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 86, 2024-05-07T14:03:50.498 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:03:50.498 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:03:50.498 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:03:50.498 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.499 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.499 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6823", 2024-05-07T14:03:50.499 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:03:50.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.499 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.499 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6825", 2024-05-07T14:03:50.499 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:03:50.499 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.500 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.500 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:03:50.500 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.500 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.500 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6826", 2024-05-07T14:03:50.500 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:03:50.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.501 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.501 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6827", 2024-05-07T14:03:50.501 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:03:50.501 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.501 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.501 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:03:50.501 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.501 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.502 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6830", 2024-05-07T14:03:50.502 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:03:50.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.502 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.502 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6831", 2024-05-07T14:03:50.502 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:03:50.502 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.502 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.503 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:03:50.503 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.503 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.503 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6828", 2024-05-07T14:03:50.503 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:03:50.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.503 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.504 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6829", 2024-05-07T14:03:50.504 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 3168866293 2024-05-07T14:03:50.504 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.504 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.504 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.107:6825/3168866293", 2024-05-07T14:03:50.504 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.107:6827/3168866293", 2024-05-07T14:03:50.504 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.107:6831/3168866293", 2024-05-07T14:03:50.504 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.107:6829/3168866293", 2024-05-07T14:03:50.504 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:03:50.505 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:03:50.505 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:03:50.505 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.505 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 7, 2024-05-07T14:03:50.505 INFO:teuthology.orchestra.run.smithi106.stdout: "uuid": "9a808e41-afba-400f-886a-8f17689bebda", 2024-05-07T14:03:50.505 INFO:teuthology.orchestra.run.smithi106.stdout: "up": 1, 2024-05-07T14:03:50.505 INFO:teuthology.orchestra.run.smithi106.stdout: "in": 1, 2024-05-07T14:03:50.505 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 1, 2024-05-07T14:03:50.505 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_affinity": 1, 2024-05-07T14:03:50.505 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_begin": 0, 2024-05-07T14:03:50.505 INFO:teuthology.orchestra.run.smithi106.stdout: "last_clean_end": 0, 2024-05-07T14:03:50.506 INFO:teuthology.orchestra.run.smithi106.stdout: "up_from": 13, 2024-05-07T14:03:50.506 INFO:teuthology.orchestra.run.smithi106.stdout: "up_thru": 102, 2024-05-07T14:03:50.506 INFO:teuthology.orchestra.run.smithi106.stdout: "down_at": 0, 2024-05-07T14:03:50.506 INFO:teuthology.orchestra.run.smithi106.stdout: "lost_at": 0, 2024-05-07T14:03:50.506 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-05-07T14:03:50.506 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.506 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.506 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6808", 2024-05-07T14:03:50.506 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:03:50.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.506 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6809", 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addrs": { 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6810", 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.507 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6811", 2024-05-07T14:03:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:03:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addrs": { 2024-05-07T14:03:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6814", 2024-05-07T14:03:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:03:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6815", 2024-05-07T14:03:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:03:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addrs": { 2024-05-07T14:03:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-05-07T14:03:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2024-05-07T14:03:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6812", 2024-05-07T14:03:50.509 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:03:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-05-07T14:03:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.107:6813", 2024-05-07T14:03:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1073700008 2024-05-07T14:03:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.107:6809/1073700008", 2024-05-07T14:03:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_addr": "172.21.15.107:6811/1073700008", 2024-05-07T14:03:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_back_addr": "172.21.15.107:6815/1073700008", 2024-05-07T14:03:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: "heartbeat_front_addr": "172.21.15.107:6813/1073700008", 2024-05-07T14:03:50.510 INFO:teuthology.orchestra.run.smithi106.stdout: "state": [ 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: "exists", 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: "up" 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_xinfo": [ 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 0, 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:03:50.511 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.435492+0000", 2024-05-07T14:03:50.512 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:03:50.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.512 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 1, 2024-05-07T14:03:50.512 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:03:50.512 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:03:50.512 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:03:50.512 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:03:50.512 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:03:50.512 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.545586+0000", 2024-05-07T14:03:50.512 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:03:50.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.513 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 2, 2024-05-07T14:03:50.513 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:03:50.513 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:03:50.513 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:03:50.513 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:03:50.513 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:03:50.513 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.430790+0000", 2024-05-07T14:03:50.513 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:03:50.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.513 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 3, 2024-05-07T14:03:50.513 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.530476+0000", 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 4, 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:03:50.514 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.487321+0000", 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 5, 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.254353+0000", 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 6, 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.381089+0000", 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": 7, 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: "down_stamp": "0.000000", 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_probability": 0, 2024-05-07T14:03:50.516 INFO:teuthology.orchestra.run.smithi106.stdout: "laggy_interval": 0, 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: "features": 4540701547738038271, 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: "old_weight": 0, 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: "last_purged_snaps_scrub": "2024-05-07T14:00:38.430233+0000", 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: "dead_epoch": 0 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_upmap": [ 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "1.0", 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: "osds": [ 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: 3 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.517 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:03:50.518 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_upmap_items": [ 2024-05-07T14:03:50.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.518 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "3.2", 2024-05-07T14:03:50.518 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:03:50.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.518 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 3, 2024-05-07T14:03:50.518 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 2 2024-05-07T14:03:50.518 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.518 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.518 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "3.13", 2024-05-07T14:03:50.518 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 7, 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 2 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "3.17", 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 0, 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 2 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.520 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "3.1f", 2024-05-07T14:03:50.520 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:03:50.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.520 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 5, 2024-05-07T14:03:50.520 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 1 2024-05-07T14:03:50.520 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.520 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.520 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "3.21", 2024-05-07T14:03:50.521 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:03:50.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.521 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 5, 2024-05-07T14:03:50.521 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 1 2024-05-07T14:03:50.521 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.521 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.521 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "4.10", 2024-05-07T14:03:50.521 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:03:50.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.521 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 3, 2024-05-07T14:03:50.521 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 5 2024-05-07T14:03:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "4.2b", 2024-05-07T14:03:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:03:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 3, 2024-05-07T14:03:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 2 2024-05-07T14:03:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: "pgid": "4.33", 2024-05-07T14:03:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: "mappings": [ 2024-05-07T14:03:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: "from": 3, 2024-05-07T14:03:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: "to": 5 2024-05-07T14:03:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:03:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_upmap_primaries": [], 2024-05-07T14:03:50.523 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_temp": [], 2024-05-07T14:03:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: "primary_temp": [], 2024-05-07T14:03:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: "blocklist": {}, 2024-05-07T14:03:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: "range_blocklist": {}, 2024-05-07T14:03:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: "erasure_code_profiles": { 2024-05-07T14:03:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: "default": { 2024-05-07T14:03:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: "crush-failure-domain": "osd", 2024-05-07T14:03:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: "k": "2", 2024-05-07T14:03:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: "m": "1", 2024-05-07T14:03:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: "plugin": "jerasure", 2024-05-07T14:03:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: "technique": "reed_sol_van" 2024-05-07T14:03:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:50.524 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_snaps_queue": [], 2024-05-07T14:03:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: "new_removed_snaps": [], 2024-05-07T14:03:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: "new_purged_snaps": [], 2024-05-07T14:03:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_node_flags": {}, 2024-05-07T14:03:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: "device_class_flags": {}, 2024-05-07T14:03:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": { 2024-05-07T14:03:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode_enabled": false, 2024-05-07T14:03:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_bucket_count": 0, 2024-05-07T14:03:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: "degraded_stretch_mode": 0, 2024-05-07T14:03:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: "recovering_stretch_mode": 0, 2024-05-07T14:03:50.525 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode_bucket": 0 2024-05-07T14:03:50.526 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:50.526 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:50.528 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:50.528 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:50.529 INFO:tasks.thrashosds.thrasher:j is {'epoch': 107, 'fsid': '0d349e2f-0c2b-4aab-8a22-181c69b40dbb', 'created': '2024-05-07T14:00:30.482506+0000', 'modified': '2024-05-07T14:03:49.742382+0000', 'last_up_change': '2024-05-07T14:00:41.658097+0000', 'last_in_change': '2024-05-07T14:00:32.857383+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-07T14:00:43.291253+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-05-07T14:00:48.791671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-05-07T14:00:54.652419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-05-07T14:00:56.328700+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-05-07T14:00:58.247912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-05-07T14:01:00.134259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-05-07T14:01:02.056070+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-05-07T14:01:04.177565+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'e76f5d56-1400-488e-b58f-7af657fa63ab', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 102, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6800', 'nonce': 3743893730}, {'type': 'v1', 'addr': '172.21.15.106:6801', 'nonce': 3743893730}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6802', 'nonce': 3743893730}, {'type': 'v1', 'addr': '172.21.15.106:6803', 'nonce': 3743893730}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6807', 'nonce': 3743893730}, {'type': 'v1', 'addr': '172.21.15.106:6809', 'nonce': 3743893730}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6804', 'nonce': 3743893730}, {'type': 'v1', 'addr': '172.21.15.106:6805', 'nonce': 3743893730}]}, 'public_addr': '172.21.15.106:6801/3743893730', 'cluster_addr': '172.21.15.106:6803/3743893730', 'heartbeat_back_addr': '172.21.15.106:6809/3743893730', 'heartbeat_front_addr': '172.21.15.106:6805/3743893730', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aad5864b-9a5f-426f-a8fd-15d02590106e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 102, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6816', 'nonce': 3901521345}, {'type': 'v1', 'addr': '172.21.15.106:6817', 'nonce': 3901521345}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6818', 'nonce': 3901521345}, {'type': 'v1', 'addr': '172.21.15.106:6819', 'nonce': 3901521345}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6822', 'nonce': 3901521345}, {'type': 'v1', 'addr': '172.21.15.106:6823', 'nonce': 3901521345}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6820', 'nonce': 3901521345}, {'type': 'v1', 'addr': '172.21.15.106:6821', 'nonce': 3901521345}]}, 'public_addr': '172.21.15.106:6817/3901521345', 'cluster_addr': '172.21.15.106:6819/3901521345', 'heartbeat_back_addr': '172.21.15.106:6823/3901521345', 'heartbeat_front_addr': '172.21.15.106:6821/3901521345', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'eea131cd-e4ca-4360-a8a0-5005a2d827d1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6824', 'nonce': 1784825450}, {'type': 'v1', 'addr': '172.21.15.106:6825', 'nonce': 1784825450}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6826', 'nonce': 1784825450}, {'type': 'v1', 'addr': '172.21.15.106:6827', 'nonce': 1784825450}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6830', 'nonce': 1784825450}, {'type': 'v1', 'addr': '172.21.15.106:6831', 'nonce': 1784825450}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6828', 'nonce': 1784825450}, {'type': 'v1', 'addr': '172.21.15.106:6829', 'nonce': 1784825450}]}, 'public_addr': '172.21.15.106:6825/1784825450', 'cluster_addr': '172.21.15.106:6827/1784825450', 'heartbeat_back_addr': '172.21.15.106:6831/1784825450', 'heartbeat_front_addr': '172.21.15.106:6829/1784825450', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'bdcb438c-1d40-45a2-8e8a-f29ba9c98909', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 101, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6806', 'nonce': 123863977}, {'type': 'v1', 'addr': '172.21.15.106:6808', 'nonce': 123863977}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6810', 'nonce': 123863977}, {'type': 'v1', 'addr': '172.21.15.106:6811', 'nonce': 123863977}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6814', 'nonce': 123863977}, {'type': 'v1', 'addr': '172.21.15.106:6815', 'nonce': 123863977}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6812', 'nonce': 123863977}, {'type': 'v1', 'addr': '172.21.15.106:6813', 'nonce': 123863977}]}, 'public_addr': '172.21.15.106:6808/123863977', 'cluster_addr': '172.21.15.106:6811/123863977', 'heartbeat_back_addr': '172.21.15.106:6815/123863977', 'heartbeat_front_addr': '172.21.15.106:6813/123863977', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '703f4a52-4283-4395-bc29-4de194d4a4ef', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 99, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6816', 'nonce': 3575310712}, {'type': 'v1', 'addr': '172.21.15.107:6817', 'nonce': 3575310712}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6818', 'nonce': 3575310712}, {'type': 'v1', 'addr': '172.21.15.107:6819', 'nonce': 3575310712}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6822', 'nonce': 3575310712}, {'type': 'v1', 'addr': '172.21.15.107:6824', 'nonce': 3575310712}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6820', 'nonce': 3575310712}, {'type': 'v1', 'addr': '172.21.15.107:6821', 'nonce': 3575310712}]}, 'public_addr': '172.21.15.107:6817/3575310712', 'cluster_addr': '172.21.15.107:6819/3575310712', 'heartbeat_back_addr': '172.21.15.107:6824/3575310712', 'heartbeat_front_addr': '172.21.15.107:6821/3575310712', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '8b70f365-8b0d-429e-b3f8-601a37cfb6ac', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 102, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 2178038050}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 2178038050}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 2178038050}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 2178038050}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 2178038050}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 2178038050}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 2178038050}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 2178038050}]}, 'public_addr': '172.21.15.107:6801/2178038050', 'cluster_addr': '172.21.15.107:6803/2178038050', 'heartbeat_back_addr': '172.21.15.107:6807/2178038050', 'heartbeat_front_addr': '172.21.15.107:6805/2178038050', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'b65085d6-47af-4dfc-91a8-cdc7a6fa937c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6823', 'nonce': 3168866293}, {'type': 'v1', 'addr': '172.21.15.107:6825', 'nonce': 3168866293}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6826', 'nonce': 3168866293}, {'type': 'v1', 'addr': '172.21.15.107:6827', 'nonce': 3168866293}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6830', 'nonce': 3168866293}, {'type': 'v1', 'addr': '172.21.15.107:6831', 'nonce': 3168866293}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6828', 'nonce': 3168866293}, {'type': 'v1', 'addr': '172.21.15.107:6829', 'nonce': 3168866293}]}, 'public_addr': '172.21.15.107:6825/3168866293', 'cluster_addr': '172.21.15.107:6827/3168866293', 'heartbeat_back_addr': '172.21.15.107:6831/3168866293', 'heartbeat_front_addr': '172.21.15.107:6829/3168866293', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '9a808e41-afba-400f-886a-8f17689bebda', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 102, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6808', 'nonce': 1073700008}, {'type': 'v1', 'addr': '172.21.15.107:6809', 'nonce': 1073700008}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6810', 'nonce': 1073700008}, {'type': 'v1', 'addr': '172.21.15.107:6811', 'nonce': 1073700008}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6814', 'nonce': 1073700008}, {'type': 'v1', 'addr': '172.21.15.107:6815', 'nonce': 1073700008}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6812', 'nonce': 1073700008}, {'type': 'v1', 'addr': '172.21.15.107:6813', 'nonce': 1073700008}]}, 'public_addr': '172.21.15.107:6809/1073700008', 'cluster_addr': '172.21.15.107:6811/1073700008', 'heartbeat_back_addr': '172.21.15.107:6815/1073700008', 'heartbeat_front_addr': '172.21.15.107:6813/1073700008', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.435492+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.545586+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.430790+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.530476+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.487321+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.254353+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.381089+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-05-07T14:00:38.430233+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '1.0', 'osds': [6, 3]}], 'pg_upmap_items': [{'pgid': '3.2', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '3.13', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '3.17', 'mappings': [{'from': 0, 'to': 2}]}, {'pgid': '3.1f', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '3.21', 'mappings': [{'from': 5, 'to': 1}]}, {'pgid': '4.10', 'mappings': [{'from': 3, 'to': 5}]}, {'pgid': '4.2b', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '4.33', 'mappings': [{'from': 3, 'to': 5}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-05-07T14:03:50.529 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 4.10 2024-05-07T14:03:50.530 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap-items 4.10 2024-05-07T14:03:50.530 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:50.531 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:50.535+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:50.628 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:50.635+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:50.660 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:03:50.699 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:50.699 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:50.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:50.699 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:50.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.700 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2224 3.1a 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:50.700 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:50.700 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.121414377000001, 2024-05-07T14:03:50.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027796929000000001, 2024-05-07T14:03:50.700 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.700 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:50.700 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:50.700 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.700 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2224 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588348+0000", 2024-05-07T14:03:50.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1629999999999998e-06 2024-05-07T14:03:50.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594043+0000", 2024-05-07T14:03:50.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056948950000000002 2024-05-07T14:03:50.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594085+0000", 2024-05-07T14:03:50.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1678999999999999e-05 2024-05-07T14:03:50.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594113+0000", 2024-05-07T14:03:50.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:03:50.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594221+0000", 2024-05-07T14:03:50.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107371 2024-05-07T14:03:50.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594405+0000", 2024-05-07T14:03:50.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018468099999999999 2024-05-07T14:03:50.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:50.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594570+0000", 2024-05-07T14:03:50.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165224 2024-05-07T14:03:50.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:50.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.603655+0000", 2024-05-07T14:03:50.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090846550000000005 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.615968+0000", 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012313199 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616069+0000", 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100309 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616141+0000", 2024-05-07T14:03:50.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2218999999999994e-05 2024-05-07T14:03:50.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.706 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.706 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2229 3.3 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:50.706 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:50.706 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 47.050117849000003, 2024-05-07T14:03:50.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028304669000000001, 2024-05-07T14:03:50.706 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.706 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.706 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2229 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659643+0000", 2024-05-07T14:03:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9129999999999999e-06 2024-05-07T14:03:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664151+0000", 2024-05-07T14:03:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045081189999999997 2024-05-07T14:03:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664198+0000", 2024-05-07T14:03:50.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6431999999999999e-05 2024-05-07T14:03:50.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664223+0000", 2024-05-07T14:03:50.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5369999999999999e-05 2024-05-07T14:03:50.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664313+0000", 2024-05-07T14:03:50.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345999999999995e-05 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664428+0000", 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115058 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664566+0000", 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138598 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:50.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.671674+0000", 2024-05-07T14:03:50.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071074529999999997 2024-05-07T14:03:50.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687772+0000", 2024-05-07T14:03:50.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016098359 2024-05-07T14:03:50.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687871+0000", 2024-05-07T14:03:50.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9098000000000006e-05 2024-05-07T14:03:50.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687945+0000", 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3923000000000004e-05 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2684 3.24 e104/21 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.9111573889999995, 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026848770000000001, 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.712 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.713 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.713 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:03:50.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:03:50.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:03:50.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6000000000000004e-07 2024-05-07T14:03:50.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810718+0000", 2024-05-07T14:03:50.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012116477 2024-05-07T14:03:50.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810747+0000", 2024-05-07T14:03:50.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8676000000000001e-05 2024-05-07T14:03:50.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810791+0000", 2024-05-07T14:03:50.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4415000000000001e-05 2024-05-07T14:03:50.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810915+0000", 2024-05-07T14:03:50.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012363399999999999 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810950+0000", 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5812999999999997e-05 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825326+0000", 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014375852 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825450+0000", 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012334299999999999 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2685 3.1c e104/21 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head v 104'1, mlcod=0'0)", 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.9043217170000002, 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023842609000000001, 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.717 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:03:50.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:03:50.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805438+0000", 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.243e-06 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812353+0000", 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069150560000000002 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812385+0000", 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2583000000000003e-05 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812406+0000", 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0378999999999999e-05 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812541+0000", 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013502699999999999 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812591+0000", 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0522999999999997e-05 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829183+0000", 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016591445999999999 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829279+0000", 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6352000000000002e-05 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.721 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2686 3.34 3:2ec0e822:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:50.722 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:03:50.722 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.9011072469999997, 2024-05-07T14:03:50.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034864805999999998, 2024-05-07T14:03:50.722 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.722 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.722 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.722 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:50.722 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:50.722 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.722 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2686 2024-05-07T14:03:50.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.722 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808656+0000", 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6029999999999998e-06 2024-05-07T14:03:50.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818059+0000", 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094034429999999992 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818114+0000", 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4625e-05 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818139+0000", 2024-05-07T14:03:50.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4850000000000001e-05 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819387+0000", 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012488060000000001 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819792+0000", 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040472400000000002 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:50.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820050+0000", 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025799800000000001 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.833596+0000", 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013546069000000001 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843174+0000", 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095773449999999993 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023329199999999999 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843516+0000", 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109051 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2696 3.14 3:2aeb6272:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:50.727 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.7967224069999999, 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022593715, 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2696 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:03:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:03:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913039+0000", 2024-05-07T14:03:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3730000000000001e-06 2024-05-07T14:03:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917057+0000", 2024-05-07T14:03:50.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040181319999999998 2024-05-07T14:03:50.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917099+0000", 2024-05-07T14:03:50.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.155e-05 2024-05-07T14:03:50.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917118+0000", 2024-05-07T14:03:50.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8862e-05 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917285+0000", 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016734000000000001 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917644+0000", 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035872600000000002 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:50.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.918201+0000", 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055705100000000003 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.934860+0000", 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016658665 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935461+0000", 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060165000000000001 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935559+0000", 2024-05-07T14:03:50.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8255e-05 2024-05-07T14:03:50.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935630+0000", 2024-05-07T14:03:50.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0110999999999993e-05 2024-05-07T14:03:50.733 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.733 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.733 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.733 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2704 3.31 e104/21 3:8c38a608:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_21:head v 104'4, mlcod=85'2)", 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.7087094990000002, 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021828251999999999, 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:03:50.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001050+0000", 2024-05-07T14:03:50.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6330000000000001e-06 2024-05-07T14:03:50.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007182+0000", 2024-05-07T14:03:50.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061313840000000001 2024-05-07T14:03:50.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007208+0000", 2024-05-07T14:03:50.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5842000000000001e-05 2024-05-07T14:03:50.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007224+0000", 2024-05-07T14:03:50.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5962999999999999e-05 2024-05-07T14:03:50.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007327+0000", 2024-05-07T14:03:50.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010380200000000001 2024-05-07T14:03:50.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007373+0000", 2024-05-07T14:03:50.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5969e-05 2024-05-07T14:03:50.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.022754+0000", 2024-05-07T14:03:50.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015381099000000001 2024-05-07T14:03:50.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.022877+0000", 2024-05-07T14:03:50.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255999999999999 2024-05-07T14:03:50.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.739 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.739 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2755 3.14 3:2b7affc7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:50.739 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:03:50.739 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.1687955319999999, 2024-05-07T14:03:50.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023747145000000001, 2024-05-07T14:03:50.739 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.739 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.739 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.739 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2755 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:03:50.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540983+0000", 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0466999999999999e-05 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545846+0000", 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048626709999999998 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545883+0000", 2024-05-07T14:03:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6769e-05 2024-05-07T14:03:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545900+0000", 2024-05-07T14:03:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6869999999999999e-05 2024-05-07T14:03:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546070+0000", 2024-05-07T14:03:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017014299999999999 2024-05-07T14:03:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546329+0000", 2024-05-07T14:03:50.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025910400000000002 2024-05-07T14:03:50.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:50.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546560+0000", 2024-05-07T14:03:50.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023119899999999999 2024-05-07T14:03:50.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:50.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.555774+0000", 2024-05-07T14:03:50.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092136490000000008 2024-05-07T14:03:50.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564539+0000", 2024-05-07T14:03:50.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087649870000000001 2024-05-07T14:03:50.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564638+0000", 2024-05-07T14:03:50.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9028000000000001e-05 2024-05-07T14:03:50.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564710+0000", 2024-05-07T14:03:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2257999999999998e-05 2024-05-07T14:03:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2799 3.9 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:03:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.697398722, 2024-05-07T14:03:50.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027222948, 2024-05-07T14:03:50.746 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.746 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.746 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.746 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:50.746 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:50.746 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.746 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2799 2024-05-07T14:03:50.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.746 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:03:50.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:03:50.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012363+0000", 2024-05-07T14:03:50.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6500000000000002e-06 2024-05-07T14:03:50.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016678+0000", 2024-05-07T14:03:50.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043148320000000002 2024-05-07T14:03:50.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016709+0000", 2024-05-07T14:03:50.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0953e-05 2024-05-07T14:03:50.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016726+0000", 2024-05-07T14:03:50.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7022999999999999e-05 2024-05-07T14:03:50.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016864+0000", 2024-05-07T14:03:50.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137854 2024-05-07T14:03:50.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017108+0000", 2024-05-07T14:03:50.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024388099999999999 2024-05-07T14:03:50.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:50.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017333+0000", 2024-05-07T14:03:50.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022492899999999999 2024-05-07T14:03:50.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:50.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.033051+0000", 2024-05-07T14:03:50.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015718352000000001 2024-05-07T14:03:50.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039272+0000", 2024-05-07T14:03:50.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062205139999999999 2024-05-07T14:03:50.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039451+0000", 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017928 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039583+0000", 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013168000000000001 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2802 3.13 e105/46 3:c8761262:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_119:head v 105'4, mlcod=85'2)", 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:03:50.752 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.6638968800000002, 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02254192, 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:03:50.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045864+0000", 2024-05-07T14:03:50.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3530000000000002e-06 2024-05-07T14:03:50.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051333+0000", 2024-05-07T14:03:50.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054687579999999998 2024-05-07T14:03:50.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051366+0000", 2024-05-07T14:03:50.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3215e-05 2024-05-07T14:03:50.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051384+0000", 2024-05-07T14:03:50.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8394e-05 2024-05-07T14:03:50.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051552+0000", 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016783600000000001 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051619+0000", 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7142000000000002e-05 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.068274+0000", 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016654987999999999 2024-05-07T14:03:50.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.068403+0000", 2024-05-07T14:03:50.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012923399999999999 2024-05-07T14:03:50.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.757 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.757 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.758 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2804 3.e e105/21 3:7356dc96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_121:head v 105'10, mlcod=105'8)", 2024-05-07T14:03:50.758 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:03:50.758 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.6364619789999999, 2024-05-07T14:03:50.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029282694000000001, 2024-05-07T14:03:50.758 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.758 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.758 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.758 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:03:50.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:03:50.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073299+0000", 2024-05-07T14:03:50.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:03:50.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076073+0000", 2024-05-07T14:03:50.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027746260000000001 2024-05-07T14:03:50.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076118+0000", 2024-05-07T14:03:50.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4223e-05 2024-05-07T14:03:50.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076138+0000", 2024-05-07T14:03:50.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0622999999999999e-05 2024-05-07T14:03:50.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076324+0000", 2024-05-07T14:03:50.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018613599999999999 2024-05-07T14:03:50.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076376+0000", 2024-05-07T14:03:50.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2068999999999999e-05 2024-05-07T14:03:50.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102438+0000", 2024-05-07T14:03:50.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026061190000000001 2024-05-07T14:03:50.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102579+0000", 2024-05-07T14:03:50.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014143399999999999 2024-05-07T14:03:50.766 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.766 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.766 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.767 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2805 3.1 e105/21 3:819b24c4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_122:head v 105'3, mlcod=104'1)", 2024-05-07T14:03:50.767 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:03:50.767 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.6334991599999995, 2024-05-07T14:03:50.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028404523000000001, 2024-05-07T14:03:50.768 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.768 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.768 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.768 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:03:50.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:03:50.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076262+0000", 2024-05-07T14:03:50.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3800000000000001e-06 2024-05-07T14:03:50.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083265+0000", 2024-05-07T14:03:50.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070039539999999997 2024-05-07T14:03:50.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083309+0000", 2024-05-07T14:03:50.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3516000000000001e-05 2024-05-07T14:03:50.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083333+0000", 2024-05-07T14:03:50.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4471999999999999e-05 2024-05-07T14:03:50.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083520+0000", 2024-05-07T14:03:50.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018616999999999999 2024-05-07T14:03:50.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083588+0000", 2024-05-07T14:03:50.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8405000000000007e-05 2024-05-07T14:03:50.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104547+0000", 2024-05-07T14:03:50.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020959228 2024-05-07T14:03:50.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104664+0000", 2024-05-07T14:03:50.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011639800000000001 2024-05-07T14:03:50.777 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.777 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.777 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.778 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2830 3.9 3:92f5cab2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.778 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.228650+0000", 2024-05-07T14:03:50.778 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.4811079039999999, 2024-05-07T14:03:50.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02137344, 2024-05-07T14:03:50.779 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.779 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.779 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.779 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:50.779 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:50.780 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.780 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2830 2024-05-07T14:03:50.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.780 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.228650+0000", 2024-05-07T14:03:50.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.228650+0000", 2024-05-07T14:03:50.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.228653+0000", 2024-05-07T14:03:50.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9000000000000002e-06 2024-05-07T14:03:50.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234475+0000", 2024-05-07T14:03:50.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058213880000000003 2024-05-07T14:03:50.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234510+0000", 2024-05-07T14:03:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5581999999999999e-05 2024-05-07T14:03:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234528+0000", 2024-05-07T14:03:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7989999999999999e-05 2024-05-07T14:03:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234649+0000", 2024-05-07T14:03:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120306 2024-05-07T14:03:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234908+0000", 2024-05-07T14:03:50.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025924599999999998 2024-05-07T14:03:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.235125+0000", 2024-05-07T14:03:50.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000217486 2024-05-07T14:03:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.245339+0000", 2024-05-07T14:03:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010213355 2024-05-07T14:03:50.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.249870+0000", 2024-05-07T14:03:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045313250000000001 2024-05-07T14:03:50.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.249954+0000", 2024-05-07T14:03:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3728999999999997e-05 2024-05-07T14:03:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.250024+0000", 2024-05-07T14:03:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0133000000000001e-05 2024-05-07T14:03:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.792 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2832 3.1a 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:03:50.793 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.4620943969999995, 2024-05-07T14:03:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030681671000000001, 2024-05-07T14:03:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.794 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2832 2024-05-07T14:03:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:03:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:03:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247666+0000", 2024-05-07T14:03:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5569999999999998e-06 2024-05-07T14:03:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253202+0000", 2024-05-07T14:03:50.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055353900000000003 2024-05-07T14:03:50.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253232+0000", 2024-05-07T14:03:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0309000000000001e-05 2024-05-07T14:03:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253250+0000", 2024-05-07T14:03:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7503000000000002e-05 2024-05-07T14:03:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253372+0000", 2024-05-07T14:03:50.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255600000000001 2024-05-07T14:03:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253592+0000", 2024-05-07T14:03:50.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021960400000000001 2024-05-07T14:03:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253831+0000", 2024-05-07T14:03:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000239223 2024-05-07T14:03:50.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.264040+0000", 2024-05-07T14:03:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010209018 2024-05-07T14:03:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278176+0000", 2024-05-07T14:03:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014135518 2024-05-07T14:03:50.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278272+0000", 2024-05-07T14:03:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6562000000000001e-05 2024-05-07T14:03:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278346+0000", 2024-05-07T14:03:50.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3430999999999995e-05 2024-05-07T14:03:50.807 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.807 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.808 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2835 3.34 3:2eb22351:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.808 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:03:50.808 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.4326218700000002, 2024-05-07T14:03:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021927980999999999, 2024-05-07T14:03:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.809 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2835 2024-05-07T14:03:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:03:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:03:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277140+0000", 2024-05-07T14:03:50.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9729999999999999e-06 2024-05-07T14:03:50.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281106+0000", 2024-05-07T14:03:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039657010000000003 2024-05-07T14:03:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281136+0000", 2024-05-07T14:03:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9913e-05 2024-05-07T14:03:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281152+0000", 2024-05-07T14:03:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5792999999999999e-05 2024-05-07T14:03:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281276+0000", 2024-05-07T14:03:50.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000124537 2024-05-07T14:03:50.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281515+0000", 2024-05-07T14:03:50.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000238698 2024-05-07T14:03:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281747+0000", 2024-05-07T14:03:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023245500000000001 2024-05-07T14:03:50.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298177+0000", 2024-05-07T14:03:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016429322999999999 2024-05-07T14:03:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298772+0000", 2024-05-07T14:03:50.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059492799999999999 2024-05-07T14:03:50.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298944+0000", 2024-05-07T14:03:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017187300000000001 2024-05-07T14:03:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.299064+0000", 2024-05-07T14:03:50.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012078699999999999 2024-05-07T14:03:50.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.822 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.823 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2853 3.34 3:2c5576f8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.823 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:03:50.823 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.2534005090000004, 2024-05-07T14:03:50.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026917739, 2024-05-07T14:03:50.824 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.824 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.824 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.824 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:50.824 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:50.824 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.825 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2853 2024-05-07T14:03:50.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.825 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:03:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:03:50.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456361+0000", 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1240000000000001e-06 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460499+0000", 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041381159999999998 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460528+0000", 2024-05-07T14:03:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8558999999999999e-05 2024-05-07T14:03:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460544+0000", 2024-05-07T14:03:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6200000000000001e-05 2024-05-07T14:03:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460699+0000", 2024-05-07T14:03:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155513 2024-05-07T14:03:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461098+0000", 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039883900000000001 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461508+0000", 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040939399999999999 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.474319+0000", 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012811002 2024-05-07T14:03:50.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483036+0000", 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087174469999999997 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483142+0000", 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010647800000000001 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483276+0000", 2024-05-07T14:03:50.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013306700000000001 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2874 3.34 3:2d878586:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0307984440000002, 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023302047999999999, 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:50.831 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2874 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678964+0000", 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.89e-06 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683101+0000", 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041374669999999997 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683138+0000", 2024-05-07T14:03:50.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7098999999999998e-05 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683155+0000", 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7139999999999999e-05 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683330+0000", 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000174919 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683715+0000", 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038476199999999997 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.684028+0000", 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031283999999999999 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701377+0000", 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017349402999999999 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701948+0000", 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057096800000000004 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702125+0000", 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176319 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702262+0000", 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137241 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.836 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2881 3.1 e105/21 3:8167d3db:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_188:head v 105'5, mlcod=105'3)", 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.9541896080000001, 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021809426999999999, 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755571+0000", 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.357e-06 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759865+0000", 2024-05-07T14:03:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042943870000000002 2024-05-07T14:03:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759901+0000", 2024-05-07T14:03:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5759000000000001e-05 2024-05-07T14:03:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759920+0000", 2024-05-07T14:03:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8559999999999998e-05 2024-05-07T14:03:50.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.760063+0000", 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000143647 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.760108+0000", 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4511999999999997e-05 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.776951+0000", 2024-05-07T14:03:50.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016842754000000001 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.777378+0000", 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042745100000000002 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2883 3.29 e105/21 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head v 105'6, mlcod=104'4)", 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.9301037240000003, 2024-05-07T14:03:50.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022805558, 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779657+0000", 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0370000000000001e-06 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784248+0000", 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045916810000000002 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784272+0000", 2024-05-07T14:03:50.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3281999999999998e-05 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784285+0000", 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3423e-05 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784399+0000", 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011439500000000001 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784452+0000", 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2142000000000003e-05 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802362+0000", 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017910874 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802460+0000", 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7724000000000002e-05 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.845 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.846 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2889 3.e e105/21 3:72a3c671:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_196:head v 105'11, mlcod=105'9)", 2024-05-07T14:03:50.846 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:03:50.846 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.8552322129999999, 2024-05-07T14:03:50.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02270175, 2024-05-07T14:03:50.846 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:50.846 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:50.846 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:50.846 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:50.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854529+0000", 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7499999999999999e-06 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857472+0000", 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002942999 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857510+0000", 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8075999999999999e-05 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857533+0000", 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3353000000000002e-05 2024-05-07T14:03:50.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857695+0000", 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016135300000000001 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857761+0000", 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6759000000000002e-05 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877052+0000", 2024-05-07T14:03:50.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019290656999999999 2024-05-07T14:03:50.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:50.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:50.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:50.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877228+0000", 2024-05-07T14:03:50.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017580300000000001 2024-05-07T14:03:50.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.850 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:50.850 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:50.850 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:50.851 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:50.852 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:50.852 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:50.853 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:50.853 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:50.853 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:50.854 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:50.854 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:50.854 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:50.855 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:50.859+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:50.870 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:50.870 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:50.888 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:50.908 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:50.909 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:50.928 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:50.979 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:50.979 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:50.989 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:50.999+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:50.993 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:51.054 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:51.063+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:51.116 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:51.116 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:51.130 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:03:51.155 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:51.163+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:51.248 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:51.248 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:51.255 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:51.263+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:51.262 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:03:51.356 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:51.367+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:51.429 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:51.429 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:51.443 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:03:51.484 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:51.495+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:51.557 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:51.567+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:51.609 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:51.609 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:51.623 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:03:51.668 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:51.679+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:51.746 INFO:teuthology.orchestra.run.smithi106.stderr:clear 4.10 pg_upmap_items mapping 2024-05-07T14:03:51.750 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:51.750 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:51.760 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:51.771+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:51.766 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:03:51.767 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:03:51.861 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:51.871+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:51.933 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:51.933 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:51.949 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:03:51.992 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:52.003+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:52.062 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:52.071+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:52.116 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:52.116 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:52.130 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:52.176 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:52.187+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:52.251 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:52.252 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:52.264 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:52.275+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:52.266 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:52.365 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:52.375+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:52.395 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:52.395 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:52.409 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:52.496 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:52.507+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:52.567 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:52.575+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:52.578 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:52.578 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:52.592 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:52.668 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:52.675+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:52.761 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:03:52.769 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:52.779+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:52.776 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:52.776 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:52.792 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:52.884 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:52.895+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:52.946 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:03:52.965 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:52.966 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:52.970 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:52.979+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:52.980 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:53.071 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:53.079+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:53.091 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:53.091 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:53.108 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:53.108 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:53.125 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:53.125 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:53.142 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:53.142 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:53.145 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:53.146 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:53.146 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:53.146 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:53.146 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:53.160 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:53.163 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:53.163 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:53.171 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:53.179+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:53.184 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:53.184 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:53.205 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:53.205 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:53.227 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:53.227 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:53.289 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:53.299+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:53.290 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:53.290 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:53.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:53.290 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 173.31610202300001, 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.291 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:53.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:53.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:03:53.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:03:53.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:03:53.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:03:53.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:03:53.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:03:53.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:03:53.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:03:53.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:03:53.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:03:53.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:53.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:03:53.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:03:53.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:03:53.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:03:53.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:03:53.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:03:53.296 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.296 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.296 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.296 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2202 3.0 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:53.297 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:53.297 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.021084643999998, 2024-05-07T14:03:53.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027191908000000001, 2024-05-07T14:03:53.297 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.297 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.297 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.297 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.297 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.297 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.297 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2202 2024-05-07T14:03:53.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.298 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.298 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.298 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:53.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.298 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.298 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:53.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279975+0000", 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0130000000000001e-06 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285489+0000", 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055143570000000001 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285531+0000", 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1504000000000001e-05 2024-05-07T14:03:53.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285550+0000", 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9256e-05 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285747+0000", 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196777 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286120+0000", 2024-05-07T14:03:53.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037285900000000002 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286489+0000", 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036951099999999999 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301589+0000", 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015099728999999999 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307085+0000", 2024-05-07T14:03:53.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054963340000000003 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307127+0000", 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1977999999999997e-05 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307162+0000", 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4589999999999999e-05 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2217 3.0 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 49.810758075999999, 2024-05-07T14:03:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019983529, 2024-05-07T14:03:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2217 2024-05-07T14:03:53.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.304 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:53.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:53.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490299+0000", 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492337+0000", 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020384489999999999 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492391+0000", 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3702000000000002e-05 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492415+0000", 2024-05-07T14:03:53.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3373000000000001e-05 2024-05-07T14:03:53.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492567+0000", 2024-05-07T14:03:53.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152788 2024-05-07T14:03:53.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492843+0000", 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027568999999999998 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493123+0000", 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028014899999999999 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509840+0000", 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016716871000000001 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510203+0000", 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036252499999999999 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510250+0000", 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7231000000000002e-05 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510280+0000", 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0270999999999999e-05 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.308 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2224 3.1a e84/21 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 49.705814408999998, 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020623257999999998, 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:53.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:53.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595243+0000", 2024-05-07T14:03:53.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6800000000000002e-06 2024-05-07T14:03:53.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.601988+0000", 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0067452479999999997 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602044+0000", 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5884999999999998e-05 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602070+0000", 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6359999999999998e-05 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602183+0000", 2024-05-07T14:03:53.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112761 2024-05-07T14:03:53.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602210+0000", 2024-05-07T14:03:53.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6882000000000001e-05 2024-05-07T14:03:53.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615811+0000", 2024-05-07T14:03:53.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01360132 2024-05-07T14:03:53.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615863+0000", 2024-05-07T14:03:53.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2122e-05 2024-05-07T14:03:53.313 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.313 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.313 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2701 3.19 3:9ba4c095:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.3382473889999993, 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017365756999999999, 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2701 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:03:53.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:03:53.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962810+0000", 2024-05-07T14:03:53.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.43e-06 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964338+0000", 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015288190000000001 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964372+0000", 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3104e-05 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964387+0000", 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5226e-05 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964473+0000", 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6289e-05 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964636+0000", 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016293899999999999 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:53.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964792+0000", 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155513 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.979623+0000", 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014831657 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980052+0000", 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042865699999999999 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980116+0000", 2024-05-07T14:03:53.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4592999999999996e-05 2024-05-07T14:03:53.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980173+0000", 2024-05-07T14:03:53.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6530000000000003e-05 2024-05-07T14:03:53.319 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.319 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.319 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.319 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2704 3.31 3:8c38a608:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:53.319 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.3020920399999998, 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.024434902000000001, 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2704 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998965+0000", 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6809999999999998e-06 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000686+0000", 2024-05-07T14:03:53.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00172109 2024-05-07T14:03:53.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000705+0000", 2024-05-07T14:03:53.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8879999999999999e-05 2024-05-07T14:03:53.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000718+0000", 2024-05-07T14:03:53.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2846e-05 2024-05-07T14:03:53.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000794+0000", 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5613999999999998e-05 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000919+0000", 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000124924 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.001034+0000", 2024-05-07T14:03:53.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115158 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.007009+0000", 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059753009999999997 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023250+0000", 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016240477 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023343+0000", 2024-05-07T14:03:53.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3362000000000005e-05 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023397+0000", 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4568999999999999e-05 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2738 3.31 3:8f11b22f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.368415+0000", 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.9326393769999992, 2024-05-07T14:03:53.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014754041000000001, 2024-05-07T14:03:53.326 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.326 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.326 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.326 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.326 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.326 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.326 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2738 2024-05-07T14:03:53.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.326 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.368415+0000", 2024-05-07T14:03:53.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.368415+0000", 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.368418+0000", 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.162e-06 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370172+0000", 2024-05-07T14:03:53.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001753533 2024-05-07T14:03:53.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370198+0000", 2024-05-07T14:03:53.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6458999999999999e-05 2024-05-07T14:03:53.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370215+0000", 2024-05-07T14:03:53.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6379999999999999e-05 2024-05-07T14:03:53.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370304+0000", 2024-05-07T14:03:53.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9149999999999999e-05 2024-05-07T14:03:53.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370479+0000", 2024-05-07T14:03:53.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017554199999999999 2024-05-07T14:03:53.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:53.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370647+0000", 2024-05-07T14:03:53.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016778799999999999 2024-05-07T14:03:53.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.376674+0000", 2024-05-07T14:03:53.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0060270109999999997 2024-05-07T14:03:53.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.383059+0000", 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063850670000000003 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.383120+0000", 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0730999999999998e-05 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.383169+0000", 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9218000000000002e-05 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.331 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2741 3.4 3:22c462fb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.402105+0000", 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.8989495830000003, 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014775256000000001, 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.332 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2741 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402105+0000", 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402105+0000", 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402108+0000", 2024-05-07T14:03:53.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.757e-06 2024-05-07T14:03:53.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404192+0000", 2024-05-07T14:03:53.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020845389999999998 2024-05-07T14:03:53.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404223+0000", 2024-05-07T14:03:53.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0790999999999997e-05 2024-05-07T14:03:53.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404235+0000", 2024-05-07T14:03:53.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2089999999999999e-05 2024-05-07T14:03:53.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404302+0000", 2024-05-07T14:03:53.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6656999999999996e-05 2024-05-07T14:03:53.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404406+0000", 2024-05-07T14:03:53.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010458699999999999 2024-05-07T14:03:53.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:53.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404506+0000", 2024-05-07T14:03:53.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9723999999999996e-05 2024-05-07T14:03:53.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416118+0000", 2024-05-07T14:03:53.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011611593 2024-05-07T14:03:53.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416765+0000", 2024-05-07T14:03:53.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064727999999999997 2024-05-07T14:03:53.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416829+0000", 2024-05-07T14:03:53.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4189999999999994e-05 2024-05-07T14:03:53.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416880+0000", 2024-05-07T14:03:53.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1048000000000003e-05 2024-05-07T14:03:53.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.338 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2743 3.8 e104/99 3:12ce00a0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_60:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.424088+0000", 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.8769666390000008, 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015852854, 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.424088+0000", 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.424088+0000", 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.424090+0000", 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8959999999999999e-06 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426151+0000", 2024-05-07T14:03:53.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020615590000000001 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426175+0000", 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3292999999999999e-05 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426186+0000", 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1630999999999999e-05 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426348+0000", 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161898 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426383+0000", 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4483000000000002e-05 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.439870+0000", 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013486908000000001 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.439941+0000", 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1186000000000006e-05 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2774 3.1f e105/46 3:f948718f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_91:head v 105'3, mlcod=84'1)", 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.733903+0000", 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.5671512950000004, 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016095564999999999, 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.343 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.733903+0000", 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.733903+0000", 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.733904+0000", 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1300000000000001e-07 2024-05-07T14:03:53.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736457+0000", 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025533819999999999 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736483+0000", 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6112999999999999e-05 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736496+0000", 2024-05-07T14:03:53.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3259e-05 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736582+0000", 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5270000000000002e-05 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736610+0000", 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8393000000000001e-05 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.749923+0000", 2024-05-07T14:03:53.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013313319000000001 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.749999+0000", 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5415999999999998e-05 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2795 3.31 3:8c1ef932:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.971318+0000", 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.3297370839999996, 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015852123999999999, 2024-05-07T14:03:53.347 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2795 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.971318+0000", 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.971318+0000", 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.971320+0000", 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0930000000000001e-06 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973467+0000", 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021476799999999999 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973490+0000", 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2591000000000001e-05 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973502+0000", 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2211e-05 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973582+0000", 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9443999999999994e-05 2024-05-07T14:03:53.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973705+0000", 2024-05-07T14:03:53.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012343799999999999 2024-05-07T14:03:53.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:53.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973817+0000", 2024-05-07T14:03:53.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111597 2024-05-07T14:03:53.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.980854+0000", 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0070369209999999998 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.987016+0000", 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061629479999999997 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.987104+0000", 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7472999999999994e-05 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.987170+0000", 2024-05-07T14:03:53.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5728000000000005e-05 2024-05-07T14:03:53.353 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.353 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.353 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.353 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2803 3.4 3:2246d6f5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:53.353 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:03:53.353 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.2473007010000003, 2024-05-07T14:03:53.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021000333999999999, 2024-05-07T14:03:53.353 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.353 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.354 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.354 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.354 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.354 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.354 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2803 2024-05-07T14:03:53.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.354 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:03:53.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053757+0000", 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1049999999999999e-06 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056166+0000", 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002409039 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056189+0000", 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2595e-05 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056200+0000", 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1212999999999999e-05 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056274+0000", 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4086999999999997e-05 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056414+0000", 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000139763 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056555+0000", 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014123900000000001 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.071326+0000", 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014771151999999999 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074566+0000", 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032398570000000001 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074699+0000", 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013297800000000001 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074754+0000", 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5306000000000002e-05 2024-05-07T14:03:53.358 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.359 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.359 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.359 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2811 3.25 3:a6013043:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:53.359 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.134821+0000", 2024-05-07T14:03:53.359 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.1662333450000002, 2024-05-07T14:03:53.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015439613, 2024-05-07T14:03:53.359 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.359 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.359 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.359 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.359 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2811 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.134821+0000", 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.134821+0000", 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.134823+0000", 2024-05-07T14:03:53.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.934e-06 2024-05-07T14:03:53.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136202+0000", 2024-05-07T14:03:53.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013786359999999999 2024-05-07T14:03:53.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136233+0000", 2024-05-07T14:03:53.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1025999999999997e-05 2024-05-07T14:03:53.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136247+0000", 2024-05-07T14:03:53.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4348000000000001e-05 2024-05-07T14:03:53.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136334+0000", 2024-05-07T14:03:53.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6452000000000005e-05 2024-05-07T14:03:53.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136472+0000", 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013793200000000001 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136563+0000", 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1706999999999995e-05 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.143623+0000", 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0070597689999999996 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.150128+0000", 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065045119999999996 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.150192+0000", 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4391000000000001e-05 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.150261+0000", 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8905999999999994e-05 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.364 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2832 3.1a e105/21 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head v 105'9, mlcod=85'7)", 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.0468372010000007, 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023326739999999999, 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254219+0000", 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0059999999999999e-06 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260033+0000", 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058134010000000002 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260063+0000", 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9762000000000001e-05 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260085+0000", 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2157000000000001e-05 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260165+0000", 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9909999999999999e-05 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260195+0000", 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9935000000000001e-05 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277464+0000", 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017269805999999999 2024-05-07T14:03:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277544+0000", 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9763000000000002e-05 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2857 3.32 e105/21 3:4d47cfce:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_164:head v 105'4, mlcod=84'2)", 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.499438+0000", 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.8016169990000002, 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014525326, 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.499438+0000", 2024-05-07T14:03:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.499438+0000", 2024-05-07T14:03:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.499439+0000", 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7290000000000001e-06 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501250+0000", 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018110229999999999 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501273+0000", 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2379999999999999e-05 2024-05-07T14:03:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501286+0000", 2024-05-07T14:03:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3499999999999999e-05 2024-05-07T14:03:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501385+0000", 2024-05-07T14:03:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8356999999999994e-05 2024-05-07T14:03:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501402+0000", 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7337999999999999e-05 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.513916+0000", 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012514058 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.513963+0000", 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6940999999999997e-05 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2860 3.3e 3:7cdd96b9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.772630479, 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019237982000000001, 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2860 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528427+0000", 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5739999999999998e-06 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530685+0000", 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022580009999999999 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530713+0000", 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8552e-05 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530727+0000", 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4054e-05 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530808+0000", 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0741999999999994e-05 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530954+0000", 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145494 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.531051+0000", 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7349999999999995e-05 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.543007+0000", 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011955873000000001 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547544+0000", 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004537091 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547610+0000", 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5722000000000005e-05 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547662+0000", 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2528999999999998e-05 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2869 3.25 3:a4e7d6f7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.623671+0000", 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.6773838520000002, 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015945890000000001, 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2869 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.623671+0000", 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.623671+0000", 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.623674+0000", 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7779999999999999e-06 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625508+0000", 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018344380000000001 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625540+0000", 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1890999999999997e-05 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625555+0000", 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4762e-05 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625629+0000", 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4673999999999997e-05 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625737+0000", 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107421 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625840+0000", 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010359800000000001 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.639429+0000", 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013589037 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.639471+0000", 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1505999999999999e-05 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.639551+0000", 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9783999999999994e-05 2024-05-07T14:03:53.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.639617+0000", 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6000999999999994e-05 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2878 3.25 3:a61790bb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.719882+0000", 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.5811728890000003, 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015143986999999999, 2024-05-07T14:03:53.385 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2878 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.719882+0000", 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.719882+0000", 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.719884+0000", 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9420000000000002e-06 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721527+0000", 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016435709999999999 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721558+0000", 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0582e-05 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721573+0000", 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5670000000000001e-05 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721660+0000", 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6040999999999998e-05 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721827+0000", 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016701500000000001 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721984+0000", 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015734700000000001 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.731807+0000", 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.009822641 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.734912+0000", 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031051730000000001 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.734975+0000", 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3459000000000003e-05 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.735026+0000", 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0546e-05 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.390 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2880 3.19 3:989dc271:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.5599186669999998, 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018463578000000001, 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2880 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741138+0000", 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2510000000000001e-06 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742746+0000", 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001608195 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742776+0000", 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9335999999999998e-05 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742789+0000", 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3059e-05 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742879+0000", 2024-05-07T14:03:53.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0073000000000003e-05 2024-05-07T14:03:53.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.743010+0000", 2024-05-07T14:03:53.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013067999999999999 2024-05-07T14:03:53.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:53.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.743127+0000", 2024-05-07T14:03:53.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117606 2024-05-07T14:03:53.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.752872+0000", 2024-05-07T14:03:53.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0097450880000000007 2024-05-07T14:03:53.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759514+0000", 2024-05-07T14:03:53.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0066419900000000004 2024-05-07T14:03:53.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759554+0000", 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0070000000000001e-05 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759600+0000", 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5229999999999999e-05 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.396 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2897 3.19 3:993ae93c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:53.397 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.945276+0000", 2024-05-07T14:03:53.397 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.3557785149999999, 2024-05-07T14:03:53.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016131030000000001, 2024-05-07T14:03:53.397 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.397 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.397 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.397 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.397 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.397 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.397 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2897 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945276+0000", 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945276+0000", 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945279+0000", 2024-05-07T14:03:53.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0089999999999999e-06 2024-05-07T14:03:53.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946504+0000", 2024-05-07T14:03:53.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001225346 2024-05-07T14:03:53.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946531+0000", 2024-05-07T14:03:53.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6412999999999999e-05 2024-05-07T14:03:53.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946545+0000", 2024-05-07T14:03:53.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4146e-05 2024-05-07T14:03:53.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946655+0000", 2024-05-07T14:03:53.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010969800000000001 2024-05-07T14:03:53.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946819+0000", 2024-05-07T14:03:53.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016466699999999999 2024-05-07T14:03:53.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:53.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946977+0000", 2024-05-07T14:03:53.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000157899 2024-05-07T14:03:53.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.957118+0000", 2024-05-07T14:03:53.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010140335 2024-05-07T14:03:53.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.961330+0000", 2024-05-07T14:03:53.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042127019999999996 2024-05-07T14:03:53.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.961372+0000", 2024-05-07T14:03:53.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1459999999999999e-05 2024-05-07T14:03:53.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.961407+0000", 2024-05-07T14:03:53.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5355000000000003e-05 2024-05-07T14:03:53.403 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.403 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.403 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.403 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.403 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.403 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:53.405 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:53.406 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:53.415+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:53.506 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:53.515+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:53.579 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:53.579 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:53.579 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:53.594 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:53.607 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:53.615+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:53.707 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:53.715+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:53.760 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:53.760 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:53.761 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:53.761 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:53.761 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:53.775 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:53.817 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:53.827+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:53.909 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:53.919+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:53.945 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:53.946 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:53.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:53.946 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:53.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.946 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2202 3.0 e84/21 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:53.946 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:53.946 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.669885485000002, 2024-05-07T14:03:53.946 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020120560999999999, 2024-05-07T14:03:53.946 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.946 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.946 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286676+0000", 2024-05-07T14:03:53.947 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.57e-06 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291894+0000", 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052185740000000001 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291939+0000", 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4676999999999999e-05 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.948 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291959+0000", 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0115999999999998e-05 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292128+0000", 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168758 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292188+0000", 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0565e-05 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.949 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306607+0000", 2024-05-07T14:03:53.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014418733 2024-05-07T14:03:53.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.950 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.950 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306794+0000", 2024-05-07T14:03:53.950 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018656799999999999 2024-05-07T14:03:53.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.950 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.950 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2216 3.21 3:86b25102:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.488455160999997, 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017498730000000001, 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2216 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.951 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468107+0000", 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5980000000000001e-06 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.952 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471311+0000", 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003203811 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471360+0000", 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9100000000000001e-05 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471383+0000", 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3289e-05 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471551+0000", 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167295 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471932+0000", 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038136799999999998 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472296+0000", 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036396200000000001 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.481648+0000", 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093518209999999997 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485379+0000", 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037311919999999999 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485533+0000", 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015429500000000001 2024-05-07T14:03:53.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485602+0000", 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8998999999999994e-05 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2217 3.0 e84/21 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.463238697999998, 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016624692, 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.956 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.957 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.957 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:53.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.957 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.957 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:53.957 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493322+0000", 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7290000000000001e-06 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496239+0000", 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029177949999999999 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496292+0000", 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2769999999999998e-05 2024-05-07T14:03:53.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496318+0000", 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6313e-05 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496471+0000", 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015206799999999999 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496540+0000", 2024-05-07T14:03:53.959 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9598999999999996e-05 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509870+0000", 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013330322 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509945+0000", 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4096000000000003e-05 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2687 3.2 3:43af9208:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 10.138017418, 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037068531000000002, 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2687 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.961 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818544+0000", 2024-05-07T14:03:53.962 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3390000000000001e-06 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821166+0000", 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026214250000000001 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821192+0000", 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5641999999999999e-05 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821203+0000", 2024-05-07T14:03:53.963 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1558e-05 2024-05-07T14:03:53.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821280+0000", 2024-05-07T14:03:53.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7237000000000006e-05 2024-05-07T14:03:53.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:53.964 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821288+0000", 2024-05-07T14:03:53.964 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0930000000000003e-06 2024-05-07T14:03:53.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.964 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823694+0000", 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024052850000000001 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823853+0000", 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015879800000000001 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823991+0000", 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013879100000000001 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.832834+0000", 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088427109999999996 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855474+0000", 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022640304 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855553+0000", 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8994999999999998e-05 2024-05-07T14:03:53.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855610+0000", 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6353000000000001e-05 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2707 3.17 3:e87c5034:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.9200037109999997, 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017998984999999999, 2024-05-07T14:03:53.967 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.968 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.968 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.968 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.968 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.968 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.968 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2707 2024-05-07T14:03:53.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.968 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.968 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036558+0000", 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8030000000000001e-06 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038073+0000", 2024-05-07T14:03:53.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001514872 2024-05-07T14:03:53.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038093+0000", 2024-05-07T14:03:53.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0023000000000001e-05 2024-05-07T14:03:53.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038102+0000", 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3389999999999999e-06 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038183+0000", 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1050999999999994e-05 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038309+0000", 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012564400000000001 2024-05-07T14:03:53.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038401+0000", 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2826999999999997e-05 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.046066+0000", 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007664761 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054423+0000", 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0083565310000000004 2024-05-07T14:03:53.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054497+0000", 2024-05-07T14:03:53.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4302999999999997e-05 2024-05-07T14:03:53.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054554+0000", 2024-05-07T14:03:53.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6830999999999998e-05 2024-05-07T14:03:53.973 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.973 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.973 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2717 3.17 3:eb96a854:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.8018239769999997, 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017081168000000001, 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2717 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.974 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154737+0000", 2024-05-07T14:03:53.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.706e-06 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156940+0000", 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022023619999999998 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156968+0000", 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156982+0000", 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3515e-05 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157066+0000", 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4746999999999993e-05 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157241+0000", 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000174496 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:53.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157410+0000", 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016901000000000001 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.163989+0000", 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065794249999999999 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171687+0000", 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0076973229999999998 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171760+0000", 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3617999999999999e-05 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171816+0000", 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5432000000000001e-05 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2721 3.3b e104/21 3:dd5ea515:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_38:head v 104'7, mlcod=85'5)", 2024-05-07T14:03:53.979 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.7551937930000001, 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017497018999999999, 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.27e-07 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207457+0000", 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0060918650000000001 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207482+0000", 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4765000000000001e-05 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207496+0000", 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3983e-05 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207576+0000", 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9803999999999997e-05 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207605+0000", 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9697e-05 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.218781+0000", 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011175681 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.218862+0000", 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0797000000000006e-05 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.983 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2722 3.2e 3:75db52c2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.7507288939999999, 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019780314, 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.984 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2722 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205833+0000", 2024-05-07T14:03:53.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3289999999999998e-06 2024-05-07T14:03:53.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207811+0000", 2024-05-07T14:03:53.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019781529999999999 2024-05-07T14:03:53.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207829+0000", 2024-05-07T14:03:53.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7402999999999999e-05 2024-05-07T14:03:53.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207838+0000", 2024-05-07T14:03:53.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0210000000000005e-06 2024-05-07T14:03:53.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207902+0000", 2024-05-07T14:03:53.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4406000000000006e-05 2024-05-07T14:03:53.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208094+0000", 2024-05-07T14:03:53.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000191626 2024-05-07T14:03:53.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:53.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208250+0000", 2024-05-07T14:03:53.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156064 2024-05-07T14:03:53.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.219242+0000", 2024-05-07T14:03:53.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010992696999999999 2024-05-07T14:03:53.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.990 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225500+0000", 2024-05-07T14:03:53.990 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.006257182 2024-05-07T14:03:53.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.990 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225550+0000", 2024-05-07T14:03:53.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0173999999999998e-05 2024-05-07T14:03:53.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225610+0000", 2024-05-07T14:03:53.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0259e-05 2024-05-07T14:03:53.991 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.991 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.991 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.991 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2735 3.2 3:4399fdca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:53.992 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:03:53.992 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.6184531419999999, 2024-05-07T14:03:53.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017836129999999999, 2024-05-07T14:03:53.992 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.992 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.992 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.992 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.992 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.992 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.992 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2735 2024-05-07T14:03:53.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:53.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338108+0000", 2024-05-07T14:03:53.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0110000000000001e-06 2024-05-07T14:03:53.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:53.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339842+0000", 2024-05-07T14:03:53.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017333330000000001 2024-05-07T14:03:53.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339870+0000", 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7875999999999999e-05 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339884+0000", 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4678000000000001e-05 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339984+0000", 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9283999999999993e-05 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:53.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.340096+0000", 2024-05-07T14:03:53.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112272 2024-05-07T14:03:53.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:53.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.340201+0000", 2024-05-07T14:03:53.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010467999999999999 2024-05-07T14:03:53.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:53.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.345876+0000", 2024-05-07T14:03:53.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056758260000000001 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355805+0000", 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099281679999999994 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355883+0000", 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8287000000000004e-05 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:53.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355942+0000", 2024-05-07T14:03:53.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8715000000000003e-05 2024-05-07T14:03:53.998 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.998 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:53.998 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:53.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.998 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2742 3.2e 3:77b7f847:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:53.998 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:03:53.998 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.5445871249999996, 2024-05-07T14:03:53.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01669147, 2024-05-07T14:03:53.998 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:53.998 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:53.998 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2742 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:53.999 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411975+0000", 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.225e-06 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413909+0000", 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001934365 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413938+0000", 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8753000000000001e-05 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413953+0000", 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5631e-05 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414034+0000", 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0173000000000006e-05 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414169+0000", 2024-05-07T14:03:54.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013502499999999999 2024-05-07T14:03:54.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:54.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414303+0000", 2024-05-07T14:03:54.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013471800000000001 2024-05-07T14:03:54.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.420795+0000", 2024-05-07T14:03:54.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064916050000000001 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428529+0000", 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077344129999999999 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428605+0000", 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5662999999999997e-05 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428663+0000", 2024-05-07T14:03:54.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7899000000000002e-05 2024-05-07T14:03:54.004 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.004 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.004 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.004 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2773 3.17 3:e87231b1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:54.004 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:03:54.004 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.2380972260000007, 2024-05-07T14:03:54.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028454317, 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2773 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:03:54.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718465+0000", 2024-05-07T14:03:54.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3680000000000002e-06 2024-05-07T14:03:54.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.006 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.006 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729580+0000", 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011115776000000001 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729608+0000", 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7617e-05 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729622+0000", 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3528e-05 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729694+0000", 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2630000000000001e-05 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729812+0000", 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118132 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729913+0000", 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100486 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.744465+0000", 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014551768 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746795+0000", 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023300270000000001 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746865+0000", 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0322999999999997e-05 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746916+0000", 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0661999999999997e-05 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2784 3.17 3:e9b6a230:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.1058016380000009, 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027214069, 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.010 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.011 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.011 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.011 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.011 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.011 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2784 2024-05-07T14:03:54.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.011 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:03:54.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850760+0000", 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0970000000000002e-06 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853165+0000", 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002405309 2024-05-07T14:03:54.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853186+0000", 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0727999999999999e-05 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853196+0000", 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0159e-05 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853277+0000", 2024-05-07T14:03:54.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0519999999999995e-05 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853440+0000", 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016281299999999999 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853608+0000", 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168126 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.860132+0000", 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065242379999999999 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877848+0000", 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017716251999999998 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877919+0000", 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.127e-05 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877971+0000", 2024-05-07T14:03:54.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1557000000000001e-05 2024-05-07T14:03:54.016 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.016 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.016 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.016 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2789 3.2 3:434a8bbf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.016 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:03:54.016 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.0501124209999997, 2024-05-07T14:03:54.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025228071000000001, 2024-05-07T14:03:54.016 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.016 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.017 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.017 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.017 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.017 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.017 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2789 2024-05-07T14:03:54.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.017 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:03:54.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906450+0000", 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5149999999999998e-06 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908568+0000", 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021184279999999999 2024-05-07T14:03:54.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908593+0000", 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5043999999999999e-05 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908607+0000", 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3716999999999999e-05 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908686+0000", 2024-05-07T14:03:54.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9492000000000004e-05 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908818+0000", 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013199199999999999 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908952+0000", 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013385400000000001 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.916238+0000", 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072861810000000001 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931560+0000", 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01532122 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931620+0000", 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0448000000000001e-05 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931674+0000", 2024-05-07T14:03:54.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.418e-05 2024-05-07T14:03:54.022 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.022 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.022 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.022 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2799 3.9 e105/21 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head v 105'7, mlcod=104'5)", 2024-05-07T14:03:54.022 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:54.022 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.9387376209999996, 2024-05-07T14:03:54.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021236735, 2024-05-07T14:03:54.022 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.022 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.75e-07 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024399+0000", 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065773769999999997 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024434+0000", 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4884e-05 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024450+0000", 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6181999999999999e-05 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024523+0000", 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3054999999999998e-05 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024550+0000", 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6735000000000001e-05 2024-05-07T14:03:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.038754+0000", 2024-05-07T14:03:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014204543 2024-05-07T14:03:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.039058+0000", 2024-05-07T14:03:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030348400000000002 2024-05-07T14:03:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2802 3.13 3:c8761262:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.9133082570000006, 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026174424000000002, 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2802 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043253+0000", 2024-05-07T14:03:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7030000000000002e-06 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045330+0000", 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020765139999999998 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045352+0000", 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2532e-05 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045363+0000", 2024-05-07T14:03:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0798000000000001e-05 2024-05-07T14:03:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045446+0000", 2024-05-07T14:03:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3592999999999997e-05 2024-05-07T14:03:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045641+0000", 2024-05-07T14:03:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019462900000000001 2024-05-07T14:03:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045809+0000", 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168312 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.054070+0000", 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082602100000000005 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069299+0000", 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015229457 2024-05-07T14:03:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069371+0000", 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1730000000000006e-05 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069425+0000", 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3946000000000002e-05 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2814 3.2d e105/21 3:b4f9607c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_131:head v 105'2, mlcod=0'0)", 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.7852349440000008, 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017192623000000001, 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2300000000000002e-07 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176766+0000", 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054422209999999997 2024-05-07T14:03:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176788+0000", 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2161e-05 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176802+0000", 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3341e-05 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176882+0000", 2024-05-07T14:03:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0622000000000002e-05 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176913+0000", 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0518999999999997e-05 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.188402+0000", 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011488824999999999 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.188516+0000", 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000114611 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2839 3.17 3:e819508b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.6398188910000009, 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019836402, 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2839 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:03:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316741+0000", 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8029999999999999e-06 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318466+0000", 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017249959999999999 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318491+0000", 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4876e-05 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318502+0000", 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0421999999999999e-05 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318582+0000", 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0593999999999994e-05 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318717+0000", 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013472199999999999 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318836+0000", 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118996 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.325781+0000", 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069447809999999997 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336451+0000", 2024-05-07T14:03:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010670416 2024-05-07T14:03:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336510+0000", 2024-05-07T14:03:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8408e-05 2024-05-07T14:03:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336576+0000", 2024-05-07T14:03:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6388000000000002e-05 2024-05-07T14:03:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2859 3.17 3:eabb580f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.519343+0000", 2024-05-07T14:03:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.4372151049999999, 2024-05-07T14:03:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01719621, 2024-05-07T14:03:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2859 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.519343+0000", 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.519343+0000", 2024-05-07T14:03:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.519346+0000", 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4250000000000001e-06 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520592+0000", 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012463979999999999 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520621+0000", 2024-05-07T14:03:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9081000000000002e-05 2024-05-07T14:03:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520634+0000", 2024-05-07T14:03:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2308e-05 2024-05-07T14:03:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520717+0000", 2024-05-07T14:03:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3644000000000001e-05 2024-05-07T14:03:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520839+0000", 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012172600000000001 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520972+0000", 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000133423 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.526747+0000", 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057745899999999996 2024-05-07T14:03:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.536435+0000", 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0096880590000000006 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.536487+0000", 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1925000000000002e-05 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.536540+0000", 2024-05-07T14:03:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2630999999999998e-05 2024-05-07T14:03:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2888 3.2 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:03:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.1179497460000007, 2024-05-07T14:03:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037006981000000001, 2024-05-07T14:03:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2888 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:03:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838611+0000", 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.441e-06 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840569+0000", 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019573189999999999 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840592+0000", 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3230999999999998e-05 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840605+0000", 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.295e-05 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840681+0000", 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6250999999999999e-05 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840821+0000", 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013997700000000001 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840966+0000", 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144735 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.846709+0000", 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057430809999999997 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875496+0000", 2024-05-07T14:03:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028787366000000002 2024-05-07T14:03:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875565+0000", 2024-05-07T14:03:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8460000000000005e-05 2024-05-07T14:03:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875616+0000", 2024-05-07T14:03:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.117e-05 2024-05-07T14:03:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2893 3.2 3:40c39b87:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.900696+0000", 2024-05-07T14:03:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.0558629429999993, 2024-05-07T14:03:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016827781, 2024-05-07T14:03:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2893 2024-05-07T14:03:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.900696+0000", 2024-05-07T14:03:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.900696+0000", 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.900699+0000", 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1970000000000001e-06 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902430+0000", 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017315340000000001 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902464+0000", 2024-05-07T14:03:54.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:03:54.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902479+0000", 2024-05-07T14:03:54.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5006e-05 2024-05-07T14:03:54.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902553+0000", 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4771999999999995e-05 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902672+0000", 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118689 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902766+0000", 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3740999999999996e-05 2024-05-07T14:03:54.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.911985+0000", 2024-05-07T14:03:54.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092191479999999999 2024-05-07T14:03:54.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.917405+0000", 2024-05-07T14:03:54.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054204190000000001 2024-05-07T14:03:54.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.917474+0000", 2024-05-07T14:03:54.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9012999999999998e-05 2024-05-07T14:03:54.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.917523+0000", 2024-05-07T14:03:54.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9118e-05 2024-05-07T14:03:54.066 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.066 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.067 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.067 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.067 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.067 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:54.068 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:54.069 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:54.079+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:54.170 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:54.179+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:54.245 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:54.245 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:54.245 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:54.245 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:54.263 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:54.308 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:54.319+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:54.372 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:54.383+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:54.380 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:54.380 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:54.394 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:54.480 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:54.491+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:54.559 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 62.265857660000002, 2024-05-07T14:03:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:03:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:03:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:03:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:03:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:03:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:03:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:03:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:03:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:03:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:03:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:03:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:03:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:03:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:03:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2203 3.1e 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 51.276141316, 2024-05-07T14:03:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029129142, 2024-05-07T14:03:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2203 2024-05-07T14:03:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294465+0000", 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7699999999999999e-06 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300328+0000", 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058633460000000002 2024-05-07T14:03:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300384+0000", 2024-05-07T14:03:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6212999999999999e-05 2024-05-07T14:03:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300411+0000", 2024-05-07T14:03:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7109000000000001e-05 2024-05-07T14:03:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300586+0000", 2024-05-07T14:03:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017478799999999999 2024-05-07T14:03:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300941+0000", 2024-05-07T14:03:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035515500000000001 2024-05-07T14:03:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301351+0000", 2024-05-07T14:03:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040996099999999997 2024-05-07T14:03:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.317495+0000", 2024-05-07T14:03:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016143462000000001 2024-05-07T14:03:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323421+0000", 2024-05-07T14:03:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059264649999999997 2024-05-07T14:03:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323498+0000", 2024-05-07T14:03:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6478999999999997e-05 2024-05-07T14:03:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323590+0000", 2024-05-07T14:03:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2393999999999997e-05 2024-05-07T14:03:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2230 3.b 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.900234646000001, 2024-05-07T14:03:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021351564, 2024-05-07T14:03:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2230 2024-05-07T14:03:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670370+0000", 2024-05-07T14:03:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5050000000000002e-06 2024-05-07T14:03:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673214+0000", 2024-05-07T14:03:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028441260000000002 2024-05-07T14:03:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673245+0000", 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0488999999999999e-05 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673259+0000", 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4443e-05 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673356+0000", 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7031e-05 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673531+0000", 2024-05-07T14:03:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017509099999999999 2024-05-07T14:03:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673696+0000", 2024-05-07T14:03:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000164306 2024-05-07T14:03:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684776+0000", 2024-05-07T14:03:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011080054000000001 2024-05-07T14:03:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691578+0000", 2024-05-07T14:03:54.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068025849999999999 2024-05-07T14:03:54.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691659+0000", 2024-05-07T14:03:54.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0976000000000005e-05 2024-05-07T14:03:54.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.578 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.578 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691719+0000", 2024-05-07T14:03:54.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9957999999999998e-05 2024-05-07T14:03:54.579 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.579 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.579 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.579 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2666 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:03:54.579 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:54.579 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.918777759999999, 2024-05-07T14:03:54.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.125351252, 2024-05-07T14:03:54.579 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.579 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.579 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:54.580 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.580 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.580 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.580 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2666 2024-05-07T14:03:54.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.580 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:54.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:54.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651827+0000", 2024-05-07T14:03:54.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-06 2024-05-07T14:03:54.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651834+0000", 2024-05-07T14:03:54.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7700000000000001e-06 2024-05-07T14:03:54.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651850+0000", 2024-05-07T14:03:54.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5755000000000001e-05 2024-05-07T14:03:54.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651862+0000", 2024-05-07T14:03:54.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.237e-05 2024-05-07T14:03:54.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651967+0000", 2024-05-07T14:03:54.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010427199999999999 2024-05-07T14:03:54.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:54.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651977+0000", 2024-05-07T14:03:54.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0743e-05 2024-05-07T14:03:54.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657294+0000", 2024-05-07T14:03:54.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053168069999999998 2024-05-07T14:03:54.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:54.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657305+0000", 2024-05-07T14:03:54.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0662000000000001e-05 2024-05-07T14:03:54.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774211+0000", 2024-05-07T14:03:54.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1169060209999999 2024-05-07T14:03:54.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774394+0000", 2024-05-07T14:03:54.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018268000000000001 2024-05-07T14:03:54.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.585 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.777176+0000", 2024-05-07T14:03:54.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002782025 2024-05-07T14:03:54.585 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.585 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.585 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.585 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2673 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:03:54.585 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:54.586 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.374844573000001, 2024-05-07T14:03:54.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57934507999999996, 2024-05-07T14:03:54.586 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.586 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.586 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:54.586 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.586 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.586 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.586 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2673 2024-05-07T14:03:54.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.586 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9699999999999996e-07 2024-05-07T14:03:54.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195761+0000", 2024-05-07T14:03:54.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2569999999999999e-06 2024-05-07T14:03:54.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195768+0000", 2024-05-07T14:03:54.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.489e-06 2024-05-07T14:03:54.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195774+0000", 2024-05-07T14:03:54.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7389999999999996e-06 2024-05-07T14:03:54.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195866+0000", 2024-05-07T14:03:54.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2349000000000006e-05 2024-05-07T14:03:54.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:54.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195878+0000", 2024-05-07T14:03:54.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1838000000000001e-05 2024-05-07T14:03:54.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774802+0000", 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.578923945 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774906+0000", 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103991 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775103+0000", 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196975 2024-05-07T14:03:54.590 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.591 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.591 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.591 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2684 3.24 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:54.591 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:03:54.591 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 10.784483662, 2024-05-07T14:03:54.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.040396402999999997, 2024-05-07T14:03:54.591 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.591 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.592 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.592 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.592 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.592 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.592 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2684 2024-05-07T14:03:54.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.592 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:03:54.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786122+0000", 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0929999999999999e-06 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788626+0000", 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025042720000000001 2024-05-07T14:03:54.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788659+0000", 2024-05-07T14:03:54.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2824999999999998e-05 2024-05-07T14:03:54.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788673+0000", 2024-05-07T14:03:54.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4721e-05 2024-05-07T14:03:54.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.594 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.594 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788768+0000", 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4178999999999994e-05 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788776+0000", 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2400000000000007e-06 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798002+0000", 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092262230000000004 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798163+0000", 2024-05-07T14:03:54.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161077 2024-05-07T14:03:54.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:54.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798305+0000", 2024-05-07T14:03:54.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014162499999999999 2024-05-07T14:03:54.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.807567+0000", 2024-05-07T14:03:54.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092618869999999999 2024-05-07T14:03:54.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826429+0000", 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018862824 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826470+0000", 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1010999999999997e-05 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826515+0000", 2024-05-07T14:03:54.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4425999999999998e-05 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2700 3.c e104/21 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 10.610637016, 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022078321000000001, 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9299999999999999e-07 2024-05-07T14:03:54.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966313+0000", 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063471889999999996 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966340+0000", 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7514000000000001e-05 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966354+0000", 2024-05-07T14:03:54.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4053000000000001e-05 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966434+0000", 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0273999999999997e-05 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966464+0000", 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.953e-05 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.981968+0000", 2024-05-07T14:03:54.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0155037 2024-05-07T14:03:54.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.982043+0000", 2024-05-07T14:03:54.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5767999999999997e-05 2024-05-07T14:03:54.602 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.602 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.602 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.602 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2710 3.29 3:9701fed0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:54.602 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 10.498811029000001, 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020865083, 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2710 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071794+0000", 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.565e-06 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073899+0000", 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002104809 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073925+0000", 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6125000000000001e-05 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073936+0000", 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0878e-05 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074018+0000", 2024-05-07T14:03:54.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2391000000000004e-05 2024-05-07T14:03:54.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074144+0000", 2024-05-07T14:03:54.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012578599999999999 2024-05-07T14:03:54.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.606 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:54.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074241+0000", 2024-05-07T14:03:54.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7547999999999995e-05 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.082159+0000", 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0079176720000000006 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092527+0000", 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010368004 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092600+0000", 2024-05-07T14:03:54.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3491000000000005e-05 2024-05-07T14:03:54.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092656+0000", 2024-05-07T14:03:54.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5813999999999998e-05 2024-05-07T14:03:54.608 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.608 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.608 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.608 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2712 3.15 e104/21 3:a83036f0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_29:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:54.608 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 10.467247213, 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021527713, 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:03:54.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103357+0000", 2024-05-07T14:03:54.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7260000000000001e-06 2024-05-07T14:03:54.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107529+0000", 2024-05-07T14:03:54.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041726999999999997 2024-05-07T14:03:54.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107551+0000", 2024-05-07T14:03:54.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1854000000000001e-05 2024-05-07T14:03:54.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107563+0000", 2024-05-07T14:03:54.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1362999999999999e-05 2024-05-07T14:03:54.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107633+0000", 2024-05-07T14:03:54.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0432999999999995e-05 2024-05-07T14:03:54.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107652+0000", 2024-05-07T14:03:54.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9250999999999999e-05 2024-05-07T14:03:54.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.612 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124797+0000", 2024-05-07T14:03:54.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017144626 2024-05-07T14:03:54.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124883+0000", 2024-05-07T14:03:54.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5760000000000006e-05 2024-05-07T14:03:54.613 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.613 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.613 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.613 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2726 3.24 3:2710602c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:54.613 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:03:54.613 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 10.326918829, 2024-05-07T14:03:54.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020082965000000001, 2024-05-07T14:03:54.613 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.613 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2726 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243686+0000", 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8420000000000001e-06 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245745+0000", 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020592890000000002 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245765+0000", 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9505e-05 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245777+0000", 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2282e-05 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245842+0000", 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4682000000000002e-05 2024-05-07T14:03:54.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245956+0000", 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113875 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.246056+0000", 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100238 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.249971+0000", 2024-05-07T14:03:54.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039145179999999996 2024-05-07T14:03:54.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263656+0000", 2024-05-07T14:03:54.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013685246999999999 2024-05-07T14:03:54.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.618 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263718+0000", 2024-05-07T14:03:54.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1704000000000004e-05 2024-05-07T14:03:54.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.618 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263766+0000", 2024-05-07T14:03:54.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8782999999999997e-05 2024-05-07T14:03:54.619 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.619 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.619 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.619 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2791 3.27 3:e46b1707:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.619 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:03:54.619 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.6413486699999993, 2024-05-07T14:03:54.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022300529999999999, 2024-05-07T14:03:54.619 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.619 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2791 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929257+0000", 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.281e-06 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931305+0000", 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020483020000000001 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931328+0000", 2024-05-07T14:03:54.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2722e-05 2024-05-07T14:03:54.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931341+0000", 2024-05-07T14:03:54.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3529e-05 2024-05-07T14:03:54.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931415+0000", 2024-05-07T14:03:54.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3597999999999996e-05 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931614+0000", 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019859000000000001 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931758+0000", 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014481699999999999 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.939706+0000", 2024-05-07T14:03:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007948063 2024-05-07T14:03:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951424+0000", 2024-05-07T14:03:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011717708 2024-05-07T14:03:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951500+0000", 2024-05-07T14:03:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5831e-05 2024-05-07T14:03:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951554+0000", 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4088999999999997e-05 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2796 3.18 3:1b781814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.5880999320000004, 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019854381000000001, 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2796 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:03:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982505+0000", 2024-05-07T14:03:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6070000000000002e-06 2024-05-07T14:03:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984438+0000", 2024-05-07T14:03:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019332609999999999 2024-05-07T14:03:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984463+0000", 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4569000000000001e-05 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984473+0000", 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8910000000000007e-06 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984549+0000", 2024-05-07T14:03:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6446999999999995e-05 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984737+0000", 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018843399999999999 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984832+0000", 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4069999999999999e-05 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.999695+0000", 2024-05-07T14:03:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01486345 2024-05-07T14:03:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002219+0000", 2024-05-07T14:03:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002523792 2024-05-07T14:03:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002299+0000", 2024-05-07T14:03:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0360999999999999e-05 2024-05-07T14:03:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002357+0000", 2024-05-07T14:03:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7499e-05 2024-05-07T14:03:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2800 3.18 3:1851862d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:03:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.548195604, 2024-05-07T14:03:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020357577000000002, 2024-05-07T14:03:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2800 2024-05-07T14:03:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:03:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022410+0000", 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0079999999999998e-06 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024625+0000", 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022156350000000001 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024652+0000", 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6715000000000001e-05 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024698+0000", 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6470000000000001e-05 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024776+0000", 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7960000000000006e-05 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024944+0000", 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016757400000000001 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.025106+0000", 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016191 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.041855+0000", 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016748939000000001 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042642+0000", 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078695000000000002 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042712+0000", 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0154999999999995e-05 2024-05-07T14:03:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042764+0000", 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2261e-05 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2817 3.24 3:24a9723e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.3755828739999991, 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020083441, 2024-05-07T14:03:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2817 2024-05-07T14:03:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:03:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195022+0000", 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4399999999999999e-06 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197097+0000", 2024-05-07T14:03:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002075173 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197131+0000", 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3952999999999998e-05 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197148+0000", 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6648000000000001e-05 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197230+0000", 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2341000000000003e-05 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197399+0000", 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168782 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197549+0000", 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000150311 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.210524+0000", 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012974930000000001 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215027+0000", 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045034979999999999 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215068+0000", 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0846000000000002e-05 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215103+0000", 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4518999999999999e-05 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2861 3.22 e105/21 3:479e234a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_168:head v 105'7, mlcod=104'5)", 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 9.0265186740000001, 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021170174999999999, 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.643 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.644 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.644 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:03:54.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:03:54.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544085+0000", 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.815e-06 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548101+0000", 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040158920000000001 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548121+0000", 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9899e-05 2024-05-07T14:03:54.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548132+0000", 2024-05-07T14:03:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0464e-05 2024-05-07T14:03:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548210+0000", 2024-05-07T14:03:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8176000000000005e-05 2024-05-07T14:03:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548229+0000", 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9701999999999999e-05 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.565217+0000", 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016987777999999999 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.565254+0000", 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6449000000000003e-05 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.647 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2864 3.29 3:97632e4b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.9955950389999995, 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021723981, 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2864 2024-05-07T14:03:54.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575010+0000", 2024-05-07T14:03:54.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5660000000000001e-06 2024-05-07T14:03:54.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576737+0000", 2024-05-07T14:03:54.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017271599999999999 2024-05-07T14:03:54.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576768+0000", 2024-05-07T14:03:54.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1424000000000003e-05 2024-05-07T14:03:54.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576783+0000", 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4656e-05 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576880+0000", 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6576999999999994e-05 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577067+0000", 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018795800000000001 2024-05-07T14:03:54.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577285+0000", 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021768499999999999 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.587487+0000", 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010202289 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596612+0000", 2024-05-07T14:03:54.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0091244440000000007 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596681+0000", 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9025999999999999e-05 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596731+0000", 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0195999999999998e-05 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.654 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2865 3.38 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.654 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:03:54.654 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.9879773810000003, 2024-05-07T14:03:54.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.035746371999999998, 2024-05-07T14:03:54.654 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.654 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.654 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.654 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.654 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.654 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.654 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2865 2024-05-07T14:03:54.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582627+0000", 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584611+0000", 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019836350000000001 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584636+0000", 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4943000000000002e-05 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584652+0000", 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5586e-05 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584733+0000", 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0987000000000002e-05 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584881+0000", 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014805800000000001 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:54.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584972+0000", 2024-05-07T14:03:54.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1218999999999995e-05 2024-05-07T14:03:54.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.591149+0000", 2024-05-07T14:03:54.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061766939999999999 2024-05-07T14:03:54.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618207+0000", 2024-05-07T14:03:54.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027058260000000001 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618319+0000", 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011267700000000001 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618371+0000", 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1683e-05 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2872 3.15 e105/21 3:ab0c6c4f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_179:head v 105'7, mlcod=104'5)", 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.9086565719999999, 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020080595999999999, 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661947+0000", 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5099999999999999e-06 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667621+0000", 2024-05-07T14:03:54.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056736269999999997 2024-05-07T14:03:54.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667649+0000", 2024-05-07T14:03:54.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8093e-05 2024-05-07T14:03:54.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667661+0000", 2024-05-07T14:03:54.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2554999999999999e-05 2024-05-07T14:03:54.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667745+0000", 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3301999999999996e-05 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667771+0000", 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6135999999999998e-05 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.681960+0000", 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014189301 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.682026+0000", 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6072e-05 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2883 3.29 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.792813743, 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025309511999999999, 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.664 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2883 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:03:54.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777791+0000", 2024-05-07T14:03:54.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.289e-06 2024-05-07T14:03:54.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779027+0000", 2024-05-07T14:03:54.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001236411 2024-05-07T14:03:54.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779063+0000", 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5658999999999999e-05 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779076+0000", 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3128e-05 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779166+0000", 2024-05-07T14:03:54.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9818e-05 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779398+0000", 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023189400000000001 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779577+0000", 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000179276 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.786782+0000", 2024-05-07T14:03:54.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072052740000000002 2024-05-07T14:03:54.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.802960+0000", 2024-05-07T14:03:54.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016177490999999999 2024-05-07T14:03:54.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803047+0000", 2024-05-07T14:03:54.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6912999999999999e-05 2024-05-07T14:03:54.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803098+0000", 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1359000000000001e-05 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2905 3.1e 3:78954da1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.5194055039999999, 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028568698, 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:54.670 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2905 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051199+0000", 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5299999999999999e-06 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055400+0000", 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042009889999999996 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055458+0000", 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.736e-05 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055486+0000", 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8914000000000001e-05 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055574+0000", 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7120999999999995e-05 2024-05-07T14:03:54.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055726+0000", 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015249600000000001 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055884+0000", 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015788900000000001 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.064235+0000", 2024-05-07T14:03:54.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008350583 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078705+0000", 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014470129999999999 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078900+0000", 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019521799999999999 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:54.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.079765+0000", 2024-05-07T14:03:54.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00086546799999999999 2024-05-07T14:03:54.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.676 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:54.676 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:54.676 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:54.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:54.678 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:54.687+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:54.779 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:54.791+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:54.790 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:03:54.808 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:54.808 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:54.808 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:54.808 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:54.822 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:54.883 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:54.891+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:54.939 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:54.939 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:54.939 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:54.940 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:54.940 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:54.954 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:54.984 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:54.991+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:55.086 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:55.095+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:55.122 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2224 3.1a 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.546157665000003, 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027796929000000001, 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2224 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588348+0000", 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1629999999999998e-06 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594043+0000", 2024-05-07T14:03:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056948950000000002 2024-05-07T14:03:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594085+0000", 2024-05-07T14:03:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1678999999999999e-05 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594113+0000", 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594221+0000", 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107371 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594405+0000", 2024-05-07T14:03:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018468099999999999 2024-05-07T14:03:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594570+0000", 2024-05-07T14:03:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165224 2024-05-07T14:03:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.603655+0000", 2024-05-07T14:03:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090846550000000005 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.615968+0000", 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012313199 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616069+0000", 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100309 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616141+0000", 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2218999999999994e-05 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2229 3.3 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.474861136999998, 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028304669000000001, 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2229 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659643+0000", 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9129999999999999e-06 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664151+0000", 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045081189999999997 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664198+0000", 2024-05-07T14:03:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6431999999999999e-05 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664223+0000", 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5369999999999999e-05 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664313+0000", 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345999999999995e-05 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664428+0000", 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115058 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664566+0000", 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138598 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.671674+0000", 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071074529999999997 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687772+0000", 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016098359 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687871+0000", 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9098000000000006e-05 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687945+0000", 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3923000000000004e-05 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2684 3.24 e104/21 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.335900677, 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026848770000000001, 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:03:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6000000000000004e-07 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810718+0000", 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012116477 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810747+0000", 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8676000000000001e-05 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810791+0000", 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4415000000000001e-05 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810915+0000", 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012363399999999999 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810950+0000", 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5812999999999997e-05 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825326+0000", 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014375852 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825450+0000", 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012334299999999999 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2685 3.1c e104/21 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head v 104'1, mlcod=0'0)", 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.329065005, 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023842609000000001, 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805438+0000", 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.243e-06 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812353+0000", 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069150560000000002 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812385+0000", 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2583000000000003e-05 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812406+0000", 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0378999999999999e-05 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812541+0000", 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013502699999999999 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812591+0000", 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0522999999999997e-05 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829183+0000", 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016591445999999999 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829279+0000", 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6352000000000002e-05 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2686 3.34 3:2ec0e822:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:03:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.325850535000001, 2024-05-07T14:03:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034864805999999998, 2024-05-07T14:03:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2686 2024-05-07T14:03:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808656+0000", 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6029999999999998e-06 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818059+0000", 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094034429999999992 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818114+0000", 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4625e-05 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818139+0000", 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4850000000000001e-05 2024-05-07T14:03:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819387+0000", 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012488060000000001 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819792+0000", 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040472400000000002 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820050+0000", 2024-05-07T14:03:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025799800000000001 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.833596+0000", 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013546069000000001 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843174+0000", 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095773449999999993 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:03:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023329199999999999 2024-05-07T14:03:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843516+0000", 2024-05-07T14:03:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109051 2024-05-07T14:03:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2696 3.14 3:2aeb6272:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:03:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.221465694999999, 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022593715, 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2696 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:03:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913039+0000", 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3730000000000001e-06 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917057+0000", 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040181319999999998 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917099+0000", 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.155e-05 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917118+0000", 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8862e-05 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917285+0000", 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016734000000000001 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917644+0000", 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035872600000000002 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.918201+0000", 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055705100000000003 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.934860+0000", 2024-05-07T14:03:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016658665 2024-05-07T14:03:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935461+0000", 2024-05-07T14:03:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060165000000000001 2024-05-07T14:03:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935559+0000", 2024-05-07T14:03:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8255e-05 2024-05-07T14:03:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935630+0000", 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0110999999999993e-05 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2704 3.31 e104/21 3:8c38a608:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_21:head v 104'4, mlcod=85'2)", 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.133452787, 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021828251999999999, 2024-05-07T14:03:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001050+0000", 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6330000000000001e-06 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007182+0000", 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061313840000000001 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007208+0000", 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5842000000000001e-05 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007224+0000", 2024-05-07T14:03:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5962999999999999e-05 2024-05-07T14:03:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007327+0000", 2024-05-07T14:03:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010380200000000001 2024-05-07T14:03:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007373+0000", 2024-05-07T14:03:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5969e-05 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.022754+0000", 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015381099000000001 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.022877+0000", 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255999999999999 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2755 3.14 3:2b7affc7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.593538819999999, 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023747145000000001, 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2755 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540983+0000", 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0466999999999999e-05 2024-05-07T14:03:55.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545846+0000", 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048626709999999998 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545883+0000", 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6769e-05 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545900+0000", 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6869999999999999e-05 2024-05-07T14:03:55.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546070+0000", 2024-05-07T14:03:55.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017014299999999999 2024-05-07T14:03:55.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546329+0000", 2024-05-07T14:03:55.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025910400000000002 2024-05-07T14:03:55.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:55.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546560+0000", 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023119899999999999 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.555774+0000", 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092136490000000008 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564539+0000", 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087649870000000001 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564638+0000", 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9028000000000001e-05 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564710+0000", 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2257999999999998e-05 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2799 3.9 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:55.165 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:03:55.166 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.122142009999999, 2024-05-07T14:03:55.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027222948, 2024-05-07T14:03:55.166 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.166 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.166 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.166 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:55.166 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:55.166 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:55.166 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2799 2024-05-07T14:03:55.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.166 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012363+0000", 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6500000000000002e-06 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016678+0000", 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043148320000000002 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016709+0000", 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0953e-05 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016726+0000", 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7022999999999999e-05 2024-05-07T14:03:55.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016864+0000", 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137854 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017108+0000", 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024388099999999999 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017333+0000", 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022492899999999999 2024-05-07T14:03:55.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.033051+0000", 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015718352000000001 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039272+0000", 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062205139999999999 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039451+0000", 2024-05-07T14:03:55.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017928 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039583+0000", 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013168000000000001 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2802 3.13 e105/46 3:c8761262:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_119:head v 105'4, mlcod=85'2)", 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.088640168, 2024-05-07T14:03:55.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02254192, 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045864+0000", 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3530000000000002e-06 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051333+0000", 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054687579999999998 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051366+0000", 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3215e-05 2024-05-07T14:03:55.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051384+0000", 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8394e-05 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051552+0000", 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016783600000000001 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051619+0000", 2024-05-07T14:03:55.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7142000000000002e-05 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.068274+0000", 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016654987999999999 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.068403+0000", 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012923399999999999 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2804 3.e e105/21 3:7356dc96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_121:head v 105'10, mlcod=105'8)", 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.061205267, 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029282694000000001, 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073299+0000", 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076073+0000", 2024-05-07T14:03:55.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027746260000000001 2024-05-07T14:03:55.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076118+0000", 2024-05-07T14:03:55.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4223e-05 2024-05-07T14:03:55.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076138+0000", 2024-05-07T14:03:55.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0622999999999999e-05 2024-05-07T14:03:55.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076324+0000", 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018613599999999999 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076376+0000", 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2068999999999999e-05 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102438+0000", 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026061190000000001 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102579+0000", 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014143399999999999 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2805 3.1 e105/21 3:819b24c4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_122:head v 105'3, mlcod=104'1)", 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.058242448, 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028404523000000001, 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.180 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076262+0000", 2024-05-07T14:03:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3800000000000001e-06 2024-05-07T14:03:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083265+0000", 2024-05-07T14:03:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070039539999999997 2024-05-07T14:03:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083309+0000", 2024-05-07T14:03:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3516000000000001e-05 2024-05-07T14:03:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083333+0000", 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4471999999999999e-05 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083520+0000", 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018616999999999999 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083588+0000", 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8405000000000007e-05 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104547+0000", 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020959228 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104664+0000", 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011639800000000001 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.184 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2830 3.9 3:92f5cab2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.228650+0000", 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.9058511920000001, 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02137344, 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2830 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.228650+0000", 2024-05-07T14:03:55.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.228650+0000", 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.228653+0000", 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9000000000000002e-06 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234475+0000", 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058213880000000003 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234510+0000", 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5581999999999999e-05 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234528+0000", 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7989999999999999e-05 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234649+0000", 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120306 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234908+0000", 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025924599999999998 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.235125+0000", 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000217486 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:55.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.245339+0000", 2024-05-07T14:03:55.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010213355 2024-05-07T14:03:55.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:55.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.249870+0000", 2024-05-07T14:03:55.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045313250000000001 2024-05-07T14:03:55.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.249954+0000", 2024-05-07T14:03:55.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3728999999999997e-05 2024-05-07T14:03:55.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.250024+0000", 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0133000000000001e-05 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2832 3.1a 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.8868376849999997, 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030681671000000001, 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.190 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2832 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247666+0000", 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5569999999999998e-06 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253202+0000", 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055353900000000003 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253232+0000", 2024-05-07T14:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0309000000000001e-05 2024-05-07T14:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253250+0000", 2024-05-07T14:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7503000000000002e-05 2024-05-07T14:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253372+0000", 2024-05-07T14:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255600000000001 2024-05-07T14:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253592+0000", 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021960400000000001 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253831+0000", 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000239223 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.264040+0000", 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010209018 2024-05-07T14:03:55.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:55.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278176+0000", 2024-05-07T14:03:55.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014135518 2024-05-07T14:03:55.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278272+0000", 2024-05-07T14:03:55.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6562000000000001e-05 2024-05-07T14:03:55.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278346+0000", 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3430999999999995e-05 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2835 3.34 3:2eb22351:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.8573651580000003, 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021927980999999999, 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.196 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2835 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:03:55.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277140+0000", 2024-05-07T14:03:55.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9729999999999999e-06 2024-05-07T14:03:55.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281106+0000", 2024-05-07T14:03:55.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039657010000000003 2024-05-07T14:03:55.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281136+0000", 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9913e-05 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281152+0000", 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5792999999999999e-05 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281276+0000", 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000124537 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281515+0000", 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000238698 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281747+0000", 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023245500000000001 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298177+0000", 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016429322999999999 2024-05-07T14:03:55.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298772+0000", 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059492799999999999 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298944+0000", 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017187300000000001 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.299064+0000", 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012078699999999999 2024-05-07T14:03:55.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2853 3.34 3:2c5576f8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.6781437970000006, 2024-05-07T14:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026917739, 2024-05-07T14:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:55.202 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2853 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456361+0000", 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1240000000000001e-06 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460499+0000", 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041381159999999998 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460528+0000", 2024-05-07T14:03:55.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8558999999999999e-05 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460544+0000", 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6200000000000001e-05 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460699+0000", 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155513 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461098+0000", 2024-05-07T14:03:55.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039883900000000001 2024-05-07T14:03:55.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:55.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461508+0000", 2024-05-07T14:03:55.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040939399999999999 2024-05-07T14:03:55.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:55.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.474319+0000", 2024-05-07T14:03:55.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012811002 2024-05-07T14:03:55.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483036+0000", 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087174469999999997 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483142+0000", 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010647800000000001 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483276+0000", 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013306700000000001 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.207 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.208 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2874 3.34 3:2d878586:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:55.208 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:03:55.208 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.4555417320000004, 2024-05-07T14:03:55.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023302047999999999, 2024-05-07T14:03:55.208 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.208 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.208 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.208 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:55.208 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:55.208 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2874 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678964+0000", 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.89e-06 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683101+0000", 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041374669999999997 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683138+0000", 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7098999999999998e-05 2024-05-07T14:03:55.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683155+0000", 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7139999999999999e-05 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683330+0000", 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000174919 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683715+0000", 2024-05-07T14:03:55.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038476199999999997 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.684028+0000", 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031283999999999999 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701377+0000", 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017349402999999999 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:55.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701948+0000", 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057096800000000004 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702125+0000", 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176319 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702262+0000", 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137241 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.214 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2881 3.1 e105/21 3:8167d3db:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_188:head v 105'5, mlcod=105'3)", 2024-05-07T14:03:55.214 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:03:55.214 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.3789328960000002, 2024-05-07T14:03:55.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021809426999999999, 2024-05-07T14:03:55.214 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.214 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.214 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.214 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:03:55.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755571+0000", 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.357e-06 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759865+0000", 2024-05-07T14:03:55.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042943870000000002 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759901+0000", 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5759000000000001e-05 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759920+0000", 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8559999999999998e-05 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.760063+0000", 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000143647 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.760108+0000", 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4511999999999997e-05 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.776951+0000", 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016842754000000001 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.777378+0000", 2024-05-07T14:03:55.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042745100000000002 2024-05-07T14:03:55.218 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.218 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.218 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.218 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2883 3.29 e105/21 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head v 105'6, mlcod=104'4)", 2024-05-07T14:03:55.218 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:03:55.218 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.3548470120000005, 2024-05-07T14:03:55.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022805558, 2024-05-07T14:03:55.218 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.218 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779657+0000", 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0370000000000001e-06 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784248+0000", 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045916810000000002 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784272+0000", 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3281999999999998e-05 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784285+0000", 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3423e-05 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784399+0000", 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011439500000000001 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784452+0000", 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2142000000000003e-05 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802362+0000", 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017910874 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802460+0000", 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7724000000000002e-05 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.222 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2889 3.e e105/21 3:72a3c671:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_196:head v 105'11, mlcod=105'9)", 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.2799755009999991, 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02270175, 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854529+0000", 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7499999999999999e-06 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857472+0000", 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002942999 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857510+0000", 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8075999999999999e-05 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857533+0000", 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3353000000000002e-05 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857695+0000", 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016135300000000001 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857761+0000", 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6759000000000002e-05 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877052+0000", 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019290656999999999 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877228+0000", 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017580300000000001 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.226 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.227 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.227 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:55.227 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:55.227 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:03:55.229 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:55.229 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:55.239+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:55.246 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:03:55.329 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:55.339+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:55.398 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:55.398 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:55.398 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:55.398 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:55.412 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:55.420 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:55.420 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:55.436 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:55.436 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:55.452 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:55.452 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:55.456 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:55.467+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:55.468 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:55.468 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:55.486 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:55.486 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:55.504 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:55.504 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:55.525 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:55.525 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:55.530 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:55.539+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:55.531 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:55.531 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:55.545 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:03:55.546 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:55.546 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:55.636 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:03:55.647+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:03:55.712 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:55.712 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:55.726 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:03:55.768 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:55.779+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:55.834 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:55.843+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:55.893 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:55.894 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:55.907 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:03:55.948 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:55.959+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:56.037 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:56.047+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:56.069 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:56.069 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:56.083 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:03:56.137 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:56.151+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:56.238 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:56.247+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:56.248 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:56.248 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:56.262 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:03:56.339 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:56.351+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:56.427 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:56.427 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:56.441 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:03:56.441 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:56.451+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:56.541 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:56.551+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:56.608 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:56.609 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:56.622 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:03:56.642 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:56.655+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:56.743 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:56.755+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:56.787 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:56.787 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:56.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:03:56.849 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:56.863+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:56.932 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:56.932 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:56.944 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:56.955+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:56.945 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:03:57.046 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:57.059+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:57.112 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:57.112 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:57.126 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:03:57.169 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:57.183+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:57.230 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:03:57.277 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:57.291+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:57.295 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:57.295 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:57.310 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:03:57.349 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:57.363+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:57.450 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:57.459+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:57.469 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:57.469 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:57.483 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:03:57.551 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:57.563+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:57.562 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:03:57.597 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:03:57.597 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:03:57.610 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:03:57.652 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:57.663+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:57.692 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:03:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:03:57.707 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:03:57.708 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:03:57.723 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:03:57.723 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:03:57.739 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:03:57.739 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:03:57.753 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:03:57.763+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:03:57.759 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:03:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:03:57.779 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:03:57.779 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:03:57.784 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:03:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 177.811830765, 2024-05-07T14:03:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:03:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:03:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:03:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:03:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:03:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:03:57.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:03:57.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:57.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:03:57.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:03:57.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:03:57.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:03:57.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:03:57.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:03:57.789 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.789 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.789 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.789 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2202 3.0 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 54.516813386000003, 2024-05-07T14:03:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027191908000000001, 2024-05-07T14:03:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2202 2024-05-07T14:03:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:03:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279975+0000", 2024-05-07T14:03:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0130000000000001e-06 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285489+0000", 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055143570000000001 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285531+0000", 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1504000000000001e-05 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285550+0000", 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9256e-05 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285747+0000", 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196777 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286120+0000", 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037285900000000002 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286489+0000", 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036951099999999999 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301589+0000", 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015099728999999999 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307085+0000", 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054963340000000003 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307127+0000", 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1977999999999997e-05 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307162+0000", 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4589999999999999e-05 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2217 3.0 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 54.306486818000003, 2024-05-07T14:03:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019983529, 2024-05-07T14:03:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2217 2024-05-07T14:03:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490299+0000", 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:03:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492337+0000", 2024-05-07T14:03:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020384489999999999 2024-05-07T14:03:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492391+0000", 2024-05-07T14:03:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3702000000000002e-05 2024-05-07T14:03:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492415+0000", 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3373000000000001e-05 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492567+0000", 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152788 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492843+0000", 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027568999999999998 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493123+0000", 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028014899999999999 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509840+0000", 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016716871000000001 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510203+0000", 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036252499999999999 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510250+0000", 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7231000000000002e-05 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510280+0000", 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0270999999999999e-05 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.801 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2224 3.1a e84/21 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 54.201543151000003, 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020623257999999998, 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:03:57.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595243+0000", 2024-05-07T14:03:57.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6800000000000002e-06 2024-05-07T14:03:57.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.601988+0000", 2024-05-07T14:03:57.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0067452479999999997 2024-05-07T14:03:57.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602044+0000", 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5884999999999998e-05 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602070+0000", 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6359999999999998e-05 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602183+0000", 2024-05-07T14:03:57.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112761 2024-05-07T14:03:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602210+0000", 2024-05-07T14:03:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6882000000000001e-05 2024-05-07T14:03:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615811+0000", 2024-05-07T14:03:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01360132 2024-05-07T14:03:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615863+0000", 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2122e-05 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2701 3.19 3:9ba4c095:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.833976131, 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017365756999999999, 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.806 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2701 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962810+0000", 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.43e-06 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964338+0000", 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015288190000000001 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964372+0000", 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3104e-05 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964387+0000", 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5226e-05 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964473+0000", 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6289e-05 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964636+0000", 2024-05-07T14:03:57.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016293899999999999 2024-05-07T14:03:57.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:57.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964792+0000", 2024-05-07T14:03:57.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155513 2024-05-07T14:03:57.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.979623+0000", 2024-05-07T14:03:57.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014831657 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980052+0000", 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042865699999999999 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980116+0000", 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4592999999999996e-05 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980173+0000", 2024-05-07T14:03:57.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6530000000000003e-05 2024-05-07T14:03:57.812 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.812 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.812 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.812 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2704 3.31 3:8c38a608:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:57.812 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:03:57.812 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.797820782000001, 2024-05-07T14:03:57.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.024434902000000001, 2024-05-07T14:03:57.812 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.812 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.812 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2704 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998965+0000", 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6809999999999998e-06 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000686+0000", 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00172109 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000705+0000", 2024-05-07T14:03:57.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8879999999999999e-05 2024-05-07T14:03:57.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000718+0000", 2024-05-07T14:03:57.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2846e-05 2024-05-07T14:03:57.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000794+0000", 2024-05-07T14:03:57.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5613999999999998e-05 2024-05-07T14:03:57.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000919+0000", 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000124924 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.001034+0000", 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115158 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.007009+0000", 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059753009999999997 2024-05-07T14:03:57.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023250+0000", 2024-05-07T14:03:57.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016240477 2024-05-07T14:03:57.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023343+0000", 2024-05-07T14:03:57.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3362000000000005e-05 2024-05-07T14:03:57.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023397+0000", 2024-05-07T14:03:57.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4568999999999999e-05 2024-05-07T14:03:57.818 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.818 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.818 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.818 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2738 3.31 3:8f11b22f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:57.818 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.368415+0000", 2024-05-07T14:03:57.818 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.428368119, 2024-05-07T14:03:57.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014754041000000001, 2024-05-07T14:03:57.818 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.818 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.818 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.819 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.819 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.819 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.819 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2738 2024-05-07T14:03:57.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.819 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.368415+0000", 2024-05-07T14:03:57.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.368415+0000", 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.368418+0000", 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.162e-06 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370172+0000", 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001753533 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370198+0000", 2024-05-07T14:03:57.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6458999999999999e-05 2024-05-07T14:03:57.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370215+0000", 2024-05-07T14:03:57.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6379999999999999e-05 2024-05-07T14:03:57.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370304+0000", 2024-05-07T14:03:57.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9149999999999999e-05 2024-05-07T14:03:57.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370479+0000", 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017554199999999999 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.370647+0000", 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016778799999999999 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.376674+0000", 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0060270109999999997 2024-05-07T14:03:57.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.383059+0000", 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063850670000000003 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.383120+0000", 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0730999999999998e-05 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.383169+0000", 2024-05-07T14:03:57.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9218000000000002e-05 2024-05-07T14:03:57.824 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.824 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.824 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.824 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2741 3.4 3:22c462fb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:57.824 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.402105+0000", 2024-05-07T14:03:57.824 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.394678324999999, 2024-05-07T14:03:57.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014775256000000001, 2024-05-07T14:03:57.824 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.824 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.824 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.824 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2741 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402105+0000", 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402105+0000", 2024-05-07T14:03:57.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.402108+0000", 2024-05-07T14:03:57.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.757e-06 2024-05-07T14:03:57.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404192+0000", 2024-05-07T14:03:57.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020845389999999998 2024-05-07T14:03:57.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404223+0000", 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0790999999999997e-05 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404235+0000", 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2089999999999999e-05 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404302+0000", 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6656999999999996e-05 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404406+0000", 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010458699999999999 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.404506+0000", 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9723999999999996e-05 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416118+0000", 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011611593 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416765+0000", 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00064727999999999997 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416829+0000", 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4189999999999994e-05 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.416880+0000", 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1048000000000003e-05 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.829 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2743 3.8 e104/99 3:12ce00a0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_60:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.424088+0000", 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.372695381, 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015852854, 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.424088+0000", 2024-05-07T14:03:57.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.424088+0000", 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.424090+0000", 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8959999999999999e-06 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426151+0000", 2024-05-07T14:03:57.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020615590000000001 2024-05-07T14:03:57.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426175+0000", 2024-05-07T14:03:57.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3292999999999999e-05 2024-05-07T14:03:57.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426186+0000", 2024-05-07T14:03:57.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1630999999999999e-05 2024-05-07T14:03:57.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426348+0000", 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161898 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.426383+0000", 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4483000000000002e-05 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.439870+0000", 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013486908000000001 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.439941+0000", 2024-05-07T14:03:57.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1186000000000006e-05 2024-05-07T14:03:57.834 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.834 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.834 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.834 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2774 3.1f e105/46 3:f948718f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_91:head v 105'3, mlcod=84'1)", 2024-05-07T14:03:57.834 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.733903+0000", 2024-05-07T14:03:57.834 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.062880036999999, 2024-05-07T14:03:57.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016095564999999999, 2024-05-07T14:03:57.834 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.733903+0000", 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.733903+0000", 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.733904+0000", 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1300000000000001e-07 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736457+0000", 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025533819999999999 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736483+0000", 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6112999999999999e-05 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736496+0000", 2024-05-07T14:03:57.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3259e-05 2024-05-07T14:03:57.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736582+0000", 2024-05-07T14:03:57.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5270000000000002e-05 2024-05-07T14:03:57.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.736610+0000", 2024-05-07T14:03:57.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8393000000000001e-05 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.749923+0000", 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013313319000000001 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.749999+0000", 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5415999999999998e-05 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.839 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2795 3.31 3:8c1ef932:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:57.839 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.971318+0000", 2024-05-07T14:03:57.839 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.825465826, 2024-05-07T14:03:57.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015852123999999999, 2024-05-07T14:03:57.839 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.839 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.839 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.839 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.839 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.839 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.840 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2795 2024-05-07T14:03:57.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.840 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.971318+0000", 2024-05-07T14:03:57.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.971318+0000", 2024-05-07T14:03:57.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.971320+0000", 2024-05-07T14:03:57.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0930000000000001e-06 2024-05-07T14:03:57.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973467+0000", 2024-05-07T14:03:57.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021476799999999999 2024-05-07T14:03:57.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973490+0000", 2024-05-07T14:03:57.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2591000000000001e-05 2024-05-07T14:03:57.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973502+0000", 2024-05-07T14:03:57.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2211e-05 2024-05-07T14:03:57.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973582+0000", 2024-05-07T14:03:57.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9443999999999994e-05 2024-05-07T14:03:57.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973705+0000", 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012343799999999999 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.973817+0000", 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000111597 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.980854+0000", 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0070369209999999998 2024-05-07T14:03:57.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.987016+0000", 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061629479999999997 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.987104+0000", 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7472999999999994e-05 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.987170+0000", 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5728000000000005e-05 2024-05-07T14:03:57.844 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.845 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.845 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.845 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2803 3.4 3:2246d6f5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:57.845 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:03:57.845 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.743029442999999, 2024-05-07T14:03:57.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021000333999999999, 2024-05-07T14:03:57.845 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.845 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.845 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.845 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.845 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2803 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053757+0000", 2024-05-07T14:03:57.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1049999999999999e-06 2024-05-07T14:03:57.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056166+0000", 2024-05-07T14:03:57.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002409039 2024-05-07T14:03:57.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056189+0000", 2024-05-07T14:03:57.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2595e-05 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056200+0000", 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1212999999999999e-05 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056274+0000", 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4086999999999997e-05 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056414+0000", 2024-05-07T14:03:57.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000139763 2024-05-07T14:03:57.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:57.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056555+0000", 2024-05-07T14:03:57.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014123900000000001 2024-05-07T14:03:57.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.071326+0000", 2024-05-07T14:03:57.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014771151999999999 2024-05-07T14:03:57.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074566+0000", 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032398570000000001 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074699+0000", 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013297800000000001 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074754+0000", 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5306000000000002e-05 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.850 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2811 3.25 3:a6013043:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.134821+0000", 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.661962086999999, 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015439613, 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.851 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2811 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.134821+0000", 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.134821+0000", 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.134823+0000", 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.934e-06 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136202+0000", 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013786359999999999 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136233+0000", 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1025999999999997e-05 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136247+0000", 2024-05-07T14:03:57.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4348000000000001e-05 2024-05-07T14:03:57.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136334+0000", 2024-05-07T14:03:57.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6452000000000005e-05 2024-05-07T14:03:57.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136472+0000", 2024-05-07T14:03:57.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013793200000000001 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.136563+0000", 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1706999999999995e-05 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.143623+0000", 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0070597689999999996 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.150128+0000", 2024-05-07T14:03:57.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065045119999999996 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.150192+0000", 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4391000000000001e-05 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.150261+0000", 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8905999999999994e-05 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2832 3.1a e105/21 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head v 105'9, mlcod=85'7)", 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.542565943, 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023326739999999999, 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:03:57.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254219+0000", 2024-05-07T14:03:57.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0059999999999999e-06 2024-05-07T14:03:57.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260033+0000", 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058134010000000002 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260063+0000", 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9762000000000001e-05 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260085+0000", 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2157000000000001e-05 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260165+0000", 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9909999999999999e-05 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260195+0000", 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9935000000000001e-05 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277464+0000", 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017269805999999999 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277544+0000", 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9763000000000002e-05 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2857 3.32 e105/21 3:4d47cfce:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_164:head v 105'4, mlcod=84'2)", 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.499438+0000", 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.297345741000001, 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014525326, 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.861 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.499438+0000", 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.499438+0000", 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.499439+0000", 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7290000000000001e-06 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501250+0000", 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018110229999999999 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501273+0000", 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2379999999999999e-05 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501286+0000", 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3499999999999999e-05 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501385+0000", 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8356999999999994e-05 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.501402+0000", 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7337999999999999e-05 2024-05-07T14:03:57.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.513916+0000", 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012514058 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.513963+0000", 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6940999999999997e-05 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.866 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2860 3.3e 3:7cdd96b9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:57.866 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:03:57.866 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.268359221000001, 2024-05-07T14:03:57.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019237982000000001, 2024-05-07T14:03:57.866 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.866 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.866 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.866 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.866 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.866 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.866 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2860 2024-05-07T14:03:57.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.866 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528427+0000", 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5739999999999998e-06 2024-05-07T14:03:57.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530685+0000", 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022580009999999999 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530713+0000", 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8552e-05 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530727+0000", 2024-05-07T14:03:57.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4054e-05 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530808+0000", 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0741999999999994e-05 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530954+0000", 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145494 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:57.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.531051+0000", 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7349999999999995e-05 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.543007+0000", 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011955873000000001 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547544+0000", 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004537091 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547610+0000", 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5722000000000005e-05 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547662+0000", 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2528999999999998e-05 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2869 3.25 3:a4e7d6f7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.623671+0000", 2024-05-07T14:03:57.871 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.173112593999999, 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015945890000000001, 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2869 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.623671+0000", 2024-05-07T14:03:57.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.623671+0000", 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.623674+0000", 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7779999999999999e-06 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625508+0000", 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0018344380000000001 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625540+0000", 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1890999999999997e-05 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625555+0000", 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4762e-05 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625629+0000", 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4673999999999997e-05 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625737+0000", 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107421 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.625840+0000", 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010359800000000001 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.639429+0000", 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013589037 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.639471+0000", 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1505999999999999e-05 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.639551+0000", 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9783999999999994e-05 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.639617+0000", 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6000999999999994e-05 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2878 3.25 3:a61790bb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.719882+0000", 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.076901631, 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015143986999999999, 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2878 2024-05-07T14:03:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.719882+0000", 2024-05-07T14:03:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.719882+0000", 2024-05-07T14:03:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.719884+0000", 2024-05-07T14:03:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9420000000000002e-06 2024-05-07T14:03:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721527+0000", 2024-05-07T14:03:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016435709999999999 2024-05-07T14:03:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721558+0000", 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0582e-05 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721573+0000", 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5670000000000001e-05 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721660+0000", 2024-05-07T14:03:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6040999999999998e-05 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721827+0000", 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016701500000000001 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.721984+0000", 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015734700000000001 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.731807+0000", 2024-05-07T14:03:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.009822641 2024-05-07T14:03:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.734912+0000", 2024-05-07T14:03:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031051730000000001 2024-05-07T14:03:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.734975+0000", 2024-05-07T14:03:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3459000000000003e-05 2024-05-07T14:03:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.735026+0000", 2024-05-07T14:03:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0546e-05 2024-05-07T14:03:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2880 3.19 3:989dc271:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:03:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.055647409000001, 2024-05-07T14:03:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018463578000000001, 2024-05-07T14:03:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2880 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741138+0000", 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2510000000000001e-06 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742746+0000", 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001608195 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742776+0000", 2024-05-07T14:03:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9335999999999998e-05 2024-05-07T14:03:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742789+0000", 2024-05-07T14:03:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3059e-05 2024-05-07T14:03:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742879+0000", 2024-05-07T14:03:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0073000000000003e-05 2024-05-07T14:03:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.743010+0000", 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013067999999999999 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.743127+0000", 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117606 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.752872+0000", 2024-05-07T14:03:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0097450880000000007 2024-05-07T14:03:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759514+0000", 2024-05-07T14:03:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0066419900000000004 2024-05-07T14:03:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759554+0000", 2024-05-07T14:03:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0070000000000001e-05 2024-05-07T14:03:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759600+0000", 2024-05-07T14:03:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5229999999999999e-05 2024-05-07T14:03:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2897 3.19 3:993ae93c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_204:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.945276+0000", 2024-05-07T14:03:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 11.851507257, 2024-05-07T14:03:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016131030000000001, 2024-05-07T14:03:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2897 2024-05-07T14:03:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945276+0000", 2024-05-07T14:03:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945276+0000", 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945279+0000", 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0089999999999999e-06 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946504+0000", 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001225346 2024-05-07T14:03:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946531+0000", 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6412999999999999e-05 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946545+0000", 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4146e-05 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946655+0000", 2024-05-07T14:03:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010969800000000001 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946819+0000", 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016466699999999999 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.946977+0000", 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000157899 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.957118+0000", 2024-05-07T14:03:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010140335 2024-05-07T14:03:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.961330+0000", 2024-05-07T14:03:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042127019999999996 2024-05-07T14:03:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.961372+0000", 2024-05-07T14:03:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1459999999999999e-05 2024-05-07T14:03:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.961407+0000", 2024-05-07T14:03:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5355000000000003e-05 2024-05-07T14:03:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:57.895 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:57.895 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:57.897 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:03:57.897 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:03:57.897 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:03:57.898 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:03:57.898 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:03:57.899 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:57.911+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:57.997 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:58.011+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:58.066 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:58.066 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:58.067 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:58.067 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:58.079 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:03:58.098 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:58.107+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:58.199 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:58.211+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:58.241 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:58.241 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:58.242 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:58.242 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:58.242 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:58.256 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:03:58.326 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:03:58.327 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:58.339+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:58.401 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:58.415+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:58.420 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:58.421 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:58.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:58.421 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:58.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.421 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2202 3.0 e84/21 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head v 84'1, mlcod=0'0)", 2024-05-07T14:03:58.421 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:58.421 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 55.145681652, 2024-05-07T14:03:58.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020120560999999999, 2024-05-07T14:03:58.421 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.421 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.421 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.421 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:58.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:03:58.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286676+0000", 2024-05-07T14:03:58.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.57e-06 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291894+0000", 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052185740000000001 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291939+0000", 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4676999999999999e-05 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291959+0000", 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0115999999999998e-05 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292128+0000", 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168758 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292188+0000", 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0565e-05 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306607+0000", 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014418733 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306794+0000", 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018656799999999999 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2216 3.21 3:86b25102:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:58.425 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:58.426 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 54.964251328000003, 2024-05-07T14:03:58.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017498730000000001, 2024-05-07T14:03:58.426 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.426 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.426 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.426 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.426 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.426 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.426 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2216 2024-05-07T14:03:58.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.426 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468107+0000", 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5980000000000001e-06 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471311+0000", 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003203811 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471360+0000", 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9100000000000001e-05 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471383+0000", 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3289e-05 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471551+0000", 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167295 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471932+0000", 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038136799999999998 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472296+0000", 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036396200000000001 2024-05-07T14:03:58.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.481648+0000", 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093518209999999997 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485379+0000", 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037311919999999999 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485533+0000", 2024-05-07T14:03:58.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015429500000000001 2024-05-07T14:03:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485602+0000", 2024-05-07T14:03:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8998999999999994e-05 2024-05-07T14:03:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2217 3.0 e84/21 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head v 84'2, mlcod=0'0)", 2024-05-07T14:03:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:58.431 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 54.939034864999996, 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016624692, 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493322+0000", 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7290000000000001e-06 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496239+0000", 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029177949999999999 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496292+0000", 2024-05-07T14:03:58.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2769999999999998e-05 2024-05-07T14:03:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496318+0000", 2024-05-07T14:03:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6313e-05 2024-05-07T14:03:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496471+0000", 2024-05-07T14:03:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015206799999999999 2024-05-07T14:03:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496540+0000", 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9598999999999996e-05 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509870+0000", 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013330322 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509945+0000", 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4096000000000003e-05 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.435 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2687 3.2 3:43af9208:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.613813585000001, 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037068531000000002, 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.436 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2687 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818544+0000", 2024-05-07T14:03:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3390000000000001e-06 2024-05-07T14:03:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821166+0000", 2024-05-07T14:03:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026214250000000001 2024-05-07T14:03:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821192+0000", 2024-05-07T14:03:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5641999999999999e-05 2024-05-07T14:03:58.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821203+0000", 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1558e-05 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821280+0000", 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7237000000000006e-05 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821288+0000", 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0930000000000003e-06 2024-05-07T14:03:58.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823694+0000", 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024052850000000001 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823853+0000", 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015879800000000001 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823991+0000", 2024-05-07T14:03:58.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013879100000000001 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.832834+0000", 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088427109999999996 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855474+0000", 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022640304 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855553+0000", 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8994999999999998e-05 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855610+0000", 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6353000000000001e-05 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2707 3.17 3:e87c5034:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:03:58.442 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.395799878, 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017998984999999999, 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2707 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:03:58.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036558+0000", 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8030000000000001e-06 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038073+0000", 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001514872 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038093+0000", 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0023000000000001e-05 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038102+0000", 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3389999999999999e-06 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038183+0000", 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1050999999999994e-05 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038309+0000", 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012564400000000001 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038401+0000", 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2826999999999997e-05 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.046066+0000", 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007664761 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054423+0000", 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0083565310000000004 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054497+0000", 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4302999999999997e-05 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054554+0000", 2024-05-07T14:03:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6830999999999998e-05 2024-05-07T14:03:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2717 3.17 3:eb96a854:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:03:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.277620144, 2024-05-07T14:03:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017081168000000001, 2024-05-07T14:03:58.448 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2717 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:03:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154737+0000", 2024-05-07T14:03:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.706e-06 2024-05-07T14:03:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156940+0000", 2024-05-07T14:03:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022023619999999998 2024-05-07T14:03:58.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156968+0000", 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156982+0000", 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3515e-05 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157066+0000", 2024-05-07T14:03:58.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4746999999999993e-05 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157241+0000", 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000174496 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157410+0000", 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016901000000000001 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.163989+0000", 2024-05-07T14:03:58.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065794249999999999 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171687+0000", 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0076973229999999998 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171760+0000", 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3617999999999999e-05 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171816+0000", 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5432000000000001e-05 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2721 3.3b e104/21 3:dd5ea515:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_38:head v 104'7, mlcod=85'5)", 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.23098996, 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017497018999999999, 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.454 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.27e-07 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207457+0000", 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0060918650000000001 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207482+0000", 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4765000000000001e-05 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207496+0000", 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3983e-05 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207576+0000", 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9803999999999997e-05 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207605+0000", 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9697e-05 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.218781+0000", 2024-05-07T14:03:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011175681 2024-05-07T14:03:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.218862+0000", 2024-05-07T14:03:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0797000000000006e-05 2024-05-07T14:03:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.458 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2722 3.2e 3:75db52c2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.226525061, 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019780314, 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2722 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205833+0000", 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3289999999999998e-06 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207811+0000", 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019781529999999999 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207829+0000", 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7402999999999999e-05 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207838+0000", 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0210000000000005e-06 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207902+0000", 2024-05-07T14:03:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4406000000000006e-05 2024-05-07T14:03:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208094+0000", 2024-05-07T14:03:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000191626 2024-05-07T14:03:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208250+0000", 2024-05-07T14:03:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156064 2024-05-07T14:03:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.219242+0000", 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010992696999999999 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225500+0000", 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.006257182 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225550+0000", 2024-05-07T14:03:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0173999999999998e-05 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225610+0000", 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0259e-05 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2735 3.2 3:4399fdca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.094249309, 2024-05-07T14:03:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017836129999999999, 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2735 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:03:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338108+0000", 2024-05-07T14:03:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0110000000000001e-06 2024-05-07T14:03:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339842+0000", 2024-05-07T14:03:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017333330000000001 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339870+0000", 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7875999999999999e-05 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339884+0000", 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4678000000000001e-05 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339984+0000", 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9283999999999993e-05 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.340096+0000", 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112272 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.340201+0000", 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010467999999999999 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.345876+0000", 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056758260000000001 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355805+0000", 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099281679999999994 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355883+0000", 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8287000000000004e-05 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355942+0000", 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8715000000000003e-05 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2742 3.2e 3:77b7f847:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.020383292, 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01669147, 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2742 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411975+0000", 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.225e-06 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413909+0000", 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001934365 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413938+0000", 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8753000000000001e-05 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413953+0000", 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5631e-05 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414034+0000", 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0173000000000006e-05 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414169+0000", 2024-05-07T14:03:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013502499999999999 2024-05-07T14:03:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414303+0000", 2024-05-07T14:03:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013471800000000001 2024-05-07T14:03:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.420795+0000", 2024-05-07T14:03:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064916050000000001 2024-05-07T14:03:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428529+0000", 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077344129999999999 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428605+0000", 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5662999999999997e-05 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428663+0000", 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7899000000000002e-05 2024-05-07T14:03:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2773 3.17 3:e87231b1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.713893392999999, 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028454317, 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2773 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718465+0000", 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3680000000000002e-06 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729580+0000", 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011115776000000001 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729608+0000", 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7617e-05 2024-05-07T14:03:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729622+0000", 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3528e-05 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729694+0000", 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2630000000000001e-05 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729812+0000", 2024-05-07T14:03:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118132 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729913+0000", 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100486 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.744465+0000", 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014551768 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746795+0000", 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023300270000000001 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746865+0000", 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0322999999999997e-05 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746916+0000", 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0661999999999997e-05 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.482 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2784 3.17 3:e9b6a230:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:58.482 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:03:58.482 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.581597804999999, 2024-05-07T14:03:58.482 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027214069, 2024-05-07T14:03:58.482 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.482 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.482 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.482 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.482 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.482 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.482 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2784 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850760+0000", 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0970000000000002e-06 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853165+0000", 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002405309 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853186+0000", 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0727999999999999e-05 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853196+0000", 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0159e-05 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853277+0000", 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0519999999999995e-05 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853440+0000", 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016281299999999999 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853608+0000", 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168126 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.860132+0000", 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065242379999999999 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877848+0000", 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017716251999999998 2024-05-07T14:03:58.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877919+0000", 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.127e-05 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877971+0000", 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1557000000000001e-05 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2789 3.2 3:434a8bbf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.525908588, 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025228071000000001, 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2789 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906450+0000", 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5149999999999998e-06 2024-05-07T14:03:58.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908568+0000", 2024-05-07T14:03:58.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021184279999999999 2024-05-07T14:03:58.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908593+0000", 2024-05-07T14:03:58.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5043999999999999e-05 2024-05-07T14:03:58.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908607+0000", 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3716999999999999e-05 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908686+0000", 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9492000000000004e-05 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908818+0000", 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013199199999999999 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908952+0000", 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013385400000000001 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.916238+0000", 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072861810000000001 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931560+0000", 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01532122 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931620+0000", 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0448000000000001e-05 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931674+0000", 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.418e-05 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.493 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2799 3.9 e105/21 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head v 105'7, mlcod=104'5)", 2024-05-07T14:03:58.494 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:58.494 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.414533788, 2024-05-07T14:03:58.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021236735, 2024-05-07T14:03:58.494 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.494 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.494 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.494 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.494 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:58.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.75e-07 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024399+0000", 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065773769999999997 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024434+0000", 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4884e-05 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024450+0000", 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6181999999999999e-05 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024523+0000", 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3054999999999998e-05 2024-05-07T14:03:58.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024550+0000", 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6735000000000001e-05 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.038754+0000", 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014204543 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.039058+0000", 2024-05-07T14:03:58.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030348400000000002 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2802 3.13 3:c8761262:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.389104423999999, 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026174424000000002, 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.498 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2802 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043253+0000", 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7030000000000002e-06 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045330+0000", 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020765139999999998 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045352+0000", 2024-05-07T14:03:58.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2532e-05 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045363+0000", 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0798000000000001e-05 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045446+0000", 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3592999999999997e-05 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045641+0000", 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019462900000000001 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045809+0000", 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168312 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.054070+0000", 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082602100000000005 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069299+0000", 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015229457 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069371+0000", 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1730000000000006e-05 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069425+0000", 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3946000000000002e-05 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.503 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2814 3.2d e105/21 3:b4f9607c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_131:head v 105'2, mlcod=0'0)", 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.261031110999999, 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017192623000000001, 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2300000000000002e-07 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176766+0000", 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054422209999999997 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176788+0000", 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2161e-05 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176802+0000", 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3341e-05 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176882+0000", 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0622000000000002e-05 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176913+0000", 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0518999999999997e-05 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.188402+0000", 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011488824999999999 2024-05-07T14:03:58.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.188516+0000", 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000114611 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2839 3.17 3:e819508b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.115615057999999, 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019836402, 2024-05-07T14:03:58.508 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2839 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:03:58.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316741+0000", 2024-05-07T14:03:58.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8029999999999999e-06 2024-05-07T14:03:58.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318466+0000", 2024-05-07T14:03:58.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017249959999999999 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318491+0000", 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4876e-05 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318502+0000", 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0421999999999999e-05 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318582+0000", 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0593999999999994e-05 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318717+0000", 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013472199999999999 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318836+0000", 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118996 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.325781+0000", 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069447809999999997 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336451+0000", 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010670416 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336510+0000", 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8408e-05 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.514 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336576+0000", 2024-05-07T14:03:58.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6388000000000002e-05 2024-05-07T14:03:58.514 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.514 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.514 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.514 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2859 3.17 3:eabb580f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:58.514 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.519343+0000", 2024-05-07T14:03:58.514 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.913011272, 2024-05-07T14:03:58.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01719621, 2024-05-07T14:03:58.514 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.514 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2859 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.519343+0000", 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.519343+0000", 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.519346+0000", 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4250000000000001e-06 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520592+0000", 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012463979999999999 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520621+0000", 2024-05-07T14:03:58.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9081000000000002e-05 2024-05-07T14:03:58.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520634+0000", 2024-05-07T14:03:58.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2308e-05 2024-05-07T14:03:58.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520717+0000", 2024-05-07T14:03:58.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3644000000000001e-05 2024-05-07T14:03:58.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520839+0000", 2024-05-07T14:03:58.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012172600000000001 2024-05-07T14:03:58.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:58.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520972+0000", 2024-05-07T14:03:58.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000133423 2024-05-07T14:03:58.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.526747+0000", 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057745899999999996 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.536435+0000", 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0096880590000000006 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.536487+0000", 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1925000000000002e-05 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.536540+0000", 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2630999999999998e-05 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2888 3.2 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.593745912999999, 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037006981000000001, 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.520 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2888 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.521 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838611+0000", 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.441e-06 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840569+0000", 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019573189999999999 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840592+0000", 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3230999999999998e-05 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840605+0000", 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.295e-05 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840681+0000", 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6250999999999999e-05 2024-05-07T14:03:58.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840821+0000", 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013997700000000001 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840966+0000", 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144735 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.846709+0000", 2024-05-07T14:03:58.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057430809999999997 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875496+0000", 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028787366000000002 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875565+0000", 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8460000000000005e-05 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875616+0000", 2024-05-07T14:03:58.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.117e-05 2024-05-07T14:03:58.526 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.526 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.526 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.526 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2893 3.2 3:40c39b87:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:58.526 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.900696+0000", 2024-05-07T14:03:58.526 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.53165911, 2024-05-07T14:03:58.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016827781, 2024-05-07T14:03:58.526 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:58.526 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:58.526 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2893 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.900696+0000", 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:58.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.900696+0000", 2024-05-07T14:03:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.900699+0000", 2024-05-07T14:03:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1970000000000001e-06 2024-05-07T14:03:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902430+0000", 2024-05-07T14:03:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017315340000000001 2024-05-07T14:03:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902464+0000", 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902479+0000", 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5006e-05 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902553+0000", 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4771999999999995e-05 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:58.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902672+0000", 2024-05-07T14:03:58.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118689 2024-05-07T14:03:58.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:58.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902766+0000", 2024-05-07T14:03:58.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3740999999999996e-05 2024-05-07T14:03:58.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:58.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.911985+0000", 2024-05-07T14:03:58.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092191479999999999 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.917405+0000", 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054204190000000001 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.917474+0000", 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9012999999999998e-05 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:58.531 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.917523+0000", 2024-05-07T14:03:58.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9118e-05 2024-05-07T14:03:58.532 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.532 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.532 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.532 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:58.532 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:58.532 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:58.533 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:03:58.534 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:58.547+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:58.635 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:58.647+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:58.705 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:58.705 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:58.705 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:03:58.705 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:58.719 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:03:58.763 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:03:58.775+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:03:58.836 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:58.847+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:58.889 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:58.889 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:03:58.889 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:03:58.889 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:03:58.889 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:58.903 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:03:58.937 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:58.947+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:59.030 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:03:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:03:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:03:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:03:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:03:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 66.736673245000006, 2024-05-07T14:03:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:03:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:03:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:03:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:03:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:03:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:03:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:03:59.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:03:59.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:03:59.037 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.037 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.037 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.037 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2203 3.1e 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:59.037 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:59.037 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 55.746956900999997, 2024-05-07T14:03:59.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029129142, 2024-05-07T14:03:59.037 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.037 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.037 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.037 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2203 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:03:59.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294465+0000", 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7699999999999999e-06 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300328+0000", 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058633460000000002 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300384+0000", 2024-05-07T14:03:59.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6212999999999999e-05 2024-05-07T14:03:59.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300411+0000", 2024-05-07T14:03:59.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7109000000000001e-05 2024-05-07T14:03:59.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300586+0000", 2024-05-07T14:03:59.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017478799999999999 2024-05-07T14:03:59.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300941+0000", 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035515500000000001 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301351+0000", 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040996099999999997 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.317495+0000", 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016143462000000001 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323421+0000", 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059264649999999997 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323498+0000", 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6478999999999997e-05 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323590+0000", 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2393999999999997e-05 2024-05-07T14:03:59.042 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.043 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.043 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.043 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2230 3.b 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:59.043 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:59.043 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 55.371050230999998, 2024-05-07T14:03:59.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021351564, 2024-05-07T14:03:59.043 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.043 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.043 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.043 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.043 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2230 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670370+0000", 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5050000000000002e-06 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673214+0000", 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028441260000000002 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673245+0000", 2024-05-07T14:03:59.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0488999999999999e-05 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673259+0000", 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4443e-05 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673356+0000", 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7031e-05 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673531+0000", 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017509099999999999 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673696+0000", 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000164306 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684776+0000", 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011080054000000001 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691578+0000", 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068025849999999999 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691659+0000", 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0976000000000005e-05 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691719+0000", 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9957999999999998e-05 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.048 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2666 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 19.389593345000002, 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.125351252, 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.049 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2666 2024-05-07T14:03:59.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.050 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:59.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:03:59.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651827+0000", 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-06 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651834+0000", 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7700000000000001e-06 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651850+0000", 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5755000000000001e-05 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651862+0000", 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.237e-05 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651967+0000", 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010427199999999999 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651977+0000", 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0743e-05 2024-05-07T14:03:59.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657294+0000", 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053168069999999998 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657305+0000", 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0662000000000001e-05 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774211+0000", 2024-05-07T14:03:59.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1169060209999999 2024-05-07T14:03:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774394+0000", 2024-05-07T14:03:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018268000000000001 2024-05-07T14:03:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.777176+0000", 2024-05-07T14:03:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002782025 2024-05-07T14:03:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.054 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2673 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.845660158000001, 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57934507999999996, 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2673 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.055 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:03:59.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9699999999999996e-07 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195761+0000", 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2569999999999999e-06 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195768+0000", 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.489e-06 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195774+0000", 2024-05-07T14:03:59.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7389999999999996e-06 2024-05-07T14:03:59.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195866+0000", 2024-05-07T14:03:59.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2349000000000006e-05 2024-05-07T14:03:59.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:03:59.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195878+0000", 2024-05-07T14:03:59.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1838000000000001e-05 2024-05-07T14:03:59.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774802+0000", 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.578923945 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774906+0000", 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103991 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775103+0000", 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196975 2024-05-07T14:03:59.059 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2684 3.24 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 15.255299247, 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.040396402999999997, 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.060 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2684 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786122+0000", 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0929999999999999e-06 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788626+0000", 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025042720000000001 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788659+0000", 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2824999999999998e-05 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788673+0000", 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4721e-05 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788768+0000", 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4178999999999994e-05 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788776+0000", 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2400000000000007e-06 2024-05-07T14:03:59.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798002+0000", 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092262230000000004 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798163+0000", 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161077 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798305+0000", 2024-05-07T14:03:59.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014162499999999999 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.807567+0000", 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092618869999999999 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826429+0000", 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018862824 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826470+0000", 2024-05-07T14:03:59.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1010999999999997e-05 2024-05-07T14:03:59.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826515+0000", 2024-05-07T14:03:59.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4425999999999998e-05 2024-05-07T14:03:59.066 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.066 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.066 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.066 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2700 3.c e104/21 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:59.066 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 15.081452601000001, 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022078321000000001, 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:59.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9299999999999999e-07 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966313+0000", 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063471889999999996 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966340+0000", 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7514000000000001e-05 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966354+0000", 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4053000000000001e-05 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966434+0000", 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0273999999999997e-05 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966464+0000", 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.953e-05 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.981968+0000", 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0155037 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.982043+0000", 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5767999999999997e-05 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.070 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2710 3.29 3:9701fed0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.969626613999999, 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020865083, 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2710 2024-05-07T14:03:59.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071794+0000", 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.565e-06 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073899+0000", 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002104809 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073925+0000", 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6125000000000001e-05 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073936+0000", 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0878e-05 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074018+0000", 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2391000000000004e-05 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074144+0000", 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012578599999999999 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074241+0000", 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7547999999999995e-05 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.082159+0000", 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0079176720000000006 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092527+0000", 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010368004 2024-05-07T14:03:59.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092600+0000", 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3491000000000005e-05 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092656+0000", 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5813999999999998e-05 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2712 3.15 e104/21 3:a83036f0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_29:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:03:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.938062798000001, 2024-05-07T14:03:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021527713, 2024-05-07T14:03:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:03:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103357+0000", 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7260000000000001e-06 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107529+0000", 2024-05-07T14:03:59.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041726999999999997 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107551+0000", 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1854000000000001e-05 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107563+0000", 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1362999999999999e-05 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107633+0000", 2024-05-07T14:03:59.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0432999999999995e-05 2024-05-07T14:03:59.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107652+0000", 2024-05-07T14:03:59.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9250999999999999e-05 2024-05-07T14:03:59.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124797+0000", 2024-05-07T14:03:59.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017144626 2024-05-07T14:03:59.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124883+0000", 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5760000000000006e-05 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2726 3.24 3:2710602c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.797734414000001, 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020082965000000001, 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.081 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2726 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243686+0000", 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8420000000000001e-06 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245745+0000", 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020592890000000002 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245765+0000", 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9505e-05 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245777+0000", 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2282e-05 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245842+0000", 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4682000000000002e-05 2024-05-07T14:03:59.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245956+0000", 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113875 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.246056+0000", 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100238 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.249971+0000", 2024-05-07T14:03:59.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039145179999999996 2024-05-07T14:03:59.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263656+0000", 2024-05-07T14:03:59.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013685246999999999 2024-05-07T14:03:59.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263718+0000", 2024-05-07T14:03:59.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1704000000000004e-05 2024-05-07T14:03:59.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263766+0000", 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8782999999999997e-05 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2791 3.27 3:e46b1707:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.112164255, 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022300529999999999, 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.087 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2791 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929257+0000", 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.281e-06 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931305+0000", 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020483020000000001 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931328+0000", 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2722e-05 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931341+0000", 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3529e-05 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931415+0000", 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3597999999999996e-05 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931614+0000", 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019859000000000001 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931758+0000", 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014481699999999999 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.939706+0000", 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007948063 2024-05-07T14:03:59.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951424+0000", 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011717708 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951500+0000", 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5831e-05 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951554+0000", 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4088999999999997e-05 2024-05-07T14:03:59.092 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2796 3.18 3:1b781814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.058915517000001, 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019854381000000001, 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.093 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2796 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982505+0000", 2024-05-07T14:03:59.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6070000000000002e-06 2024-05-07T14:03:59.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984438+0000", 2024-05-07T14:03:59.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019332609999999999 2024-05-07T14:03:59.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984463+0000", 2024-05-07T14:03:59.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4569000000000001e-05 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984473+0000", 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8910000000000007e-06 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984549+0000", 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6446999999999995e-05 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984737+0000", 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018843399999999999 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984832+0000", 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4069999999999999e-05 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.999695+0000", 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01486345 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002219+0000", 2024-05-07T14:03:59.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002523792 2024-05-07T14:03:59.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002299+0000", 2024-05-07T14:03:59.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0360999999999999e-05 2024-05-07T14:03:59.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002357+0000", 2024-05-07T14:03:59.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7499e-05 2024-05-07T14:03:59.098 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.098 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2800 3.18 3:1851862d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.019011189, 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020357577000000002, 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.099 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2800 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022410+0000", 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0079999999999998e-06 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024625+0000", 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022156350000000001 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024652+0000", 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6715000000000001e-05 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024698+0000", 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6470000000000001e-05 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024776+0000", 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7960000000000006e-05 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024944+0000", 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016757400000000001 2024-05-07T14:03:59.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.025106+0000", 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016191 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.041855+0000", 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016748939000000001 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042642+0000", 2024-05-07T14:03:59.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078695000000000002 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042712+0000", 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0154999999999995e-05 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042764+0000", 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2261e-05 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2817 3.24 3:24a9723e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.846398459, 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020083441, 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2817 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.105 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:03:59.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:03:59.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195022+0000", 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4399999999999999e-06 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197097+0000", 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002075173 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197131+0000", 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3952999999999998e-05 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197148+0000", 2024-05-07T14:03:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6648000000000001e-05 2024-05-07T14:03:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197230+0000", 2024-05-07T14:03:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2341000000000003e-05 2024-05-07T14:03:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197399+0000", 2024-05-07T14:03:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168782 2024-05-07T14:03:59.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197549+0000", 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000150311 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.210524+0000", 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012974930000000001 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215027+0000", 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045034979999999999 2024-05-07T14:03:59.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215068+0000", 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0846000000000002e-05 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215103+0000", 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4518999999999999e-05 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.111 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2861 3.22 e105/21 3:479e234a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_168:head v 105'7, mlcod=104'5)", 2024-05-07T14:03:59.111 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:03:59.111 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.497334259000001, 2024-05-07T14:03:59.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021170174999999999, 2024-05-07T14:03:59.111 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.111 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.111 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.111 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:03:59.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544085+0000", 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.815e-06 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548101+0000", 2024-05-07T14:03:59.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040158920000000001 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548121+0000", 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9899e-05 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548132+0000", 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0464e-05 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548210+0000", 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8176000000000005e-05 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548229+0000", 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9701999999999999e-05 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.565217+0000", 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016987777999999999 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.565254+0000", 2024-05-07T14:03:59.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6449000000000003e-05 2024-05-07T14:03:59.115 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.115 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.115 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.115 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2864 3.29 3:97632e4b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.115 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:03:59.115 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.466410624, 2024-05-07T14:03:59.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021723981, 2024-05-07T14:03:59.115 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.115 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2864 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575010+0000", 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5660000000000001e-06 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576737+0000", 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017271599999999999 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576768+0000", 2024-05-07T14:03:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1424000000000003e-05 2024-05-07T14:03:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576783+0000", 2024-05-07T14:03:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4656e-05 2024-05-07T14:03:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576880+0000", 2024-05-07T14:03:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6576999999999994e-05 2024-05-07T14:03:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577067+0000", 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018795800000000001 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577285+0000", 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021768499999999999 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.587487+0000", 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010202289 2024-05-07T14:03:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596612+0000", 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0091244440000000007 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596681+0000", 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9025999999999999e-05 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596731+0000", 2024-05-07T14:03:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0195999999999998e-05 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2865 3.38 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.458792966000001, 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.035746371999999998, 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2865 2024-05-07T14:03:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:03:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:03:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582627+0000", 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584611+0000", 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019836350000000001 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584636+0000", 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4943000000000002e-05 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584652+0000", 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5586e-05 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584733+0000", 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0987000000000002e-05 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584881+0000", 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014805800000000001 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584972+0000", 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1218999999999995e-05 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.591149+0000", 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061766939999999999 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618207+0000", 2024-05-07T14:03:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027058260000000001 2024-05-07T14:03:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618319+0000", 2024-05-07T14:03:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011267700000000001 2024-05-07T14:03:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618371+0000", 2024-05-07T14:03:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1683e-05 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2872 3.15 e105/21 3:ab0c6c4f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_179:head v 105'7, mlcod=104'5)", 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.379472157, 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020080595999999999, 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661947+0000", 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5099999999999999e-06 2024-05-07T14:03:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667621+0000", 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056736269999999997 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667649+0000", 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8093e-05 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667661+0000", 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2554999999999999e-05 2024-05-07T14:03:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667745+0000", 2024-05-07T14:03:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3301999999999996e-05 2024-05-07T14:03:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667771+0000", 2024-05-07T14:03:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6135999999999998e-05 2024-05-07T14:03:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.681960+0000", 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014189301 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.682026+0000", 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6072e-05 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2883 3.29 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 13.263629328, 2024-05-07T14:03:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025309511999999999, 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2883 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777791+0000", 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.289e-06 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779027+0000", 2024-05-07T14:03:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001236411 2024-05-07T14:03:59.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779063+0000", 2024-05-07T14:03:59.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5658999999999999e-05 2024-05-07T14:03:59.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779076+0000", 2024-05-07T14:03:59.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3128e-05 2024-05-07T14:03:59.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779166+0000", 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9818e-05 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779398+0000", 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023189400000000001 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779577+0000", 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000179276 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.786782+0000", 2024-05-07T14:03:59.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072052740000000002 2024-05-07T14:03:59.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.802960+0000", 2024-05-07T14:03:59.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016177490999999999 2024-05-07T14:03:59.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.136 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.136 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803047+0000", 2024-05-07T14:03:59.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6912999999999999e-05 2024-05-07T14:03:59.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803098+0000", 2024-05-07T14:03:59.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1359000000000001e-05 2024-05-07T14:03:59.137 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.137 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.137 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.137 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2905 3.1e 3:78954da1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.137 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:03:59.137 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 12.990221089, 2024-05-07T14:03:59.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028568698, 2024-05-07T14:03:59.138 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:03:59.138 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:03:59.138 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.138 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:03:59.138 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:03:59.138 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.138 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2905 2024-05-07T14:03:59.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.138 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:03:59.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051199+0000", 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5299999999999999e-06 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055400+0000", 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042009889999999996 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055458+0000", 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.736e-05 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055486+0000", 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8914000000000001e-05 2024-05-07T14:03:59.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055574+0000", 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7120999999999995e-05 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055726+0000", 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015249600000000001 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055884+0000", 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015788900000000001 2024-05-07T14:03:59.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.064235+0000", 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008350583 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078705+0000", 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014470129999999999 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078900+0000", 2024-05-07T14:03:59.142 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019521799999999999 2024-05-07T14:03:59.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:03:59.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:03:59.143 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:03:59.143 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.079765+0000", 2024-05-07T14:03:59.143 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00086546799999999999 2024-05-07T14:03:59.143 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.143 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.143 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.143 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:03:59.143 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:03:59.143 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:03:59.145 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:03:59.145 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:03:59.155+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:03:59.246 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:59.259+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:59.276 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:59.276 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:59.276 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:59.276 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:59.290 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:03:59.347 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:03:59.359+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:03:59.413 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:59.413 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:59.413 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:59.414 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:59.414 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:59.428 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:03:59.448 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:59.463+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:59.545 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:59.545 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:03:59.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:03:59.545 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:03:59.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.545 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2224 3.1a 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.969062319000003, 2024-05-07T14:03:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027796929000000001, 2024-05-07T14:03:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2224 2024-05-07T14:03:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:03:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588348+0000", 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1629999999999998e-06 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594043+0000", 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056948950000000002 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594085+0000", 2024-05-07T14:03:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1678999999999999e-05 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594113+0000", 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594221+0000", 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107371 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594405+0000", 2024-05-07T14:03:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018468099999999999 2024-05-07T14:03:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594570+0000", 2024-05-07T14:03:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165224 2024-05-07T14:03:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.603655+0000", 2024-05-07T14:03:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090846550000000005 2024-05-07T14:03:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.615968+0000", 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012313199 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616069+0000", 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100309 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616141+0000", 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2218999999999994e-05 2024-05-07T14:03:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2229 3.3 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.897765790999998, 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028304669000000001, 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2229 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659643+0000", 2024-05-07T14:03:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9129999999999999e-06 2024-05-07T14:03:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664151+0000", 2024-05-07T14:03:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045081189999999997 2024-05-07T14:03:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664198+0000", 2024-05-07T14:03:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6431999999999999e-05 2024-05-07T14:03:59.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664223+0000", 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5369999999999999e-05 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664313+0000", 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345999999999995e-05 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664428+0000", 2024-05-07T14:03:59.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115058 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664566+0000", 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138598 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.671674+0000", 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071074529999999997 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687772+0000", 2024-05-07T14:03:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016098359 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687871+0000", 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9098000000000006e-05 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687945+0000", 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3923000000000004e-05 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2684 3.24 e104/21 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head v 104'6, mlcod=85'4)", 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.758805331, 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026848770000000001, 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:03:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:03:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6000000000000004e-07 2024-05-07T14:03:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810718+0000", 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012116477 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810747+0000", 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8676000000000001e-05 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810791+0000", 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4415000000000001e-05 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810915+0000", 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012363399999999999 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810950+0000", 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5812999999999997e-05 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825326+0000", 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014375852 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825450+0000", 2024-05-07T14:03:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012334299999999999 2024-05-07T14:03:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2685 3.1c e104/21 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head v 104'1, mlcod=0'0)", 2024-05-07T14:03:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:03:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.751969659, 2024-05-07T14:03:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023842609000000001, 2024-05-07T14:03:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805438+0000", 2024-05-07T14:03:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.243e-06 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812353+0000", 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069150560000000002 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812385+0000", 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2583000000000003e-05 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812406+0000", 2024-05-07T14:03:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0378999999999999e-05 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812541+0000", 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013502699999999999 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812591+0000", 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0522999999999997e-05 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829183+0000", 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016591445999999999 2024-05-07T14:03:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829279+0000", 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6352000000000002e-05 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2686 3.34 3:2ec0e822:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.748755189000001, 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034864805999999998, 2024-05-07T14:03:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2686 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:03:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808656+0000", 2024-05-07T14:03:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6029999999999998e-06 2024-05-07T14:03:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818059+0000", 2024-05-07T14:03:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094034429999999992 2024-05-07T14:03:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818114+0000", 2024-05-07T14:03:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4625e-05 2024-05-07T14:03:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818139+0000", 2024-05-07T14:03:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4850000000000001e-05 2024-05-07T14:03:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819387+0000", 2024-05-07T14:03:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012488060000000001 2024-05-07T14:03:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819792+0000", 2024-05-07T14:03:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040472400000000002 2024-05-07T14:03:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820050+0000", 2024-05-07T14:03:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025799800000000001 2024-05-07T14:03:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.833596+0000", 2024-05-07T14:03:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013546069000000001 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843174+0000", 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095773449999999993 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023329199999999999 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843516+0000", 2024-05-07T14:03:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109051 2024-05-07T14:03:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2696 3.14 3:2aeb6272:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:03:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.644370349000001, 2024-05-07T14:03:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022593715, 2024-05-07T14:03:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2696 2024-05-07T14:03:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:03:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:03:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913039+0000", 2024-05-07T14:03:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3730000000000001e-06 2024-05-07T14:03:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917057+0000", 2024-05-07T14:03:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040181319999999998 2024-05-07T14:03:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917099+0000", 2024-05-07T14:03:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.155e-05 2024-05-07T14:03:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917118+0000", 2024-05-07T14:03:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8862e-05 2024-05-07T14:03:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917285+0000", 2024-05-07T14:03:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016734000000000001 2024-05-07T14:03:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917644+0000", 2024-05-07T14:03:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035872600000000002 2024-05-07T14:03:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.918201+0000", 2024-05-07T14:03:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055705100000000003 2024-05-07T14:03:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.934860+0000", 2024-05-07T14:03:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016658665 2024-05-07T14:03:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935461+0000", 2024-05-07T14:03:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060165000000000001 2024-05-07T14:03:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935559+0000", 2024-05-07T14:03:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8255e-05 2024-05-07T14:03:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935630+0000", 2024-05-07T14:03:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0110999999999993e-05 2024-05-07T14:03:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2704 3.31 e104/21 3:8c38a608:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_21:head v 104'4, mlcod=85'2)", 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.556357440999999, 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021828251999999999, 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001050+0000", 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6330000000000001e-06 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007182+0000", 2024-05-07T14:03:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061313840000000001 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007208+0000", 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5842000000000001e-05 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007224+0000", 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5962999999999999e-05 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007327+0000", 2024-05-07T14:03:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010380200000000001 2024-05-07T14:03:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007373+0000", 2024-05-07T14:03:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5969e-05 2024-05-07T14:03:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.022754+0000", 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015381099000000001 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.022877+0000", 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255999999999999 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2755 3.14 3:2b7affc7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:03:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.016443474000001, 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023747145000000001, 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2755 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:03:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540983+0000", 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0466999999999999e-05 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545846+0000", 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048626709999999998 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545883+0000", 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6769e-05 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545900+0000", 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6869999999999999e-05 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546070+0000", 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017014299999999999 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546329+0000", 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025910400000000002 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546560+0000", 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023119899999999999 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.555774+0000", 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092136490000000008 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564539+0000", 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087649870000000001 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564638+0000", 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9028000000000001e-05 2024-05-07T14:03:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564710+0000", 2024-05-07T14:03:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2257999999999998e-05 2024-05-07T14:03:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2799 3.9 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:03:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.545046664000001, 2024-05-07T14:03:59.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027222948, 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2799 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012363+0000", 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6500000000000002e-06 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016678+0000", 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043148320000000002 2024-05-07T14:03:59.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016709+0000", 2024-05-07T14:03:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0953e-05 2024-05-07T14:03:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016726+0000", 2024-05-07T14:03:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7022999999999999e-05 2024-05-07T14:03:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016864+0000", 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137854 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017108+0000", 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024388099999999999 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017333+0000", 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022492899999999999 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.033051+0000", 2024-05-07T14:03:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015718352000000001 2024-05-07T14:03:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039272+0000", 2024-05-07T14:03:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062205139999999999 2024-05-07T14:03:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039451+0000", 2024-05-07T14:03:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017928 2024-05-07T14:03:59.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039583+0000", 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013168000000000001 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2802 3.13 e105/46 3:c8761262:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_119:head v 105'4, mlcod=85'2)", 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.511544821999999, 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02254192, 2024-05-07T14:03:59.601 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045864+0000", 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3530000000000002e-06 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051333+0000", 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054687579999999998 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051366+0000", 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3215e-05 2024-05-07T14:03:59.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051384+0000", 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8394e-05 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051552+0000", 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016783600000000001 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051619+0000", 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7142000000000002e-05 2024-05-07T14:03:59.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.068274+0000", 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016654987999999999 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.068403+0000", 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012923399999999999 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2804 3.e e105/21 3:7356dc96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_121:head v 105'10, mlcod=105'8)", 2024-05-07T14:03:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:03:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.484109921, 2024-05-07T14:03:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029282694000000001, 2024-05-07T14:03:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073299+0000", 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076073+0000", 2024-05-07T14:03:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027746260000000001 2024-05-07T14:03:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076118+0000", 2024-05-07T14:03:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4223e-05 2024-05-07T14:03:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076138+0000", 2024-05-07T14:03:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0622999999999999e-05 2024-05-07T14:03:59.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076324+0000", 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018613599999999999 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076376+0000", 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2068999999999999e-05 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102438+0000", 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026061190000000001 2024-05-07T14:03:59.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102579+0000", 2024-05-07T14:03:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014143399999999999 2024-05-07T14:03:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2805 3.1 e105/21 3:819b24c4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_122:head v 105'3, mlcod=104'1)", 2024-05-07T14:03:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:03:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.481147102, 2024-05-07T14:03:59.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028404523000000001, 2024-05-07T14:03:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:03:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076262+0000", 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3800000000000001e-06 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083265+0000", 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070039539999999997 2024-05-07T14:03:59.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083309+0000", 2024-05-07T14:03:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3516000000000001e-05 2024-05-07T14:03:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083333+0000", 2024-05-07T14:03:59.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4471999999999999e-05 2024-05-07T14:03:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083520+0000", 2024-05-07T14:03:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018616999999999999 2024-05-07T14:03:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083588+0000", 2024-05-07T14:03:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8405000000000007e-05 2024-05-07T14:03:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104547+0000", 2024-05-07T14:03:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020959228 2024-05-07T14:03:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104664+0000", 2024-05-07T14:03:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011639800000000001 2024-05-07T14:03:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2830 3.9 3:92f5cab2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.228650+0000", 2024-05-07T14:03:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.328755846, 2024-05-07T14:03:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02137344, 2024-05-07T14:03:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2830 2024-05-07T14:03:59.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.228650+0000", 2024-05-07T14:03:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.228650+0000", 2024-05-07T14:03:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.228653+0000", 2024-05-07T14:03:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9000000000000002e-06 2024-05-07T14:03:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234475+0000", 2024-05-07T14:03:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058213880000000003 2024-05-07T14:03:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234510+0000", 2024-05-07T14:03:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5581999999999999e-05 2024-05-07T14:03:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234528+0000", 2024-05-07T14:03:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7989999999999999e-05 2024-05-07T14:03:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234649+0000", 2024-05-07T14:03:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120306 2024-05-07T14:03:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234908+0000", 2024-05-07T14:03:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025924599999999998 2024-05-07T14:03:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:03:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.235125+0000", 2024-05-07T14:03:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000217486 2024-05-07T14:03:59.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.245339+0000", 2024-05-07T14:03:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010213355 2024-05-07T14:03:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.249870+0000", 2024-05-07T14:03:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045313250000000001 2024-05-07T14:03:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.249954+0000", 2024-05-07T14:03:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3728999999999997e-05 2024-05-07T14:03:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.250024+0000", 2024-05-07T14:03:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0133000000000001e-05 2024-05-07T14:03:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2832 3.1a 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:03:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.309742339, 2024-05-07T14:03:59.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030681671000000001, 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2832 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247666+0000", 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5569999999999998e-06 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253202+0000", 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055353900000000003 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253232+0000", 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0309000000000001e-05 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253250+0000", 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7503000000000002e-05 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253372+0000", 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255600000000001 2024-05-07T14:03:59.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253592+0000", 2024-05-07T14:03:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021960400000000001 2024-05-07T14:03:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:03:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253831+0000", 2024-05-07T14:03:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000239223 2024-05-07T14:03:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:59.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.264040+0000", 2024-05-07T14:03:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010209018 2024-05-07T14:03:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278176+0000", 2024-05-07T14:03:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014135518 2024-05-07T14:03:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278272+0000", 2024-05-07T14:03:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6562000000000001e-05 2024-05-07T14:03:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278346+0000", 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3430999999999995e-05 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2835 3.34 3:2eb22351:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.280269812, 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021927980999999999, 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.629 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2835 2024-05-07T14:03:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:03:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277140+0000", 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9729999999999999e-06 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281106+0000", 2024-05-07T14:03:59.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039657010000000003 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281136+0000", 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9913e-05 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281152+0000", 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5792999999999999e-05 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281276+0000", 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000124537 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281515+0000", 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000238698 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281747+0000", 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023245500000000001 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298177+0000", 2024-05-07T14:03:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016429322999999999 2024-05-07T14:03:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298772+0000", 2024-05-07T14:03:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059492799999999999 2024-05-07T14:03:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298944+0000", 2024-05-07T14:03:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017187300000000001 2024-05-07T14:03:59.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.299064+0000", 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012078699999999999 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2853 3.34 3:2c5576f8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.101048451, 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026917739, 2024-05-07T14:03:59.635 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2853 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456361+0000", 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1240000000000001e-06 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460499+0000", 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041381159999999998 2024-05-07T14:03:59.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460528+0000", 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8558999999999999e-05 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460544+0000", 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6200000000000001e-05 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460699+0000", 2024-05-07T14:03:59.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155513 2024-05-07T14:03:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461098+0000", 2024-05-07T14:03:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039883900000000001 2024-05-07T14:03:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461508+0000", 2024-05-07T14:03:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040939399999999999 2024-05-07T14:03:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.474319+0000", 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012811002 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483036+0000", 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087174469999999997 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483142+0000", 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010647800000000001 2024-05-07T14:03:59.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483276+0000", 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013306700000000001 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2874 3.34 3:2d878586:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.878446386, 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023302047999999999, 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.641 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:03:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:03:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:03:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2874 2024-05-07T14:03:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:03:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:03:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678964+0000", 2024-05-07T14:03:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.89e-06 2024-05-07T14:03:59.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683101+0000", 2024-05-07T14:03:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041374669999999997 2024-05-07T14:03:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683138+0000", 2024-05-07T14:03:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7098999999999998e-05 2024-05-07T14:03:59.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683155+0000", 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7139999999999999e-05 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683330+0000", 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000174919 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683715+0000", 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038476199999999997 2024-05-07T14:03:59.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:03:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.684028+0000", 2024-05-07T14:03:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031283999999999999 2024-05-07T14:03:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:03:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701377+0000", 2024-05-07T14:03:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017349402999999999 2024-05-07T14:03:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701948+0000", 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057096800000000004 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702125+0000", 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176319 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702262+0000", 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137241 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.647 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2881 3.1 e105/21 3:8167d3db:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_188:head v 105'5, mlcod=105'3)", 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.80183755, 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021809426999999999, 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755571+0000", 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.357e-06 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759865+0000", 2024-05-07T14:03:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042943870000000002 2024-05-07T14:03:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759901+0000", 2024-05-07T14:03:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5759000000000001e-05 2024-05-07T14:03:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759920+0000", 2024-05-07T14:03:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8559999999999998e-05 2024-05-07T14:03:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.760063+0000", 2024-05-07T14:03:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000143647 2024-05-07T14:03:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.760108+0000", 2024-05-07T14:03:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4511999999999997e-05 2024-05-07T14:03:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.776951+0000", 2024-05-07T14:03:59.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016842754000000001 2024-05-07T14:03:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.777378+0000", 2024-05-07T14:03:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042745100000000002 2024-05-07T14:03:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.652 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2883 3.29 e105/21 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head v 105'6, mlcod=104'4)", 2024-05-07T14:03:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:03:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.777751666, 2024-05-07T14:03:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022805558, 2024-05-07T14:03:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:03:59.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:03:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779657+0000", 2024-05-07T14:03:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0370000000000001e-06 2024-05-07T14:03:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784248+0000", 2024-05-07T14:03:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045916810000000002 2024-05-07T14:03:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784272+0000", 2024-05-07T14:03:59.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3281999999999998e-05 2024-05-07T14:03:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784285+0000", 2024-05-07T14:03:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3423e-05 2024-05-07T14:03:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784399+0000", 2024-05-07T14:03:59.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011439500000000001 2024-05-07T14:03:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784452+0000", 2024-05-07T14:03:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2142000000000003e-05 2024-05-07T14:03:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802362+0000", 2024-05-07T14:03:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017910874 2024-05-07T14:03:59.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802460+0000", 2024-05-07T14:03:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7724000000000002e-05 2024-05-07T14:03:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2889 3.e e105/21 3:72a3c671:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_196:head v 105'11, mlcod=105'9)", 2024-05-07T14:03:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:03:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 13.702880155000001, 2024-05-07T14:03:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02270175, 2024-05-07T14:03:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:03:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:03:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:03:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:03:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:03:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:03:59.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:03:59.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:03:59.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:03:59.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:03:59.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854529+0000", 2024-05-07T14:03:59.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7499999999999999e-06 2024-05-07T14:03:59.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:03:59.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857472+0000", 2024-05-07T14:03:59.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002942999 2024-05-07T14:03:59.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:03:59.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857510+0000", 2024-05-07T14:03:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8075999999999999e-05 2024-05-07T14:03:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:03:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857533+0000", 2024-05-07T14:03:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3353000000000002e-05 2024-05-07T14:03:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:03:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857695+0000", 2024-05-07T14:03:59.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016135300000000001 2024-05-07T14:03:59.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:03:59.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857761+0000", 2024-05-07T14:03:59.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6759000000000002e-05 2024-05-07T14:03:59.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:03:59.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877052+0000", 2024-05-07T14:03:59.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019290656999999999 2024-05-07T14:03:59.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:03:59.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:03:59.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:03:59.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877228+0000", 2024-05-07T14:03:59.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017580300000000001 2024-05-07T14:03:59.664 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.664 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.664 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.664 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:03:59.664 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:03:59.664 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:59.666 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:03:59.667 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:59.679+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:59.769 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:03:59.775+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:03:59.799 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:59.799 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:03:59.799 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:03:59.813 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:03:59.868 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:03:59.883+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:03:59.899 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:03:59.971 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:03:59.983+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:03:59.988 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:03:59.988 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:03:59.988 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:03:59.988 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:03:59.988 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:00.011 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:04:00.060 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:00.070 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:00.079+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:00.076 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:00.093 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:00.093 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:00.109 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:00.129 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:00.133 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:00.133 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:00.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:00.134 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:00.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.134 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2498 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:00.134 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:00.134 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.749347176999997, 2024-05-07T14:04:00.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.06015305, 2024-05-07T14:04:00.134 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.134 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.134 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:00.134 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.134 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.134 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.135 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2498 2024-05-07T14:04:00.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.135 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:00.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:00.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394887+0000", 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394900+0000", 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3125999999999999e-05 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394940+0000", 2024-05-07T14:04:00.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9579999999999997e-05 2024-05-07T14:04:00.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394961+0000", 2024-05-07T14:04:00.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1075999999999999e-05 2024-05-07T14:04:00.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395122+0000", 2024-05-07T14:04:00.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160741 2024-05-07T14:04:00.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:00.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395140+0000", 2024-05-07T14:04:00.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:04:00.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430325+0000", 2024-05-07T14:04:00.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.03518512 2024-05-07T14:04:00.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:00.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430355+0000", 2024-05-07T14:04:00.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9181999999999999e-05 2024-05-07T14:04:00.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.445424+0000", 2024-05-07T14:04:00.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.015069751 2024-05-07T14:04:00.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:00.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.446159+0000", 2024-05-07T14:04:00.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073452200000000004 2024-05-07T14:04:00.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450456+0000", 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042973689999999997 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450627+0000", 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017032700000000001 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455037+0000", 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044108690000000004 2024-05-07T14:04:00.140 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2499 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.749218128000003, 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.065623158, 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.141 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.142 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2499 2024-05-07T14:04:00.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.142 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:00.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:00.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395015+0000", 2024-05-07T14:04:00.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.57e-06 2024-05-07T14:04:00.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395022+0000", 2024-05-07T14:04:00.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1330000000000001e-06 2024-05-07T14:04:00.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395043+0000", 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1022999999999998e-05 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395060+0000", 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6325999999999999e-05 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395199+0000", 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139815 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395215+0000", 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5693e-05 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413112+0000", 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017896860000000001 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413143+0000", 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1609000000000002e-05 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.447430+0000", 2024-05-07T14:04:00.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0342867060000001 2024-05-07T14:04:00.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:00.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450079+0000", 2024-05-07T14:04:00.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002648386 2024-05-07T14:04:00.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455213+0000", 2024-05-07T14:04:00.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051342749999999998 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455444+0000", 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023070799999999999 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.460637+0000", 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051930539999999999 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.148 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2667 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:00.148 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:00.148 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.493973563000001, 2024-05-07T14:04:00.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1292758329999999, 2024-05-07T14:04:00.148 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.148 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.148 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:00.148 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.148 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.148 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.148 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2667 2024-05-07T14:04:00.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650260+0000", 2024-05-07T14:04:00.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1160000000000002e-06 2024-05-07T14:04:00.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650270+0000", 2024-05-07T14:04:00.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0047000000000001e-05 2024-05-07T14:04:00.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650296+0000", 2024-05-07T14:04:00.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6058999999999999e-05 2024-05-07T14:04:00.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650313+0000", 2024-05-07T14:04:00.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6727000000000001e-05 2024-05-07T14:04:00.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660781+0000", 2024-05-07T14:04:00.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010468518 2024-05-07T14:04:00.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:00.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660805+0000", 2024-05-07T14:04:00.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3246000000000001e-05 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776636+0000", 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.115831102 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776958+0000", 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032243199999999999 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.779534+0000", 2024-05-07T14:04:00.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025755859999999999 2024-05-07T14:04:00.153 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.153 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.153 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.153 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2674 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:00.153 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:00.153 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.948549883999998, 2024-05-07T14:04:00.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58268987500000002, 2024-05-07T14:04:00.153 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.153 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.153 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:00.154 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.154 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.154 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.154 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2674 2024-05-07T14:04:00.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.154 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:00.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195683+0000", 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2500000000000001e-06 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195689+0000", 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4300000000000003e-06 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195702+0000", 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3026e-05 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195718+0000", 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5532999999999998e-05 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195943+0000", 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022518899999999999 2024-05-07T14:04:00.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195971+0000", 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7688999999999999e-05 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.777763+0000", 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58179212899999999 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778060+0000", 2024-05-07T14:04:00.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029683599999999997 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778372+0000", 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031179299999999999 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2685 3.1c 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.348700863000001, 2024-05-07T14:04:00.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034286608000000003, 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2685 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795533+0000", 2024-05-07T14:04:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:04:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803767+0000", 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082339079999999999 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803810+0000", 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2969000000000001e-05 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803837+0000", 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7036e-05 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804026+0000", 2024-05-07T14:04:00.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018935600000000001 2024-05-07T14:04:00.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804408+0000", 2024-05-07T14:04:00.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038137799999999998 2024-05-07T14:04:00.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:00.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804786+0000", 2024-05-07T14:04:00.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037841200000000001 2024-05-07T14:04:00.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.823281+0000", 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018494561999999999 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829623+0000", 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063427279999999997 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829715+0000", 2024-05-07T14:04:00.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1815000000000001e-05 2024-05-07T14:04:00.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829817+0000", 2024-05-07T14:04:00.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102051 2024-05-07T14:04:00.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.164 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.164 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2687 3.2 e104/46 3:43af9208:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_4:head v 104'5, mlcod=85'3)", 2024-05-07T14:04:00.164 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.829025+0000", 2024-05-07T14:04:00.164 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.315206327999999, 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026001561999999999, 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829025+0000", 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829025+0000", 2024-05-07T14:04:00.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829026+0000", 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0999999999999998e-07 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837259+0000", 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082336319999999994 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837292+0000", 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2156000000000002e-05 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837310+0000", 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7893e-05 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837449+0000", 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013917399999999999 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837490+0000", 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1085999999999999e-05 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.854949+0000", 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017459526 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.855027+0000", 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7484999999999994e-05 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.168 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.169 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2689 3.2a 3:57071f6f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:00.169 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:00.169 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.305263242999999, 2024-05-07T14:04:00.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032293512000000003, 2024-05-07T14:04:00.169 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.169 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.169 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.169 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.169 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.169 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2689 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838972+0000", 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.72e-06 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843363+0000", 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043909810000000004 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4181999999999998e-05 2024-05-07T14:04:00.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843430+0000", 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3139999999999999e-05 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843735+0000", 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030467299999999999 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844287+0000", 2024-05-07T14:04:00.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055224799999999998 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844674+0000", 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038716199999999998 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.868480+0000", 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023805639999999999 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:00.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.870993+0000", 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025130920000000002 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871151+0000", 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000158176 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871262+0000", 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110498 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.174 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.175 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2700 3.c 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:00.175 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:00.175 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 16.190248864000001, 2024-05-07T14:04:00.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028853172999999999, 2024-05-07T14:04:00.175 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.175 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.175 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.175 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.175 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.175 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.175 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2700 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.954040+0000", 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7735000000000002e-05 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958710+0000", 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046694220000000003 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958759+0000", 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8671999999999997e-05 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958778+0000", 2024-05-07T14:04:00.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:00.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958955+0000", 2024-05-07T14:04:00.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177197 2024-05-07T14:04:00.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959253+0000", 2024-05-07T14:04:00.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029744999999999999 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959545+0000", 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029215699999999997 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.969251+0000", 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097062789999999999 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982559+0000", 2024-05-07T14:04:00.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013307818000000001 2024-05-07T14:04:00.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982721+0000", 2024-05-07T14:04:00.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016221200000000001 2024-05-07T14:04:00.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982836+0000", 2024-05-07T14:04:00.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114605 2024-05-07T14:04:00.180 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.180 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.180 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2782 3.5 3:a0760020:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.320478016999999, 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029185556000000001, 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2782 2024-05-07T14:04:00.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823757+0000", 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7330000000000001e-06 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829013+0000", 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052552889999999998 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829062+0000", 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9375000000000001e-05 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829089+0000", 2024-05-07T14:04:00.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7143000000000001e-05 2024-05-07T14:04:00.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829248+0000", 2024-05-07T14:04:00.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015877 2024-05-07T14:04:00.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:00.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829262+0000", 2024-05-07T14:04:00.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.365e-05 2024-05-07T14:04:00.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835685+0000", 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064232339999999999 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835910+0000", 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022484800000000001 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.836115+0000", 2024-05-07T14:04:00.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000204916 2024-05-07T14:04:00.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:00.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.851571+0000", 2024-05-07T14:04:00.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015456634 2024-05-07T14:04:00.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:00.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852768+0000", 2024-05-07T14:04:00.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001197264 2024-05-07T14:04:00.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852867+0000", 2024-05-07T14:04:00.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9011000000000005e-05 2024-05-07T14:04:00.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852939+0000", 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1688999999999998e-05 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2793 3.30 3:0c9cfcfb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.19482483, 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028754691999999998, 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.191 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.192 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.192 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.192 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2793 2024-05-07T14:04:00.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.192 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:00.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:00.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949410+0000", 2024-05-07T14:04:00.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7239999999999998e-06 2024-05-07T14:04:00.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956008+0000", 2024-05-07T14:04:00.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065976560000000004 2024-05-07T14:04:00.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956068+0000", 2024-05-07T14:04:00.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9781999999999998e-05 2024-05-07T14:04:00.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956087+0000", 2024-05-07T14:04:00.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9009999999999999e-05 2024-05-07T14:04:00.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956241+0000", 2024-05-07T14:04:00.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015391600000000001 2024-05-07T14:04:00.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956640+0000", 2024-05-07T14:04:00.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039917499999999999 2024-05-07T14:04:00.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:00.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956860+0000", 2024-05-07T14:04:00.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021961499999999999 2024-05-07T14:04:00.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.967010+0000", 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01015011 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.977827+0000", 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010817148 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978012+0000", 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018541 2024-05-07T14:04:00.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978161+0000", 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014914600000000001 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2808 3.2f 3:f7427dbd:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.105619+0000", 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.038612226, 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025705095000000001, 2024-05-07T14:04:00.197 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.198 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.198 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.198 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.198 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.198 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.198 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2808 2024-05-07T14:04:00.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.198 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105619+0000", 2024-05-07T14:04:00.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105619+0000", 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105623+0000", 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0799999999999999e-06 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.110678+0000", 2024-05-07T14:04:00.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050544370000000002 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.110724+0000", 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6004999999999997e-05 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.110747+0000", 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2813999999999999e-05 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.110926+0000", 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000179679 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.111175+0000", 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024892099999999998 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.111411+0000", 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023604799999999999 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.130779+0000", 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019367497000000001 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.131130+0000", 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035130200000000001 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.131249+0000", 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118434 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.131324+0000", 2024-05-07T14:04:00.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5877999999999994e-05 2024-05-07T14:04:00.203 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.203 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.203 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.203 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2815 3.2a 3:5644b81f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:00.203 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:00.203 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.969099736, 2024-05-07T14:04:00.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027617527999999999, 2024-05-07T14:04:00.203 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2815 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175136+0000", 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7869999999999999e-06 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179183+0000", 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004047358 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179215+0000", 2024-05-07T14:04:00.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1919999999999999e-05 2024-05-07T14:04:00.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179238+0000", 2024-05-07T14:04:00.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3036000000000001e-05 2024-05-07T14:04:00.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179367+0000", 2024-05-07T14:04:00.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128627 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179613+0000", 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024667500000000002 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179847+0000", 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000233668 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:00.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.196418+0000", 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016571579999999999 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202617+0000", 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061980830000000001 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202688+0000", 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1481000000000002e-05 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202749+0000", 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1313000000000001e-05 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2843 3.1c 3:38256868:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.357553+0000", 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.786678854, 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025435343999999999, 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.209 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2843 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.357553+0000", 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.357553+0000", 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.357556+0000", 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9629999999999998e-06 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.361463+0000", 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039073859999999997 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.361498+0000", 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5034999999999999e-05 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.361515+0000", 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7180000000000002e-05 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.361676+0000", 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000161053 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.362071+0000", 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039430200000000002 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.362480+0000", 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040946800000000002 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.379119+0000", 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016638813999999998 2024-05-07T14:04:00.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.382799+0000", 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036803840000000001 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.382917+0000", 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011803699999999999 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.382988+0000", 2024-05-07T14:04:00.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0722000000000005e-05 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2849 3.1c 3:3bf188b7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.418294+0000", 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.725937786999999, 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025104044999999998, 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.215 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2849 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.418294+0000", 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.418294+0000", 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.418297+0000", 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4000000000000001e-06 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.422292+0000", 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039952670000000003 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.422326+0000", 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3878999999999999e-05 2024-05-07T14:04:00.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.422344+0000", 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7563000000000001e-05 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.422494+0000", 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014972299999999999 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.422905+0000", 2024-05-07T14:04:00.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041102800000000002 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.423331+0000", 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042669099999999998 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443079+0000", 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019747173999999999 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:00.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443111+0000", 2024-05-07T14:04:00.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2486e-05 2024-05-07T14:04:00.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443267+0000", 2024-05-07T14:04:00.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015611999999999999 2024-05-07T14:04:00.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443398+0000", 2024-05-07T14:04:00.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013071400000000001 2024-05-07T14:04:00.220 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.220 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2861 3.22 3:479e234a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.538927+0000", 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.605304989, 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026733855000000001, 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2861 2024-05-07T14:04:00.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.222 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.538927+0000", 2024-05-07T14:04:00.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.538927+0000", 2024-05-07T14:04:00.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.538930+0000", 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1300000000000001e-06 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.542998+0000", 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040679740000000002 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543028+0000", 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0329999999999999e-05 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543046+0000", 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7825999999999998e-05 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543198+0000", 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000152223 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543456+0000", 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025800399999999999 2024-05-07T14:04:00.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543704+0000", 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024830499999999999 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.555067+0000", 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011362336000000001 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.565485+0000", 2024-05-07T14:04:00.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010418627999999999 2024-05-07T14:04:00.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.565578+0000", 2024-05-07T14:04:00.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2255000000000004e-05 2024-05-07T14:04:00.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.565660+0000", 2024-05-07T14:04:00.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2843999999999995e-05 2024-05-07T14:04:00.226 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.226 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.226 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2865 3.38 e105/21 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.559205244999999, 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032748549000000002, 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:00.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585029+0000", 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9639999999999999e-06 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589707+0000", 2024-05-07T14:04:00.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046776889999999996 2024-05-07T14:04:00.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589754+0000", 2024-05-07T14:04:00.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7382000000000001e-05 2024-05-07T14:04:00.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589780+0000", 2024-05-07T14:04:00.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5232000000000002e-05 2024-05-07T14:04:00.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589966+0000", 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000186596 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.590031+0000", 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5038999999999999e-05 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617527+0000", 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027496216 2024-05-07T14:04:00.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617775+0000", 2024-05-07T14:04:00.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247431 2024-05-07T14:04:00.231 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.231 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.231 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.231 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2888 3.2 e105/46 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head v 105'8, mlcod=104'6)", 2024-05-07T14:04:00.231 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:00.231 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.303143012, 2024-05-07T14:04:00.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.033929095999999999, 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841091+0000", 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.39e-06 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.847981+0000", 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068900630000000001 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848020+0000", 2024-05-07T14:04:00.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8846e-05 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848039+0000", 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848222+0000", 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018251300000000001 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848268+0000", 2024-05-07T14:04:00.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5552e-05 2024-05-07T14:04:00.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.874885+0000", 2024-05-07T14:04:00.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026617335999999998 2024-05-07T14:04:00.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.875018+0000", 2024-05-07T14:04:00.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013276999999999999 2024-05-07T14:04:00.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2894 3.16 3:6aec0fdf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.230496509, 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029574030000000001, 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.236 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.237 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2894 2024-05-07T14:04:00.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.237 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:00.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:00.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913738+0000", 2024-05-07T14:04:00.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.491e-06 2024-05-07T14:04:00.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917692+0000", 2024-05-07T14:04:00.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039540799999999996 2024-05-07T14:04:00.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917718+0000", 2024-05-07T14:04:00.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6211e-05 2024-05-07T14:04:00.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917732+0000", 2024-05-07T14:04:00.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4487999999999999e-05 2024-05-07T14:04:00.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917897+0000", 2024-05-07T14:04:00.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016455199999999999 2024-05-07T14:04:00.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918296+0000", 2024-05-07T14:04:00.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000398825 2024-05-07T14:04:00.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:00.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918724+0000", 2024-05-07T14:04:00.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042847399999999998 2024-05-07T14:04:00.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:00.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.933484+0000", 2024-05-07T14:04:00.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014759959 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.942986+0000", 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095014739999999993 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943179+0000", 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019320200000000001 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943309+0000", 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013027399999999999 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2896 3.3a 3:5f842f5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.209736846, 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028429466, 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.242 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.243 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.243 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.243 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2896 2024-05-07T14:04:00.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.243 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:00.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934498+0000", 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.557e-06 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939927+0000", 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054289250000000002 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939955+0000", 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8245000000000001e-05 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939971+0000", 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.504e-05 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940161+0000", 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019040499999999999 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940562+0000", 2024-05-07T14:04:00.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040076800000000002 2024-05-07T14:04:00.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:00.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940979+0000", 2024-05-07T14:04:00.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041760099999999997 2024-05-07T14:04:00.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:00.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.950692+0000", 2024-05-07T14:04:00.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097127529999999993 2024-05-07T14:04:00.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:00.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962768+0000", 2024-05-07T14:04:00.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012075987 2024-05-07T14:04:00.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962863+0000", 2024-05-07T14:04:00.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5103000000000001e-05 2024-05-07T14:04:00.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962924+0000", 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1081999999999996e-05 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2908 3.3a 3:5d7a0a59:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.058385507000001, 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027562652999999999, 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:00.248 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2908 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085850+0000", 2024-05-07T14:04:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.267e-06 2024-05-07T14:04:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091371+0000", 2024-05-07T14:04:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055205619999999997 2024-05-07T14:04:00.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091411+0000", 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0365999999999999e-05 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091432+0000", 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0276e-05 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091608+0000", 2024-05-07T14:04:00.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176653 2024-05-07T14:04:00.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:00.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.092025+0000", 2024-05-07T14:04:00.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041696799999999998 2024-05-07T14:04:00.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:00.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.092418+0000", 2024-05-07T14:04:00.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000393099 2024-05-07T14:04:00.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.102443+0000", 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010024798999999999 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113230+0000", 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010786963 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113330+0000", 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9808000000000004e-05 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:00.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:00.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:00.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113409+0000", 2024-05-07T14:04:00.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8892000000000003e-05 2024-05-07T14:04:00.254 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.254 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.254 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.254 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:00.254 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:00.254 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:00.255 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:00.255 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:00.256 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:00.256 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:00.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:04:00.257 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:00.267+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:00.257 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:04:00.258 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:04:00.350 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:04:00.396 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:00.411+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:00.427 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:00.428 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:00.442 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:04:00.489 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:00.499+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:00.558 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:00.567+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:00.559 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:00.559 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:00.572 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:04:00.664 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:00.675+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:00.727 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:00.727 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:00.740 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:04:00.785 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:00.795+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:00.862 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:00.871+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:00.908 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:00.909 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:00.922 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:04:00.965 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:00.975+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:01.062 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:01.071+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:01.089 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:01.089 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:01.105 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:04:01.163 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:01.175+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:01.264 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:01.275+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:01.268 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:01.268 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:01.283 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:04:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:04:01.365 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:01.379+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:01.418 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:01.418 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:01.432 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:04:01.477 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:01.491+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:01.555 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:01.556 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:01.566 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:01.575+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:01.570 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:04:01.667 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:01.679+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:01.741 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:01.741 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:01.755 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:04:01.796 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:01.811+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:01.870 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:01.883+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:01.923 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:01.923 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:01.937 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:04:01.971 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:01.979+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:02.052 INFO:tasks.workunit.client.0.smithi106.stderr:200+0 records in 2024-05-07T14:04:02.052 INFO:tasks.workunit.client.0.smithi106.stderr:200+0 records out 2024-05-07T14:04:02.052 INFO:tasks.workunit.client.0.smithi106.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 15.0684 s, 139 MB/s 2024-05-07T14:04:02.072 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:02.083+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:02.116 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:02.116 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:02.133 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:04:02.176 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:02.191+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:02.245 INFO:tasks.workunit.client.0.smithi106.stdout:Bucket Created: buck_2024_04_7_14_04_02 2024-05-07T14:04:02.257 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:02.257 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:02.260 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:04:02.274 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:04:02.274 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:02.287+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:02.375 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:02.383+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:02.404 INFO:tasks.workunit.client.0.smithi106.stdout:quota set for the bucket: buck_2024_04_7_14_04_02 2024-05-07T14:04:02.412 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:02.429 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:02.447 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:02.447 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:02.448 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:02.448 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:02.448 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:04:02.448 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:02.464 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:04:02.467 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:02.475 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:02.487+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:02.490 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:02.490 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:02.512 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:02.513 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:02.534 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:02.535 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:02.569 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:04:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:04:02.576 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:02.587+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:02.591 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:02.591 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:02.604 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:04:02.677 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:02.687+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:02.756 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:02.756 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:02.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:02.757 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:02.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.757 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2202 3.0 e84/21 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head v 84'1, mlcod=0'0)", 2024-05-07T14:04:02.757 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:04:02.757 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 59.482293732999999, 2024-05-07T14:04:02.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020120560999999999, 2024-05-07T14:04:02.758 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.758 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.758 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.758 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:04:02.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286676+0000", 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.57e-06 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291894+0000", 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052185740000000001 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291939+0000", 2024-05-07T14:04:02.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4676999999999999e-05 2024-05-07T14:04:02.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291959+0000", 2024-05-07T14:04:02.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0115999999999998e-05 2024-05-07T14:04:02.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292128+0000", 2024-05-07T14:04:02.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168758 2024-05-07T14:04:02.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292188+0000", 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0565e-05 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306607+0000", 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014418733 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306794+0000", 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018656799999999999 2024-05-07T14:04:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2216 3.21 3:86b25102:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:04:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 59.300863409000002, 2024-05-07T14:04:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017498730000000001, 2024-05-07T14:04:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2216 2024-05-07T14:04:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:04:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468103+0000", 2024-05-07T14:04:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.468107+0000", 2024-05-07T14:04:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5980000000000001e-06 2024-05-07T14:04:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471311+0000", 2024-05-07T14:04:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003203811 2024-05-07T14:04:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471360+0000", 2024-05-07T14:04:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9100000000000001e-05 2024-05-07T14:04:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471383+0000", 2024-05-07T14:04:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3289e-05 2024-05-07T14:04:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471551+0000", 2024-05-07T14:04:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167295 2024-05-07T14:04:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.471932+0000", 2024-05-07T14:04:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00038136799999999998 2024-05-07T14:04:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.472296+0000", 2024-05-07T14:04:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036396200000000001 2024-05-07T14:04:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.481648+0000", 2024-05-07T14:04:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093518209999999997 2024-05-07T14:04:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485379+0000", 2024-05-07T14:04:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0037311919999999999 2024-05-07T14:04:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485533+0000", 2024-05-07T14:04:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015429500000000001 2024-05-07T14:04:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.485602+0000", 2024-05-07T14:04:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8998999999999994e-05 2024-05-07T14:04:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2217 3.0 e84/21 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head v 84'2, mlcod=0'0)", 2024-05-07T14:04:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:04:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 59.275646946000002, 2024-05-07T14:04:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016624692, 2024-05-07T14:04:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:04:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493320+0000", 2024-05-07T14:04:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493322+0000", 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7290000000000001e-06 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496239+0000", 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029177949999999999 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496292+0000", 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2769999999999998e-05 2024-05-07T14:04:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496318+0000", 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6313e-05 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496471+0000", 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015206799999999999 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.496540+0000", 2024-05-07T14:04:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9598999999999996e-05 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509870+0000", 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013330322 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509945+0000", 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4096000000000003e-05 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2687 3.2 3:43af9208:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.950425666000001, 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037068531000000002, 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2687 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:04:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:04:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818544+0000", 2024-05-07T14:04:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3390000000000001e-06 2024-05-07T14:04:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821166+0000", 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026214250000000001 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821192+0000", 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5641999999999999e-05 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821203+0000", 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1558e-05 2024-05-07T14:04:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821280+0000", 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7237000000000006e-05 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821288+0000", 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0930000000000003e-06 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823694+0000", 2024-05-07T14:04:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024052850000000001 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823853+0000", 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015879800000000001 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823991+0000", 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013879100000000001 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.832834+0000", 2024-05-07T14:04:02.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088427109999999996 2024-05-07T14:04:02.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855474+0000", 2024-05-07T14:04:02.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022640304 2024-05-07T14:04:02.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855553+0000", 2024-05-07T14:04:02.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8994999999999998e-05 2024-05-07T14:04:02.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855610+0000", 2024-05-07T14:04:02.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6353000000000001e-05 2024-05-07T14:04:02.783 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.783 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.783 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.783 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2707 3.17 3:e87c5034:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:02.783 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:04:02.783 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.732411959, 2024-05-07T14:04:02.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017998984999999999, 2024-05-07T14:04:02.784 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.784 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.784 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.784 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.784 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.784 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.784 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2707 2024-05-07T14:04:02.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.784 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036558+0000", 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8030000000000001e-06 2024-05-07T14:04:02.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038073+0000", 2024-05-07T14:04:02.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001514872 2024-05-07T14:04:02.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038093+0000", 2024-05-07T14:04:02.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0023000000000001e-05 2024-05-07T14:04:02.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038102+0000", 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3389999999999999e-06 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038183+0000", 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1050999999999994e-05 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038309+0000", 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012564400000000001 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:02.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038401+0000", 2024-05-07T14:04:02.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2826999999999997e-05 2024-05-07T14:04:02.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.046066+0000", 2024-05-07T14:04:02.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007664761 2024-05-07T14:04:02.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054423+0000", 2024-05-07T14:04:02.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0083565310000000004 2024-05-07T14:04:02.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054497+0000", 2024-05-07T14:04:02.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4302999999999997e-05 2024-05-07T14:04:02.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054554+0000", 2024-05-07T14:04:02.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6830999999999998e-05 2024-05-07T14:04:02.790 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.790 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.790 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.791 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2717 3.17 3:eb96a854:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:02.791 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:04:02.791 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.614232224999999, 2024-05-07T14:04:02.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017081168000000001, 2024-05-07T14:04:02.791 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.792 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.792 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.792 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.792 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.792 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.792 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2717 2024-05-07T14:04:02.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.793 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:04:02.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154735+0000", 2024-05-07T14:04:02.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.154737+0000", 2024-05-07T14:04:02.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.706e-06 2024-05-07T14:04:02.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156940+0000", 2024-05-07T14:04:02.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022023619999999998 2024-05-07T14:04:02.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156968+0000", 2024-05-07T14:04:02.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:04:02.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.156982+0000", 2024-05-07T14:04:02.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3515e-05 2024-05-07T14:04:02.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157066+0000", 2024-05-07T14:04:02.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4746999999999993e-05 2024-05-07T14:04:02.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157241+0000", 2024-05-07T14:04:02.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000174496 2024-05-07T14:04:02.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:02.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.157410+0000", 2024-05-07T14:04:02.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016901000000000001 2024-05-07T14:04:02.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.163989+0000", 2024-05-07T14:04:02.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065794249999999999 2024-05-07T14:04:02.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171687+0000", 2024-05-07T14:04:02.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0076973229999999998 2024-05-07T14:04:02.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171760+0000", 2024-05-07T14:04:02.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3617999999999999e-05 2024-05-07T14:04:02.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.171816+0000", 2024-05-07T14:04:02.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5432000000000001e-05 2024-05-07T14:04:02.803 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.803 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.803 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.803 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2721 3.3b e104/21 3:dd5ea515:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_38:head v 104'7, mlcod=85'5)", 2024-05-07T14:04:02.803 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:04:02.804 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.567602041000001, 2024-05-07T14:04:02.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017497018999999999, 2024-05-07T14:04:02.804 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.804 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.804 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.804 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:04:02.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:04:02.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.201365+0000", 2024-05-07T14:04:02.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.27e-07 2024-05-07T14:04:02.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207457+0000", 2024-05-07T14:04:02.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0060918650000000001 2024-05-07T14:04:02.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207482+0000", 2024-05-07T14:04:02.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4765000000000001e-05 2024-05-07T14:04:02.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207496+0000", 2024-05-07T14:04:02.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3983e-05 2024-05-07T14:04:02.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207576+0000", 2024-05-07T14:04:02.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9803999999999997e-05 2024-05-07T14:04:02.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207605+0000", 2024-05-07T14:04:02.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9697e-05 2024-05-07T14:04:02.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.218781+0000", 2024-05-07T14:04:02.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011175681 2024-05-07T14:04:02.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.218862+0000", 2024-05-07T14:04:02.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0797000000000006e-05 2024-05-07T14:04:02.813 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.813 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.813 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.814 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2722 3.2e 3:75db52c2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:02.814 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:04:02.814 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.563137141999999, 2024-05-07T14:04:02.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019780314, 2024-05-07T14:04:02.814 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.815 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.815 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.815 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.815 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.815 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.815 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2722 2024-05-07T14:04:02.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.816 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:04:02.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:04:02.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205833+0000", 2024-05-07T14:04:02.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3289999999999998e-06 2024-05-07T14:04:02.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207811+0000", 2024-05-07T14:04:02.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019781529999999999 2024-05-07T14:04:02.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207829+0000", 2024-05-07T14:04:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7402999999999999e-05 2024-05-07T14:04:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207838+0000", 2024-05-07T14:04:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0210000000000005e-06 2024-05-07T14:04:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207902+0000", 2024-05-07T14:04:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4406000000000006e-05 2024-05-07T14:04:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208094+0000", 2024-05-07T14:04:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000191626 2024-05-07T14:04:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208250+0000", 2024-05-07T14:04:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156064 2024-05-07T14:04:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.219242+0000", 2024-05-07T14:04:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010992696999999999 2024-05-07T14:04:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225500+0000", 2024-05-07T14:04:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.006257182 2024-05-07T14:04:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225550+0000", 2024-05-07T14:04:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0173999999999998e-05 2024-05-07T14:04:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225610+0000", 2024-05-07T14:04:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0259e-05 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2735 3.2 3:4399fdca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.43086139, 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017836129999999999, 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2735 2024-05-07T14:04:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:04:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:04:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338108+0000", 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0110000000000001e-06 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339842+0000", 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017333330000000001 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339870+0000", 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7875999999999999e-05 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339884+0000", 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4678000000000001e-05 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339984+0000", 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9283999999999993e-05 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.340096+0000", 2024-05-07T14:04:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112272 2024-05-07T14:04:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.340201+0000", 2024-05-07T14:04:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010467999999999999 2024-05-07T14:04:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.345876+0000", 2024-05-07T14:04:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056758260000000001 2024-05-07T14:04:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355805+0000", 2024-05-07T14:04:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099281679999999994 2024-05-07T14:04:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355883+0000", 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8287000000000004e-05 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355942+0000", 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8715000000000003e-05 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2742 3.2e 3:77b7f847:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.356995373, 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01669147, 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2742 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411971+0000", 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.411975+0000", 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.225e-06 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413909+0000", 2024-05-07T14:04:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001934365 2024-05-07T14:04:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413938+0000", 2024-05-07T14:04:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8753000000000001e-05 2024-05-07T14:04:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.413953+0000", 2024-05-07T14:04:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5631e-05 2024-05-07T14:04:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414034+0000", 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0173000000000006e-05 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414169+0000", 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013502499999999999 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.414303+0000", 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013471800000000001 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.420795+0000", 2024-05-07T14:04:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064916050000000001 2024-05-07T14:04:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428529+0000", 2024-05-07T14:04:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077344129999999999 2024-05-07T14:04:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428605+0000", 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5662999999999997e-05 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.428663+0000", 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7899000000000002e-05 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2773 3.17 3:e87231b1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.050505474000001, 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028454317, 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2773 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:04:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:04:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718465+0000", 2024-05-07T14:04:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3680000000000002e-06 2024-05-07T14:04:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729580+0000", 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011115776000000001 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729608+0000", 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7617e-05 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729622+0000", 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3528e-05 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729694+0000", 2024-05-07T14:04:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2630000000000001e-05 2024-05-07T14:04:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729812+0000", 2024-05-07T14:04:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118132 2024-05-07T14:04:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729913+0000", 2024-05-07T14:04:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100486 2024-05-07T14:04:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.744465+0000", 2024-05-07T14:04:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014551768 2024-05-07T14:04:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746795+0000", 2024-05-07T14:04:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023300270000000001 2024-05-07T14:04:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746865+0000", 2024-05-07T14:04:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0322999999999997e-05 2024-05-07T14:04:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746916+0000", 2024-05-07T14:04:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0661999999999997e-05 2024-05-07T14:04:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2784 3.17 3:e9b6a230:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:04:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.918209886, 2024-05-07T14:04:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027214069, 2024-05-07T14:04:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2784 2024-05-07T14:04:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:04:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:04:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850760+0000", 2024-05-07T14:04:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0970000000000002e-06 2024-05-07T14:04:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853165+0000", 2024-05-07T14:04:02.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002405309 2024-05-07T14:04:02.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853186+0000", 2024-05-07T14:04:02.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0727999999999999e-05 2024-05-07T14:04:02.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853196+0000", 2024-05-07T14:04:02.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0159e-05 2024-05-07T14:04:02.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853277+0000", 2024-05-07T14:04:02.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0519999999999995e-05 2024-05-07T14:04:02.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853440+0000", 2024-05-07T14:04:02.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016281299999999999 2024-05-07T14:04:02.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:02.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853608+0000", 2024-05-07T14:04:02.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168126 2024-05-07T14:04:02.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.860132+0000", 2024-05-07T14:04:02.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065242379999999999 2024-05-07T14:04:02.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877848+0000", 2024-05-07T14:04:02.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017716251999999998 2024-05-07T14:04:02.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877919+0000", 2024-05-07T14:04:02.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.127e-05 2024-05-07T14:04:02.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877971+0000", 2024-05-07T14:04:02.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1557000000000001e-05 2024-05-07T14:04:02.854 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.854 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.854 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.854 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2789 3.2 3:434a8bbf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:02.855 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:04:02.855 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.862520668999998, 2024-05-07T14:04:02.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025228071000000001, 2024-05-07T14:04:02.855 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.855 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.855 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.855 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.855 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.855 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2789 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906450+0000", 2024-05-07T14:04:02.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5149999999999998e-06 2024-05-07T14:04:02.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908568+0000", 2024-05-07T14:04:02.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021184279999999999 2024-05-07T14:04:02.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908593+0000", 2024-05-07T14:04:02.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5043999999999999e-05 2024-05-07T14:04:02.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908607+0000", 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3716999999999999e-05 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908686+0000", 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9492000000000004e-05 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908818+0000", 2024-05-07T14:04:02.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013199199999999999 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908952+0000", 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013385400000000001 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.916238+0000", 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072861810000000001 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931560+0000", 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01532122 2024-05-07T14:04:02.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931620+0000", 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0448000000000001e-05 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931674+0000", 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.418e-05 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.860 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2799 3.9 e105/21 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.751145868999998, 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021236735, 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:02.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.75e-07 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024399+0000", 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065773769999999997 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024434+0000", 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4884e-05 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024450+0000", 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6181999999999999e-05 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024523+0000", 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3054999999999998e-05 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024550+0000", 2024-05-07T14:04:02.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6735000000000001e-05 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.038754+0000", 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014204543 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.039058+0000", 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030348400000000002 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.864 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2802 3.13 3:c8761262:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.725716505000001, 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026174424000000002, 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2802 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:04:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:04:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043253+0000", 2024-05-07T14:04:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7030000000000002e-06 2024-05-07T14:04:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045330+0000", 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020765139999999998 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045352+0000", 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2532e-05 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045363+0000", 2024-05-07T14:04:02.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0798000000000001e-05 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045446+0000", 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3592999999999997e-05 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045641+0000", 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019462900000000001 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:02.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045809+0000", 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168312 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.054070+0000", 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082602100000000005 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069299+0000", 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015229457 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069371+0000", 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1730000000000006e-05 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069425+0000", 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3946000000000002e-05 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2814 3.2d e105/21 3:b4f9607c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_131:head v 105'2, mlcod=0'0)", 2024-05-07T14:04:02.870 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.597643192, 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017192623000000001, 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.171324+0000", 2024-05-07T14:04:02.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2300000000000002e-07 2024-05-07T14:04:02.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176766+0000", 2024-05-07T14:04:02.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054422209999999997 2024-05-07T14:04:02.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176788+0000", 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2161e-05 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176802+0000", 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3341e-05 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176882+0000", 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0622000000000002e-05 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.176913+0000", 2024-05-07T14:04:02.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0518999999999997e-05 2024-05-07T14:04:02.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.188402+0000", 2024-05-07T14:04:02.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011488824999999999 2024-05-07T14:04:02.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.188516+0000", 2024-05-07T14:04:02.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000114611 2024-05-07T14:04:02.874 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.874 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2839 3.17 3:e819508b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.452227139000001, 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019836402, 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2839 2024-05-07T14:04:02.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316741+0000", 2024-05-07T14:04:02.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8029999999999999e-06 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318466+0000", 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017249959999999999 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318491+0000", 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4876e-05 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318502+0000", 2024-05-07T14:04:02.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0421999999999999e-05 2024-05-07T14:04:02.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318582+0000", 2024-05-07T14:04:02.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0593999999999994e-05 2024-05-07T14:04:02.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318717+0000", 2024-05-07T14:04:02.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013472199999999999 2024-05-07T14:04:02.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318836+0000", 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118996 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.325781+0000", 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069447809999999997 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336451+0000", 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010670416 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336510+0000", 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8408e-05 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336576+0000", 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6388000000000002e-05 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.880 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2859 3.17 3:eabb580f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:02.881 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.519343+0000", 2024-05-07T14:04:02.881 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.249623353, 2024-05-07T14:04:02.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01719621, 2024-05-07T14:04:02.881 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.881 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.881 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.881 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.881 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.881 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.881 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2859 2024-05-07T14:04:02.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.881 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.519343+0000", 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.519343+0000", 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.519346+0000", 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4250000000000001e-06 2024-05-07T14:04:02.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520592+0000", 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012463979999999999 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520621+0000", 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9081000000000002e-05 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520634+0000", 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2308e-05 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520717+0000", 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3644000000000001e-05 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520839+0000", 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012172600000000001 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.520972+0000", 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000133423 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.526747+0000", 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057745899999999996 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.536435+0000", 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0096880590000000006 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.536487+0000", 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1925000000000002e-05 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.536540+0000", 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2630999999999998e-05 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2888 3.2 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.930357994000001, 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037006981000000001, 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.886 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2888 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838611+0000", 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.441e-06 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840569+0000", 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019573189999999999 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840592+0000", 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3230999999999998e-05 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840605+0000", 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.295e-05 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840681+0000", 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6250999999999999e-05 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840821+0000", 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013997700000000001 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840966+0000", 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144735 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.846709+0000", 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057430809999999997 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875496+0000", 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028787366000000002 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875565+0000", 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8460000000000005e-05 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875616+0000", 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.117e-05 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2893 3.2 3:40c39b87:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.900696+0000", 2024-05-07T14:04:02.891 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 16.868271191000002, 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016827781, 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2893 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.900696+0000", 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.900696+0000", 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.900699+0000", 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1970000000000001e-06 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902430+0000", 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017315340000000001 2024-05-07T14:04:02.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:02.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902464+0000", 2024-05-07T14:04:02.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3144e-05 2024-05-07T14:04:02.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:02.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902479+0000", 2024-05-07T14:04:02.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5006e-05 2024-05-07T14:04:02.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.894 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:02.894 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902553+0000", 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4771999999999995e-05 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902672+0000", 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118689 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.902766+0000", 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3740999999999996e-05 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.911985+0000", 2024-05-07T14:04:02.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092191479999999999 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.917405+0000", 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054204190000000001 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.917474+0000", 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9012999999999998e-05 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.917523+0000", 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9118e-05 2024-05-07T14:04:02.896 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.897 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.897 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.897 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:02.897 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:02.897 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:02.898 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:04:02.899 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:02.907+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:02.999 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:03.007+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:03.020 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:03.020 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:03.020 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:04:03.020 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:03.033 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:04:03.100 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:03.111+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:03.148 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:03.148 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:03.148 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:03.149 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:03.149 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:03.162 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:04:03.201 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:03.215+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:03.286 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:04:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 70.992293337000007, 2024-05-07T14:04:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:04:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:04:03.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:04:03.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.290 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:04:03.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:04:03.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.290 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:04:03.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:04:03.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:04:03.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:04:03.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:03.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:04:03.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:04:03.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:04:03.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:04:03.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:04:03.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:04:03.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:04:03.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:04:03.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2203 3.1e 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 60.002576992999998, 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029129142, 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.293 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.294 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.294 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.294 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.294 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.294 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2203 2024-05-07T14:04:03.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.294 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:03.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:03.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294465+0000", 2024-05-07T14:04:03.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7699999999999999e-06 2024-05-07T14:04:03.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300328+0000", 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058633460000000002 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300384+0000", 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6212999999999999e-05 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300411+0000", 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7109000000000001e-05 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300586+0000", 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017478799999999999 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300941+0000", 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035515500000000001 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301351+0000", 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040996099999999997 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.298 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.298 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.317495+0000", 2024-05-07T14:04:03.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016143462000000001 2024-05-07T14:04:03.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.298 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.298 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323421+0000", 2024-05-07T14:04:03.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059264649999999997 2024-05-07T14:04:03.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.298 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.298 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323498+0000", 2024-05-07T14:04:03.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6478999999999997e-05 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323590+0000", 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2393999999999997e-05 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2230 3.b 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 59.626670322999999, 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021351564, 2024-05-07T14:04:03.299 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.300 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.300 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.300 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.300 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.300 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.300 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2230 2024-05-07T14:04:03.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.300 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:03.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670370+0000", 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5050000000000002e-06 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673214+0000", 2024-05-07T14:04:03.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028441260000000002 2024-05-07T14:04:03.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673245+0000", 2024-05-07T14:04:03.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0488999999999999e-05 2024-05-07T14:04:03.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673259+0000", 2024-05-07T14:04:03.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4443e-05 2024-05-07T14:04:03.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673356+0000", 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7031e-05 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673531+0000", 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017509099999999999 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673696+0000", 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000164306 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684776+0000", 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011080054000000001 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691578+0000", 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068025849999999999 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691659+0000", 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0976000000000005e-05 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691719+0000", 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9957999999999998e-05 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2666 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.645213436999999, 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.125351252, 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.305 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.306 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:03.306 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.306 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.306 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.306 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2666 2024-05-07T14:04:03.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.306 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:03.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:03.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651827+0000", 2024-05-07T14:04:03.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-06 2024-05-07T14:04:03.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651834+0000", 2024-05-07T14:04:03.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7700000000000001e-06 2024-05-07T14:04:03.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651850+0000", 2024-05-07T14:04:03.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5755000000000001e-05 2024-05-07T14:04:03.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651862+0000", 2024-05-07T14:04:03.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.237e-05 2024-05-07T14:04:03.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651967+0000", 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010427199999999999 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651977+0000", 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0743e-05 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657294+0000", 2024-05-07T14:04:03.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053168069999999998 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657305+0000", 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0662000000000001e-05 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774211+0000", 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1169060209999999 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774394+0000", 2024-05-07T14:04:03.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018268000000000001 2024-05-07T14:04:03.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.777176+0000", 2024-05-07T14:04:03.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002782025 2024-05-07T14:04:03.311 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.311 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.311 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.311 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2673 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:03.311 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.101280249999999, 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57934507999999996, 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2673 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:03.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9699999999999996e-07 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195761+0000", 2024-05-07T14:04:03.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2569999999999999e-06 2024-05-07T14:04:03.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195768+0000", 2024-05-07T14:04:03.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.489e-06 2024-05-07T14:04:03.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195774+0000", 2024-05-07T14:04:03.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7389999999999996e-06 2024-05-07T14:04:03.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195866+0000", 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2349000000000006e-05 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195878+0000", 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1838000000000001e-05 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774802+0000", 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.578923945 2024-05-07T14:04:03.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774906+0000", 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103991 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775103+0000", 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196975 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2684 3.24 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 19.510919339000001, 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.040396402999999997, 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2684 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786122+0000", 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0929999999999999e-06 2024-05-07T14:04:03.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788626+0000", 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025042720000000001 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788659+0000", 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2824999999999998e-05 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788673+0000", 2024-05-07T14:04:03.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4721e-05 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788768+0000", 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4178999999999994e-05 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788776+0000", 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2400000000000007e-06 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798002+0000", 2024-05-07T14:04:03.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092262230000000004 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798163+0000", 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161077 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798305+0000", 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014162499999999999 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.807567+0000", 2024-05-07T14:04:03.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092618869999999999 2024-05-07T14:04:03.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826429+0000", 2024-05-07T14:04:03.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018862824 2024-05-07T14:04:03.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826470+0000", 2024-05-07T14:04:03.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1010999999999997e-05 2024-05-07T14:04:03.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826515+0000", 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4425999999999998e-05 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2700 3.c e104/21 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 19.337072693, 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022078321000000001, 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.323 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:03.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9299999999999999e-07 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966313+0000", 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063471889999999996 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966340+0000", 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7514000000000001e-05 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966354+0000", 2024-05-07T14:04:03.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4053000000000001e-05 2024-05-07T14:04:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966434+0000", 2024-05-07T14:04:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0273999999999997e-05 2024-05-07T14:04:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966464+0000", 2024-05-07T14:04:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.953e-05 2024-05-07T14:04:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.981968+0000", 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0155037 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.982043+0000", 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5767999999999997e-05 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2710 3.29 3:9701fed0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:04:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 19.225246706, 2024-05-07T14:04:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020865083, 2024-05-07T14:04:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2710 2024-05-07T14:04:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071794+0000", 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.565e-06 2024-05-07T14:04:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073899+0000", 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002104809 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073925+0000", 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6125000000000001e-05 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073936+0000", 2024-05-07T14:04:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0878e-05 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074018+0000", 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2391000000000004e-05 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074144+0000", 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012578599999999999 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074241+0000", 2024-05-07T14:04:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7547999999999995e-05 2024-05-07T14:04:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.082159+0000", 2024-05-07T14:04:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0079176720000000006 2024-05-07T14:04:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092527+0000", 2024-05-07T14:04:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010368004 2024-05-07T14:04:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092600+0000", 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3491000000000005e-05 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092656+0000", 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5813999999999998e-05 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2712 3.15 e104/21 3:a83036f0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_29:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 19.193682890000002, 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021527713, 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103357+0000", 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7260000000000001e-06 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107529+0000", 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041726999999999997 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107551+0000", 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1854000000000001e-05 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107563+0000", 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1362999999999999e-05 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107633+0000", 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0432999999999995e-05 2024-05-07T14:04:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107652+0000", 2024-05-07T14:04:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9250999999999999e-05 2024-05-07T14:04:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124797+0000", 2024-05-07T14:04:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017144626 2024-05-07T14:04:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124883+0000", 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5760000000000006e-05 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2726 3.24 3:2710602c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 19.053354506000002, 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020082965000000001, 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2726 2024-05-07T14:04:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:04:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243686+0000", 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8420000000000001e-06 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245745+0000", 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020592890000000002 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245765+0000", 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9505e-05 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245777+0000", 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2282e-05 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245842+0000", 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4682000000000002e-05 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245956+0000", 2024-05-07T14:04:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113875 2024-05-07T14:04:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.246056+0000", 2024-05-07T14:04:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100238 2024-05-07T14:04:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.249971+0000", 2024-05-07T14:04:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039145179999999996 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263656+0000", 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013685246999999999 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263718+0000", 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1704000000000004e-05 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263766+0000", 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8782999999999997e-05 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2791 3.27 3:e46b1707:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.367784347000001, 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022300529999999999, 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2791 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929257+0000", 2024-05-07T14:04:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.281e-06 2024-05-07T14:04:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931305+0000", 2024-05-07T14:04:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020483020000000001 2024-05-07T14:04:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931328+0000", 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2722e-05 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931341+0000", 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3529e-05 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931415+0000", 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3597999999999996e-05 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931614+0000", 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019859000000000001 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931758+0000", 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014481699999999999 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.939706+0000", 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007948063 2024-05-07T14:04:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951424+0000", 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011717708 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951500+0000", 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5831e-05 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951554+0000", 2024-05-07T14:04:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4088999999999997e-05 2024-05-07T14:04:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2796 3.18 3:1b781814:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_113:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:04:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.314535609, 2024-05-07T14:04:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019854381000000001, 2024-05-07T14:04:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2796 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982502+0000", 2024-05-07T14:04:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.982505+0000", 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6070000000000002e-06 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984438+0000", 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019332609999999999 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984463+0000", 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4569000000000001e-05 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984473+0000", 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8910000000000007e-06 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984549+0000", 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6446999999999995e-05 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984737+0000", 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018843399999999999 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.984832+0000", 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4069999999999999e-05 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.999695+0000", 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01486345 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002219+0000", 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002523792 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002299+0000", 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0360999999999999e-05 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.002357+0000", 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7499e-05 2024-05-07T14:04:03.355 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2800 3.18 3:1851862d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.274631281000001, 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020357577000000002, 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.356 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2800 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022410+0000", 2024-05-07T14:04:03.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0079999999999998e-06 2024-05-07T14:04:03.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024625+0000", 2024-05-07T14:04:03.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022156350000000001 2024-05-07T14:04:03.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024652+0000", 2024-05-07T14:04:03.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6715000000000001e-05 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024698+0000", 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6470000000000001e-05 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024776+0000", 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7960000000000006e-05 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024944+0000", 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016757400000000001 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.025106+0000", 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016191 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.041855+0000", 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016748939000000001 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042642+0000", 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078695000000000002 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042712+0000", 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0154999999999995e-05 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042764+0000", 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2261e-05 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.361 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2817 3.24 3:24a9723e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.102018551, 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020083441, 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.362 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2817 2024-05-07T14:04:03.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.363 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:04:03.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:04:03.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195022+0000", 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4399999999999999e-06 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197097+0000", 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002075173 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197131+0000", 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3952999999999998e-05 2024-05-07T14:04:03.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197148+0000", 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6648000000000001e-05 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197230+0000", 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2341000000000003e-05 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197399+0000", 2024-05-07T14:04:03.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168782 2024-05-07T14:04:03.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:03.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197549+0000", 2024-05-07T14:04:03.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000150311 2024-05-07T14:04:03.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.210524+0000", 2024-05-07T14:04:03.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012974930000000001 2024-05-07T14:04:03.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215027+0000", 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045034979999999999 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215068+0000", 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0846000000000002e-05 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215103+0000", 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4518999999999999e-05 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.368 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2861 3.22 e105/21 3:479e234a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_168:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:03.368 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:04:03.368 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.752954351, 2024-05-07T14:04:03.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021170174999999999, 2024-05-07T14:04:03.368 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.368 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.368 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.368 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:04:03.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:04:03.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544085+0000", 2024-05-07T14:04:03.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.815e-06 2024-05-07T14:04:03.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548101+0000", 2024-05-07T14:04:03.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040158920000000001 2024-05-07T14:04:03.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548121+0000", 2024-05-07T14:04:03.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9899e-05 2024-05-07T14:04:03.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548132+0000", 2024-05-07T14:04:03.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0464e-05 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548210+0000", 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8176000000000005e-05 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548229+0000", 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9701999999999999e-05 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.565217+0000", 2024-05-07T14:04:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016987777999999999 2024-05-07T14:04:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.565254+0000", 2024-05-07T14:04:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6449000000000003e-05 2024-05-07T14:04:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2864 3.29 3:97632e4b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.722030715999999, 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021723981, 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2864 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:04:03.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:04:03.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575010+0000", 2024-05-07T14:04:03.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5660000000000001e-06 2024-05-07T14:04:03.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576737+0000", 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017271599999999999 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576768+0000", 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1424000000000003e-05 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576783+0000", 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4656e-05 2024-05-07T14:04:03.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576880+0000", 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6576999999999994e-05 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577067+0000", 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018795800000000001 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577285+0000", 2024-05-07T14:04:03.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021768499999999999 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.587487+0000", 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010202289 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596612+0000", 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0091244440000000007 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596681+0000", 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9025999999999999e-05 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596731+0000", 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0195999999999998e-05 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2865 3.38 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:03.378 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.714413058000002, 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.035746371999999998, 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2865 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:03.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:03.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582627+0000", 2024-05-07T14:04:03.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:04:03.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584611+0000", 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019836350000000001 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584636+0000", 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4943000000000002e-05 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584652+0000", 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5586e-05 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584733+0000", 2024-05-07T14:04:03.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0987000000000002e-05 2024-05-07T14:04:03.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584881+0000", 2024-05-07T14:04:03.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014805800000000001 2024-05-07T14:04:03.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:03.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584972+0000", 2024-05-07T14:04:03.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1218999999999995e-05 2024-05-07T14:04:03.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.591149+0000", 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061766939999999999 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618207+0000", 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027058260000000001 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618319+0000", 2024-05-07T14:04:03.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011267700000000001 2024-05-07T14:04:03.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618371+0000", 2024-05-07T14:04:03.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1683e-05 2024-05-07T14:04:03.384 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.384 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.384 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.384 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2872 3.15 e105/21 3:ab0c6c4f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_179:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:03.384 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:04:03.384 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.635092248999999, 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020080595999999999, 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:04:03.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661947+0000", 2024-05-07T14:04:03.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5099999999999999e-06 2024-05-07T14:04:03.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667621+0000", 2024-05-07T14:04:03.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056736269999999997 2024-05-07T14:04:03.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667649+0000", 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8093e-05 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667661+0000", 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2554999999999999e-05 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667745+0000", 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3301999999999996e-05 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667771+0000", 2024-05-07T14:04:03.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6135999999999998e-05 2024-05-07T14:04:03.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.681960+0000", 2024-05-07T14:04:03.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014189301 2024-05-07T14:04:03.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.682026+0000", 2024-05-07T14:04:03.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6072e-05 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2883 3.29 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.519249420000001, 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025309511999999999, 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.389 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.390 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.390 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2883 2024-05-07T14:04:03.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.390 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:03.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:03.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777791+0000", 2024-05-07T14:04:03.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.289e-06 2024-05-07T14:04:03.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779027+0000", 2024-05-07T14:04:03.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001236411 2024-05-07T14:04:03.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779063+0000", 2024-05-07T14:04:03.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5658999999999999e-05 2024-05-07T14:04:03.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779076+0000", 2024-05-07T14:04:03.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3128e-05 2024-05-07T14:04:03.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779166+0000", 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9818e-05 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779398+0000", 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023189400000000001 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779577+0000", 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000179276 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.393 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.786782+0000", 2024-05-07T14:04:03.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072052740000000002 2024-05-07T14:04:03.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.802960+0000", 2024-05-07T14:04:03.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016177490999999999 2024-05-07T14:04:03.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803047+0000", 2024-05-07T14:04:03.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6912999999999999e-05 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803098+0000", 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1359000000000001e-05 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2905 3.1e 3:78954da1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.245841180999999, 2024-05-07T14:04:03.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028568698, 2024-05-07T14:04:03.396 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:03.396 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:03.396 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.396 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:03.396 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:03.396 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.396 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2905 2024-05-07T14:04:03.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.396 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:03.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:03.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:03.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:03.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:03.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:03.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:03.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051199+0000", 2024-05-07T14:04:03.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5299999999999999e-06 2024-05-07T14:04:03.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:03.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055400+0000", 2024-05-07T14:04:03.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042009889999999996 2024-05-07T14:04:03.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:03.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055458+0000", 2024-05-07T14:04:03.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.736e-05 2024-05-07T14:04:03.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055486+0000", 2024-05-07T14:04:03.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8914000000000001e-05 2024-05-07T14:04:03.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:03.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055574+0000", 2024-05-07T14:04:03.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7120999999999995e-05 2024-05-07T14:04:03.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:03.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055726+0000", 2024-05-07T14:04:03.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015249600000000001 2024-05-07T14:04:03.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.399 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:03.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055884+0000", 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015788900000000001 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.064235+0000", 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008350583 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078705+0000", 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014470129999999999 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:03.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078900+0000", 2024-05-07T14:04:03.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019521799999999999 2024-05-07T14:04:03.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:03.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:03.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:03.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.079765+0000", 2024-05-07T14:04:03.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00086546799999999999 2024-05-07T14:04:03.401 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.401 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.401 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.401 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:03.401 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:03.402 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:03.402 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:04:03.404 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:04:03.404 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:03.415+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:03.504 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:03.515+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:03.537 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:03.537 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:03.537 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:03.537 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:03.551 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:04:03.604 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:03.619+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:03.705 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:03.719+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:03.714 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:03.714 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:03.714 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:03.714 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:03.714 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:03.728 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:04:03.806 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:03.815+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:03.855 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:03.855 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:03.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:03.855 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2224 3.1a 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.277645542000002, 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027796929000000001, 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2224 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.856 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588348+0000", 2024-05-07T14:04:03.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1629999999999998e-06 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594043+0000", 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056948950000000002 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594085+0000", 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1678999999999999e-05 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594113+0000", 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594221+0000", 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107371 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594405+0000", 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018468099999999999 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594570+0000", 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165224 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.603655+0000", 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090846550000000005 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.615968+0000", 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012313199 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616069+0000", 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100309 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616141+0000", 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2218999999999994e-05 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2229 3.3 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:03.861 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 60.206349013999997, 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028304669000000001, 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2229 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:03.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:03.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659643+0000", 2024-05-07T14:04:03.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9129999999999999e-06 2024-05-07T14:04:03.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664151+0000", 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045081189999999997 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664198+0000", 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6431999999999999e-05 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664223+0000", 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5369999999999999e-05 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664313+0000", 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345999999999995e-05 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664428+0000", 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115058 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664566+0000", 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138598 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.671674+0000", 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071074529999999997 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687772+0000", 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016098359 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687871+0000", 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9098000000000006e-05 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687945+0000", 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3923000000000004e-05 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2684 3.24 e104/21 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.067388554000001, 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026848770000000001, 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.870 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6000000000000004e-07 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810718+0000", 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012116477 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810747+0000", 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8676000000000001e-05 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810791+0000", 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4415000000000001e-05 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810915+0000", 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012363399999999999 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810950+0000", 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5812999999999997e-05 2024-05-07T14:04:03.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825326+0000", 2024-05-07T14:04:03.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014375852 2024-05-07T14:04:03.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825450+0000", 2024-05-07T14:04:03.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012334299999999999 2024-05-07T14:04:03.874 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.874 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.874 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2685 3.1c e104/21 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head v 104'1, mlcod=0'0)", 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.060552882, 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023842609000000001, 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805438+0000", 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.243e-06 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812353+0000", 2024-05-07T14:04:03.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069150560000000002 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812385+0000", 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2583000000000003e-05 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812406+0000", 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0378999999999999e-05 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812541+0000", 2024-05-07T14:04:03.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013502699999999999 2024-05-07T14:04:03.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812591+0000", 2024-05-07T14:04:03.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0522999999999997e-05 2024-05-07T14:04:03.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829183+0000", 2024-05-07T14:04:03.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016591445999999999 2024-05-07T14:04:03.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829279+0000", 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6352000000000002e-05 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2686 3.34 3:2ec0e822:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.057338412, 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034864805999999998, 2024-05-07T14:04:03.879 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2686 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808656+0000", 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6029999999999998e-06 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818059+0000", 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094034429999999992 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818114+0000", 2024-05-07T14:04:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4625e-05 2024-05-07T14:04:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818139+0000", 2024-05-07T14:04:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4850000000000001e-05 2024-05-07T14:04:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819387+0000", 2024-05-07T14:04:03.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012488060000000001 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819792+0000", 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040472400000000002 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820050+0000", 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025799800000000001 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:03.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.833596+0000", 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013546069000000001 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843174+0000", 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095773449999999993 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023329199999999999 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843516+0000", 2024-05-07T14:04:03.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109051 2024-05-07T14:04:03.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.885 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.885 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2696 3.14 3:2aeb6272:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:03.885 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:03.885 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.952953571999998, 2024-05-07T14:04:03.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022593715, 2024-05-07T14:04:03.885 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.885 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.885 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.886 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:03.886 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:03.886 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.886 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2696 2024-05-07T14:04:03.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.886 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:03.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913039+0000", 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3730000000000001e-06 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917057+0000", 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040181319999999998 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917099+0000", 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.155e-05 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917118+0000", 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8862e-05 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917285+0000", 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016734000000000001 2024-05-07T14:04:03.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917644+0000", 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035872600000000002 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.918201+0000", 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055705100000000003 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.934860+0000", 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016658665 2024-05-07T14:04:03.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935461+0000", 2024-05-07T14:04:03.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060165000000000001 2024-05-07T14:04:03.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935559+0000", 2024-05-07T14:04:03.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8255e-05 2024-05-07T14:04:03.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935630+0000", 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0110999999999993e-05 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2704 3.31 e104/21 3:8c38a608:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_21:head v 104'4, mlcod=85'2)", 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.864940663999999, 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021828251999999999, 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:04:03.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:04:03.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001050+0000", 2024-05-07T14:04:03.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6330000000000001e-06 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007182+0000", 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061313840000000001 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007208+0000", 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5842000000000001e-05 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007224+0000", 2024-05-07T14:04:03.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5962999999999999e-05 2024-05-07T14:04:03.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007327+0000", 2024-05-07T14:04:03.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010380200000000001 2024-05-07T14:04:03.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007373+0000", 2024-05-07T14:04:03.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5969e-05 2024-05-07T14:04:03.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.022754+0000", 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015381099000000001 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.022877+0000", 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255999999999999 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2755 3.14 3:2b7affc7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:03.895 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.325026696999998, 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023747145000000001, 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2755 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:03.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540983+0000", 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0466999999999999e-05 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545846+0000", 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048626709999999998 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545883+0000", 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6769e-05 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545900+0000", 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6869999999999999e-05 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546070+0000", 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017014299999999999 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546329+0000", 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025910400000000002 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546560+0000", 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023119899999999999 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.555774+0000", 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092136490000000008 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564539+0000", 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087649870000000001 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564638+0000", 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9028000000000001e-05 2024-05-07T14:04:03.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564710+0000", 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2257999999999998e-05 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2799 3.9 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.853629887, 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027222948, 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.901 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.902 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.902 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:03.902 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:03.902 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.902 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2799 2024-05-07T14:04:03.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.902 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:03.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012363+0000", 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6500000000000002e-06 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016678+0000", 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043148320000000002 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016709+0000", 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0953e-05 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016726+0000", 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7022999999999999e-05 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016864+0000", 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137854 2024-05-07T14:04:03.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017108+0000", 2024-05-07T14:04:03.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024388099999999999 2024-05-07T14:04:03.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:03.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017333+0000", 2024-05-07T14:04:03.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022492899999999999 2024-05-07T14:04:03.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:03.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.033051+0000", 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015718352000000001 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039272+0000", 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062205139999999999 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039451+0000", 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017928 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039583+0000", 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013168000000000001 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2802 3.13 e105/46 3:c8761262:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_119:head v 105'4, mlcod=85'2)", 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.820128045000001, 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02254192, 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.907 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.908 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:04:03.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:04:03.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045864+0000", 2024-05-07T14:04:03.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3530000000000002e-06 2024-05-07T14:04:03.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051333+0000", 2024-05-07T14:04:03.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054687579999999998 2024-05-07T14:04:03.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051366+0000", 2024-05-07T14:04:03.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3215e-05 2024-05-07T14:04:03.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051384+0000", 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8394e-05 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051552+0000", 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016783600000000001 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051619+0000", 2024-05-07T14:04:03.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7142000000000002e-05 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.068274+0000", 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016654987999999999 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.068403+0000", 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012923399999999999 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.912 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2804 3.e e105/21 3:7356dc96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_121:head v 105'10, mlcod=105'8)", 2024-05-07T14:04:03.912 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:03.912 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.792693144000001, 2024-05-07T14:04:03.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029282694000000001, 2024-05-07T14:04:03.912 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.912 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.912 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.912 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:03.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073299+0000", 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076073+0000", 2024-05-07T14:04:03.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027746260000000001 2024-05-07T14:04:03.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076118+0000", 2024-05-07T14:04:03.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4223e-05 2024-05-07T14:04:03.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076138+0000", 2024-05-07T14:04:03.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0622999999999999e-05 2024-05-07T14:04:03.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076324+0000", 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018613599999999999 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076376+0000", 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2068999999999999e-05 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102438+0000", 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026061190000000001 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102579+0000", 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014143399999999999 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2805 3.1 e105/21 3:819b24c4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_122:head v 105'3, mlcod=104'1)", 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.789730325000001, 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028404523000000001, 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.916 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076262+0000", 2024-05-07T14:04:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3800000000000001e-06 2024-05-07T14:04:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083265+0000", 2024-05-07T14:04:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070039539999999997 2024-05-07T14:04:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083309+0000", 2024-05-07T14:04:03.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3516000000000001e-05 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083333+0000", 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4471999999999999e-05 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083520+0000", 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018616999999999999 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083588+0000", 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8405000000000007e-05 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104547+0000", 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020959228 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104664+0000", 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011639800000000001 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2830 3.9 3:92f5cab2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.228650+0000", 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.637339068999999, 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02137344, 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2830 2024-05-07T14:04:03.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.922 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.228650+0000", 2024-05-07T14:04:03.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.228650+0000", 2024-05-07T14:04:03.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.228653+0000", 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9000000000000002e-06 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234475+0000", 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058213880000000003 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234510+0000", 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5581999999999999e-05 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234528+0000", 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7989999999999999e-05 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234649+0000", 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120306 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.234908+0000", 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025924599999999998 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.235125+0000", 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000217486 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.245339+0000", 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010213355 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.249870+0000", 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045313250000000001 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.249954+0000", 2024-05-07T14:04:03.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.3728999999999997e-05 2024-05-07T14:04:03.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.250024+0000", 2024-05-07T14:04:03.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0133000000000001e-05 2024-05-07T14:04:03.926 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.926 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.926 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2832 3.1a 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.618325561999999, 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030681671000000001, 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2832 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247666+0000", 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5569999999999998e-06 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253202+0000", 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055353900000000003 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253232+0000", 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0309000000000001e-05 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253250+0000", 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7503000000000002e-05 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253372+0000", 2024-05-07T14:04:03.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255600000000001 2024-05-07T14:04:03.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253592+0000", 2024-05-07T14:04:03.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021960400000000001 2024-05-07T14:04:03.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:03.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253831+0000", 2024-05-07T14:04:03.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000239223 2024-05-07T14:04:03.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.264040+0000", 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010209018 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278176+0000", 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014135518 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278272+0000", 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6562000000000001e-05 2024-05-07T14:04:03.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278346+0000", 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3430999999999995e-05 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2835 3.34 3:2eb22351:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.588853035, 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021927980999999999, 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.932 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2835 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:04:03.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277140+0000", 2024-05-07T14:04:03.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9729999999999999e-06 2024-05-07T14:04:03.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281106+0000", 2024-05-07T14:04:03.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039657010000000003 2024-05-07T14:04:03.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281136+0000", 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9913e-05 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281152+0000", 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5792999999999999e-05 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281276+0000", 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000124537 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281515+0000", 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000238698 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281747+0000", 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023245500000000001 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298177+0000", 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016429322999999999 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298772+0000", 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059492799999999999 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298944+0000", 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017187300000000001 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.299064+0000", 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012078699999999999 2024-05-07T14:04:03.937 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.938 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.938 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.938 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2853 3.34 3:2c5576f8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.938 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:03.938 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.409631674, 2024-05-07T14:04:03.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026917739, 2024-05-07T14:04:03.938 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.938 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.938 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.938 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:03.938 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2853 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456361+0000", 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1240000000000001e-06 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460499+0000", 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041381159999999998 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460528+0000", 2024-05-07T14:04:03.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8558999999999999e-05 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460544+0000", 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6200000000000001e-05 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460699+0000", 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155513 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461098+0000", 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039883900000000001 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461508+0000", 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040939399999999999 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.474319+0000", 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012811002 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483036+0000", 2024-05-07T14:04:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087174469999999997 2024-05-07T14:04:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483142+0000", 2024-05-07T14:04:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010647800000000001 2024-05-07T14:04:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483276+0000", 2024-05-07T14:04:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013306700000000001 2024-05-07T14:04:03.943 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.944 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.944 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.944 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2874 3.34 3:2d878586:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:03.944 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:03.944 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.187029609, 2024-05-07T14:04:03.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023302047999999999, 2024-05-07T14:04:03.944 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.944 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.944 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.944 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:03.944 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2874 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678964+0000", 2024-05-07T14:04:03.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.89e-06 2024-05-07T14:04:03.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683101+0000", 2024-05-07T14:04:03.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041374669999999997 2024-05-07T14:04:03.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683138+0000", 2024-05-07T14:04:03.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7098999999999998e-05 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683155+0000", 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7139999999999999e-05 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683330+0000", 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000174919 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683715+0000", 2024-05-07T14:04:03.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038476199999999997 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.684028+0000", 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031283999999999999 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701377+0000", 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017349402999999999 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701948+0000", 2024-05-07T14:04:03.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057096800000000004 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702125+0000", 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176319 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702262+0000", 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137241 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.950 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2881 3.1 e105/21 3:8167d3db:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_188:head v 105'5, mlcod=105'3)", 2024-05-07T14:04:03.950 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:04:03.950 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.110420773000001, 2024-05-07T14:04:03.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021809426999999999, 2024-05-07T14:04:03.950 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.950 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.950 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.950 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755571+0000", 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.357e-06 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759865+0000", 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042943870000000002 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759901+0000", 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5759000000000001e-05 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759920+0000", 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8559999999999998e-05 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.760063+0000", 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000143647 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.760108+0000", 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4511999999999997e-05 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.776951+0000", 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016842754000000001 2024-05-07T14:04:03.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.777378+0000", 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042745100000000002 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2883 3.29 e105/21 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head v 105'6, mlcod=104'4)", 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.086334889, 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022805558, 2024-05-07T14:04:03.954 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779657+0000", 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0370000000000001e-06 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784248+0000", 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045916810000000002 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784272+0000", 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3281999999999998e-05 2024-05-07T14:04:03.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784285+0000", 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3423e-05 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784399+0000", 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011439500000000001 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784452+0000", 2024-05-07T14:04:03.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2142000000000003e-05 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802362+0000", 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017910874 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802460+0000", 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7724000000000002e-05 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2889 3.e e105/21 3:72a3c671:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_196:head v 105'11, mlcod=105'9)", 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.011463377999998, 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02270175, 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854529+0000", 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7499999999999999e-06 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857472+0000", 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002942999 2024-05-07T14:04:03.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857510+0000", 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8075999999999999e-05 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857533+0000", 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3353000000000002e-05 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857695+0000", 2024-05-07T14:04:03.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016135300000000001 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857761+0000", 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6759000000000002e-05 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877052+0000", 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019290656999999999 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:03.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877228+0000", 2024-05-07T14:04:03.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017580300000000001 2024-05-07T14:04:03.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.963 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:03.963 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:03.963 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:03.964 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:04:03.965 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:03.975+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:04.065 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:04.079+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:04.137 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:04.137 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:04.137 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:04.137 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:04.151 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:04:04.166 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:04.179+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:04.267 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:04.275+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:04.269 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:04.269 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:04.269 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:04.269 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:04.269 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:04.283 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:04:04.351 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:04:04.368 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:04.383+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:04.453 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2498 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:04.453 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.068671178999999, 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.06015305, 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2498 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394887+0000", 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394900+0000", 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3125999999999999e-05 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394940+0000", 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9579999999999997e-05 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394961+0000", 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1075999999999999e-05 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395122+0000", 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160741 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395140+0000", 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430325+0000", 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.03518512 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430355+0000", 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9181999999999999e-05 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.445424+0000", 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.015069751 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.446159+0000", 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073452200000000004 2024-05-07T14:04:04.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450456+0000", 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042973689999999997 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450627+0000", 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017032700000000001 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455037+0000", 2024-05-07T14:04:04.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044108690000000004 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2499 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.068542129999997, 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.065623158, 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.460 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2499 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395015+0000", 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.57e-06 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395022+0000", 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1330000000000001e-06 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395043+0000", 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1022999999999998e-05 2024-05-07T14:04:04.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395060+0000", 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6325999999999999e-05 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395199+0000", 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139815 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395215+0000", 2024-05-07T14:04:04.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5693e-05 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413112+0000", 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017896860000000001 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413143+0000", 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1609000000000002e-05 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.447430+0000", 2024-05-07T14:04:04.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0342867060000001 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450079+0000", 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002648386 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455213+0000", 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051342749999999998 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455444+0000", 2024-05-07T14:04:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023070799999999999 2024-05-07T14:04:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.460637+0000", 2024-05-07T14:04:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051930539999999999 2024-05-07T14:04:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2667 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:04.466 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.813297564999999, 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1292758329999999, 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2667 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650260+0000", 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1160000000000002e-06 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650270+0000", 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0047000000000001e-05 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650296+0000", 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6058999999999999e-05 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650313+0000", 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6727000000000001e-05 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660781+0000", 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010468518 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660805+0000", 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3246000000000001e-05 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776636+0000", 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.115831102 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776958+0000", 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032243199999999999 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.779534+0000", 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025755859999999999 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2674 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:04.471 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.267873886, 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58268987500000002, 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2674 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195683+0000", 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2500000000000001e-06 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195689+0000", 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4300000000000003e-06 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195702+0000", 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3026e-05 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195718+0000", 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5532999999999998e-05 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195943+0000", 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022518899999999999 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195971+0000", 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7688999999999999e-05 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.777763+0000", 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58179212899999999 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778060+0000", 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029683599999999997 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778372+0000", 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031179299999999999 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2685 3.1c 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:04.476 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.668024865, 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034286608000000003, 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2685 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:04.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795533+0000", 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803767+0000", 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082339079999999999 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803810+0000", 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2969000000000001e-05 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803837+0000", 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7036e-05 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804026+0000", 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018935600000000001 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804408+0000", 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038137799999999998 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804786+0000", 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037841200000000001 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.823281+0000", 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018494561999999999 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829623+0000", 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063427279999999997 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829715+0000", 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1815000000000001e-05 2024-05-07T14:04:04.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829817+0000", 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102051 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2687 3.2 e104/46 3:43af9208:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_4:head v 104'5, mlcod=85'3)", 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.829025+0000", 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.63453033, 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026001561999999999, 2024-05-07T14:04:04.482 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829025+0000", 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829025+0000", 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829026+0000", 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0999999999999998e-07 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837259+0000", 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082336319999999994 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837292+0000", 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2156000000000002e-05 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837310+0000", 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7893e-05 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837449+0000", 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013917399999999999 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837490+0000", 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1085999999999999e-05 2024-05-07T14:04:04.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.854949+0000", 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017459526 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.855027+0000", 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7484999999999994e-05 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2689 3.2a 3:57071f6f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.624587245000001, 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032293512000000003, 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2689 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838972+0000", 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.72e-06 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843363+0000", 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043909810000000004 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4181999999999998e-05 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843430+0000", 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3139999999999999e-05 2024-05-07T14:04:04.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843735+0000", 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030467299999999999 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844287+0000", 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055224799999999998 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844674+0000", 2024-05-07T14:04:04.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038716199999999998 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.868480+0000", 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023805639999999999 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.870993+0000", 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025130920000000002 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871151+0000", 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000158176 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871262+0000", 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110498 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2700 3.c 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 20.509572865999999, 2024-05-07T14:04:04.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028853172999999999, 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2700 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.954040+0000", 2024-05-07T14:04:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7735000000000002e-05 2024-05-07T14:04:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958710+0000", 2024-05-07T14:04:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046694220000000003 2024-05-07T14:04:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958759+0000", 2024-05-07T14:04:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8671999999999997e-05 2024-05-07T14:04:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958778+0000", 2024-05-07T14:04:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958955+0000", 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177197 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959253+0000", 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029744999999999999 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959545+0000", 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029215699999999997 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.969251+0000", 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097062789999999999 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982559+0000", 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013307818000000001 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982721+0000", 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016221200000000001 2024-05-07T14:04:04.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982836+0000", 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114605 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2782 3.5 3:a0760020:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.639802019000001, 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029185556000000001, 2024-05-07T14:04:04.498 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2782 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823757+0000", 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7330000000000001e-06 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829013+0000", 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052552889999999998 2024-05-07T14:04:04.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829062+0000", 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9375000000000001e-05 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829089+0000", 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7143000000000001e-05 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829248+0000", 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015877 2024-05-07T14:04:04.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829262+0000", 2024-05-07T14:04:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.365e-05 2024-05-07T14:04:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835685+0000", 2024-05-07T14:04:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064232339999999999 2024-05-07T14:04:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835910+0000", 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022484800000000001 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.836115+0000", 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000204916 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.851571+0000", 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015456634 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852768+0000", 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001197264 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852867+0000", 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9011000000000005e-05 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852939+0000", 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1688999999999998e-05 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.504 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2793 3.30 3:0c9cfcfb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.514148832, 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028754691999999998, 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.505 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2793 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949410+0000", 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7239999999999998e-06 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956008+0000", 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065976560000000004 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956068+0000", 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9781999999999998e-05 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956087+0000", 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9009999999999999e-05 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956241+0000", 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015391600000000001 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956640+0000", 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039917499999999999 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956860+0000", 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021961499999999999 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.967010+0000", 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01015011 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.977827+0000", 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010817148 2024-05-07T14:04:04.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978012+0000", 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018541 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978161+0000", 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014914600000000001 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2808 3.2f 3:f7427dbd:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.105619+0000", 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.357936228, 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025705095000000001, 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2808 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105619+0000", 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105619+0000", 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105623+0000", 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0799999999999999e-06 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.110678+0000", 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050544370000000002 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.110724+0000", 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6004999999999997e-05 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.110747+0000", 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2813999999999999e-05 2024-05-07T14:04:04.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.110926+0000", 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000179679 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.111175+0000", 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024892099999999998 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.111411+0000", 2024-05-07T14:04:04.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023604799999999999 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.130779+0000", 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019367497000000001 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.131130+0000", 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035130200000000001 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.131249+0000", 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118434 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.131324+0000", 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5877999999999994e-05 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2815 3.2a 3:5644b81f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:04.516 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.288423737999999, 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027617527999999999, 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2815 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:04.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175136+0000", 2024-05-07T14:04:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7869999999999999e-06 2024-05-07T14:04:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179183+0000", 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004047358 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179215+0000", 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1919999999999999e-05 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179238+0000", 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3036000000000001e-05 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179367+0000", 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128627 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179613+0000", 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024667500000000002 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179847+0000", 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000233668 2024-05-07T14:04:04.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.196418+0000", 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016571579999999999 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202617+0000", 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061980830000000001 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202688+0000", 2024-05-07T14:04:04.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1481000000000002e-05 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202749+0000", 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1313000000000001e-05 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2843 3.1c 3:38256868:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.357553+0000", 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.106002856, 2024-05-07T14:04:04.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025435343999999999, 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2843 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.357553+0000", 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.357553+0000", 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.357556+0000", 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9629999999999998e-06 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.361463+0000", 2024-05-07T14:04:04.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039073859999999997 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.361498+0000", 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5034999999999999e-05 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.361515+0000", 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7180000000000002e-05 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.361676+0000", 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000161053 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.362071+0000", 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039430200000000002 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.362480+0000", 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040946800000000002 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.379119+0000", 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016638813999999998 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.382799+0000", 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036803840000000001 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.382917+0000", 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011803699999999999 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.382988+0000", 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0722000000000005e-05 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2849 3.1c 3:3bf188b7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.418294+0000", 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 19.045261789000001, 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025104044999999998, 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.528 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2849 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.418294+0000", 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.418294+0000", 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.418297+0000", 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4000000000000001e-06 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.422292+0000", 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039952670000000003 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.422326+0000", 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3878999999999999e-05 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.422344+0000", 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7563000000000001e-05 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.422494+0000", 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014972299999999999 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.422905+0000", 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041102800000000002 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.423331+0000", 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042669099999999998 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443079+0000", 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019747173999999999 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443111+0000", 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2486e-05 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443267+0000", 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015611999999999999 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443398+0000", 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013071400000000001 2024-05-07T14:04:04.533 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2861 3.22 3:479e234a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.538927+0000", 2024-05-07T14:04:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.924628990999999, 2024-05-07T14:04:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026733855000000001, 2024-05-07T14:04:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.534 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2861 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.538927+0000", 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.538927+0000", 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.538930+0000", 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1300000000000001e-06 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.542998+0000", 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040679740000000002 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543028+0000", 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0329999999999999e-05 2024-05-07T14:04:04.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543046+0000", 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7825999999999998e-05 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543198+0000", 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000152223 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543456+0000", 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025800399999999999 2024-05-07T14:04:04.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543704+0000", 2024-05-07T14:04:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024830499999999999 2024-05-07T14:04:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.555067+0000", 2024-05-07T14:04:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011362336000000001 2024-05-07T14:04:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:04.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.565485+0000", 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010418627999999999 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.565578+0000", 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2255000000000004e-05 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.565660+0000", 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2843999999999995e-05 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.539 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2865 3.38 e105/21 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.878529246999999, 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032748549000000002, 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:04.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585029+0000", 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9639999999999999e-06 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589707+0000", 2024-05-07T14:04:04.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046776889999999996 2024-05-07T14:04:04.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589754+0000", 2024-05-07T14:04:04.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7382000000000001e-05 2024-05-07T14:04:04.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589780+0000", 2024-05-07T14:04:04.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5232000000000002e-05 2024-05-07T14:04:04.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589966+0000", 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000186596 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.590031+0000", 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5038999999999999e-05 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617527+0000", 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027496216 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617775+0000", 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247431 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2888 3.2 e105/46 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head v 105'8, mlcod=104'6)", 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.622467014000001, 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.033929095999999999, 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.544 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841091+0000", 2024-05-07T14:04:04.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.39e-06 2024-05-07T14:04:04.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.847981+0000", 2024-05-07T14:04:04.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068900630000000001 2024-05-07T14:04:04.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848020+0000", 2024-05-07T14:04:04.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8846e-05 2024-05-07T14:04:04.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848039+0000", 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848222+0000", 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018251300000000001 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848268+0000", 2024-05-07T14:04:04.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5552e-05 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.874885+0000", 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026617335999999998 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.875018+0000", 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013276999999999999 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2894 3.16 3:6aec0fdf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.549820511, 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029574030000000001, 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2894 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913738+0000", 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.491e-06 2024-05-07T14:04:04.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917692+0000", 2024-05-07T14:04:04.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039540799999999996 2024-05-07T14:04:04.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917718+0000", 2024-05-07T14:04:04.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6211e-05 2024-05-07T14:04:04.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917732+0000", 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4487999999999999e-05 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917897+0000", 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016455199999999999 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918296+0000", 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000398825 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918724+0000", 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042847399999999998 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.933484+0000", 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014759959 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.942986+0000", 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095014739999999993 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943179+0000", 2024-05-07T14:04:04.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019320200000000001 2024-05-07T14:04:04.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943309+0000", 2024-05-07T14:04:04.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013027399999999999 2024-05-07T14:04:04.554 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.554 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.554 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.554 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2896 3.3a 3:5f842f5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.529060848, 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028429466, 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2896 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934498+0000", 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.557e-06 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939927+0000", 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054289250000000002 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939955+0000", 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8245000000000001e-05 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939971+0000", 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.504e-05 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940161+0000", 2024-05-07T14:04:04.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019040499999999999 2024-05-07T14:04:04.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940562+0000", 2024-05-07T14:04:04.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040076800000000002 2024-05-07T14:04:04.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:04.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940979+0000", 2024-05-07T14:04:04.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041760099999999997 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.950692+0000", 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097127529999999993 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962768+0000", 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012075987 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962863+0000", 2024-05-07T14:04:04.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5103000000000001e-05 2024-05-07T14:04:04.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962924+0000", 2024-05-07T14:04:04.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1081999999999996e-05 2024-05-07T14:04:04.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.560 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.560 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2908 3.3a 3:5d7a0a59:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:04.560 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:04.560 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.377709508999999, 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027562652999999999, 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2908 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:04.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085850+0000", 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.267e-06 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:04.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091371+0000", 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055205619999999997 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091411+0000", 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0365999999999999e-05 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091432+0000", 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0276e-05 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091608+0000", 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176653 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.092025+0000", 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041696799999999998 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.092418+0000", 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000393099 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.102443+0000", 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010024798999999999 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113230+0000", 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010786963 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113330+0000", 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9808000000000004e-05 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:04.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:04.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:04.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113409+0000", 2024-05-07T14:04:04.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8892000000000003e-05 2024-05-07T14:04:04.566 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.566 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.566 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.566 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:04.566 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:04.566 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:04.568 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:04:04.568 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:04.579+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:04.587 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:04:04.669 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:04.679+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:04.698 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:04.698 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:04.713 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:04:04.733 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:04.733 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:04.749 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:04.749 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:04.765 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:04.768 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:04.783+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:04.781 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:04.782 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:04.799 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:04.799 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:04.818 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:04.818 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:04.838 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:04.838 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:04.858 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:04:04.859 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:04:04.870 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:04.883+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:04.880 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:04.880 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:04.895 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:04:04.971 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:04.979+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:05.018 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:05.018 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:05.032 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:04:05.076 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:05.087+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:05.177 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:05.187+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:05.198 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:05.198 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:05.212 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:04:05.278 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:05.291+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:05.378 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:05.378 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:05.379 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:05.387+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:05.392 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:04:05.480 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:05.491+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:05.558 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:05.558 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:05.572 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:04:05.581 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:05.591+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:05.682 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:05.695+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:05.694 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:05.694 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:05.709 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:04:05.783 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:05.791+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:05.827 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:05.827 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:05.840 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:04:05.884 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:05.899+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:05.958 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:05.959 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:05.973 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:04:05.985 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:05.995+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:06.086 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:06.099+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:06.136 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:06.136 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:06.151 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:04:06.192 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:06.207+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:06.288 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:06.299+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:06.308 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:06.308 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:06.323 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:04:06.371 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:04:06.389 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:06.399+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:06.490 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:06.499+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:06.522 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:06.522 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:06.550 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:04:06.591 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:06.599+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:06.692 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:06.703+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:06.703 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:06.703 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:06.721 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:04:06.793 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:06.807+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:06.864 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:06.864 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:06.874 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:04:06.884 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:04:06.894 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:06.903+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:06.995 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:07.003+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:07.061 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:07.062 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:07.076 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:07.076 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:07.089 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:07.089 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:07.096 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:04:07.097 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:07.107+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:07.123 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:07.123 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:07.151 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:07.152 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:07.177 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:07.177 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:07.197 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:07.207+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:07.210 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:07.210 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:07.236 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:07.236 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:07.239 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:07.239 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:07.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.239 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3188 3.24 3:262a01e0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:07.239 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.242522+0000", 2024-05-07T14:04:07.239 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.010952399999999999, 2024-05-07T14:04:07.239 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010988379, 2024-05-07T14:04:07.239 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.239 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.239 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "waiting for sub ops", 2024-05-07T14:04:07.239 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3188 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.242522+0000", 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.242522+0000", 2024-05-07T14:04:07.240 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.242524+0000", 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.086e-06 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.244071+0000", 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015468000000000001 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.241 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.244103+0000", 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2271999999999999e-05 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.244117+0000", 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4106e-05 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.244204+0000", 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7077000000000007e-05 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.242 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.244391+0000", 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000187178 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.244561+0000", 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016917599999999999 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 1 2024-05-07T14:04:07.243 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:07.255 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:04:07.271 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:04:07.272 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:04:07.336 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:07.351+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:07.374 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:04:07.399 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:07.411+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:07.417 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:07.417 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:07.417 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:07.417 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:07.417 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:07.442 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:04:07.504 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:07.511+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:07.600 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:07.611+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:07.666 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:07.667 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:07.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:07.667 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:07.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.667 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:04:07.667 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:07.667 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 75.374190349000003, 2024-05-07T14:04:07.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:04:07.667 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.667 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.667 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.667 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:07.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:04:07.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:04:07.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:07.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:04:07.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:04:07.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:04:07.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2203 3.1e 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 64.384474005000001, 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029129142, 2024-05-07T14:04:07.673 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2203 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294465+0000", 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7699999999999999e-06 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300328+0000", 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058633460000000002 2024-05-07T14:04:07.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300384+0000", 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6212999999999999e-05 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300411+0000", 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7109000000000001e-05 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300586+0000", 2024-05-07T14:04:07.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017478799999999999 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300941+0000", 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035515500000000001 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301351+0000", 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040996099999999997 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.317495+0000", 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016143462000000001 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323421+0000", 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059264649999999997 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323498+0000", 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6478999999999997e-05 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323590+0000", 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2393999999999997e-05 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2230 3.b 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 64.008567334999995, 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021351564, 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.679 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.680 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.680 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.680 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.680 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2230 2024-05-07T14:04:07.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.680 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:07.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:07.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670370+0000", 2024-05-07T14:04:07.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5050000000000002e-06 2024-05-07T14:04:07.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673214+0000", 2024-05-07T14:04:07.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028441260000000002 2024-05-07T14:04:07.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673245+0000", 2024-05-07T14:04:07.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0488999999999999e-05 2024-05-07T14:04:07.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673259+0000", 2024-05-07T14:04:07.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4443e-05 2024-05-07T14:04:07.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673356+0000", 2024-05-07T14:04:07.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7031e-05 2024-05-07T14:04:07.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673531+0000", 2024-05-07T14:04:07.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017509099999999999 2024-05-07T14:04:07.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:07.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673696+0000", 2024-05-07T14:04:07.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000164306 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684776+0000", 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011080054000000001 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691578+0000", 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068025849999999999 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691659+0000", 2024-05-07T14:04:07.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0976000000000005e-05 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691719+0000", 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9957999999999998e-05 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2666 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.027110448999998, 2024-05-07T14:04:07.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.125351252, 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2666 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651827+0000", 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-06 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651834+0000", 2024-05-07T14:04:07.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7700000000000001e-06 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651850+0000", 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5755000000000001e-05 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651862+0000", 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.237e-05 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651967+0000", 2024-05-07T14:04:07.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010427199999999999 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651977+0000", 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0743e-05 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657294+0000", 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053168069999999998 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:07.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657305+0000", 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0662000000000001e-05 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774211+0000", 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1169060209999999 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774394+0000", 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018268000000000001 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.777176+0000", 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002782025 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2673 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.483177262000002, 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57934507999999996, 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.691 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2673 2024-05-07T14:04:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9699999999999996e-07 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195761+0000", 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2569999999999999e-06 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195768+0000", 2024-05-07T14:04:07.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.489e-06 2024-05-07T14:04:07.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195774+0000", 2024-05-07T14:04:07.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7389999999999996e-06 2024-05-07T14:04:07.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195866+0000", 2024-05-07T14:04:07.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2349000000000006e-05 2024-05-07T14:04:07.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195878+0000", 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1838000000000001e-05 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774802+0000", 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.578923945 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774906+0000", 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103991 2024-05-07T14:04:07.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775103+0000", 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196975 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2684 3.24 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.892816351, 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.040396402999999997, 2024-05-07T14:04:07.696 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2684 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:07.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786122+0000", 2024-05-07T14:04:07.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0929999999999999e-06 2024-05-07T14:04:07.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788626+0000", 2024-05-07T14:04:07.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025042720000000001 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788659+0000", 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2824999999999998e-05 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788673+0000", 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4721e-05 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788768+0000", 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4178999999999994e-05 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788776+0000", 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2400000000000007e-06 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798002+0000", 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092262230000000004 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798163+0000", 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161077 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798305+0000", 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014162499999999999 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.807567+0000", 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092618869999999999 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826429+0000", 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018862824 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826470+0000", 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1010999999999997e-05 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826515+0000", 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4425999999999998e-05 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.702 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2700 3.c e104/21 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.718969704999999, 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022078321000000001, 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:07.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9299999999999999e-07 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966313+0000", 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063471889999999996 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966340+0000", 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7514000000000001e-05 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966354+0000", 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4053000000000001e-05 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966434+0000", 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0273999999999997e-05 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966464+0000", 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.953e-05 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.981968+0000", 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0155037 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.982043+0000", 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5767999999999997e-05 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2710 3.29 3:9701fed0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.607143718, 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020865083, 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.707 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2710 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071791+0000", 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.071794+0000", 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.565e-06 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073899+0000", 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002104809 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073925+0000", 2024-05-07T14:04:07.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6125000000000001e-05 2024-05-07T14:04:07.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.073936+0000", 2024-05-07T14:04:07.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0878e-05 2024-05-07T14:04:07.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074018+0000", 2024-05-07T14:04:07.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2391000000000004e-05 2024-05-07T14:04:07.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074144+0000", 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012578599999999999 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.074241+0000", 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7547999999999995e-05 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.082159+0000", 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0079176720000000006 2024-05-07T14:04:07.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092527+0000", 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010368004 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092600+0000", 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3491000000000005e-05 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.092656+0000", 2024-05-07T14:04:07.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5813999999999998e-05 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2712 3.15 e104/21 3:a83036f0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_29:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.575579902000001, 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021527713, 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103357+0000", 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7260000000000001e-06 2024-05-07T14:04:07.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107529+0000", 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041726999999999997 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107551+0000", 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1854000000000001e-05 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107563+0000", 2024-05-07T14:04:07.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1362999999999999e-05 2024-05-07T14:04:07.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107633+0000", 2024-05-07T14:04:07.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0432999999999995e-05 2024-05-07T14:04:07.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107652+0000", 2024-05-07T14:04:07.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9250999999999999e-05 2024-05-07T14:04:07.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124797+0000", 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017144626 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124883+0000", 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5760000000000006e-05 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2726 3.24 3:2710602c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:07.717 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.435251518000001, 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020082965000000001, 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2726 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.718 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243683+0000", 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.243686+0000", 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8420000000000001e-06 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245745+0000", 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020592890000000002 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245765+0000", 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9505e-05 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245777+0000", 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2282e-05 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245842+0000", 2024-05-07T14:04:07.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4682000000000002e-05 2024-05-07T14:04:07.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.245956+0000", 2024-05-07T14:04:07.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000113875 2024-05-07T14:04:07.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:07.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.246056+0000", 2024-05-07T14:04:07.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100238 2024-05-07T14:04:07.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.249971+0000", 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039145179999999996 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263656+0000", 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013685246999999999 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263718+0000", 2024-05-07T14:04:07.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1704000000000004e-05 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.263766+0000", 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8782999999999997e-05 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2791 3.27 3:e46b1707:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.749681359, 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022300529999999999, 2024-05-07T14:04:07.723 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.724 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.724 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.724 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.724 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.724 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.724 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2791 2024-05-07T14:04:07.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.724 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:07.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929257+0000", 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.281e-06 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931305+0000", 2024-05-07T14:04:07.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020483020000000001 2024-05-07T14:04:07.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931328+0000", 2024-05-07T14:04:07.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2722e-05 2024-05-07T14:04:07.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931341+0000", 2024-05-07T14:04:07.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3529e-05 2024-05-07T14:04:07.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931415+0000", 2024-05-07T14:04:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3597999999999996e-05 2024-05-07T14:04:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931614+0000", 2024-05-07T14:04:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019859000000000001 2024-05-07T14:04:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931758+0000", 2024-05-07T14:04:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014481699999999999 2024-05-07T14:04:07.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.939706+0000", 2024-05-07T14:04:07.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007948063 2024-05-07T14:04:07.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951424+0000", 2024-05-07T14:04:07.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011717708 2024-05-07T14:04:07.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951500+0000", 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5831e-05 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951554+0000", 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4088999999999997e-05 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2800 3.18 3:1851862d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:04:07.729 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.656528293000001, 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020357577000000002, 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2800 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:04:07.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022407+0000", 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.022410+0000", 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0079999999999998e-06 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024625+0000", 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022156350000000001 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024652+0000", 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6715000000000001e-05 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024698+0000", 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6470000000000001e-05 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024776+0000", 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7960000000000006e-05 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024944+0000", 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016757400000000001 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.025106+0000", 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016191 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.041855+0000", 2024-05-07T14:04:07.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016748939000000001 2024-05-07T14:04:07.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042642+0000", 2024-05-07T14:04:07.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00078695000000000002 2024-05-07T14:04:07.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042712+0000", 2024-05-07T14:04:07.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0154999999999995e-05 2024-05-07T14:04:07.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.042764+0000", 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2261e-05 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2817 3.24 3:24a9723e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.483915563, 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020083441, 2024-05-07T14:04:07.735 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2817 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195019+0000", 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.195022+0000", 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4399999999999999e-06 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197097+0000", 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002075173 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197131+0000", 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3952999999999998e-05 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197148+0000", 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6648000000000001e-05 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197230+0000", 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2341000000000003e-05 2024-05-07T14:04:07.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197399+0000", 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168782 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.197549+0000", 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000150311 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.210524+0000", 2024-05-07T14:04:07.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012974930000000001 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215027+0000", 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0045034979999999999 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215068+0000", 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0846000000000002e-05 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.215103+0000", 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4518999999999999e-05 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2861 3.22 e105/21 3:479e234a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_168:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.134851362999999, 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021170174999999999, 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.741 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:04:07.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544084+0000", 2024-05-07T14:04:07.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.544085+0000", 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.815e-06 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548101+0000", 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040158920000000001 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548121+0000", 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9899e-05 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548132+0000", 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0464e-05 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548210+0000", 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8176000000000005e-05 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.548229+0000", 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9701999999999999e-05 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.565217+0000", 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016987777999999999 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.565254+0000", 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6449000000000003e-05 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2864 3.29 3:97632e4b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:07.745 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.103927727999999, 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021723981, 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2864 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.746 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575010+0000", 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5660000000000001e-06 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576737+0000", 2024-05-07T14:04:07.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017271599999999999 2024-05-07T14:04:07.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576768+0000", 2024-05-07T14:04:07.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1424000000000003e-05 2024-05-07T14:04:07.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576783+0000", 2024-05-07T14:04:07.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4656e-05 2024-05-07T14:04:07.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576880+0000", 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6576999999999994e-05 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577067+0000", 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018795800000000001 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577285+0000", 2024-05-07T14:04:07.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021768499999999999 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.587487+0000", 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010202289 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596612+0000", 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0091244440000000007 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596681+0000", 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9025999999999999e-05 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596731+0000", 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0195999999999998e-05 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2865 3.38 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:07.751 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.096310070000001, 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.035746371999999998, 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2865 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:07.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582627+0000", 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584611+0000", 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019836350000000001 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584636+0000", 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4943000000000002e-05 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584652+0000", 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5586e-05 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584733+0000", 2024-05-07T14:04:07.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0987000000000002e-05 2024-05-07T14:04:07.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584881+0000", 2024-05-07T14:04:07.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014805800000000001 2024-05-07T14:04:07.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:07.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584972+0000", 2024-05-07T14:04:07.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1218999999999995e-05 2024-05-07T14:04:07.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.591149+0000", 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061766939999999999 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618207+0000", 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027058260000000001 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618319+0000", 2024-05-07T14:04:07.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011267700000000001 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618371+0000", 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1683e-05 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2872 3.15 e105/21 3:ab0c6c4f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_179:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.016989260999999, 2024-05-07T14:04:07.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020080595999999999, 2024-05-07T14:04:07.758 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.758 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.758 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.758 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:04:07.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661946+0000", 2024-05-07T14:04:07.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.661947+0000", 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5099999999999999e-06 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667621+0000", 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056736269999999997 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667649+0000", 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8093e-05 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667661+0000", 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2554999999999999e-05 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667745+0000", 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3301999999999996e-05 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.667771+0000", 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6135999999999998e-05 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.681960+0000", 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014189301 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.682026+0000", 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6072e-05 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.761 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2883 3.29 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.901146432000001, 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025309511999999999, 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.762 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2883 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777791+0000", 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.289e-06 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779027+0000", 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001236411 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779063+0000", 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5658999999999999e-05 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779076+0000", 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3128e-05 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779166+0000", 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9818e-05 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779398+0000", 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023189400000000001 2024-05-07T14:04:07.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779577+0000", 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000179276 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.786782+0000", 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072052740000000002 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.802960+0000", 2024-05-07T14:04:07.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016177490999999999 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803047+0000", 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6912999999999999e-05 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803098+0000", 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1359000000000001e-05 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2905 3.1e 3:78954da1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.627738192999999, 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028568698, 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2905 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051199+0000", 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5299999999999999e-06 2024-05-07T14:04:07.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055400+0000", 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042009889999999996 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055458+0000", 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.736e-05 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055486+0000", 2024-05-07T14:04:07.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8914000000000001e-05 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055574+0000", 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7120999999999995e-05 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055726+0000", 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015249600000000001 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:07.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055884+0000", 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015788900000000001 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.064235+0000", 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008350583 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078705+0000", 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014470129999999999 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078900+0000", 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019521799999999999 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.079765+0000", 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00086546799999999999 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3187 3.24 3:255656f5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.230843+0000", 2024-05-07T14:04:07.773 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.448092143, 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020294631, 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3187 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.230843+0000", 2024-05-07T14:04:07.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.230843+0000", 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.230846+0000", 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1240000000000001e-06 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:07.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.232348+0000", 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001502066 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.232377+0000", 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8904999999999999e-05 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.232389+0000", 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2563e-05 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.232473+0000", 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3938999999999997e-05 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.232658+0000", 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018486500000000001 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.232829+0000", 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017104800000000001 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.240638+0000", 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078088819999999996 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.251003+0000", 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010365295 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.251077+0000", 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3769000000000005e-05 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:07.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:07.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:07.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.251137+0000", 2024-05-07T14:04:07.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0174999999999999e-05 2024-05-07T14:04:07.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.779 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:07.779 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:07.779 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:07.780 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:04:07.781 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:07.791+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:07.882 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:07.891+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:07.916 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:07.916 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:07.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:07.916 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3251 3.29 e114/21 3:97fea302:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_143:head v 114'9, mlcod=105'7)", 2024-05-07T14:04:07.916 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.917262+0000", 2024-05-07T14:04:07.916 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.012632856, 2024-05-07T14:04:07.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012704128, 2024-05-07T14:04:07.916 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:07.916 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:07.916 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.917262+0000", 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.917262+0000", 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:07.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.917262+0000", 2024-05-07T14:04:07.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9799999999999999e-07 2024-05-07T14:04:07.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:07.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:07.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:07.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.921672+0000", 2024-05-07T14:04:07.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044098439999999996 2024-05-07T14:04:07.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:07.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:07.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:07.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.921687+0000", 2024-05-07T14:04:07.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5023e-05 2024-05-07T14:04:07.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.921698+0000", 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1157e-05 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.921828+0000", 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013019 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.921880+0000", 2024-05-07T14:04:07.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2157999999999998e-05 2024-05-07T14:04:07.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:07.920 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:07.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:07.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:07.920 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-07T14:04:07.920 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-05-07T14:04:07.920 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:07.937 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:04:07.982 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:07.991+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:08.083 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:08.091+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:08.129 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:08.129 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:08.130 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:08.146 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:04:08.192 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:08.203+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:08.285 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:08.299+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:08.325 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:08.325 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:08.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:08.326 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:08.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.326 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2224 3.1a 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:08.326 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:08.326 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.747988078999995, 2024-05-07T14:04:08.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027796929000000001, 2024-05-07T14:04:08.326 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.326 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.326 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2224 2024-05-07T14:04:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:08.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588348+0000", 2024-05-07T14:04:08.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1629999999999998e-06 2024-05-07T14:04:08.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594043+0000", 2024-05-07T14:04:08.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056948950000000002 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594085+0000", 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1678999999999999e-05 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594113+0000", 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594221+0000", 2024-05-07T14:04:08.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107371 2024-05-07T14:04:08.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594405+0000", 2024-05-07T14:04:08.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018468099999999999 2024-05-07T14:04:08.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594570+0000", 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165224 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.603655+0000", 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090846550000000005 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.615968+0000", 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012313199 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616069+0000", 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100309 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616141+0000", 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2218999999999994e-05 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.332 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2229 3.3 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:08.333 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:08.333 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.676691551000005, 2024-05-07T14:04:08.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028304669000000001, 2024-05-07T14:04:08.333 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.333 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.333 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.333 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.333 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.333 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.333 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2229 2024-05-07T14:04:08.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.333 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659643+0000", 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9129999999999999e-06 2024-05-07T14:04:08.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664151+0000", 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045081189999999997 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664198+0000", 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6431999999999999e-05 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664223+0000", 2024-05-07T14:04:08.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5369999999999999e-05 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664313+0000", 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345999999999995e-05 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664428+0000", 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115058 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:08.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664566+0000", 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138598 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.671674+0000", 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071074529999999997 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687772+0000", 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016098359 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687871+0000", 2024-05-07T14:04:08.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9098000000000006e-05 2024-05-07T14:04:08.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687945+0000", 2024-05-07T14:04:08.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3923000000000004e-05 2024-05-07T14:04:08.338 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.338 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.338 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.338 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2684 3.24 e104/21 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.537731091000001, 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026848770000000001, 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:08.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:08.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6000000000000004e-07 2024-05-07T14:04:08.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810718+0000", 2024-05-07T14:04:08.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012116477 2024-05-07T14:04:08.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810747+0000", 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8676000000000001e-05 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810791+0000", 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4415000000000001e-05 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810915+0000", 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012363399999999999 2024-05-07T14:04:08.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810950+0000", 2024-05-07T14:04:08.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5812999999999997e-05 2024-05-07T14:04:08.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825326+0000", 2024-05-07T14:04:08.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014375852 2024-05-07T14:04:08.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825450+0000", 2024-05-07T14:04:08.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012334299999999999 2024-05-07T14:04:08.343 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.343 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.343 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.343 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2685 3.1c e104/21 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head v 104'1, mlcod=0'0)", 2024-05-07T14:04:08.343 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:08.343 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.530895419, 2024-05-07T14:04:08.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023842609000000001, 2024-05-07T14:04:08.344 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.344 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.344 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:08.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:08.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805438+0000", 2024-05-07T14:04:08.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.243e-06 2024-05-07T14:04:08.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812353+0000", 2024-05-07T14:04:08.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069150560000000002 2024-05-07T14:04:08.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812385+0000", 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2583000000000003e-05 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812406+0000", 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0378999999999999e-05 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812541+0000", 2024-05-07T14:04:08.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013502699999999999 2024-05-07T14:04:08.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812591+0000", 2024-05-07T14:04:08.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0522999999999997e-05 2024-05-07T14:04:08.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829183+0000", 2024-05-07T14:04:08.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016591445999999999 2024-05-07T14:04:08.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829279+0000", 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6352000000000002e-05 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2686 3.34 3:2ec0e822:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.527680949000001, 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034864805999999998, 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.348 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2686 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808656+0000", 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6029999999999998e-06 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818059+0000", 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094034429999999992 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818114+0000", 2024-05-07T14:04:08.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4625e-05 2024-05-07T14:04:08.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818139+0000", 2024-05-07T14:04:08.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4850000000000001e-05 2024-05-07T14:04:08.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819387+0000", 2024-05-07T14:04:08.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012488060000000001 2024-05-07T14:04:08.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819792+0000", 2024-05-07T14:04:08.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040472400000000002 2024-05-07T14:04:08.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:08.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820050+0000", 2024-05-07T14:04:08.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025799800000000001 2024-05-07T14:04:08.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.833596+0000", 2024-05-07T14:04:08.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013546069000000001 2024-05-07T14:04:08.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843174+0000", 2024-05-07T14:04:08.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095773449999999993 2024-05-07T14:04:08.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:04:08.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023329199999999999 2024-05-07T14:04:08.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843516+0000", 2024-05-07T14:04:08.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109051 2024-05-07T14:04:08.354 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.354 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.354 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.354 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2696 3.14 3:2aeb6272:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:08.354 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:08.354 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.423296108999999, 2024-05-07T14:04:08.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022593715, 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2696 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913039+0000", 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3730000000000001e-06 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917057+0000", 2024-05-07T14:04:08.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040181319999999998 2024-05-07T14:04:08.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917099+0000", 2024-05-07T14:04:08.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.155e-05 2024-05-07T14:04:08.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917118+0000", 2024-05-07T14:04:08.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8862e-05 2024-05-07T14:04:08.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917285+0000", 2024-05-07T14:04:08.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016734000000000001 2024-05-07T14:04:08.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917644+0000", 2024-05-07T14:04:08.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035872600000000002 2024-05-07T14:04:08.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:08.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.918201+0000", 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055705100000000003 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.934860+0000", 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016658665 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935461+0000", 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060165000000000001 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935559+0000", 2024-05-07T14:04:08.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8255e-05 2024-05-07T14:04:08.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935630+0000", 2024-05-07T14:04:08.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0110999999999993e-05 2024-05-07T14:04:08.360 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.360 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.360 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.360 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2704 3.31 e104/21 3:8c38a608:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_21:head v 104'4, mlcod=85'2)", 2024-05-07T14:04:08.360 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:04:08.361 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.335283200999999, 2024-05-07T14:04:08.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021828251999999999, 2024-05-07T14:04:08.361 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.361 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.361 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.361 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:04:08.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001049+0000", 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.001050+0000", 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6330000000000001e-06 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007182+0000", 2024-05-07T14:04:08.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061313840000000001 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007208+0000", 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5842000000000001e-05 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007224+0000", 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5962999999999999e-05 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007327+0000", 2024-05-07T14:04:08.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010380200000000001 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.007373+0000", 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5969e-05 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.022754+0000", 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015381099000000001 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.022877+0000", 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255999999999999 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2755 3.14 3:2b7affc7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.795369233999999, 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023747145000000001, 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.365 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.366 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.366 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.366 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2755 2024-05-07T14:04:08.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.366 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:08.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540983+0000", 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0466999999999999e-05 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545846+0000", 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048626709999999998 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545883+0000", 2024-05-07T14:04:08.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6769e-05 2024-05-07T14:04:08.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545900+0000", 2024-05-07T14:04:08.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6869999999999999e-05 2024-05-07T14:04:08.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546070+0000", 2024-05-07T14:04:08.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017014299999999999 2024-05-07T14:04:08.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546329+0000", 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025910400000000002 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546560+0000", 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023119899999999999 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.555774+0000", 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092136490000000008 2024-05-07T14:04:08.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564539+0000", 2024-05-07T14:04:08.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087649870000000001 2024-05-07T14:04:08.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564638+0000", 2024-05-07T14:04:08.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9028000000000001e-05 2024-05-07T14:04:08.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564710+0000", 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2257999999999998e-05 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2799 3.9 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.323972424000001, 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027222948, 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.371 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2799 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:08.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012363+0000", 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6500000000000002e-06 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016678+0000", 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043148320000000002 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016709+0000", 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0953e-05 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016726+0000", 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7022999999999999e-05 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016864+0000", 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137854 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017108+0000", 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024388099999999999 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017333+0000", 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022492899999999999 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.033051+0000", 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015718352000000001 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039272+0000", 2024-05-07T14:04:08.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062205139999999999 2024-05-07T14:04:08.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039451+0000", 2024-05-07T14:04:08.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017928 2024-05-07T14:04:08.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039583+0000", 2024-05-07T14:04:08.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013168000000000001 2024-05-07T14:04:08.377 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.377 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.377 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.377 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2802 3.13 e105/46 3:c8761262:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_119:head v 105'4, mlcod=85'2)", 2024-05-07T14:04:08.377 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:04:08.377 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.290470582000001, 2024-05-07T14:04:08.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02254192, 2024-05-07T14:04:08.377 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.377 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.377 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.378 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:04:08.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045861+0000", 2024-05-07T14:04:08.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.045864+0000", 2024-05-07T14:04:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3530000000000002e-06 2024-05-07T14:04:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051333+0000", 2024-05-07T14:04:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054687579999999998 2024-05-07T14:04:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051366+0000", 2024-05-07T14:04:08.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3215e-05 2024-05-07T14:04:08.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051384+0000", 2024-05-07T14:04:08.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8394e-05 2024-05-07T14:04:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051552+0000", 2024-05-07T14:04:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016783600000000001 2024-05-07T14:04:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.051619+0000", 2024-05-07T14:04:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7142000000000002e-05 2024-05-07T14:04:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.068274+0000", 2024-05-07T14:04:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016654987999999999 2024-05-07T14:04:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.068403+0000", 2024-05-07T14:04:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012923399999999999 2024-05-07T14:04:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2804 3.e e105/21 3:7356dc96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_121:head v 105'10, mlcod=105'8)", 2024-05-07T14:04:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.263035681000002, 2024-05-07T14:04:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029282694000000001, 2024-05-07T14:04:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073299+0000", 2024-05-07T14:04:08.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:04:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076073+0000", 2024-05-07T14:04:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027746260000000001 2024-05-07T14:04:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076118+0000", 2024-05-07T14:04:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4223e-05 2024-05-07T14:04:08.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076138+0000", 2024-05-07T14:04:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0622999999999999e-05 2024-05-07T14:04:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076324+0000", 2024-05-07T14:04:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018613599999999999 2024-05-07T14:04:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076376+0000", 2024-05-07T14:04:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2068999999999999e-05 2024-05-07T14:04:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102438+0000", 2024-05-07T14:04:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026061190000000001 2024-05-07T14:04:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102579+0000", 2024-05-07T14:04:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014143399999999999 2024-05-07T14:04:08.389 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2805 3.1 e105/21 3:819b24c4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_122:head v 105'3, mlcod=104'1)", 2024-05-07T14:04:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.260072862000001, 2024-05-07T14:04:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028404523000000001, 2024-05-07T14:04:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076262+0000", 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3800000000000001e-06 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083265+0000", 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070039539999999997 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083309+0000", 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3516000000000001e-05 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083333+0000", 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4471999999999999e-05 2024-05-07T14:04:08.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083520+0000", 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018616999999999999 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083588+0000", 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8405000000000007e-05 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104547+0000", 2024-05-07T14:04:08.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020959228 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104664+0000", 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011639800000000001 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2832 3.1a 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.088668099, 2024-05-07T14:04:08.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030681671000000001, 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2832 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247666+0000", 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5569999999999998e-06 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253202+0000", 2024-05-07T14:04:08.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055353900000000003 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253232+0000", 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0309000000000001e-05 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253250+0000", 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7503000000000002e-05 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253372+0000", 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255600000000001 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253592+0000", 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021960400000000001 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253831+0000", 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000239223 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.264040+0000", 2024-05-07T14:04:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010209018 2024-05-07T14:04:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278176+0000", 2024-05-07T14:04:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014135518 2024-05-07T14:04:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278272+0000", 2024-05-07T14:04:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6562000000000001e-05 2024-05-07T14:04:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278346+0000", 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3430999999999995e-05 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2835 3.34 3:2eb22351:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.059195572, 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021927980999999999, 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.400 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2835 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277136+0000", 2024-05-07T14:04:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.277140+0000", 2024-05-07T14:04:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9729999999999999e-06 2024-05-07T14:04:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281106+0000", 2024-05-07T14:04:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039657010000000003 2024-05-07T14:04:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281136+0000", 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9913e-05 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281152+0000", 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5792999999999999e-05 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281276+0000", 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000124537 2024-05-07T14:04:08.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281515+0000", 2024-05-07T14:04:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000238698 2024-05-07T14:04:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.281747+0000", 2024-05-07T14:04:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023245500000000001 2024-05-07T14:04:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298177+0000", 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016429322999999999 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298772+0000", 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059492799999999999 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.298944+0000", 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017187300000000001 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.299064+0000", 2024-05-07T14:04:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012078699999999999 2024-05-07T14:04:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2853 3.34 3:2c5576f8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.879974211, 2024-05-07T14:04:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026917739, 2024-05-07T14:04:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.406 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2853 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456361+0000", 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1240000000000001e-06 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460499+0000", 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041381159999999998 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460528+0000", 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8558999999999999e-05 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460544+0000", 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6200000000000001e-05 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460699+0000", 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155513 2024-05-07T14:04:08.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461098+0000", 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039883900000000001 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461508+0000", 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040939399999999999 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.474319+0000", 2024-05-07T14:04:08.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012811002 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483036+0000", 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087174469999999997 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483142+0000", 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010647800000000001 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483276+0000", 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013306700000000001 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2874 3.34 3:2d878586:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.657372146, 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023302047999999999, 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.412 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2874 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:08.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678964+0000", 2024-05-07T14:04:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.89e-06 2024-05-07T14:04:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683101+0000", 2024-05-07T14:04:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041374669999999997 2024-05-07T14:04:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683138+0000", 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7098999999999998e-05 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683155+0000", 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7139999999999999e-05 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683330+0000", 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000174919 2024-05-07T14:04:08.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683715+0000", 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038476199999999997 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.684028+0000", 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031283999999999999 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701377+0000", 2024-05-07T14:04:08.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017349402999999999 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701948+0000", 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057096800000000004 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702125+0000", 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176319 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702262+0000", 2024-05-07T14:04:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137241 2024-05-07T14:04:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2881 3.1 e105/21 3:8167d3db:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_188:head v 105'5, mlcod=105'3)", 2024-05-07T14:04:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:04:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.580763310000002, 2024-05-07T14:04:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021809426999999999, 2024-05-07T14:04:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.418 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:04:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755569+0000", 2024-05-07T14:04:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.755571+0000", 2024-05-07T14:04:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.357e-06 2024-05-07T14:04:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759865+0000", 2024-05-07T14:04:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042943870000000002 2024-05-07T14:04:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759901+0000", 2024-05-07T14:04:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5759000000000001e-05 2024-05-07T14:04:08.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.759920+0000", 2024-05-07T14:04:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8559999999999998e-05 2024-05-07T14:04:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.760063+0000", 2024-05-07T14:04:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000143647 2024-05-07T14:04:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.760108+0000", 2024-05-07T14:04:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4511999999999997e-05 2024-05-07T14:04:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.776951+0000", 2024-05-07T14:04:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016842754000000001 2024-05-07T14:04:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.777378+0000", 2024-05-07T14:04:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042745100000000002 2024-05-07T14:04:08.422 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2883 3.29 e105/21 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head v 105'6, mlcod=104'4)", 2024-05-07T14:04:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.556677426, 2024-05-07T14:04:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022805558, 2024-05-07T14:04:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779657+0000", 2024-05-07T14:04:08.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0370000000000001e-06 2024-05-07T14:04:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784248+0000", 2024-05-07T14:04:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045916810000000002 2024-05-07T14:04:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784272+0000", 2024-05-07T14:04:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3281999999999998e-05 2024-05-07T14:04:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784285+0000", 2024-05-07T14:04:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3423e-05 2024-05-07T14:04:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784399+0000", 2024-05-07T14:04:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011439500000000001 2024-05-07T14:04:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784452+0000", 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2142000000000003e-05 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802362+0000", 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017910874 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802460+0000", 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7724000000000002e-05 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.427 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2889 3.e e105/21 3:72a3c671:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_196:head v 105'11, mlcod=105'9)", 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.481805914999999, 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02270175, 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854529+0000", 2024-05-07T14:04:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7499999999999999e-06 2024-05-07T14:04:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857472+0000", 2024-05-07T14:04:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002942999 2024-05-07T14:04:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857510+0000", 2024-05-07T14:04:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8075999999999999e-05 2024-05-07T14:04:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857533+0000", 2024-05-07T14:04:08.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3353000000000002e-05 2024-05-07T14:04:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857695+0000", 2024-05-07T14:04:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016135300000000001 2024-05-07T14:04:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857761+0000", 2024-05-07T14:04:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6759000000000002e-05 2024-05-07T14:04:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877052+0000", 2024-05-07T14:04:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019290656999999999 2024-05-07T14:04:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877228+0000", 2024-05-07T14:04:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017580300000000001 2024-05-07T14:04:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.432 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3190 3.1a 3:59666d5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.0759026359999999, 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026496828, 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3190 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260444+0000", 2024-05-07T14:04:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4766000000000001e-05 2024-05-07T14:04:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267146+0000", 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00670179 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267176+0000", 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0534999999999998e-05 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267191+0000", 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4080000000000001e-05 2024-05-07T14:04:08.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267300+0000", 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109962 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267473+0000", 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000172516 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267636+0000", 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016309699999999999 2024-05-07T14:04:08.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.275955+0000", 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083188399999999992 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286699+0000", 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010743674999999999 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286808+0000", 2024-05-07T14:04:08.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109702 2024-05-07T14:04:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286926+0000", 2024-05-07T14:04:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117865 2024-05-07T14:04:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.438 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.438 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:08.440 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:04:08.440 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:08.447+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:08.541 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:08.555+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:08.624 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:08.624 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:08.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.624 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3297 3.2a 3:55116b95:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:08.624 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:08.620414+0000", 2024-05-07T14:04:08.624 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.017524504999999999, 2024-05-07T14:04:08.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017554664000000001, 2024-05-07T14:04:08.624 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.624 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.624 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "waiting for sub ops", 2024-05-07T14:04:08.624 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.624 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3297 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:08.620414+0000", 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:08.620414+0000", 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:08.620418+0000", 2024-05-07T14:04:08.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7570000000000002e-06 2024-05-07T14:04:08.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:08.624752+0000", 2024-05-07T14:04:08.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043343959999999999 2024-05-07T14:04:08.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:08.624789+0000", 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6896e-05 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:08.624807+0000", 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7713000000000001e-05 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:08.624935+0000", 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012766500000000001 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:08.625199+0000", 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026385599999999998 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:08.625431+0000", 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000232227 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:08.637687+0000", 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012256636 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.628 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.629 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.629 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-05-07T14:04:08.629 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-05-07T14:04:08.629 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:08.640 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:04:08.641 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:08.651+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:08.742 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:08.755+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:08.766 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:08.766 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:08.766 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:08.766 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:08.766 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:08.780 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:04:08.843 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:08.855+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:08.915 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2498 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.531489010999998, 2024-05-07T14:04:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.06015305, 2024-05-07T14:04:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2498 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394887+0000", 2024-05-07T14:04:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:04:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394900+0000", 2024-05-07T14:04:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3125999999999999e-05 2024-05-07T14:04:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394940+0000", 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9579999999999997e-05 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394961+0000", 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1075999999999999e-05 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395122+0000", 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160741 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395140+0000", 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430325+0000", 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.03518512 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430355+0000", 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9181999999999999e-05 2024-05-07T14:04:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.445424+0000", 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.015069751 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.446159+0000", 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073452200000000004 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450456+0000", 2024-05-07T14:04:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042973689999999997 2024-05-07T14:04:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450627+0000", 2024-05-07T14:04:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017032700000000001 2024-05-07T14:04:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455037+0000", 2024-05-07T14:04:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044108690000000004 2024-05-07T14:04:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2499 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 62.531359962000003, 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.065623158, 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2499 2024-05-07T14:04:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395015+0000", 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.57e-06 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395022+0000", 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1330000000000001e-06 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395043+0000", 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1022999999999998e-05 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395060+0000", 2024-05-07T14:04:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6325999999999999e-05 2024-05-07T14:04:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395199+0000", 2024-05-07T14:04:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139815 2024-05-07T14:04:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395215+0000", 2024-05-07T14:04:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5693e-05 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413112+0000", 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017896860000000001 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413143+0000", 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1609000000000002e-05 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.447430+0000", 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0342867060000001 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450079+0000", 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002648386 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455213+0000", 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051342749999999998 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455444+0000", 2024-05-07T14:04:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023070799999999999 2024-05-07T14:04:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.460637+0000", 2024-05-07T14:04:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051930539999999999 2024-05-07T14:04:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2667 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.276115397000002, 2024-05-07T14:04:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1292758329999999, 2024-05-07T14:04:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2667 2024-05-07T14:04:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650260+0000", 2024-05-07T14:04:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1160000000000002e-06 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650270+0000", 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0047000000000001e-05 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650296+0000", 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6058999999999999e-05 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650313+0000", 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6727000000000001e-05 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660781+0000", 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010468518 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660805+0000", 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3246000000000001e-05 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776636+0000", 2024-05-07T14:04:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.115831102 2024-05-07T14:04:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776958+0000", 2024-05-07T14:04:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032243199999999999 2024-05-07T14:04:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.779534+0000", 2024-05-07T14:04:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025755859999999999 2024-05-07T14:04:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2674 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.730691717999999, 2024-05-07T14:04:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58268987500000002, 2024-05-07T14:04:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2674 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195683+0000", 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2500000000000001e-06 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195689+0000", 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4300000000000003e-06 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195702+0000", 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3026e-05 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195718+0000", 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5532999999999998e-05 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195943+0000", 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022518899999999999 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195971+0000", 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7688999999999999e-05 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.777763+0000", 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58179212899999999 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778060+0000", 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029683599999999997 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778372+0000", 2024-05-07T14:04:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031179299999999999 2024-05-07T14:04:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2685 3.1c 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.130842696999999, 2024-05-07T14:04:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034286608000000003, 2024-05-07T14:04:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2685 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795533+0000", 2024-05-07T14:04:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:04:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803767+0000", 2024-05-07T14:04:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082339079999999999 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803810+0000", 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2969000000000001e-05 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803837+0000", 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7036e-05 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804026+0000", 2024-05-07T14:04:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018935600000000001 2024-05-07T14:04:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804408+0000", 2024-05-07T14:04:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038137799999999998 2024-05-07T14:04:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804786+0000", 2024-05-07T14:04:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037841200000000001 2024-05-07T14:04:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.823281+0000", 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018494561999999999 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829623+0000", 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063427279999999997 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829715+0000", 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1815000000000001e-05 2024-05-07T14:04:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829817+0000", 2024-05-07T14:04:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102051 2024-05-07T14:04:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2687 3.2 e104/46 3:43af9208:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_4:head v 104'5, mlcod=85'3)", 2024-05-07T14:04:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.829025+0000", 2024-05-07T14:04:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.097348161999999, 2024-05-07T14:04:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026001561999999999, 2024-05-07T14:04:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829025+0000", 2024-05-07T14:04:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829025+0000", 2024-05-07T14:04:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829026+0000", 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.0999999999999998e-07 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837259+0000", 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082336319999999994 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837292+0000", 2024-05-07T14:04:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2156000000000002e-05 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837310+0000", 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7893e-05 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837449+0000", 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013917399999999999 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.837490+0000", 2024-05-07T14:04:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1085999999999999e-05 2024-05-07T14:04:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.854949+0000", 2024-05-07T14:04:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017459526 2024-05-07T14:04:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.855027+0000", 2024-05-07T14:04:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7484999999999994e-05 2024-05-07T14:04:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2689 3.2a 3:57071f6f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.087405077, 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032293512000000003, 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2689 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838972+0000", 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.72e-06 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843363+0000", 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043909810000000004 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4181999999999998e-05 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843430+0000", 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3139999999999999e-05 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843735+0000", 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030467299999999999 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844287+0000", 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055224799999999998 2024-05-07T14:04:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844674+0000", 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038716199999999998 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.868480+0000", 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023805639999999999 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.870993+0000", 2024-05-07T14:04:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025130920000000002 2024-05-07T14:04:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871151+0000", 2024-05-07T14:04:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000158176 2024-05-07T14:04:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871262+0000", 2024-05-07T14:04:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110498 2024-05-07T14:04:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2700 3.c 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.972390698000002, 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028853172999999999, 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2700 2024-05-07T14:04:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.954040+0000", 2024-05-07T14:04:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7735000000000002e-05 2024-05-07T14:04:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958710+0000", 2024-05-07T14:04:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046694220000000003 2024-05-07T14:04:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958759+0000", 2024-05-07T14:04:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8671999999999997e-05 2024-05-07T14:04:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958778+0000", 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958955+0000", 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177197 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959253+0000", 2024-05-07T14:04:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029744999999999999 2024-05-07T14:04:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959545+0000", 2024-05-07T14:04:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029215699999999997 2024-05-07T14:04:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.969251+0000", 2024-05-07T14:04:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097062789999999999 2024-05-07T14:04:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982559+0000", 2024-05-07T14:04:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013307818000000001 2024-05-07T14:04:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982721+0000", 2024-05-07T14:04:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016221200000000001 2024-05-07T14:04:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982836+0000", 2024-05-07T14:04:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114605 2024-05-07T14:04:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2782 3.5 3:a0760020:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.102619851, 2024-05-07T14:04:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029185556000000001, 2024-05-07T14:04:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2782 2024-05-07T14:04:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823757+0000", 2024-05-07T14:04:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7330000000000001e-06 2024-05-07T14:04:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829013+0000", 2024-05-07T14:04:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052552889999999998 2024-05-07T14:04:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829062+0000", 2024-05-07T14:04:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9375000000000001e-05 2024-05-07T14:04:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829089+0000", 2024-05-07T14:04:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7143000000000001e-05 2024-05-07T14:04:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829248+0000", 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015877 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829262+0000", 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.365e-05 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835685+0000", 2024-05-07T14:04:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064232339999999999 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835910+0000", 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022484800000000001 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.836115+0000", 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000204916 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.851571+0000", 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015456634 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852768+0000", 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001197264 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852867+0000", 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9011000000000005e-05 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852939+0000", 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1688999999999998e-05 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2793 3.30 3:0c9cfcfb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.976966663999999, 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028754691999999998, 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.970 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2793 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949410+0000", 2024-05-07T14:04:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7239999999999998e-06 2024-05-07T14:04:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956008+0000", 2024-05-07T14:04:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065976560000000004 2024-05-07T14:04:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956068+0000", 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9781999999999998e-05 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956087+0000", 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9009999999999999e-05 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956241+0000", 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015391600000000001 2024-05-07T14:04:08.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956640+0000", 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039917499999999999 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956860+0000", 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021961499999999999 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.967010+0000", 2024-05-07T14:04:08.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01015011 2024-05-07T14:04:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.977827+0000", 2024-05-07T14:04:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010817148 2024-05-07T14:04:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978012+0000", 2024-05-07T14:04:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018541 2024-05-07T14:04:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978161+0000", 2024-05-07T14:04:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014914600000000001 2024-05-07T14:04:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2808 3.2f 3:f7427dbd:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.105619+0000", 2024-05-07T14:04:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.820754059999999, 2024-05-07T14:04:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025705095000000001, 2024-05-07T14:04:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.976 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2808 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105619+0000", 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105619+0000", 2024-05-07T14:04:08.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105623+0000", 2024-05-07T14:04:08.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0799999999999999e-06 2024-05-07T14:04:08.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.110678+0000", 2024-05-07T14:04:08.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050544370000000002 2024-05-07T14:04:08.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.110724+0000", 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6004999999999997e-05 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.110747+0000", 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2813999999999999e-05 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.110926+0000", 2024-05-07T14:04:08.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000179679 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.111175+0000", 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024892099999999998 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.111411+0000", 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023604799999999999 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.130779+0000", 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019367497000000001 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.131130+0000", 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035130200000000001 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.131249+0000", 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000118434 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.131324+0000", 2024-05-07T14:04:08.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5877999999999994e-05 2024-05-07T14:04:08.982 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.982 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.982 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.982 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2815 3.2a 3:5644b81f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:08.982 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:08.982 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.751241570000001, 2024-05-07T14:04:08.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027617527999999999, 2024-05-07T14:04:08.982 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.982 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.983 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.983 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.983 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.983 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.983 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2815 2024-05-07T14:04:08.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.983 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:08.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175136+0000", 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7869999999999999e-06 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179183+0000", 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004047358 2024-05-07T14:04:08.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179215+0000", 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1919999999999999e-05 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179238+0000", 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3036000000000001e-05 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179367+0000", 2024-05-07T14:04:08.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128627 2024-05-07T14:04:08.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179613+0000", 2024-05-07T14:04:08.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024667500000000002 2024-05-07T14:04:08.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:08.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179847+0000", 2024-05-07T14:04:08.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000233668 2024-05-07T14:04:08.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.196418+0000", 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016571579999999999 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202617+0000", 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061980830000000001 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202688+0000", 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1481000000000002e-05 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202749+0000", 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1313000000000001e-05 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2861 3.22 3:479e234a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.538927+0000", 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.387446823000001, 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026733855000000001, 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.988 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2861 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.538927+0000", 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.538927+0000", 2024-05-07T14:04:08.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.538930+0000", 2024-05-07T14:04:08.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1300000000000001e-06 2024-05-07T14:04:08.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.542998+0000", 2024-05-07T14:04:08.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040679740000000002 2024-05-07T14:04:08.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543028+0000", 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0329999999999999e-05 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543046+0000", 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7825999999999998e-05 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543198+0000", 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000152223 2024-05-07T14:04:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543456+0000", 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025800399999999999 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.543704+0000", 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024830499999999999 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.555067+0000", 2024-05-07T14:04:08.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011362336000000001 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.565485+0000", 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010418627999999999 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.565578+0000", 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2255000000000004e-05 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:08.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.565660+0000", 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2843999999999995e-05 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2865 3.38 e105/21 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.341347078999998, 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032748549000000002, 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:08.994 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:08.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:08.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:08.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:08.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:08.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:08.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:08.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585029+0000", 2024-05-07T14:04:08.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9639999999999999e-06 2024-05-07T14:04:08.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589707+0000", 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046776889999999996 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589754+0000", 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7382000000000001e-05 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589780+0000", 2024-05-07T14:04:08.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5232000000000002e-05 2024-05-07T14:04:09.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589966+0000", 2024-05-07T14:04:09.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000186596 2024-05-07T14:04:09.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.590031+0000", 2024-05-07T14:04:09.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5038999999999999e-05 2024-05-07T14:04:09.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617527+0000", 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027496216 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617775+0000", 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247431 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2888 3.2 e105/46 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head v 105'8, mlcod=104'6)", 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.085284846, 2024-05-07T14:04:09.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.033929095999999999, 2024-05-07T14:04:09.002 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.002 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.002 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.002 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:09.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:09.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841091+0000", 2024-05-07T14:04:09.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.39e-06 2024-05-07T14:04:09.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.847981+0000", 2024-05-07T14:04:09.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068900630000000001 2024-05-07T14:04:09.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848020+0000", 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8846e-05 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848039+0000", 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848222+0000", 2024-05-07T14:04:09.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018251300000000001 2024-05-07T14:04:09.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848268+0000", 2024-05-07T14:04:09.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5552e-05 2024-05-07T14:04:09.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.874885+0000", 2024-05-07T14:04:09.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026617335999999998 2024-05-07T14:04:09.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.875018+0000", 2024-05-07T14:04:09.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013276999999999999 2024-05-07T14:04:09.006 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.006 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.006 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.006 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2894 3.16 3:6aec0fdf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:09.006 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:09.006 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.012638342999999, 2024-05-07T14:04:09.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029574030000000001, 2024-05-07T14:04:09.006 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.007 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.007 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.007 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.007 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.007 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.007 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2894 2024-05-07T14:04:09.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.007 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:09.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:09.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913738+0000", 2024-05-07T14:04:09.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.491e-06 2024-05-07T14:04:09.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917692+0000", 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039540799999999996 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917718+0000", 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6211e-05 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917732+0000", 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4487999999999999e-05 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917897+0000", 2024-05-07T14:04:09.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016455199999999999 2024-05-07T14:04:09.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918296+0000", 2024-05-07T14:04:09.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000398825 2024-05-07T14:04:09.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:09.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918724+0000", 2024-05-07T14:04:09.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042847399999999998 2024-05-07T14:04:09.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.933484+0000", 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014759959 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.942986+0000", 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095014739999999993 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943179+0000", 2024-05-07T14:04:09.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019320200000000001 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943309+0000", 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013027399999999999 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2896 3.3a 3:5f842f5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.991878679999999, 2024-05-07T14:04:09.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028429466, 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2896 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:09.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934498+0000", 2024-05-07T14:04:09.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.557e-06 2024-05-07T14:04:09.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939927+0000", 2024-05-07T14:04:09.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054289250000000002 2024-05-07T14:04:09.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939955+0000", 2024-05-07T14:04:09.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8245000000000001e-05 2024-05-07T14:04:09.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939971+0000", 2024-05-07T14:04:09.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.504e-05 2024-05-07T14:04:09.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940161+0000", 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019040499999999999 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940562+0000", 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040076800000000002 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940979+0000", 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041760099999999997 2024-05-07T14:04:09.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.950692+0000", 2024-05-07T14:04:09.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097127529999999993 2024-05-07T14:04:09.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962768+0000", 2024-05-07T14:04:09.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012075987 2024-05-07T14:04:09.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962863+0000", 2024-05-07T14:04:09.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5103000000000001e-05 2024-05-07T14:04:09.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962924+0000", 2024-05-07T14:04:09.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1081999999999996e-05 2024-05-07T14:04:09.018 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.018 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.018 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.018 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2908 3.3a 3:5d7a0a59:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 22.840527341000001, 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027562652999999999, 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2908 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085850+0000", 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.267e-06 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091371+0000", 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055205619999999997 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091411+0000", 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0365999999999999e-05 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091432+0000", 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0276e-05 2024-05-07T14:04:09.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091608+0000", 2024-05-07T14:04:09.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176653 2024-05-07T14:04:09.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.092025+0000", 2024-05-07T14:04:09.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041696799999999998 2024-05-07T14:04:09.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:09.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.092418+0000", 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000393099 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.102443+0000", 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010024798999999999 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113230+0000", 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010786963 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113330+0000", 2024-05-07T14:04:09.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9808000000000004e-05 2024-05-07T14:04:09.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113409+0000", 2024-05-07T14:04:09.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8892000000000003e-05 2024-05-07T14:04:09.024 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.024 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.024 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.024 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3197 3.d e113/21 3:b35829be:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_89:head v 113'16, mlcod=113'14)", 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.591194231, 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029081169, 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:09.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335182+0000", 2024-05-07T14:04:09.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7329999999999999e-06 2024-05-07T14:04:09.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338859+0000", 2024-05-07T14:04:09.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036773589999999998 2024-05-07T14:04:09.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338896+0000", 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6656000000000003e-05 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338922+0000", 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5936999999999999e-05 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339046+0000", 2024-05-07T14:04:09.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012458400000000001 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339089+0000", 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2342999999999998e-05 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.364123+0000", 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025034187999999999 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.364260+0000", 2024-05-07T14:04:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013736900000000001 2024-05-07T14:04:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3210 3.2f 3:f67c3789:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.459430475, 2024-05-07T14:04:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042403633000000003, 2024-05-07T14:04:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.029 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3210 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466947+0000", 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5669999999999999e-06 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471128+0000", 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041817620000000003 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471175+0000", 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6279000000000002e-05 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471200+0000", 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5177e-05 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471361+0000", 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160848 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471379+0000", 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8142e-05 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.479968+0000", 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085897040000000001 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.480366+0000", 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039736399999999999 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:09.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.480736+0000", 2024-05-07T14:04:09.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037031899999999998 2024-05-07T14:04:09.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.495479+0000", 2024-05-07T14:04:09.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014742992 2024-05-07T14:04:09.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509169+0000", 2024-05-07T14:04:09.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013690179 2024-05-07T14:04:09.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509268+0000", 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8814999999999995e-05 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509347+0000", 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8485000000000005e-05 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.035 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.036 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:09.037 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:04:09.038 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:09.051+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:09.138 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:09.147+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:09.176 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:09.176 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:09.177 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:09.177 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:09.190 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:04:09.284 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:09.295+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:09.294 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:04:09.340 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:09.351+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:09.369 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:09.369 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:09.369 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:09.369 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:09.369 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:09.386 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:04:09.426 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:04:09.472 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:09.487+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:09.478 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:09.479 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:09.502 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:09.502 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:09.525 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:09.526 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:09.542 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:09.555+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:09.553 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:09.554 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:09.561 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:09.561 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:09.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:09.561 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:09.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.561 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2207 3.26 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:09.562 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:09.562 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 66.231219088000003, 2024-05-07T14:04:09.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029257551999999999, 2024-05-07T14:04:09.562 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.562 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.562 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.562 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.562 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2207 2024-05-07T14:04:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:09.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338601+0000", 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0769999999999998e-06 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344166+0000", 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055649139999999998 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344203+0000", 2024-05-07T14:04:09.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7109e-05 2024-05-07T14:04:09.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344221+0000", 2024-05-07T14:04:09.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:04:09.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344394+0000", 2024-05-07T14:04:09.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000173208 2024-05-07T14:04:09.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344788+0000", 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039418400000000001 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345265+0000", 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047689299999999999 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365597+0000", 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020331954999999999 2024-05-07T14:04:09.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367512+0000", 2024-05-07T14:04:09.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001915237 2024-05-07T14:04:09.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367693+0000", 2024-05-07T14:04:09.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018108800000000001 2024-05-07T14:04:09.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367853+0000", 2024-05-07T14:04:09.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016028400000000001 2024-05-07T14:04:09.568 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.568 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.568 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.569 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2507 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [call rgw.bucket_list in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:09.569 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:09.569 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.154110549999999, 2024-05-07T14:04:09.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.019773713, 2024-05-07T14:04:09.569 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.569 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.569 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:09.570 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.570 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.570 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.570 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2507 2024-05-07T14:04:09.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.570 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:09.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415708+0000", 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4860000000000002e-06 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415724+0000", 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.643e-05 2024-05-07T14:04:09.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415759+0000", 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4252999999999999e-05 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415783+0000", 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4315999999999999e-05 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419072+0000", 2024-05-07T14:04:09.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032886119999999998 2024-05-07T14:04:09.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:09.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419099+0000", 2024-05-07T14:04:09.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6956000000000001e-05 2024-05-07T14:04:09.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435061+0000", 2024-05-07T14:04:09.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0159622509999999 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435231+0000", 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016978800000000001 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435478+0000", 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024762100000000001 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2686 3.34 e104/21 3:2ec0e822:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_3:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.820422+0000", 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.749392622999999, 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022287620000000001, 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820422+0000", 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820422+0000", 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820423+0000", 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.44e-07 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825658+0000", 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005235066 2024-05-07T14:04:09.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825692+0000", 2024-05-07T14:04:09.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4048999999999999e-05 2024-05-07T14:04:09.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825717+0000", 2024-05-07T14:04:09.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5216e-05 2024-05-07T14:04:09.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.826297+0000", 2024-05-07T14:04:09.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058014099999999995 2024-05-07T14:04:09.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.826353+0000", 2024-05-07T14:04:09.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5831999999999997e-05 2024-05-07T14:04:09.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.842559+0000", 2024-05-07T14:04:09.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016205768999999998 2024-05-07T14:04:09.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.842710+0000", 2024-05-07T14:04:09.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151003 2024-05-07T14:04:09.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.579 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.580 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2695 3.35 3:acf2d7d8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:09.580 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:09.580 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.668377796000001, 2024-05-07T14:04:09.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028454303, 2024-05-07T14:04:09.580 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.580 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.580 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.580 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.580 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.580 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.580 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2695 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901441+0000", 2024-05-07T14:04:09.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9600000000000002e-06 2024-05-07T14:04:09.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907573+0000", 2024-05-07T14:04:09.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061315939999999998 2024-05-07T14:04:09.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907630+0000", 2024-05-07T14:04:09.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6818999999999999e-05 2024-05-07T14:04:09.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907649+0000", 2024-05-07T14:04:09.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9859000000000001e-05 2024-05-07T14:04:09.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907857+0000", 2024-05-07T14:04:09.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000207159 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.908127+0000", 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027069099999999999 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.908468+0000", 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034104600000000001 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.918062+0000", 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095934409999999994 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929718+0000", 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011656141 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929819+0000", 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100634 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929892+0000", 2024-05-07T14:04:09.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2959000000000004e-05 2024-05-07T14:04:09.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.586 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.586 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2719 3.10 3:0b5df28b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:09.587 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:09.587 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.393287399999998, 2024-05-07T14:04:09.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028912935000000001, 2024-05-07T14:04:09.587 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.587 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.587 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.587 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.587 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.587 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.587 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2719 2024-05-07T14:04:09.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.587 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:09.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:09.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176531+0000", 2024-05-07T14:04:09.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3699999999999999e-06 2024-05-07T14:04:09.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182042+0000", 2024-05-07T14:04:09.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00551105 2024-05-07T14:04:09.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182083+0000", 2024-05-07T14:04:09.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1402000000000001e-05 2024-05-07T14:04:09.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182103+0000", 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9953e-05 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182262+0000", 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015816699999999999 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182545+0000", 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028303999999999997 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:09.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182779+0000", 2024-05-07T14:04:09.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023474800000000001 2024-05-07T14:04:09.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.195512+0000", 2024-05-07T14:04:09.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012733081 2024-05-07T14:04:09.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205013+0000", 2024-05-07T14:04:09.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095007670000000002 2024-05-07T14:04:09.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205264+0000", 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025112099999999998 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205441+0000", 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176236 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.593 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2734 3.a 3:5117726b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:09.594 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:09.594 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.241166373999999, 2024-05-07T14:04:09.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026910749000000001, 2024-05-07T14:04:09.594 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.594 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.594 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.594 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.594 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2734 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328652+0000", 2024-05-07T14:04:09.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9500000000000001e-06 2024-05-07T14:04:09.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333686+0000", 2024-05-07T14:04:09.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050342010000000003 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333726+0000", 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9802000000000003e-05 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333753+0000", 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7702999999999999e-05 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333900+0000", 2024-05-07T14:04:09.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014663999999999999 2024-05-07T14:04:09.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.334151+0000", 2024-05-07T14:04:09.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025143799999999999 2024-05-07T14:04:09.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:09.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.334390+0000", 2024-05-07T14:04:09.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000238268 2024-05-07T14:04:09.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.346870+0000", 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012480753000000001 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355331+0000", 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084610090000000002 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355483+0000", 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015194000000000001 2024-05-07T14:04:09.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355559+0000", 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6044999999999994e-05 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2786 3.20 3:043afb92:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.697942652000002, 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026616246, 2024-05-07T14:04:09.600 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.601 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.601 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.601 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.601 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.601 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.601 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2786 2024-05-07T14:04:09.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.602 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:09.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:09.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871877+0000", 2024-05-07T14:04:09.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2969999999999997e-06 2024-05-07T14:04:09.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876185+0000", 2024-05-07T14:04:09.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004308503 2024-05-07T14:04:09.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876223+0000", 2024-05-07T14:04:09.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7852000000000003e-05 2024-05-07T14:04:09.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876242+0000", 2024-05-07T14:04:09.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9253999999999999e-05 2024-05-07T14:04:09.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876395+0000", 2024-05-07T14:04:09.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015306599999999999 2024-05-07T14:04:09.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876685+0000", 2024-05-07T14:04:09.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028964699999999997 2024-05-07T14:04:09.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:09.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876925+0000", 2024-05-07T14:04:09.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023967500000000001 2024-05-07T14:04:09.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.885744+0000", 2024-05-07T14:04:09.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008819749 2024-05-07T14:04:09.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898308+0000", 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012563710000000001 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898410+0000", 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101582 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898489+0000", 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8911000000000004e-05 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.608 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.609 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2807 3.3f e105/21 3:fd0db1b2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_124:head v 105'6, mlcod=85'4)", 2024-05-07T14:04:09.609 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:09.609 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.468862853000001, 2024-05-07T14:04:09.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026784641000000001, 2024-05-07T14:04:09.609 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.609 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.609 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.609 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:09.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:09.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100955+0000", 2024-05-07T14:04:09.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8200000000000001e-06 2024-05-07T14:04:09.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105915+0000", 2024-05-07T14:04:09.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049600290000000003 2024-05-07T14:04:09.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105956+0000", 2024-05-07T14:04:09.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1205000000000003e-05 2024-05-07T14:04:09.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105973+0000", 2024-05-07T14:04:09.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7087000000000001e-05 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.106125+0000", 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015208299999999999 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.106192+0000", 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6809000000000004e-05 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.127628+0000", 2024-05-07T14:04:09.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02143579 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.127737+0000", 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000108818 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2828 3.2c 3:37c1d26d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.206105+0000", 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.363710046000001, 2024-05-07T14:04:09.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023644783999999999, 2024-05-07T14:04:09.614 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.614 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.614 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.614 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.614 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.614 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.614 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2828 2024-05-07T14:04:09.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.614 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.206105+0000", 2024-05-07T14:04:09.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.206105+0000", 2024-05-07T14:04:09.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.206109+0000", 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5939999999999998e-06 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.212890+0000", 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067816780000000002 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.212936+0000", 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5535999999999999e-05 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.212960+0000", 2024-05-07T14:04:09.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4685000000000002e-05 2024-05-07T14:04:09.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.213165+0000", 2024-05-07T14:04:09.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020478299999999999 2024-05-07T14:04:09.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.213570+0000", 2024-05-07T14:04:09.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040477800000000001 2024-05-07T14:04:09.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:09.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.213999+0000", 2024-05-07T14:04:09.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042946 2024-05-07T14:04:09.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.227004+0000", 2024-05-07T14:04:09.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013004946999999999 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.229490+0000", 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024852120000000001 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.229634+0000", 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144074 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.229750+0000", 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116037 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2829 3.35 3:aeb9f674:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.217157+0000", 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.352658491, 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022531881, 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.620 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2829 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.217157+0000", 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.217157+0000", 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.217159+0000", 2024-05-07T14:04:09.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.531e-06 2024-05-07T14:04:09.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221183+0000", 2024-05-07T14:04:09.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040234559999999999 2024-05-07T14:04:09.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221218+0000", 2024-05-07T14:04:09.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5602000000000002e-05 2024-05-07T14:04:09.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221235+0000", 2024-05-07T14:04:09.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6948000000000001e-05 2024-05-07T14:04:09.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221367+0000", 2024-05-07T14:04:09.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013174199999999999 2024-05-07T14:04:09.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221629+0000", 2024-05-07T14:04:09.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026224400000000002 2024-05-07T14:04:09.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:09.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221852+0000", 2024-05-07T14:04:09.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022335599999999999 2024-05-07T14:04:09.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.238414+0000", 2024-05-07T14:04:09.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016561306000000001 2024-05-07T14:04:09.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.239379+0000", 2024-05-07T14:04:09.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00096533899999999995 2024-05-07T14:04:09.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.239557+0000", 2024-05-07T14:04:09.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177916 2024-05-07T14:04:09.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.239688+0000", 2024-05-07T14:04:09.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013144099999999999 2024-05-07T14:04:09.627 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.627 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.627 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.627 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2851 3.35 3:aedd2f32:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:09.627 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.437038+0000", 2024-05-07T14:04:09.627 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.132776796000002, 2024-05-07T14:04:09.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023592841, 2024-05-07T14:04:09.627 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.627 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.627 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.628 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.628 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.628 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.628 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2851 2024-05-07T14:04:09.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.628 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.437038+0000", 2024-05-07T14:04:09.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.437038+0000", 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.437042+0000", 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6899999999999998e-06 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443186+0000", 2024-05-07T14:04:09.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006144137 2024-05-07T14:04:09.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443240+0000", 2024-05-07T14:04:09.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4061000000000003e-05 2024-05-07T14:04:09.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443268+0000", 2024-05-07T14:04:09.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7843000000000001e-05 2024-05-07T14:04:09.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443448+0000", 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018044 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443858+0000", 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040941399999999998 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.444268+0000", 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041045799999999999 2024-05-07T14:04:09.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453481+0000", 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092126599999999993 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460427+0000", 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069463989999999998 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460519+0000", 2024-05-07T14:04:09.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1778000000000001e-05 2024-05-07T14:04:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460631+0000", 2024-05-07T14:04:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011196099999999999 2024-05-07T14:04:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2852 3.26 3:6683f345:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.446514+0000", 2024-05-07T14:04:09.633 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 24.123300975999999, 2024-05-07T14:04:09.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022598677000000001, 2024-05-07T14:04:09.634 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.634 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.634 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.634 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.634 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.634 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.634 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2852 2024-05-07T14:04:09.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.634 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.446514+0000", 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.446514+0000", 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.446517+0000", 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7199999999999998e-06 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453133+0000", 2024-05-07T14:04:09.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066160769999999997 2024-05-07T14:04:09.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453162+0000", 2024-05-07T14:04:09.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.921e-05 2024-05-07T14:04:09.636 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.636 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453179+0000", 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7266e-05 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453334+0000", 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000154253 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453706+0000", 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037270400000000001 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:09.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.454035+0000", 2024-05-07T14:04:09.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032850099999999998 2024-05-07T14:04:09.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.462913+0000", 2024-05-07T14:04:09.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088785270000000006 2024-05-07T14:04:09.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.468949+0000", 2024-05-07T14:04:09.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060357450000000003 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.469023+0000", 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4406000000000006e-05 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.469113+0000", 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9268e-05 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.640 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2902 3.10 3:0b53d764:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:09.640 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.012188+0000", 2024-05-07T14:04:09.640 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.557627316000001, 2024-05-07T14:04:09.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023745938000000001, 2024-05-07T14:04:09.640 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.640 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.640 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.640 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.640 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.640 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.640 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2902 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.012188+0000", 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.012188+0000", 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.012190+0000", 2024-05-07T14:04:09.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2680000000000001e-06 2024-05-07T14:04:09.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017271+0000", 2024-05-07T14:04:09.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050807179999999997 2024-05-07T14:04:09.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017301+0000", 2024-05-07T14:04:09.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0354000000000001e-05 2024-05-07T14:04:09.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017317+0000", 2024-05-07T14:04:09.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6388e-05 2024-05-07T14:04:09.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017445+0000", 2024-05-07T14:04:09.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012714000000000001 2024-05-07T14:04:09.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017761+0000", 2024-05-07T14:04:09.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031622699999999998 2024-05-07T14:04:09.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:09.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.018089+0000", 2024-05-07T14:04:09.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000328093 2024-05-07T14:04:09.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.030270+0000", 2024-05-07T14:04:09.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012180679999999999 2024-05-07T14:04:09.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.035653+0000", 2024-05-07T14:04:09.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053833900000000001 2024-05-07T14:04:09.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.035818+0000", 2024-05-07T14:04:09.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016458600000000001 2024-05-07T14:04:09.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.035934+0000", 2024-05-07T14:04:09.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116094 2024-05-07T14:04:09.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.646 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.647 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2912 3.36 3:6fcd222f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:09.647 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:09.647 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.431386792000001, 2024-05-07T14:04:09.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02818507, 2024-05-07T14:04:09.647 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.647 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.647 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.648 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.648 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.648 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.648 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2912 2024-05-07T14:04:09.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.648 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:09.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:09.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138433+0000", 2024-05-07T14:04:09.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0069999999999997e-06 2024-05-07T14:04:09.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.143973+0000", 2024-05-07T14:04:09.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055392719999999996 2024-05-07T14:04:09.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144024+0000", 2024-05-07T14:04:09.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1128999999999998e-05 2024-05-07T14:04:09.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144044+0000", 2024-05-07T14:04:09.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0526e-05 2024-05-07T14:04:09.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144267+0000", 2024-05-07T14:04:09.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022246500000000001 2024-05-07T14:04:09.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144532+0000", 2024-05-07T14:04:09.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026575900000000001 2024-05-07T14:04:09.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:09.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144805+0000", 2024-05-07T14:04:09.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027290000000000002 2024-05-07T14:04:09.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.162814+0000", 2024-05-07T14:04:09.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018008631000000001 2024-05-07T14:04:09.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166347+0000", 2024-05-07T14:04:09.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035334429999999998 2024-05-07T14:04:09.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166490+0000", 2024-05-07T14:04:09.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014308699999999999 2024-05-07T14:04:09.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166613+0000", 2024-05-07T14:04:09.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012285099999999999 2024-05-07T14:04:09.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.658 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.658 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2918 3.10 3:0a57f05a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:09.658 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:09.659 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.363003204000002, 2024-05-07T14:04:09.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030233789, 2024-05-07T14:04:09.659 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.659 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.659 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.659 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.659 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.660 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2918 2024-05-07T14:04:09.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.660 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:09.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:09.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206816+0000", 2024-05-07T14:04:09.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6229999999999996e-06 2024-05-07T14:04:09.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.210992+0000", 2024-05-07T14:04:09.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041755799999999999 2024-05-07T14:04:09.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211043+0000", 2024-05-07T14:04:09.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0584999999999998e-05 2024-05-07T14:04:09.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211070+0000", 2024-05-07T14:04:09.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7716999999999999e-05 2024-05-07T14:04:09.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211251+0000", 2024-05-07T14:04:09.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000180683 2024-05-07T14:04:09.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211678+0000", 2024-05-07T14:04:09.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042701099999999998 2024-05-07T14:04:09.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:09.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.212087+0000", 2024-05-07T14:04:09.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040911799999999998 2024-05-07T14:04:09.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.222312+0000", 2024-05-07T14:04:09.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010224551 2024-05-07T14:04:09.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.236912+0000", 2024-05-07T14:04:09.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014600548 2024-05-07T14:04:09.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.236982+0000", 2024-05-07T14:04:09.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9476999999999999e-05 2024-05-07T14:04:09.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.237046+0000", 2024-05-07T14:04:09.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3895999999999999e-05 2024-05-07T14:04:09.667 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.667 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.667 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3198 3.2c 3:34ce24fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 2.2299008389999999, 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026711016000000001, 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3198 2024-05-07T14:04:09.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339918+0000", 2024-05-07T14:04:09.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000001e-06 2024-05-07T14:04:09.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.343982+0000", 2024-05-07T14:04:09.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040642320000000001 2024-05-07T14:04:09.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344027+0000", 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024999999999997e-05 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344052+0000", 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4603000000000001e-05 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344190+0000", 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013819 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344377+0000", 2024-05-07T14:04:09.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018666200000000001 2024-05-07T14:04:09.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:09.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344585+0000", 2024-05-07T14:04:09.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000208452 2024-05-07T14:04:09.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.362586+0000", 2024-05-07T14:04:09.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018000754000000001 2024-05-07T14:04:09.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366457+0000", 2024-05-07T14:04:09.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003871542 2024-05-07T14:04:09.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366546+0000", 2024-05-07T14:04:09.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8601000000000001e-05 2024-05-07T14:04:09.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366625+0000", 2024-05-07T14:04:09.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9272999999999998e-05 2024-05-07T14:04:09.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.674 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.674 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3208 3.26 3:66fd0e21:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:09.674 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:09.675 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 2.1205624950000002, 2024-05-07T14:04:09.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041868750000000003, 2024-05-07T14:04:09.675 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.675 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.675 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.675 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.675 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.675 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.675 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3208 2024-05-07T14:04:09.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.675 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449257+0000", 2024-05-07T14:04:09.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.07e-06 2024-05-07T14:04:09.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455814+0000", 2024-05-07T14:04:09.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065570660000000003 2024-05-07T14:04:09.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455854+0000", 2024-05-07T14:04:09.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0819999999999999e-05 2024-05-07T14:04:09.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455874+0000", 2024-05-07T14:04:09.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9993e-05 2024-05-07T14:04:09.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.456063+0000", 2024-05-07T14:04:09.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018892400000000001 2024-05-07T14:04:09.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:09.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.456077+0000", 2024-05-07T14:04:09.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3433e-05 2024-05-07T14:04:09.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.462635+0000", 2024-05-07T14:04:09.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065577869999999998 2024-05-07T14:04:09.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.462869+0000", 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023394299999999999 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.463127+0000", 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0002588 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.473024+0000", 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0098969100000000001 2024-05-07T14:04:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.490912+0000", 2024-05-07T14:04:09.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017887291 2024-05-07T14:04:09.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.491010+0000", 2024-05-07T14:04:09.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8041999999999994e-05 2024-05-07T14:04:09.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.491121+0000", 2024-05-07T14:04:09.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111671 2024-05-07T14:04:09.682 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.682 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.682 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.682 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3214 3.2c 3:36c50e70:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:09.682 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.505220+0000", 2024-05-07T14:04:09.682 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 2.0645953989999999, 2024-05-07T14:04:09.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022100794999999999, 2024-05-07T14:04:09.682 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.682 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.683 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.683 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.683 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3214 2024-05-07T14:04:09.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.683 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.505220+0000", 2024-05-07T14:04:09.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.505220+0000", 2024-05-07T14:04:09.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.505224+0000", 2024-05-07T14:04:09.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4560000000000002e-06 2024-05-07T14:04:09.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510370+0000", 2024-05-07T14:04:09.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051455140000000003 2024-05-07T14:04:09.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510407+0000", 2024-05-07T14:04:09.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7902999999999999e-05 2024-05-07T14:04:09.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510424+0000", 2024-05-07T14:04:09.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6840000000000001e-05 2024-05-07T14:04:09.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510580+0000", 2024-05-07T14:04:09.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015549100000000001 2024-05-07T14:04:09.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510839+0000", 2024-05-07T14:04:09.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025945299999999998 2024-05-07T14:04:09.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:09.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.511096+0000", 2024-05-07T14:04:09.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025659899999999999 2024-05-07T14:04:09.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.524699+0000", 2024-05-07T14:04:09.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013603373 2024-05-07T14:04:09.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.527137+0000", 2024-05-07T14:04:09.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024377610000000001 2024-05-07T14:04:09.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.527245+0000", 2024-05-07T14:04:09.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107792 2024-05-07T14:04:09.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.527320+0000", 2024-05-07T14:04:09.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5612999999999996e-05 2024-05-07T14:04:09.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.689 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.690 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.690 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3230 3.35 3:af7e1017:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:09.690 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.683889+0000", 2024-05-07T14:04:09.690 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.8859263689999999, 2024-05-07T14:04:09.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024914794000000001, 2024-05-07T14:04:09.690 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.690 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.690 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.691 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:09.691 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:09.691 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:09.691 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3230 2024-05-07T14:04:09.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.691 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.683889+0000", 2024-05-07T14:04:09.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.683889+0000", 2024-05-07T14:04:09.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.683893+0000", 2024-05-07T14:04:09.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8339999999999998e-06 2024-05-07T14:04:09.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689114+0000", 2024-05-07T14:04:09.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005220616 2024-05-07T14:04:09.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689172+0000", 2024-05-07T14:04:09.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7479000000000003e-05 2024-05-07T14:04:09.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689189+0000", 2024-05-07T14:04:09.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.766e-05 2024-05-07T14:04:09.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689318+0000", 2024-05-07T14:04:09.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012900499999999999 2024-05-07T14:04:09.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689573+0000", 2024-05-07T14:04:09.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025489600000000001 2024-05-07T14:04:09.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:09.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689808+0000", 2024-05-07T14:04:09.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023451 2024-05-07T14:04:09.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:09.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.698461+0000", 2024-05-07T14:04:09.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086537990000000002 2024-05-07T14:04:09.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:09.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.708562+0000", 2024-05-07T14:04:09.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010100052 2024-05-07T14:04:09.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.708728+0000", 2024-05-07T14:04:09.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000166214 2024-05-07T14:04:09.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.708803+0000", 2024-05-07T14:04:09.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5729000000000006e-05 2024-05-07T14:04:09.697 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.697 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.697 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.697 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3240 3.33 e114/21 3:cd111f2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_132:head v 114'8, mlcod=85'6)", 2024-05-07T14:04:09.698 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.792225+0000", 2024-05-07T14:04:09.698 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7775900930000001, 2024-05-07T14:04:09.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022016482, 2024-05-07T14:04:09.698 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:09.698 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:09.698 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:09.698 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:09.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:09.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.792225+0000", 2024-05-07T14:04:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.792225+0000", 2024-05-07T14:04:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.792225+0000", 2024-05-07T14:04:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4600000000000005e-07 2024-05-07T14:04:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.796796+0000", 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045708329999999998 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.796832+0000", 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5549000000000001e-05 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.796854+0000", 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.181e-05 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:09.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.797013+0000", 2024-05-07T14:04:09.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015973100000000001 2024-05-07T14:04:09.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:09.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.797079+0000", 2024-05-07T14:04:09.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5943000000000002e-05 2024-05-07T14:04:09.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:09.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.814088+0000", 2024-05-07T14:04:09.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017008629000000001 2024-05-07T14:04:09.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:09.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:09.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:09.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.814241+0000", 2024-05-07T14:04:09.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015344100000000001 2024-05-07T14:04:09.702 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.702 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.702 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.702 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:09.702 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:09.703 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:09.703 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:09.704 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:09.705 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:09.705 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:09.705 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:04:09.706 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:09.706 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:09.707 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:04:09.707 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:04:09.707 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:09.715+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:09.805 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:09.819+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:09.869 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:09.869 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:09.887 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:04:09.932 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:09.943+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:10.007 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:10.015+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:10.036 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:10.036 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:10.056 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:04:10.144 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:10.155+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:10.210 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:10.223+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:10.237 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:10.237 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:10.253 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:04:10.311 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:10.319+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:10.391 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:04:10.409 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:10.409 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:10.413 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:10.423+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:10.438 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:04:10.512 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:10.523+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:10.591 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:10.591 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:10.611 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:04:10.616 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:10.627+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:10.713 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:10.727+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:10.761 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:10.761 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:10.777 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:04:10.820 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:10.835+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:10.915 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:10.927+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:10.961 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:10.961 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:10.979 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:04:11.021 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:11.035+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:11.116 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:11.131+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:11.159 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:11.159 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:11.180 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:04:11.217 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:11.227+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:11.318 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:11.327+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:11.367 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:11.367 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:11.386 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:04:11.432 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:11.447+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:11.519 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:11.527+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:11.532 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:11.533 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:11.558 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:04:11.644 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:11.659+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:11.709 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:04:11.721 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:11.731+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:11.743 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:11.743 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:11.766 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:04:11.852 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:11.867+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:11.880 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:11.880 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:11.907 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:11.907 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:11.923 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:11.935+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:11.928 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:11.929 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:11.955 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:11.955 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:11.968 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:11.968 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:11.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:11.969 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:11.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.969 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2202 3.0 e84/21 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head v 84'1, mlcod=0'0)", 2024-05-07T14:04:11.969 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:04:11.969 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 68.694312424000003, 2024-05-07T14:04:11.969 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020120560999999999, 2024-05-07T14:04:11.969 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:11.969 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:11.969 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:11.970 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:11.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:11.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:04:11.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:11.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.970 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:11.970 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:04:11.970 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:11.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:11.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286676+0000", 2024-05-07T14:04:11.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.57e-06 2024-05-07T14:04:11.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:11.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291894+0000", 2024-05-07T14:04:11.971 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052185740000000001 2024-05-07T14:04:11.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.971 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:11.971 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291939+0000", 2024-05-07T14:04:11.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4676999999999999e-05 2024-05-07T14:04:11.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:11.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291959+0000", 2024-05-07T14:04:11.972 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0115999999999998e-05 2024-05-07T14:04:11.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.972 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:11.972 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292128+0000", 2024-05-07T14:04:11.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168758 2024-05-07T14:04:11.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:11.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292188+0000", 2024-05-07T14:04:11.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0565e-05 2024-05-07T14:04:11.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.973 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:11.973 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306607+0000", 2024-05-07T14:04:11.973 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014418733 2024-05-07T14:04:11.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.974 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:11.974 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306794+0000", 2024-05-07T14:04:11.974 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018656799999999999 2024-05-07T14:04:11.974 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:11.974 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:11.974 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:11.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.974 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2687 3.2 3:43af9208:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:11.974 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:04:11.975 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.162444356999998, 2024-05-07T14:04:11.975 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037068531000000002, 2024-05-07T14:04:11.975 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:11.975 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:11.975 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:11.975 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:11.975 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:11.975 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:11.975 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2687 2024-05-07T14:04:11.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.976 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:11.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:11.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:04:11.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:11.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.976 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:11.976 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:04:11.976 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:11.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:11.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818544+0000", 2024-05-07T14:04:11.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3390000000000001e-06 2024-05-07T14:04:11.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.977 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:11.977 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821166+0000", 2024-05-07T14:04:11.977 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026214250000000001 2024-05-07T14:04:11.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:11.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821192+0000", 2024-05-07T14:04:11.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5641999999999999e-05 2024-05-07T14:04:11.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.978 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:11.978 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821203+0000", 2024-05-07T14:04:11.978 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1558e-05 2024-05-07T14:04:11.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:11.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821280+0000", 2024-05-07T14:04:11.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7237000000000006e-05 2024-05-07T14:04:11.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:11.979 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821288+0000", 2024-05-07T14:04:11.979 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0930000000000003e-06 2024-05-07T14:04:11.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.979 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:11.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823694+0000", 2024-05-07T14:04:11.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024052850000000001 2024-05-07T14:04:11.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:11.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823853+0000", 2024-05-07T14:04:11.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015879800000000001 2024-05-07T14:04:11.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.980 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:11.980 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823991+0000", 2024-05-07T14:04:11.980 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013879100000000001 2024-05-07T14:04:11.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:11.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.832834+0000", 2024-05-07T14:04:11.981 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088427109999999996 2024-05-07T14:04:11.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.981 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:11.981 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855474+0000", 2024-05-07T14:04:11.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022640304 2024-05-07T14:04:11.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:11.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855553+0000", 2024-05-07T14:04:11.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8994999999999998e-05 2024-05-07T14:04:11.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.982 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:11.982 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855610+0000", 2024-05-07T14:04:11.982 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6353000000000001e-05 2024-05-07T14:04:11.982 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:11.983 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:11.983 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:11.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.983 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2707 3.17 3:e87c5034:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:11.983 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:04:11.983 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.944430650000001, 2024-05-07T14:04:11.983 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017998984999999999, 2024-05-07T14:04:11.983 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:11.983 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:11.983 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:11.984 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:11.984 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:11.984 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:11.984 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2707 2024-05-07T14:04:11.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.984 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:11.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.984 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:11.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:04:11.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:11.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:11.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036555+0000", 2024-05-07T14:04:11.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:11.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.985 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:11.985 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.036558+0000", 2024-05-07T14:04:11.985 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8030000000000001e-06 2024-05-07T14:04:11.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.986 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:11.986 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038073+0000", 2024-05-07T14:04:11.986 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001514872 2024-05-07T14:04:11.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:11.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038093+0000", 2024-05-07T14:04:11.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0023000000000001e-05 2024-05-07T14:04:11.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:11.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038102+0000", 2024-05-07T14:04:11.987 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3389999999999999e-06 2024-05-07T14:04:11.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.987 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:11.987 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038183+0000", 2024-05-07T14:04:11.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1050999999999994e-05 2024-05-07T14:04:11.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:11.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038309+0000", 2024-05-07T14:04:11.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012564400000000001 2024-05-07T14:04:11.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.988 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:11.988 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.038401+0000", 2024-05-07T14:04:11.988 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2826999999999997e-05 2024-05-07T14:04:11.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.989 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:11.989 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.046066+0000", 2024-05-07T14:04:11.989 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007664761 2024-05-07T14:04:11.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:11.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054423+0000", 2024-05-07T14:04:11.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0083565310000000004 2024-05-07T14:04:11.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:11.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054497+0000", 2024-05-07T14:04:11.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4302999999999997e-05 2024-05-07T14:04:11.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.991 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:11.991 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.054554+0000", 2024-05-07T14:04:11.991 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6830999999999998e-05 2024-05-07T14:04:11.992 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:11.992 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:11.992 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:11.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.992 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2722 3.2e 3:75db52c2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:11.992 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:04:11.992 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.775155832999999, 2024-05-07T14:04:11.992 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019780314, 2024-05-07T14:04:11.992 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:11.992 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:11.992 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:11.992 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:11.993 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:11.993 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:11.993 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2722 2024-05-07T14:04:11.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.993 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:11.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:11.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:04:11.993 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:11.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.993 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:11.993 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:04:11.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:11.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:11.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205833+0000", 2024-05-07T14:04:11.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3289999999999998e-06 2024-05-07T14:04:11.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.994 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:11.994 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207811+0000", 2024-05-07T14:04:11.994 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019781529999999999 2024-05-07T14:04:11.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:11.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207829+0000", 2024-05-07T14:04:11.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7402999999999999e-05 2024-05-07T14:04:11.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:11.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207838+0000", 2024-05-07T14:04:11.995 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0210000000000005e-06 2024-05-07T14:04:11.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.995 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:11.995 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207902+0000", 2024-05-07T14:04:11.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4406000000000006e-05 2024-05-07T14:04:11.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:11.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208094+0000", 2024-05-07T14:04:11.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000191626 2024-05-07T14:04:11.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.996 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:11.996 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208250+0000", 2024-05-07T14:04:11.996 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156064 2024-05-07T14:04:11.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:11.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.219242+0000", 2024-05-07T14:04:11.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010992696999999999 2024-05-07T14:04:11.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:11.997 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225500+0000", 2024-05-07T14:04:11.997 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.006257182 2024-05-07T14:04:11.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.997 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:11.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225550+0000", 2024-05-07T14:04:11.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0173999999999998e-05 2024-05-07T14:04:11.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.998 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:11.998 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225610+0000", 2024-05-07T14:04:11.998 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0259e-05 2024-05-07T14:04:11.998 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:11.998 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:11.998 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:11.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:11.999 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2735 3.2 3:4399fdca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:11.999 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:04:11.999 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.642880081000001, 2024-05-07T14:04:11.999 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017836129999999999, 2024-05-07T14:04:11.999 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:11.999 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:11.999 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:11.999 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:11.999 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:11.999 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:11.999 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2735 2024-05-07T14:04:11.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:11.999 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:04:12.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338105+0000", 2024-05-07T14:04:12.000 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.000 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.000 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.338108+0000", 2024-05-07T14:04:12.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0110000000000001e-06 2024-05-07T14:04:12.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339842+0000", 2024-05-07T14:04:12.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017333330000000001 2024-05-07T14:04:12.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.001 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.001 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339870+0000", 2024-05-07T14:04:12.001 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7875999999999999e-05 2024-05-07T14:04:12.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339884+0000", 2024-05-07T14:04:12.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4678000000000001e-05 2024-05-07T14:04:12.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.339984+0000", 2024-05-07T14:04:12.002 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.9283999999999993e-05 2024-05-07T14:04:12.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.002 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.002 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.340096+0000", 2024-05-07T14:04:12.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112272 2024-05-07T14:04:12.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:12.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.340201+0000", 2024-05-07T14:04:12.003 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010467999999999999 2024-05-07T14:04:12.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.003 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.003 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.345876+0000", 2024-05-07T14:04:12.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056758260000000001 2024-05-07T14:04:12.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355805+0000", 2024-05-07T14:04:12.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099281679999999994 2024-05-07T14:04:12.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.004 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.004 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355883+0000", 2024-05-07T14:04:12.004 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8287000000000004e-05 2024-05-07T14:04:12.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.005 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.005 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.355942+0000", 2024-05-07T14:04:12.005 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8715000000000003e-05 2024-05-07T14:04:12.005 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.005 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.005 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.005 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2773 3.17 3:e87231b1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:12.005 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:04:12.006 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.262524164999999, 2024-05-07T14:04:12.006 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028454317, 2024-05-07T14:04:12.006 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.006 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.006 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.006 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.006 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.006 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.006 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2773 2024-05-07T14:04:12.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.006 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718465+0000", 2024-05-07T14:04:12.007 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3680000000000002e-06 2024-05-07T14:04:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729580+0000", 2024-05-07T14:04:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011115776000000001 2024-05-07T14:04:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729608+0000", 2024-05-07T14:04:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7617e-05 2024-05-07T14:04:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729622+0000", 2024-05-07T14:04:12.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3528e-05 2024-05-07T14:04:12.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729694+0000", 2024-05-07T14:04:12.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2630000000000001e-05 2024-05-07T14:04:12.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.009 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.009 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729812+0000", 2024-05-07T14:04:12.009 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118132 2024-05-07T14:04:12.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:12.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729913+0000", 2024-05-07T14:04:12.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100486 2024-05-07T14:04:12.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.744465+0000", 2024-05-07T14:04:12.010 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014551768 2024-05-07T14:04:12.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.010 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.010 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746795+0000", 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023300270000000001 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746865+0000", 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0322999999999997e-05 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746916+0000", 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0661999999999997e-05 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.011 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.012 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2784 3.17 3:e9b6a230:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:12.012 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:04:12.012 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.130228577, 2024-05-07T14:04:12.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027214069, 2024-05-07T14:04:12.012 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.012 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.012 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.012 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.012 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.012 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.013 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2784 2024-05-07T14:04:12.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.013 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:04:12.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.013 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.013 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:04:12.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850760+0000", 2024-05-07T14:04:12.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0970000000000002e-06 2024-05-07T14:04:12.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853165+0000", 2024-05-07T14:04:12.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002405309 2024-05-07T14:04:12.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853186+0000", 2024-05-07T14:04:12.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0727999999999999e-05 2024-05-07T14:04:12.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853196+0000", 2024-05-07T14:04:12.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0159e-05 2024-05-07T14:04:12.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853277+0000", 2024-05-07T14:04:12.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0519999999999995e-05 2024-05-07T14:04:12.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.016 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853440+0000", 2024-05-07T14:04:12.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016281299999999999 2024-05-07T14:04:12.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:12.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853608+0000", 2024-05-07T14:04:12.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168126 2024-05-07T14:04:12.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.860132+0000", 2024-05-07T14:04:12.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065242379999999999 2024-05-07T14:04:12.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877848+0000", 2024-05-07T14:04:12.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017716251999999998 2024-05-07T14:04:12.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877919+0000", 2024-05-07T14:04:12.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.127e-05 2024-05-07T14:04:12.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877971+0000", 2024-05-07T14:04:12.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1557000000000001e-05 2024-05-07T14:04:12.019 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.019 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.019 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.019 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2789 3.2 3:434a8bbf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:12.020 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:04:12.020 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.074539359999999, 2024-05-07T14:04:12.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025228071000000001, 2024-05-07T14:04:12.020 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.020 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.020 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.020 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.020 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.020 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.020 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2789 2024-05-07T14:04:12.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.020 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906450+0000", 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5149999999999998e-06 2024-05-07T14:04:12.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908568+0000", 2024-05-07T14:04:12.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021184279999999999 2024-05-07T14:04:12.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908593+0000", 2024-05-07T14:04:12.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5043999999999999e-05 2024-05-07T14:04:12.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908607+0000", 2024-05-07T14:04:12.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3716999999999999e-05 2024-05-07T14:04:12.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908686+0000", 2024-05-07T14:04:12.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9492000000000004e-05 2024-05-07T14:04:12.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908818+0000", 2024-05-07T14:04:12.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013199199999999999 2024-05-07T14:04:12.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:12.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908952+0000", 2024-05-07T14:04:12.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013385400000000001 2024-05-07T14:04:12.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.916238+0000", 2024-05-07T14:04:12.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072861810000000001 2024-05-07T14:04:12.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931560+0000", 2024-05-07T14:04:12.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01532122 2024-05-07T14:04:12.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931620+0000", 2024-05-07T14:04:12.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0448000000000001e-05 2024-05-07T14:04:12.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931674+0000", 2024-05-07T14:04:12.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.418e-05 2024-05-07T14:04:12.026 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.026 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.026 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.027 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2799 3.9 e105/21 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:12.027 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:12.027 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.963164559999999, 2024-05-07T14:04:12.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021236735, 2024-05-07T14:04:12.027 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.027 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.027 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.027 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:12.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:12.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:12.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.75e-07 2024-05-07T14:04:12.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024399+0000", 2024-05-07T14:04:12.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065773769999999997 2024-05-07T14:04:12.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024434+0000", 2024-05-07T14:04:12.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4884e-05 2024-05-07T14:04:12.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024450+0000", 2024-05-07T14:04:12.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6181999999999999e-05 2024-05-07T14:04:12.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024523+0000", 2024-05-07T14:04:12.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3054999999999998e-05 2024-05-07T14:04:12.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024550+0000", 2024-05-07T14:04:12.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6735000000000001e-05 2024-05-07T14:04:12.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.038754+0000", 2024-05-07T14:04:12.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014204543 2024-05-07T14:04:12.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.039058+0000", 2024-05-07T14:04:12.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030348400000000002 2024-05-07T14:04:12.032 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.032 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.032 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.033 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2802 3.13 3:c8761262:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:12.033 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:04:12.033 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.937735195999998, 2024-05-07T14:04:12.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026174424000000002, 2024-05-07T14:04:12.033 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.033 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.033 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.033 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.033 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.033 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.033 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2802 2024-05-07T14:04:12.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.033 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:04:12.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:04:12.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043253+0000", 2024-05-07T14:04:12.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7030000000000002e-06 2024-05-07T14:04:12.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045330+0000", 2024-05-07T14:04:12.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020765139999999998 2024-05-07T14:04:12.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045352+0000", 2024-05-07T14:04:12.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2532e-05 2024-05-07T14:04:12.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045363+0000", 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0798000000000001e-05 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045446+0000", 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3592999999999997e-05 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045641+0000", 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019462900000000001 2024-05-07T14:04:12.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045809+0000", 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168312 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.054070+0000", 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082602100000000005 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069299+0000", 2024-05-07T14:04:12.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015229457 2024-05-07T14:04:12.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069371+0000", 2024-05-07T14:04:12.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1730000000000006e-05 2024-05-07T14:04:12.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069425+0000", 2024-05-07T14:04:12.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3946000000000002e-05 2024-05-07T14:04:12.038 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.038 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.039 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.039 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2839 3.17 3:e819508b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:12.039 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:04:12.039 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.664245829999999, 2024-05-07T14:04:12.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019836402, 2024-05-07T14:04:12.039 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.039 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.040 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.040 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.040 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.040 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.040 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2839 2024-05-07T14:04:12.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.040 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:04:12.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:04:12.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316741+0000", 2024-05-07T14:04:12.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8029999999999999e-06 2024-05-07T14:04:12.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318466+0000", 2024-05-07T14:04:12.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017249959999999999 2024-05-07T14:04:12.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318491+0000", 2024-05-07T14:04:12.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4876e-05 2024-05-07T14:04:12.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318502+0000", 2024-05-07T14:04:12.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0421999999999999e-05 2024-05-07T14:04:12.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318582+0000", 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0593999999999994e-05 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318717+0000", 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013472199999999999 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318836+0000", 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118996 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.325781+0000", 2024-05-07T14:04:12.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069447809999999997 2024-05-07T14:04:12.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336451+0000", 2024-05-07T14:04:12.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010670416 2024-05-07T14:04:12.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336510+0000", 2024-05-07T14:04:12.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8408e-05 2024-05-07T14:04:12.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336576+0000", 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6388000000000002e-05 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2888 3.2 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.142376684999999, 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037006981000000001, 2024-05-07T14:04:12.045 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.046 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.046 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.046 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.046 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.046 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.046 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2888 2024-05-07T14:04:12.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.046 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:04:12.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838611+0000", 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.441e-06 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840569+0000", 2024-05-07T14:04:12.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019573189999999999 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840592+0000", 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3230999999999998e-05 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840605+0000", 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.295e-05 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840681+0000", 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6250999999999999e-05 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840821+0000", 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013997700000000001 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840966+0000", 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144735 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.846709+0000", 2024-05-07T14:04:12.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057430809999999997 2024-05-07T14:04:12.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875496+0000", 2024-05-07T14:04:12.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028787366000000002 2024-05-07T14:04:12.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875565+0000", 2024-05-07T14:04:12.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8460000000000005e-05 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875616+0000", 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.117e-05 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3180 3.13 3:caa8d6d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.171133+0000", 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.8098525749999999, 2024-05-07T14:04:12.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022191593999999999, 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3180 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.171133+0000", 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.171133+0000", 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.171136+0000", 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0539999999999999e-06 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172705+0000", 2024-05-07T14:04:12.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001568605 2024-05-07T14:04:12.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172735+0000", 2024-05-07T14:04:12.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0871999999999999e-05 2024-05-07T14:04:12.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.054 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172749+0000", 2024-05-07T14:04:12.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3342e-05 2024-05-07T14:04:12.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.054 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172824+0000", 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5142999999999995e-05 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172960+0000", 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013564800000000001 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.173060+0000", 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0001004 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.177196+0000", 2024-05-07T14:04:12.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041360930000000004 2024-05-07T14:04:12.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.193225+0000", 2024-05-07T14:04:12.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016028718000000001 2024-05-07T14:04:12.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.193274+0000", 2024-05-07T14:04:12.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9002000000000003e-05 2024-05-07T14:04:12.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.193325+0000", 2024-05-07T14:04:12.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0717000000000002e-05 2024-05-07T14:04:12.057 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.057 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.057 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.058 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3196 3.13 3:ca161e2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:12.058 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.320598+0000", 2024-05-07T14:04:12.058 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.660387869, 2024-05-07T14:04:12.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023572460999999999, 2024-05-07T14:04:12.058 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.058 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.059 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.059 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.059 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.059 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.059 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3196 2024-05-07T14:04:12.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.059 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.320598+0000", 2024-05-07T14:04:12.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.320598+0000", 2024-05-07T14:04:12.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.320601+0000", 2024-05-07T14:04:12.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0479999999999999e-06 2024-05-07T14:04:12.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.321972+0000", 2024-05-07T14:04:12.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013711890000000001 2024-05-07T14:04:12.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.321996+0000", 2024-05-07T14:04:12.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4494e-05 2024-05-07T14:04:12.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.322008+0000", 2024-05-07T14:04:12.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1307e-05 2024-05-07T14:04:12.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.322083+0000", 2024-05-07T14:04:12.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5572000000000001e-05 2024-05-07T14:04:12.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.322196+0000", 2024-05-07T14:04:12.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011228199999999999 2024-05-07T14:04:12.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:12.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.322309+0000", 2024-05-07T14:04:12.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011369799999999999 2024-05-07T14:04:12.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.326918+0000", 2024-05-07T14:04:12.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046091190000000001 2024-05-07T14:04:12.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.344051+0000", 2024-05-07T14:04:12.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017132903000000001 2024-05-07T14:04:12.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.344119+0000", 2024-05-07T14:04:12.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8059999999999996e-05 2024-05-07T14:04:12.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.344170+0000", 2024-05-07T14:04:12.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0788999999999998e-05 2024-05-07T14:04:12.065 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.065 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.065 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.065 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3246 3.17 3:e8614b39:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:12.065 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.858916+0000", 2024-05-07T14:04:12.065 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.1220692129999996, 2024-05-07T14:04:12.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018635514999999998, 2024-05-07T14:04:12.066 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.066 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.066 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.066 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.066 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.066 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.066 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3246 2024-05-07T14:04:12.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.066 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.858916+0000", 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.858916+0000", 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.858919+0000", 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9160000000000001e-06 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.860471+0000", 2024-05-07T14:04:12.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015522229999999999 2024-05-07T14:04:12.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.860505+0000", 2024-05-07T14:04:12.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3287999999999997e-05 2024-05-07T14:04:12.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.860520+0000", 2024-05-07T14:04:12.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.558e-05 2024-05-07T14:04:12.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.860622+0000", 2024-05-07T14:04:12.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010135 2024-05-07T14:04:12.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.070 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.860825+0000", 2024-05-07T14:04:12.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000203217 2024-05-07T14:04:12.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.070 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:12.070 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.861041+0000", 2024-05-07T14:04:12.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021571000000000001 2024-05-07T14:04:12.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.070 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.866014+0000", 2024-05-07T14:04:12.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004973557 2024-05-07T14:04:12.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.877444+0000", 2024-05-07T14:04:12.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011429946 2024-05-07T14:04:12.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.877499+0000", 2024-05-07T14:04:12.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4948000000000003e-05 2024-05-07T14:04:12.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.877552+0000", 2024-05-07T14:04:12.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2779999999999999e-05 2024-05-07T14:04:12.072 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.072 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.072 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.072 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3250 3.2e 3:75e09b47:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:12.073 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.903138+0000", 2024-05-07T14:04:12.073 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.0778478339999999, 2024-05-07T14:04:12.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020147194, 2024-05-07T14:04:12.073 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.073 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.073 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.073 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.073 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.073 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.073 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3250 2024-05-07T14:04:12.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.073 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.903138+0000", 2024-05-07T14:04:12.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.903138+0000", 2024-05-07T14:04:12.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.903140+0000", 2024-05-07T14:04:12.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.34e-06 2024-05-07T14:04:12.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904918+0000", 2024-05-07T14:04:12.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017780960000000001 2024-05-07T14:04:12.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904944+0000", 2024-05-07T14:04:12.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5426e-05 2024-05-07T14:04:12.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904956+0000", 2024-05-07T14:04:12.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1982e-05 2024-05-07T14:04:12.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.905063+0000", 2024-05-07T14:04:12.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107896 2024-05-07T14:04:12.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.905230+0000", 2024-05-07T14:04:12.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016688099999999999 2024-05-07T14:04:12.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:12.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.905398+0000", 2024-05-07T14:04:12.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168157 2024-05-07T14:04:12.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.912075+0000", 2024-05-07T14:04:12.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0066761219999999996 2024-05-07T14:04:12.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.923215+0000", 2024-05-07T14:04:12.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011140469 2024-05-07T14:04:12.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.923254+0000", 2024-05-07T14:04:12.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9053e-05 2024-05-07T14:04:12.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.923285+0000", 2024-05-07T14:04:12.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0772000000000003e-05 2024-05-07T14:04:12.079 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.079 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.079 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.079 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3252 3.2 3:422326a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:12.079 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.925584+0000", 2024-05-07T14:04:12.079 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.0554018340000004, 2024-05-07T14:04:12.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020260311999999999, 2024-05-07T14:04:12.079 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.080 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.080 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.080 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.080 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.080 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.080 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3252 2024-05-07T14:04:12.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.080 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.925584+0000", 2024-05-07T14:04:12.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.925584+0000", 2024-05-07T14:04:12.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.925586+0000", 2024-05-07T14:04:12.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9099999999999999e-06 2024-05-07T14:04:12.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927037+0000", 2024-05-07T14:04:12.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014510199999999999 2024-05-07T14:04:12.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927071+0000", 2024-05-07T14:04:12.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4326000000000003e-05 2024-05-07T14:04:12.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927085+0000", 2024-05-07T14:04:12.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4022999999999999e-05 2024-05-07T14:04:12.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927161+0000", 2024-05-07T14:04:12.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5909999999999997e-05 2024-05-07T14:04:12.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927327+0000", 2024-05-07T14:04:12.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016630799999999999 2024-05-07T14:04:12.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:12.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927444+0000", 2024-05-07T14:04:12.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116885 2024-05-07T14:04:12.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.935938+0000", 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0084935159999999996 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.945759+0000", 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0098209990000000004 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.945806+0000", 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7361000000000003e-05 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.945844+0000", 2024-05-07T14:04:12.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8053999999999999e-05 2024-05-07T14:04:12.086 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.086 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.086 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.086 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3293 3.2 3:41f19516:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:12.086 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.566244+0000", 2024-05-07T14:04:12.086 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.4147416690000001, 2024-05-07T14:04:12.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017848627999999998, 2024-05-07T14:04:12.086 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.086 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3293 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.566244+0000", 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.566244+0000", 2024-05-07T14:04:12.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.566247+0000", 2024-05-07T14:04:12.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0070000000000002e-06 2024-05-07T14:04:12.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.569089+0000", 2024-05-07T14:04:12.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028421200000000001 2024-05-07T14:04:12.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.569120+0000", 2024-05-07T14:04:12.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0923000000000002e-05 2024-05-07T14:04:12.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.569134+0000", 2024-05-07T14:04:12.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4209000000000001e-05 2024-05-07T14:04:12.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.569225+0000", 2024-05-07T14:04:12.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1271000000000001e-05 2024-05-07T14:04:12.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.569404+0000", 2024-05-07T14:04:12.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017827899999999999 2024-05-07T14:04:12.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:12.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.569552+0000", 2024-05-07T14:04:12.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014798400000000001 2024-05-07T14:04:12.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.578166+0000", 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086139219999999996 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.583962+0000", 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057962279999999996 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.584022+0000", 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0368000000000002e-05 2024-05-07T14:04:12.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.584092+0000", 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0316999999999998e-05 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3295 3.2d e114/21 3:b6ee7f94:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_187:head v 114'10, mlcod=114'8)", 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.594055+0000", 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.3869309599999999, 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021164453999999999, 2024-05-07T14:04:12.092 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.093 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.093 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.093 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.594055+0000", 2024-05-07T14:04:12.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.594055+0000", 2024-05-07T14:04:12.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.594057+0000", 2024-05-07T14:04:12.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6479999999999999e-06 2024-05-07T14:04:12.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599702+0000", 2024-05-07T14:04:12.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056445380000000002 2024-05-07T14:04:12.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599734+0000", 2024-05-07T14:04:12.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1822000000000001e-05 2024-05-07T14:04:12.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599750+0000", 2024-05-07T14:04:12.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6731999999999998e-05 2024-05-07T14:04:12.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599897+0000", 2024-05-07T14:04:12.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000146279 2024-05-07T14:04:12.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599955+0000", 2024-05-07T14:04:12.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8723e-05 2024-05-07T14:04:12.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.615151+0000", 2024-05-07T14:04:12.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015195919 2024-05-07T14:04:12.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.615219+0000", 2024-05-07T14:04:12.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.7793000000000006e-05 2024-05-07T14:04:12.097 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.097 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.097 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.097 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3335 3.9 e114/21 3:93f3a6ca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_226:head v 114'11, mlcod=105'9)", 2024-05-07T14:04:12.098 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.370623+0000", 2024-05-07T14:04:12.098 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.6103621299999999, 2024-05-07T14:04:12.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01829478, 2024-05-07T14:04:12.098 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.098 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.098 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.098 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.370623+0000", 2024-05-07T14:04:12.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.370623+0000", 2024-05-07T14:04:12.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.370625+0000", 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5269999999999999e-06 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.378301+0000", 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0076756560000000003 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.378353+0000", 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1959000000000002e-05 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.378377+0000", 2024-05-07T14:04:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4743e-05 2024-05-07T14:04:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.378480+0000", 2024-05-07T14:04:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010239 2024-05-07T14:04:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.378514+0000", 2024-05-07T14:04:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4672999999999998e-05 2024-05-07T14:04:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.388777+0000", 2024-05-07T14:04:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010262957 2024-05-07T14:04:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.388918+0000", 2024-05-07T14:04:12.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140875 2024-05-07T14:04:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.103 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.103 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:12.104 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:12.104 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:12.105 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:04:12.106 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:12.106 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:12.106 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:12.107 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:12.107 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:04:12.107 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:04:12.108 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:12.119+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:12.206 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:12.215+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:12.289 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:12.289 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:12.289 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:04:12.289 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:12.301 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:04:12.349 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:12.363+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:12.366 INFO:tasks.workunit.client.0.smithi106.stdout:quota disabled for the bucket: buck_2024_04_7_14_04_02 2024-05-07T14:04:12.366 INFO:tasks.workunit.client.0.smithi106.stdout:adding file to bucket: 2Gb. 2024-05-07T14:04:12.366 INFO:tasks.workunit.client.0.smithi106.stdout:upload file successful 2024-05-07T14:04:12.366 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:04:12.366 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - bucket quota size doesnt take effect when quota is disabled 2024-05-07T14:04:12.366 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:04:12.408 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:12.419+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:12.422 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:12.422 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:12.422 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:12.423 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:12.423 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:12.437 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:04:12.442 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:04:12.524 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:12.539+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:12.600 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:12.600 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:12.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:12.600 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:12.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.600 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:04:12.600 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:12.600 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 80.307758203999995, 2024-05-07T14:04:12.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:04:12.600 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.600 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:12.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:04:12.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:04:12.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:04:12.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:04:12.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:04:12.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:04:12.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:04:12.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:12.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:04:12.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:04:12.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2203 3.1e 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 69.318041859999994, 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029129142, 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.606 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2203 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294465+0000", 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7699999999999999e-06 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300328+0000", 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058633460000000002 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300384+0000", 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6212999999999999e-05 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300411+0000", 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7109000000000001e-05 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300586+0000", 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017478799999999999 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300941+0000", 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035515500000000001 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301351+0000", 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040996099999999997 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.317495+0000", 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016143462000000001 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323421+0000", 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059264649999999997 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323498+0000", 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6478999999999997e-05 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323590+0000", 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2393999999999997e-05 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.611 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2230 3.b 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 68.942135190000002, 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021351564, 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2230 2024-05-07T14:04:12.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.613 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:12.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:12.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670370+0000", 2024-05-07T14:04:12.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5050000000000002e-06 2024-05-07T14:04:12.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673214+0000", 2024-05-07T14:04:12.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028441260000000002 2024-05-07T14:04:12.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673245+0000", 2024-05-07T14:04:12.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0488999999999999e-05 2024-05-07T14:04:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673259+0000", 2024-05-07T14:04:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4443e-05 2024-05-07T14:04:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673356+0000", 2024-05-07T14:04:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7031e-05 2024-05-07T14:04:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673531+0000", 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017509099999999999 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673696+0000", 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000164306 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684776+0000", 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011080054000000001 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691578+0000", 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068025849999999999 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691659+0000", 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0976000000000005e-05 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691719+0000", 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9957999999999998e-05 2024-05-07T14:04:12.617 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.618 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.618 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.618 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2666 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:12.618 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:12.618 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.960678303999998, 2024-05-07T14:04:12.618 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.125351252, 2024-05-07T14:04:12.618 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.618 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.618 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:12.618 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.618 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2666 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651827+0000", 2024-05-07T14:04:12.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-06 2024-05-07T14:04:12.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.620 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.620 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651834+0000", 2024-05-07T14:04:12.620 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7700000000000001e-06 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651850+0000", 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5755000000000001e-05 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651862+0000", 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.237e-05 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.621 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651967+0000", 2024-05-07T14:04:12.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010427199999999999 2024-05-07T14:04:12.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:12.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651977+0000", 2024-05-07T14:04:12.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0743e-05 2024-05-07T14:04:12.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.622 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.622 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657294+0000", 2024-05-07T14:04:12.622 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053168069999999998 2024-05-07T14:04:12.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:12.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657305+0000", 2024-05-07T14:04:12.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0662000000000001e-05 2024-05-07T14:04:12.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.623 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.623 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774211+0000", 2024-05-07T14:04:12.623 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1169060209999999 2024-05-07T14:04:12.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774394+0000", 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018268000000000001 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.777176+0000", 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002782025 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2673 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.416745116999998, 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57934507999999996, 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2673 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9699999999999996e-07 2024-05-07T14:04:12.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195761+0000", 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2569999999999999e-06 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195768+0000", 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.489e-06 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195774+0000", 2024-05-07T14:04:12.627 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7389999999999996e-06 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195866+0000", 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2349000000000006e-05 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195878+0000", 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1838000000000001e-05 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774802+0000", 2024-05-07T14:04:12.628 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.578923945 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774906+0000", 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103991 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775103+0000", 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196975 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2684 3.24 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.826384206, 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.040396402999999997, 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2684 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.630 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786122+0000", 2024-05-07T14:04:12.631 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0929999999999999e-06 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788626+0000", 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025042720000000001 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788659+0000", 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2824999999999998e-05 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.632 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788673+0000", 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4721e-05 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788768+0000", 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4178999999999994e-05 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788776+0000", 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2400000000000007e-06 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.633 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798002+0000", 2024-05-07T14:04:12.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092262230000000004 2024-05-07T14:04:12.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798163+0000", 2024-05-07T14:04:12.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161077 2024-05-07T14:04:12.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.634 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:12.634 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798305+0000", 2024-05-07T14:04:12.634 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014162499999999999 2024-05-07T14:04:12.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.807567+0000", 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092618869999999999 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826429+0000", 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018862824 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826470+0000", 2024-05-07T14:04:12.635 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1010999999999997e-05 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826515+0000", 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4425999999999998e-05 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2700 3.c e104/21 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.652537559999999, 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022078321000000001, 2024-05-07T14:04:12.636 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:12.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9299999999999999e-07 2024-05-07T14:04:12.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966313+0000", 2024-05-07T14:04:12.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063471889999999996 2024-05-07T14:04:12.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.638 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.638 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966340+0000", 2024-05-07T14:04:12.638 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7514000000000001e-05 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966354+0000", 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4053000000000001e-05 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966434+0000", 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0273999999999997e-05 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966464+0000", 2024-05-07T14:04:12.639 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.953e-05 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.981968+0000", 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0155037 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.982043+0000", 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5767999999999997e-05 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.641 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2712 3.15 e104/21 3:a83036f0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_29:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:12.641 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:04:12.641 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.509147757000001, 2024-05-07T14:04:12.641 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021527713, 2024-05-07T14:04:12.641 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.641 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.641 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.641 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.641 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.641 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:04:12.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:04:12.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.642 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.642 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103357+0000", 2024-05-07T14:04:12.642 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7260000000000001e-06 2024-05-07T14:04:12.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107529+0000", 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041726999999999997 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107551+0000", 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1854000000000001e-05 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107563+0000", 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1362999999999999e-05 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107633+0000", 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0432999999999995e-05 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107652+0000", 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9250999999999999e-05 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124797+0000", 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017144626 2024-05-07T14:04:12.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124883+0000", 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5760000000000006e-05 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2791 3.27 3:e46b1707:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.683249214, 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022300529999999999, 2024-05-07T14:04:12.645 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.646 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.646 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.646 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.646 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.646 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.646 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2791 2024-05-07T14:04:12.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.646 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.646 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.646 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:12.646 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929257+0000", 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.281e-06 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931305+0000", 2024-05-07T14:04:12.647 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020483020000000001 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931328+0000", 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2722e-05 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931341+0000", 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3529e-05 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931415+0000", 2024-05-07T14:04:12.648 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3597999999999996e-05 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931614+0000", 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019859000000000001 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931758+0000", 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014481699999999999 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.939706+0000", 2024-05-07T14:04:12.649 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007948063 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951424+0000", 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011717708 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951500+0000", 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5831e-05 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.650 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951554+0000", 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4088999999999997e-05 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2864 3.29 3:97632e4b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.037495582999998, 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021723981, 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.651 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2864 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:04:12.652 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575010+0000", 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5660000000000001e-06 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576737+0000", 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017271599999999999 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576768+0000", 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1424000000000003e-05 2024-05-07T14:04:12.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576783+0000", 2024-05-07T14:04:12.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4656e-05 2024-05-07T14:04:12.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.654 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576880+0000", 2024-05-07T14:04:12.654 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6576999999999994e-05 2024-05-07T14:04:12.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.654 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577067+0000", 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018795800000000001 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577285+0000", 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021768499999999999 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.587487+0000", 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010202289 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.655 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596612+0000", 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0091244440000000007 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596681+0000", 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9025999999999999e-05 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596731+0000", 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0195999999999998e-05 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.656 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2865 3.38 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.029877925000001, 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.035746371999999998, 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2865 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.657 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582627+0000", 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584611+0000", 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019836350000000001 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584636+0000", 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4943000000000002e-05 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584652+0000", 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5586e-05 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584733+0000", 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0987000000000002e-05 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584881+0000", 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014805800000000001 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584972+0000", 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1218999999999995e-05 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.591149+0000", 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061766939999999999 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618207+0000", 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027058260000000001 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618319+0000", 2024-05-07T14:04:12.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011267700000000001 2024-05-07T14:04:12.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618371+0000", 2024-05-07T14:04:12.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1683e-05 2024-05-07T14:04:12.662 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.662 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.662 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2883 3.29 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.834714287000001, 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025309511999999999, 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2883 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.663 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:12.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:12.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.664 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.664 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777791+0000", 2024-05-07T14:04:12.664 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.289e-06 2024-05-07T14:04:12.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779027+0000", 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001236411 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779063+0000", 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5658999999999999e-05 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779076+0000", 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3128e-05 2024-05-07T14:04:12.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779166+0000", 2024-05-07T14:04:12.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9818e-05 2024-05-07T14:04:12.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779398+0000", 2024-05-07T14:04:12.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023189400000000001 2024-05-07T14:04:12.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:12.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779577+0000", 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000179276 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.786782+0000", 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072052740000000002 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.802960+0000", 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016177490999999999 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803047+0000", 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6912999999999999e-05 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803098+0000", 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1359000000000001e-05 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2905 3.1e 3:78954da1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:12.668 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.561306047999999, 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028568698, 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2905 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051199+0000", 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5299999999999999e-06 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055400+0000", 2024-05-07T14:04:12.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042009889999999996 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055458+0000", 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.736e-05 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055486+0000", 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8914000000000001e-05 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055574+0000", 2024-05-07T14:04:12.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7120999999999995e-05 2024-05-07T14:04:12.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055726+0000", 2024-05-07T14:04:12.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015249600000000001 2024-05-07T14:04:12.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:12.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055884+0000", 2024-05-07T14:04:12.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015788900000000001 2024-05-07T14:04:12.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.064235+0000", 2024-05-07T14:04:12.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008350583 2024-05-07T14:04:12.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078705+0000", 2024-05-07T14:04:12.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014470129999999999 2024-05-07T14:04:12.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078900+0000", 2024-05-07T14:04:12.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019521799999999999 2024-05-07T14:04:12.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.079765+0000", 2024-05-07T14:04:12.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00086546799999999999 2024-05-07T14:04:12.674 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.674 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.674 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.674 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3240 3.33 3:cd111f2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:12.674 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.788271+0000", 2024-05-07T14:04:12.675 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.8242312380000003, 2024-05-07T14:04:12.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026491491999999998, 2024-05-07T14:04:12.675 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.675 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.675 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.675 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.675 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.675 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.675 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3240 2024-05-07T14:04:12.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.675 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.788271+0000", 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.788271+0000", 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.788275+0000", 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2399999999999999e-06 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791613+0000", 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033385329999999999 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791645+0000", 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1602e-05 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791659+0000", 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4596999999999999e-05 2024-05-07T14:04:12.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791766+0000", 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106043 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791961+0000", 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019581399999999999 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.792139+0000", 2024-05-07T14:04:12.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017790899999999999 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.804241+0000", 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012101519999999999 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.814683+0000", 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010442158999999999 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.814728+0000", 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5456e-05 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.814763+0000", 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4619000000000002e-05 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3241 3.33 3:cda6606c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.798545+0000", 2024-05-07T14:04:12.680 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.8139580479999999, 2024-05-07T14:04:12.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021264295999999999, 2024-05-07T14:04:12.681 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.681 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.681 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.681 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.681 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.681 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.681 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3241 2024-05-07T14:04:12.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.681 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.798545+0000", 2024-05-07T14:04:12.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.798545+0000", 2024-05-07T14:04:12.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.798547+0000", 2024-05-07T14:04:12.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:04:12.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.800726+0000", 2024-05-07T14:04:12.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021789489999999999 2024-05-07T14:04:12.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.800745+0000", 2024-05-07T14:04:12.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8711000000000001e-05 2024-05-07T14:04:12.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.800754+0000", 2024-05-07T14:04:12.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8539999999999992e-06 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.800825+0000", 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0217999999999998e-05 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.800965+0000", 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014002200000000001 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.801110+0000", 2024-05-07T14:04:12.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145499 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.806952+0000", 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058421510000000003 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.819743+0000", 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012790345999999999 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.819781+0000", 2024-05-07T14:04:12.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7886999999999998e-05 2024-05-07T14:04:12.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.819809+0000", 2024-05-07T14:04:12.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8356000000000001e-05 2024-05-07T14:04:12.686 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.686 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.686 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.687 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3248 3.33 3:cd0a349a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:12.687 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.881531+0000", 2024-05-07T14:04:12.687 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.7309720459999998, 2024-05-07T14:04:12.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022568742999999999, 2024-05-07T14:04:12.687 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.687 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.687 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.687 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.687 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.687 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.688 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3248 2024-05-07T14:04:12.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.689 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.689 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.689 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.881531+0000", 2024-05-07T14:04:12.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.881531+0000", 2024-05-07T14:04:12.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.881532+0000", 2024-05-07T14:04:12.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7430000000000001e-06 2024-05-07T14:04:12.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883223+0000", 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001690799 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883253+0000", 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9365000000000001e-05 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883265+0000", 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2267e-05 2024-05-07T14:04:12.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883342+0000", 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7200999999999995e-05 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883469+0000", 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012662099999999999 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883608+0000", 2024-05-07T14:04:12.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000139493 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.889589+0000", 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059812320000000004 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.903960+0000", 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014370186 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904062+0000", 2024-05-07T14:04:12.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102056 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904099+0000", 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7780000000000001e-05 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3277 3.b 3:d1f9c1c7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.317440+0000", 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.295063098, 2024-05-07T14:04:12.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025103065000000001, 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3277 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.317440+0000", 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.317440+0000", 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.317443+0000", 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2969999999999999e-06 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320371+0000", 2024-05-07T14:04:12.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029279280000000002 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320424+0000", 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2972e-05 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320451+0000", 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7056e-05 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320604+0000", 2024-05-07T14:04:12.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152688 2024-05-07T14:04:12.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320950+0000", 2024-05-07T14:04:12.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00034685400000000001 2024-05-07T14:04:12.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:12.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.321362+0000", 2024-05-07T14:04:12.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041191300000000003 2024-05-07T14:04:12.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.340027+0000", 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018665010999999999 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342301+0000", 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022736750000000002 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342433+0000", 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000131712 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342543+0000", 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000109959 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3288 3.7 3:e3df0df9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.487335+0000", 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.1251673960000002, 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022910593999999999, 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.700 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3288 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.487335+0000", 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.701 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.487335+0000", 2024-05-07T14:04:12.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.487339+0000", 2024-05-07T14:04:12.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1139999999999999e-06 2024-05-07T14:04:12.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490002+0000", 2024-05-07T14:04:12.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026621510000000002 2024-05-07T14:04:12.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490040+0000", 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8575000000000003e-05 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490058+0000", 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490206+0000", 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014781899999999999 2024-05-07T14:04:12.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490531+0000", 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032532500000000001 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490865+0000", 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000333319 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.501257+0000", 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010392083 2024-05-07T14:04:12.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.509955+0000", 2024-05-07T14:04:12.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086984690000000003 2024-05-07T14:04:12.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.510124+0000", 2024-05-07T14:04:12.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016896700000000001 2024-05-07T14:04:12.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.510246+0000", 2024-05-07T14:04:12.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121694 2024-05-07T14:04:12.706 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.706 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.706 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.706 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3319 3.33 3:cda0bc3e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:12.706 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.050548+0000", 2024-05-07T14:04:12.706 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.5619550479999997, 2024-05-07T14:04:12.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022485041000000001, 2024-05-07T14:04:12.706 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.706 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.706 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3319 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.050548+0000", 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.050548+0000", 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.050552+0000", 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3669999999999999e-06 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054164+0000", 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036120660000000001 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054218+0000", 2024-05-07T14:04:12.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3507000000000001e-05 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054245+0000", 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7002e-05 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054387+0000", 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142306 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054620+0000", 2024-05-07T14:04:12.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023293700000000001 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054829+0000", 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020874500000000001 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.062575+0000", 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077465930000000004 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:12.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.072708+0000", 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010132482999999999 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.072898+0000", 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018985700000000001 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.073033+0000", 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013517800000000001 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.711 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3602 3.5 e115/21 3:a2d0df3e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_483:head v 115'13, mlcod=115'11)", 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:12.137890+0000", 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.47461314500000001, 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021333174, 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.137890+0000", 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.137890+0000", 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.137892+0000", 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0379999999999998e-06 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.141960+0000", 2024-05-07T14:04:12.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040683309999999997 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.141997+0000", 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6993999999999999e-05 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.142013+0000", 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5846e-05 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.142108+0000", 2024-05-07T14:04:12.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5529e-05 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.142141+0000", 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2817000000000001e-05 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.159162+0000", 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017021273999999999 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.159223+0000", 2024-05-07T14:04:12.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0344999999999999e-05 2024-05-07T14:04:12.716 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.716 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.716 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.716 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:12.716 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:12.716 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:12.718 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:04:12.718 INFO:tasks.workunit.client.0.smithi106.stdout:user qa_user deleted 2024-05-07T14:04:12.718 INFO:tasks.workunit.client.0.smithi106.stdout:bucket delete succeeded 2024-05-07T14:04:12.718 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:12.730+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:12.818 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:12.830+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:12.850 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:12.850 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:12.850 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:12.864 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:04:12.919 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:12.927+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:12.983 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:12.983 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:12.983 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:12.996 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:04:13.040 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:13.051+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:13.121 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:13.134+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:13.164 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:13.164 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:13.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:13.165 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:13.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.165 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2224 3.1a 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:13.165 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:13.165 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.586803738, 2024-05-07T14:04:13.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027796929000000001, 2024-05-07T14:04:13.165 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.165 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.165 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2224 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588348+0000", 2024-05-07T14:04:13.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1629999999999998e-06 2024-05-07T14:04:13.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594043+0000", 2024-05-07T14:04:13.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056948950000000002 2024-05-07T14:04:13.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594085+0000", 2024-05-07T14:04:13.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1678999999999999e-05 2024-05-07T14:04:13.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594113+0000", 2024-05-07T14:04:13.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:04:13.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594221+0000", 2024-05-07T14:04:13.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107371 2024-05-07T14:04:13.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594405+0000", 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018468099999999999 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594570+0000", 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165224 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.603655+0000", 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090846550000000005 2024-05-07T14:04:13.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.615968+0000", 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012313199 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616069+0000", 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100309 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616141+0000", 2024-05-07T14:04:13.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2218999999999994e-05 2024-05-07T14:04:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2229 3.3 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.515507209999996, 2024-05-07T14:04:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028304669000000001, 2024-05-07T14:04:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.171 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2229 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:13.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659643+0000", 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9129999999999999e-06 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664151+0000", 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045081189999999997 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664198+0000", 2024-05-07T14:04:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6431999999999999e-05 2024-05-07T14:04:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664223+0000", 2024-05-07T14:04:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5369999999999999e-05 2024-05-07T14:04:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664313+0000", 2024-05-07T14:04:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345999999999995e-05 2024-05-07T14:04:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664428+0000", 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115058 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664566+0000", 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138598 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.671674+0000", 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071074529999999997 2024-05-07T14:04:13.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687772+0000", 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016098359 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687871+0000", 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9098000000000006e-05 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687945+0000", 2024-05-07T14:04:13.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3923000000000004e-05 2024-05-07T14:04:13.177 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.177 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.177 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.177 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2684 3.24 e104/21 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:13.177 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:13.177 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.376546749999999, 2024-05-07T14:04:13.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026848770000000001, 2024-05-07T14:04:13.177 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.177 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.177 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.177 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:13.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6000000000000004e-07 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810718+0000", 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012116477 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810747+0000", 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8676000000000001e-05 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810791+0000", 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4415000000000001e-05 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810915+0000", 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012363399999999999 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810950+0000", 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5812999999999997e-05 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825326+0000", 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014375852 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825450+0000", 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012334299999999999 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2685 3.1c e104/21 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head v 104'1, mlcod=0'0)", 2024-05-07T14:04:13.181 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:13.182 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.369711078000002, 2024-05-07T14:04:13.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023842609000000001, 2024-05-07T14:04:13.182 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.182 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.182 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.182 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:13.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:13.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805438+0000", 2024-05-07T14:04:13.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.243e-06 2024-05-07T14:04:13.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812353+0000", 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069150560000000002 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812385+0000", 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2583000000000003e-05 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812406+0000", 2024-05-07T14:04:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0378999999999999e-05 2024-05-07T14:04:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812541+0000", 2024-05-07T14:04:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013502699999999999 2024-05-07T14:04:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812591+0000", 2024-05-07T14:04:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0522999999999997e-05 2024-05-07T14:04:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829183+0000", 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016591445999999999 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829279+0000", 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6352000000000002e-05 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2686 3.34 3:2ec0e822:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.366496607999999, 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034864805999999998, 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2686 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808656+0000", 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6029999999999998e-06 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818059+0000", 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094034429999999992 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818114+0000", 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4625e-05 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818139+0000", 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4850000000000001e-05 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819387+0000", 2024-05-07T14:04:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012488060000000001 2024-05-07T14:04:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819792+0000", 2024-05-07T14:04:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040472400000000002 2024-05-07T14:04:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820050+0000", 2024-05-07T14:04:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025799800000000001 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.833596+0000", 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013546069000000001 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843174+0000", 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095773449999999993 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:04:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023329199999999999 2024-05-07T14:04:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843516+0000", 2024-05-07T14:04:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109051 2024-05-07T14:04:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2696 3.14 3:2aeb6272:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.262111768, 2024-05-07T14:04:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022593715, 2024-05-07T14:04:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2696 2024-05-07T14:04:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913039+0000", 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3730000000000001e-06 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917057+0000", 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040181319999999998 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917099+0000", 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.155e-05 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917118+0000", 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8862e-05 2024-05-07T14:04:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917285+0000", 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016734000000000001 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917644+0000", 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035872600000000002 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.918201+0000", 2024-05-07T14:04:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055705100000000003 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.934860+0000", 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016658665 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935461+0000", 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060165000000000001 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935559+0000", 2024-05-07T14:04:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8255e-05 2024-05-07T14:04:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935630+0000", 2024-05-07T14:04:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0110999999999993e-05 2024-05-07T14:04:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2755 3.14 3:2b7affc7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.634184893, 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023747145000000001, 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2755 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540983+0000", 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0466999999999999e-05 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545846+0000", 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048626709999999998 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545883+0000", 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6769e-05 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545900+0000", 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6869999999999999e-05 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546070+0000", 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017014299999999999 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546329+0000", 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025910400000000002 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546560+0000", 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023119899999999999 2024-05-07T14:04:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.555774+0000", 2024-05-07T14:04:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092136490000000008 2024-05-07T14:04:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564539+0000", 2024-05-07T14:04:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087649870000000001 2024-05-07T14:04:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564638+0000", 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9028000000000001e-05 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564710+0000", 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2257999999999998e-05 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2799 3.9 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.162788082999999, 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027222948, 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2799 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012363+0000", 2024-05-07T14:04:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6500000000000002e-06 2024-05-07T14:04:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016678+0000", 2024-05-07T14:04:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043148320000000002 2024-05-07T14:04:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016709+0000", 2024-05-07T14:04:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0953e-05 2024-05-07T14:04:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016726+0000", 2024-05-07T14:04:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7022999999999999e-05 2024-05-07T14:04:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016864+0000", 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137854 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017108+0000", 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024388099999999999 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017333+0000", 2024-05-07T14:04:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022492899999999999 2024-05-07T14:04:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.033051+0000", 2024-05-07T14:04:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015718352000000001 2024-05-07T14:04:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039272+0000", 2024-05-07T14:04:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062205139999999999 2024-05-07T14:04:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039451+0000", 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017928 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039583+0000", 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013168000000000001 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2804 3.e e105/21 3:7356dc96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_121:head v 105'10, mlcod=105'8)", 2024-05-07T14:04:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.10185134, 2024-05-07T14:04:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029282694000000001, 2024-05-07T14:04:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073299+0000", 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076073+0000", 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027746260000000001 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076118+0000", 2024-05-07T14:04:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4223e-05 2024-05-07T14:04:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076138+0000", 2024-05-07T14:04:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0622999999999999e-05 2024-05-07T14:04:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076324+0000", 2024-05-07T14:04:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018613599999999999 2024-05-07T14:04:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076376+0000", 2024-05-07T14:04:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2068999999999999e-05 2024-05-07T14:04:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102438+0000", 2024-05-07T14:04:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026061190000000001 2024-05-07T14:04:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102579+0000", 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014143399999999999 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2805 3.1 e105/21 3:819b24c4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_122:head v 105'3, mlcod=104'1)", 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.098888520999999, 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028404523000000001, 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076262+0000", 2024-05-07T14:04:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3800000000000001e-06 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083265+0000", 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070039539999999997 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083309+0000", 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3516000000000001e-05 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083333+0000", 2024-05-07T14:04:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4471999999999999e-05 2024-05-07T14:04:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083520+0000", 2024-05-07T14:04:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018616999999999999 2024-05-07T14:04:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083588+0000", 2024-05-07T14:04:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8405000000000007e-05 2024-05-07T14:04:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104547+0000", 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020959228 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104664+0000", 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011639800000000001 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2832 3.1a 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:13.220 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.927483758000001, 2024-05-07T14:04:13.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030681671000000001, 2024-05-07T14:04:13.220 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.220 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.220 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.220 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.220 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.220 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.220 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2832 2024-05-07T14:04:13.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.220 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247666+0000", 2024-05-07T14:04:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5569999999999998e-06 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253202+0000", 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055353900000000003 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253232+0000", 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0309000000000001e-05 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253250+0000", 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7503000000000002e-05 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253372+0000", 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255600000000001 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253592+0000", 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021960400000000001 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253831+0000", 2024-05-07T14:04:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000239223 2024-05-07T14:04:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.264040+0000", 2024-05-07T14:04:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010209018 2024-05-07T14:04:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278176+0000", 2024-05-07T14:04:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014135518 2024-05-07T14:04:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278272+0000", 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6562000000000001e-05 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278346+0000", 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3430999999999995e-05 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2853 3.34 3:2c5576f8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.718789869999998, 2024-05-07T14:04:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026917739, 2024-05-07T14:04:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2853 2024-05-07T14:04:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456361+0000", 2024-05-07T14:04:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1240000000000001e-06 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460499+0000", 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041381159999999998 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460528+0000", 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8558999999999999e-05 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460544+0000", 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6200000000000001e-05 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460699+0000", 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155513 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461098+0000", 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039883900000000001 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461508+0000", 2024-05-07T14:04:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040939399999999999 2024-05-07T14:04:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.474319+0000", 2024-05-07T14:04:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012811002 2024-05-07T14:04:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483036+0000", 2024-05-07T14:04:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087174469999999997 2024-05-07T14:04:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483142+0000", 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010647800000000001 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483276+0000", 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013306700000000001 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2874 3.34 3:2d878586:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.496187805000002, 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023302047999999999, 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2874 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678964+0000", 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.89e-06 2024-05-07T14:04:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683101+0000", 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041374669999999997 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683138+0000", 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7098999999999998e-05 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683155+0000", 2024-05-07T14:04:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7139999999999999e-05 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683330+0000", 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000174919 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683715+0000", 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038476199999999997 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.684028+0000", 2024-05-07T14:04:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031283999999999999 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701377+0000", 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017349402999999999 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701948+0000", 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057096800000000004 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702125+0000", 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176319 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702262+0000", 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137241 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2883 3.29 e105/21 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head v 105'6, mlcod=104'4)", 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.395493084999998, 2024-05-07T14:04:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022805558, 2024-05-07T14:04:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779657+0000", 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0370000000000001e-06 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784248+0000", 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045916810000000002 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784272+0000", 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3281999999999998e-05 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784285+0000", 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3423e-05 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784399+0000", 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011439500000000001 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784452+0000", 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2142000000000003e-05 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802362+0000", 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017910874 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802460+0000", 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7724000000000002e-05 2024-05-07T14:04:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2889 3.e e105/21 3:72a3c671:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_196:head v 105'11, mlcod=105'9)", 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.320621574, 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02270175, 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854529+0000", 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7499999999999999e-06 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857472+0000", 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002942999 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857510+0000", 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8075999999999999e-05 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857533+0000", 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3353000000000002e-05 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857695+0000", 2024-05-07T14:04:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016135300000000001 2024-05-07T14:04:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857761+0000", 2024-05-07T14:04:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6759000000000002e-05 2024-05-07T14:04:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877052+0000", 2024-05-07T14:04:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019290656999999999 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877228+0000", 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017580300000000001 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3190 3.1a 3:59666d5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.9147182950000001, 2024-05-07T14:04:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026496828, 2024-05-07T14:04:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3190 2024-05-07T14:04:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260444+0000", 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4766000000000001e-05 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267146+0000", 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00670179 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267176+0000", 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0534999999999998e-05 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267191+0000", 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4080000000000001e-05 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267300+0000", 2024-05-07T14:04:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109962 2024-05-07T14:04:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267473+0000", 2024-05-07T14:04:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000172516 2024-05-07T14:04:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267636+0000", 2024-05-07T14:04:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016309699999999999 2024-05-07T14:04:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.275955+0000", 2024-05-07T14:04:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083188399999999992 2024-05-07T14:04:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286699+0000", 2024-05-07T14:04:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010743674999999999 2024-05-07T14:04:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286808+0000", 2024-05-07T14:04:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109702 2024-05-07T14:04:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286926+0000", 2024-05-07T14:04:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117865 2024-05-07T14:04:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3335 3.9 3:93f3a6ca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:09.361724+0000", 2024-05-07T14:04:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.8134233829999999, 2024-05-07T14:04:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027372132, 2024-05-07T14:04:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3335 2024-05-07T14:04:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.361724+0000", 2024-05-07T14:04:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.361724+0000", 2024-05-07T14:04:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.361930+0000", 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000205331 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369409+0000", 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074794070000000004 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369456+0000", 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7413000000000002e-05 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369483+0000", 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6366000000000001e-05 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369665+0000", 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018191799999999999 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369944+0000", 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027922599999999999 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.370170+0000", 2024-05-07T14:04:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000226233 2024-05-07T14:04:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.379097+0000", 2024-05-07T14:04:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089264380000000001 2024-05-07T14:04:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.388922+0000", 2024-05-07T14:04:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0098254650000000002 2024-05-07T14:04:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.389020+0000", 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7663000000000003e-05 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.389096+0000", 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6672e-05 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3351 3.31 e114/21 3:8fd6054f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_242:head v 114'10, mlcod=113'8)", 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:09.578617+0000", 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.5965303319999999, 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024903304000000001, 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.578617+0000", 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.578617+0000", 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.578620+0000", 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3599999999999999e-06 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582736+0000", 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041163069999999996 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582774+0000", 2024-05-07T14:04:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7944000000000001e-05 2024-05-07T14:04:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582799+0000", 2024-05-07T14:04:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5222e-05 2024-05-07T14:04:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582906+0000", 2024-05-07T14:04:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010689299999999999 2024-05-07T14:04:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582933+0000", 2024-05-07T14:04:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7192e-05 2024-05-07T14:04:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.603465+0000", 2024-05-07T14:04:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020531341000000002 2024-05-07T14:04:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.603521+0000", 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6045000000000003e-05 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3604 3.1c e115/21 3:3a3fe722:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_485:head v 115'10, mlcod=114'8)", 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.157830+0000", 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.017317233, 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032404158000000002, 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157830+0000", 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157830+0000", 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157833+0000", 2024-05-07T14:04:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5900000000000002e-06 2024-05-07T14:04:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164272+0000", 2024-05-07T14:04:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006439485 2024-05-07T14:04:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164319+0000", 2024-05-07T14:04:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6699000000000001e-05 2024-05-07T14:04:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164345+0000", 2024-05-07T14:04:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5415999999999999e-05 2024-05-07T14:04:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164521+0000", 2024-05-07T14:04:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176751 2024-05-07T14:04:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164589+0000", 2024-05-07T14:04:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7803000000000001e-05 2024-05-07T14:04:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190083+0000", 2024-05-07T14:04:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025494176 2024-05-07T14:04:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190235+0000", 2024-05-07T14:04:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015123799999999999 2024-05-07T14:04:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3605 3.11 e115/21 3:8ac2b8fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_486:head v 115'13, mlcod=115'11)", 2024-05-07T14:04:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.168137+0000", 2024-05-07T14:04:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.007010755, 2024-05-07T14:04:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025037206999999999, 2024-05-07T14:04:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.168137+0000", 2024-05-07T14:04:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.168137+0000", 2024-05-07T14:04:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.168140+0000", 2024-05-07T14:04:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6699999999999998e-06 2024-05-07T14:04:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173479+0000", 2024-05-07T14:04:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053395300000000003 2024-05-07T14:04:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173515+0000", 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6273999999999999e-05 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173533+0000", 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7368999999999999e-05 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173679+0000", 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000146568 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173722+0000", 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2395999999999999e-05 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.193023+0000", 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019300955000000002 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.193174+0000", 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151445 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.273 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:13.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:04:13.275 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:13.286+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:13.375 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:13.383+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:13.404 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:13.404 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:13.404 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:13.404 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:13.421 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:04:13.423 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:04:13.508 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:13.519+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:13.577 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:13.587+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:13.582 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:13.582 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:13.582 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:13.582 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:13.583 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:13.597 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:04:13.678 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:13.690+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:13.770 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:13.771 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:13.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:13.771 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:13.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.771 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2498 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:13.771 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:13.771 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.385900057000001, 2024-05-07T14:04:13.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.06015305, 2024-05-07T14:04:13.771 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:13.771 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.771 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2498 2024-05-07T14:04:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:13.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394887+0000", 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394900+0000", 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3125999999999999e-05 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394940+0000", 2024-05-07T14:04:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9579999999999997e-05 2024-05-07T14:04:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394961+0000", 2024-05-07T14:04:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1075999999999999e-05 2024-05-07T14:04:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395122+0000", 2024-05-07T14:04:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160741 2024-05-07T14:04:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395140+0000", 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430325+0000", 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.03518512 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430355+0000", 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9181999999999999e-05 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.445424+0000", 2024-05-07T14:04:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.015069751 2024-05-07T14:04:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.446159+0000", 2024-05-07T14:04:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073452200000000004 2024-05-07T14:04:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450456+0000", 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042973689999999997 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450627+0000", 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017032700000000001 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455037+0000", 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044108690000000004 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.777 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2499 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.385771008000006, 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.065623158, 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2499 2024-05-07T14:04:13.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395015+0000", 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.57e-06 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395022+0000", 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1330000000000001e-06 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395043+0000", 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1022999999999998e-05 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395060+0000", 2024-05-07T14:04:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6325999999999999e-05 2024-05-07T14:04:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395199+0000", 2024-05-07T14:04:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139815 2024-05-07T14:04:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395215+0000", 2024-05-07T14:04:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5693e-05 2024-05-07T14:04:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413112+0000", 2024-05-07T14:04:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017896860000000001 2024-05-07T14:04:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413143+0000", 2024-05-07T14:04:13.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1609000000000002e-05 2024-05-07T14:04:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.447430+0000", 2024-05-07T14:04:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0342867060000001 2024-05-07T14:04:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450079+0000", 2024-05-07T14:04:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002648386 2024-05-07T14:04:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455213+0000", 2024-05-07T14:04:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051342749999999998 2024-05-07T14:04:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455444+0000", 2024-05-07T14:04:13.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023070799999999999 2024-05-07T14:04:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.460637+0000", 2024-05-07T14:04:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051930539999999999 2024-05-07T14:04:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2667 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:13.785 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.130526443000001, 2024-05-07T14:04:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1292758329999999, 2024-05-07T14:04:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2667 2024-05-07T14:04:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650260+0000", 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1160000000000002e-06 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650270+0000", 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0047000000000001e-05 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650296+0000", 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6058999999999999e-05 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650313+0000", 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6727000000000001e-05 2024-05-07T14:04:13.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660781+0000", 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010468518 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660805+0000", 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3246000000000001e-05 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776636+0000", 2024-05-07T14:04:13.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.115831102 2024-05-07T14:04:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776958+0000", 2024-05-07T14:04:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032243199999999999 2024-05-07T14:04:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.779534+0000", 2024-05-07T14:04:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025755859999999999 2024-05-07T14:04:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.790 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2674 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.585102763999998, 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58268987500000002, 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2674 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.791 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195683+0000", 2024-05-07T14:04:13.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2500000000000001e-06 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195689+0000", 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4300000000000003e-06 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195702+0000", 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3026e-05 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195718+0000", 2024-05-07T14:04:13.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5532999999999998e-05 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195943+0000", 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022518899999999999 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195971+0000", 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7688999999999999e-05 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.777763+0000", 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58179212899999999 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778060+0000", 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029683599999999997 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778372+0000", 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031179299999999999 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2685 3.1c 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.985253743000001, 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034286608000000003, 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2685 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.796 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795533+0000", 2024-05-07T14:04:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:04:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803767+0000", 2024-05-07T14:04:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082339079999999999 2024-05-07T14:04:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803810+0000", 2024-05-07T14:04:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2969000000000001e-05 2024-05-07T14:04:13.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803837+0000", 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7036e-05 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804026+0000", 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018935600000000001 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804408+0000", 2024-05-07T14:04:13.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038137799999999998 2024-05-07T14:04:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804786+0000", 2024-05-07T14:04:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037841200000000001 2024-05-07T14:04:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.823281+0000", 2024-05-07T14:04:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018494561999999999 2024-05-07T14:04:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829623+0000", 2024-05-07T14:04:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063427279999999997 2024-05-07T14:04:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829715+0000", 2024-05-07T14:04:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1815000000000001e-05 2024-05-07T14:04:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829817+0000", 2024-05-07T14:04:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102051 2024-05-07T14:04:13.801 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2689 3.2a 3:57071f6f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.941816122999999, 2024-05-07T14:04:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032293512000000003, 2024-05-07T14:04:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.802 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2689 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838972+0000", 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.72e-06 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843363+0000", 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043909810000000004 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:04:13.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4181999999999998e-05 2024-05-07T14:04:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843430+0000", 2024-05-07T14:04:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3139999999999999e-05 2024-05-07T14:04:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843735+0000", 2024-05-07T14:04:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030467299999999999 2024-05-07T14:04:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844287+0000", 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055224799999999998 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844674+0000", 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038716199999999998 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.868480+0000", 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023805639999999999 2024-05-07T14:04:13.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.870993+0000", 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025130920000000002 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871151+0000", 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000158176 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871262+0000", 2024-05-07T14:04:13.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110498 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2700 3.c 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.826801744000001, 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028853172999999999, 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.808 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2700 2024-05-07T14:04:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.954040+0000", 2024-05-07T14:04:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7735000000000002e-05 2024-05-07T14:04:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958710+0000", 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046694220000000003 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958759+0000", 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8671999999999997e-05 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958778+0000", 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958955+0000", 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177197 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959253+0000", 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029744999999999999 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959545+0000", 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029215699999999997 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.969251+0000", 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097062789999999999 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982559+0000", 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013307818000000001 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982721+0000", 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016221200000000001 2024-05-07T14:04:13.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982836+0000", 2024-05-07T14:04:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114605 2024-05-07T14:04:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.814 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2782 3.5 3:a0760020:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.957030896999999, 2024-05-07T14:04:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029185556000000001, 2024-05-07T14:04:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2782 2024-05-07T14:04:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823757+0000", 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7330000000000001e-06 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829013+0000", 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052552889999999998 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829062+0000", 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9375000000000001e-05 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829089+0000", 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7143000000000001e-05 2024-05-07T14:04:13.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829248+0000", 2024-05-07T14:04:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015877 2024-05-07T14:04:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829262+0000", 2024-05-07T14:04:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.365e-05 2024-05-07T14:04:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835685+0000", 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064232339999999999 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835910+0000", 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022484800000000001 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.836115+0000", 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000204916 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.851571+0000", 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015456634 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852768+0000", 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001197264 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852867+0000", 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9011000000000005e-05 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852939+0000", 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1688999999999998e-05 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2793 3.30 3:0c9cfcfb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.831377710000002, 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028754691999999998, 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.821 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2793 2024-05-07T14:04:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949410+0000", 2024-05-07T14:04:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7239999999999998e-06 2024-05-07T14:04:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956008+0000", 2024-05-07T14:04:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065976560000000004 2024-05-07T14:04:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956068+0000", 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9781999999999998e-05 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956087+0000", 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9009999999999999e-05 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956241+0000", 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015391600000000001 2024-05-07T14:04:13.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956640+0000", 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039917499999999999 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956860+0000", 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021961499999999999 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.967010+0000", 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01015011 2024-05-07T14:04:13.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.977827+0000", 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010817148 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978012+0000", 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018541 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978161+0000", 2024-05-07T14:04:13.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014914600000000001 2024-05-07T14:04:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2815 3.2a 3:5644b81f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.605652616, 2024-05-07T14:04:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027617527999999999, 2024-05-07T14:04:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.827 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2815 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:13.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175136+0000", 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7869999999999999e-06 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179183+0000", 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004047358 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179215+0000", 2024-05-07T14:04:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1919999999999999e-05 2024-05-07T14:04:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179238+0000", 2024-05-07T14:04:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3036000000000001e-05 2024-05-07T14:04:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179367+0000", 2024-05-07T14:04:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128627 2024-05-07T14:04:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179613+0000", 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024667500000000002 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179847+0000", 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000233668 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.196418+0000", 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016571579999999999 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202617+0000", 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061980830000000001 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202688+0000", 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1481000000000002e-05 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202749+0000", 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1313000000000001e-05 2024-05-07T14:04:13.832 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2865 3.38 e105/21 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.195758125000001, 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032748549000000002, 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585029+0000", 2024-05-07T14:04:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9639999999999999e-06 2024-05-07T14:04:13.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589707+0000", 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046776889999999996 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589754+0000", 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7382000000000001e-05 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589780+0000", 2024-05-07T14:04:13.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5232000000000002e-05 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589966+0000", 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000186596 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.590031+0000", 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5038999999999999e-05 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617527+0000", 2024-05-07T14:04:13.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027496216 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617775+0000", 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247431 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2888 3.2 e105/46 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head v 105'8, mlcod=104'6)", 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.939695892, 2024-05-07T14:04:13.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.033929095999999999, 2024-05-07T14:04:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:13.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841091+0000", 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.39e-06 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.847981+0000", 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068900630000000001 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848020+0000", 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8846e-05 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848039+0000", 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848222+0000", 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018251300000000001 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848268+0000", 2024-05-07T14:04:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5552e-05 2024-05-07T14:04:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.874885+0000", 2024-05-07T14:04:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026617335999999998 2024-05-07T14:04:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.875018+0000", 2024-05-07T14:04:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013276999999999999 2024-05-07T14:04:13.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2894 3.16 3:6aec0fdf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.867049389000002, 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029574030000000001, 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.842 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2894 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913738+0000", 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.491e-06 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917692+0000", 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039540799999999996 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917718+0000", 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6211e-05 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917732+0000", 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4487999999999999e-05 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917897+0000", 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016455199999999999 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918296+0000", 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000398825 2024-05-07T14:04:13.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918724+0000", 2024-05-07T14:04:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042847399999999998 2024-05-07T14:04:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.933484+0000", 2024-05-07T14:04:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014759959 2024-05-07T14:04:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.942986+0000", 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095014739999999993 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943179+0000", 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019320200000000001 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943309+0000", 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013027399999999999 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.847 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2896 3.3a 3:5f842f5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.846289725999998, 2024-05-07T14:04:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028429466, 2024-05-07T14:04:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.848 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2896 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934498+0000", 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.557e-06 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939927+0000", 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054289250000000002 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939955+0000", 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8245000000000001e-05 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939971+0000", 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.504e-05 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940161+0000", 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019040499999999999 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940562+0000", 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040076800000000002 2024-05-07T14:04:13.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940979+0000", 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041760099999999997 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.950692+0000", 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097127529999999993 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962768+0000", 2024-05-07T14:04:13.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012075987 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962863+0000", 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5103000000000001e-05 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962924+0000", 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1081999999999996e-05 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2908 3.3a 3:5d7a0a59:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.694938387000001, 2024-05-07T14:04:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027562652999999999, 2024-05-07T14:04:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2908 2024-05-07T14:04:13.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085850+0000", 2024-05-07T14:04:13.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.267e-06 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091371+0000", 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055205619999999997 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091411+0000", 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0365999999999999e-05 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091432+0000", 2024-05-07T14:04:13.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0276e-05 2024-05-07T14:04:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091608+0000", 2024-05-07T14:04:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176653 2024-05-07T14:04:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.092025+0000", 2024-05-07T14:04:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041696799999999998 2024-05-07T14:04:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.092418+0000", 2024-05-07T14:04:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000393099 2024-05-07T14:04:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.102443+0000", 2024-05-07T14:04:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010024798999999999 2024-05-07T14:04:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113230+0000", 2024-05-07T14:04:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010786963 2024-05-07T14:04:13.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113330+0000", 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9808000000000004e-05 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113409+0000", 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8892000000000003e-05 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3197 3.d e113/21 3:b35829be:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_89:head v 113'16, mlcod=113'14)", 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4456052770000003, 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029081169, 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335182+0000", 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7329999999999999e-06 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338859+0000", 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036773589999999998 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338896+0000", 2024-05-07T14:04:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6656000000000003e-05 2024-05-07T14:04:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338922+0000", 2024-05-07T14:04:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5936999999999999e-05 2024-05-07T14:04:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339046+0000", 2024-05-07T14:04:13.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012458400000000001 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339089+0000", 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2342999999999998e-05 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.364123+0000", 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025034187999999999 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.364260+0000", 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013736900000000001 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3210 3.2f 3:f67c3789:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.3138415209999996, 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042403633000000003, 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.864 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3210 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466947+0000", 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5669999999999999e-06 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471128+0000", 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041817620000000003 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471175+0000", 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6279000000000002e-05 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471200+0000", 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5177e-05 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471361+0000", 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160848 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471379+0000", 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8142e-05 2024-05-07T14:04:13.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.479968+0000", 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085897040000000001 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.480366+0000", 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039736399999999999 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.480736+0000", 2024-05-07T14:04:13.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037031899999999998 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.495479+0000", 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014742992 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509169+0000", 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013690179 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509268+0000", 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8814999999999995e-05 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509347+0000", 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8485000000000005e-05 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3602 3.5 3:a2d0df3e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_483:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.132400+0000", 2024-05-07T14:04:13.870 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.6483846039999999, 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027859134000000001, 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3602 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.132400+0000", 2024-05-07T14:04:13.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.132400+0000", 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.132404+0000", 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8160000000000004e-06 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.136457+0000", 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040533849999999996 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.136498+0000", 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1059000000000001e-05 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.136526+0000", 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7520000000000001e-05 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.136700+0000", 2024-05-07T14:04:13.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017472399999999999 2024-05-07T14:04:13.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.137075+0000", 2024-05-07T14:04:13.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037488799999999998 2024-05-07T14:04:13.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:13.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.137366+0000", 2024-05-07T14:04:13.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000290613 2024-05-07T14:04:13.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.148499+0000", 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011133077 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.160042+0000", 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011542682 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.160135+0000", 2024-05-07T14:04:13.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3745000000000005e-05 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.160259+0000", 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012362500000000001 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3604 3.1c 3:3a3fe722:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_485:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.152001+0000", 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.6287829660000002, 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038767554000000003, 2024-05-07T14:04:13.876 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.877 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.877 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.877 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.877 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.877 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.877 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3604 2024-05-07T14:04:13.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.877 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.152001+0000", 2024-05-07T14:04:13.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.152001+0000", 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.152004+0000", 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8899999999999999e-06 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.156819+0000", 2024-05-07T14:04:13.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048148369999999998 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.156860+0000", 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0355999999999998e-05 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.156878+0000", 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.878e-05 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157060+0000", 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181991 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157341+0000", 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028081599999999998 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157583+0000", 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241506 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.169148+0000", 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011565242 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190604+0000", 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021456052 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190700+0000", 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6164999999999998e-05 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190769+0000", 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8918999999999995e-05 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3611 3.16 3:6a1fde75:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_492:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.231125+0000", 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.549659262, 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032234160999999997, 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:13.882 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3611 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.231125+0000", 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.231125+0000", 2024-05-07T14:04:13.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.231130+0000", 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9629999999999997e-06 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235158+0000", 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040282679999999998 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:13.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235197+0000", 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8654e-05 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235216+0000", 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9099000000000001e-05 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235350+0000", 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013348200000000001 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:13.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235617+0000", 2024-05-07T14:04:13.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026753900000000001 2024-05-07T14:04:13.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:13.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235861+0000", 2024-05-07T14:04:13.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024357299999999999 2024-05-07T14:04:13.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:13.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.249418+0000", 2024-05-07T14:04:13.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013557394 2024-05-07T14:04:13.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.263075+0000", 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013656423000000001 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.263246+0000", 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000170944 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.263359+0000", 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113822 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.887 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.888 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.888 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:13.888 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:13.888 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:13.889 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:04:13.890 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:13.899+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:13.990 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:13.999+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:14.060 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:14.060 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:14.061 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:14.061 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:14.074 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:04:14.110 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:04:14.116 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:14.127+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:14.192 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:14.199+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:14.239 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:14.239 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:14.239 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:14.239 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:14.239 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:14.253 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:04:14.253 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:14.254 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:14.269 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:14.269 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:14.285 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:14.285 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:14.293 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:14.306+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:14.303 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:14.303 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:14.322 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:14.323 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:14.340 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:14.341 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:14.360 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:14.360 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:14.379 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:04:14.379 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:04:14.393 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:14.406+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:14.420 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:14.420 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:14.434 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:04:14.494 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:14.503+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:14.555 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:14.556 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:14.570 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:04:14.595 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:14.606+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:14.695 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:14.706+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:14.738 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:14.738 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:14.752 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:04:14.796 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:14.810+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:14.870 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:14.870 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:14.885 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:04:14.932 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:14.946+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:14.998 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:15.010+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:15.014 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:15.014 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:15.027 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:04:15.112 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:15.126+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:15.191 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:15.192 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:15.199 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:15.210+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:15.206 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:04:15.300 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:15.307+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:15.380 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:15.380 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:15.394 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:04:15.401 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:15.415+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:15.446 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:04:15.502 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:15.511+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:15.518 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:15.518 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:15.533 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:04:15.603 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:15.611+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:15.654 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:15.654 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:15.668 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:04:15.703 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:15.715+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:15.783 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:15.783 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:15.797 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:04:15.804 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:15.815+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:15.905 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:15.918+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:15.917 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:15.917 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:15.931 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:04:16.016 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:16.030+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:16.094 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:16.094 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:16.107 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:16.115+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:16.108 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:04:16.207 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:16.215+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:16.269 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:16.269 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:16.283 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:04:16.309 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:16.319+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:16.396 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:04:16.405 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:16.405 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:16.409 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:16.422+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:16.415 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:04:16.422 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:04:16.528 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:16.542+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:16.557 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:16.557 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:16.574 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:16.574 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:16.591 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:16.591 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:16.607 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:16.610 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:16.610 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:16.610 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:16.610 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:16.610 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:16.611 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:16.619+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:16.624 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:04:16.628 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:16.649 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:16.670 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:16.670 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:16.691 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:04:16.691 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:04:16.712 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:16.722+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:16.753 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:16.753 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:16.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:16.753 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:16.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.754 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:04:16.754 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:16.754 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.460877389000004, 2024-05-07T14:04:16.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:04:16.754 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.754 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.754 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.754 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.754 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.754 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.754 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:04:16.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:04:16.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:04:16.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:04:16.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:04:16.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:04:16.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:04:16.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:04:16.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:04:16.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:16.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:04:16.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:04:16.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:04:16.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:04:16.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:04:16.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:04:16.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:04:16.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:04:16.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:04:16.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:04:16.759 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.760 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.760 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.760 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2203 3.1e 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:16.760 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:16.760 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.471161045000002, 2024-05-07T14:04:16.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029129142, 2024-05-07T14:04:16.760 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.760 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.760 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.760 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.760 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.761 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.761 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2203 2024-05-07T14:04:16.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.761 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:16.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:16.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294465+0000", 2024-05-07T14:04:16.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7699999999999999e-06 2024-05-07T14:04:16.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300328+0000", 2024-05-07T14:04:16.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058633460000000002 2024-05-07T14:04:16.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300384+0000", 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6212999999999999e-05 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300411+0000", 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7109000000000001e-05 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300586+0000", 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017478799999999999 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300941+0000", 2024-05-07T14:04:16.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035515500000000001 2024-05-07T14:04:16.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:16.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301351+0000", 2024-05-07T14:04:16.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040996099999999997 2024-05-07T14:04:16.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.317495+0000", 2024-05-07T14:04:16.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016143462000000001 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323421+0000", 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059264649999999997 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323498+0000", 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6478999999999997e-05 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323590+0000", 2024-05-07T14:04:16.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2393999999999997e-05 2024-05-07T14:04:16.766 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.766 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.766 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.766 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2230 3.b 3:d16eb33d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:16.766 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:16.766 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 73.095254374999996, 2024-05-07T14:04:16.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021351564, 2024-05-07T14:04:16.766 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.766 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.766 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.767 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.767 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.767 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.767 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2230 2024-05-07T14:04:16.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.767 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:16.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670370+0000", 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5050000000000002e-06 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673214+0000", 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028441260000000002 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673245+0000", 2024-05-07T14:04:16.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0488999999999999e-05 2024-05-07T14:04:16.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673259+0000", 2024-05-07T14:04:16.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4443e-05 2024-05-07T14:04:16.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.769 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.769 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673356+0000", 2024-05-07T14:04:16.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7031e-05 2024-05-07T14:04:16.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673531+0000", 2024-05-07T14:04:16.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017509099999999999 2024-05-07T14:04:16.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:16.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.673696+0000", 2024-05-07T14:04:16.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000164306 2024-05-07T14:04:16.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.684776+0000", 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011080054000000001 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691578+0000", 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0068025849999999999 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691659+0000", 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0976000000000005e-05 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.691719+0000", 2024-05-07T14:04:16.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9957999999999998e-05 2024-05-07T14:04:16.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.772 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.772 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2666 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:16.772 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:16.772 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.113797489, 2024-05-07T14:04:16.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.125351252, 2024-05-07T14:04:16.772 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.773 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.773 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:16.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.773 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2666 2024-05-07T14:04:16.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.773 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:16.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:16.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651827+0000", 2024-05-07T14:04:16.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-06 2024-05-07T14:04:16.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651834+0000", 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7700000000000001e-06 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651850+0000", 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5755000000000001e-05 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651862+0000", 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.237e-05 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.775 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651967+0000", 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010427199999999999 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651977+0000", 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0743e-05 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657294+0000", 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053168069999999998 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657305+0000", 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0662000000000001e-05 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774211+0000", 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1169060209999999 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774394+0000", 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018268000000000001 2024-05-07T14:04:16.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.777176+0000", 2024-05-07T14:04:16.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002782025 2024-05-07T14:04:16.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.778 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2673 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:16.778 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:16.778 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 36.569864301999999, 2024-05-07T14:04:16.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57934507999999996, 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2673 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9699999999999996e-07 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195761+0000", 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2569999999999999e-06 2024-05-07T14:04:16.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195768+0000", 2024-05-07T14:04:16.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.489e-06 2024-05-07T14:04:16.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195774+0000", 2024-05-07T14:04:16.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7389999999999996e-06 2024-05-07T14:04:16.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.781 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.781 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195866+0000", 2024-05-07T14:04:16.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2349000000000006e-05 2024-05-07T14:04:16.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:16.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195878+0000", 2024-05-07T14:04:16.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1838000000000001e-05 2024-05-07T14:04:16.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774802+0000", 2024-05-07T14:04:16.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.578923945 2024-05-07T14:04:16.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774906+0000", 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103991 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775103+0000", 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196975 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.783 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2684 3.24 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.979503391000001, 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.040396402999999997, 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2684 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786122+0000", 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0929999999999999e-06 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788626+0000", 2024-05-07T14:04:16.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025042720000000001 2024-05-07T14:04:16.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788659+0000", 2024-05-07T14:04:16.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2824999999999998e-05 2024-05-07T14:04:16.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788673+0000", 2024-05-07T14:04:16.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4721e-05 2024-05-07T14:04:16.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788768+0000", 2024-05-07T14:04:16.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4178999999999994e-05 2024-05-07T14:04:16.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.787 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:16.787 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788776+0000", 2024-05-07T14:04:16.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2400000000000007e-06 2024-05-07T14:04:16.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798002+0000", 2024-05-07T14:04:16.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092262230000000004 2024-05-07T14:04:16.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798163+0000", 2024-05-07T14:04:16.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161077 2024-05-07T14:04:16.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:16.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798305+0000", 2024-05-07T14:04:16.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014162499999999999 2024-05-07T14:04:16.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.807567+0000", 2024-05-07T14:04:16.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092618869999999999 2024-05-07T14:04:16.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826429+0000", 2024-05-07T14:04:16.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018862824 2024-05-07T14:04:16.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826470+0000", 2024-05-07T14:04:16.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1010999999999997e-05 2024-05-07T14:04:16.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826515+0000", 2024-05-07T14:04:16.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4425999999999998e-05 2024-05-07T14:04:16.790 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.790 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.790 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.791 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2700 3.c e104/21 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:16.791 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:16.791 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.805656745, 2024-05-07T14:04:16.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022078321000000001, 2024-05-07T14:04:16.791 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.791 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.791 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.791 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:16.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:16.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.959965+0000", 2024-05-07T14:04:16.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9299999999999999e-07 2024-05-07T14:04:16.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966313+0000", 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0063471889999999996 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966340+0000", 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7514000000000001e-05 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966354+0000", 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4053000000000001e-05 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966434+0000", 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0273999999999997e-05 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.966464+0000", 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.953e-05 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.981968+0000", 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0155037 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.982043+0000", 2024-05-07T14:04:16.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5767999999999997e-05 2024-05-07T14:04:16.795 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.795 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.795 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.795 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2712 3.15 e104/21 3:a83036f0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_29:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:16.795 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:04:16.795 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 32.662266942000002, 2024-05-07T14:04:16.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021527713, 2024-05-07T14:04:16.795 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.796 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.796 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.796 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:04:16.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103355+0000", 2024-05-07T14:04:16.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.103357+0000", 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7260000000000001e-06 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107529+0000", 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041726999999999997 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107551+0000", 2024-05-07T14:04:16.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1854000000000001e-05 2024-05-07T14:04:16.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107563+0000", 2024-05-07T14:04:16.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1362999999999999e-05 2024-05-07T14:04:16.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107633+0000", 2024-05-07T14:04:16.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0432999999999995e-05 2024-05-07T14:04:16.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.107652+0000", 2024-05-07T14:04:16.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9250999999999999e-05 2024-05-07T14:04:16.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124797+0000", 2024-05-07T14:04:16.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017144626 2024-05-07T14:04:16.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.124883+0000", 2024-05-07T14:04:16.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5760000000000006e-05 2024-05-07T14:04:16.800 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.800 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.800 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.800 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2791 3.27 3:e46b1707:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:16.800 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:16.800 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 31.836368399000001, 2024-05-07T14:04:16.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022300529999999999, 2024-05-07T14:04:16.800 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.800 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.800 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.801 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.801 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.801 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.801 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2791 2024-05-07T14:04:16.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.801 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:16.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:16.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929257+0000", 2024-05-07T14:04:16.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.281e-06 2024-05-07T14:04:16.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931305+0000", 2024-05-07T14:04:16.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020483020000000001 2024-05-07T14:04:16.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931328+0000", 2024-05-07T14:04:16.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2722e-05 2024-05-07T14:04:16.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.803 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931341+0000", 2024-05-07T14:04:16.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3529e-05 2024-05-07T14:04:16.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.803 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931415+0000", 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3597999999999996e-05 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931614+0000", 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019859000000000001 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931758+0000", 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014481699999999999 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.939706+0000", 2024-05-07T14:04:16.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007948063 2024-05-07T14:04:16.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951424+0000", 2024-05-07T14:04:16.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011717708 2024-05-07T14:04:16.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951500+0000", 2024-05-07T14:04:16.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5831e-05 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951554+0000", 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4088999999999997e-05 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2864 3.29 3:97632e4b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 31.190614768, 2024-05-07T14:04:16.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021723981, 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2864 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575007+0000", 2024-05-07T14:04:16.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.575010+0000", 2024-05-07T14:04:16.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5660000000000001e-06 2024-05-07T14:04:16.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576737+0000", 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017271599999999999 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576768+0000", 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1424000000000003e-05 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576783+0000", 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4656e-05 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.576880+0000", 2024-05-07T14:04:16.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6576999999999994e-05 2024-05-07T14:04:16.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577067+0000", 2024-05-07T14:04:16.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018795800000000001 2024-05-07T14:04:16.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:16.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.577285+0000", 2024-05-07T14:04:16.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021768499999999999 2024-05-07T14:04:16.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.587487+0000", 2024-05-07T14:04:16.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010202289 2024-05-07T14:04:16.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596612+0000", 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0091244440000000007 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596681+0000", 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9025999999999999e-05 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.596731+0000", 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0195999999999998e-05 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.812 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.813 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.813 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2865 3.38 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:16.813 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:16.813 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 31.182997109999999, 2024-05-07T14:04:16.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.035746371999999998, 2024-05-07T14:04:16.813 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.814 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.814 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.814 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.814 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.814 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.814 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2865 2024-05-07T14:04:16.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.814 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:16.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:16.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582627+0000", 2024-05-07T14:04:16.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:04:16.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584611+0000", 2024-05-07T14:04:16.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019836350000000001 2024-05-07T14:04:16.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584636+0000", 2024-05-07T14:04:16.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4943000000000002e-05 2024-05-07T14:04:16.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584652+0000", 2024-05-07T14:04:16.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5586e-05 2024-05-07T14:04:16.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584733+0000", 2024-05-07T14:04:16.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0987000000000002e-05 2024-05-07T14:04:16.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584881+0000", 2024-05-07T14:04:16.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014805800000000001 2024-05-07T14:04:16.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:16.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584972+0000", 2024-05-07T14:04:16.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1218999999999995e-05 2024-05-07T14:04:16.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.591149+0000", 2024-05-07T14:04:16.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061766939999999999 2024-05-07T14:04:16.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618207+0000", 2024-05-07T14:04:16.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027058260000000001 2024-05-07T14:04:16.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618319+0000", 2024-05-07T14:04:16.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011267700000000001 2024-05-07T14:04:16.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618371+0000", 2024-05-07T14:04:16.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1683e-05 2024-05-07T14:04:16.821 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.821 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.821 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.822 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2883 3.29 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:16.822 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:16.822 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.987833471999998, 2024-05-07T14:04:16.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025309511999999999, 2024-05-07T14:04:16.822 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.822 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.823 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.823 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.823 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.823 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.823 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2883 2024-05-07T14:04:16.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.823 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:16.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777791+0000", 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.289e-06 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779027+0000", 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001236411 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779063+0000", 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5658999999999999e-05 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779076+0000", 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3128e-05 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779166+0000", 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9818e-05 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779398+0000", 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023189400000000001 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779577+0000", 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000179276 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.786782+0000", 2024-05-07T14:04:16.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072052740000000002 2024-05-07T14:04:16.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.802960+0000", 2024-05-07T14:04:16.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016177490999999999 2024-05-07T14:04:16.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803047+0000", 2024-05-07T14:04:16.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6912999999999999e-05 2024-05-07T14:04:16.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803098+0000", 2024-05-07T14:04:16.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1359000000000001e-05 2024-05-07T14:04:16.828 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.828 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.828 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.828 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2905 3.1e 3:78954da1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:16.828 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:16.828 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 30.714425233, 2024-05-07T14:04:16.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028568698, 2024-05-07T14:04:16.829 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.829 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.829 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.829 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2905 2024-05-07T14:04:16.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.829 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051199+0000", 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5299999999999999e-06 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055400+0000", 2024-05-07T14:04:16.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042009889999999996 2024-05-07T14:04:16.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055458+0000", 2024-05-07T14:04:16.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.736e-05 2024-05-07T14:04:16.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055486+0000", 2024-05-07T14:04:16.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8914000000000001e-05 2024-05-07T14:04:16.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055574+0000", 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7120999999999995e-05 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055726+0000", 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015249600000000001 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055884+0000", 2024-05-07T14:04:16.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015788900000000001 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.064235+0000", 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008350583 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078705+0000", 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014470129999999999 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078900+0000", 2024-05-07T14:04:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019521799999999999 2024-05-07T14:04:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.079765+0000", 2024-05-07T14:04:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00086546799999999999 2024-05-07T14:04:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3240 3.33 3:cd111f2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.788271+0000", 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.9773504230000007, 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026491491999999998, 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3240 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.788271+0000", 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.788271+0000", 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.788275+0000", 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2399999999999999e-06 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791613+0000", 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033385329999999999 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791645+0000", 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1602e-05 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791659+0000", 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4596999999999999e-05 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791766+0000", 2024-05-07T14:04:16.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106043 2024-05-07T14:04:16.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791961+0000", 2024-05-07T14:04:16.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019581399999999999 2024-05-07T14:04:16.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:16.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.792139+0000", 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017790899999999999 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.804241+0000", 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012101519999999999 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.814683+0000", 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010442158999999999 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.814728+0000", 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5456e-05 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.814763+0000", 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4619000000000002e-05 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3241 3.33 3:cda6606c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.798545+0000", 2024-05-07T14:04:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.9670772329999995, 2024-05-07T14:04:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021264295999999999, 2024-05-07T14:04:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3241 2024-05-07T14:04:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.798545+0000", 2024-05-07T14:04:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.798545+0000", 2024-05-07T14:04:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.798547+0000", 2024-05-07T14:04:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3029999999999998e-06 2024-05-07T14:04:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.800726+0000", 2024-05-07T14:04:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021789489999999999 2024-05-07T14:04:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.800745+0000", 2024-05-07T14:04:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8711000000000001e-05 2024-05-07T14:04:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.800754+0000", 2024-05-07T14:04:16.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8539999999999992e-06 2024-05-07T14:04:16.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.800825+0000", 2024-05-07T14:04:16.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0217999999999998e-05 2024-05-07T14:04:16.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.800965+0000", 2024-05-07T14:04:16.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014002200000000001 2024-05-07T14:04:16.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:16.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.801110+0000", 2024-05-07T14:04:16.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145499 2024-05-07T14:04:16.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.806952+0000", 2024-05-07T14:04:16.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058421510000000003 2024-05-07T14:04:16.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.819743+0000", 2024-05-07T14:04:16.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012790345999999999 2024-05-07T14:04:16.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.819781+0000", 2024-05-07T14:04:16.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7886999999999998e-05 2024-05-07T14:04:16.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.819809+0000", 2024-05-07T14:04:16.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8356000000000001e-05 2024-05-07T14:04:16.847 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.847 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.847 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.848 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3248 3.33 3:cd0a349a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:16.848 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.881531+0000", 2024-05-07T14:04:16.848 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.8840912309999993, 2024-05-07T14:04:16.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022568742999999999, 2024-05-07T14:04:16.848 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.848 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.848 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.848 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.848 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.848 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.848 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3248 2024-05-07T14:04:16.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.849 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.881531+0000", 2024-05-07T14:04:16.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.881531+0000", 2024-05-07T14:04:16.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.881532+0000", 2024-05-07T14:04:16.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7430000000000001e-06 2024-05-07T14:04:16.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883223+0000", 2024-05-07T14:04:16.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001690799 2024-05-07T14:04:16.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883253+0000", 2024-05-07T14:04:16.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9365000000000001e-05 2024-05-07T14:04:16.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883265+0000", 2024-05-07T14:04:16.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2267e-05 2024-05-07T14:04:16.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883342+0000", 2024-05-07T14:04:16.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7200999999999995e-05 2024-05-07T14:04:16.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883469+0000", 2024-05-07T14:04:16.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012662099999999999 2024-05-07T14:04:16.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:16.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883608+0000", 2024-05-07T14:04:16.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000139493 2024-05-07T14:04:16.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.889589+0000", 2024-05-07T14:04:16.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059812320000000004 2024-05-07T14:04:16.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.903960+0000", 2024-05-07T14:04:16.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014370186 2024-05-07T14:04:16.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904062+0000", 2024-05-07T14:04:16.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102056 2024-05-07T14:04:16.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904099+0000", 2024-05-07T14:04:16.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7780000000000001e-05 2024-05-07T14:04:16.855 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.855 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.855 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.855 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3277 3.b 3:d1f9c1c7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:16.855 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.317440+0000", 2024-05-07T14:04:16.855 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.4481822829999995, 2024-05-07T14:04:16.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025103065000000001, 2024-05-07T14:04:16.856 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.856 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.856 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.856 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.856 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.856 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.856 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3277 2024-05-07T14:04:16.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.856 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.317440+0000", 2024-05-07T14:04:16.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.317440+0000", 2024-05-07T14:04:16.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.317443+0000", 2024-05-07T14:04:16.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2969999999999999e-06 2024-05-07T14:04:16.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320371+0000", 2024-05-07T14:04:16.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029279280000000002 2024-05-07T14:04:16.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320424+0000", 2024-05-07T14:04:16.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2972e-05 2024-05-07T14:04:16.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320451+0000", 2024-05-07T14:04:16.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7056e-05 2024-05-07T14:04:16.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320604+0000", 2024-05-07T14:04:16.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152688 2024-05-07T14:04:16.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320950+0000", 2024-05-07T14:04:16.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00034685400000000001 2024-05-07T14:04:16.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:16.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.321362+0000", 2024-05-07T14:04:16.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041191300000000003 2024-05-07T14:04:16.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.340027+0000", 2024-05-07T14:04:16.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018665010999999999 2024-05-07T14:04:16.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342301+0000", 2024-05-07T14:04:16.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022736750000000002 2024-05-07T14:04:16.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342433+0000", 2024-05-07T14:04:16.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000131712 2024-05-07T14:04:16.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342543+0000", 2024-05-07T14:04:16.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000109959 2024-05-07T14:04:16.862 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.862 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.862 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.862 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3288 3.7 3:e3df0df9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:16.862 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.487335+0000", 2024-05-07T14:04:16.862 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 8.2782865809999997, 2024-05-07T14:04:16.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022910593999999999, 2024-05-07T14:04:16.862 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.862 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3288 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.487335+0000", 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.487335+0000", 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.487339+0000", 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1139999999999999e-06 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490002+0000", 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026621510000000002 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490040+0000", 2024-05-07T14:04:16.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8575000000000003e-05 2024-05-07T14:04:16.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490058+0000", 2024-05-07T14:04:16.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:04:16.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490206+0000", 2024-05-07T14:04:16.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014781899999999999 2024-05-07T14:04:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490531+0000", 2024-05-07T14:04:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032532500000000001 2024-05-07T14:04:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490865+0000", 2024-05-07T14:04:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000333319 2024-05-07T14:04:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.501257+0000", 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010392083 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.509955+0000", 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086984690000000003 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.510124+0000", 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016896700000000001 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.510246+0000", 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121694 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3319 3.33 3:cda0bc3e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.050548+0000", 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 7.7150742330000002, 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022485041000000001, 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.868 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3319 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.050548+0000", 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.050548+0000", 2024-05-07T14:04:16.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.050552+0000", 2024-05-07T14:04:16.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3669999999999999e-06 2024-05-07T14:04:16.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054164+0000", 2024-05-07T14:04:16.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036120660000000001 2024-05-07T14:04:16.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054218+0000", 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3507000000000001e-05 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054245+0000", 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7002e-05 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054387+0000", 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142306 2024-05-07T14:04:16.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054620+0000", 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023293700000000001 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054829+0000", 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020874500000000001 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.062575+0000", 2024-05-07T14:04:16.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077465930000000004 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.072708+0000", 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010132482999999999 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.072898+0000", 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018985700000000001 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.073033+0000", 2024-05-07T14:04:16.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013517800000000001 2024-05-07T14:04:16.874 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.874 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.874 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.874 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3602 3.5 e115/21 3:a2d0df3e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_483:head v 115'13, mlcod=115'11)", 2024-05-07T14:04:16.874 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:12.137890+0000", 2024-05-07T14:04:16.874 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.6277323299999997, 2024-05-07T14:04:16.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021333174, 2024-05-07T14:04:16.874 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:16.874 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.137890+0000", 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.137890+0000", 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.137892+0000", 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0379999999999998e-06 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.141960+0000", 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040683309999999997 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.141997+0000", 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6993999999999999e-05 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.142013+0000", 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5846e-05 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.142108+0000", 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5529e-05 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.142141+0000", 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2817000000000001e-05 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:16.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.159162+0000", 2024-05-07T14:04:16.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017021273999999999 2024-05-07T14:04:16.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:16.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:16.878 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:16.878 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.159223+0000", 2024-05-07T14:04:16.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0344999999999999e-05 2024-05-07T14:04:16.878 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.878 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.878 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.878 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:16.878 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:16.879 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:16.880 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:04:16.881 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:16.891+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:16.981 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:16.994+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:17.012 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:17.012 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:17.012 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:17.013 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:17.026 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:04:17.082 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:17.094+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:17.142 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:17.142 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:17.142 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:17.143 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:17.143 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:17.156 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:04:17.183 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:17.194+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:17.277 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:17.278 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:17.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:17.278 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:17.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.278 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2224 3.1a 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:17.278 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:17.278 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.699918910999997, 2024-05-07T14:04:17.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027796929000000001, 2024-05-07T14:04:17.278 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.278 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.279 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.279 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.279 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.279 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2224 2024-05-07T14:04:17.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.279 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:17.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:17.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588348+0000", 2024-05-07T14:04:17.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1629999999999998e-06 2024-05-07T14:04:17.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594043+0000", 2024-05-07T14:04:17.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056948950000000002 2024-05-07T14:04:17.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594085+0000", 2024-05-07T14:04:17.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1678999999999999e-05 2024-05-07T14:04:17.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594113+0000", 2024-05-07T14:04:17.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:04:17.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594221+0000", 2024-05-07T14:04:17.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107371 2024-05-07T14:04:17.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594405+0000", 2024-05-07T14:04:17.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018468099999999999 2024-05-07T14:04:17.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:17.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594570+0000", 2024-05-07T14:04:17.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165224 2024-05-07T14:04:17.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.603655+0000", 2024-05-07T14:04:17.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090846550000000005 2024-05-07T14:04:17.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.615968+0000", 2024-05-07T14:04:17.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012313199 2024-05-07T14:04:17.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616069+0000", 2024-05-07T14:04:17.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100309 2024-05-07T14:04:17.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616141+0000", 2024-05-07T14:04:17.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2218999999999994e-05 2024-05-07T14:04:17.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.284 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2229 3.3 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.628622383000007, 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028304669000000001, 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.285 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2229 2024-05-07T14:04:17.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.286 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:17.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:17.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659643+0000", 2024-05-07T14:04:17.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9129999999999999e-06 2024-05-07T14:04:17.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664151+0000", 2024-05-07T14:04:17.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045081189999999997 2024-05-07T14:04:17.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664198+0000", 2024-05-07T14:04:17.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6431999999999999e-05 2024-05-07T14:04:17.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664223+0000", 2024-05-07T14:04:17.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5369999999999999e-05 2024-05-07T14:04:17.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664313+0000", 2024-05-07T14:04:17.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345999999999995e-05 2024-05-07T14:04:17.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664428+0000", 2024-05-07T14:04:17.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115058 2024-05-07T14:04:17.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:17.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664566+0000", 2024-05-07T14:04:17.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138598 2024-05-07T14:04:17.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.671674+0000", 2024-05-07T14:04:17.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071074529999999997 2024-05-07T14:04:17.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687772+0000", 2024-05-07T14:04:17.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016098359 2024-05-07T14:04:17.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687871+0000", 2024-05-07T14:04:17.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9098000000000006e-05 2024-05-07T14:04:17.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687945+0000", 2024-05-07T14:04:17.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3923000000000004e-05 2024-05-07T14:04:17.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.291 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.291 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2684 3.24 e104/21 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:17.291 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:17.291 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.489661923, 2024-05-07T14:04:17.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026848770000000001, 2024-05-07T14:04:17.292 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.292 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.292 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.292 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:17.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:17.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6000000000000004e-07 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810718+0000", 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012116477 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810747+0000", 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8676000000000001e-05 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810791+0000", 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4415000000000001e-05 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810915+0000", 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012363399999999999 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810950+0000", 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5812999999999997e-05 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825326+0000", 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014375852 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825450+0000", 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012334299999999999 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.295 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2685 3.1c e104/21 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head v 104'1, mlcod=0'0)", 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.482826250999999, 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023842609000000001, 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805438+0000", 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.243e-06 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812353+0000", 2024-05-07T14:04:17.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069150560000000002 2024-05-07T14:04:17.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812385+0000", 2024-05-07T14:04:17.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2583000000000003e-05 2024-05-07T14:04:17.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812406+0000", 2024-05-07T14:04:17.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0378999999999999e-05 2024-05-07T14:04:17.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812541+0000", 2024-05-07T14:04:17.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013502699999999999 2024-05-07T14:04:17.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812591+0000", 2024-05-07T14:04:17.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0522999999999997e-05 2024-05-07T14:04:17.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829183+0000", 2024-05-07T14:04:17.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016591445999999999 2024-05-07T14:04:17.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829279+0000", 2024-05-07T14:04:17.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6352000000000002e-05 2024-05-07T14:04:17.300 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.300 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.300 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.300 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2686 3.34 3:2ec0e822:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:17.300 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:17.300 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.479611781000003, 2024-05-07T14:04:17.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034864805999999998, 2024-05-07T14:04:17.301 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.301 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.301 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.301 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.301 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.301 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.301 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2686 2024-05-07T14:04:17.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.301 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:17.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:17.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808656+0000", 2024-05-07T14:04:17.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6029999999999998e-06 2024-05-07T14:04:17.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818059+0000", 2024-05-07T14:04:17.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094034429999999992 2024-05-07T14:04:17.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818114+0000", 2024-05-07T14:04:17.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4625e-05 2024-05-07T14:04:17.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818139+0000", 2024-05-07T14:04:17.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4850000000000001e-05 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819387+0000", 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012488060000000001 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819792+0000", 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040472400000000002 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:17.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820050+0000", 2024-05-07T14:04:17.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025799800000000001 2024-05-07T14:04:17.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.833596+0000", 2024-05-07T14:04:17.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013546069000000001 2024-05-07T14:04:17.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843174+0000", 2024-05-07T14:04:17.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095773449999999993 2024-05-07T14:04:17.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:04:17.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023329199999999999 2024-05-07T14:04:17.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843516+0000", 2024-05-07T14:04:17.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109051 2024-05-07T14:04:17.306 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.306 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.306 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.307 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2696 3.14 3:2aeb6272:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:17.307 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:17.307 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.375226941000001, 2024-05-07T14:04:17.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022593715, 2024-05-07T14:04:17.307 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.307 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.307 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.307 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.307 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.307 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.307 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2696 2024-05-07T14:04:17.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.308 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:17.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:17.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913039+0000", 2024-05-07T14:04:17.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3730000000000001e-06 2024-05-07T14:04:17.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917057+0000", 2024-05-07T14:04:17.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040181319999999998 2024-05-07T14:04:17.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917099+0000", 2024-05-07T14:04:17.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.155e-05 2024-05-07T14:04:17.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917118+0000", 2024-05-07T14:04:17.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8862e-05 2024-05-07T14:04:17.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917285+0000", 2024-05-07T14:04:17.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016734000000000001 2024-05-07T14:04:17.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917644+0000", 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035872600000000002 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.918201+0000", 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055705100000000003 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.934860+0000", 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016658665 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935461+0000", 2024-05-07T14:04:17.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060165000000000001 2024-05-07T14:04:17.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935559+0000", 2024-05-07T14:04:17.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8255e-05 2024-05-07T14:04:17.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935630+0000", 2024-05-07T14:04:17.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0110999999999993e-05 2024-05-07T14:04:17.313 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.313 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.313 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.313 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2755 3.14 3:2b7affc7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:17.313 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:17.313 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.747300066000001, 2024-05-07T14:04:17.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023747145000000001, 2024-05-07T14:04:17.313 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.313 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.313 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.313 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.314 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.314 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.314 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2755 2024-05-07T14:04:17.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.314 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:17.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540983+0000", 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0466999999999999e-05 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545846+0000", 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048626709999999998 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545883+0000", 2024-05-07T14:04:17.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6769e-05 2024-05-07T14:04:17.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545900+0000", 2024-05-07T14:04:17.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6869999999999999e-05 2024-05-07T14:04:17.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546070+0000", 2024-05-07T14:04:17.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017014299999999999 2024-05-07T14:04:17.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546329+0000", 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025910400000000002 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546560+0000", 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023119899999999999 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.555774+0000", 2024-05-07T14:04:17.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092136490000000008 2024-05-07T14:04:17.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564539+0000", 2024-05-07T14:04:17.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087649870000000001 2024-05-07T14:04:17.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564638+0000", 2024-05-07T14:04:17.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9028000000000001e-05 2024-05-07T14:04:17.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564710+0000", 2024-05-07T14:04:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2257999999999998e-05 2024-05-07T14:04:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2799 3.9 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.275903255999999, 2024-05-07T14:04:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027222948, 2024-05-07T14:04:17.319 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2799 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:17.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012363+0000", 2024-05-07T14:04:17.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6500000000000002e-06 2024-05-07T14:04:17.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016678+0000", 2024-05-07T14:04:17.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043148320000000002 2024-05-07T14:04:17.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016709+0000", 2024-05-07T14:04:17.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0953e-05 2024-05-07T14:04:17.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016726+0000", 2024-05-07T14:04:17.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7022999999999999e-05 2024-05-07T14:04:17.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016864+0000", 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137854 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017108+0000", 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024388099999999999 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017333+0000", 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022492899999999999 2024-05-07T14:04:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.033051+0000", 2024-05-07T14:04:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015718352000000001 2024-05-07T14:04:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039272+0000", 2024-05-07T14:04:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062205139999999999 2024-05-07T14:04:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039451+0000", 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017928 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039583+0000", 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013168000000000001 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2804 3.e e105/21 3:7356dc96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_121:head v 105'10, mlcod=105'8)", 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:17.325 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.214966513, 2024-05-07T14:04:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029282694000000001, 2024-05-07T14:04:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:17.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073299+0000", 2024-05-07T14:04:17.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:04:17.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076073+0000", 2024-05-07T14:04:17.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027746260000000001 2024-05-07T14:04:17.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076118+0000", 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4223e-05 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076138+0000", 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0622999999999999e-05 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076324+0000", 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018613599999999999 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076376+0000", 2024-05-07T14:04:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2068999999999999e-05 2024-05-07T14:04:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102438+0000", 2024-05-07T14:04:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026061190000000001 2024-05-07T14:04:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102579+0000", 2024-05-07T14:04:17.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014143399999999999 2024-05-07T14:04:17.330 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.330 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.330 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.330 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2805 3.1 e105/21 3:819b24c4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_122:head v 105'3, mlcod=104'1)", 2024-05-07T14:04:17.330 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:17.330 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.212003694000003, 2024-05-07T14:04:17.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028404523000000001, 2024-05-07T14:04:17.330 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.330 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.330 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076262+0000", 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3800000000000001e-06 2024-05-07T14:04:17.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083265+0000", 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070039539999999997 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083309+0000", 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3516000000000001e-05 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083333+0000", 2024-05-07T14:04:17.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4471999999999999e-05 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083520+0000", 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018616999999999999 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083588+0000", 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8405000000000007e-05 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104547+0000", 2024-05-07T14:04:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020959228 2024-05-07T14:04:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104664+0000", 2024-05-07T14:04:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011639800000000001 2024-05-07T14:04:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2832 3.1a 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:17.334 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.040598930999998, 2024-05-07T14:04:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030681671000000001, 2024-05-07T14:04:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2832 2024-05-07T14:04:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247666+0000", 2024-05-07T14:04:17.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5569999999999998e-06 2024-05-07T14:04:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253202+0000", 2024-05-07T14:04:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055353900000000003 2024-05-07T14:04:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253232+0000", 2024-05-07T14:04:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0309000000000001e-05 2024-05-07T14:04:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253250+0000", 2024-05-07T14:04:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7503000000000002e-05 2024-05-07T14:04:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253372+0000", 2024-05-07T14:04:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255600000000001 2024-05-07T14:04:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253592+0000", 2024-05-07T14:04:17.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021960400000000001 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253831+0000", 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000239223 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.264040+0000", 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010209018 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278176+0000", 2024-05-07T14:04:17.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014135518 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278272+0000", 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6562000000000001e-05 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278346+0000", 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3430999999999995e-05 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2853 3.34 3:2c5576f8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.831905042999999, 2024-05-07T14:04:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026917739, 2024-05-07T14:04:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2853 2024-05-07T14:04:17.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456361+0000", 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1240000000000001e-06 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460499+0000", 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041381159999999998 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460528+0000", 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8558999999999999e-05 2024-05-07T14:04:17.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460544+0000", 2024-05-07T14:04:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6200000000000001e-05 2024-05-07T14:04:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460699+0000", 2024-05-07T14:04:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155513 2024-05-07T14:04:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461098+0000", 2024-05-07T14:04:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039883900000000001 2024-05-07T14:04:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461508+0000", 2024-05-07T14:04:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040939399999999999 2024-05-07T14:04:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.474319+0000", 2024-05-07T14:04:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012811002 2024-05-07T14:04:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483036+0000", 2024-05-07T14:04:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087174469999999997 2024-05-07T14:04:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483142+0000", 2024-05-07T14:04:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010647800000000001 2024-05-07T14:04:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483276+0000", 2024-05-07T14:04:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013306700000000001 2024-05-07T14:04:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2874 3.34 3:2d878586:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:17.347 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.609302977999999, 2024-05-07T14:04:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023302047999999999, 2024-05-07T14:04:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2874 2024-05-07T14:04:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678964+0000", 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.89e-06 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683101+0000", 2024-05-07T14:04:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041374669999999997 2024-05-07T14:04:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683138+0000", 2024-05-07T14:04:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7098999999999998e-05 2024-05-07T14:04:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683155+0000", 2024-05-07T14:04:17.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7139999999999999e-05 2024-05-07T14:04:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683330+0000", 2024-05-07T14:04:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000174919 2024-05-07T14:04:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683715+0000", 2024-05-07T14:04:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038476199999999997 2024-05-07T14:04:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.684028+0000", 2024-05-07T14:04:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031283999999999999 2024-05-07T14:04:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701377+0000", 2024-05-07T14:04:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017349402999999999 2024-05-07T14:04:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701948+0000", 2024-05-07T14:04:17.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057096800000000004 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702125+0000", 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176319 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702262+0000", 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137241 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2883 3.29 e105/21 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head v 105'6, mlcod=104'4)", 2024-05-07T14:04:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.508608257999999, 2024-05-07T14:04:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022805558, 2024-05-07T14:04:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:17.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779657+0000", 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0370000000000001e-06 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784248+0000", 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045916810000000002 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784272+0000", 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3281999999999998e-05 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784285+0000", 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3423e-05 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784399+0000", 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011439500000000001 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784452+0000", 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2142000000000003e-05 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802362+0000", 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017910874 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802460+0000", 2024-05-07T14:04:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7724000000000002e-05 2024-05-07T14:04:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2889 3.e e105/21 3:72a3c671:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_196:head v 105'11, mlcod=105'9)", 2024-05-07T14:04:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.433736747000001, 2024-05-07T14:04:17.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02270175, 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854529+0000", 2024-05-07T14:04:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7499999999999999e-06 2024-05-07T14:04:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857472+0000", 2024-05-07T14:04:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002942999 2024-05-07T14:04:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857510+0000", 2024-05-07T14:04:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8075999999999999e-05 2024-05-07T14:04:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857533+0000", 2024-05-07T14:04:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3353000000000002e-05 2024-05-07T14:04:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857695+0000", 2024-05-07T14:04:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016135300000000001 2024-05-07T14:04:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857761+0000", 2024-05-07T14:04:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6759000000000002e-05 2024-05-07T14:04:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877052+0000", 2024-05-07T14:04:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019290656999999999 2024-05-07T14:04:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877228+0000", 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017580300000000001 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3190 3.1a 3:59666d5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.027833468000001, 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026496828, 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.363 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3190 2024-05-07T14:04:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260444+0000", 2024-05-07T14:04:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4766000000000001e-05 2024-05-07T14:04:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267146+0000", 2024-05-07T14:04:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00670179 2024-05-07T14:04:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267176+0000", 2024-05-07T14:04:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0534999999999998e-05 2024-05-07T14:04:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267191+0000", 2024-05-07T14:04:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4080000000000001e-05 2024-05-07T14:04:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267300+0000", 2024-05-07T14:04:17.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109962 2024-05-07T14:04:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267473+0000", 2024-05-07T14:04:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000172516 2024-05-07T14:04:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267636+0000", 2024-05-07T14:04:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016309699999999999 2024-05-07T14:04:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.275955+0000", 2024-05-07T14:04:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083188399999999992 2024-05-07T14:04:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286699+0000", 2024-05-07T14:04:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010743674999999999 2024-05-07T14:04:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286808+0000", 2024-05-07T14:04:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109702 2024-05-07T14:04:17.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286926+0000", 2024-05-07T14:04:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117865 2024-05-07T14:04:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3335 3.9 3:93f3a6ca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:09.361724+0000", 2024-05-07T14:04:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.9265385559999997, 2024-05-07T14:04:17.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027372132, 2024-05-07T14:04:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3335 2024-05-07T14:04:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.361724+0000", 2024-05-07T14:04:17.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.361724+0000", 2024-05-07T14:04:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.361930+0000", 2024-05-07T14:04:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000205331 2024-05-07T14:04:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369409+0000", 2024-05-07T14:04:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074794070000000004 2024-05-07T14:04:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369456+0000", 2024-05-07T14:04:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7413000000000002e-05 2024-05-07T14:04:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369483+0000", 2024-05-07T14:04:17.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6366000000000001e-05 2024-05-07T14:04:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369665+0000", 2024-05-07T14:04:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018191799999999999 2024-05-07T14:04:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369944+0000", 2024-05-07T14:04:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027922599999999999 2024-05-07T14:04:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.370170+0000", 2024-05-07T14:04:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000226233 2024-05-07T14:04:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.379097+0000", 2024-05-07T14:04:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089264380000000001 2024-05-07T14:04:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.388922+0000", 2024-05-07T14:04:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0098254650000000002 2024-05-07T14:04:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.389020+0000", 2024-05-07T14:04:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7663000000000003e-05 2024-05-07T14:04:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.389096+0000", 2024-05-07T14:04:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6672e-05 2024-05-07T14:04:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.375 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3351 3.31 e114/21 3:8fd6054f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_242:head v 114'10, mlcod=113'8)", 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:09.578617+0000", 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.7096455050000001, 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024903304000000001, 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.578617+0000", 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.578617+0000", 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.578620+0000", 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3599999999999999e-06 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582736+0000", 2024-05-07T14:04:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041163069999999996 2024-05-07T14:04:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582774+0000", 2024-05-07T14:04:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7944000000000001e-05 2024-05-07T14:04:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582799+0000", 2024-05-07T14:04:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5222e-05 2024-05-07T14:04:17.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582906+0000", 2024-05-07T14:04:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010689299999999999 2024-05-07T14:04:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582933+0000", 2024-05-07T14:04:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7192e-05 2024-05-07T14:04:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.603465+0000", 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020531341000000002 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.603521+0000", 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6045000000000003e-05 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3604 3.1c e115/21 3:3a3fe722:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_485:head v 115'10, mlcod=114'8)", 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.157830+0000", 2024-05-07T14:04:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.1304324059999997, 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032404158000000002, 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157830+0000", 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157830+0000", 2024-05-07T14:04:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157833+0000", 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5900000000000002e-06 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164272+0000", 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006439485 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164319+0000", 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6699000000000001e-05 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164345+0000", 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5415999999999999e-05 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164521+0000", 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176751 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164589+0000", 2024-05-07T14:04:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7803000000000001e-05 2024-05-07T14:04:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190083+0000", 2024-05-07T14:04:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025494176 2024-05-07T14:04:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190235+0000", 2024-05-07T14:04:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015123799999999999 2024-05-07T14:04:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3605 3.11 e115/21 3:8ac2b8fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_486:head v 115'13, mlcod=115'11)", 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.168137+0000", 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.1201259280000002, 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025037206999999999, 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.168137+0000", 2024-05-07T14:04:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.168137+0000", 2024-05-07T14:04:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.168140+0000", 2024-05-07T14:04:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6699999999999998e-06 2024-05-07T14:04:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173479+0000", 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053395300000000003 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173515+0000", 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6273999999999999e-05 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173533+0000", 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7368999999999999e-05 2024-05-07T14:04:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173679+0000", 2024-05-07T14:04:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000146568 2024-05-07T14:04:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173722+0000", 2024-05-07T14:04:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2395999999999999e-05 2024-05-07T14:04:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.193023+0000", 2024-05-07T14:04:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019300955000000002 2024-05-07T14:04:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.193174+0000", 2024-05-07T14:04:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151445 2024-05-07T14:04:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.389 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:17.391 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:04:17.392 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:17.402+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:17.492 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:17.506+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:17.522 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:17.523 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:17.536 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:04:17.593 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:17.606+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:17.652 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:17.652 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:17.652 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:17.652 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:17.652 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:17.666 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:04:17.693 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:17.706+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:17.787 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:17.787 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:17.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:17.787 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:17.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.787 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2498 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.402536748000003, 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.06015305, 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2498 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394887+0000", 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394900+0000", 2024-05-07T14:04:17.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3125999999999999e-05 2024-05-07T14:04:17.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394940+0000", 2024-05-07T14:04:17.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9579999999999997e-05 2024-05-07T14:04:17.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394961+0000", 2024-05-07T14:04:17.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1075999999999999e-05 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395122+0000", 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160741 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395140+0000", 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430325+0000", 2024-05-07T14:04:17.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.03518512 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430355+0000", 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9181999999999999e-05 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.445424+0000", 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.015069751 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:17.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.446159+0000", 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073452200000000004 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450456+0000", 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042973689999999997 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450627+0000", 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017032700000000001 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455037+0000", 2024-05-07T14:04:17.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044108690000000004 2024-05-07T14:04:17.794 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.794 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.794 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.794 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2499 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:17.794 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:17.794 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.402407698999994, 2024-05-07T14:04:17.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.065623158, 2024-05-07T14:04:17.794 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.794 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.794 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:17.795 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.795 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.795 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.795 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2499 2024-05-07T14:04:17.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.795 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:17.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395015+0000", 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.57e-06 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395022+0000", 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1330000000000001e-06 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395043+0000", 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1022999999999998e-05 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395060+0000", 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6325999999999999e-05 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395199+0000", 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139815 2024-05-07T14:04:17.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395215+0000", 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5693e-05 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413112+0000", 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017896860000000001 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413143+0000", 2024-05-07T14:04:17.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1609000000000002e-05 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.447430+0000", 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0342867060000001 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450079+0000", 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002648386 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455213+0000", 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051342749999999998 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455444+0000", 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023070799999999999 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.460637+0000", 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051930539999999999 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.801 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2667 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:17.801 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:17.801 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.147163134000003, 2024-05-07T14:04:17.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1292758329999999, 2024-05-07T14:04:17.801 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.801 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.801 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:17.801 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.801 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.801 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.801 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2667 2024-05-07T14:04:17.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650260+0000", 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1160000000000002e-06 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650270+0000", 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0047000000000001e-05 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650296+0000", 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6058999999999999e-05 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650313+0000", 2024-05-07T14:04:17.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6727000000000001e-05 2024-05-07T14:04:17.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660781+0000", 2024-05-07T14:04:17.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010468518 2024-05-07T14:04:17.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660805+0000", 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3246000000000001e-05 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776636+0000", 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.115831102 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776958+0000", 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032243199999999999 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.779534+0000", 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025755859999999999 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2674 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.601739455000001, 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58268987500000002, 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.806 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:17.807 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.807 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.807 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.807 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2674 2024-05-07T14:04:17.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.809 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195683+0000", 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2500000000000001e-06 2024-05-07T14:04:17.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195689+0000", 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4300000000000003e-06 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195702+0000", 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3026e-05 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195718+0000", 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5532999999999998e-05 2024-05-07T14:04:17.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195943+0000", 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022518899999999999 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195971+0000", 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7688999999999999e-05 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.777763+0000", 2024-05-07T14:04:17.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58179212899999999 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778060+0000", 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029683599999999997 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778372+0000", 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031179299999999999 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.814 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2685 3.1c 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:17.814 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:17.814 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.001890434000003, 2024-05-07T14:04:17.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034286608000000003, 2024-05-07T14:04:17.814 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.814 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.814 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.814 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.814 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.814 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.814 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2685 2024-05-07T14:04:17.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795533+0000", 2024-05-07T14:04:17.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803767+0000", 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082339079999999999 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803810+0000", 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2969000000000001e-05 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803837+0000", 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7036e-05 2024-05-07T14:04:17.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804026+0000", 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018935600000000001 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804408+0000", 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038137799999999998 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804786+0000", 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037841200000000001 2024-05-07T14:04:17.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.823281+0000", 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018494561999999999 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829623+0000", 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063427279999999997 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829715+0000", 2024-05-07T14:04:17.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1815000000000001e-05 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829817+0000", 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102051 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2689 3.2a 3:57071f6f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.958452813999997, 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032293512000000003, 2024-05-07T14:04:17.819 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2689 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838972+0000", 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.72e-06 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843363+0000", 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043909810000000004 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:04:17.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4181999999999998e-05 2024-05-07T14:04:17.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843430+0000", 2024-05-07T14:04:17.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3139999999999999e-05 2024-05-07T14:04:17.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843735+0000", 2024-05-07T14:04:17.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030467299999999999 2024-05-07T14:04:17.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844287+0000", 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055224799999999998 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844674+0000", 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038716199999999998 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.868480+0000", 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023805639999999999 2024-05-07T14:04:17.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.870993+0000", 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025130920000000002 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871151+0000", 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000158176 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871262+0000", 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110498 2024-05-07T14:04:17.824 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2700 3.c 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.843438435000003, 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028853172999999999, 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2700 2024-05-07T14:04:17.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.826 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:17.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:17.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.954040+0000", 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7735000000000002e-05 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958710+0000", 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046694220000000003 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958759+0000", 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8671999999999997e-05 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958778+0000", 2024-05-07T14:04:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958955+0000", 2024-05-07T14:04:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177197 2024-05-07T14:04:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959253+0000", 2024-05-07T14:04:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029744999999999999 2024-05-07T14:04:17.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959545+0000", 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029215699999999997 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.969251+0000", 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097062789999999999 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982559+0000", 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013307818000000001 2024-05-07T14:04:17.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982721+0000", 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016221200000000001 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982836+0000", 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114605 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2782 3.5 3:a0760020:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.973667587999998, 2024-05-07T14:04:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029185556000000001, 2024-05-07T14:04:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2782 2024-05-07T14:04:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.831 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823757+0000", 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7330000000000001e-06 2024-05-07T14:04:17.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829013+0000", 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052552889999999998 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829062+0000", 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9375000000000001e-05 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829089+0000", 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7143000000000001e-05 2024-05-07T14:04:17.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829248+0000", 2024-05-07T14:04:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015877 2024-05-07T14:04:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829262+0000", 2024-05-07T14:04:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.365e-05 2024-05-07T14:04:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835685+0000", 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064232339999999999 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835910+0000", 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022484800000000001 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.836115+0000", 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000204916 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.851571+0000", 2024-05-07T14:04:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015456634 2024-05-07T14:04:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852768+0000", 2024-05-07T14:04:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001197264 2024-05-07T14:04:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852867+0000", 2024-05-07T14:04:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9011000000000005e-05 2024-05-07T14:04:17.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852939+0000", 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1688999999999998e-05 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2793 3.30 3:0c9cfcfb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.848014401, 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028754691999999998, 2024-05-07T14:04:17.837 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2793 2024-05-07T14:04:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949410+0000", 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7239999999999998e-06 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956008+0000", 2024-05-07T14:04:17.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065976560000000004 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956068+0000", 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9781999999999998e-05 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956087+0000", 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9009999999999999e-05 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956241+0000", 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015391600000000001 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956640+0000", 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039917499999999999 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956860+0000", 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021961499999999999 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.967010+0000", 2024-05-07T14:04:17.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01015011 2024-05-07T14:04:17.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.977827+0000", 2024-05-07T14:04:17.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010817148 2024-05-07T14:04:17.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978012+0000", 2024-05-07T14:04:17.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018541 2024-05-07T14:04:17.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978161+0000", 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014914600000000001 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2815 3.2a 3:5644b81f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.622289307000003, 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027617527999999999, 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.844 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.844 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.844 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.844 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2815 2024-05-07T14:04:17.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.844 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:17.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175136+0000", 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7869999999999999e-06 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179183+0000", 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004047358 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179215+0000", 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1919999999999999e-05 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179238+0000", 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3036000000000001e-05 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179367+0000", 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128627 2024-05-07T14:04:17.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179613+0000", 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024667500000000002 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179847+0000", 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000233668 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.196418+0000", 2024-05-07T14:04:17.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016571579999999999 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202617+0000", 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061980830000000001 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202688+0000", 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1481000000000002e-05 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202749+0000", 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1313000000000001e-05 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2865 3.38 e105/21 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.212394816, 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032748549000000002, 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.849 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:17.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:17.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585029+0000", 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9639999999999999e-06 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589707+0000", 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046776889999999996 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589754+0000", 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7382000000000001e-05 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589780+0000", 2024-05-07T14:04:17.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5232000000000002e-05 2024-05-07T14:04:17.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589966+0000", 2024-05-07T14:04:17.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000186596 2024-05-07T14:04:17.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.590031+0000", 2024-05-07T14:04:17.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5038999999999999e-05 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617527+0000", 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027496216 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617775+0000", 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247431 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.854 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2888 3.2 e105/46 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head v 105'8, mlcod=104'6)", 2024-05-07T14:04:17.854 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:17.854 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.956332582999998, 2024-05-07T14:04:17.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.033929095999999999, 2024-05-07T14:04:17.854 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.854 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.854 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.854 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:17.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841091+0000", 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.39e-06 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.847981+0000", 2024-05-07T14:04:17.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068900630000000001 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848020+0000", 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8846e-05 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848039+0000", 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848222+0000", 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018251300000000001 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848268+0000", 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5552e-05 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.874885+0000", 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026617335999999998 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.875018+0000", 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013276999999999999 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2894 3.16 3:6aec0fdf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.88368608, 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029574030000000001, 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.858 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2894 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:17.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913738+0000", 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.491e-06 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917692+0000", 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039540799999999996 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917718+0000", 2024-05-07T14:04:17.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6211e-05 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917732+0000", 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4487999999999999e-05 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917897+0000", 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016455199999999999 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918296+0000", 2024-05-07T14:04:17.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000398825 2024-05-07T14:04:17.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:17.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918724+0000", 2024-05-07T14:04:17.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042847399999999998 2024-05-07T14:04:17.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.933484+0000", 2024-05-07T14:04:17.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014759959 2024-05-07T14:04:17.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.942986+0000", 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095014739999999993 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943179+0000", 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019320200000000001 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943309+0000", 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013027399999999999 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.863 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2896 3.3a 3:5f842f5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.862926417000001, 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028429466, 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2896 2024-05-07T14:04:17.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934498+0000", 2024-05-07T14:04:17.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.557e-06 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939927+0000", 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054289250000000002 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939955+0000", 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8245000000000001e-05 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939971+0000", 2024-05-07T14:04:17.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.504e-05 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940161+0000", 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019040499999999999 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940562+0000", 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040076800000000002 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940979+0000", 2024-05-07T14:04:17.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041760099999999997 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.950692+0000", 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097127529999999993 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962768+0000", 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012075987 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962863+0000", 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5103000000000001e-05 2024-05-07T14:04:17.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962924+0000", 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1081999999999996e-05 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2908 3.3a 3:5d7a0a59:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 31.711575077999999, 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027562652999999999, 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.869 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2908 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085850+0000", 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.267e-06 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091371+0000", 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055205619999999997 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091411+0000", 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0365999999999999e-05 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091432+0000", 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0276e-05 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091608+0000", 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176653 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.092025+0000", 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041696799999999998 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.092418+0000", 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000393099 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.102443+0000", 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010024798999999999 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113230+0000", 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010786963 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113330+0000", 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9808000000000004e-05 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113409+0000", 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8892000000000003e-05 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.874 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3197 3.d e113/21 3:b35829be:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_89:head v 113'16, mlcod=113'14)", 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.462241968000001, 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029081169, 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:17.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335182+0000", 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7329999999999999e-06 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338859+0000", 2024-05-07T14:04:17.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036773589999999998 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338896+0000", 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6656000000000003e-05 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338922+0000", 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5936999999999999e-05 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339046+0000", 2024-05-07T14:04:17.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012458400000000001 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339089+0000", 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2342999999999998e-05 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.364123+0000", 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025034187999999999 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.364260+0000", 2024-05-07T14:04:17.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013736900000000001 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3210 3.2f 3:f67c3789:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.330478211999999, 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042403633000000003, 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.879 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3210 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466947+0000", 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5669999999999999e-06 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471128+0000", 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041817620000000003 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471175+0000", 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6279000000000002e-05 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471200+0000", 2024-05-07T14:04:17.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5177e-05 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471361+0000", 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160848 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471379+0000", 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8142e-05 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.479968+0000", 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085897040000000001 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.480366+0000", 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039736399999999999 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.480736+0000", 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037031899999999998 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.495479+0000", 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014742992 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509169+0000", 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013690179 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509268+0000", 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8814999999999995e-05 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509347+0000", 2024-05-07T14:04:17.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8485000000000005e-05 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3602 3.5 3:a2d0df3e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_483:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.132400+0000", 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.6650212949999998, 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027859134000000001, 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.885 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3602 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.132400+0000", 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.132400+0000", 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.132404+0000", 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8160000000000004e-06 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.136457+0000", 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040533849999999996 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.136498+0000", 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1059000000000001e-05 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.136526+0000", 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7520000000000001e-05 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.136700+0000", 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017472399999999999 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.137075+0000", 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037488799999999998 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:17.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.137366+0000", 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000290613 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.148499+0000", 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011133077 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.160042+0000", 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011542682 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.160135+0000", 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3745000000000005e-05 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.160259+0000", 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012362500000000001 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3604 3.1c 3:3a3fe722:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_485:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.152001+0000", 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.6454196569999997, 2024-05-07T14:04:17.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038767554000000003, 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3604 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.152001+0000", 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.152001+0000", 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.152004+0000", 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8899999999999999e-06 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.156819+0000", 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048148369999999998 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.156860+0000", 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0355999999999998e-05 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.156878+0000", 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.878e-05 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157060+0000", 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181991 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157341+0000", 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028081599999999998 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157583+0000", 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241506 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.169148+0000", 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011565242 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190604+0000", 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021456052 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190700+0000", 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6164999999999998e-05 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190769+0000", 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8918999999999995e-05 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.895 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3611 3.16 3:6a1fde75:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_492:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.231125+0000", 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.566295953, 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032234160999999997, 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3611 2024-05-07T14:04:17.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.231125+0000", 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.231125+0000", 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.231130+0000", 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9629999999999997e-06 2024-05-07T14:04:17.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235158+0000", 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040282679999999998 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235197+0000", 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8654e-05 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235216+0000", 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9099000000000001e-05 2024-05-07T14:04:17.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235350+0000", 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013348200000000001 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235617+0000", 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026753900000000001 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235861+0000", 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024357299999999999 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.249418+0000", 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013557394 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.263075+0000", 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013656423000000001 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.263246+0000", 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000170944 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:17.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:17.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:17.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.263359+0000", 2024-05-07T14:04:17.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113822 2024-05-07T14:04:17.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.901 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:17.901 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:17.901 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:17.903 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:04:17.903 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:17.914+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:18.004 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:18.011+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:18.033 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:18.033 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:18.033 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:18.033 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:18.047 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:04:18.132 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:18.143+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:18.206 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:18.218+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:18.209 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:18.209 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:18.209 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:18.209 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:18.209 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:18.223 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:04:18.312 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:18.323+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:18.394 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:18.395 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:18.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:18.395 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:18.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.395 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2207 3.26 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:18.395 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:18.395 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.066201794999998, 2024-05-07T14:04:18.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029257551999999999, 2024-05-07T14:04:18.395 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.395 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.395 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.395 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.395 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2207 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338601+0000", 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0769999999999998e-06 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344166+0000", 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055649139999999998 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344203+0000", 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7109e-05 2024-05-07T14:04:18.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344221+0000", 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344394+0000", 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000173208 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344788+0000", 2024-05-07T14:04:18.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039418400000000001 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345265+0000", 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047689299999999999 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365597+0000", 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020331954999999999 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367512+0000", 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001915237 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367693+0000", 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018108800000000001 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367853+0000", 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016028400000000001 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2507 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [call rgw.bucket_list in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.989093256999993, 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.019773713, 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2507 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.401 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415708+0000", 2024-05-07T14:04:18.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4860000000000002e-06 2024-05-07T14:04:18.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415724+0000", 2024-05-07T14:04:18.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.643e-05 2024-05-07T14:04:18.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415759+0000", 2024-05-07T14:04:18.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4252999999999999e-05 2024-05-07T14:04:18.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415783+0000", 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4315999999999999e-05 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419072+0000", 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032886119999999998 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419099+0000", 2024-05-07T14:04:18.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6956000000000001e-05 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435061+0000", 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0159622509999999 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435231+0000", 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016978800000000001 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435478+0000", 2024-05-07T14:04:18.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024762100000000001 2024-05-07T14:04:18.406 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.406 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.406 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.406 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2686 3.34 e104/21 3:2ec0e822:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_3:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:18.406 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.820422+0000", 2024-05-07T14:04:18.406 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.58437533, 2024-05-07T14:04:18.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022287620000000001, 2024-05-07T14:04:18.407 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.407 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.407 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.407 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820422+0000", 2024-05-07T14:04:18.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820422+0000", 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820423+0000", 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.44e-07 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825658+0000", 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005235066 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825692+0000", 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4048999999999999e-05 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825717+0000", 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5216e-05 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.826297+0000", 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058014099999999995 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.826353+0000", 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5831999999999997e-05 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.842559+0000", 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016205768999999998 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.842710+0000", 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151003 2024-05-07T14:04:18.410 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2695 3.35 3:acf2d7d8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.503360503000003, 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028454303, 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.411 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.412 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2695 2024-05-07T14:04:18.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.412 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:18.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:18.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901441+0000", 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9600000000000002e-06 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907573+0000", 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061315939999999998 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907630+0000", 2024-05-07T14:04:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6818999999999999e-05 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907649+0000", 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9859000000000001e-05 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907857+0000", 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000207159 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.908127+0000", 2024-05-07T14:04:18.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027069099999999999 2024-05-07T14:04:18.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:18.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.908468+0000", 2024-05-07T14:04:18.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034104600000000001 2024-05-07T14:04:18.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.918062+0000", 2024-05-07T14:04:18.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095934409999999994 2024-05-07T14:04:18.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929718+0000", 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011656141 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929819+0000", 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100634 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929892+0000", 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2959000000000004e-05 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.416 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2719 3.10 3:0b5df28b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.228270107, 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028912935000000001, 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.417 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2719 2024-05-07T14:04:18.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.418 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:18.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:18.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176531+0000", 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3699999999999999e-06 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182042+0000", 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00551105 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182083+0000", 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1402000000000001e-05 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182103+0000", 2024-05-07T14:04:18.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9953e-05 2024-05-07T14:04:18.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182262+0000", 2024-05-07T14:04:18.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015816699999999999 2024-05-07T14:04:18.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182545+0000", 2024-05-07T14:04:18.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028303999999999997 2024-05-07T14:04:18.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:18.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182779+0000", 2024-05-07T14:04:18.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023474800000000001 2024-05-07T14:04:18.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.195512+0000", 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012733081 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205013+0000", 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095007670000000002 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205264+0000", 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025112099999999998 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205441+0000", 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176236 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2734 3.a 3:5117726b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 34.076149080999997, 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026910749000000001, 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.424 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2734 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:18.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328652+0000", 2024-05-07T14:04:18.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9500000000000001e-06 2024-05-07T14:04:18.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333686+0000", 2024-05-07T14:04:18.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050342010000000003 2024-05-07T14:04:18.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333726+0000", 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9802000000000003e-05 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333753+0000", 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7702999999999999e-05 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333900+0000", 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014663999999999999 2024-05-07T14:04:18.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.334151+0000", 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025143799999999999 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.334390+0000", 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000238268 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.346870+0000", 2024-05-07T14:04:18.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012480753000000001 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355331+0000", 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084610090000000002 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355483+0000", 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015194000000000001 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355559+0000", 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6044999999999994e-05 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2786 3.20 3:043afb92:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.532925359000004, 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026616246, 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.430 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2786 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871877+0000", 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2969999999999997e-06 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876185+0000", 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004308503 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876223+0000", 2024-05-07T14:04:18.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7852000000000003e-05 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876242+0000", 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9253999999999999e-05 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876395+0000", 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015306599999999999 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876685+0000", 2024-05-07T14:04:18.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028964699999999997 2024-05-07T14:04:18.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:18.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876925+0000", 2024-05-07T14:04:18.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023967500000000001 2024-05-07T14:04:18.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.885744+0000", 2024-05-07T14:04:18.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008819749 2024-05-07T14:04:18.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898308+0000", 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012563710000000001 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898410+0000", 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101582 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898489+0000", 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8911000000000004e-05 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.435 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2807 3.3f e105/21 3:fd0db1b2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_124:head v 105'6, mlcod=85'4)", 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.303845559999999, 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026784641000000001, 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100955+0000", 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8200000000000001e-06 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105915+0000", 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049600290000000003 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105956+0000", 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1205000000000003e-05 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105973+0000", 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7087000000000001e-05 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.106125+0000", 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015208299999999999 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.106192+0000", 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6809000000000004e-05 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.127628+0000", 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02143579 2024-05-07T14:04:18.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.127737+0000", 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000108818 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2828 3.2c 3:37c1d26d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.206105+0000", 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.198692753000003, 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023644783999999999, 2024-05-07T14:04:18.440 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2828 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.206105+0000", 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.206105+0000", 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.206109+0000", 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5939999999999998e-06 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.212890+0000", 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067816780000000002 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.212936+0000", 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5535999999999999e-05 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.212960+0000", 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4685000000000002e-05 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.213165+0000", 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020478299999999999 2024-05-07T14:04:18.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.213570+0000", 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040477800000000001 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.213999+0000", 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042946 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.227004+0000", 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013004946999999999 2024-05-07T14:04:18.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.229490+0000", 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024852120000000001 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.229634+0000", 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144074 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.229750+0000", 2024-05-07T14:04:18.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116037 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2829 3.35 3:aeb9f674:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.217157+0000", 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.187641198000001, 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022531881, 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.446 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2829 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.217157+0000", 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.217157+0000", 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.217159+0000", 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.531e-06 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221183+0000", 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040234559999999999 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221218+0000", 2024-05-07T14:04:18.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5602000000000002e-05 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221235+0000", 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6948000000000001e-05 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221367+0000", 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013174199999999999 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221629+0000", 2024-05-07T14:04:18.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026224400000000002 2024-05-07T14:04:18.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:18.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221852+0000", 2024-05-07T14:04:18.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022335599999999999 2024-05-07T14:04:18.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.238414+0000", 2024-05-07T14:04:18.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016561306000000001 2024-05-07T14:04:18.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.239379+0000", 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00096533899999999995 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.239557+0000", 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177916 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.239688+0000", 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013144099999999999 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.451 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2851 3.35 3:aedd2f32:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.437038+0000", 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.967759503000003, 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023592841, 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2851 2024-05-07T14:04:18.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.437038+0000", 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.437038+0000", 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.437042+0000", 2024-05-07T14:04:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6899999999999998e-06 2024-05-07T14:04:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443186+0000", 2024-05-07T14:04:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006144137 2024-05-07T14:04:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443240+0000", 2024-05-07T14:04:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4061000000000003e-05 2024-05-07T14:04:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443268+0000", 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7843000000000001e-05 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443448+0000", 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018044 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443858+0000", 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040941399999999998 2024-05-07T14:04:18.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.444268+0000", 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041045799999999999 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453481+0000", 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092126599999999993 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460427+0000", 2024-05-07T14:04:18.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069463989999999998 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460519+0000", 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1778000000000001e-05 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460631+0000", 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011196099999999999 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2852 3.26 3:6683f345:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.446514+0000", 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.958283682999998, 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022598677000000001, 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2852 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.446514+0000", 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.446514+0000", 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.446517+0000", 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7199999999999998e-06 2024-05-07T14:04:18.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453133+0000", 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066160769999999997 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453162+0000", 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.921e-05 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453179+0000", 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7266e-05 2024-05-07T14:04:18.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453334+0000", 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000154253 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453706+0000", 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037270400000000001 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.454035+0000", 2024-05-07T14:04:18.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032850099999999998 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.462913+0000", 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088785270000000006 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.468949+0000", 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060357450000000003 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.469023+0000", 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4406000000000006e-05 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.469113+0000", 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9268e-05 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2902 3.10 3:0b53d764:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.012188+0000", 2024-05-07T14:04:18.463 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.392610023000003, 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023745938000000001, 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2902 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.012188+0000", 2024-05-07T14:04:18.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.012188+0000", 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.012190+0000", 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2680000000000001e-06 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017271+0000", 2024-05-07T14:04:18.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050807179999999997 2024-05-07T14:04:18.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017301+0000", 2024-05-07T14:04:18.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0354000000000001e-05 2024-05-07T14:04:18.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017317+0000", 2024-05-07T14:04:18.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6388e-05 2024-05-07T14:04:18.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017445+0000", 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012714000000000001 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017761+0000", 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031622699999999998 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.018089+0000", 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000328093 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.030270+0000", 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012180679999999999 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.035653+0000", 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053833900000000001 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.035818+0000", 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016458600000000001 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.035934+0000", 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116094 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2912 3.36 3:6fcd222f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.266369499, 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02818507, 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.469 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2912 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:18.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138433+0000", 2024-05-07T14:04:18.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0069999999999997e-06 2024-05-07T14:04:18.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.143973+0000", 2024-05-07T14:04:18.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055392719999999996 2024-05-07T14:04:18.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144024+0000", 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1128999999999998e-05 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144044+0000", 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0526e-05 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144267+0000", 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022246500000000001 2024-05-07T14:04:18.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144532+0000", 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026575900000000001 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144805+0000", 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027290000000000002 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.162814+0000", 2024-05-07T14:04:18.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018008631000000001 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166347+0000", 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035334429999999998 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166490+0000", 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014308699999999999 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166613+0000", 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012285099999999999 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2918 3.10 3:0a57f05a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.197985911000004, 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030233789, 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.475 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.476 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.476 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.476 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2918 2024-05-07T14:04:18.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.476 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:18.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206816+0000", 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6229999999999996e-06 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.210992+0000", 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041755799999999999 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211043+0000", 2024-05-07T14:04:18.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0584999999999998e-05 2024-05-07T14:04:18.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211070+0000", 2024-05-07T14:04:18.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7716999999999999e-05 2024-05-07T14:04:18.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211251+0000", 2024-05-07T14:04:18.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000180683 2024-05-07T14:04:18.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211678+0000", 2024-05-07T14:04:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042701099999999998 2024-05-07T14:04:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.212087+0000", 2024-05-07T14:04:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040911799999999998 2024-05-07T14:04:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.222312+0000", 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010224551 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.236912+0000", 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014600548 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.236982+0000", 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9476999999999999e-05 2024-05-07T14:04:18.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.237046+0000", 2024-05-07T14:04:18.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3895999999999999e-05 2024-05-07T14:04:18.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.481 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.481 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3198 3.2c 3:34ce24fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:18.481 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:18.481 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.064883546000001, 2024-05-07T14:04:18.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026711016000000001, 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3198 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339918+0000", 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000001e-06 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.343982+0000", 2024-05-07T14:04:18.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040642320000000001 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344027+0000", 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024999999999997e-05 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344052+0000", 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4603000000000001e-05 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344190+0000", 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013819 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344377+0000", 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018666200000000001 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344585+0000", 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000208452 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.362586+0000", 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018000754000000001 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366457+0000", 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003871542 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366546+0000", 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8601000000000001e-05 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366625+0000", 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9272999999999998e-05 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3208 3.26 3:66fd0e21:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.955545202, 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041868750000000003, 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.487 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3208 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:18.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449257+0000", 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.07e-06 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455814+0000", 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065570660000000003 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455854+0000", 2024-05-07T14:04:18.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0819999999999999e-05 2024-05-07T14:04:18.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455874+0000", 2024-05-07T14:04:18.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9993e-05 2024-05-07T14:04:18.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.456063+0000", 2024-05-07T14:04:18.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018892400000000001 2024-05-07T14:04:18.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.456077+0000", 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3433e-05 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.462635+0000", 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065577869999999998 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.462869+0000", 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023394299999999999 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.463127+0000", 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0002588 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.473024+0000", 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0098969100000000001 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.490912+0000", 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017887291 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.491010+0000", 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8041999999999994e-05 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.491121+0000", 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111671 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3214 3.2c 3:36c50e70:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:18.493 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.505220+0000", 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.899578106, 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022100794999999999, 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3214 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.505220+0000", 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.505220+0000", 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.505224+0000", 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4560000000000002e-06 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510370+0000", 2024-05-07T14:04:18.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051455140000000003 2024-05-07T14:04:18.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510407+0000", 2024-05-07T14:04:18.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7902999999999999e-05 2024-05-07T14:04:18.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510424+0000", 2024-05-07T14:04:18.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6840000000000001e-05 2024-05-07T14:04:18.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510580+0000", 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015549100000000001 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510839+0000", 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025945299999999998 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.511096+0000", 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025659899999999999 2024-05-07T14:04:18.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.524699+0000", 2024-05-07T14:04:18.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013603373 2024-05-07T14:04:18.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.527137+0000", 2024-05-07T14:04:18.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024377610000000001 2024-05-07T14:04:18.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.527245+0000", 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107792 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.527320+0000", 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5612999999999996e-05 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3230 3.35 3:af7e1017:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.683889+0000", 2024-05-07T14:04:18.499 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.720909076, 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024914794000000001, 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3230 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.683889+0000", 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.683889+0000", 2024-05-07T14:04:18.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.683893+0000", 2024-05-07T14:04:18.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8339999999999998e-06 2024-05-07T14:04:18.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689114+0000", 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005220616 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689172+0000", 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7479000000000003e-05 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689189+0000", 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.766e-05 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689318+0000", 2024-05-07T14:04:18.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012900499999999999 2024-05-07T14:04:18.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689573+0000", 2024-05-07T14:04:18.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025489600000000001 2024-05-07T14:04:18.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:18.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689808+0000", 2024-05-07T14:04:18.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023451 2024-05-07T14:04:18.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.698461+0000", 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086537990000000002 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.708562+0000", 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010100052 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.708728+0000", 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000166214 2024-05-07T14:04:18.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.708803+0000", 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5729000000000006e-05 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3598 3.36 3:6ff6851c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_479:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.088618+0000", 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.3161800599999998, 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026105204999999999, 2024-05-07T14:04:18.505 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:18.506 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:18.506 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:18.506 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:18.506 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:18.506 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:18.506 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3598 2024-05-07T14:04:18.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.506 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:18.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:18.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.088618+0000", 2024-05-07T14:04:18.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:18.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.088618+0000", 2024-05-07T14:04:18.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:18.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:18.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.088622+0000", 2024-05-07T14:04:18.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5029999999999999e-06 2024-05-07T14:04:18.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:18.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095119+0000", 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006496501 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095156+0000", 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7552999999999998e-05 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095175+0000", 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8349999999999999e-05 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095315+0000", 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014044900000000001 2024-05-07T14:04:18.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095538+0000", 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022285999999999999 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095747+0000", 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020863199999999999 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.112469+0000", 2024-05-07T14:04:18.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016722012000000001 2024-05-07T14:04:18.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:18.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.114371+0000", 2024-05-07T14:04:18.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019026500000000001 2024-05-07T14:04:18.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:18.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.114592+0000", 2024-05-07T14:04:18.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022095400000000001 2024-05-07T14:04:18.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:18.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:18.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:18.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.114723+0000", 2024-05-07T14:04:18.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000130741 2024-05-07T14:04:18.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.511 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:18.511 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:18.511 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:18.512 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:04:18.513 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:04:18.514 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:18.523+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:18.613 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:18.626+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:18.684 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:18.685 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:18.685 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:18.700 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-05-07T14:04:18.715 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:04:18.748 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:18.759+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:18.815 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:18.823+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:18.823 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:18.823 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:18.823 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:18.837 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-05-07T14:04:18.857 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:18.857 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:18.873 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:18.874 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:18.890 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:18.907 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:18.907 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:18.924 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:18.924 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:18.935+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:18.924 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:18.942 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:18.943 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:18.961 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:18.962 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:18.982 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:04:18.982 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:04:19.000 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:19.000 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:19.015 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:04:19.056 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:19.067+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:19.118 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:19.131+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:19.137 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:19.137 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:19.151 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:04:19.219 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:19.227+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:19.275 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:19.276 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:19.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:04:19.319 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:19.327+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:19.407 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:19.408 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:19.420 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:19.434+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:19.422 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:04:19.443 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:04:19.521 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:19.531+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:19.566 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:19.566 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:19.580 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:04:19.624 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:19.638+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:19.707 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:19.707 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:19.721 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:04:19.722 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:19.731+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:19.824 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:19.834+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:19.895 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:19.896 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:19.909 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:04:19.924 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:19.935+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:20.025 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:20.038+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:20.083 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:20.083 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:20.097 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:04:20.144 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:20.158+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:20.227 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:20.238+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:20.267 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:20.267 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:20.281 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:04:20.368 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:20.382+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:20.429 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:20.439+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:20.450 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:20.451 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:20.465 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:04:20.553 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:20.566+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:20.630 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:20.642+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:20.631 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:20.631 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:20.645 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:04:20.737 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:20.750+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:20.815 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:20.815 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:20.829 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:04:20.831 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:20.839+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:20.932 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:20.943+0000 7f3754e23640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25374) UID: 0 2024-05-07T14:04:20.994 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:20.994 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:20.999 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:04:21.008 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:04:21.052 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:21.066+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:21.134 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:21.143+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:21.142 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:21.142 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:21.143 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:21.144 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:21.156 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:04:21.160 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:21.160 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:21.176 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:21.192 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:21.192 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:21.210 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:21.211 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:21.229 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:21.229 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:21.244 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:21.255+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:21.248 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:21.266 INFO:teuthology.orchestra.run.smithi106.stdout:osd.7: {} 2024-05-07T14:04:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:osd.7: osd_enable_op_tracker = '' 2024-05-07T14:04:21.322 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:21.322 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:21.322 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:21.322 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:21.322 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:21.336 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:04:21.336 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:21.350+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:21.437 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:21.450+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:21.467 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:04:21.507 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2224 3.1a 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.929267995000004, 2024-05-07T14:04:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027796929000000001, 2024-05-07T14:04:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2224 2024-05-07T14:04:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588348+0000", 2024-05-07T14:04:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1629999999999998e-06 2024-05-07T14:04:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594043+0000", 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056948950000000002 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594085+0000", 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1678999999999999e-05 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594113+0000", 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594221+0000", 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107371 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594405+0000", 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018468099999999999 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594570+0000", 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165224 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.603655+0000", 2024-05-07T14:04:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090846550000000005 2024-05-07T14:04:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.615968+0000", 2024-05-07T14:04:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012313199 2024-05-07T14:04:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616069+0000", 2024-05-07T14:04:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100309 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616141+0000", 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2218999999999994e-05 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2229 3.3 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.857971466999999, 2024-05-07T14:04:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028304669000000001, 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2229 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659643+0000", 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9129999999999999e-06 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664151+0000", 2024-05-07T14:04:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045081189999999997 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664198+0000", 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6431999999999999e-05 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664223+0000", 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5369999999999999e-05 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664313+0000", 2024-05-07T14:04:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345999999999995e-05 2024-05-07T14:04:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664428+0000", 2024-05-07T14:04:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115058 2024-05-07T14:04:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664566+0000", 2024-05-07T14:04:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138598 2024-05-07T14:04:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.671674+0000", 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071074529999999997 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687772+0000", 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016098359 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687871+0000", 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9098000000000006e-05 2024-05-07T14:04:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687945+0000", 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3923000000000004e-05 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2684 3.24 e104/21 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.719011006999999, 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026848770000000001, 2024-05-07T14:04:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6000000000000004e-07 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810718+0000", 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012116477 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810747+0000", 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8676000000000001e-05 2024-05-07T14:04:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810791+0000", 2024-05-07T14:04:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4415000000000001e-05 2024-05-07T14:04:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810915+0000", 2024-05-07T14:04:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012363399999999999 2024-05-07T14:04:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810950+0000", 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5812999999999997e-05 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825326+0000", 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014375852 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825450+0000", 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012334299999999999 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2685 3.1c e104/21 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head v 104'1, mlcod=0'0)", 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.712175334999998, 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023842609000000001, 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805437+0000", 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.805438+0000", 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.243e-06 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812353+0000", 2024-05-07T14:04:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069150560000000002 2024-05-07T14:04:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812385+0000", 2024-05-07T14:04:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2583000000000003e-05 2024-05-07T14:04:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812406+0000", 2024-05-07T14:04:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0378999999999999e-05 2024-05-07T14:04:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812541+0000", 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013502699999999999 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.812591+0000", 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0522999999999997e-05 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829183+0000", 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016591445999999999 2024-05-07T14:04:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829279+0000", 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6352000000000002e-05 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2686 3.34 3:2ec0e822:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.708960865000002, 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034864805999999998, 2024-05-07T14:04:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2686 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808656+0000", 2024-05-07T14:04:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6029999999999998e-06 2024-05-07T14:04:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818059+0000", 2024-05-07T14:04:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094034429999999992 2024-05-07T14:04:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818114+0000", 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4625e-05 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818139+0000", 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4850000000000001e-05 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819387+0000", 2024-05-07T14:04:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012488060000000001 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819792+0000", 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040472400000000002 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820050+0000", 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025799800000000001 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.833596+0000", 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013546069000000001 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843174+0000", 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095773449999999993 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023329199999999999 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843516+0000", 2024-05-07T14:04:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109051 2024-05-07T14:04:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2696 3.14 3:2aeb6272:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.604576025, 2024-05-07T14:04:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022593715, 2024-05-07T14:04:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2696 2024-05-07T14:04:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913036+0000", 2024-05-07T14:04:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.913039+0000", 2024-05-07T14:04:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3730000000000001e-06 2024-05-07T14:04:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917057+0000", 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040181319999999998 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917099+0000", 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.155e-05 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917118+0000", 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8862e-05 2024-05-07T14:04:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917285+0000", 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016734000000000001 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.917644+0000", 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00035872600000000002 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.918201+0000", 2024-05-07T14:04:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055705100000000003 2024-05-07T14:04:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.934860+0000", 2024-05-07T14:04:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016658665 2024-05-07T14:04:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935461+0000", 2024-05-07T14:04:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060165000000000001 2024-05-07T14:04:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935559+0000", 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8255e-05 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.935630+0000", 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0110999999999993e-05 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2755 3.14 3:2b7affc7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_72:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.97664915, 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023747145000000001, 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2755 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540963+0000", 2024-05-07T14:04:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.540983+0000", 2024-05-07T14:04:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0466999999999999e-05 2024-05-07T14:04:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545846+0000", 2024-05-07T14:04:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048626709999999998 2024-05-07T14:04:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545883+0000", 2024-05-07T14:04:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6769e-05 2024-05-07T14:04:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.545900+0000", 2024-05-07T14:04:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6869999999999999e-05 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546070+0000", 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017014299999999999 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546329+0000", 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025910400000000002 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.546560+0000", 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023119899999999999 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.555774+0000", 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092136490000000008 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564539+0000", 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087649870000000001 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564638+0000", 2024-05-07T14:04:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9028000000000001e-05 2024-05-07T14:04:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.564710+0000", 2024-05-07T14:04:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2257999999999998e-05 2024-05-07T14:04:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2799 3.9 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.505252339999998, 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027222948, 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2799 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012363+0000", 2024-05-07T14:04:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6500000000000002e-06 2024-05-07T14:04:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016678+0000", 2024-05-07T14:04:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043148320000000002 2024-05-07T14:04:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016709+0000", 2024-05-07T14:04:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0953e-05 2024-05-07T14:04:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016726+0000", 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7022999999999999e-05 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016864+0000", 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137854 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017108+0000", 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024388099999999999 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017333+0000", 2024-05-07T14:04:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022492899999999999 2024-05-07T14:04:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.033051+0000", 2024-05-07T14:04:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015718352000000001 2024-05-07T14:04:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039272+0000", 2024-05-07T14:04:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062205139999999999 2024-05-07T14:04:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039451+0000", 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017928 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039583+0000", 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013168000000000001 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2804 3.e e105/21 3:7356dc96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_121:head v 105'10, mlcod=105'8)", 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.444315596999999, 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029282694000000001, 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073299+0000", 2024-05-07T14:04:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:04:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076073+0000", 2024-05-07T14:04:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027746260000000001 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076118+0000", 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4223e-05 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076138+0000", 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0622999999999999e-05 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076324+0000", 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018613599999999999 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076376+0000", 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2068999999999999e-05 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102438+0000", 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026061190000000001 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102579+0000", 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014143399999999999 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2805 3.1 e105/21 3:819b24c4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_122:head v 105'3, mlcod=104'1)", 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.441352778000002, 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028404523000000001, 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076262+0000", 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3800000000000001e-06 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083265+0000", 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070039539999999997 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083309+0000", 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3516000000000001e-05 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083333+0000", 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4471999999999999e-05 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083520+0000", 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018616999999999999 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083588+0000", 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8405000000000007e-05 2024-05-07T14:04:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104547+0000", 2024-05-07T14:04:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020959228 2024-05-07T14:04:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104664+0000", 2024-05-07T14:04:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011639800000000001 2024-05-07T14:04:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2832 3.1a 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.269948014999997, 2024-05-07T14:04:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030681671000000001, 2024-05-07T14:04:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2832 2024-05-07T14:04:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247666+0000", 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5569999999999998e-06 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253202+0000", 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055353900000000003 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253232+0000", 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0309000000000001e-05 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253250+0000", 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7503000000000002e-05 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253372+0000", 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255600000000001 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253592+0000", 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021960400000000001 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253831+0000", 2024-05-07T14:04:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000239223 2024-05-07T14:04:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.264040+0000", 2024-05-07T14:04:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010209018 2024-05-07T14:04:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278176+0000", 2024-05-07T14:04:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014135518 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278272+0000", 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6562000000000001e-05 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278346+0000", 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3430999999999995e-05 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2853 3.34 3:2c5576f8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.061254126999998, 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026917739, 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2853 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456361+0000", 2024-05-07T14:04:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1240000000000001e-06 2024-05-07T14:04:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460499+0000", 2024-05-07T14:04:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041381159999999998 2024-05-07T14:04:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460528+0000", 2024-05-07T14:04:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8558999999999999e-05 2024-05-07T14:04:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460544+0000", 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6200000000000001e-05 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460699+0000", 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155513 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461098+0000", 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039883900000000001 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461508+0000", 2024-05-07T14:04:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040939399999999999 2024-05-07T14:04:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.474319+0000", 2024-05-07T14:04:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012811002 2024-05-07T14:04:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483036+0000", 2024-05-07T14:04:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087174469999999997 2024-05-07T14:04:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483142+0000", 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010647800000000001 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483276+0000", 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013306700000000001 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2874 3.34 3:2d878586:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.838652062000001, 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023302047999999999, 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2874 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678960+0000", 2024-05-07T14:04:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.678964+0000", 2024-05-07T14:04:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.89e-06 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683101+0000", 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041374669999999997 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683138+0000", 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7098999999999998e-05 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683155+0000", 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7139999999999999e-05 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683330+0000", 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000174919 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.683715+0000", 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038476199999999997 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.684028+0000", 2024-05-07T14:04:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031283999999999999 2024-05-07T14:04:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701377+0000", 2024-05-07T14:04:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017349402999999999 2024-05-07T14:04:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.701948+0000", 2024-05-07T14:04:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057096800000000004 2024-05-07T14:04:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702125+0000", 2024-05-07T14:04:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176319 2024-05-07T14:04:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.702262+0000", 2024-05-07T14:04:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137241 2024-05-07T14:04:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2883 3.29 e105/21 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head v 105'6, mlcod=104'4)", 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.737957342000001, 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022805558, 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779655+0000", 2024-05-07T14:04:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.779657+0000", 2024-05-07T14:04:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0370000000000001e-06 2024-05-07T14:04:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784248+0000", 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045916810000000002 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784272+0000", 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3281999999999998e-05 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784285+0000", 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3423e-05 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784399+0000", 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011439500000000001 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.784452+0000", 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2142000000000003e-05 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802362+0000", 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017910874 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.802460+0000", 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7724000000000002e-05 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2889 3.e e105/21 3:72a3c671:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_196:head v 105'11, mlcod=105'9)", 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 35.663085830999997, 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02270175, 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854526+0000", 2024-05-07T14:04:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.854529+0000", 2024-05-07T14:04:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7499999999999999e-06 2024-05-07T14:04:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857472+0000", 2024-05-07T14:04:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002942999 2024-05-07T14:04:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857510+0000", 2024-05-07T14:04:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8075999999999999e-05 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857533+0000", 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3353000000000002e-05 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857695+0000", 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016135300000000001 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.857761+0000", 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6759000000000002e-05 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877052+0000", 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019290656999999999 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.877228+0000", 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017580300000000001 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3190 3.1a 3:59666d5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.257182552, 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026496828, 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3190 2024-05-07T14:04:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260444+0000", 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4766000000000001e-05 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267146+0000", 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00670179 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267176+0000", 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0534999999999998e-05 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267191+0000", 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4080000000000001e-05 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267300+0000", 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109962 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267473+0000", 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000172516 2024-05-07T14:04:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267636+0000", 2024-05-07T14:04:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016309699999999999 2024-05-07T14:04:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.275955+0000", 2024-05-07T14:04:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083188399999999992 2024-05-07T14:04:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286699+0000", 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010743674999999999 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286808+0000", 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109702 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286926+0000", 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117865 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3335 3.9 3:93f3a6ca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:09.361724+0000", 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.15588764, 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027372132, 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3335 2024-05-07T14:04:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.361724+0000", 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.361724+0000", 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.361930+0000", 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000205331 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369409+0000", 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074794070000000004 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369456+0000", 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7413000000000002e-05 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369483+0000", 2024-05-07T14:04:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6366000000000001e-05 2024-05-07T14:04:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369665+0000", 2024-05-07T14:04:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018191799999999999 2024-05-07T14:04:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369944+0000", 2024-05-07T14:04:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027922599999999999 2024-05-07T14:04:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.370170+0000", 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000226233 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.379097+0000", 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089264380000000001 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.388922+0000", 2024-05-07T14:04:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0098254650000000002 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.389020+0000", 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7663000000000003e-05 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.389096+0000", 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6672e-05 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3351 3.31 e114/21 3:8fd6054f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_242:head v 114'10, mlcod=113'8)", 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:09.578617+0000", 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.938994589, 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024903304000000001, 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.578617+0000", 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.578617+0000", 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.578620+0000", 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3599999999999999e-06 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582736+0000", 2024-05-07T14:04:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041163069999999996 2024-05-07T14:04:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582774+0000", 2024-05-07T14:04:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7944000000000001e-05 2024-05-07T14:04:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582799+0000", 2024-05-07T14:04:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5222e-05 2024-05-07T14:04:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582906+0000", 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010689299999999999 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582933+0000", 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7192e-05 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.603465+0000", 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020531341000000002 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.603521+0000", 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6045000000000003e-05 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3604 3.1c e115/21 3:3a3fe722:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_485:head v 115'10, mlcod=114'8)", 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.157830+0000", 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.3597814899999996, 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032404158000000002, 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157830+0000", 2024-05-07T14:04:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157830+0000", 2024-05-07T14:04:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157833+0000", 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5900000000000002e-06 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164272+0000", 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006439485 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164319+0000", 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6699000000000001e-05 2024-05-07T14:04:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164345+0000", 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5415999999999999e-05 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164521+0000", 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176751 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164589+0000", 2024-05-07T14:04:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7803000000000001e-05 2024-05-07T14:04:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190083+0000", 2024-05-07T14:04:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025494176 2024-05-07T14:04:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190235+0000", 2024-05-07T14:04:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015123799999999999 2024-05-07T14:04:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3605 3.11 e115/21 3:8ac2b8fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_486:head v 115'13, mlcod=115'11)", 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.168137+0000", 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.3494750119999992, 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025037206999999999, 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.168137+0000", 2024-05-07T14:04:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.168137+0000", 2024-05-07T14:04:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.168140+0000", 2024-05-07T14:04:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6699999999999998e-06 2024-05-07T14:04:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173479+0000", 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053395300000000003 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173515+0000", 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6273999999999999e-05 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173533+0000", 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7368999999999999e-05 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173679+0000", 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000146568 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173722+0000", 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2395999999999999e-05 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.193023+0000", 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019300955000000002 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:21.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:21.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.193174+0000", 2024-05-07T14:04:21.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151445 2024-05-07T14:04:21.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.614 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.614 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:21.614 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:21.614 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:21.616 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:04:21.616 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:21.623+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:21.716 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:21.727+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:21.774 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-07T14:04:21.775 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-05-07T14:04:21.775 INFO:tasks.thrashosds.thrasher:Killing osd 7, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-05-07T14:04:21.775 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-07T14:04:21.775 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:04:21.787 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:21.787 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:21.787 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:21.802 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:04:21.845 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:21.855+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:21.873 INFO:tasks.ceph.osd.7:Stopped 2024-05-07T14:04:21.918 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:21.930+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:21.961 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:21.962 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:21.962 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:21.976 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:04:22.024 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:22.035+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:22.103 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2498 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.719100534999995, 2024-05-07T14:04:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.06015305, 2024-05-07T14:04:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:22.104 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2498 2024-05-07T14:04:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394887+0000", 2024-05-07T14:04:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:04:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394900+0000", 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3125999999999999e-05 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394940+0000", 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9579999999999997e-05 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394961+0000", 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1075999999999999e-05 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395122+0000", 2024-05-07T14:04:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160741 2024-05-07T14:04:22.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395140+0000", 2024-05-07T14:04:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:04:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430325+0000", 2024-05-07T14:04:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.03518512 2024-05-07T14:04:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:22.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430355+0000", 2024-05-07T14:04:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9181999999999999e-05 2024-05-07T14:04:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.445424+0000", 2024-05-07T14:04:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.015069751 2024-05-07T14:04:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:22.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.446159+0000", 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073452200000000004 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450456+0000", 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042973689999999997 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450627+0000", 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017032700000000001 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455037+0000", 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044108690000000004 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2499 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 75.718971486000001, 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.065623158, 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.113 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2499 2024-05-07T14:04:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395015+0000", 2024-05-07T14:04:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.57e-06 2024-05-07T14:04:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395022+0000", 2024-05-07T14:04:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1330000000000001e-06 2024-05-07T14:04:22.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395043+0000", 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1022999999999998e-05 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395060+0000", 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6325999999999999e-05 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395199+0000", 2024-05-07T14:04:22.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139815 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395215+0000", 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5693e-05 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413112+0000", 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017896860000000001 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:22.117 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413143+0000", 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1609000000000002e-05 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.447430+0000", 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0342867060000001 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450079+0000", 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002648386 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455213+0000", 2024-05-07T14:04:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051342749999999998 2024-05-07T14:04:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455444+0000", 2024-05-07T14:04:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023070799999999999 2024-05-07T14:04:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.460637+0000", 2024-05-07T14:04:22.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051930539999999999 2024-05-07T14:04:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2667 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.463726921000003, 2024-05-07T14:04:22.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1292758329999999, 2024-05-07T14:04:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2667 2024-05-07T14:04:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:22.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650260+0000", 2024-05-07T14:04:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1160000000000002e-06 2024-05-07T14:04:22.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650270+0000", 2024-05-07T14:04:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0047000000000001e-05 2024-05-07T14:04:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650296+0000", 2024-05-07T14:04:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6058999999999999e-05 2024-05-07T14:04:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650313+0000", 2024-05-07T14:04:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6727000000000001e-05 2024-05-07T14:04:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660781+0000", 2024-05-07T14:04:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010468518 2024-05-07T14:04:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660805+0000", 2024-05-07T14:04:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3246000000000001e-05 2024-05-07T14:04:22.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776636+0000", 2024-05-07T14:04:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.115831102 2024-05-07T14:04:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776958+0000", 2024-05-07T14:04:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032243199999999999 2024-05-07T14:04:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.779534+0000", 2024-05-07T14:04:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025755859999999999 2024-05-07T14:04:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2674 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:22.126 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.918303242, 2024-05-07T14:04:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58268987500000002, 2024-05-07T14:04:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2674 2024-05-07T14:04:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195683+0000", 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2500000000000001e-06 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195689+0000", 2024-05-07T14:04:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4300000000000003e-06 2024-05-07T14:04:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195702+0000", 2024-05-07T14:04:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3026e-05 2024-05-07T14:04:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195718+0000", 2024-05-07T14:04:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5532999999999998e-05 2024-05-07T14:04:22.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195943+0000", 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022518899999999999 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195971+0000", 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7688999999999999e-05 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.777763+0000", 2024-05-07T14:04:22.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58179212899999999 2024-05-07T14:04:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778060+0000", 2024-05-07T14:04:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029683599999999997 2024-05-07T14:04:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778372+0000", 2024-05-07T14:04:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031179299999999999 2024-05-07T14:04:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2685 3.1c 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.318454221000003, 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034286608000000003, 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2685 2024-05-07T14:04:22.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795533+0000", 2024-05-07T14:04:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:04:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803767+0000", 2024-05-07T14:04:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082339079999999999 2024-05-07T14:04:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803810+0000", 2024-05-07T14:04:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2969000000000001e-05 2024-05-07T14:04:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803837+0000", 2024-05-07T14:04:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7036e-05 2024-05-07T14:04:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804026+0000", 2024-05-07T14:04:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018935600000000001 2024-05-07T14:04:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804408+0000", 2024-05-07T14:04:22.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038137799999999998 2024-05-07T14:04:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804786+0000", 2024-05-07T14:04:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037841200000000001 2024-05-07T14:04:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.823281+0000", 2024-05-07T14:04:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018494561999999999 2024-05-07T14:04:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829623+0000", 2024-05-07T14:04:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063427279999999997 2024-05-07T14:04:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829715+0000", 2024-05-07T14:04:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1815000000000001e-05 2024-05-07T14:04:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829817+0000", 2024-05-07T14:04:22.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102051 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2689 3.2a 3:57071f6f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.275016600999997, 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032293512000000003, 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.138 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2689 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838972+0000", 2024-05-07T14:04:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.72e-06 2024-05-07T14:04:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843363+0000", 2024-05-07T14:04:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043909810000000004 2024-05-07T14:04:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:04:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4181999999999998e-05 2024-05-07T14:04:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843430+0000", 2024-05-07T14:04:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3139999999999999e-05 2024-05-07T14:04:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843735+0000", 2024-05-07T14:04:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030467299999999999 2024-05-07T14:04:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844287+0000", 2024-05-07T14:04:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055224799999999998 2024-05-07T14:04:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844674+0000", 2024-05-07T14:04:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038716199999999998 2024-05-07T14:04:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.868480+0000", 2024-05-07T14:04:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023805639999999999 2024-05-07T14:04:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.870993+0000", 2024-05-07T14:04:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025130920000000002 2024-05-07T14:04:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871151+0000", 2024-05-07T14:04:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000158176 2024-05-07T14:04:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871262+0000", 2024-05-07T14:04:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110498 2024-05-07T14:04:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.144 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2700 3.c 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.160002222000003, 2024-05-07T14:04:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028853172999999999, 2024-05-07T14:04:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2700 2024-05-07T14:04:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.145 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.954040+0000", 2024-05-07T14:04:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7735000000000002e-05 2024-05-07T14:04:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958710+0000", 2024-05-07T14:04:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046694220000000003 2024-05-07T14:04:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958759+0000", 2024-05-07T14:04:22.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8671999999999997e-05 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958778+0000", 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958955+0000", 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177197 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959253+0000", 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029744999999999999 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959545+0000", 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029215699999999997 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.969251+0000", 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097062789999999999 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982559+0000", 2024-05-07T14:04:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013307818000000001 2024-05-07T14:04:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982721+0000", 2024-05-07T14:04:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016221200000000001 2024-05-07T14:04:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982836+0000", 2024-05-07T14:04:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114605 2024-05-07T14:04:22.150 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2782 3.5 3:a0760020:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.290231374999998, 2024-05-07T14:04:22.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029185556000000001, 2024-05-07T14:04:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2782 2024-05-07T14:04:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:22.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823757+0000", 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7330000000000001e-06 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829013+0000", 2024-05-07T14:04:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052552889999999998 2024-05-07T14:04:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829062+0000", 2024-05-07T14:04:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9375000000000001e-05 2024-05-07T14:04:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829089+0000", 2024-05-07T14:04:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7143000000000001e-05 2024-05-07T14:04:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829248+0000", 2024-05-07T14:04:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015877 2024-05-07T14:04:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829262+0000", 2024-05-07T14:04:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.365e-05 2024-05-07T14:04:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835685+0000", 2024-05-07T14:04:22.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064232339999999999 2024-05-07T14:04:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835910+0000", 2024-05-07T14:04:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022484800000000001 2024-05-07T14:04:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.836115+0000", 2024-05-07T14:04:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000204916 2024-05-07T14:04:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.851571+0000", 2024-05-07T14:04:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015456634 2024-05-07T14:04:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852768+0000", 2024-05-07T14:04:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001197264 2024-05-07T14:04:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852867+0000", 2024-05-07T14:04:22.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9011000000000005e-05 2024-05-07T14:04:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852939+0000", 2024-05-07T14:04:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1688999999999998e-05 2024-05-07T14:04:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2793 3.30 3:0c9cfcfb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.164578188, 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028754691999999998, 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2793 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.159 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949410+0000", 2024-05-07T14:04:22.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7239999999999998e-06 2024-05-07T14:04:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956008+0000", 2024-05-07T14:04:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065976560000000004 2024-05-07T14:04:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956068+0000", 2024-05-07T14:04:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9781999999999998e-05 2024-05-07T14:04:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956087+0000", 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9009999999999999e-05 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956241+0000", 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015391600000000001 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956640+0000", 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039917499999999999 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956860+0000", 2024-05-07T14:04:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021961499999999999 2024-05-07T14:04:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.967010+0000", 2024-05-07T14:04:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01015011 2024-05-07T14:04:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.977827+0000", 2024-05-07T14:04:22.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010817148 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978012+0000", 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018541 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978161+0000", 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014914600000000001 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2815 3.2a 3:5644b81f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.938853094000002, 2024-05-07T14:04:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027617527999999999, 2024-05-07T14:04:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2815 2024-05-07T14:04:22.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175132+0000", 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.175136+0000", 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7869999999999999e-06 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179183+0000", 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004047358 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179215+0000", 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1919999999999999e-05 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179238+0000", 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3036000000000001e-05 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179367+0000", 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000128627 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179613+0000", 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024667500000000002 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.179847+0000", 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000233668 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.196418+0000", 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016571579999999999 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202617+0000", 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061980830000000001 2024-05-07T14:04:22.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202688+0000", 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1481000000000002e-05 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.202749+0000", 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1313000000000001e-05 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2865 3.38 e105/21 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.528958603, 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032748549000000002, 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585029+0000", 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9639999999999999e-06 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589707+0000", 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046776889999999996 2024-05-07T14:04:22.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589754+0000", 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7382000000000001e-05 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589780+0000", 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5232000000000002e-05 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589966+0000", 2024-05-07T14:04:22.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000186596 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.590031+0000", 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5038999999999999e-05 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617527+0000", 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027496216 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617775+0000", 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247431 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2888 3.2 e105/46 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head v 105'8, mlcod=104'6)", 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.272896369999998, 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.033929095999999999, 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841091+0000", 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.39e-06 2024-05-07T14:04:22.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.847981+0000", 2024-05-07T14:04:22.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068900630000000001 2024-05-07T14:04:22.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848020+0000", 2024-05-07T14:04:22.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8846e-05 2024-05-07T14:04:22.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848039+0000", 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848222+0000", 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018251300000000001 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848268+0000", 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5552e-05 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.874885+0000", 2024-05-07T14:04:22.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026617335999999998 2024-05-07T14:04:22.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.875018+0000", 2024-05-07T14:04:22.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013276999999999999 2024-05-07T14:04:22.179 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.179 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.179 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.179 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2894 3.16 3:6aec0fdf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.200249866999997, 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029574030000000001, 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2894 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:22.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:22.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913738+0000", 2024-05-07T14:04:22.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.491e-06 2024-05-07T14:04:22.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917692+0000", 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039540799999999996 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917718+0000", 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6211e-05 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917732+0000", 2024-05-07T14:04:22.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4487999999999999e-05 2024-05-07T14:04:22.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917897+0000", 2024-05-07T14:04:22.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016455199999999999 2024-05-07T14:04:22.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918296+0000", 2024-05-07T14:04:22.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000398825 2024-05-07T14:04:22.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918724+0000", 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042847399999999998 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.933484+0000", 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014759959 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.942986+0000", 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095014739999999993 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943179+0000", 2024-05-07T14:04:22.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019320200000000001 2024-05-07T14:04:22.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943309+0000", 2024-05-07T14:04:22.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013027399999999999 2024-05-07T14:04:22.185 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.185 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.185 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.186 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2896 3.3a 3:5f842f5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.186 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:22.186 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.179490203999997, 2024-05-07T14:04:22.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028429466, 2024-05-07T14:04:22.186 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.186 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.186 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.186 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.186 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.186 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.186 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2896 2024-05-07T14:04:22.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.186 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934498+0000", 2024-05-07T14:04:22.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.557e-06 2024-05-07T14:04:22.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939927+0000", 2024-05-07T14:04:22.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054289250000000002 2024-05-07T14:04:22.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939955+0000", 2024-05-07T14:04:22.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8245000000000001e-05 2024-05-07T14:04:22.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939971+0000", 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.504e-05 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940161+0000", 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019040499999999999 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940562+0000", 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040076800000000002 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:22.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940979+0000", 2024-05-07T14:04:22.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041760099999999997 2024-05-07T14:04:22.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.950692+0000", 2024-05-07T14:04:22.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097127529999999993 2024-05-07T14:04:22.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962768+0000", 2024-05-07T14:04:22.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012075987 2024-05-07T14:04:22.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962863+0000", 2024-05-07T14:04:22.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5103000000000001e-05 2024-05-07T14:04:22.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962924+0000", 2024-05-07T14:04:22.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1081999999999996e-05 2024-05-07T14:04:22.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.191 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.192 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.192 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2908 3.3a 3:5d7a0a59:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.192 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:22.192 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.028138865000003, 2024-05-07T14:04:22.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027562652999999999, 2024-05-07T14:04:22.192 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.192 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.192 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.192 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.192 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.192 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.193 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2908 2024-05-07T14:04:22.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.193 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:22.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085846+0000", 2024-05-07T14:04:22.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.085850+0000", 2024-05-07T14:04:22.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.267e-06 2024-05-07T14:04:22.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091371+0000", 2024-05-07T14:04:22.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055205619999999997 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091411+0000", 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0365999999999999e-05 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091432+0000", 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0276e-05 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.091608+0000", 2024-05-07T14:04:22.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176653 2024-05-07T14:04:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.092025+0000", 2024-05-07T14:04:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041696799999999998 2024-05-07T14:04:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.092418+0000", 2024-05-07T14:04:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000393099 2024-05-07T14:04:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.102443+0000", 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010024798999999999 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113230+0000", 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010786963 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113330+0000", 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9808000000000004e-05 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.113409+0000", 2024-05-07T14:04:22.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8892000000000003e-05 2024-05-07T14:04:22.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.198 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.198 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3197 3.d e113/21 3:b35829be:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_89:head v 113'16, mlcod=113'14)", 2024-05-07T14:04:22.198 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:22.198 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.778805755, 2024-05-07T14:04:22.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029081169, 2024-05-07T14:04:22.198 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335182+0000", 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7329999999999999e-06 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338859+0000", 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036773589999999998 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338896+0000", 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6656000000000003e-05 2024-05-07T14:04:22.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338922+0000", 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5936999999999999e-05 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339046+0000", 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012458400000000001 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339089+0000", 2024-05-07T14:04:22.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2342999999999998e-05 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.364123+0000", 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025034187999999999 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.364260+0000", 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013736900000000001 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.203 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3210 3.2f 3:f67c3789:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:22.203 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:22.203 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.647041999000001, 2024-05-07T14:04:22.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042403633000000003, 2024-05-07T14:04:22.203 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.203 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.203 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.203 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.203 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.203 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.203 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3210 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466947+0000", 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5669999999999999e-06 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471128+0000", 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041817620000000003 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471175+0000", 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6279000000000002e-05 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471200+0000", 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5177e-05 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471361+0000", 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160848 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471379+0000", 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8142e-05 2024-05-07T14:04:22.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.479968+0000", 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085897040000000001 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.480366+0000", 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039736399999999999 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.480736+0000", 2024-05-07T14:04:22.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037031899999999998 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.495479+0000", 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014742992 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509169+0000", 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013690179 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509268+0000", 2024-05-07T14:04:22.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8814999999999995e-05 2024-05-07T14:04:22.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509347+0000", 2024-05-07T14:04:22.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8485000000000005e-05 2024-05-07T14:04:22.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.209 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.209 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3602 3.5 3:a2d0df3e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_483:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:22.209 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.132400+0000", 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.9815850820000005, 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027859134000000001, 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3602 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.132400+0000", 2024-05-07T14:04:22.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.132400+0000", 2024-05-07T14:04:22.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.132404+0000", 2024-05-07T14:04:22.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8160000000000004e-06 2024-05-07T14:04:22.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.136457+0000", 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040533849999999996 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.136498+0000", 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1059000000000001e-05 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.136526+0000", 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7520000000000001e-05 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.136700+0000", 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017472399999999999 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.137075+0000", 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037488799999999998 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.137366+0000", 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000290613 2024-05-07T14:04:22.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.148499+0000", 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011133077 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.160042+0000", 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011542682 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.160135+0000", 2024-05-07T14:04:22.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3745000000000005e-05 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.160259+0000", 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012362500000000001 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3604 3.1c 3:3a3fe722:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_485:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.152001+0000", 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.9619834439999995, 2024-05-07T14:04:22.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038767554000000003, 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3604 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.152001+0000", 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.152001+0000", 2024-05-07T14:04:22.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.152004+0000", 2024-05-07T14:04:22.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8899999999999999e-06 2024-05-07T14:04:22.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.156819+0000", 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048148369999999998 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.156860+0000", 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0355999999999998e-05 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.156878+0000", 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.878e-05 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157060+0000", 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181991 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157341+0000", 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028081599999999998 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157583+0000", 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241506 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.169148+0000", 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011565242 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190604+0000", 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021456052 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190700+0000", 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6164999999999998e-05 2024-05-07T14:04:22.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190769+0000", 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8918999999999995e-05 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3611 3.16 3:6a1fde75:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_492:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.231125+0000", 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.8828597400000007, 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032234160999999997, 2024-05-07T14:04:22.221 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3611 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.231125+0000", 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.231125+0000", 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.231130+0000", 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9629999999999997e-06 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235158+0000", 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040282679999999998 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235197+0000", 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8654e-05 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235216+0000", 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9099000000000001e-05 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235350+0000", 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013348200000000001 2024-05-07T14:04:22.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235617+0000", 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026753900000000001 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235861+0000", 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024357299999999999 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.249418+0000", 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013557394 2024-05-07T14:04:22.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.263075+0000", 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013656423000000001 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.263246+0000", 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000170944 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.263359+0000", 2024-05-07T14:04:22.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113822 2024-05-07T14:04:22.227 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.227 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.227 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.227 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.227 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.227 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:22.228 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:04:22.229 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:22.239+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:22.329 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:22.342+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:22.397 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:22.398 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:22.398 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:22.398 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:22.412 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:04:22.430 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:22.442+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:04:22.530 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:22.539+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:22.537 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:22.537 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:22.537 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:22.551 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:04:22.631 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:22.642+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2207 3.26 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.391506864999997, 2024-05-07T14:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029257551999999999, 2024-05-07T14:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2207 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338601+0000", 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0769999999999998e-06 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344166+0000", 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055649139999999998 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344203+0000", 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7109e-05 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344221+0000", 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344394+0000", 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000173208 2024-05-07T14:04:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344788+0000", 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039418400000000001 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345265+0000", 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047689299999999999 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365597+0000", 2024-05-07T14:04:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020331954999999999 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367512+0000", 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001915237 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367693+0000", 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018108800000000001 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367853+0000", 2024-05-07T14:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016028400000000001 2024-05-07T14:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2507 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [call rgw.bucket_list in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.314398327000006, 2024-05-07T14:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.019773713, 2024-05-07T14:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2507 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415708+0000", 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4860000000000002e-06 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415724+0000", 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.643e-05 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415759+0000", 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4252999999999999e-05 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415783+0000", 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4315999999999999e-05 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419072+0000", 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032886119999999998 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419099+0000", 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6956000000000001e-05 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435061+0000", 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0159622509999999 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435231+0000", 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016978800000000001 2024-05-07T14:04:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435478+0000", 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024762100000000001 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2686 3.34 e104/21 3:2ec0e822:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_3:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.820422+0000", 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.909680399999999, 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022287620000000001, 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820422+0000", 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820422+0000", 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820423+0000", 2024-05-07T14:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.44e-07 2024-05-07T14:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825658+0000", 2024-05-07T14:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005235066 2024-05-07T14:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825692+0000", 2024-05-07T14:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4048999999999999e-05 2024-05-07T14:04:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825717+0000", 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5216e-05 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.826297+0000", 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058014099999999995 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.826353+0000", 2024-05-07T14:04:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5831999999999997e-05 2024-05-07T14:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.842559+0000", 2024-05-07T14:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016205768999999998 2024-05-07T14:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.842710+0000", 2024-05-07T14:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151003 2024-05-07T14:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2695 3.35 3:acf2d7d8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.828665573000002, 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028454303, 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2695 2024-05-07T14:04:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901441+0000", 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9600000000000002e-06 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907573+0000", 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061315939999999998 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907630+0000", 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6818999999999999e-05 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907649+0000", 2024-05-07T14:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9859000000000001e-05 2024-05-07T14:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907857+0000", 2024-05-07T14:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000207159 2024-05-07T14:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.908127+0000", 2024-05-07T14:04:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027069099999999999 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.908468+0000", 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034104600000000001 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.918062+0000", 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095934409999999994 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929718+0000", 2024-05-07T14:04:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011656141 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929819+0000", 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100634 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929892+0000", 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2959000000000004e-05 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2719 3.10 3:0b5df28b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.553575176999999, 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028912935000000001, 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2719 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176531+0000", 2024-05-07T14:04:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3699999999999999e-06 2024-05-07T14:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182042+0000", 2024-05-07T14:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00551105 2024-05-07T14:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182083+0000", 2024-05-07T14:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1402000000000001e-05 2024-05-07T14:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182103+0000", 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9953e-05 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182262+0000", 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015816699999999999 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182545+0000", 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028303999999999997 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182779+0000", 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023474800000000001 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.195512+0000", 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012733081 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205013+0000", 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095007670000000002 2024-05-07T14:04:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205264+0000", 2024-05-07T14:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025112099999999998 2024-05-07T14:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205441+0000", 2024-05-07T14:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176236 2024-05-07T14:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2734 3.a 3:5117726b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.401454151000003, 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026910749000000001, 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2734 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328652+0000", 2024-05-07T14:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9500000000000001e-06 2024-05-07T14:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333686+0000", 2024-05-07T14:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050342010000000003 2024-05-07T14:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333726+0000", 2024-05-07T14:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9802000000000003e-05 2024-05-07T14:04:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333753+0000", 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7702999999999999e-05 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333900+0000", 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014663999999999999 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.334151+0000", 2024-05-07T14:04:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025143799999999999 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.334390+0000", 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000238268 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.346870+0000", 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012480753000000001 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355331+0000", 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084610090000000002 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355483+0000", 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015194000000000001 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355559+0000", 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6044999999999994e-05 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2786 3.20 3:043afb92:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.858230429000002, 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026616246, 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2786 2024-05-07T14:04:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871877+0000", 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2969999999999997e-06 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876185+0000", 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004308503 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876223+0000", 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7852000000000003e-05 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876242+0000", 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9253999999999999e-05 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876395+0000", 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015306599999999999 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876685+0000", 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028964699999999997 2024-05-07T14:04:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876925+0000", 2024-05-07T14:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023967500000000001 2024-05-07T14:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.885744+0000", 2024-05-07T14:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008819749 2024-05-07T14:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898308+0000", 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012563710000000001 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898410+0000", 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101582 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898489+0000", 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8911000000000004e-05 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2807 3.3f e105/21 3:fd0db1b2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_124:head v 105'6, mlcod=85'4)", 2024-05-07T14:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.629150629999998, 2024-05-07T14:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026784641000000001, 2024-05-07T14:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100955+0000", 2024-05-07T14:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8200000000000001e-06 2024-05-07T14:04:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105915+0000", 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049600290000000003 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105956+0000", 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1205000000000003e-05 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105973+0000", 2024-05-07T14:04:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7087000000000001e-05 2024-05-07T14:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.106125+0000", 2024-05-07T14:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015208299999999999 2024-05-07T14:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.106192+0000", 2024-05-07T14:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6809000000000004e-05 2024-05-07T14:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.127628+0000", 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02143579 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.127737+0000", 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000108818 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2828 3.2c 3:37c1d26d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.206105+0000", 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.523997823000002, 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023644783999999999, 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2828 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.206105+0000", 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.206105+0000", 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.206109+0000", 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5939999999999998e-06 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.212890+0000", 2024-05-07T14:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067816780000000002 2024-05-07T14:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.212936+0000", 2024-05-07T14:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5535999999999999e-05 2024-05-07T14:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.212960+0000", 2024-05-07T14:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4685000000000002e-05 2024-05-07T14:04:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.213165+0000", 2024-05-07T14:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020478299999999999 2024-05-07T14:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.213570+0000", 2024-05-07T14:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040477800000000001 2024-05-07T14:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.213999+0000", 2024-05-07T14:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042946 2024-05-07T14:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.227004+0000", 2024-05-07T14:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013004946999999999 2024-05-07T14:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.229490+0000", 2024-05-07T14:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024852120000000001 2024-05-07T14:04:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.229634+0000", 2024-05-07T14:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144074 2024-05-07T14:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.229750+0000", 2024-05-07T14:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116037 2024-05-07T14:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2829 3.35 3:aeb9f674:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.217157+0000", 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.512946268, 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022531881, 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2829 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.217157+0000", 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.217157+0000", 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.217159+0000", 2024-05-07T14:04:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.531e-06 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221183+0000", 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040234559999999999 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221218+0000", 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5602000000000002e-05 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221235+0000", 2024-05-07T14:04:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6948000000000001e-05 2024-05-07T14:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221367+0000", 2024-05-07T14:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013174199999999999 2024-05-07T14:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221629+0000", 2024-05-07T14:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026224400000000002 2024-05-07T14:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221852+0000", 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022335599999999999 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.238414+0000", 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016561306000000001 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.239379+0000", 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00096533899999999995 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.239557+0000", 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177916 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.239688+0000", 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013144099999999999 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2851 3.35 3:aedd2f32:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.437038+0000", 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.293064573000002, 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023592841, 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2851 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.437038+0000", 2024-05-07T14:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.437038+0000", 2024-05-07T14:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.437042+0000", 2024-05-07T14:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6899999999999998e-06 2024-05-07T14:04:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443186+0000", 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006144137 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443240+0000", 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4061000000000003e-05 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443268+0000", 2024-05-07T14:04:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7843000000000001e-05 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443448+0000", 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018044 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443858+0000", 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040941399999999998 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.444268+0000", 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041045799999999999 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453481+0000", 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092126599999999993 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460427+0000", 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069463989999999998 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460519+0000", 2024-05-07T14:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1778000000000001e-05 2024-05-07T14:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460631+0000", 2024-05-07T14:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011196099999999999 2024-05-07T14:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2852 3.26 3:6683f345:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.446514+0000", 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 37.283588752999997, 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022598677000000001, 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2852 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.446514+0000", 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.446514+0000", 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.446517+0000", 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7199999999999998e-06 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453133+0000", 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066160769999999997 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453162+0000", 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.921e-05 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453179+0000", 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7266e-05 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453334+0000", 2024-05-07T14:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000154253 2024-05-07T14:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453706+0000", 2024-05-07T14:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037270400000000001 2024-05-07T14:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.454035+0000", 2024-05-07T14:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032850099999999998 2024-05-07T14:04:22.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.462913+0000", 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088785270000000006 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.468949+0000", 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060357450000000003 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.469023+0000", 2024-05-07T14:04:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4406000000000006e-05 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.469113+0000", 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9268e-05 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2902 3.10 3:0b53d764:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.012188+0000", 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.717915093000002, 2024-05-07T14:04:22.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023745938000000001, 2024-05-07T14:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2902 2024-05-07T14:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.012188+0000", 2024-05-07T14:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.012188+0000", 2024-05-07T14:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.012190+0000", 2024-05-07T14:04:22.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2680000000000001e-06 2024-05-07T14:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017271+0000", 2024-05-07T14:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050807179999999997 2024-05-07T14:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017301+0000", 2024-05-07T14:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0354000000000001e-05 2024-05-07T14:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017317+0000", 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6388e-05 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017445+0000", 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012714000000000001 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017761+0000", 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031622699999999998 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.018089+0000", 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000328093 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.030270+0000", 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012180679999999999 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.035653+0000", 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053833900000000001 2024-05-07T14:04:22.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.035818+0000", 2024-05-07T14:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016458600000000001 2024-05-07T14:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.035934+0000", 2024-05-07T14:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116094 2024-05-07T14:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2912 3.36 3:6fcd222f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.591674568999998, 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02818507, 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2912 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.795 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138433+0000", 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0069999999999997e-06 2024-05-07T14:04:22.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.143973+0000", 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055392719999999996 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144024+0000", 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1128999999999998e-05 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144044+0000", 2024-05-07T14:04:22.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0526e-05 2024-05-07T14:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144267+0000", 2024-05-07T14:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022246500000000001 2024-05-07T14:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144532+0000", 2024-05-07T14:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026575900000000001 2024-05-07T14:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144805+0000", 2024-05-07T14:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027290000000000002 2024-05-07T14:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.162814+0000", 2024-05-07T14:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018008631000000001 2024-05-07T14:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166347+0000", 2024-05-07T14:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035334429999999998 2024-05-07T14:04:22.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166490+0000", 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014308699999999999 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166613+0000", 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012285099999999999 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2918 3.10 3:0a57f05a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.523290981000002, 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030233789, 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2918 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206816+0000", 2024-05-07T14:04:22.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6229999999999996e-06 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.210992+0000", 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041755799999999999 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211043+0000", 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0584999999999998e-05 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211070+0000", 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7716999999999999e-05 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211251+0000", 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000180683 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211678+0000", 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042701099999999998 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.212087+0000", 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040911799999999998 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.222312+0000", 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010224551 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.236912+0000", 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014600548 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.236982+0000", 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9476999999999999e-05 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.237046+0000", 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3895999999999999e-05 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.806 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3198 3.2c 3:34ce24fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.390188616, 2024-05-07T14:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026711016000000001, 2024-05-07T14:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3198 2024-05-07T14:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339918+0000", 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000001e-06 2024-05-07T14:04:22.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.343982+0000", 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040642320000000001 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344027+0000", 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024999999999997e-05 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344052+0000", 2024-05-07T14:04:22.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4603000000000001e-05 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344190+0000", 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013819 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344377+0000", 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018666200000000001 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:22.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344585+0000", 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000208452 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.362586+0000", 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018000754000000001 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366457+0000", 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003871542 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366546+0000", 2024-05-07T14:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8601000000000001e-05 2024-05-07T14:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366625+0000", 2024-05-07T14:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9272999999999998e-05 2024-05-07T14:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.812 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3208 3.26 3:66fd0e21:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.280850272, 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041868750000000003, 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3208 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449257+0000", 2024-05-07T14:04:22.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.07e-06 2024-05-07T14:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455814+0000", 2024-05-07T14:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065570660000000003 2024-05-07T14:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455854+0000", 2024-05-07T14:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0819999999999999e-05 2024-05-07T14:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455874+0000", 2024-05-07T14:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9993e-05 2024-05-07T14:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.456063+0000", 2024-05-07T14:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018892400000000001 2024-05-07T14:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.456077+0000", 2024-05-07T14:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3433e-05 2024-05-07T14:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.462635+0000", 2024-05-07T14:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065577869999999998 2024-05-07T14:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.462869+0000", 2024-05-07T14:04:22.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023394299999999999 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.463127+0000", 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0002588 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.473024+0000", 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0098969100000000001 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.490912+0000", 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017887291 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.491010+0000", 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8041999999999994e-05 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.491121+0000", 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111671 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.819 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3214 3.2c 3:36c50e70:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.505220+0000", 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.224883176000001, 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022100794999999999, 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3214 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.820 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.505220+0000", 2024-05-07T14:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.505220+0000", 2024-05-07T14:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.505224+0000", 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4560000000000002e-06 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510370+0000", 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051455140000000003 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510407+0000", 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7902999999999999e-05 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510424+0000", 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6840000000000001e-05 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510580+0000", 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015549100000000001 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.510839+0000", 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025945299999999998 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.511096+0000", 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025659899999999999 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.524699+0000", 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013603373 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.527137+0000", 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024377610000000001 2024-05-07T14:04:22.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.527245+0000", 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107792 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.527320+0000", 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5612999999999996e-05 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3230 3.35 3:af7e1017:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.683889+0000", 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.046214146000001, 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024914794000000001, 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3230 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.683889+0000", 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.683889+0000", 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.683893+0000", 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8339999999999998e-06 2024-05-07T14:04:22.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689114+0000", 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005220616 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689172+0000", 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7479000000000003e-05 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689189+0000", 2024-05-07T14:04:22.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.766e-05 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689318+0000", 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012900499999999999 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689573+0000", 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025489600000000001 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689808+0000", 2024-05-07T14:04:22.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023451 2024-05-07T14:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.698461+0000", 2024-05-07T14:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086537990000000002 2024-05-07T14:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.708562+0000", 2024-05-07T14:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010100052 2024-05-07T14:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.708728+0000", 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000166214 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.708803+0000", 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5729000000000006e-05 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3598 3.36 3:6ff6851c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_479:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.088618+0000", 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.64148513, 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026105204999999999, 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3598 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:22.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.088618+0000", 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.088618+0000", 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.088622+0000", 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5029999999999999e-06 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:22.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095119+0000", 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006496501 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095156+0000", 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7552999999999998e-05 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095175+0000", 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8349999999999999e-05 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095315+0000", 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014044900000000001 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095538+0000", 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022285999999999999 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095747+0000", 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020863199999999999 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.112469+0000", 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016722012000000001 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.114371+0000", 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019026500000000001 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.114592+0000", 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022095400000000001 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:22.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.114723+0000", 2024-05-07T14:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000130741 2024-05-07T14:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:22.837 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:22.839 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:04:22.839 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:22.850+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:22.940 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:22.951+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:22.969 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:22.969 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:22.969 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:04:22.970 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:22.984 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:04:23.040 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:23.054+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:23.106 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:23.106 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:23.106 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:23.106 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:23.106 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:23.120 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:04:23.164 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:23.178+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:23.242 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:23.255+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:23.284 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:04:23.296 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:23.296 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:23.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2225 3.1f 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:04:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 79.708643222999996, 2024-05-07T14:04:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020378113, 2024-05-07T14:04:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.297 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2225 2024-05-07T14:04:23.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.298 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.298 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.298 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:04:23.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.298 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.298 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:04:23.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598750+0000", 2024-05-07T14:04:23.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8859999999999997e-06 2024-05-07T14:04:23.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602351+0000", 2024-05-07T14:04:23.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600195 2024-05-07T14:04:23.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602470+0000", 2024-05-07T14:04:23.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119608 2024-05-07T14:04:23.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602494+0000", 2024-05-07T14:04:23.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.376e-05 2024-05-07T14:04:23.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602590+0000", 2024-05-07T14:04:23.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6399999999999999e-05 2024-05-07T14:04:23.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602740+0000", 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014951 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602884+0000", 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000143616 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618629+0000", 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015745420999999999 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:23.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619008+0000", 2024-05-07T14:04:23.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037870699999999999 2024-05-07T14:04:23.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619069+0000", 2024-05-07T14:04:23.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1617000000000003e-05 2024-05-07T14:04:23.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619125+0000", 2024-05-07T14:04:23.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5393000000000003e-05 2024-05-07T14:04:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2229 3.3 e84/21 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head v 84'2, mlcod=0'0)", 2024-05-07T14:04:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:04:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 79.642432181000004, 2024-05-07T14:04:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022534413, 2024-05-07T14:04:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.303 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:04:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:04:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664960+0000", 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0109999999999999e-06 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670334+0000", 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005374635 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3374999999999998e-05 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670385+0000", 2024-05-07T14:04:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7512000000000001e-05 2024-05-07T14:04:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670515+0000", 2024-05-07T14:04:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012940900000000001 2024-05-07T14:04:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670543+0000", 2024-05-07T14:04:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8157000000000002e-05 2024-05-07T14:04:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687374+0000", 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016831793000000001 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687492+0000", 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117521 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.307 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2497 7.9 7:93e5b521:::notify.7:head [watch reconnect cookie 94397682177536 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 76.912448760000004, 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0512951690000001, 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2497 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394942+0000", 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9100000000000002e-07 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.309 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394946+0000", 2024-05-07T14:04:23.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2239999999999997e-06 2024-05-07T14:04:23.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394960+0000", 2024-05-07T14:04:23.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3419e-05 2024-05-07T14:04:23.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394966+0000", 2024-05-07T14:04:23.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3620000000000002e-06 2024-05-07T14:04:23.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395019+0000", 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3099000000000001e-05 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395023+0000", 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0879999999999997e-06 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400981+0000", 2024-05-07T14:04:23.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059580520000000001 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400990+0000", 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0880000000000001e-06 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438550+0000", 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.037559288 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:23.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.439512+0000", 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000962154 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442920+0000", 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034085109999999999 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442966+0000", 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5509000000000001e-05 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.446236+0000", 2024-05-07T14:04:23.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032704840000000002 2024-05-07T14:04:23.314 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.314 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.314 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.314 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2665 7.9 7:93e5b521:::notify.7:head [watch reconnect cookie 94397682177536 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:23.314 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.650634+0000", 2024-05-07T14:04:23.314 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.656755486000002, 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1256737430000001, 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2665 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650634+0000", 2024-05-07T14:04:23.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650634+0000", 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650636+0000", 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0549999999999998e-06 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650644+0000", 2024-05-07T14:04:23.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1849999999999998e-06 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650657+0000", 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3839000000000001e-05 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650669+0000", 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1483e-05 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650731+0000", 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2327000000000001e-05 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650742+0000", 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1216999999999999e-05 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774923+0000", 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.124180213 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775019+0000", 2024-05-07T14:04:23.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5995000000000005e-05 2024-05-07T14:04:23.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.776308+0000", 2024-05-07T14:04:23.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012894289999999999 2024-05-07T14:04:23.319 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.319 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.319 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.319 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2669 7.9 7:93e5b521:::notify.7:head [watch ping cookie 94397682177536 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195592+0000", 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.111797992, 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.58012271999999998, 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2669 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195592+0000", 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195592+0000", 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195594+0000", 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4899999999999999e-06 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195605+0000", 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.08e-05 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195627+0000", 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1577999999999999e-05 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195637+0000", 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0258000000000001e-05 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195966+0000", 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032875299999999999 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.196005+0000", 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9662000000000001e-05 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775356+0000", 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57935019200000004 2024-05-07T14:04:23.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775484+0000", 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012866399999999999 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775715+0000", 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000230323 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.324 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2702 3.1b 3:d8b8357f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:23.325 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.975062+0000", 2024-05-07T14:04:23.325 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.332328242999999, 2024-05-07T14:04:23.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021948369999999998, 2024-05-07T14:04:23.325 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.325 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.325 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.325 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.325 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.325 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.325 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2702 2024-05-07T14:04:23.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.325 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.975062+0000", 2024-05-07T14:04:23.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.975062+0000", 2024-05-07T14:04:23.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.975064+0000", 2024-05-07T14:04:23.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.973e-06 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977232+0000", 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002168728 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977260+0000", 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7475e-05 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977275+0000", 2024-05-07T14:04:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5183e-05 2024-05-07T14:04:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977377+0000", 2024-05-07T14:04:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010254100000000001 2024-05-07T14:04:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977581+0000", 2024-05-07T14:04:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020312499999999999 2024-05-07T14:04:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977709+0000", 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012883799999999999 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.985043+0000", 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007334007 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.996896+0000", 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01185277 2024-05-07T14:04:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.996962+0000", 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6267999999999996e-05 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.997010+0000", 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7462000000000001e-05 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2703 3.2b 3:d6a94723:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.986066+0000", 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 39.321323575000001, 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026422658000000002, 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2703 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.986066+0000", 2024-05-07T14:04:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.986066+0000", 2024-05-07T14:04:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.986068+0000", 2024-05-07T14:04:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.533e-06 2024-05-07T14:04:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988000+0000", 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001931861 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988017+0000", 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6960999999999999e-05 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988026+0000", 2024-05-07T14:04:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5089999999999999e-06 2024-05-07T14:04:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988103+0000", 2024-05-07T14:04:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7145999999999996e-05 2024-05-07T14:04:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988291+0000", 2024-05-07T14:04:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018802399999999999 2024-05-07T14:04:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988468+0000", 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000176436 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.994911+0000", 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064430160000000002 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.012381+0000", 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017470672 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.012434+0000", 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2667999999999998e-05 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.012489+0000", 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4832e-05 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2762 3.1b 3:d9d65702:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.610418+0000", 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.696972103999997, 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021519017000000001, 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2762 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.610418+0000", 2024-05-07T14:04:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.610418+0000", 2024-05-07T14:04:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.610420+0000", 2024-05-07T14:04:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.928e-06 2024-05-07T14:04:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.611751+0000", 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013312479999999999 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.611782+0000", 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0923000000000002e-05 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.611797+0000", 2024-05-07T14:04:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5514000000000001e-05 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.611880+0000", 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2752999999999999e-05 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.612041+0000", 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160612 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.612203+0000", 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016274400000000001 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.617942+0000", 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057384360000000004 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.631827+0000", 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013884811 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.631886+0000", 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9348000000000002e-05 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.631937+0000", 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0699999999999999e-05 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2786 3.20 e105/21 3:043afb92:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_103:head v 105'7, mlcod=85'5)", 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.877401+0000", 2024-05-07T14:04:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.429989028999998, 2024-05-07T14:04:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020697717000000001, 2024-05-07T14:04:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877401+0000", 2024-05-07T14:04:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877401+0000", 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877401+0000", 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0699999999999998e-07 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882693+0000", 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052920179999999999 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882721+0000", 2024-05-07T14:04:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7960999999999999e-05 2024-05-07T14:04:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882735+0000", 2024-05-07T14:04:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3730999999999999e-05 2024-05-07T14:04:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882809+0000", 2024-05-07T14:04:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4145000000000002e-05 2024-05-07T14:04:23.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882827+0000", 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7802999999999999e-05 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.898034+0000", 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015206871 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.898098+0000", 2024-05-07T14:04:23.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4781000000000002e-05 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2805 3.1 3:819b24c4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.073271+0000", 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.234119053999997, 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.031866104999999999, 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.349 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2805 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.073271+0000", 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.073271+0000", 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.073273+0000", 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6850000000000001e-06 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075721+0000", 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002447421 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075740+0000", 2024-05-07T14:04:23.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9576e-05 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075749+0000", 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9789999999999999e-06 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075825+0000", 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5260999999999997e-05 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075983+0000", 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015831600000000001 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.076151+0000", 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016770700000000001 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.082660+0000", 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065091610000000003 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.105024+0000", 2024-05-07T14:04:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022364063 2024-05-07T14:04:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.105085+0000", 2024-05-07T14:04:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1239000000000001e-05 2024-05-07T14:04:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.105137+0000", 2024-05-07T14:04:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1697000000000003e-05 2024-05-07T14:04:23.354 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2833 3.23 3:c4434fb0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.257751+0000", 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 38.049639247999998, 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022056151, 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.355 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2833 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.257751+0000", 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.257751+0000", 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.257753+0000", 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.835e-06 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260054+0000", 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023008759999999999 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260077+0000", 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2390000000000001e-05 2024-05-07T14:04:23.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260086+0000", 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2939999999999994e-06 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260164+0000", 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7967999999999996e-05 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260322+0000", 2024-05-07T14:04:23.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015761599999999999 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260413+0000", 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1052999999999997e-05 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277331+0000", 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016918408999999999 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:23.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.279697+0000", 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023660650000000001 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.279757+0000", 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0183000000000003e-05 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.279807+0000", 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9462000000000002e-05 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.360 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2881 3.1 3:8167d3db:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.753242+0000", 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.554147600999997, 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.024564928, 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2881 2024-05-07T14:04:23.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.753242+0000", 2024-05-07T14:04:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.753242+0000", 2024-05-07T14:04:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.753245+0000", 2024-05-07T14:04:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3369999999999998e-06 2024-05-07T14:04:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.754969+0000", 2024-05-07T14:04:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001724146 2024-05-07T14:04:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755003+0000", 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4347999999999997e-05 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755019+0000", 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5789000000000001e-05 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755107+0000", 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7861999999999993e-05 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755284+0000", 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017727300000000001 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755454+0000", 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017009800000000001 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.763510+0000", 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080555130000000003 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777718+0000", 2024-05-07T14:04:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014208461 2024-05-07T14:04:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777773+0000", 2024-05-07T14:04:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5210999999999997e-05 2024-05-07T14:04:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777807+0000", 2024-05-07T14:04:23.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3890000000000002e-05 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2896 3.3a e105/21 3:5f842f5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_203:head v 105'5, mlcod=84'3)", 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.941416+0000", 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 37.365973781999998, 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021136130999999999, 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.941416+0000", 2024-05-07T14:04:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.941416+0000", 2024-05-07T14:04:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.941420+0000", 2024-05-07T14:04:23.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8449999999999996e-06 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945321+0000", 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039015709999999999 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945345+0000", 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3169000000000001e-05 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945356+0000", 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1032e-05 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945445+0000", 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9456999999999994e-05 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945464+0000", 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8442999999999999e-05 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.962473+0000", 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017009929999999999 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.962552+0000", 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8683999999999994e-05 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3207 3.2b 3:d4330214:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:23.371 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.442936+0000", 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 15.864454043, 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027263519, 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3207 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.442936+0000", 2024-05-07T14:04:23.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.442936+0000", 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.442938+0000", 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.492e-06 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444455+0000", 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001516358 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444480+0000", 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5377000000000001e-05 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444490+0000", 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6269999999999995e-06 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444559+0000", 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9751000000000004e-05 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444564+0000", 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0119999999999996e-06 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.447717+0000", 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031529280000000002 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.447849+0000", 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013140299999999999 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.447989+0000", 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014011199999999999 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.456943+0000", 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0089544410000000005 2024-05-07T14:04:23.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.470091+0000", 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013147771000000001 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.470160+0000", 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9386000000000003e-05 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.470199+0000", 2024-05-07T14:04:23.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8860999999999999e-05 2024-05-07T14:04:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3277 3.b e114/21 3:d1f9c1c7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_169:head v 114'12, mlcod=105'10)", 2024-05-07T14:04:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.321578+0000", 2024-05-07T14:04:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.985811836, 2024-05-07T14:04:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020255588000000001, 2024-05-07T14:04:23.378 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.321578+0000", 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.321578+0000", 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.321580+0000", 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0159999999999998e-06 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323743+0000", 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021628250000000002 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323773+0000", 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0660999999999997e-05 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323788+0000", 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4674999999999999e-05 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323911+0000", 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012308299999999999 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323950+0000", 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8804000000000003e-05 2024-05-07T14:04:23.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.341689+0000", 2024-05-07T14:04:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017738812999999999 2024-05-07T14:04:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.341834+0000", 2024-05-07T14:04:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144711 2024-05-07T14:04:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3294 3.2b 3:d7c35516:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.576719+0000", 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.730670547000001, 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022223448, 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3294 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.383 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.576719+0000", 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.576719+0000", 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.576722+0000", 2024-05-07T14:04:23.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.066e-06 2024-05-07T14:04:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.579823+0000", 2024-05-07T14:04:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003100223 2024-05-07T14:04:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.579853+0000", 2024-05-07T14:04:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0243000000000002e-05 2024-05-07T14:04:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.579869+0000", 2024-05-07T14:04:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6033e-05 2024-05-07T14:04:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.580020+0000", 2024-05-07T14:04:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015147899999999999 2024-05-07T14:04:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.580300+0000", 2024-05-07T14:04:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027962499999999998 2024-05-07T14:04:23.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.580566+0000", 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000266292 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.589954+0000", 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093879900000000006 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.598626+0000", 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086722380000000005 2024-05-07T14:04:23.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.598814+0000", 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018747699999999999 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.598943+0000", 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128782 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3318 3.3e e114/99 3:7ccfcb84:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_210:head v 114'13, mlcod=114'11)", 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.035722+0000", 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.271668226999999, 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020383162999999999, 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035722+0000", 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035722+0000", 2024-05-07T14:04:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035724+0000", 2024-05-07T14:04:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7870000000000002e-06 2024-05-07T14:04:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.040965+0000", 2024-05-07T14:04:23.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052403010000000002 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.041003+0000", 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7959e-05 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.041020+0000", 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7439999999999999e-05 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.041178+0000", 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015785699999999999 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.041244+0000", 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6298999999999997e-05 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.055937+0000", 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014693289 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.056105+0000", 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167231 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3320 3.32 3:4c525d3e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.073155+0000", 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.234235028000001, 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022527378000000001, 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.393 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3320 2024-05-07T14:04:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.073155+0000", 2024-05-07T14:04:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.073155+0000", 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.073158+0000", 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7930000000000002e-06 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.077835+0000", 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046779270000000001 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.077880+0000", 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4675999999999997e-05 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.077907+0000", 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6801999999999999e-05 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.078080+0000", 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000173308 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.078360+0000", 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027958200000000001 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.078586+0000", 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000225963 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.091539+0000", 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012953411 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.095472+0000", 2024-05-07T14:04:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039331770000000004 2024-05-07T14:04:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.095593+0000", 2024-05-07T14:04:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120368 2024-05-07T14:04:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.095682+0000", 2024-05-07T14:04:23.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9370999999999995e-05 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3330 3.1b 3:d91d1d28:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.270831+0000", 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.036558601999999, 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020299610999999999, 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.399 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3330 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.270831+0000", 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.270831+0000", 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.270835+0000", 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3270000000000001e-06 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274195+0000", 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033601299999999998 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274232+0000", 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7749000000000001e-05 2024-05-07T14:04:23.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274259+0000", 2024-05-07T14:04:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.622e-05 2024-05-07T14:04:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274415+0000", 2024-05-07T14:04:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015658800000000001 2024-05-07T14:04:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274793+0000", 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037737399999999998 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.275080+0000", 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028749800000000002 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.286142+0000", 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011061932999999999 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:23.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.290773+0000", 2024-05-07T14:04:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046313350000000003 2024-05-07T14:04:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.290971+0000", 2024-05-07T14:04:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000197713 2024-05-07T14:04:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.291131+0000", 2024-05-07T14:04:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015974399999999999 2024-05-07T14:04:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.404 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3579 3.6 3:6382c9b5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_460:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:11.892750+0000", 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 11.414639748000001, 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022152108, 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:23.405 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3579 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.892750+0000", 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.892750+0000", 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.892753+0000", 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.633e-06 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.894764+0000", 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00201126 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.894789+0000", 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4969000000000001e-05 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.894803+0000", 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.399e-05 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.894896+0000", 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3478000000000002e-05 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.895074+0000", 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000177586 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.895179+0000", 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010524200000000001 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.905751+0000", 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010571525 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.914770+0000", 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0090197469999999998 2024-05-07T14:04:23.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.914847+0000", 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6413000000000002e-05 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.914902+0000", 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5265e-05 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:23.410 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:23.411 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:23.412 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:04:23.413 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:23.422+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:23.428 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:23.428 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:23.445 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:23.446 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:23.466 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:23.466 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:23.492 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:23.513 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:23.513 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:23.513 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:23.523+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:23.533 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:23.534 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:23.554 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:23.554 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:23.554 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:23.554 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:23.555 INFO:teuthology.orchestra.run.smithi106.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-05-07T14:04:23.558 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T14:04:23.558 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T14:04:23.569 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:04:23.614 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:23.623+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:23.715 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:23.726+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:23.731 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:23.731 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:23.746 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:04:23.815 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:23.823+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:23.913 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:23.914 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:23.916 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:23.927+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:23.928 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:04:24.017 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:24.030+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:24.055 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:24.055 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:24.069 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:04:24.118 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:24.131+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:24.219 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:24.227+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:24.235 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:24.235 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:24.249 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:04:24.320 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:24.331+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:24.371 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:24.371 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:24.385 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:04:24.421 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:24.435+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:24.493 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:04:24.511 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:24.511 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:24.522 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:24.531+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:24.526 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:04:24.623 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:24.631+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:24.690 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:24.691 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:24.705 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:04:24.756 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:24.770+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:24.824 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:24.824 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:24.825 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:24.838+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:24.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:04:24.926 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:24.938+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:24.971 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:24.971 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:24.987 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:04:25.027 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:25.038+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:25.108 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:25.108 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:25.122 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:04:25.168 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:25.179+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:25.229 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:25.242+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:25.239 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:25.239 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:25.254 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:04:25.330 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:25.342+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:25.421 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:25.421 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:25.432 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:25.442+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:25.435 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:04:25.497 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:04:25.556 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:25.556 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:25.559 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:04:25.570 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:04:25.576 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:25.590+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:25.633 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:25.643+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:25.691 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:25.691 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:25.705 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:04:25.723 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:25.724 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:25.734 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:25.746+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:25.740 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:25.757 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:25.757 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:25.774 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:25.775 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:25.792 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:25.792 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:25.814 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:25.833 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:25.834 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:25.835 INFO:teuthology.orchestra.run.smithi106.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-05-07T14:04:25.838 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:25.847+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:25.840 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T14:04:25.840 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T14:04:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:25.871 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:25.871 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:25.885 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:04:25.938 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:25.950+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:26.039 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:26.050+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:26.053 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:26.053 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:26.053 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:26.053 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:26.053 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:26.067 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:04:26.140 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:26.151+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:26.151 INFO:tasks.workunit.client.0.smithi106.stderr:200+0 records in 2024-05-07T14:04:26.151 INFO:tasks.workunit.client.0.smithi106.stderr:200+0 records out 2024-05-07T14:04:26.151 INFO:tasks.workunit.client.0.smithi106.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.3039 s, 158 MB/s 2024-05-07T14:04:26.193 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2207 3.26 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.864399917, 2024-05-07T14:04:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029257551999999999, 2024-05-07T14:04:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2207 2024-05-07T14:04:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338601+0000", 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0769999999999998e-06 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344166+0000", 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055649139999999998 2024-05-07T14:04:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344203+0000", 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7109e-05 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344221+0000", 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344394+0000", 2024-05-07T14:04:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000173208 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344788+0000", 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039418400000000001 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345265+0000", 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047689299999999999 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365597+0000", 2024-05-07T14:04:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020331954999999999 2024-05-07T14:04:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367512+0000", 2024-05-07T14:04:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001915237 2024-05-07T14:04:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367693+0000", 2024-05-07T14:04:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018108800000000001 2024-05-07T14:04:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367853+0000", 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016028400000000001 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2507 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [call rgw.bucket_list in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.787291378999996, 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.019773713, 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2507 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415708+0000", 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4860000000000002e-06 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415724+0000", 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.643e-05 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415759+0000", 2024-05-07T14:04:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4252999999999999e-05 2024-05-07T14:04:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415783+0000", 2024-05-07T14:04:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4315999999999999e-05 2024-05-07T14:04:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419072+0000", 2024-05-07T14:04:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032886119999999998 2024-05-07T14:04:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419099+0000", 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6956000000000001e-05 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435061+0000", 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0159622509999999 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435231+0000", 2024-05-07T14:04:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016978800000000001 2024-05-07T14:04:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435478+0000", 2024-05-07T14:04:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024762100000000001 2024-05-07T14:04:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2686 3.34 e104/21 3:2ec0e822:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_3:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.820422+0000", 2024-05-07T14:04:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.382573452000003, 2024-05-07T14:04:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022287620000000001, 2024-05-07T14:04:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820422+0000", 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820422+0000", 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820423+0000", 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.44e-07 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825658+0000", 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005235066 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825692+0000", 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4048999999999999e-05 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825717+0000", 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5216e-05 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.826297+0000", 2024-05-07T14:04:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00058014099999999995 2024-05-07T14:04:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.826353+0000", 2024-05-07T14:04:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5831999999999997e-05 2024-05-07T14:04:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.842559+0000", 2024-05-07T14:04:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016205768999999998 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.842710+0000", 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151003 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2695 3.35 3:acf2d7d8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.301558624999998, 2024-05-07T14:04:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028454303, 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2695 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901441+0000", 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9600000000000002e-06 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907573+0000", 2024-05-07T14:04:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061315939999999998 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907630+0000", 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6818999999999999e-05 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907649+0000", 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9859000000000001e-05 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907857+0000", 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000207159 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.908127+0000", 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027069099999999999 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.908468+0000", 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034104600000000001 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.918062+0000", 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095934409999999994 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929718+0000", 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011656141 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929819+0000", 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100634 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929892+0000", 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2959000000000004e-05 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2719 3.10 3:0b5df28b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.026468229000002, 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028912935000000001, 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2719 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176531+0000", 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3699999999999999e-06 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182042+0000", 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00551105 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182083+0000", 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1402000000000001e-05 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182103+0000", 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9953e-05 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182262+0000", 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015816699999999999 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182545+0000", 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028303999999999997 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182779+0000", 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023474800000000001 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.195512+0000", 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012733081 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205013+0000", 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095007670000000002 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205264+0000", 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025112099999999998 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205441+0000", 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176236 2024-05-07T14:04:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2734 3.a 3:5117726b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.874347202999999, 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026910749000000001, 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2734 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328652+0000", 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9500000000000001e-06 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333686+0000", 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050342010000000003 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333726+0000", 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9802000000000003e-05 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333753+0000", 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7702999999999999e-05 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333900+0000", 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014663999999999999 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.334151+0000", 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025143799999999999 2024-05-07T14:04:26.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.334390+0000", 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000238268 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.346870+0000", 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012480753000000001 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355331+0000", 2024-05-07T14:04:26.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084610090000000002 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355483+0000", 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015194000000000001 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355559+0000", 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6044999999999994e-05 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2786 3.20 3:043afb92:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.331123480999999, 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026616246, 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2786 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871877+0000", 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2969999999999997e-06 2024-05-07T14:04:26.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876185+0000", 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004308503 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876223+0000", 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7852000000000003e-05 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876242+0000", 2024-05-07T14:04:26.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9253999999999999e-05 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876395+0000", 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015306599999999999 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876685+0000", 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028964699999999997 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876925+0000", 2024-05-07T14:04:26.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023967500000000001 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.885744+0000", 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008819749 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898308+0000", 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012563710000000001 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898410+0000", 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101582 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898489+0000", 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8911000000000004e-05 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2807 3.3f e105/21 3:fd0db1b2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_124:head v 105'6, mlcod=85'4)", 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 41.102043682000001, 2024-05-07T14:04:26.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026784641000000001, 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100955+0000", 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8200000000000001e-06 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105915+0000", 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049600290000000003 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105956+0000", 2024-05-07T14:04:26.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1205000000000003e-05 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105973+0000", 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7087000000000001e-05 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.106125+0000", 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015208299999999999 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.106192+0000", 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6809000000000004e-05 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.127628+0000", 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02143579 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.127737+0000", 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000108818 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2828 3.2c 3:37c1d26d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.206105+0000", 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.996890874999998, 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023644783999999999, 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2828 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.238 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.206105+0000", 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.206105+0000", 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.206109+0000", 2024-05-07T14:04:26.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5939999999999998e-06 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.212890+0000", 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067816780000000002 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.212936+0000", 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5535999999999999e-05 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.212960+0000", 2024-05-07T14:04:26.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4685000000000002e-05 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.213165+0000", 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020478299999999999 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.213570+0000", 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040477800000000001 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:26.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.213999+0000", 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042946 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.227004+0000", 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013004946999999999 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.229490+0000", 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0024852120000000001 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.229634+0000", 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144074 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.229750+0000", 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116037 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2829 3.35 3:aeb9f674:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.217157+0000", 2024-05-07T14:04:26.243 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.985839319999997, 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022531881, 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2829 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.217157+0000", 2024-05-07T14:04:26.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.217157+0000", 2024-05-07T14:04:26.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.217159+0000", 2024-05-07T14:04:26.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.531e-06 2024-05-07T14:04:26.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221183+0000", 2024-05-07T14:04:26.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040234559999999999 2024-05-07T14:04:26.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221218+0000", 2024-05-07T14:04:26.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5602000000000002e-05 2024-05-07T14:04:26.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221235+0000", 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6948000000000001e-05 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221367+0000", 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013174199999999999 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221629+0000", 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026224400000000002 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.221852+0000", 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022335599999999999 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.238414+0000", 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016561306000000001 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.239379+0000", 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00096533899999999995 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.239557+0000", 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177916 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.239688+0000", 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013144099999999999 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.249 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2851 3.35 3:aedd2f32:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.437038+0000", 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.765957624999999, 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023592841, 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2851 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.437038+0000", 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.437038+0000", 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.437042+0000", 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6899999999999998e-06 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443186+0000", 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006144137 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443240+0000", 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4061000000000003e-05 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443268+0000", 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7843000000000001e-05 2024-05-07T14:04:26.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443448+0000", 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018044 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.443858+0000", 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040941399999999998 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.444268+0000", 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041045799999999999 2024-05-07T14:04:26.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453481+0000", 2024-05-07T14:04:26.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092126599999999993 2024-05-07T14:04:26.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460427+0000", 2024-05-07T14:04:26.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069463989999999998 2024-05-07T14:04:26.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460519+0000", 2024-05-07T14:04:26.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1778000000000001e-05 2024-05-07T14:04:26.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460631+0000", 2024-05-07T14:04:26.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011196099999999999 2024-05-07T14:04:26.255 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.255 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.255 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.255 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2852 3.26 3:6683f345:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:26.256 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.446514+0000", 2024-05-07T14:04:26.256 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.756481805, 2024-05-07T14:04:26.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022598677000000001, 2024-05-07T14:04:26.256 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.256 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.256 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.256 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.256 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.256 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.256 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2852 2024-05-07T14:04:26.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.256 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.446514+0000", 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.446514+0000", 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.446517+0000", 2024-05-07T14:04:26.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7199999999999998e-06 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453133+0000", 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066160769999999997 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453162+0000", 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.921e-05 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453179+0000", 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7266e-05 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453334+0000", 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000154253 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.453706+0000", 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037270400000000001 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:26.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.454035+0000", 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032850099999999998 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.462913+0000", 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088785270000000006 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.468949+0000", 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060357450000000003 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.469023+0000", 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4406000000000006e-05 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.469113+0000", 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9268e-05 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2902 3.10 3:0b53d764:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.012188+0000", 2024-05-07T14:04:26.261 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.190808144999998, 2024-05-07T14:04:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023745938000000001, 2024-05-07T14:04:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2902 2024-05-07T14:04:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.012188+0000", 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.012188+0000", 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.012190+0000", 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2680000000000001e-06 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017271+0000", 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050807179999999997 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017301+0000", 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0354000000000001e-05 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017317+0000", 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6388e-05 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017445+0000", 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012714000000000001 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.017761+0000", 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031622699999999998 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.018089+0000", 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000328093 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.030270+0000", 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012180679999999999 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.035653+0000", 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053833900000000001 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.035818+0000", 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016458600000000001 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.035934+0000", 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000116094 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2912 3.36 3:6fcd222f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.064567621000002, 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02818507, 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.267 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2912 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138433+0000", 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0069999999999997e-06 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.143973+0000", 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055392719999999996 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144024+0000", 2024-05-07T14:04:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1128999999999998e-05 2024-05-07T14:04:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144044+0000", 2024-05-07T14:04:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0526e-05 2024-05-07T14:04:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144267+0000", 2024-05-07T14:04:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022246500000000001 2024-05-07T14:04:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144532+0000", 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026575900000000001 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144805+0000", 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027290000000000002 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.162814+0000", 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018008631000000001 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166347+0000", 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035334429999999998 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166490+0000", 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014308699999999999 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166613+0000", 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012285099999999999 2024-05-07T14:04:26.272 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2918 3.10 3:0a57f05a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 39.996184032999999, 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030233789, 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.273 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2918 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206816+0000", 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6229999999999996e-06 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.210992+0000", 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041755799999999999 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211043+0000", 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0584999999999998e-05 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211070+0000", 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7716999999999999e-05 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211251+0000", 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000180683 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211678+0000", 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042701099999999998 2024-05-07T14:04:26.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.212087+0000", 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040911799999999998 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.222312+0000", 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010224551 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.236912+0000", 2024-05-07T14:04:26.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014600548 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.236982+0000", 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9476999999999999e-05 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.237046+0000", 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3895999999999999e-05 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3198 3.2c 3:34ce24fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.863081668, 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026711016000000001, 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3198 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.279 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339918+0000", 2024-05-07T14:04:26.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000001e-06 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.343982+0000", 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040642320000000001 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344027+0000", 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024999999999997e-05 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344052+0000", 2024-05-07T14:04:26.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4603000000000001e-05 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344190+0000", 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013819 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344377+0000", 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018666200000000001 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:26.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344585+0000", 2024-05-07T14:04:26.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000208452 2024-05-07T14:04:26.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.362586+0000", 2024-05-07T14:04:26.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018000754000000001 2024-05-07T14:04:26.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366457+0000", 2024-05-07T14:04:26.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003871542 2024-05-07T14:04:26.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366546+0000", 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8601000000000001e-05 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366625+0000", 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9272999999999998e-05 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.284 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3208 3.26 3:66fd0e21:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.753743323999998, 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041868750000000003, 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3208 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449257+0000", 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.07e-06 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455814+0000", 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065570660000000003 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455854+0000", 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0819999999999999e-05 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455874+0000", 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9993e-05 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.456063+0000", 2024-05-07T14:04:26.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018892400000000001 2024-05-07T14:04:26.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:26.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.456077+0000", 2024-05-07T14:04:26.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3433e-05 2024-05-07T14:04:26.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.462635+0000", 2024-05-07T14:04:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065577869999999998 2024-05-07T14:04:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.462869+0000", 2024-05-07T14:04:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023394299999999999 2024-05-07T14:04:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.463127+0000", 2024-05-07T14:04:26.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0002588 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.473024+0000", 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0098969100000000001 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.490912+0000", 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017887291 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.491010+0000", 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8041999999999994e-05 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.491121+0000", 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111671 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3230 3.35 3:af7e1017:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.683889+0000", 2024-05-07T14:04:26.291 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.519107198, 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024914794000000001, 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3230 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.683889+0000", 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.683889+0000", 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.683893+0000", 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8339999999999998e-06 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689114+0000", 2024-05-07T14:04:26.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005220616 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689172+0000", 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7479000000000003e-05 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689189+0000", 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.766e-05 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689318+0000", 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012900499999999999 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689573+0000", 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025489600000000001 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.689808+0000", 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023451 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.698461+0000", 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086537990000000002 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.708562+0000", 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010100052 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.708728+0000", 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000166214 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.708803+0000", 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5729000000000006e-05 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3598 3.36 3:6ff6851c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_479:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.088618+0000", 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 14.114378181999999, 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026105204999999999, 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.297 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.298 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.298 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.298 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.298 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3598 2024-05-07T14:04:26.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.298 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.088618+0000", 2024-05-07T14:04:26.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.088618+0000", 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.088622+0000", 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5029999999999999e-06 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095119+0000", 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006496501 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095156+0000", 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7552999999999998e-05 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095175+0000", 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8349999999999999e-05 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095315+0000", 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014044900000000001 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095538+0000", 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022285999999999999 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.095747+0000", 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020863199999999999 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.112469+0000", 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016722012000000001 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.114371+0000", 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019026500000000001 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.114592+0000", 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022095400000000001 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.114723+0000", 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000130741 2024-05-07T14:04:26.302 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3738 6.5 6:a60f9269:lc::lua_package_allowlist:head [watch reconnect cookie 94397699570432 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:22.471993+0000", 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.731002481, 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0312905320000001, 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:26.303 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3738 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.471993+0000", 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.471993+0000", 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.471995+0000", 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.559e-06 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.472002+0000", 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5310000000000004e-06 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.472024+0000", 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1056e-05 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.472037+0000", 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3115000000000001e-05 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.472129+0000", 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2788000000000007e-05 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.472139+0000", 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8460000000000003e-06 2024-05-07T14:04:26.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.475635+0000", 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003496178 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.475648+0000", 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2499e-05 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:23.498819+0000", 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023170562 2024-05-07T14:04:26.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:23.499276+0000", 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00045746799999999999 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:23.503284+0000", 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040079299999999998 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:26.308 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:26.309 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:26.310 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:04:26.311 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:26.322+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:26.337 INFO:tasks.workunit.client.0.smithi106.stdout:Bucket Created: buck_2024_04_7_14_04_26 2024-05-07T14:04:26.411 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:26.419+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:26.439 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:26.440 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:04:26.440 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:26.457 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:04:26.547 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:26.558+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:26.613 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:26.623+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:26.636 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:26.636 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:26.636 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:26.637 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:26.637 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:26.638 INFO:tasks.workunit.client.0.smithi106.stdout:bucket quota max size set for the given user: buck_2024_04_7_14_04_26 2024-05-07T14:04:26.651 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:04:26.744 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:26.758+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:26.811 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:26.811 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:26.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:26.811 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:26.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.811 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2225 3.1f 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:26.812 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:04:26.812 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.225618957999998, 2024-05-07T14:04:26.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020378113, 2024-05-07T14:04:26.812 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.812 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.812 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.812 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.812 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.812 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.812 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2225 2024-05-07T14:04:26.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.812 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598750+0000", 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8859999999999997e-06 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602351+0000", 2024-05-07T14:04:26.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600195 2024-05-07T14:04:26.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602470+0000", 2024-05-07T14:04:26.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119608 2024-05-07T14:04:26.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602494+0000", 2024-05-07T14:04:26.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.376e-05 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602590+0000", 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6399999999999999e-05 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602740+0000", 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014951 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602884+0000", 2024-05-07T14:04:26.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000143616 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618629+0000", 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015745420999999999 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619008+0000", 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037870699999999999 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619069+0000", 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1617000000000003e-05 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619125+0000", 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5393000000000003e-05 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2229 3.3 e84/21 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head v 84'2, mlcod=0'0)", 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:04:26.817 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.159407916000006, 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022534413, 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:04:26.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664960+0000", 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0109999999999999e-06 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670334+0000", 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005374635 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3374999999999998e-05 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670385+0000", 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7512000000000001e-05 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670515+0000", 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012940900000000001 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670543+0000", 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8157000000000002e-05 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687374+0000", 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016831793000000001 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687492+0000", 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117521 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.821 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2497 7.9 7:93e5b521:::notify.7:head [watch reconnect cookie 94397682177536 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 80.429424495000006, 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0512951690000001, 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.822 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2497 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394942+0000", 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9100000000000002e-07 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394946+0000", 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2239999999999997e-06 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394960+0000", 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3419e-05 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394966+0000", 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3620000000000002e-06 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395019+0000", 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3099000000000001e-05 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395023+0000", 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0879999999999997e-06 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400981+0000", 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059580520000000001 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400990+0000", 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0880000000000001e-06 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438550+0000", 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.037559288 2024-05-07T14:04:26.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.439512+0000", 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000962154 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442920+0000", 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034085109999999999 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442966+0000", 2024-05-07T14:04:26.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5509000000000001e-05 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.446236+0000", 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032704840000000002 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2665 7.9 7:93e5b521:::notify.7:head [watch reconnect cookie 94397682177536 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.650634+0000", 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.173731220999997, 2024-05-07T14:04:26.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1256737430000001, 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2665 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650634+0000", 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650634+0000", 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650636+0000", 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0549999999999998e-06 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650644+0000", 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1849999999999998e-06 2024-05-07T14:04:26.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650657+0000", 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3839000000000001e-05 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650669+0000", 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1483e-05 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650731+0000", 2024-05-07T14:04:26.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2327000000000001e-05 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650742+0000", 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1216999999999999e-05 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774923+0000", 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.124180213 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775019+0000", 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5995000000000005e-05 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.776308+0000", 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012894289999999999 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2669 7.9 7:93e5b521:::notify.7:head [watch ping cookie 94397682177536 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195592+0000", 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.628773727000002, 2024-05-07T14:04:26.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.58012271999999998, 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2669 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195592+0000", 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195592+0000", 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195594+0000", 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4899999999999999e-06 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195605+0000", 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.08e-05 2024-05-07T14:04:26.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195627+0000", 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1577999999999999e-05 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195637+0000", 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0258000000000001e-05 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195966+0000", 2024-05-07T14:04:26.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032875299999999999 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.196005+0000", 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9662000000000001e-05 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775356+0000", 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57935019200000004 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775484+0000", 2024-05-07T14:04:26.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012866399999999999 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775715+0000", 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000230323 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2702 3.1b 3:d8b8357f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.975062+0000", 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.849303978000002, 2024-05-07T14:04:26.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021948369999999998, 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2702 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.975062+0000", 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.975062+0000", 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.975064+0000", 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.973e-06 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977232+0000", 2024-05-07T14:04:26.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002168728 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977260+0000", 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7475e-05 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977275+0000", 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5183e-05 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977377+0000", 2024-05-07T14:04:26.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010254100000000001 2024-05-07T14:04:26.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977581+0000", 2024-05-07T14:04:26.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020312499999999999 2024-05-07T14:04:26.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:26.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977709+0000", 2024-05-07T14:04:26.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012883799999999999 2024-05-07T14:04:26.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.985043+0000", 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007334007 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.996896+0000", 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01185277 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.996962+0000", 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6267999999999996e-05 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.997010+0000", 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7462000000000001e-05 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2703 3.2b 3:d6a94723:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.986066+0000", 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.838299309999996, 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026422658000000002, 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.844 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2703 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.986066+0000", 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.986066+0000", 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.986068+0000", 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.533e-06 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988000+0000", 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001931861 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988017+0000", 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6960999999999999e-05 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988026+0000", 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5089999999999999e-06 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988103+0000", 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7145999999999996e-05 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988291+0000", 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018802399999999999 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988468+0000", 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000176436 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.994911+0000", 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064430160000000002 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.012381+0000", 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017470672 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.012434+0000", 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2667999999999998e-05 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.012489+0000", 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4832e-05 2024-05-07T14:04:26.849 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2762 3.1b 3:d9d65702:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.610418+0000", 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.213947838999999, 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021519017000000001, 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.850 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.851 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2762 2024-05-07T14:04:26.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.851 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.610418+0000", 2024-05-07T14:04:26.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.610418+0000", 2024-05-07T14:04:26.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.610420+0000", 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.928e-06 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.611751+0000", 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013312479999999999 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.611782+0000", 2024-05-07T14:04:26.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0923000000000002e-05 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.611797+0000", 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5514000000000001e-05 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.611880+0000", 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2752999999999999e-05 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.612041+0000", 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160612 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.612203+0000", 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016274400000000001 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.617942+0000", 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057384360000000004 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.631827+0000", 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013884811 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.631886+0000", 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9348000000000002e-05 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.631937+0000", 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0699999999999999e-05 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.855 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2786 3.20 e105/21 3:043afb92:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_103:head v 105'7, mlcod=85'5)", 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.877401+0000", 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.946964764000001, 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020697717000000001, 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877401+0000", 2024-05-07T14:04:26.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877401+0000", 2024-05-07T14:04:26.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877401+0000", 2024-05-07T14:04:26.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0699999999999998e-07 2024-05-07T14:04:26.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882693+0000", 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052920179999999999 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882721+0000", 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7960999999999999e-05 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882735+0000", 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3730999999999999e-05 2024-05-07T14:04:26.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882809+0000", 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4145000000000002e-05 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882827+0000", 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7802999999999999e-05 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.898034+0000", 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015206871 2024-05-07T14:04:26.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.898098+0000", 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4781000000000002e-05 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2805 3.1 3:819b24c4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.073271+0000", 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.751094789, 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.031866104999999999, 2024-05-07T14:04:26.860 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2805 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.073271+0000", 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.073271+0000", 2024-05-07T14:04:26.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.073273+0000", 2024-05-07T14:04:26.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6850000000000001e-06 2024-05-07T14:04:26.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075721+0000", 2024-05-07T14:04:26.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002447421 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075740+0000", 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9576e-05 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075749+0000", 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9789999999999999e-06 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075825+0000", 2024-05-07T14:04:26.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5260999999999997e-05 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075983+0000", 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015831600000000001 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.076151+0000", 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016770700000000001 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:26.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.082660+0000", 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065091610000000003 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.105024+0000", 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022364063 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.105085+0000", 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1239000000000001e-05 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.105137+0000", 2024-05-07T14:04:26.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1697000000000003e-05 2024-05-07T14:04:26.866 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.866 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.866 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.866 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2833 3.23 3:c4434fb0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:26.866 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.257751+0000", 2024-05-07T14:04:26.866 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.566614983000001, 2024-05-07T14:04:26.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022056151, 2024-05-07T14:04:26.866 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.866 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2833 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.257751+0000", 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.257751+0000", 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.257753+0000", 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.835e-06 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260054+0000", 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023008759999999999 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260077+0000", 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2390000000000001e-05 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260086+0000", 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2939999999999994e-06 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260164+0000", 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7967999999999996e-05 2024-05-07T14:04:26.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260322+0000", 2024-05-07T14:04:26.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015761599999999999 2024-05-07T14:04:26.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:26.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260413+0000", 2024-05-07T14:04:26.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1052999999999997e-05 2024-05-07T14:04:26.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.870 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:26.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277331+0000", 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016918408999999999 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.279697+0000", 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023660650000000001 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.279757+0000", 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0183000000000003e-05 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.871 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.279807+0000", 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9462000000000002e-05 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2881 3.1 3:8167d3db:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.753242+0000", 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.071123335999999, 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.024564928, 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.872 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2881 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.753242+0000", 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.753242+0000", 2024-05-07T14:04:26.873 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.753245+0000", 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3369999999999998e-06 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.754969+0000", 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001724146 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.874 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755003+0000", 2024-05-07T14:04:26.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4347999999999997e-05 2024-05-07T14:04:26.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755019+0000", 2024-05-07T14:04:26.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5789000000000001e-05 2024-05-07T14:04:26.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.875 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.875 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755107+0000", 2024-05-07T14:04:26.875 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7861999999999993e-05 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755284+0000", 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017727300000000001 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755454+0000", 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017009800000000001 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.763510+0000", 2024-05-07T14:04:26.876 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080555130000000003 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777718+0000", 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014208461 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777773+0000", 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5210999999999997e-05 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.877 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777807+0000", 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3890000000000002e-05 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2896 3.3a e105/21 3:5f842f5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_203:head v 105'5, mlcod=84'3)", 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.941416+0000", 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 40.882949517, 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021136130999999999, 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.878 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.941416+0000", 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.941416+0000", 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.941420+0000", 2024-05-07T14:04:26.879 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8449999999999996e-06 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945321+0000", 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039015709999999999 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945345+0000", 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3169000000000001e-05 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.880 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945356+0000", 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1032e-05 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945445+0000", 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9456999999999994e-05 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945464+0000", 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8442999999999999e-05 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.881 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.962473+0000", 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017009929999999999 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.962552+0000", 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8683999999999994e-05 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3207 3.2b 3:d4330214:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.442936+0000", 2024-05-07T14:04:26.882 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 19.381429778000001, 2024-05-07T14:04:26.883 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027263519, 2024-05-07T14:04:26.883 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.883 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.883 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.883 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.883 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.883 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.883 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3207 2024-05-07T14:04:26.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.883 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.442936+0000", 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.442936+0000", 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.442938+0000", 2024-05-07T14:04:26.884 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.492e-06 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444455+0000", 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001516358 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444480+0000", 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5377000000000001e-05 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.885 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444490+0000", 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6269999999999995e-06 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444559+0000", 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9751000000000004e-05 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444564+0000", 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0119999999999996e-06 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.886 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.447717+0000", 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031529280000000002 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.447849+0000", 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013140299999999999 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.447989+0000", 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014011199999999999 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.456943+0000", 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0089544410000000005 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.470091+0000", 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013147771000000001 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.470160+0000", 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9386000000000003e-05 2024-05-07T14:04:26.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.470199+0000", 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8860999999999999e-05 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3277 3.b e114/21 3:d1f9c1c7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_169:head v 114'12, mlcod=105'10)", 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.321578+0000", 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.502787570999999, 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020255588000000001, 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.889 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.321578+0000", 2024-05-07T14:04:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.321578+0000", 2024-05-07T14:04:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.321580+0000", 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0159999999999998e-06 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323743+0000", 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021628250000000002 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323773+0000", 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0660999999999997e-05 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323788+0000", 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4674999999999999e-05 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323911+0000", 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012308299999999999 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323950+0000", 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8804000000000003e-05 2024-05-07T14:04:26.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.341689+0000", 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017738812999999999 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.341834+0000", 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144711 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3294 3.2b 3:d7c35516:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.576719+0000", 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.247646282000002, 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022223448, 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3294 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.576719+0000", 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.576719+0000", 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.576722+0000", 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.066e-06 2024-05-07T14:04:26.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.579823+0000", 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003100223 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.579853+0000", 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0243000000000002e-05 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.579869+0000", 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6033e-05 2024-05-07T14:04:26.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.580020+0000", 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015147899999999999 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.580300+0000", 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027962499999999998 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.580566+0000", 2024-05-07T14:04:26.897 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000266292 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.589954+0000", 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093879900000000006 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.598626+0000", 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086722380000000005 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.898 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.598814+0000", 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018747699999999999 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.598943+0000", 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128782 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3318 3.3e e114/99 3:7ccfcb84:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_210:head v 114'13, mlcod=114'11)", 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.035722+0000", 2024-05-07T14:04:26.899 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.788643961999998, 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020383162999999999, 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035722+0000", 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035722+0000", 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035724+0000", 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7870000000000002e-06 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.040965+0000", 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052403010000000002 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.041003+0000", 2024-05-07T14:04:26.901 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7959e-05 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.041020+0000", 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7439999999999999e-05 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.041178+0000", 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015785699999999999 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.902 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.041244+0000", 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6298999999999997e-05 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.055937+0000", 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014693289 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.056105+0000", 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167231 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3320 3.32 3:4c525d3e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.073155+0000", 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.751210763, 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022527378000000001, 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3320 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.073155+0000", 2024-05-07T14:04:26.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.073155+0000", 2024-05-07T14:04:26.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.905 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.905 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.073158+0000", 2024-05-07T14:04:26.905 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7930000000000002e-06 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.077835+0000", 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046779270000000001 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.077880+0000", 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4675999999999997e-05 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.906 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.077907+0000", 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6801999999999999e-05 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.078080+0000", 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000173308 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.078360+0000", 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027958200000000001 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:26.907 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.078586+0000", 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000225963 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.091539+0000", 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012953411 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.095472+0000", 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039331770000000004 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.908 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.095593+0000", 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120368 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.095682+0000", 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9370999999999995e-05 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3330 3.1b 3:d91d1d28:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:26.909 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.270831+0000", 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 17.553534336999999, 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020299610999999999, 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3330 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.910 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.270831+0000", 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.270831+0000", 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.270835+0000", 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3270000000000001e-06 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.911 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274195+0000", 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033601299999999998 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274232+0000", 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7749000000000001e-05 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274259+0000", 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.622e-05 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274415+0000", 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015658800000000001 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274793+0000", 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037737399999999998 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.275080+0000", 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028749800000000002 2024-05-07T14:04:26.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.286142+0000", 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011061932999999999 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.290773+0000", 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046313350000000003 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.290971+0000", 2024-05-07T14:04:26.914 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000197713 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.291131+0000", 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015974399999999999 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3579 3.6 3:6382c9b5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_460:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:11.892750+0000", 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 14.931615483, 2024-05-07T14:04:26.915 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022152108, 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3579 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.892750+0000", 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.892750+0000", 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.892753+0000", 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.633e-06 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.894764+0000", 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00201126 2024-05-07T14:04:26.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.894789+0000", 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4969000000000001e-05 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.894803+0000", 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.399e-05 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.894896+0000", 2024-05-07T14:04:26.918 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3478000000000002e-05 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.895074+0000", 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000177586 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.895179+0000", 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010524200000000001 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.905751+0000", 2024-05-07T14:04:26.919 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010571525 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.914770+0000", 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0090197469999999998 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.914847+0000", 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6413000000000002e-05 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.914902+0000", 2024-05-07T14:04:26.920 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5265e-05 2024-05-07T14:04:26.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.921 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:26.921 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:26.921 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:26.922 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:04:26.923 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:26.934+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:27.023 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:27.034+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:27.075 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:27.075 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:27.075 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:04:27.076 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:27.088 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:04:27.132 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:27.146+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:27.225 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:27.238+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:27.247 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:27.247 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:27.247 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:27.247 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:27.247 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:27.260 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:04:27.348 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:27.362+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:27.416 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:27.417 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:27.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:27.417 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:27.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.417 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-05-07T14:04:27.417 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:04:27.417 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 207.44306098499999, 2024-05-07T14:04:27.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017349720999999999, 2024-05-07T14:04:27.417 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.417 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.417 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:04:27.417 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.417 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4455", 2024-05-07T14:04:27.418 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/2047456512", 2024-05-07T14:04:27.418 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2 2024-05-07T14:04:27.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.418 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:04:27.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.418 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.418 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984953+0000", 2024-05-07T14:04:27.418 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984955+0000", 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.03e-06 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984966+0000", 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1126e-05 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.984989+0000", 2024-05-07T14:04:27.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3241e-05 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.985026+0000", 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6915000000000001e-05 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986480+0000", 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001454489 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:27.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:00:59.986501+0000", 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0927000000000001e-05 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.001934+0000", 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015432477999999999 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:01:00.002302+0000", 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036851499999999998 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2202 3.0 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:04:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 84.148043606000002, 2024-05-07T14:04:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027191908000000001, 2024-05-07T14:04:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2202 2024-05-07T14:04:27.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279975+0000", 2024-05-07T14:04:27.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0130000000000001e-06 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285489+0000", 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055143570000000001 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285531+0000", 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1504000000000001e-05 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285550+0000", 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9256e-05 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285747+0000", 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196777 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286120+0000", 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037285900000000002 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:27.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286489+0000", 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036951099999999999 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301589+0000", 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015099728999999999 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307085+0000", 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054963340000000003 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307127+0000", 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1977999999999997e-05 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307162+0000", 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4589999999999999e-05 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2217 3.0 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:27.427 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.937717038000002, 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019983529, 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2217 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490299+0000", 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492337+0000", 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020384489999999999 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492391+0000", 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3702000000000002e-05 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492415+0000", 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3373000000000001e-05 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492567+0000", 2024-05-07T14:04:27.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152788 2024-05-07T14:04:27.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492843+0000", 2024-05-07T14:04:27.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027568999999999998 2024-05-07T14:04:27.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:27.431 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493123+0000", 2024-05-07T14:04:27.431 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028014899999999999 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509840+0000", 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016716871000000001 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510203+0000", 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036252499999999999 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510250+0000", 2024-05-07T14:04:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7231000000000002e-05 2024-05-07T14:04:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510280+0000", 2024-05-07T14:04:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0270999999999999e-05 2024-05-07T14:04:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2224 3.1a e84/21 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head v 84'2, mlcod=0'0)", 2024-05-07T14:04:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:04:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.832773371000002, 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020623257999999998, 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:04:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595243+0000", 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6800000000000002e-06 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.601988+0000", 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0067452479999999997 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602044+0000", 2024-05-07T14:04:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5884999999999998e-05 2024-05-07T14:04:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602070+0000", 2024-05-07T14:04:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6359999999999998e-05 2024-05-07T14:04:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602183+0000", 2024-05-07T14:04:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112761 2024-05-07T14:04:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602210+0000", 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6882000000000001e-05 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615811+0000", 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01360132 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615863+0000", 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2122e-05 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2701 3.19 3:9ba4c095:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:04:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.465206350999999, 2024-05-07T14:04:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017365756999999999, 2024-05-07T14:04:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2701 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962807+0000", 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.962810+0000", 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.43e-06 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964338+0000", 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015288190000000001 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964372+0000", 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3104e-05 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964387+0000", 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5226e-05 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964473+0000", 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6289e-05 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964636+0000", 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016293899999999999 2024-05-07T14:04:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.964792+0000", 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000155513 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.979623+0000", 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014831657 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980052+0000", 2024-05-07T14:04:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00042865699999999999 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980116+0000", 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4592999999999996e-05 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.980173+0000", 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6530000000000003e-05 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2704 3.31 3:8c38a608:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:04:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 43.429051002000001, 2024-05-07T14:04:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.024434902000000001, 2024-05-07T14:04:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2704 2024-05-07T14:04:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998965+0000", 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6809999999999998e-06 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000686+0000", 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00172109 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000705+0000", 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8879999999999999e-05 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000718+0000", 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2846e-05 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000794+0000", 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5613999999999998e-05 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000919+0000", 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000124924 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.001034+0000", 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115158 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.007009+0000", 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059753009999999997 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023250+0000", 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016240477 2024-05-07T14:04:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023343+0000", 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3362000000000005e-05 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023397+0000", 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4568999999999999e-05 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2803 3.4 3:2246d6f5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:04:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.374259662999997, 2024-05-07T14:04:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021000333999999999, 2024-05-07T14:04:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2803 2024-05-07T14:04:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053757+0000", 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1049999999999999e-06 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056166+0000", 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002409039 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056189+0000", 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2595e-05 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056200+0000", 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1212999999999999e-05 2024-05-07T14:04:27.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056274+0000", 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4086999999999997e-05 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056414+0000", 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000139763 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056555+0000", 2024-05-07T14:04:27.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014123900000000001 2024-05-07T14:04:27.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.071326+0000", 2024-05-07T14:04:27.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014771151999999999 2024-05-07T14:04:27.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074566+0000", 2024-05-07T14:04:27.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032398570000000001 2024-05-07T14:04:27.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074699+0000", 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013297800000000001 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074754+0000", 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5306000000000002e-05 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2832 3.1a e105/21 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head v 105'9, mlcod=85'7)", 2024-05-07T14:04:27.455 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 42.173796162999999, 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023326739999999999, 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:04:27.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254219+0000", 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0059999999999999e-06 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260033+0000", 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058134010000000002 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260063+0000", 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9762000000000001e-05 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260085+0000", 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2157000000000001e-05 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260165+0000", 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9909999999999999e-05 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260195+0000", 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9935000000000001e-05 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277464+0000", 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017269805999999999 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277544+0000", 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9763000000000002e-05 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.459 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2860 3.3e 3:7cdd96b9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.899589441000003, 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019237982000000001, 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.460 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2860 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528427+0000", 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5739999999999998e-06 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530685+0000", 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022580009999999999 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530713+0000", 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8552e-05 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530727+0000", 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4054e-05 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530808+0000", 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0741999999999994e-05 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530954+0000", 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145494 2024-05-07T14:04:27.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.531051+0000", 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7349999999999995e-05 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.543007+0000", 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011955873000000001 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547544+0000", 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004537091 2024-05-07T14:04:27.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547610+0000", 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5722000000000005e-05 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547662+0000", 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2528999999999998e-05 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2880 3.19 3:989dc271:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 41.686877629000001, 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018463578000000001, 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2880 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741138+0000", 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2510000000000001e-06 2024-05-07T14:04:27.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742746+0000", 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001608195 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742776+0000", 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9335999999999998e-05 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742789+0000", 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3059e-05 2024-05-07T14:04:27.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742879+0000", 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0073000000000003e-05 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.743010+0000", 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013067999999999999 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.743127+0000", 2024-05-07T14:04:27.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117606 2024-05-07T14:04:27.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.752872+0000", 2024-05-07T14:04:27.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0097450880000000007 2024-05-07T14:04:27.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.470 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759514+0000", 2024-05-07T14:04:27.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0066419900000000004 2024-05-07T14:04:27.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.470 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759554+0000", 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0070000000000001e-05 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759600+0000", 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5229999999999999e-05 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3190 3.1a e113/21 3:59666d5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_82:head v 113'16, mlcod=113'14)", 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.268091+0000", 2024-05-07T14:04:27.471 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.159922154, 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018489769, 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.268091+0000", 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.268091+0000", 2024-05-07T14:04:27.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.268094+0000", 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1110000000000002e-06 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272518+0000", 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044240620000000003 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272549+0000", 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1881999999999997e-05 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272563+0000", 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3943e-05 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272640+0000", 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6468e-05 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272660+0000", 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9945999999999998e-05 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.286524+0000", 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013864227999999999 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.286581+0000", 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7129000000000001e-05 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.475 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.476 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3191 3.0 3:02119845:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:27.476 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.271155+0000", 2024-05-07T14:04:27.476 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.156858355000001, 2024-05-07T14:04:27.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017478067, 2024-05-07T14:04:27.476 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.476 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.476 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3191 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.271155+0000", 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.271155+0000", 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.271157+0000", 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.734e-06 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.273451+0000", 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022944039999999999 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.273463+0000", 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1623999999999999e-05 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.273470+0000", 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.7159999999999997e-06 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.273526+0000", 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6499999999999998e-05 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.273673+0000", 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014678299999999999 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.273766+0000", 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2874000000000006e-05 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.286945+0000", 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013179051000000001 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.288508+0000", 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015628370000000001 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.288584+0000", 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5854999999999998e-05 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.288633+0000", 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9688999999999998e-05 2024-05-07T14:04:27.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3202 3.19 3:9b833f57:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.381014+0000", 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.046999977999999, 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018118082000000001, 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.482 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3202 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.381014+0000", 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.381014+0000", 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.483 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.381016+0000", 2024-05-07T14:04:27.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3879999999999998e-06 2024-05-07T14:04:27.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.382901+0000", 2024-05-07T14:04:27.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001884868 2024-05-07T14:04:27.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.484 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.484 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.382923+0000", 2024-05-07T14:04:27.484 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2209e-05 2024-05-07T14:04:27.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.382936+0000", 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3036e-05 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.383023+0000", 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6841000000000004e-05 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.383199+0000", 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017636099999999999 2024-05-07T14:04:27.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:27.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.383367+0000", 2024-05-07T14:04:27.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016805300000000001 2024-05-07T14:04:27.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.395462+0000", 2024-05-07T14:04:27.486 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012094183 2024-05-07T14:04:27.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.486 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.486 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.399010+0000", 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035486559999999999 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.399077+0000", 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6457000000000004e-05 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.399132+0000", 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.503e-05 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.487 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3205 3.31 3:8edf8d67:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.413707+0000", 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 20.014306557000001, 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020052646, 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3205 2024-05-07T14:04:27.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.413707+0000", 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.413707+0000", 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.489 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.413709+0000", 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.458e-06 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415525+0000", 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001815421 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415551+0000", 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.618e-05 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.490 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415566+0000", 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5356e-05 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415658+0000", 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1460999999999997e-05 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415844+0000", 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000186329 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.416021+0000", 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017681700000000001 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.426085+0000", 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010063880000000001 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.433647+0000", 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0075620460000000002 2024-05-07T14:04:27.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.433715+0000", 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8239999999999997e-05 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.433760+0000", 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4458e-05 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.493 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3272 3.0 3:00176f47:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.212328+0000", 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 19.215685949000001, 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020854049, 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3272 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.494 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.212328+0000", 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.212328+0000", 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.212332+0000", 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0999999999999997e-06 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214290+0000", 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001958647 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214325+0000", 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4993999999999997e-05 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214348+0000", 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2402999999999999e-05 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214476+0000", 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012784600000000001 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214718+0000", 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024232499999999999 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214960+0000", 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000241933 2024-05-07T14:04:27.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.232983+0000", 2024-05-07T14:04:27.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018023127 2024-05-07T14:04:27.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.233043+0000", 2024-05-07T14:04:27.498 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0226000000000002e-05 2024-05-07T14:04:27.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.498 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.498 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.233121+0000", 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7751999999999997e-05 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.233182+0000", 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0696000000000003e-05 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3278 3.3e 3:7f660573:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_170:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.342288+0000", 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 19.085725845999999, 2024-05-07T14:04:27.499 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017241407, 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3278 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342288+0000", 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342288+0000", 2024-05-07T14:04:27.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342290+0000", 2024-05-07T14:04:27.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5500000000000001e-06 2024-05-07T14:04:27.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.501 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.501 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.345246+0000", 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029561650000000002 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.345294+0000", 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7513999999999999e-05 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.345319+0000", 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4964999999999999e-05 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.345433+0000", 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000114471 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.345593+0000", 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015943700000000001 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.345710+0000", 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116663 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.353488+0000", 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077782859999999997 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.359394+0000", 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059060290000000001 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.359469+0000", 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5638999999999999e-05 2024-05-07T14:04:27.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.359529+0000", 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9688000000000002e-05 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3303 3.0 3:02427a19:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.742146+0000", 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.685867533, 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017583926999999999, 2024-05-07T14:04:27.505 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3303 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.742146+0000", 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.742146+0000", 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.742150+0000", 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2529999999999998e-06 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.745252+0000", 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031012639999999998 2024-05-07T14:04:27.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.745283+0000", 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1588999999999999e-05 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.745298+0000", 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5336e-05 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.745513+0000", 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021474499999999999 2024-05-07T14:04:27.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.745865+0000", 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035175400000000002 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.746122+0000", 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025658899999999999 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.759115+0000", 2024-05-07T14:04:27.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012993648999999999 2024-05-07T14:04:27.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.759653+0000", 2024-05-07T14:04:27.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053803100000000001 2024-05-07T14:04:27.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.759694+0000", 2024-05-07T14:04:27.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0309999999999999e-05 2024-05-07T14:04:27.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.759730+0000", 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6406999999999999e-05 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3318 3.3e 3:7ccfcb84:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.031876+0000", 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.396137156000002, 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.02503468, 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.511 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3318 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.031876+0000", 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.031876+0000", 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.031879+0000", 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4600000000000002e-06 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.034903+0000", 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030236730000000002 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.513 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.034950+0000", 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7922e-05 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.034975+0000", 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-05 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035105+0000", 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129901 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035338+0000", 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023303000000000001 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035526+0000", 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018805100000000001 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.047239+0000", 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011713072 2024-05-07T14:04:27.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.056528+0000", 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092883140000000006 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.056759+0000", 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023124300000000001 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.056911+0000", 2024-05-07T14:04:27.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015221399999999999 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3325 3.19 3:9a914b7d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.188566+0000", 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.239447919, 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023664281999999998, 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.517 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3325 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.188566+0000", 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.188566+0000", 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.188569+0000", 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4680000000000001e-06 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.192695+0000", 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004125933 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.192736+0000", 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1196000000000003e-05 2024-05-07T14:04:27.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.192755+0000", 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8257000000000002e-05 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.192921+0000", 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016651400000000001 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.193267+0000", 2024-05-07T14:04:27.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000346289 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.193536+0000", 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026907899999999998 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.203492+0000", 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099560800000000008 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.521 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.211923+0000", 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0084306810000000006 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.212134+0000", 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021085 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.212230+0000", 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5934999999999995e-05 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.522 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3338 3.3e 3:7de3d26b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.419519+0000", 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.008494146, 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018001646, 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3338 2024-05-07T14:04:27.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.419519+0000", 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.419519+0000", 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:27.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.419523+0000", 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4029999999999999e-06 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.422528+0000", 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030051489999999999 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.422567+0000", 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8974000000000003e-05 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:27.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.422585+0000", 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7816999999999999e-05 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.422689+0000", 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000104689 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.422868+0000", 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017882900000000001 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.526 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.423035+0000", 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016687700000000001 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.430611+0000", 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0075756529999999999 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.437397+0000", 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0067862540000000002 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:27.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.437466+0000", 2024-05-07T14:04:27.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9408999999999999e-05 2024-05-07T14:04:27.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:27.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:27.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:27.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.437521+0000", 2024-05-07T14:04:27.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4592000000000002e-05 2024-05-07T14:04:27.528 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.528 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.528 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.528 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:27.528 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:27.528 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:27.530 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:04:27.530 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-05-07T14:04:27.531 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:27.543+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:27.631 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:27.642+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:27.686 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:27.686 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:27.687 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:04:27.687 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:27.702 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:04:27.744 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:27.758+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:27.833 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:27.846+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:27.841 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:04:27.854 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:27.854 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:27.854 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:27.854 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:27.855 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:27.868 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:04:27.934 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:27.943+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:27.969 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:27.970 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:27.986 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:27.986 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:28.003 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:28.003 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:28.019 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:28.019 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:28.027 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:28.027 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:28.035 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:28.046+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:28.040 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:04:28.040 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:28.040 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:28.059 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:28.060 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:28.079 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-05-07T14:04:28.084 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T14:04:28.084 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T14:04:28.136 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:28.147+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:28.171 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:28.172 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:28.184 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:04:28.237 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:28.250+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:28.300 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:28.300 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:28.313 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:04:28.356 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:28.370+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:28.439 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:28.447+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:28.473 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:28.473 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:28.485 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:04:28.494 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is set 2024-05-07T14:04:28.540 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:28.551+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:28.615 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:28.616 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:28.630 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:04:28.641 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:28.654+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:28.742 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:28.754+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:28.797 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:28.797 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:28.811 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:04:28.842 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:28.854+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:28.930 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:28.930 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:28.943 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:28.954+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:28.944 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:04:29.045 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:29.055+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:29.068 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:29.068 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:29.082 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:04:29.168 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:29.179+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:29.246 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:29.258+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:29.246 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:29.246 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:29.260 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:04:29.348 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:29.359+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:29.423 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:29.424 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:29.439 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:04:29.448 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:29.458+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:29.549 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:29.562+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:29.605 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:29.605 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:29.619 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:04:29.668 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:29.679+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:29.738 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:29.738 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:29.751 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:29.759+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:29.752 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:04:29.852 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:29.866+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:29.921 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:29.921 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:29.936 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:04:29.954 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:29.963+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:30.052 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:30.053 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:30.054 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:30.066+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:30.066 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:04:30.085 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:04:30.155 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:30.163+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:30.222 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:30.222 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:30.241 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:04:30.249 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:30.249 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:30.255 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:30.266+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:30.265 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:30.265 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:30.281 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:30.281 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:30.297 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:30.298 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:30.318 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:30.318 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:30.338 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:30.338 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:30.351 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:30.351 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:30.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:30.351 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:30.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.351 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2225 3.1f 3:fbace07c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:30.351 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.765420371999994, 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020378113, 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2225 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:04:30.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598747+0000", 2024-05-07T14:04:30.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.598750+0000", 2024-05-07T14:04:30.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8859999999999997e-06 2024-05-07T14:04:30.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602351+0000", 2024-05-07T14:04:30.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003600195 2024-05-07T14:04:30.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602470+0000", 2024-05-07T14:04:30.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000119608 2024-05-07T14:04:30.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602494+0000", 2024-05-07T14:04:30.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.376e-05 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602590+0000", 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6399999999999999e-05 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602740+0000", 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014951 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602884+0000", 2024-05-07T14:04:30.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000143616 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.618629+0000", 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015745420999999999 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619008+0000", 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037870699999999999 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619069+0000", 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1617000000000003e-05 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.619125+0000", 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5393000000000003e-05 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2229 3.3 e84/21 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head v 84'2, mlcod=0'0)", 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:04:30.357 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 86.699209330000002, 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022534413, 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664958+0000", 2024-05-07T14:04:30.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.664960+0000", 2024-05-07T14:04:30.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0109999999999999e-06 2024-05-07T14:04:30.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670334+0000", 2024-05-07T14:04:30.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.005374635 2024-05-07T14:04:30.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670368+0000", 2024-05-07T14:04:30.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3374999999999998e-05 2024-05-07T14:04:30.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670385+0000", 2024-05-07T14:04:30.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7512000000000001e-05 2024-05-07T14:04:30.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670515+0000", 2024-05-07T14:04:30.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012940900000000001 2024-05-07T14:04:30.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.670543+0000", 2024-05-07T14:04:30.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8157000000000002e-05 2024-05-07T14:04:30.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.361 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687374+0000", 2024-05-07T14:04:30.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016831793000000001 2024-05-07T14:04:30.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.687492+0000", 2024-05-07T14:04:30.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117521 2024-05-07T14:04:30.362 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.362 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.362 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.363 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2497 7.9 7:93e5b521:::notify.7:head [watch reconnect cookie 94397682177536 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:30.363 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:04:30.363 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 83.969225909000002, 2024-05-07T14:04:30.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0512951690000001, 2024-05-07T14:04:30.363 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.363 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.363 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:30.363 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.363 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.363 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.363 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2497 2024-05-07T14:04:30.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.364 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:04:30.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394941+0000", 2024-05-07T14:04:30.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394942+0000", 2024-05-07T14:04:30.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9100000000000002e-07 2024-05-07T14:04:30.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394946+0000", 2024-05-07T14:04:30.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2239999999999997e-06 2024-05-07T14:04:30.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394960+0000", 2024-05-07T14:04:30.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3419e-05 2024-05-07T14:04:30.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.394966+0000", 2024-05-07T14:04:30.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3620000000000002e-06 2024-05-07T14:04:30.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395019+0000", 2024-05-07T14:04:30.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3099000000000001e-05 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.395023+0000", 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0879999999999997e-06 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400981+0000", 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059580520000000001 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:30.367 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:06.400990+0000", 2024-05-07T14:04:30.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0880000000000001e-06 2024-05-07T14:04:30.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.438550+0000", 2024-05-07T14:04:30.368 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.037559288 2024-05-07T14:04:30.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.368 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:30.368 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.439512+0000", 2024-05-07T14:04:30.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000962154 2024-05-07T14:04:30.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442920+0000", 2024-05-07T14:04:30.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0034085109999999999 2024-05-07T14:04:30.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.369 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.369 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.442966+0000", 2024-05-07T14:04:30.369 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5509000000000001e-05 2024-05-07T14:04:30.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.370 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.370 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:07.446236+0000", 2024-05-07T14:04:30.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032704840000000002 2024-05-07T14:04:30.370 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.370 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.370 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.370 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2665 7.9 7:93e5b521:::notify.7:head [watch reconnect cookie 94397682177536 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:30.370 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.650634+0000", 2024-05-07T14:04:30.370 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.713532635, 2024-05-07T14:04:30.370 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1256737430000001, 2024-05-07T14:04:30.370 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.371 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.371 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:30.371 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.371 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.371 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.371 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2665 2024-05-07T14:04:30.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.371 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.371 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.371 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650634+0000", 2024-05-07T14:04:30.371 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650634+0000", 2024-05-07T14:04:30.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650636+0000", 2024-05-07T14:04:30.372 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0549999999999998e-06 2024-05-07T14:04:30.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.372 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.372 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650644+0000", 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1849999999999998e-06 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650657+0000", 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3839000000000001e-05 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650669+0000", 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1483e-05 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650731+0000", 2024-05-07T14:04:30.373 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.2327000000000001e-05 2024-05-07T14:04:30.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:30.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.650742+0000", 2024-05-07T14:04:30.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1216999999999999e-05 2024-05-07T14:04:30.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.374 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.374 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774923+0000", 2024-05-07T14:04:30.374 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.124180213 2024-05-07T14:04:30.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775019+0000", 2024-05-07T14:04:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5995000000000005e-05 2024-05-07T14:04:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.776308+0000", 2024-05-07T14:04:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0012894289999999999 2024-05-07T14:04:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2669 7.9 7:93e5b521:::notify.7:head [watch ping cookie 94397682177536 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195592+0000", 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.168575140999998, 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.58012271999999998, 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2669 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195592+0000", 2024-05-07T14:04:30.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195592+0000", 2024-05-07T14:04:30.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.377 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.377 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195594+0000", 2024-05-07T14:04:30.377 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4899999999999999e-06 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195605+0000", 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.08e-05 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195627+0000", 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1577999999999999e-05 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.378 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195637+0000", 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0258000000000001e-05 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195966+0000", 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032875299999999999 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.196005+0000", 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9662000000000001e-05 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.379 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775356+0000", 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57935019200000004 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775484+0000", 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012866399999999999 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775715+0000", 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000230323 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.380 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.381 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2702 3.1b 3:d8b8357f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:30.381 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.975062+0000", 2024-05-07T14:04:30.381 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.389105391999998, 2024-05-07T14:04:30.381 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021948369999999998, 2024-05-07T14:04:30.381 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.381 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.381 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.381 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.381 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.381 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.381 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2702 2024-05-07T14:04:30.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.382 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.975062+0000", 2024-05-07T14:04:30.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.382 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.382 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.975062+0000", 2024-05-07T14:04:30.382 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.975064+0000", 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.973e-06 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977232+0000", 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002168728 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977260+0000", 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7475e-05 2024-05-07T14:04:30.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977275+0000", 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5183e-05 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977377+0000", 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010254100000000001 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977581+0000", 2024-05-07T14:04:30.384 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020312499999999999 2024-05-07T14:04:30.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:30.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.977709+0000", 2024-05-07T14:04:30.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012883799999999999 2024-05-07T14:04:30.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.385 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:30.385 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.985043+0000", 2024-05-07T14:04:30.385 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007334007 2024-05-07T14:04:30.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:30.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.996896+0000", 2024-05-07T14:04:30.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01185277 2024-05-07T14:04:30.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.996962+0000", 2024-05-07T14:04:30.386 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6267999999999996e-05 2024-05-07T14:04:30.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.386 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.386 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.997010+0000", 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7462000000000001e-05 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2703 3.2b 3:d6a94723:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.986066+0000", 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.378100723999999, 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026422658000000002, 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.387 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2703 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.986066+0000", 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.986066+0000", 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.986068+0000", 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.533e-06 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988000+0000", 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001931861 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988017+0000", 2024-05-07T14:04:30.389 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6960999999999999e-05 2024-05-07T14:04:30.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988026+0000", 2024-05-07T14:04:30.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5089999999999999e-06 2024-05-07T14:04:30.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.390 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988103+0000", 2024-05-07T14:04:30.390 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7145999999999996e-05 2024-05-07T14:04:30.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.390 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988291+0000", 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018802399999999999 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.988468+0000", 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000176436 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.994911+0000", 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0064430160000000002 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.012381+0000", 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017470672 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.012434+0000", 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2667999999999998e-05 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.012489+0000", 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4832e-05 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.392 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.393 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.393 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2762 3.1b 3:d9d65702:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:30.393 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.610418+0000", 2024-05-07T14:04:30.393 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.753749253000002, 2024-05-07T14:04:30.393 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021519017000000001, 2024-05-07T14:04:30.393 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.393 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.393 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.393 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.393 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.394 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.394 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2762 2024-05-07T14:04:30.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.394 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.610418+0000", 2024-05-07T14:04:30.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.394 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.394 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.610418+0000", 2024-05-07T14:04:30.394 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.610420+0000", 2024-05-07T14:04:30.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.928e-06 2024-05-07T14:04:30.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.395 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.611751+0000", 2024-05-07T14:04:30.395 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013312479999999999 2024-05-07T14:04:30.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.395 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.611782+0000", 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0923000000000002e-05 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.611797+0000", 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5514000000000001e-05 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.611880+0000", 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2752999999999999e-05 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.612041+0000", 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000160612 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.612203+0000", 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016274400000000001 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.617942+0000", 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057384360000000004 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:30.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.631827+0000", 2024-05-07T14:04:30.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013884811 2024-05-07T14:04:30.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.398 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.631886+0000", 2024-05-07T14:04:30.398 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.9348000000000002e-05 2024-05-07T14:04:30.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.398 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.399 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.631937+0000", 2024-05-07T14:04:30.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0699999999999999e-05 2024-05-07T14:04:30.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.399 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.399 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2786 3.20 e105/21 3:043afb92:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_103:head v 105'7, mlcod=85'5)", 2024-05-07T14:04:30.399 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.877401+0000", 2024-05-07T14:04:30.399 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.486766178000003, 2024-05-07T14:04:30.399 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020697717000000001, 2024-05-07T14:04:30.399 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.399 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877401+0000", 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877401+0000", 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.400 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877401+0000", 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0699999999999998e-07 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882693+0000", 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052920179999999999 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882721+0000", 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7960999999999999e-05 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.401 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882735+0000", 2024-05-07T14:04:30.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3730999999999999e-05 2024-05-07T14:04:30.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882809+0000", 2024-05-07T14:04:30.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4145000000000002e-05 2024-05-07T14:04:30.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.402 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.402 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.882827+0000", 2024-05-07T14:04:30.402 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7802999999999999e-05 2024-05-07T14:04:30.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.898034+0000", 2024-05-07T14:04:30.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015206871 2024-05-07T14:04:30.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.403 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.403 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.898098+0000", 2024-05-07T14:04:30.403 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4781000000000002e-05 2024-05-07T14:04:30.403 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.403 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.403 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2805 3.1 3:819b24c4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.073271+0000", 2024-05-07T14:04:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.290896203000003, 2024-05-07T14:04:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.031866104999999999, 2024-05-07T14:04:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.404 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2805 2024-05-07T14:04:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.405 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.073271+0000", 2024-05-07T14:04:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.406 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.073271+0000", 2024-05-07T14:04:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.073273+0000", 2024-05-07T14:04:30.407 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6850000000000001e-06 2024-05-07T14:04:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075721+0000", 2024-05-07T14:04:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002447421 2024-05-07T14:04:30.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075740+0000", 2024-05-07T14:04:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9576e-05 2024-05-07T14:04:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075749+0000", 2024-05-07T14:04:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9789999999999999e-06 2024-05-07T14:04:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075825+0000", 2024-05-07T14:04:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5260999999999997e-05 2024-05-07T14:04:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.411 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.075983+0000", 2024-05-07T14:04:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015831600000000001 2024-05-07T14:04:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.076151+0000", 2024-05-07T14:04:30.412 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016770700000000001 2024-05-07T14:04:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.082660+0000", 2024-05-07T14:04:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065091610000000003 2024-05-07T14:04:30.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.105024+0000", 2024-05-07T14:04:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022364063 2024-05-07T14:04:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.105085+0000", 2024-05-07T14:04:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1239000000000001e-05 2024-05-07T14:04:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.415 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.105137+0000", 2024-05-07T14:04:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1697000000000003e-05 2024-05-07T14:04:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2833 3.23 3:c4434fb0:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:30.416 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.257751+0000", 2024-05-07T14:04:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.106416396999997, 2024-05-07T14:04:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022056151, 2024-05-07T14:04:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.417 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2833 2024-05-07T14:04:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.257751+0000", 2024-05-07T14:04:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.419 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.257751+0000", 2024-05-07T14:04:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.420 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.257753+0000", 2024-05-07T14:04:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.835e-06 2024-05-07T14:04:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.421 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260054+0000", 2024-05-07T14:04:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023008759999999999 2024-05-07T14:04:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.422 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260077+0000", 2024-05-07T14:04:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2390000000000001e-05 2024-05-07T14:04:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260086+0000", 2024-05-07T14:04:30.423 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2939999999999994e-06 2024-05-07T14:04:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260164+0000", 2024-05-07T14:04:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7967999999999996e-05 2024-05-07T14:04:30.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260322+0000", 2024-05-07T14:04:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015761599999999999 2024-05-07T14:04:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260413+0000", 2024-05-07T14:04:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1052999999999997e-05 2024-05-07T14:04:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277331+0000", 2024-05-07T14:04:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016918408999999999 2024-05-07T14:04:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.427 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.279697+0000", 2024-05-07T14:04:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023660650000000001 2024-05-07T14:04:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.428 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.279757+0000", 2024-05-07T14:04:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0183000000000003e-05 2024-05-07T14:04:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.279807+0000", 2024-05-07T14:04:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9462000000000002e-05 2024-05-07T14:04:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.429 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2881 3.1 3:8167d3db:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.753242+0000", 2024-05-07T14:04:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 44.610924750000002, 2024-05-07T14:04:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.024564928, 2024-05-07T14:04:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.430 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2881 2024-05-07T14:04:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.431 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.753242+0000", 2024-05-07T14:04:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.753242+0000", 2024-05-07T14:04:30.432 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.753245+0000", 2024-05-07T14:04:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3369999999999998e-06 2024-05-07T14:04:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.754969+0000", 2024-05-07T14:04:30.433 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001724146 2024-05-07T14:04:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755003+0000", 2024-05-07T14:04:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4347999999999997e-05 2024-05-07T14:04:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755019+0000", 2024-05-07T14:04:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5789000000000001e-05 2024-05-07T14:04:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.434 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755107+0000", 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7861999999999993e-05 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755284+0000", 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017727300000000001 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.755454+0000", 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017009800000000001 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.435 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.763510+0000", 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080555130000000003 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777718+0000", 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014208461 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777773+0000", 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5210999999999997e-05 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.436 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777807+0000", 2024-05-07T14:04:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3890000000000002e-05 2024-05-07T14:04:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2896 3.3a e105/21 3:5f842f5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_203:head v 105'5, mlcod=84'3)", 2024-05-07T14:04:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.941416+0000", 2024-05-07T14:04:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 44.422750931000003, 2024-05-07T14:04:30.437 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021136130999999999, 2024-05-07T14:04:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.941416+0000", 2024-05-07T14:04:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.438 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.941416+0000", 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.941420+0000", 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8449999999999996e-06 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945321+0000", 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039015709999999999 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.439 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945345+0000", 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3169000000000001e-05 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945356+0000", 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1032e-05 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945445+0000", 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9456999999999994e-05 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.945464+0000", 2024-05-07T14:04:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8442999999999999e-05 2024-05-07T14:04:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.962473+0000", 2024-05-07T14:04:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017009929999999999 2024-05-07T14:04:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.962552+0000", 2024-05-07T14:04:30.441 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8683999999999994e-05 2024-05-07T14:04:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3207 3.2b 3:d4330214:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.442936+0000", 2024-05-07T14:04:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.921231192, 2024-05-07T14:04:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027263519, 2024-05-07T14:04:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.442 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3207 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.442936+0000", 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.443 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.442936+0000", 2024-05-07T14:04:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.442938+0000", 2024-05-07T14:04:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.492e-06 2024-05-07T14:04:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444455+0000", 2024-05-07T14:04:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001516358 2024-05-07T14:04:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444480+0000", 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5377000000000001e-05 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444490+0000", 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.6269999999999995e-06 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444559+0000", 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9751000000000004e-05 2024-05-07T14:04:30.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.444564+0000", 2024-05-07T14:04:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0119999999999996e-06 2024-05-07T14:04:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.447717+0000", 2024-05-07T14:04:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031529280000000002 2024-05-07T14:04:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.446 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.447849+0000", 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013140299999999999 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.447989+0000", 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014011199999999999 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.456943+0000", 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0089544410000000005 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:30.447 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.470091+0000", 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013147771000000001 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.470160+0000", 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9386000000000003e-05 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.470199+0000", 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8860999999999999e-05 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.448 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3277 3.b e114/21 3:d1f9c1c7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_169:head v 114'12, mlcod=105'10)", 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.321578+0000", 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.042588984999998, 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020255588000000001, 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.321578+0000", 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.321578+0000", 2024-05-07T14:04:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.321580+0000", 2024-05-07T14:04:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0159999999999998e-06 2024-05-07T14:04:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323743+0000", 2024-05-07T14:04:30.450 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021628250000000002 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323773+0000", 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0660999999999997e-05 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323788+0000", 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4674999999999999e-05 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323911+0000", 2024-05-07T14:04:30.451 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012308299999999999 2024-05-07T14:04:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.323950+0000", 2024-05-07T14:04:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8804000000000003e-05 2024-05-07T14:04:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.341689+0000", 2024-05-07T14:04:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017738812999999999 2024-05-07T14:04:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.341834+0000", 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144711 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3294 3.2b 3:d7c35516:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_186:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.576719+0000", 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.787447696000001, 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022223448, 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.453 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3294 2024-05-07T14:04:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.576719+0000", 2024-05-07T14:04:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.576719+0000", 2024-05-07T14:04:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.576722+0000", 2024-05-07T14:04:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.066e-06 2024-05-07T14:04:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.455 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.579823+0000", 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.003100223 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.579853+0000", 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0243000000000002e-05 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.579869+0000", 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6033e-05 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.456 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.580020+0000", 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015147899999999999 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.580300+0000", 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027962499999999998 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.580566+0000", 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000266292 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.589954+0000", 2024-05-07T14:04:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0093879900000000006 2024-05-07T14:04:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.598626+0000", 2024-05-07T14:04:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086722380000000005 2024-05-07T14:04:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.598814+0000", 2024-05-07T14:04:30.458 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018747699999999999 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.598943+0000", 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000128782 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3318 3.3e e114/99 3:7ccfcb84:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_210:head v 114'13, mlcod=114'11)", 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.035722+0000", 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.328445376000001, 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020383162999999999, 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.459 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035722+0000", 2024-05-07T14:04:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035722+0000", 2024-05-07T14:04:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035724+0000", 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7870000000000002e-06 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.040965+0000", 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052403010000000002 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.041003+0000", 2024-05-07T14:04:30.461 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7959e-05 2024-05-07T14:04:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.041020+0000", 2024-05-07T14:04:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7439999999999999e-05 2024-05-07T14:04:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.041178+0000", 2024-05-07T14:04:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015785699999999999 2024-05-07T14:04:30.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.041244+0000", 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6298999999999997e-05 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.055937+0000", 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014693289 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.056105+0000", 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000167231 2024-05-07T14:04:30.463 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3320 3.32 3:4c525d3e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.073155+0000", 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.291012176999999, 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022527378000000001, 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.464 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3320 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.073155+0000", 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.073155+0000", 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.465 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.073158+0000", 2024-05-07T14:04:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7930000000000002e-06 2024-05-07T14:04:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.077835+0000", 2024-05-07T14:04:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046779270000000001 2024-05-07T14:04:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.466 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.077880+0000", 2024-05-07T14:04:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4675999999999997e-05 2024-05-07T14:04:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.077907+0000", 2024-05-07T14:04:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6801999999999999e-05 2024-05-07T14:04:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.078080+0000", 2024-05-07T14:04:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000173308 2024-05-07T14:04:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.078360+0000", 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027958200000000001 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.078586+0000", 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000225963 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.091539+0000", 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012953411 2024-05-07T14:04:30.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.095472+0000", 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0039331770000000004 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.095593+0000", 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120368 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.095682+0000", 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9370999999999995e-05 2024-05-07T14:04:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3330 3.1b 3:d91d1d28:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_221:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.270831+0000", 2024-05-07T14:04:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.093335751000001, 2024-05-07T14:04:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020299610999999999, 2024-05-07T14:04:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.470 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3330 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.270831+0000", 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.270831+0000", 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.270835+0000", 2024-05-07T14:04:30.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3270000000000001e-06 2024-05-07T14:04:30.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274195+0000", 2024-05-07T14:04:30.472 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033601299999999998 2024-05-07T14:04:30.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.472 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.472 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274232+0000", 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7749000000000001e-05 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274259+0000", 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.622e-05 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274415+0000", 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015658800000000001 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.473 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.274793+0000", 2024-05-07T14:04:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037737399999999998 2024-05-07T14:04:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.275080+0000", 2024-05-07T14:04:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028749800000000002 2024-05-07T14:04:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.286142+0000", 2024-05-07T14:04:30.474 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011061932999999999 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.290773+0000", 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046313350000000003 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.290971+0000", 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000197713 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.475 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.291131+0000", 2024-05-07T14:04:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015974399999999999 2024-05-07T14:04:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3579 3.6 3:6382c9b5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_460:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:11.892750+0000", 2024-05-07T14:04:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 18.471416897000001, 2024-05-07T14:04:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022152108, 2024-05-07T14:04:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:30.476 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3579 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.892750+0000", 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.892750+0000", 2024-05-07T14:04:30.477 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.892753+0000", 2024-05-07T14:04:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.633e-06 2024-05-07T14:04:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.894764+0000", 2024-05-07T14:04:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00201126 2024-05-07T14:04:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.894789+0000", 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4969000000000001e-05 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.894803+0000", 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.399e-05 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.894896+0000", 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3478000000000002e-05 2024-05-07T14:04:30.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.895074+0000", 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000177586 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.895179+0000", 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010524200000000001 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.905751+0000", 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010571525 2024-05-07T14:04:30.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.914770+0000", 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0090197469999999998 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.914847+0000", 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6413000000000002e-05 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:11.914902+0000", 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5265e-05 2024-05-07T14:04:30.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:30.482 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:30.482 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:30.483 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:30.483 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T14:04:30.484 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:30.484 INFO:teuthology.orchestra.run.smithi106.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-05-07T14:04:30.484 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T14:04:30.485 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:04:30.485 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:30.494+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:30.516 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-05-07T14:04:30.584 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:30.595+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:30.650 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:30.650 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:04:30.650 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:30.675 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:04:30.685 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:30.695+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:30.786 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:30.798+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:30.822 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:30.822 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:30.822 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:30.822 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:30.822 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:30.842 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:04:30.928 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:30.942+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:30.987 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:30.998+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:31.021 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:31.021 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:31.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:31.021 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:31.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.021 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2202 3.0 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:31.022 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:04:31.022 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.753967564000007, 2024-05-07T14:04:31.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027191908000000001, 2024-05-07T14:04:31.022 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.022 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.022 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.022 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.022 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.022 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.022 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2202 2024-05-07T14:04:31.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.022 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279975+0000", 2024-05-07T14:04:31.023 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0130000000000001e-06 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285489+0000", 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055143570000000001 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285531+0000", 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1504000000000001e-05 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.024 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285550+0000", 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9256e-05 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285747+0000", 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196777 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286120+0000", 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037285900000000002 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286489+0000", 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036951099999999999 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301589+0000", 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015099728999999999 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307085+0000", 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054963340000000003 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307127+0000", 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1977999999999997e-05 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307162+0000", 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4589999999999999e-05 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.027 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2217 3.0 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:31.028 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:04:31.028 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.543640995999993, 2024-05-07T14:04:31.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019983529, 2024-05-07T14:04:31.028 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.028 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.028 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.028 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.028 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.028 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.028 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2217 2024-05-07T14:04:31.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.028 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:04:31.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:04:31.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490299+0000", 2024-05-07T14:04:31.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:04:31.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492337+0000", 2024-05-07T14:04:31.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020384489999999999 2024-05-07T14:04:31.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492391+0000", 2024-05-07T14:04:31.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3702000000000002e-05 2024-05-07T14:04:31.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492415+0000", 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3373000000000001e-05 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492567+0000", 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152788 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492843+0000", 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027568999999999998 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493123+0000", 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028014899999999999 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509840+0000", 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016716871000000001 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510203+0000", 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036252499999999999 2024-05-07T14:04:31.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510250+0000", 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7231000000000002e-05 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510280+0000", 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0270999999999999e-05 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.034 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2224 3.1a e84/21 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head v 84'2, mlcod=0'0)", 2024-05-07T14:04:31.034 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:04:31.034 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 87.438697329000007, 2024-05-07T14:04:31.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020623257999999998, 2024-05-07T14:04:31.034 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.034 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.034 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.034 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:04:31.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595243+0000", 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6800000000000002e-06 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.601988+0000", 2024-05-07T14:04:31.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0067452479999999997 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602044+0000", 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5884999999999998e-05 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602070+0000", 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6359999999999998e-05 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602183+0000", 2024-05-07T14:04:31.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112761 2024-05-07T14:04:31.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602210+0000", 2024-05-07T14:04:31.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6882000000000001e-05 2024-05-07T14:04:31.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615811+0000", 2024-05-07T14:04:31.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01360132 2024-05-07T14:04:31.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615863+0000", 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2122e-05 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2704 3.31 3:8c38a608:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.03497496, 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.024434902000000001, 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.038 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2704 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:04:31.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998965+0000", 2024-05-07T14:04:31.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6809999999999998e-06 2024-05-07T14:04:31.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000686+0000", 2024-05-07T14:04:31.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00172109 2024-05-07T14:04:31.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000705+0000", 2024-05-07T14:04:31.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8879999999999999e-05 2024-05-07T14:04:31.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000718+0000", 2024-05-07T14:04:31.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2846e-05 2024-05-07T14:04:31.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000794+0000", 2024-05-07T14:04:31.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5613999999999998e-05 2024-05-07T14:04:31.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000919+0000", 2024-05-07T14:04:31.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000124924 2024-05-07T14:04:31.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:31.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.001034+0000", 2024-05-07T14:04:31.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115158 2024-05-07T14:04:31.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.007009+0000", 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059753009999999997 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023250+0000", 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016240477 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023343+0000", 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3362000000000005e-05 2024-05-07T14:04:31.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023397+0000", 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4568999999999999e-05 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2803 3.4 3:2246d6f5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.980183621000002, 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021000333999999999, 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.044 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2803 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:04:31.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053757+0000", 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1049999999999999e-06 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056166+0000", 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002409039 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056189+0000", 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2595e-05 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056200+0000", 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1212999999999999e-05 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056274+0000", 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4086999999999997e-05 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056414+0000", 2024-05-07T14:04:31.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000139763 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056555+0000", 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014123900000000001 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.071326+0000", 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014771151999999999 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074566+0000", 2024-05-07T14:04:31.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032398570000000001 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074699+0000", 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013297800000000001 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074754+0000", 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5306000000000002e-05 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.049 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2832 3.1a e105/21 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head v 105'9, mlcod=85'7)", 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.779720120999997, 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023326739999999999, 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254219+0000", 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0059999999999999e-06 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260033+0000", 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058134010000000002 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260063+0000", 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9762000000000001e-05 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260085+0000", 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2157000000000001e-05 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260165+0000", 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9909999999999999e-05 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260195+0000", 2024-05-07T14:04:31.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9935000000000001e-05 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277464+0000", 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017269805999999999 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277544+0000", 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9763000000000002e-05 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.054 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2860 3.3e 3:7cdd96b9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:31.054 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:04:31.054 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.505513399000002, 2024-05-07T14:04:31.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019237982000000001, 2024-05-07T14:04:31.054 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.054 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.054 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.054 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.054 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.054 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.054 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2860 2024-05-07T14:04:31.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528427+0000", 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5739999999999998e-06 2024-05-07T14:04:31.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530685+0000", 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022580009999999999 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530713+0000", 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8552e-05 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530727+0000", 2024-05-07T14:04:31.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4054e-05 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530808+0000", 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0741999999999994e-05 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530954+0000", 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145494 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.531051+0000", 2024-05-07T14:04:31.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7349999999999995e-05 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.543007+0000", 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011955873000000001 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547544+0000", 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004537091 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547610+0000", 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5722000000000005e-05 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547662+0000", 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2528999999999998e-05 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2880 3.19 3:989dc271:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.292801587, 2024-05-07T14:04:31.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018463578000000001, 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2880 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741138+0000", 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2510000000000001e-06 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742746+0000", 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001608195 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742776+0000", 2024-05-07T14:04:31.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9335999999999998e-05 2024-05-07T14:04:31.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742789+0000", 2024-05-07T14:04:31.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3059e-05 2024-05-07T14:04:31.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742879+0000", 2024-05-07T14:04:31.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0073000000000003e-05 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.743010+0000", 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013067999999999999 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.743127+0000", 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117606 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.752872+0000", 2024-05-07T14:04:31.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0097450880000000007 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759514+0000", 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0066419900000000004 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759554+0000", 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0070000000000001e-05 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759600+0000", 2024-05-07T14:04:31.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5229999999999999e-05 2024-05-07T14:04:31.065 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.065 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.065 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.065 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3190 3.1a e113/21 3:59666d5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_82:head v 113'16, mlcod=113'14)", 2024-05-07T14:04:31.065 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.268091+0000", 2024-05-07T14:04:31.065 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.765846111999998, 2024-05-07T14:04:31.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018489769, 2024-05-07T14:04:31.065 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.065 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.065 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.268091+0000", 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.268091+0000", 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.066 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.268094+0000", 2024-05-07T14:04:31.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1110000000000002e-06 2024-05-07T14:04:31.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272518+0000", 2024-05-07T14:04:31.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044240620000000003 2024-05-07T14:04:31.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272549+0000", 2024-05-07T14:04:31.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1881999999999997e-05 2024-05-07T14:04:31.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272563+0000", 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3943e-05 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272640+0000", 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6468e-05 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272660+0000", 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9945999999999998e-05 2024-05-07T14:04:31.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.286524+0000", 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013864227999999999 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.286581+0000", 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7129000000000001e-05 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.070 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3202 3.19 3:9b833f57:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:31.070 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.381014+0000", 2024-05-07T14:04:31.070 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.652923936000001, 2024-05-07T14:04:31.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018118082000000001, 2024-05-07T14:04:31.070 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.070 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.070 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.070 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.070 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.070 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3202 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.381014+0000", 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.381014+0000", 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.381016+0000", 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3879999999999998e-06 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.382901+0000", 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001884868 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.382923+0000", 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2209e-05 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.382936+0000", 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3036e-05 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.383023+0000", 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6841000000000004e-05 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.383199+0000", 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017636099999999999 2024-05-07T14:04:31.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.383367+0000", 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016805300000000001 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.395462+0000", 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012094183 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.399010+0000", 2024-05-07T14:04:31.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0035486559999999999 2024-05-07T14:04:31.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.399077+0000", 2024-05-07T14:04:31.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6457000000000004e-05 2024-05-07T14:04:31.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.399132+0000", 2024-05-07T14:04:31.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.503e-05 2024-05-07T14:04:31.075 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.075 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.075 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3205 3.31 3:8edf8d67:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.413707+0000", 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.620230514999999, 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020052646, 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3205 2024-05-07T14:04:31.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.413707+0000", 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.413707+0000", 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.413709+0000", 2024-05-07T14:04:31.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.458e-06 2024-05-07T14:04:31.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415525+0000", 2024-05-07T14:04:31.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001815421 2024-05-07T14:04:31.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.078 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.078 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415551+0000", 2024-05-07T14:04:31.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.618e-05 2024-05-07T14:04:31.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415566+0000", 2024-05-07T14:04:31.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5356e-05 2024-05-07T14:04:31.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415658+0000", 2024-05-07T14:04:31.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1460999999999997e-05 2024-05-07T14:04:31.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415844+0000", 2024-05-07T14:04:31.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000186329 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.416021+0000", 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017681700000000001 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.426085+0000", 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010063880000000001 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.433647+0000", 2024-05-07T14:04:31.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0075620460000000002 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.433715+0000", 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8239999999999997e-05 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.433760+0000", 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4458e-05 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3272 3.0 3:00176f47:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.212328+0000", 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.821609906999999, 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020854049, 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3272 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.082 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.212328+0000", 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.212328+0000", 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.212332+0000", 2024-05-07T14:04:31.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0999999999999997e-06 2024-05-07T14:04:31.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214290+0000", 2024-05-07T14:04:31.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001958647 2024-05-07T14:04:31.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.084 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.084 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214325+0000", 2024-05-07T14:04:31.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4993999999999997e-05 2024-05-07T14:04:31.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214348+0000", 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2402999999999999e-05 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214476+0000", 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012784600000000001 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214718+0000", 2024-05-07T14:04:31.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024232499999999999 2024-05-07T14:04:31.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:31.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214960+0000", 2024-05-07T14:04:31.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000241933 2024-05-07T14:04:31.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.232983+0000", 2024-05-07T14:04:31.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018023127 2024-05-07T14:04:31.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.233043+0000", 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0226000000000002e-05 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.233121+0000", 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7751999999999997e-05 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.233182+0000", 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0696000000000003e-05 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.087 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.088 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3303 3.0 3:02427a19:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:31.088 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.742146+0000", 2024-05-07T14:04:31.088 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.291791491000001, 2024-05-07T14:04:31.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017583926999999999, 2024-05-07T14:04:31.088 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.088 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.088 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.088 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.088 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.088 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.088 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3303 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.742146+0000", 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.742146+0000", 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.742150+0000", 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.2529999999999998e-06 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.745252+0000", 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0031012639999999998 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.745283+0000", 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1588999999999999e-05 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.745298+0000", 2024-05-07T14:04:31.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5336e-05 2024-05-07T14:04:31.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.745513+0000", 2024-05-07T14:04:31.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021474499999999999 2024-05-07T14:04:31.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.745865+0000", 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035175400000000002 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.746122+0000", 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00025658899999999999 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.759115+0000", 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012993648999999999 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.759653+0000", 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00053803100000000001 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.759694+0000", 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0309999999999999e-05 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.759730+0000", 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6406999999999999e-05 2024-05-07T14:04:31.093 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.094 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.094 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3318 3.3e 3:7ccfcb84:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:31.094 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.031876+0000", 2024-05-07T14:04:31.094 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 22.002061114, 2024-05-07T14:04:31.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.02503468, 2024-05-07T14:04:31.094 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.094 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.094 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.094 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.094 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3318 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.031876+0000", 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.031876+0000", 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.031879+0000", 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4600000000000002e-06 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.034903+0000", 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030236730000000002 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.034950+0000", 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7922e-05 2024-05-07T14:04:31.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.034975+0000", 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-05 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035105+0000", 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129901 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035338+0000", 2024-05-07T14:04:31.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023303000000000001 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035526+0000", 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018805100000000001 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.047239+0000", 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011713072 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.056528+0000", 2024-05-07T14:04:31.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092883140000000006 2024-05-07T14:04:31.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.056759+0000", 2024-05-07T14:04:31.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023124300000000001 2024-05-07T14:04:31.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.056911+0000", 2024-05-07T14:04:31.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015221399999999999 2024-05-07T14:04:31.099 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.100 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.100 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3325 3.19 3:9a914b7d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:31.100 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.188566+0000", 2024-05-07T14:04:31.100 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.845371877000002, 2024-05-07T14:04:31.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023664281999999998, 2024-05-07T14:04:31.100 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.100 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.101 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.101 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3325 2024-05-07T14:04:31.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.101 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.188566+0000", 2024-05-07T14:04:31.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.188566+0000", 2024-05-07T14:04:31.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.188569+0000", 2024-05-07T14:04:31.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4680000000000001e-06 2024-05-07T14:04:31.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.192695+0000", 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004125933 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.192736+0000", 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1196000000000003e-05 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.192755+0000", 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8257000000000002e-05 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.192921+0000", 2024-05-07T14:04:31.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016651400000000001 2024-05-07T14:04:31.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.193267+0000", 2024-05-07T14:04:31.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000346289 2024-05-07T14:04:31.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:31.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.193536+0000", 2024-05-07T14:04:31.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026907899999999998 2024-05-07T14:04:31.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.203492+0000", 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099560800000000008 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.211923+0000", 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0084306810000000006 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.212134+0000", 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021085 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.212230+0000", 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5934999999999995e-05 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3338 3.3e 3:7de3d26b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_229:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.419519+0000", 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 21.614418103999999, 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018001646, 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.108 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3338 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.419519+0000", 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.419519+0000", 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.419523+0000", 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4029999999999999e-06 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.422528+0000", 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030051489999999999 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.422567+0000", 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8974000000000003e-05 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.422585+0000", 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7816999999999999e-05 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.422689+0000", 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000104689 2024-05-07T14:04:31.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.422868+0000", 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017882900000000001 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.423035+0000", 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016687700000000001 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.430611+0000", 2024-05-07T14:04:31.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0075756529999999999 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.437397+0000", 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0067862540000000002 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.437466+0000", 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9408999999999999e-05 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.437521+0000", 2024-05-07T14:04:31.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4592000000000002e-05 2024-05-07T14:04:31.114 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.114 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.114 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.114 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3791 3.3e 3:7c4972ca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:31.114 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:30.736519+0000", 2024-05-07T14:04:31.114 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.29741828999999997, 2024-05-07T14:04:31.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019341526000000001, 2024-05-07T14:04:31.114 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.114 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.114 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.114 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3791 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.736519+0000", 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.736519+0000", 2024-05-07T14:04:31.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.736522+0000", 2024-05-07T14:04:31.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.072e-06 2024-05-07T14:04:31.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.738809+0000", 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002286265 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.738842+0000", 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3553000000000002e-05 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.738857+0000", 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5106000000000001e-05 2024-05-07T14:04:31.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.738945+0000", 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7299999999999994e-05 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.739078+0000", 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000133948 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.739242+0000", 2024-05-07T14:04:31.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016338100000000001 2024-05-07T14:04:31.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.751510+0000", 2024-05-07T14:04:31.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012268055 2024-05-07T14:04:31.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.755732+0000", 2024-05-07T14:04:31.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042221660000000003 2024-05-07T14:04:31.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.755801+0000", 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8677999999999995e-05 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.755861+0000", 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0001999999999999e-05 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3793 3.4 3:21e6e332:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:31.122 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:30.757536+0000", 2024-05-07T14:04:31.123 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.276401487, 2024-05-07T14:04:31.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019316313000000002, 2024-05-07T14:04:31.123 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.123 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.123 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.123 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.123 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.123 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.123 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3793 2024-05-07T14:04:31.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.123 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.123 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.757536+0000", 2024-05-07T14:04:31.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.757536+0000", 2024-05-07T14:04:31.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.757538+0000", 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3590000000000002e-06 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.759562+0000", 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002024063 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.759589+0000", 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6342e-05 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.759602+0000", 2024-05-07T14:04:31.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3106e-05 2024-05-07T14:04:31.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.759694+0000", 2024-05-07T14:04:31.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999999e-05 2024-05-07T14:04:31.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.759901+0000", 2024-05-07T14:04:31.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020608000000000001 2024-05-07T14:04:31.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:31.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.760082+0000", 2024-05-07T14:04:31.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018143200000000001 2024-05-07T14:04:31.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.776366+0000", 2024-05-07T14:04:31.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016284284 2024-05-07T14:04:31.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.776581+0000", 2024-05-07T14:04:31.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215226 2024-05-07T14:04:31.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.776791+0000", 2024-05-07T14:04:31.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020968899999999999 2024-05-07T14:04:31.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.129 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.776852+0000", 2024-05-07T14:04:31.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1231999999999999e-05 2024-05-07T14:04:31.129 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.129 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.129 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.129 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3802 3.25 3:a44480c7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:31.129 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:30.852518+0000", 2024-05-07T14:04:31.129 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.18141923500000001, 2024-05-07T14:04:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018386917999999999, 2024-05-07T14:04:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3802 2024-05-07T14:04:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.852518+0000", 2024-05-07T14:04:31.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.852518+0000", 2024-05-07T14:04:31.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.852521+0000", 2024-05-07T14:04:31.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6989999999999999e-06 2024-05-07T14:04:31.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.854493+0000", 2024-05-07T14:04:31.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019719799999999999 2024-05-07T14:04:31.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.854515+0000", 2024-05-07T14:04:31.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1713e-05 2024-05-07T14:04:31.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.854524+0000", 2024-05-07T14:04:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3999999999999998e-06 2024-05-07T14:04:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.854590+0000", 2024-05-07T14:04:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6002999999999998e-05 2024-05-07T14:04:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.854754+0000", 2024-05-07T14:04:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000164399 2024-05-07T14:04:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:31.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.854853+0000", 2024-05-07T14:04:31.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8856000000000004e-05 2024-05-07T14:04:31.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.869164+0000", 2024-05-07T14:04:31.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014310359 2024-05-07T14:04:31.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.870782+0000", 2024-05-07T14:04:31.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016185520000000001 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.870853+0000", 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0683000000000001e-05 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.870905+0000", 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2274000000000001e-05 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3805 3.4 3:2245806e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:30.883916+0000", 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.1500214, 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027647418999999999, 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3805 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.136 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.883916+0000", 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.883916+0000", 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.883919+0000", 2024-05-07T14:04:31.137 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.717e-06 2024-05-07T14:04:31.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.885838+0000", 2024-05-07T14:04:31.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019192199999999999 2024-05-07T14:04:31.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.138 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.885859+0000", 2024-05-07T14:04:31.138 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0579999999999999e-05 2024-05-07T14:04:31.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.138 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.885870+0000", 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1019000000000001e-05 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.885953+0000", 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3758999999999995e-05 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.886144+0000", 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000190473 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:31.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.886303+0000", 2024-05-07T14:04:31.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015875899999999999 2024-05-07T14:04:31.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.908501+0000", 2024-05-07T14:04:31.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022198388999999999 2024-05-07T14:04:31.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.140 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.140 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.911445+0000", 2024-05-07T14:04:31.140 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00294363 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.911516+0000", 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1038000000000007e-05 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.911564+0000", 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7834999999999999e-05 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.142 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.142 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:31.143 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:04:31.144 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:31.154+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:31.243 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:31.254+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:31.314 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:31.314 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:31.314 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:04:31.314 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:31.330 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:04:31.372 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:31.386+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:31.446 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:31.455+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:31.519 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:31.519 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:31.519 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:31.519 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:31.519 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:31.539 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is set 2024-05-07T14:04:31.544 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:04:31.547 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:31.558+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:31.648 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:31.658+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:31.749 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:31.759+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:31.758 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:31.758 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:31.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:31.758 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:31.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.758 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2202 3.0 e84/21 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head v 84'1, mlcod=0'0)", 2024-05-07T14:04:31.758 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:04:31.758 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 88.484023285999996, 2024-05-07T14:04:31.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020120560999999999, 2024-05-07T14:04:31.758 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.758 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286676+0000", 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.57e-06 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291894+0000", 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052185740000000001 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291939+0000", 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4676999999999999e-05 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291959+0000", 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0115999999999998e-05 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292128+0000", 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168758 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292188+0000", 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0565e-05 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306607+0000", 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014418733 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306794+0000", 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018656799999999999 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2687 3.2 3:43af9208:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:04:31.762 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.952155218999998, 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037068531000000002, 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2687 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:04:31.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818544+0000", 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3390000000000001e-06 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821166+0000", 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026214250000000001 2024-05-07T14:04:31.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821192+0000", 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5641999999999999e-05 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821203+0000", 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1558e-05 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821280+0000", 2024-05-07T14:04:31.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7237000000000006e-05 2024-05-07T14:04:31.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:31.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821288+0000", 2024-05-07T14:04:31.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0930000000000003e-06 2024-05-07T14:04:31.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823694+0000", 2024-05-07T14:04:31.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024052850000000001 2024-05-07T14:04:31.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823853+0000", 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015879800000000001 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823991+0000", 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013879100000000001 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.832834+0000", 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088427109999999996 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855474+0000", 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022640304 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855553+0000", 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8994999999999998e-05 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855610+0000", 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6353000000000001e-05 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2722 3.2e 3:75db52c2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.564866694999999, 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019780314, 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2722 2024-05-07T14:04:31.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.770 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:04:31.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205830+0000", 2024-05-07T14:04:31.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.205833+0000", 2024-05-07T14:04:31.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3289999999999998e-06 2024-05-07T14:04:31.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207811+0000", 2024-05-07T14:04:31.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019781529999999999 2024-05-07T14:04:31.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207829+0000", 2024-05-07T14:04:31.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7402999999999999e-05 2024-05-07T14:04:31.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207838+0000", 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0210000000000005e-06 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.207902+0000", 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4406000000000006e-05 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208094+0000", 2024-05-07T14:04:31.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000191626 2024-05-07T14:04:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.208250+0000", 2024-05-07T14:04:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000156064 2024-05-07T14:04:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.219242+0000", 2024-05-07T14:04:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010992696999999999 2024-05-07T14:04:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225500+0000", 2024-05-07T14:04:31.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.006257182 2024-05-07T14:04:31.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225550+0000", 2024-05-07T14:04:31.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0173999999999998e-05 2024-05-07T14:04:31.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.225610+0000", 2024-05-07T14:04:31.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0259e-05 2024-05-07T14:04:31.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2773 3.17 3:e87231b1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.052235027000002, 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028454317, 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.775 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.776 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2773 2024-05-07T14:04:31.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.776 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:04:31.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.776 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.776 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:04:31.776 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718465+0000", 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3680000000000002e-06 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729580+0000", 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011115776000000001 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729608+0000", 2024-05-07T14:04:31.777 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7617e-05 2024-05-07T14:04:31.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729622+0000", 2024-05-07T14:04:31.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3528e-05 2024-05-07T14:04:31.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.778 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729694+0000", 2024-05-07T14:04:31.778 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2630000000000001e-05 2024-05-07T14:04:31.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.778 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729812+0000", 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118132 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729913+0000", 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100486 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.744465+0000", 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014551768 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746795+0000", 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023300270000000001 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746865+0000", 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0322999999999997e-05 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746916+0000", 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0661999999999997e-05 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.780 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2784 3.17 3:e9b6a230:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.919939438999997, 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027214069, 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.781 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2784 2024-05-07T14:04:31.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.782 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:04:31.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.782 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.782 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:04:31.782 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850760+0000", 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0970000000000002e-06 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853165+0000", 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002405309 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853186+0000", 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0727999999999999e-05 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853196+0000", 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0159e-05 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853277+0000", 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0519999999999995e-05 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853440+0000", 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016281299999999999 2024-05-07T14:04:31.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853608+0000", 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168126 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.860132+0000", 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065242379999999999 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877848+0000", 2024-05-07T14:04:31.785 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017716251999999998 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877919+0000", 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.127e-05 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877971+0000", 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1557000000000001e-05 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2789 3.2 3:434a8bbf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.864250222000003, 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025228071000000001, 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2789 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.787 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906450+0000", 2024-05-07T14:04:31.788 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5149999999999998e-06 2024-05-07T14:04:31.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908568+0000", 2024-05-07T14:04:31.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021184279999999999 2024-05-07T14:04:31.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.789 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908593+0000", 2024-05-07T14:04:31.789 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5043999999999999e-05 2024-05-07T14:04:31.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.789 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908607+0000", 2024-05-07T14:04:31.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3716999999999999e-05 2024-05-07T14:04:31.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908686+0000", 2024-05-07T14:04:31.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9492000000000004e-05 2024-05-07T14:04:31.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.790 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.790 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908818+0000", 2024-05-07T14:04:31.790 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013199199999999999 2024-05-07T14:04:31.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908952+0000", 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013385400000000001 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.916238+0000", 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072861810000000001 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931560+0000", 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01532122 2024-05-07T14:04:31.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931620+0000", 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0448000000000001e-05 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931674+0000", 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.418e-05 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2799 3.9 e105/21 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.752875422000002, 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021236735, 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.793 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.75e-07 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024399+0000", 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065773769999999997 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024434+0000", 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4884e-05 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024450+0000", 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6181999999999999e-05 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024523+0000", 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3054999999999998e-05 2024-05-07T14:04:31.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024550+0000", 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6735000000000001e-05 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.038754+0000", 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014204543 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.039058+0000", 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030348400000000002 2024-05-07T14:04:31.796 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2802 3.13 3:c8761262:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.727446057999998, 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026174424000000002, 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.797 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2802 2024-05-07T14:04:31.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.798 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:04:31.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.798 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.798 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:04:31.798 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043253+0000", 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7030000000000002e-06 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045330+0000", 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020765139999999998 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045352+0000", 2024-05-07T14:04:31.799 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2532e-05 2024-05-07T14:04:31.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045363+0000", 2024-05-07T14:04:31.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0798000000000001e-05 2024-05-07T14:04:31.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.800 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045446+0000", 2024-05-07T14:04:31.800 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3592999999999997e-05 2024-05-07T14:04:31.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.800 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045641+0000", 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019462900000000001 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045809+0000", 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168312 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.054070+0000", 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082602100000000005 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.801 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069299+0000", 2024-05-07T14:04:31.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015229457 2024-05-07T14:04:31.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069371+0000", 2024-05-07T14:04:31.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1730000000000006e-05 2024-05-07T14:04:31.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.802 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.802 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069425+0000", 2024-05-07T14:04:31.802 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3946000000000002e-05 2024-05-07T14:04:31.802 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2839 3.17 3:e819508b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.453956691999998, 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019836402, 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.803 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2839 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316740+0000", 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.804 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.316741+0000", 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8029999999999999e-06 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318466+0000", 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017249959999999999 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318491+0000", 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4876e-05 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.805 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318502+0000", 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0421999999999999e-05 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318582+0000", 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0593999999999994e-05 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318717+0000", 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013472199999999999 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.806 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.318836+0000", 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118996 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.325781+0000", 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069447809999999997 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336451+0000", 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010670416 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336510+0000", 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8408e-05 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.336576+0000", 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6388000000000002e-05 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.808 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2888 3.2 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 45.932087547000002, 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037006981000000001, 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2888 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.809 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:04:31.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:04:31.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.810 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.810 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838611+0000", 2024-05-07T14:04:31.810 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.441e-06 2024-05-07T14:04:31.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840569+0000", 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019573189999999999 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840592+0000", 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3230999999999998e-05 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840605+0000", 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.295e-05 2024-05-07T14:04:31.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840681+0000", 2024-05-07T14:04:31.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6250999999999999e-05 2024-05-07T14:04:31.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.812 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.812 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840821+0000", 2024-05-07T14:04:31.812 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013997700000000001 2024-05-07T14:04:31.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:31.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840966+0000", 2024-05-07T14:04:31.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144735 2024-05-07T14:04:31.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.846709+0000", 2024-05-07T14:04:31.813 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057430809999999997 2024-05-07T14:04:31.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.813 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.813 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875496+0000", 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028787366000000002 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875565+0000", 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8460000000000005e-05 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875616+0000", 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.117e-05 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.814 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3180 3.13 3:caa8d6d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.171133+0000", 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.599563437, 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022191593999999999, 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3180 2024-05-07T14:04:31.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.171133+0000", 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.171133+0000", 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.816 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.171136+0000", 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0539999999999999e-06 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172705+0000", 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001568605 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172735+0000", 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0871999999999999e-05 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.817 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172749+0000", 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3342e-05 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172824+0000", 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5142999999999995e-05 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172960+0000", 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013564800000000001 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.173060+0000", 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0001004 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.177196+0000", 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041360930000000004 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.193225+0000", 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016028718000000001 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.193274+0000", 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9002000000000003e-05 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.193325+0000", 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0717000000000002e-05 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.820 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3196 3.13 3:ca161e2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:31.821 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.320598+0000", 2024-05-07T14:04:31.821 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.450098731000001, 2024-05-07T14:04:31.821 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023572460999999999, 2024-05-07T14:04:31.821 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.821 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.821 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.821 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.821 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.821 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.821 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3196 2024-05-07T14:04:31.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.821 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.320598+0000", 2024-05-07T14:04:31.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.320598+0000", 2024-05-07T14:04:31.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.822 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.822 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.320601+0000", 2024-05-07T14:04:31.822 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0479999999999999e-06 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.321972+0000", 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013711890000000001 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.321996+0000", 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4494e-05 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.322008+0000", 2024-05-07T14:04:31.823 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1307e-05 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.322083+0000", 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5572000000000001e-05 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.322196+0000", 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011228199999999999 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:31.824 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.322309+0000", 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011369799999999999 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.326918+0000", 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046091190000000001 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.344051+0000", 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017132903000000001 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.825 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.344119+0000", 2024-05-07T14:04:31.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8059999999999996e-05 2024-05-07T14:04:31.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.826 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.826 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.344170+0000", 2024-05-07T14:04:31.826 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0788999999999998e-05 2024-05-07T14:04:31.826 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.826 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.826 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.826 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3246 3.17 3:e8614b39:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.858916+0000", 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.911780074999999, 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018635514999999998, 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3246 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.827 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.858916+0000", 2024-05-07T14:04:31.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.858916+0000", 2024-05-07T14:04:31.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.828 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.828 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.858919+0000", 2024-05-07T14:04:31.828 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9160000000000001e-06 2024-05-07T14:04:31.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.860471+0000", 2024-05-07T14:04:31.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0015522229999999999 2024-05-07T14:04:31.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.860505+0000", 2024-05-07T14:04:31.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3287999999999997e-05 2024-05-07T14:04:31.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.829 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.829 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.860520+0000", 2024-05-07T14:04:31.829 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.558e-05 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.860622+0000", 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010135 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.860825+0000", 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000203217 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.861041+0000", 2024-05-07T14:04:31.830 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021571000000000001 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.866014+0000", 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004973557 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.877444+0000", 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011429946 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.831 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.877499+0000", 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4948000000000003e-05 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.877552+0000", 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2779999999999999e-05 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3250 3.2e 3:75e09b47:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.903138+0000", 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.867558696, 2024-05-07T14:04:31.832 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020147194, 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3250 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.903138+0000", 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.903138+0000", 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.903140+0000", 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.34e-06 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904918+0000", 2024-05-07T14:04:31.834 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017780960000000001 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904944+0000", 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5426e-05 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904956+0000", 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1982e-05 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.835 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.905063+0000", 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107896 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.905230+0000", 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016688099999999999 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.905398+0000", 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168157 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.836 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.912075+0000", 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0066761219999999996 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.923215+0000", 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011140469 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.923254+0000", 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9053e-05 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.837 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.838 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.923285+0000", 2024-05-07T14:04:31.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0772000000000003e-05 2024-05-07T14:04:31.838 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.838 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.838 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.838 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3252 3.2 3:422326a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:31.838 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.925584+0000", 2024-05-07T14:04:31.838 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.845112696000001, 2024-05-07T14:04:31.838 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020260311999999999, 2024-05-07T14:04:31.838 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.838 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3252 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.925584+0000", 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.839 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.925584+0000", 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.925586+0000", 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9099999999999999e-06 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927037+0000", 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014510199999999999 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.840 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927071+0000", 2024-05-07T14:04:31.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4326000000000003e-05 2024-05-07T14:04:31.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927085+0000", 2024-05-07T14:04:31.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4022999999999999e-05 2024-05-07T14:04:31.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.841 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.841 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927161+0000", 2024-05-07T14:04:31.841 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5909999999999997e-05 2024-05-07T14:04:31.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927327+0000", 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016630799999999999 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927444+0000", 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116885 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.935938+0000", 2024-05-07T14:04:31.842 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0084935159999999996 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.945759+0000", 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0098209990000000004 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.945806+0000", 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7361000000000003e-05 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.843 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.945844+0000", 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8053999999999999e-05 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3295 3.2d e114/21 3:b6ee7f94:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_187:head v 114'10, mlcod=114'8)", 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.594055+0000", 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.176641822000001, 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021164453999999999, 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.844 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.594055+0000", 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.594055+0000", 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.594057+0000", 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6479999999999999e-06 2024-05-07T14:04:31.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599702+0000", 2024-05-07T14:04:31.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056445380000000002 2024-05-07T14:04:31.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599734+0000", 2024-05-07T14:04:31.846 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1822000000000001e-05 2024-05-07T14:04:31.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.846 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.846 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599750+0000", 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6731999999999998e-05 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599897+0000", 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000146279 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599955+0000", 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8723e-05 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.847 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.615151+0000", 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015195919 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.615219+0000", 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.7793000000000006e-05 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3614 3.2e 3:74f8d4ae:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_495:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:12.264021+0000", 2024-05-07T14:04:31.848 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 19.506675359999999, 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022976369999999999, 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3614 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.264021+0000", 2024-05-07T14:04:31.849 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.264021+0000", 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.264024+0000", 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.638e-06 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.850 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.266574+0000", 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025504410000000001 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.266610+0000", 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6161000000000002e-05 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.266626+0000", 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5398999999999999e-05 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.851 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.266714+0000", 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8024999999999998e-05 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.266911+0000", 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000197379 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.267076+0000", 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016495600000000001 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.852 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.274876+0000", 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078003550000000001 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.286903+0000", 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012026606 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.286957+0000", 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4499000000000001e-05 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.854 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.854 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.286997+0000", 2024-05-07T14:04:31.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9910999999999998e-05 2024-05-07T14:04:31.854 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.854 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.854 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.854 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3800 3.17 3:ea765717:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:31.854 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:30.832471+0000", 2024-05-07T14:04:31.854 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.93822585199999997, 2024-05-07T14:04:31.854 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020980064999999999, 2024-05-07T14:04:31.854 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3800 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.832471+0000", 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.855 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.832471+0000", 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.832474+0000", 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0460000000000001e-06 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.834914+0000", 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024399930000000001 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.834941+0000", 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6979e-05 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.834955+0000", 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4054e-05 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.835040+0000", 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4919000000000005e-05 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.835213+0000", 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017349299999999999 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.835366+0000", 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000153368 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.848206+0000", 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012839339999999999 2024-05-07T14:04:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.853322+0000", 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051166229999999998 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.853397+0000", 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4314999999999996e-05 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.853451+0000", 2024-05-07T14:04:31.859 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3934999999999998e-05 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3805 3.4 e122/21 3:2245806e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_23:head v 122'14, mlcod=114'12)", 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:30.886430+0000", 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.88426596599999996, 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.024818463999999998, 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.886430+0000", 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.886430+0000", 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.886432+0000", 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6729999999999999e-06 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.888159+0000", 2024-05-07T14:04:31.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001727323 2024-05-07T14:04:31.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.888188+0000", 2024-05-07T14:04:31.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8353000000000001e-05 2024-05-07T14:04:31.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.862 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.862 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.888201+0000", 2024-05-07T14:04:31.862 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3478e-05 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.888287+0000", 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5420000000000005e-05 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.888318+0000", 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1513000000000001e-05 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.863 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.911195+0000", 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022877227 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.911249+0000", 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3477000000000003e-05 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3868 3.13 3:ca00a2f1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:31.537006+0000", 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.233690603, 2024-05-07T14:04:31.864 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020587405999999999, 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3868 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.537006+0000", 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.537006+0000", 2024-05-07T14:04:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.537009+0000", 2024-05-07T14:04:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8210000000000002e-06 2024-05-07T14:04:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:31.866 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.539843+0000", 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028341410000000001 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.539868+0000", 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4793000000000001e-05 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.539881+0000", 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3818000000000001e-05 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:31.867 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.539946+0000", 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5028000000000001e-05 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.540119+0000", 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017279 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.540269+0000", 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000149495 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:31.868 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.549460+0000", 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0091909569999999996 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.557486+0000", 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080261489999999998 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.557550+0000", 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3974999999999996e-05 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:31.869 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:31.870 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.557593+0000", 2024-05-07T14:04:31.870 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3439000000000002e-05 2024-05-07T14:04:31.870 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.870 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.870 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.870 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:31.870 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:31.870 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:31.872 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:04:31.872 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:31.882+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:31.973 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:31.983+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:32.074 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:32.086+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:32.101 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:32.101 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:32.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.101 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3918 3.5 e123/21 3:a2fd6bff:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_136:head v 123'16, mlcod=122'14)", 2024-05-07T14:04:32.101 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.107001+0000", 2024-05-07T14:04:32.101 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.0084637380000000002, 2024-05-07T14:04:32.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0084956389999999993, 2024-05-07T14:04:32.101 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.107001+0000", 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.107001+0000", 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.107002+0000", 2024-05-07T14:04:32.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3600000000000002e-07 2024-05-07T14:04:32.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.111093+0000", 2024-05-07T14:04:32.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040911350000000001 2024-05-07T14:04:32.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.111115+0000", 2024-05-07T14:04:32.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2147e-05 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.111127+0000", 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2052000000000001e-05 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.111208+0000", 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.1162000000000007e-05 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.111244+0000", 2024-05-07T14:04:32.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5531000000000003e-05 2024-05-07T14:04:32.105 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.105 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.105 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.105 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.105 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:04:32.105 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 1 2024-05-07T14:04:32.105 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:32.121 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:04:32.213 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:32.226+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:32.276 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:32.287+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:32.297 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:32.297 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:32.297 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:32.297 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:32.298 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:32.318 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:04:32.405 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:32.418+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:32.478 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:32.487+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:32.485 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-05-07T14:04:32.500 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:32.500 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 100.207751187, 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.501 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:04:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:04:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:04:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:04:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:04:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.503 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.504 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.505 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:04:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:04:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:04:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:04:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:04:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:04:32.506 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2203 3.1e 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 89.218034842999998, 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029129142, 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.507 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2203 2024-05-07T14:04:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294465+0000", 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7699999999999999e-06 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300328+0000", 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058633460000000002 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300384+0000", 2024-05-07T14:04:32.509 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6212999999999999e-05 2024-05-07T14:04:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300411+0000", 2024-05-07T14:04:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7109000000000001e-05 2024-05-07T14:04:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300586+0000", 2024-05-07T14:04:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017478799999999999 2024-05-07T14:04:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.510 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300941+0000", 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035515500000000001 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301351+0000", 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040996099999999997 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.317495+0000", 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016143462000000001 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323421+0000", 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059264649999999997 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323498+0000", 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6478999999999997e-05 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323590+0000", 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2393999999999997e-05 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.512 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2666 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 52.860671287000002, 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.125351252, 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.513 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2666 2024-05-07T14:04:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.514 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651827+0000", 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-06 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651834+0000", 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7700000000000001e-06 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651850+0000", 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5755000000000001e-05 2024-05-07T14:04:32.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651862+0000", 2024-05-07T14:04:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.237e-05 2024-05-07T14:04:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651967+0000", 2024-05-07T14:04:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010427199999999999 2024-05-07T14:04:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:32.516 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651977+0000", 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0743e-05 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657294+0000", 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053168069999999998 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657305+0000", 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0662000000000001e-05 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.517 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774211+0000", 2024-05-07T14:04:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1169060209999999 2024-05-07T14:04:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774394+0000", 2024-05-07T14:04:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018268000000000001 2024-05-07T14:04:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.777176+0000", 2024-05-07T14:04:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002782025 2024-05-07T14:04:32.518 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2673 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 52.316738100000002, 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57934507999999996, 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.519 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2673 2024-05-07T14:04:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9699999999999996e-07 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195761+0000", 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2569999999999999e-06 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195768+0000", 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.489e-06 2024-05-07T14:04:32.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195774+0000", 2024-05-07T14:04:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7389999999999996e-06 2024-05-07T14:04:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195866+0000", 2024-05-07T14:04:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2349000000000006e-05 2024-05-07T14:04:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:32.522 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195878+0000", 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1838000000000001e-05 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774802+0000", 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.578923945 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774906+0000", 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103991 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.523 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775103+0000", 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196975 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2684 3.24 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 48.726377188999997, 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.040396402999999997, 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.524 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2684 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.525 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786122+0000", 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0929999999999999e-06 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788626+0000", 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025042720000000001 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.526 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788659+0000", 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2824999999999998e-05 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788673+0000", 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4721e-05 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788768+0000", 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4178999999999994e-05 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788776+0000", 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2400000000000007e-06 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798002+0000", 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092262230000000004 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798163+0000", 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161077 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798305+0000", 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014162499999999999 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.807567+0000", 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092618869999999999 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826429+0000", 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018862824 2024-05-07T14:04:32.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826470+0000", 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1010999999999997e-05 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826515+0000", 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4425999999999998e-05 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2791 3.27 3:e46b1707:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_108:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 47.583242196999997, 2024-05-07T14:04:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022300529999999999, 2024-05-07T14:04:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2791 2024-05-07T14:04:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.531 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929254+0000", 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.929257+0000", 2024-05-07T14:04:32.532 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.281e-06 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931305+0000", 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020483020000000001 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931328+0000", 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2722e-05 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931341+0000", 2024-05-07T14:04:32.533 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3529e-05 2024-05-07T14:04:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931415+0000", 2024-05-07T14:04:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3597999999999996e-05 2024-05-07T14:04:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931614+0000", 2024-05-07T14:04:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019859000000000001 2024-05-07T14:04:32.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931758+0000", 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014481699999999999 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.939706+0000", 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.007948063 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951424+0000", 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011717708 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951500+0000", 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5831e-05 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.951554+0000", 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4088999999999997e-05 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2865 3.38 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:32.536 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.929870907999998, 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.035746371999999998, 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2865 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:32.537 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582627+0000", 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.538 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584611+0000", 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019836350000000001 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584636+0000", 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4943000000000002e-05 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584652+0000", 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5586e-05 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.539 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584733+0000", 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0987000000000002e-05 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584881+0000", 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014805800000000001 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584972+0000", 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1218999999999995e-05 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.540 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.591149+0000", 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061766939999999999 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618207+0000", 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027058260000000001 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618319+0000", 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011267700000000001 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.541 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618371+0000", 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1683e-05 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2883 3.29 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.734707270000001, 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025309511999999999, 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.542 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2883 2024-05-07T14:04:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.543 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777791+0000", 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.289e-06 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779027+0000", 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001236411 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779063+0000", 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5658999999999999e-05 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779076+0000", 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3128e-05 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779166+0000", 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9818e-05 2024-05-07T14:04:32.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779398+0000", 2024-05-07T14:04:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023189400000000001 2024-05-07T14:04:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779577+0000", 2024-05-07T14:04:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000179276 2024-05-07T14:04:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.546 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.786782+0000", 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072052740000000002 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.802960+0000", 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016177490999999999 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803047+0000", 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6912999999999999e-05 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.547 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803098+0000", 2024-05-07T14:04:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1359000000000001e-05 2024-05-07T14:04:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2905 3.1e 3:78954da1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 46.461299031000003, 2024-05-07T14:04:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028568698, 2024-05-07T14:04:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.548 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2905 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.549 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051199+0000", 2024-05-07T14:04:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5299999999999999e-06 2024-05-07T14:04:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055400+0000", 2024-05-07T14:04:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042009889999999996 2024-05-07T14:04:32.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055458+0000", 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.736e-05 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055486+0000", 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8914000000000001e-05 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055574+0000", 2024-05-07T14:04:32.551 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7120999999999995e-05 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055726+0000", 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015249600000000001 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055884+0000", 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015788900000000001 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.064235+0000", 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008350583 2024-05-07T14:04:32.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078705+0000", 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014470129999999999 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078900+0000", 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019521799999999999 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.079765+0000", 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00086546799999999999 2024-05-07T14:04:32.553 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3240 3.33 3:cd111f2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.788271+0000", 2024-05-07T14:04:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.724224221, 2024-05-07T14:04:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026491491999999998, 2024-05-07T14:04:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.554 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3240 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.788271+0000", 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.788271+0000", 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.788275+0000", 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2399999999999999e-06 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791613+0000", 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033385329999999999 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791645+0000", 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1602e-05 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791659+0000", 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4596999999999999e-05 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791766+0000", 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106043 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791961+0000", 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019581399999999999 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.557 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.792139+0000", 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017790899999999999 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.804241+0000", 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012101519999999999 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.814683+0000", 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010442158999999999 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.814728+0000", 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5456e-05 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.814763+0000", 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4619000000000002e-05 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.559 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3248 3.33 3:cd0a349a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.881531+0000", 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.630965028999999, 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022568742999999999, 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3248 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.560 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.881531+0000", 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.881531+0000", 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.881532+0000", 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.7430000000000001e-06 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883223+0000", 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001690799 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883253+0000", 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9365000000000001e-05 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883265+0000", 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2267e-05 2024-05-07T14:04:32.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883342+0000", 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7200999999999995e-05 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883469+0000", 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012662099999999999 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.883608+0000", 2024-05-07T14:04:32.563 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000139493 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.889589+0000", 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059812320000000004 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.903960+0000", 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014370186 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.564 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904062+0000", 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102056 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904099+0000", 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7780000000000001e-05 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3277 3.b 3:d1f9c1c7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.317440+0000", 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.195056081000001, 2024-05-07T14:04:32.565 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025103065000000001, 2024-05-07T14:04:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3277 2024-05-07T14:04:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.317440+0000", 2024-05-07T14:04:32.566 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.317440+0000", 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.317443+0000", 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2969999999999999e-06 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.567 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320371+0000", 2024-05-07T14:04:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029279280000000002 2024-05-07T14:04:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320424+0000", 2024-05-07T14:04:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2972e-05 2024-05-07T14:04:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320451+0000", 2024-05-07T14:04:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7056e-05 2024-05-07T14:04:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320604+0000", 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152688 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320950+0000", 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00034685400000000001 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.321362+0000", 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041191300000000003 2024-05-07T14:04:32.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.340027+0000", 2024-05-07T14:04:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018665010999999999 2024-05-07T14:04:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342301+0000", 2024-05-07T14:04:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022736750000000002 2024-05-07T14:04:32.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342433+0000", 2024-05-07T14:04:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000131712 2024-05-07T14:04:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342543+0000", 2024-05-07T14:04:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000109959 2024-05-07T14:04:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3288 3.7 3:e3df0df9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.487335+0000", 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 24.025160378999999, 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022910593999999999, 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3288 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.572 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.487335+0000", 2024-05-07T14:04:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.487335+0000", 2024-05-07T14:04:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.573 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.487339+0000", 2024-05-07T14:04:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1139999999999999e-06 2024-05-07T14:04:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490002+0000", 2024-05-07T14:04:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026621510000000002 2024-05-07T14:04:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490040+0000", 2024-05-07T14:04:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8575000000000003e-05 2024-05-07T14:04:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490058+0000", 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490206+0000", 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014781899999999999 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490531+0000", 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032532500000000001 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490865+0000", 2024-05-07T14:04:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000333319 2024-05-07T14:04:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.501257+0000", 2024-05-07T14:04:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010392083 2024-05-07T14:04:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.509955+0000", 2024-05-07T14:04:32.576 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086984690000000003 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.510124+0000", 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016896700000000001 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.510246+0000", 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121694 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.578 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3319 3.33 3:cda0bc3e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:32.578 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.050548+0000", 2024-05-07T14:04:32.578 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.461948030999999, 2024-05-07T14:04:32.578 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022485041000000001, 2024-05-07T14:04:32.578 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.578 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.578 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.578 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.578 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.578 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.578 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3319 2024-05-07T14:04:32.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.578 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.050548+0000", 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.050548+0000", 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.050552+0000", 2024-05-07T14:04:32.579 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3669999999999999e-06 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054164+0000", 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0036120660000000001 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054218+0000", 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3507000000000001e-05 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054245+0000", 2024-05-07T14:04:32.580 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7002e-05 2024-05-07T14:04:32.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054387+0000", 2024-05-07T14:04:32.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000142306 2024-05-07T14:04:32.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.581 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054620+0000", 2024-05-07T14:04:32.581 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023293700000000001 2024-05-07T14:04:32.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.581 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:32.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.054829+0000", 2024-05-07T14:04:32.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020874500000000001 2024-05-07T14:04:32.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.062575+0000", 2024-05-07T14:04:32.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0077465930000000004 2024-05-07T14:04:32.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.582 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.582 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.072708+0000", 2024-05-07T14:04:32.582 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010132482999999999 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.072898+0000", 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018985700000000001 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.073033+0000", 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013517800000000001 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3866 3.5 e122/21 3:a35b7c92:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_84:head v 122'14, mlcod=115'12)", 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:31.521817+0000", 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.99067841700000003, 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022251673999999999, 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.521817+0000", 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.521817+0000", 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.521819+0000", 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.646e-06 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.525681+0000", 2024-05-07T14:04:32.585 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0038622740000000002 2024-05-07T14:04:32.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.525708+0000", 2024-05-07T14:04:32.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6554999999999999e-05 2024-05-07T14:04:32.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.586 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.525719+0000", 2024-05-07T14:04:32.586 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1371e-05 2024-05-07T14:04:32.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.586 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.525795+0000", 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5389000000000006e-05 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.525842+0000", 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7293999999999998e-05 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.544010+0000", 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018168515 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.544069+0000", 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8629999999999999e-05 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3913 3.8 3:1097d8db:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.035868+0000", 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.476628151, 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027605465999999999, 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.588 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.589 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.589 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.589 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.589 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.589 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3913 2024-05-07T14:04:32.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.589 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.589 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.589 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.035868+0000", 2024-05-07T14:04:32.589 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.035868+0000", 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.035870+0000", 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0439999999999998e-06 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.038072+0000", 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022028070000000002 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.038126+0000", 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3127999999999997e-05 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.038142+0000", 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6915999999999999e-05 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.038223+0000", 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0641000000000003e-05 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.038386+0000", 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000163194 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.038501+0000", 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000114806 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.058998+0000", 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020496978999999999 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.063366+0000", 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043684259999999999 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.063430+0000", 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3396000000000001e-05 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.063473+0000", 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3129e-05 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.593 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3923 3.1e 3:78b90cbf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.155280+0000", 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.35721605400000001, 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029486865000000001, 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.594 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3923 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.155280+0000", 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.155280+0000", 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.595 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.155282+0000", 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2639999999999998e-06 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.156901+0000", 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016192260000000001 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.156915+0000", 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4168999999999999e-05 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.596 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.156926+0000", 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0755e-05 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.157001+0000", 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4443999999999994e-05 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.157207+0000", 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206954 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.597 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.157328+0000", 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120171 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.162796+0000", 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054688510000000003 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.184646+0000", 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021849095999999998 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.184701+0000", 2024-05-07T14:04:32.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5498999999999998e-05 2024-05-07T14:04:32.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.599 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.599 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.184767+0000", 2024-05-07T14:04:32.599 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5436000000000002e-05 2024-05-07T14:04:32.599 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.599 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.599 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3928 3.1e 3:7b4ff8f9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.204919+0000", 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.30757692599999997, 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023374621000000002, 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3928 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.204919+0000", 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.204919+0000", 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.204922+0000", 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.411e-06 2024-05-07T14:04:32.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.207240+0000", 2024-05-07T14:04:32.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023177889999999998 2024-05-07T14:04:32.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.207266+0000", 2024-05-07T14:04:32.602 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5948e-05 2024-05-07T14:04:32.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.602 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.602 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.207276+0000", 2024-05-07T14:04:32.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7149999999999993e-06 2024-05-07T14:04:32.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.207379+0000", 2024-05-07T14:04:32.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103627 2024-05-07T14:04:32.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.603 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.603 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.207602+0000", 2024-05-07T14:04:32.603 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022313699999999999 2024-05-07T14:04:32.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:32.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.207782+0000", 2024-05-07T14:04:32.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017995399999999999 2024-05-07T14:04:32.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.216125+0000", 2024-05-07T14:04:32.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0083425649999999997 2024-05-07T14:04:32.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.604 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.604 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.228209+0000", 2024-05-07T14:04:32.604 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012084007000000001 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.228257+0000", 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8035999999999999e-05 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.228293+0000", 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6431999999999999e-05 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3939 3.27 3:e4a6764e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.330432+0000", 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.18206351900000001, 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029885104999999999, 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3939 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.330432+0000", 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.330432+0000", 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.330434+0000", 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.154e-06 2024-05-07T14:04:32.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.332096+0000", 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016616179999999999 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.332122+0000", 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6435e-05 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.332138+0000", 2024-05-07T14:04:32.608 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5554e-05 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.332239+0000", 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101056 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.332387+0000", 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014808099999999999 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:32.609 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.332491+0000", 2024-05-07T14:04:32.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000104394 2024-05-07T14:04:32.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.338170+0000", 2024-05-07T14:04:32.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056784410000000002 2024-05-07T14:04:32.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.610 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.610 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.360226+0000", 2024-05-07T14:04:32.610 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022055603999999999 2024-05-07T14:04:32.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.360267+0000", 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1724000000000002e-05 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.360317+0000", 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0043999999999997e-05 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.611 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3943 3.1e 3:7846badd:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.367330+0000", 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.145165405, 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023406542999999998, 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3943 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.612 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.367330+0000", 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.367330+0000", 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.367333+0000", 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0299999999999998e-06 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.613 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:32.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.368732+0000", 2024-05-07T14:04:32.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001398968 2024-05-07T14:04:32.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:32.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.368759+0000", 2024-05-07T14:04:32.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7118999999999999e-05 2024-05-07T14:04:32.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.614 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:32.614 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.368774+0000", 2024-05-07T14:04:32.614 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4219999999999999e-05 2024-05-07T14:04:32.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.368851+0000", 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7818999999999995e-05 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.368985+0000", 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013384099999999999 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.369093+0000", 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107377 2024-05-07T14:04:32.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.374035+0000", 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049426449999999999 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.390586+0000", 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016550907 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.390657+0000", 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0981000000000004e-05 2024-05-07T14:04:32.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:32.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:32.617 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:32.617 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.390737+0000", 2024-05-07T14:04:32.617 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9635999999999994e-05 2024-05-07T14:04:32.617 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.617 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.617 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.617 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:32.617 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:32.617 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:32.619 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:04:32.619 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:32.627+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:32.662 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:32.662 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:32.683 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:32.683 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:32.703 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:32.704 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:32.719 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:32.730+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:32.724 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:32.725 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:32.748 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:32.749 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:32.767 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:32.767 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:32.770 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:32.770 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:32.784 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:04:32.794 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:32.794 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:32.794 INFO:teuthology.orchestra.run.smithi106.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-05-07T14:04:32.800 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T14:04:32.800 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T14:04:32.832 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:32.843+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:32.919 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:32.919 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:32.921 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:32.934+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:32.937 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:04:33.021 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:33.034+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:33.112 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:33.112 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:33.122 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:33.134+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:33.131 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:04:33.223 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:33.235+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:33.262 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:33.262 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:33.278 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:04:33.324 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:33.338+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:33.425 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:33.438+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:33.448 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:33.449 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:33.468 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:04:33.526 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:33.538+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:33.571 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:04:33.598 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:33.598 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:33.615 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:04:33.664 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:33.675+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:33.728 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:33.738+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:33.750 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:33.751 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:33.765 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:04:33.852 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:33.863+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:33.930 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:33.939+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:33.947 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:33.948 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:33.966 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:04:34.056 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:34.067+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:34.131 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:34.142+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:34.149 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:34.149 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:34.166 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-05-07T14:04:34.232 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:34.242+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:34.308 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:34.308 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:34.323 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-05-07T14:04:34.364 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:34.378+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:34.433 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:34.443+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:34.503 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:34.504 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:34.522 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-05-07T14:04:34.539 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:04:34.542 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:34.554+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:34.636 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:34.643+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:34.672 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:34.672 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:34.693 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-05-07T14:04:34.737 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:34.747+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:34.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-05-07T14:04:34.828 INFO:teuthology.orchestra.run.smithi106.stdout:ERROR: (22) Invalid argument 2024-05-07T14:04:34.828 INFO:teuthology.orchestra.run.smithi106.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-05-07T14:04:34.837 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:34.847+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:34.847 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-05-07T14:04:34.938 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:34.950+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:34.977 INFO:teuthology.orchestra.run.smithi106.stdout:osd.0: {} 2024-05-07T14:04:34.978 INFO:teuthology.orchestra.run.smithi106.stderr:osd.0: osd_enable_op_tracker = '' 2024-05-07T14:04:34.999 INFO:teuthology.orchestra.run.smithi106.stdout:osd.1: {} 2024-05-07T14:04:34.999 INFO:teuthology.orchestra.run.smithi106.stderr:osd.1: osd_enable_op_tracker = '' 2024-05-07T14:04:35.019 INFO:teuthology.orchestra.run.smithi106.stdout:osd.2: {} 2024-05-07T14:04:35.019 INFO:teuthology.orchestra.run.smithi106.stderr:osd.2: osd_enable_op_tracker = '' 2024-05-07T14:04:35.039 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:35.050+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:35.052 INFO:teuthology.orchestra.run.smithi106.stdout:osd.3: {} 2024-05-07T14:04:35.052 INFO:teuthology.orchestra.run.smithi106.stderr:osd.3: osd_enable_op_tracker = '' 2024-05-07T14:04:35.066 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:35.066 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:35.066 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:35.066 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:35.066 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:35.086 INFO:teuthology.orchestra.run.smithi106.stdout:osd.4: {} 2024-05-07T14:04:35.086 INFO:teuthology.orchestra.run.smithi106.stderr:osd.4: osd_enable_op_tracker = '' 2024-05-07T14:04:35.091 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-05-07T14:04:35.113 INFO:teuthology.orchestra.run.smithi106.stdout:osd.5: {} 2024-05-07T14:04:35.113 INFO:teuthology.orchestra.run.smithi106.stderr:osd.5: osd_enable_op_tracker = '' 2024-05-07T14:04:35.139 INFO:teuthology.orchestra.run.smithi106.stdout:osd.6: {} 2024-05-07T14:04:35.139 INFO:teuthology.orchestra.run.smithi106.stderr:osd.6: osd_enable_op_tracker = '' 2024-05-07T14:04:35.140 INFO:teuthology.orchestra.run.smithi106.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-05-07T14:04:35.142 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:35.154+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:35.144 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-07T14:04:35.144 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-05-07T14:04:35.242 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:35.251+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:35.253 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2202 3.0 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:04:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.985698244000005, 2024-05-07T14:04:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027191908000000001, 2024-05-07T14:04:35.253 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2202 2024-05-07T14:04:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:04:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279970+0000", 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.279975+0000", 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0130000000000001e-06 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285489+0000", 2024-05-07T14:04:35.255 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0055143570000000001 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285531+0000", 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1504000000000001e-05 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285550+0000", 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9256e-05 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.256 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.285747+0000", 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196777 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286120+0000", 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00037285900000000002 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286489+0000", 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036951099999999999 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.257 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301589+0000", 2024-05-07T14:04:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015099728999999999 2024-05-07T14:04:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307085+0000", 2024-05-07T14:04:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054963340000000003 2024-05-07T14:04:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307127+0000", 2024-05-07T14:04:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1977999999999997e-05 2024-05-07T14:04:35.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.307162+0000", 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4589999999999999e-05 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2217 3.0 3:03bc95d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.775371676000006, 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019983529, 2024-05-07T14:04:35.259 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2217 2024-05-07T14:04:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:04:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490297+0000", 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.490299+0000", 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-06 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492337+0000", 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020384489999999999 2024-05-07T14:04:35.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492391+0000", 2024-05-07T14:04:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3702000000000002e-05 2024-05-07T14:04:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492415+0000", 2024-05-07T14:04:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3373000000000001e-05 2024-05-07T14:04:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.262 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492567+0000", 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152788 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.492843+0000", 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00027568999999999998 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.493123+0000", 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00028014899999999999 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.263 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.509840+0000", 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016716871000000001 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510203+0000", 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00036252499999999999 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510250+0000", 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7231000000000002e-05 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.264 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.510280+0000", 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0270999999999999e-05 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2224 3.1a e84/21 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head v 84'2, mlcod=0'0)", 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 91.670428009000005, 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020623257999999998, 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.265 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595240+0000", 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.266 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.595243+0000", 2024-05-07T14:04:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6800000000000002e-06 2024-05-07T14:04:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.601988+0000", 2024-05-07T14:04:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0067452479999999997 2024-05-07T14:04:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602044+0000", 2024-05-07T14:04:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5884999999999998e-05 2024-05-07T14:04:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602070+0000", 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6359999999999998e-05 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602183+0000", 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112761 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.602210+0000", 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6882000000000001e-05 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615811+0000", 2024-05-07T14:04:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01360132 2024-05-07T14:04:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.615863+0000", 2024-05-07T14:04:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2122e-05 2024-05-07T14:04:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2704 3.31 3:8c38a608:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 51.266705639999998, 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.024434902000000001, 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2704 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:04:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998963+0000", 2024-05-07T14:04:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.998965+0000", 2024-05-07T14:04:35.271 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6809999999999998e-06 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000686+0000", 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00172109 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000705+0000", 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8879999999999999e-05 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.272 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000718+0000", 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2846e-05 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000794+0000", 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5613999999999998e-05 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.000919+0000", 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000124924 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.273 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.001034+0000", 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000115158 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.007009+0000", 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059753009999999997 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023250+0000", 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016240477 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023343+0000", 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3362000000000005e-05 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.023397+0000", 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4568999999999999e-05 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.275 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2803 3.4 3:2246d6f5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.211914301, 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021000333999999999, 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2803 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.276 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053754+0000", 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.053757+0000", 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1049999999999999e-06 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.278 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.278 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056166+0000", 2024-05-07T14:04:35.278 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002409039 2024-05-07T14:04:35.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.278 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.278 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056189+0000", 2024-05-07T14:04:35.278 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2595e-05 2024-05-07T14:04:35.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.278 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.278 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056200+0000", 2024-05-07T14:04:35.278 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1212999999999999e-05 2024-05-07T14:04:35.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.279 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.279 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056274+0000", 2024-05-07T14:04:35.279 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4086999999999997e-05 2024-05-07T14:04:35.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.279 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.279 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056414+0000", 2024-05-07T14:04:35.279 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000139763 2024-05-07T14:04:35.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.280 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:35.280 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.056555+0000", 2024-05-07T14:04:35.280 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014123900000000001 2024-05-07T14:04:35.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.280 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.280 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.071326+0000", 2024-05-07T14:04:35.280 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014771151999999999 2024-05-07T14:04:35.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.280 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.280 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074566+0000", 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032398570000000001 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074699+0000", 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013297800000000001 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.074754+0000", 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5306000000000002e-05 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.281 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2832 3.1a e105/21 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head v 105'9, mlcod=85'7)", 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.011450801000002, 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023326739999999999, 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:04:35.282 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.283 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.283 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254217+0000", 2024-05-07T14:04:35.283 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.283 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.283 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.254219+0000", 2024-05-07T14:04:35.283 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0059999999999999e-06 2024-05-07T14:04:35.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.283 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260033+0000", 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058134010000000002 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260063+0000", 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9762000000000001e-05 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260085+0000", 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2157000000000001e-05 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260165+0000", 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9909999999999999e-05 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.260195+0000", 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9935000000000001e-05 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277464+0000", 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017269805999999999 2024-05-07T14:04:35.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.277544+0000", 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9763000000000002e-05 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2860 3.3e 3:7cdd96b9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 49.737244079, 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019237982000000001, 2024-05-07T14:04:35.286 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2860 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528424+0000", 2024-05-07T14:04:35.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.528427+0000", 2024-05-07T14:04:35.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5739999999999998e-06 2024-05-07T14:04:35.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.288 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.288 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530685+0000", 2024-05-07T14:04:35.288 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022580009999999999 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530713+0000", 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8552e-05 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530727+0000", 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4054e-05 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530808+0000", 2024-05-07T14:04:35.289 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0741999999999994e-05 2024-05-07T14:04:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.530954+0000", 2024-05-07T14:04:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000145494 2024-05-07T14:04:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.531051+0000", 2024-05-07T14:04:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7349999999999995e-05 2024-05-07T14:04:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.543007+0000", 2024-05-07T14:04:35.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011955873000000001 2024-05-07T14:04:35.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547544+0000", 2024-05-07T14:04:35.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004537091 2024-05-07T14:04:35.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.291 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.291 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547610+0000", 2024-05-07T14:04:35.291 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5722000000000005e-05 2024-05-07T14:04:35.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.547662+0000", 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2528999999999998e-05 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2880 3.19 3:989dc271:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 49.524532266999998, 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018463578000000001, 2024-05-07T14:04:35.292 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2880 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741136+0000", 2024-05-07T14:04:35.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.741138+0000", 2024-05-07T14:04:35.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2510000000000001e-06 2024-05-07T14:04:35.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.294 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.294 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742746+0000", 2024-05-07T14:04:35.294 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001608195 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742776+0000", 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.9335999999999998e-05 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742789+0000", 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3059e-05 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.295 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.742879+0000", 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.0073000000000003e-05 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.743010+0000", 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013067999999999999 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.743127+0000", 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000117606 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.296 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.752872+0000", 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0097450880000000007 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759514+0000", 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0066419900000000004 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759554+0000", 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0070000000000001e-05 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.298 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.298 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.759600+0000", 2024-05-07T14:04:35.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5229999999999999e-05 2024-05-07T14:04:35.298 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.298 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.298 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.298 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3190 3.1a e113/21 3:59666d5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_82:head v 113'16, mlcod=113'14)", 2024-05-07T14:04:35.298 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.268091+0000", 2024-05-07T14:04:35.298 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.997576792, 2024-05-07T14:04:35.298 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018489769, 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.268091+0000", 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.268091+0000", 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.268094+0000", 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1110000000000002e-06 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272518+0000", 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0044240620000000003 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272549+0000", 2024-05-07T14:04:35.300 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1881999999999997e-05 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272563+0000", 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3943e-05 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272640+0000", 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6468e-05 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.301 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.272660+0000", 2024-05-07T14:04:35.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9945999999999998e-05 2024-05-07T14:04:35.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.286524+0000", 2024-05-07T14:04:35.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013864227999999999 2024-05-07T14:04:35.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.302 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.302 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.286581+0000", 2024-05-07T14:04:35.302 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7129000000000001e-05 2024-05-07T14:04:35.302 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.302 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3205 3.31 3:8edf8d67:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_97:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.413707+0000", 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.851961195000001, 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020052646, 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.303 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3205 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.413707+0000", 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.413707+0000", 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.304 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.413709+0000", 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.458e-06 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415525+0000", 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001815421 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415551+0000", 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.618e-05 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415566+0000", 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5356e-05 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415658+0000", 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1460999999999997e-05 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.415844+0000", 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000186329 2024-05-07T14:04:35.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.416021+0000", 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017681700000000001 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.426085+0000", 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010063880000000001 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.433647+0000", 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0075620460000000002 2024-05-07T14:04:35.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.433715+0000", 2024-05-07T14:04:35.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8239999999999997e-05 2024-05-07T14:04:35.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.308 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.308 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.433760+0000", 2024-05-07T14:04:35.308 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4458e-05 2024-05-07T14:04:35.308 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.308 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.308 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3272 3.0 3:00176f47:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.212328+0000", 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.053340587000001, 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020854049, 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3272 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.212328+0000", 2024-05-07T14:04:35.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.212328+0000", 2024-05-07T14:04:35.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.310 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.310 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.212332+0000", 2024-05-07T14:04:35.310 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0999999999999997e-06 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214290+0000", 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001958647 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214325+0000", 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4993999999999997e-05 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.311 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214348+0000", 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2402999999999999e-05 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214476+0000", 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00012784600000000001 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214718+0000", 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00024232499999999999 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:35.312 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.214960+0000", 2024-05-07T14:04:35.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000241933 2024-05-07T14:04:35.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.232983+0000", 2024-05-07T14:04:35.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018023127 2024-05-07T14:04:35.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.313 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.313 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.233043+0000", 2024-05-07T14:04:35.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0226000000000002e-05 2024-05-07T14:04:35.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.233121+0000", 2024-05-07T14:04:35.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7751999999999997e-05 2024-05-07T14:04:35.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.233182+0000", 2024-05-07T14:04:35.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0696000000000003e-05 2024-05-07T14:04:35.314 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.314 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.314 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3318 3.3e 3:7ccfcb84:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_210:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.031876+0000", 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.233791793999998, 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.02503468, 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3318 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.031876+0000", 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.031876+0000", 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.031879+0000", 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4600000000000002e-06 2024-05-07T14:04:35.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.034903+0000", 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0030236730000000002 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.034950+0000", 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7922e-05 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.034975+0000", 2024-05-07T14:04:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.48e-05 2024-05-07T14:04:35.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035105+0000", 2024-05-07T14:04:35.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000129901 2024-05-07T14:04:35.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035338+0000", 2024-05-07T14:04:35.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023303000000000001 2024-05-07T14:04:35.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.318 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.035526+0000", 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018805100000000001 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.047239+0000", 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011713072 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.056528+0000", 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092883140000000006 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.056759+0000", 2024-05-07T14:04:35.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023124300000000001 2024-05-07T14:04:35.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.056911+0000", 2024-05-07T14:04:35.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015221399999999999 2024-05-07T14:04:35.320 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.320 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.320 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.321 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3325 3.19 3:9a914b7d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:35.321 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:09.188566+0000", 2024-05-07T14:04:35.321 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 26.077102557, 2024-05-07T14:04:35.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023664281999999998, 2024-05-07T14:04:35.321 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.321 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.321 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.321 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.321 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.321 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.321 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3325 2024-05-07T14:04:35.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.321 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.188566+0000", 2024-05-07T14:04:35.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.188566+0000", 2024-05-07T14:04:35.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.188569+0000", 2024-05-07T14:04:35.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4680000000000001e-06 2024-05-07T14:04:35.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.192695+0000", 2024-05-07T14:04:35.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.004125933 2024-05-07T14:04:35.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.192736+0000", 2024-05-07T14:04:35.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1196000000000003e-05 2024-05-07T14:04:35.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.192755+0000", 2024-05-07T14:04:35.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8257000000000002e-05 2024-05-07T14:04:35.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.192921+0000", 2024-05-07T14:04:35.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016651400000000001 2024-05-07T14:04:35.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.193267+0000", 2024-05-07T14:04:35.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000346289 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.193536+0000", 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00026907899999999998 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.203492+0000", 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0099560800000000008 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.211923+0000", 2024-05-07T14:04:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0084306810000000006 2024-05-07T14:04:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.212134+0000", 2024-05-07T14:04:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00021085 2024-05-07T14:04:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:09.212230+0000", 2024-05-07T14:04:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5934999999999995e-05 2024-05-07T14:04:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.326 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3791 3.3e 3:7c4972ca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:30.736519+0000", 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.5291489699999996, 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019341526000000001, 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.327 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3791 2024-05-07T14:04:35.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.328 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.736519+0000", 2024-05-07T14:04:35.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.328 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.328 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.736519+0000", 2024-05-07T14:04:35.328 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.736522+0000", 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.072e-06 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.738809+0000", 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002286265 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.738842+0000", 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3553000000000002e-05 2024-05-07T14:04:35.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.738857+0000", 2024-05-07T14:04:35.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5106000000000001e-05 2024-05-07T14:04:35.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.738945+0000", 2024-05-07T14:04:35.330 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7299999999999994e-05 2024-05-07T14:04:35.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.330 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.330 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.739078+0000", 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000133948 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.739242+0000", 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016338100000000001 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.751510+0000", 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012268055 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.331 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.755732+0000", 2024-05-07T14:04:35.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042221660000000003 2024-05-07T14:04:35.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.755801+0000", 2024-05-07T14:04:35.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8677999999999995e-05 2024-05-07T14:04:35.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.332 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.332 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.755861+0000", 2024-05-07T14:04:35.332 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0001999999999999e-05 2024-05-07T14:04:35.332 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3793 3.4 3:21e6e332:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:30.757536+0000", 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.5081321670000003, 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019316313000000002, 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3793 2024-05-07T14:04:35.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.334 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.757536+0000", 2024-05-07T14:04:35.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.334 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.757536+0000", 2024-05-07T14:04:35.334 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.334 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.757538+0000", 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3590000000000002e-06 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.759562+0000", 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002024063 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.759589+0000", 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6342e-05 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.759602+0000", 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3106e-05 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.759694+0000", 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2499999999999999e-05 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.759901+0000", 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020608000000000001 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.760082+0000", 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018143200000000001 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.776366+0000", 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016284284 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.776581+0000", 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000215226 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.337 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.776791+0000", 2024-05-07T14:04:35.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00020968899999999999 2024-05-07T14:04:35.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.338 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.338 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.776852+0000", 2024-05-07T14:04:35.338 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1231999999999999e-05 2024-05-07T14:04:35.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.338 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.338 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3805 3.4 3:2245806e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:30.883916+0000", 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.38175208, 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027647418999999999, 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3805 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.883916+0000", 2024-05-07T14:04:35.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.883916+0000", 2024-05-07T14:04:35.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.340 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.340 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.883919+0000", 2024-05-07T14:04:35.340 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.717e-06 2024-05-07T14:04:35.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.885838+0000", 2024-05-07T14:04:35.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019192199999999999 2024-05-07T14:04:35.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.885859+0000", 2024-05-07T14:04:35.341 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0579999999999999e-05 2024-05-07T14:04:35.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.341 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.341 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.885870+0000", 2024-05-07T14:04:35.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1019000000000001e-05 2024-05-07T14:04:35.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.885953+0000", 2024-05-07T14:04:35.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3758999999999995e-05 2024-05-07T14:04:35.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.342 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.342 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.886144+0000", 2024-05-07T14:04:35.342 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000190473 2024-05-07T14:04:35.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:35.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.886303+0000", 2024-05-07T14:04:35.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015875899999999999 2024-05-07T14:04:35.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.908501+0000", 2024-05-07T14:04:35.343 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022198388999999999 2024-05-07T14:04:35.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.343 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.343 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.911445+0000", 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00294363 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.911516+0000", 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1038000000000007e-05 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.911564+0000", 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7834999999999999e-05 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3885 3.31 3:8e65a48e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:31.737012+0000", 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.5286566420000001, 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018649947, 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3885 2024-05-07T14:04:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.737012+0000", 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.737012+0000", 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.346 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.737014+0000", 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.791e-06 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.739155+0000", 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021401359999999999 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.739172+0000", 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.753e-05 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.347 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.739181+0000", 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.448e-06 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.739256+0000", 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4232000000000003e-05 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.739423+0000", 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016684600000000001 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:35.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.739586+0000", 2024-05-07T14:04:35.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016302499999999999 2024-05-07T14:04:35.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.745734+0000", 2024-05-07T14:04:35.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061483570000000001 2024-05-07T14:04:35.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.349 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.349 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.755578+0000", 2024-05-07T14:04:35.349 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0098443839999999994 2024-05-07T14:04:35.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.755621+0000", 2024-05-07T14:04:35.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.303e-05 2024-05-07T14:04:35.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.350 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.350 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.755662+0000", 2024-05-07T14:04:35.350 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.0167999999999999e-05 2024-05-07T14:04:35.350 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.350 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.350 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3893 3.3e 3:7d9008d4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_111:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:31.822275+0000", 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.443393097, 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.019655379000000001, 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3893 2024-05-07T14:04:35.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.822275+0000", 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.822275+0000", 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.352 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.822278+0000", 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4059999999999999e-06 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.823892+0000", 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001614423 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.823921+0000", 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8634000000000001e-05 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.353 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.823935+0000", 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4806e-05 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.824006+0000", 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1097e-05 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.824147+0000", 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000140944 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.824264+0000", 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116742 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.840339+0000", 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016074713000000001 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.841812+0000", 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014727099999999999 2024-05-07T14:04:35.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.841880+0000", 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8095000000000004e-05 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.841931+0000", 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0809000000000001e-05 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3913 3.8 e123/99 3:1097d8db:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_131:head v 123'19, mlcod=115'17)", 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.039868+0000", 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.2257999489999998, 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018967263000000002, 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.039868+0000", 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.039868+0000", 2024-05-07T14:04:35.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.039870+0000", 2024-05-07T14:04:35.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.666e-06 2024-05-07T14:04:35.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.358 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.358 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.041282+0000", 2024-05-07T14:04:35.358 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014121050000000001 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.041306+0000", 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4426e-05 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.041320+0000", 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3886999999999999e-05 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.359 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.041459+0000", 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013820400000000001 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.041486+0000", 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7410999999999999e-05 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.058760+0000", 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017273786999999999 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.360 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.058836+0000", 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5777000000000003e-05 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3938 3.31 3:8cd7e74d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.322202+0000", 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 2.9434659079999999, 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.02381873, 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:35.361 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3938 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.322202+0000", 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:35.362 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.322202+0000", 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.322204+0000", 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1720000000000001e-06 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.324457+0000", 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022520970000000002 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.363 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.324491+0000", 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4644000000000002e-05 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.324507+0000", 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5736999999999999e-05 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.324587+0000", 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0109000000000002e-05 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.324701+0000", 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011348 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.324796+0000", 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.5198000000000006e-05 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.330946+0000", 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061505309999999999 2024-05-07T14:04:35.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:35.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.345937+0000", 2024-05-07T14:04:35.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014991193 2024-05-07T14:04:35.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:35.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.345981+0000", 2024-05-07T14:04:35.366 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3699000000000003e-05 2024-05-07T14:04:35.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:35.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:35.366 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:35.366 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.346021+0000", 2024-05-07T14:04:35.367 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9870000000000003e-05 2024-05-07T14:04:35.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.367 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:35.367 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:35.367 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:35.368 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-05-07T14:04:35.370 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:35.379+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:35.469 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-05-07T14:04:35.482+0000 7f347c67f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25254) UID: 0 2024-05-07T14:04:35.544 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:35.544 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:35.544 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 0 2024-05-07T14:04:35.544 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:35.567 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-05-07T14:04:35.609 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:35.622+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:35.670 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:35.682+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:35.771 INFO:tasks.ceph.osd.3.smithi106.stderr:2024-05-07T14:04:35.782+0000 7f7397b7b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25253) UID: 0 2024-05-07T14:04:35.805 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:35.806 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:35.806 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:35.825 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-05-07T14:04:35.913 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:35.926+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:35.973 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:35.986+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:36.011 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:36.011 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:36.012 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:36.012 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:36.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.012 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2202 3.0 e84/21 3:0391d3a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_1:head v 84'1, mlcod=0'0)", 2024-05-07T14:04:36.012 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:04:36.012 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 92.736815230000005, 2024-05-07T14:04:36.013 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020120560999999999, 2024-05-07T14:04:36.013 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.013 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.013 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.013 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.014 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.014 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:04:36.014 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.015 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286673+0000", 2024-05-07T14:04:36.015 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.015 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.016 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.286676+0000", 2024-05-07T14:04:36.016 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.57e-06 2024-05-07T14:04:36.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.017 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.017 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291894+0000", 2024-05-07T14:04:36.017 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0052185740000000001 2024-05-07T14:04:36.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.018 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291939+0000", 2024-05-07T14:04:36.018 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4676999999999999e-05 2024-05-07T14:04:36.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.018 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.291959+0000", 2024-05-07T14:04:36.019 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0115999999999998e-05 2024-05-07T14:04:36.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.019 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.019 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292128+0000", 2024-05-07T14:04:36.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168758 2024-05-07T14:04:36.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.020 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.020 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.292188+0000", 2024-05-07T14:04:36.020 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0565e-05 2024-05-07T14:04:36.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.021 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.021 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306607+0000", 2024-05-07T14:04:36.021 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014418733 2024-05-07T14:04:36.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.022 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.022 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.306794+0000", 2024-05-07T14:04:36.022 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018656799999999999 2024-05-07T14:04:36.022 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.022 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.022 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.023 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2687 3.2 3:43af9208:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:36.023 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:04:36.023 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 52.204947163, 2024-05-07T14:04:36.024 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037068531000000002, 2024-05-07T14:04:36.024 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.024 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.024 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.024 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.024 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.024 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.025 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2687 2024-05-07T14:04:36.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.025 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.025 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.025 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:04:36.025 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.026 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.026 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818541+0000", 2024-05-07T14:04:36.026 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.818544+0000", 2024-05-07T14:04:36.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3390000000000001e-06 2024-05-07T14:04:36.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821166+0000", 2024-05-07T14:04:36.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026214250000000001 2024-05-07T14:04:36.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.027 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.027 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821192+0000", 2024-05-07T14:04:36.027 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5641999999999999e-05 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821203+0000", 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1558e-05 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821280+0000", 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7237000000000006e-05 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:36.028 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.821288+0000", 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0930000000000003e-06 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823694+0000", 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024052850000000001 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823853+0000", 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015879800000000001 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.029 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.823991+0000", 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013879100000000001 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.832834+0000", 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0088427109999999996 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855474+0000", 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022640304 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855553+0000", 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.8994999999999998e-05 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.855610+0000", 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6353000000000001e-05 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.031 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2773 3.17 3:e87231b1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 51.305026970999997, 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028454317, 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2773 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.032 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718461+0000", 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.718465+0000", 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.3680000000000002e-06 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729580+0000", 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011115776000000001 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729608+0000", 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7617e-05 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729622+0000", 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3528e-05 2024-05-07T14:04:36.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729694+0000", 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2630000000000001e-05 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729812+0000", 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000118132 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.729913+0000", 2024-05-07T14:04:36.035 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000100486 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.744465+0000", 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014551768 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746795+0000", 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023300270000000001 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.036 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746865+0000", 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0322999999999997e-05 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.746916+0000", 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0661999999999997e-05 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2784 3.17 3:e9b6a230:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:04:36.037 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 51.172731382999999, 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027214069, 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2784 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:04:36.038 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850757+0000", 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.850760+0000", 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0970000000000002e-06 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.039 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853165+0000", 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002405309 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853186+0000", 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0727999999999999e-05 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853196+0000", 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0159e-05 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.040 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853277+0000", 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0519999999999995e-05 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853440+0000", 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016281299999999999 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.853608+0000", 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168126 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.860132+0000", 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065242379999999999 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877848+0000", 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017716251999999998 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877919+0000", 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.127e-05 2024-05-07T14:04:36.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.877971+0000", 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1557000000000001e-05 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2789 3.2 3:434a8bbf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 51.117042165999997, 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025228071000000001, 2024-05-07T14:04:36.043 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2789 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906446+0000", 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.906450+0000", 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5149999999999998e-06 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908568+0000", 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0021184279999999999 2024-05-07T14:04:36.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908593+0000", 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5043999999999999e-05 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908607+0000", 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3716999999999999e-05 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908686+0000", 2024-05-07T14:04:36.046 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9492000000000004e-05 2024-05-07T14:04:36.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908818+0000", 2024-05-07T14:04:36.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013199199999999999 2024-05-07T14:04:36.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:36.047 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.908952+0000", 2024-05-07T14:04:36.047 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013385400000000001 2024-05-07T14:04:36.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.047 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.916238+0000", 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072861810000000001 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931560+0000", 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.01532122 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931620+0000", 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0448000000000001e-05 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.049 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.049 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:44.931674+0000", 2024-05-07T14:04:36.049 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.418e-05 2024-05-07T14:04:36.049 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.049 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.049 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.049 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:2799 3.9 e105/21 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:36.049 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:36.049 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 51.005667365999997, 2024-05-07T14:04:36.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021236735, 2024-05-07T14:04:36.050 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.050 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.050 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.050 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:36.050 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.050 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.050 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.017821+0000", 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.75e-07 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024399+0000", 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065773769999999997 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.051 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024434+0000", 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4884e-05 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024450+0000", 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6181999999999999e-05 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024523+0000", 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.3054999999999998e-05 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.024550+0000", 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6735000000000001e-05 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.038754+0000", 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014204543 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.039058+0000", 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00030348400000000002 2024-05-07T14:04:36.053 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2802 3.13 3:c8761262:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.980238002, 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026174424000000002, 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.054 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2802 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043250+0000", 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.043253+0000", 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7030000000000002e-06 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045330+0000", 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0020765139999999998 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045352+0000", 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2532e-05 2024-05-07T14:04:36.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045363+0000", 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0798000000000001e-05 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045446+0000", 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.3592999999999997e-05 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045641+0000", 2024-05-07T14:04:36.057 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019462900000000001 2024-05-07T14:04:36.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:36.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.045809+0000", 2024-05-07T14:04:36.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168312 2024-05-07T14:04:36.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.058 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.054070+0000", 2024-05-07T14:04:36.058 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0082602100000000005 2024-05-07T14:04:36.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.058 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069299+0000", 2024-05-07T14:04:36.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015229457 2024-05-07T14:04:36.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069371+0000", 2024-05-07T14:04:36.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1730000000000006e-05 2024-05-07T14:04:36.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.059 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.059 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.069425+0000", 2024-05-07T14:04:36.059 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3946000000000002e-05 2024-05-07T14:04:36.059 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2888 3.2 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.184879490999997, 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.037006981000000001, 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.060 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2888 2024-05-07T14:04:36.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.061 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:04:36.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.061 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.061 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838609+0000", 2024-05-07T14:04:36.061 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.838611+0000", 2024-05-07T14:04:36.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.441e-06 2024-05-07T14:04:36.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840569+0000", 2024-05-07T14:04:36.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019573189999999999 2024-05-07T14:04:36.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.062 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.062 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840592+0000", 2024-05-07T14:04:36.062 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.3230999999999998e-05 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840605+0000", 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.295e-05 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840681+0000", 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6250999999999999e-05 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.063 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840821+0000", 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013997700000000001 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.840966+0000", 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000144735 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.846709+0000", 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0057430809999999997 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.064 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875496+0000", 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028787366000000002 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875565+0000", 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8460000000000005e-05 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.875616+0000", 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.117e-05 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.065 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.066 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.066 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.066 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3180 3.13 3:caa8d6d3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_73:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:36.066 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.171133+0000", 2024-05-07T14:04:36.066 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.852355380999999, 2024-05-07T14:04:36.066 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022191593999999999, 2024-05-07T14:04:36.066 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.066 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.066 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.066 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.066 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3180 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.171133+0000", 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.171133+0000", 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.171136+0000", 2024-05-07T14:04:36.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0539999999999999e-06 2024-05-07T14:04:36.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172705+0000", 2024-05-07T14:04:36.068 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001568605 2024-05-07T14:04:36.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.068 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.068 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172735+0000", 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0871999999999999e-05 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172749+0000", 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3342e-05 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172824+0000", 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5142999999999995e-05 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.069 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.172960+0000", 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013564800000000001 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.173060+0000", 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0001004 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.177196+0000", 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0041360930000000004 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.193225+0000", 2024-05-07T14:04:36.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016028718000000001 2024-05-07T14:04:36.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.193274+0000", 2024-05-07T14:04:36.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9002000000000003e-05 2024-05-07T14:04:36.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.071 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.071 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.193325+0000", 2024-05-07T14:04:36.071 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0717000000000002e-05 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3196 3.13 3:ca161e2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_88:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.320598+0000", 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.702890674999999, 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023572460999999999, 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.072 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3196 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.320598+0000", 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.320598+0000", 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.320601+0000", 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0479999999999999e-06 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.321972+0000", 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013711890000000001 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.321996+0000", 2024-05-07T14:04:36.074 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4494e-05 2024-05-07T14:04:36.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.322008+0000", 2024-05-07T14:04:36.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1307e-05 2024-05-07T14:04:36.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.075 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.322083+0000", 2024-05-07T14:04:36.075 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5572000000000001e-05 2024-05-07T14:04:36.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.075 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.322196+0000", 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011228199999999999 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.322309+0000", 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011369799999999999 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.326918+0000", 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0046091190000000001 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.344051+0000", 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.017132903000000001 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.344119+0000", 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.8059999999999996e-05 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.344170+0000", 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0788999999999998e-05 2024-05-07T14:04:36.077 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3250 3.2e 3:75e09b47:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.903138+0000", 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.120350640000002, 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020147194, 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.078 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.079 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3250 2024-05-07T14:04:36.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.079 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.903138+0000", 2024-05-07T14:04:36.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.079 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.079 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.903138+0000", 2024-05-07T14:04:36.079 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.903140+0000", 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.34e-06 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904918+0000", 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017780960000000001 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904944+0000", 2024-05-07T14:04:36.080 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5426e-05 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.904956+0000", 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1982e-05 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.905063+0000", 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107896 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.081 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.905230+0000", 2024-05-07T14:04:36.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016688099999999999 2024-05-07T14:04:36.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:36.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.905398+0000", 2024-05-07T14:04:36.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000168157 2024-05-07T14:04:36.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.082 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.082 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.912075+0000", 2024-05-07T14:04:36.082 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0066761219999999996 2024-05-07T14:04:36.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.923215+0000", 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.011140469 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.923254+0000", 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9053e-05 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.923285+0000", 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0772000000000003e-05 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.083 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.084 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.084 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3252 3.2 3:422326a2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:36.084 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.925584+0000", 2024-05-07T14:04:36.084 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.097904639999999, 2024-05-07T14:04:36.084 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020260311999999999, 2024-05-07T14:04:36.084 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.084 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.084 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.084 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.084 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.084 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3252 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.925584+0000", 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.925584+0000", 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.085 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.925586+0000", 2024-05-07T14:04:36.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.9099999999999999e-06 2024-05-07T14:04:36.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927037+0000", 2024-05-07T14:04:36.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0014510199999999999 2024-05-07T14:04:36.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.086 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.086 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927071+0000", 2024-05-07T14:04:36.086 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4326000000000003e-05 2024-05-07T14:04:36.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927085+0000", 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4022999999999999e-05 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927161+0000", 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.5909999999999997e-05 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927327+0000", 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016630799999999999 2024-05-07T14:04:36.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.927444+0000", 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116885 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.935938+0000", 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0084935159999999996 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.945759+0000", 2024-05-07T14:04:36.088 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0098209990000000004 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.945806+0000", 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7361000000000003e-05 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.945844+0000", 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8053999999999999e-05 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.090 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3295 3.2d e114/21 3:b6ee7f94:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_187:head v 114'10, mlcod=114'8)", 2024-05-07T14:04:36.090 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.594055+0000", 2024-05-07T14:04:36.090 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 27.429433765999999, 2024-05-07T14:04:36.090 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021164453999999999, 2024-05-07T14:04:36.090 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.090 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.090 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.090 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.090 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.090 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.594055+0000", 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.594055+0000", 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.594057+0000", 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6479999999999999e-06 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.091 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599702+0000", 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056445380000000002 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599734+0000", 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1822000000000001e-05 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599750+0000", 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6731999999999998e-05 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599897+0000", 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000146279 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.599955+0000", 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8723e-05 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.615151+0000", 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.015195919 2024-05-07T14:04:36.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.094 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.094 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.615219+0000", 2024-05-07T14:04:36.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.7793000000000006e-05 2024-05-07T14:04:36.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.094 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.094 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3614 3.2e 3:74f8d4ae:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_495:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:36.094 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:12.264021+0000", 2024-05-07T14:04:36.094 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 23.759467304000001, 2024-05-07T14:04:36.094 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022976369999999999, 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3614 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.264021+0000", 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.264021+0000", 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.264024+0000", 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.638e-06 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.266574+0000", 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025504410000000001 2024-05-07T14:04:36.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.266610+0000", 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6161000000000002e-05 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.266626+0000", 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5398999999999999e-05 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.266714+0000", 2024-05-07T14:04:36.097 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8024999999999998e-05 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.266911+0000", 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000197379 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.267076+0000", 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016495600000000001 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.098 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.274876+0000", 2024-05-07T14:04:36.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0078003550000000001 2024-05-07T14:04:36.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.286903+0000", 2024-05-07T14:04:36.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012026606 2024-05-07T14:04:36.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.099 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.099 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.286957+0000", 2024-05-07T14:04:36.099 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4499000000000001e-05 2024-05-07T14:04:36.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:12.286997+0000", 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9910999999999998e-05 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3800 3.17 3:ea765717:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:30.832471+0000", 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.1910177959999997, 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020980064999999999, 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.100 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3800 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.832471+0000", 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.101 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.832471+0000", 2024-05-07T14:04:36.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.832474+0000", 2024-05-07T14:04:36.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0460000000000001e-06 2024-05-07T14:04:36.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.102 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.102 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.834914+0000", 2024-05-07T14:04:36.102 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0024399930000000001 2024-05-07T14:04:36.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.834941+0000", 2024-05-07T14:04:36.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6979e-05 2024-05-07T14:04:36.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.834955+0000", 2024-05-07T14:04:36.103 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4054e-05 2024-05-07T14:04:36.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.103 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.103 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.835040+0000", 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.4919000000000005e-05 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.835213+0000", 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017349299999999999 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.835366+0000", 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000153368 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.104 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.848206+0000", 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012839339999999999 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.853322+0000", 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0051166229999999998 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.853397+0000", 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4314999999999996e-05 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.106 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.106 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.853451+0000", 2024-05-07T14:04:36.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3934999999999998e-05 2024-05-07T14:04:36.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.106 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.106 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop(client.4464.0:3805 3.4 e122/21 3:2245806e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_23:head v 122'14, mlcod=114'12)", 2024-05-07T14:04:36.106 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:30.886430+0000", 2024-05-07T14:04:36.106 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 5.1370579100000002, 2024-05-07T14:04:36.106 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.024818463999999998, 2024-05-07T14:04:36.106 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.886430+0000", 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.886430+0000", 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.886432+0000", 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6729999999999999e-06 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.888159+0000", 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001727323 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.888188+0000", 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8353000000000001e-05 2024-05-07T14:04:36.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.888201+0000", 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3478e-05 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.888287+0000", 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.5420000000000005e-05 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.888318+0000", 2024-05-07T14:04:36.109 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1513000000000001e-05 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.911195+0000", 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022877227 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:30.911249+0000", 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3477000000000003e-05 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.111 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3868 3.13 3:ca00a2f1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:36.111 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:31.537006+0000", 2024-05-07T14:04:36.111 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.4864825469999996, 2024-05-07T14:04:36.111 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020587405999999999, 2024-05-07T14:04:36.111 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.111 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.111 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.111 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.111 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.111 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.111 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3868 2024-05-07T14:04:36.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.537006+0000", 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.537006+0000", 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.537009+0000", 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8210000000000002e-06 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.539843+0000", 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0028341410000000001 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.539868+0000", 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4793000000000001e-05 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.113 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.539881+0000", 2024-05-07T14:04:36.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3818000000000001e-05 2024-05-07T14:04:36.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.539946+0000", 2024-05-07T14:04:36.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5028000000000001e-05 2024-05-07T14:04:36.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.114 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.114 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.540119+0000", 2024-05-07T14:04:36.114 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017279 2024-05-07T14:04:36.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.540269+0000", 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000149495 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.549460+0000", 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0091909569999999996 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.557486+0000", 2024-05-07T14:04:36.115 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0080261489999999998 2024-05-07T14:04:36.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.557550+0000", 2024-05-07T14:04:36.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3974999999999996e-05 2024-05-07T14:04:36.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.116 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.116 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.557593+0000", 2024-05-07T14:04:36.116 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3439000000000002e-05 2024-05-07T14:04:36.116 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.116 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.116 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3909 3.17 3:e82f1df1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:31.988508+0000", 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.0349807179999999, 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023187276999999999, 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3909 2024-05-07T14:04:36.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.118 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.988508+0000", 2024-05-07T14:04:36.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.118 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.988508+0000", 2024-05-07T14:04:36.118 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.118 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.988510+0000", 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.058e-06 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.990111+0000", 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016009010000000001 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.990126+0000", 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5271999999999999e-05 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.990136+0000", 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0604e-05 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.990219+0000", 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2650000000000003e-05 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.990366+0000", 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014719700000000001 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:36.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.990505+0000", 2024-05-07T14:04:36.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000139085 2024-05-07T14:04:36.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:31.998075+0000", 2024-05-07T14:04:36.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0075698839999999998 2024-05-07T14:04:36.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.121 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.121 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.011608+0000", 2024-05-07T14:04:36.121 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013533115 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.011655+0000", 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.6805000000000003e-05 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.011695+0000", 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.9706000000000002e-05 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3941 3.13 3:c80c6139:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_159:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.348295+0000", 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 3.6751934349999997, 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022594086999999999, 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3941 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.123 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.348295+0000", 2024-05-07T14:04:36.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.348295+0000", 2024-05-07T14:04:36.124 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.124 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.124 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.348297+0000", 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.39e-06 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.350014+0000", 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0017171759999999999 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.350045+0000", 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0524000000000001e-05 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.125 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.350058+0000", 2024-05-07T14:04:36.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3376e-05 2024-05-07T14:04:36.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.350135+0000", 2024-05-07T14:04:36.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7101000000000006e-05 2024-05-07T14:04:36.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.126 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.126 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.350250+0000", 2024-05-07T14:04:36.126 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000114873 2024-05-07T14:04:36.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:36.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.350351+0000", 2024-05-07T14:04:36.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101069 2024-05-07T14:04:36.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.357604+0000", 2024-05-07T14:04:36.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072524959999999998 2024-05-07T14:04:36.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.127 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.127 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.370774+0000", 2024-05-07T14:04:36.127 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013169775 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.370835+0000", 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.1185000000000005e-05 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.370889+0000", 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.4122000000000001e-05 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.129 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:4184 3.2e 3:75b9fabb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_402:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-05-07T14:04:36.129 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:35.097591+0000", 2024-05-07T14:04:36.129 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.92589684900000002, 2024-05-07T14:04:36.129 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023369060000000001, 2024-05-07T14:04:36.129 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.129 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.129 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.129 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.129 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.129 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.129 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 4184 2024-05-07T14:04:36.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.129 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.097591+0000", 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.097591+0000", 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.097595+0000", 2024-05-07T14:04:36.130 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0690000000000002e-06 2024-05-07T14:04:36.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.100853+0000", 2024-05-07T14:04:36.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0032585840000000001 2024-05-07T14:04:36.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.131 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.100879+0000", 2024-05-07T14:04:36.131 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5754000000000001e-05 2024-05-07T14:04:36.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.131 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.100891+0000", 2024-05-07T14:04:36.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1813e-05 2024-05-07T14:04:36.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.100965+0000", 2024-05-07T14:04:36.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4289000000000007e-05 2024-05-07T14:04:36.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.132 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.132 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.101107+0000", 2024-05-07T14:04:36.132 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014226000000000001 2024-05-07T14:04:36.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.101266+0000", 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015879699999999999 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.107828+0000", 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0065618359999999997 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.120833+0000", 2024-05-07T14:04:36.133 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013005281 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.120905+0000", 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1403999999999996e-05 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.120961+0000", 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5973000000000001e-05 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.134 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.135 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.135 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:36.136 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-05-07T14:04:36.136 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:36.146+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:36.207 INFO:tasks.workunit.client.0.smithi106.stdout:quota disabled for the bucket: buck_2024_04_7_14_04_26 2024-05-07T14:04:36.207 INFO:tasks.workunit.client.0.smithi106.stdout:adding file to bucket: 2Gb. 2024-05-07T14:04:36.207 INFO:tasks.workunit.client.0.smithi106.stdout:upload file successful 2024-05-07T14:04:36.207 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:04:36.207 INFO:tasks.workunit.client.0.smithi106.stdout:Test case: PASSED - bucket quota size for a given user doesnt take effect when quota is disabled 2024-05-07T14:04:36.207 INFO:tasks.workunit.client.0.smithi106.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-05-07T14:04:36.236 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:36.250+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:36.313 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:36.313 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:36.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.313 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.6648.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94591933109360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-05-07T14:04:36.313 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:36.326332+0000", 2024-05-07T14:04:36.313 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.000811669, 2024-05-07T14:04:36.313 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00083011999999999995, 2024-05-07T14:04:36.313 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.313 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.313 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "waiting for sub ops", 2024-05-07T14:04:36.313 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.314 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.6648", 2024-05-07T14:04:36.314 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/1055339707", 2024-05-07T14:04:36.314 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 55 2024-05-07T14:04:36.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.314 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.314 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326332+0000", 2024-05-07T14:04:36.314 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.314 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326332+0000", 2024-05-07T14:04:36.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326333+0000", 2024-05-07T14:04:36.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.1800000000000005e-07 2024-05-07T14:04:36.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.315 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.315 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326337+0000", 2024-05-07T14:04:36.315 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1910000000000002e-06 2024-05-07T14:04:36.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326347+0000", 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.8539999999999992e-06 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326354+0000", 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6769999999999998e-06 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326395+0000", 2024-05-07T14:04:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1108e-05 2024-05-07T14:04:36.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326449+0000", 2024-05-07T14:04:36.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3842999999999999e-05 2024-05-07T14:04:36.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:36.317 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326554+0000", 2024-05-07T14:04:36.317 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000105461 2024-05-07T14:04:36.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.317 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.327000+0000", 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000446031 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.6648.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:36.326384+0000", 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.000759977, 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00086675100000000002, 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.318 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "waiting for sub ops", 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.6648", 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/1055339707", 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 56 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326384+0000", 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.319 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326384+0000", 2024-05-07T14:04:36.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326385+0000", 2024-05-07T14:04:36.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8999999999999996e-07 2024-05-07T14:04:36.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.320 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.320 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326388+0000", 2024-05-07T14:04:36.320 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.123e-06 2024-05-07T14:04:36.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326395+0000", 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6260000000000003e-06 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326401+0000", 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8969999999999996e-06 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326465+0000", 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.4103000000000006e-05 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326554+0000", 2024-05-07T14:04:36.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8549999999999998e-05 2024-05-07T14:04:36.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.322 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:36.322 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.326669+0000", 2024-05-07T14:04:36.322 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000114474 2024-05-07T14:04:36.322 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.322 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.322 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.323 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_repop_reply(client.6648.0:55 7.3 e124/29)", 2024-05-07T14:04:36.323 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:36.327262+0000", 2024-05-07T14:04:36.323 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4294967295.9998817, 2024-05-07T14:04:36.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4425000000000007e-05, 2024-05-07T14:04:36.323 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.323 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.323 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "reached pg", 2024-05-07T14:04:36.323 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.323 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.323 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.327262+0000", 2024-05-07T14:04:36.323 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.327262+0000", 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.327263+0000", 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.8699999999999995e-07 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.327267+0000", 2024-05-07T14:04:36.324 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7780000000000001e-06 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.327275+0000", 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9810000000000003e-06 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.327279+0000", 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.741e-06 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.327332+0000", 2024-05-07T14:04:36.325 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2216000000000003e-05 2024-05-07T14:04:36.326 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.326 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.326 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.326 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.326 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-05-07T14:04:36.326 INFO:teuthology.orchestra.run.smithi106.stdout: "num_ops": 3 2024-05-07T14:04:36.326 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:36.328 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-05-07T14:04:36.372 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:36.386+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:36.438 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-05-07T14:04:36.450+0000 7f314e437640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25249) UID: 0 2024-05-07T14:04:36.458 INFO:tasks.workunit.client.0.smithi106.stdout:user qa_user deleted 2024-05-07T14:04:36.458 INFO:tasks.workunit.client.0.smithi106.stdout:bucket delete succeeded 2024-05-07T14:04:36.458 INFO:tasks.workunit.client.0.smithi106.stdout:OK 2024-05-07T14:04:36.459 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-07T14:04:36.459 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-07T14:04:36.485 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:36.485 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [], 2024-05-07T14:04:36.485 INFO:teuthology.orchestra.run.smithi106.stdout: "complaint_time": 30, 2024-05-07T14:04:36.485 INFO:teuthology.orchestra.run.smithi106.stdout: "num_blocked_ops": 0 2024-05-07T14:04:36.485 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:36.496 INFO:tasks.workunit:Stopping ['rgw/s3_bucket_quota.pl'] on client.0... 2024-05-07T14:04:36.496 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-07T14:04:36.498 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-05-07T14:04:36.540 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-07T14:04:36.551+0000 7f3fa2ae5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25376) UID: 0 2024-05-07T14:04:36.572 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:04:36.641 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-05-07T14:04:36.654+0000 7f4474bf9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25252) UID: 0 2024-05-07T14:04:36.656 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:04:36.656 INFO:teuthology.orchestra.run.smithi106.stdout: "size": 20, 2024-05-07T14:04:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 600, 2024-05-07T14:04:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "ops": [ 2024-05-07T14:04:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:1480 3.7 3:e0f70db9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.3_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (355) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-05-07T14:04:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 104.364523436, 2024-05-07T14:04:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028704014, 2024-05-07T14:04:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.657 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 1480 2024-05-07T14:04:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304745+0000", 2024-05-07T14:04:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.304746+0000", 2024-05-07T14:04:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1990000000000001e-06 2024-05-07T14:04:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305870+0000", 2024-05-07T14:04:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001123902 2024-05-07T14:04:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.659 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305890+0000", 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0472999999999999e-05 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305899+0000", 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.8699999999999998e-06 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.305955+0000", 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6492000000000001e-05 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.660 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306072+0000", 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000116393 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.306401+0000", 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032867900000000002 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.315114+0000", 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008713508 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.661 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333353+0000", 2024-05-07T14:04:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018239328999999999 2024-05-07T14:04:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333401+0000", 2024-05-07T14:04:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7716999999999997e-05 2024-05-07T14:04:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:02:52.333449+0000", 2024-05-07T14:04:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.7451999999999999e-05 2024-05-07T14:04:36.662 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2203 3.1e 3:7a03ed3c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 93.374807091999998, 2024-05-07T14:04:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029129142, 2024-05-07T14:04:36.663 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.665 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2203 2024-05-07T14:04:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.666 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294461+0000", 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.294465+0000", 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7699999999999999e-06 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300328+0000", 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0058633460000000002 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300384+0000", 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.6212999999999999e-05 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300411+0000", 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7109000000000001e-05 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300586+0000", 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017478799999999999 2024-05-07T14:04:36.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.300941+0000", 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00035515500000000001 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.301351+0000", 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00040996099999999997 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.317495+0000", 2024-05-07T14:04:36.669 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016143462000000001 2024-05-07T14:04:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323421+0000", 2024-05-07T14:04:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0059264649999999997 2024-05-07T14:04:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323498+0000", 2024-05-07T14:04:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6478999999999997e-05 2024-05-07T14:04:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.670 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:03.323590+0000", 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2393999999999997e-05 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2666 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 57.017443536000002, 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.125351252, 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.671 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2666 2024-05-07T14:04:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651824+0000", 2024-05-07T14:04:36.672 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651827+0000", 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1469999999999999e-06 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651834+0000", 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7700000000000001e-06 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651850+0000", 2024-05-07T14:04:36.673 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5755000000000001e-05 2024-05-07T14:04:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651862+0000", 2024-05-07T14:04:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.237e-05 2024-05-07T14:04:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651967+0000", 2024-05-07T14:04:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00010427199999999999 2024-05-07T14:04:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.674 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.651977+0000", 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0743e-05 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657294+0000", 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0053168069999999998 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:39.657305+0000", 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0662000000000001e-05 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774211+0000", 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1169060209999999 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774394+0000", 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00018268000000000001 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.777176+0000", 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.002782025 2024-05-07T14:04:36.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2673 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch ping cookie 94397682178688 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 56.473510349000001, 2024-05-07T14:04:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.57934507999999996, 2024-05-07T14:04:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "started", 2024-05-07T14:04:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.677 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2673 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195758+0000", 2024-05-07T14:04:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.9699999999999996e-07 2024-05-07T14:04:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195761+0000", 2024-05-07T14:04:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2569999999999999e-06 2024-05-07T14:04:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.679 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195768+0000", 2024-05-07T14:04:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.489e-06 2024-05-07T14:04:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195774+0000", 2024-05-07T14:04:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.7389999999999996e-06 2024-05-07T14:04:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195866+0000", 2024-05-07T14:04:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.2349000000000006e-05 2024-05-07T14:04:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for peered", 2024-05-07T14:04:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.195878+0000", 2024-05-07T14:04:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.1838000000000001e-05 2024-05-07T14:04:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774802+0000", 2024-05-07T14:04:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.578923945 2024-05-07T14:04:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.774906+0000", 2024-05-07T14:04:36.681 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103991 2024-05-07T14:04:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:40.775103+0000", 2024-05-07T14:04:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000196975 2024-05-07T14:04:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2684 3.24 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:36.682 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 52.883149437999997, 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.040396402999999997, 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2684 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:36.683 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786119+0000", 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.786122+0000", 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0929999999999999e-06 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.684 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788626+0000", 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0025042720000000001 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788659+0000", 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2824999999999998e-05 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788673+0000", 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4721e-05 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.685 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788768+0000", 2024-05-07T14:04:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.4178999999999994e-05 2024-05-07T14:04:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op must wait for map", 2024-05-07T14:04:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.788776+0000", 2024-05-07T14:04:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2400000000000007e-06 2024-05-07T14:04:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798002+0000", 2024-05-07T14:04:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092262230000000004 2024-05-07T14:04:36.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798163+0000", 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000161077 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.798305+0000", 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014162499999999999 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.807567+0000", 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0092618869999999999 2024-05-07T14:04:36.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826429+0000", 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018862824 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826470+0000", 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1010999999999997e-05 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:43.826515+0000", 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.4425999999999998e-05 2024-05-07T14:04:36.688 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2865 3.38 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 51.086643156999997, 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.035746371999999998, 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.689 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2865 2024-05-07T14:04:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582625+0000", 2024-05-07T14:04:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.582627+0000", 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6299999999999998e-06 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584611+0000", 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0019836350000000001 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584636+0000", 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4943000000000002e-05 2024-05-07T14:04:36.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584652+0000", 2024-05-07T14:04:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5586e-05 2024-05-07T14:04:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584733+0000", 2024-05-07T14:04:36.692 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0987000000000002e-05 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584881+0000", 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014805800000000001 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.584972+0000", 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.1218999999999995e-05 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.591149+0000", 2024-05-07T14:04:36.693 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061766939999999999 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618207+0000", 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027058260000000001 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618319+0000", 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00011267700000000001 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.694 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.618371+0000", 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1683e-05 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2883 3.29 3:96d09a23:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_190:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.891479519000001, 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025309511999999999, 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.695 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2883 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777788+0000", 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.696 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.777791+0000", 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.289e-06 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779027+0000", 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001236411 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779063+0000", 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.5658999999999999e-05 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.697 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779076+0000", 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3128e-05 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779166+0000", 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.9818e-05 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779398+0000", 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00023189400000000001 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.779577+0000", 2024-05-07T14:04:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000179276 2024-05-07T14:04:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.786782+0000", 2024-05-07T14:04:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0072052740000000002 2024-05-07T14:04:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.699 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.802960+0000", 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016177490999999999 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803047+0000", 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.6912999999999999e-05 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:45.803098+0000", 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.1359000000000001e-05 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:2905 3.1e 3:78954da1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_212:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 50.618071280000002, 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028568698, 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 2905 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051197+0000", 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.051199+0000", 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5299999999999999e-06 2024-05-07T14:04:36.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055400+0000", 2024-05-07T14:04:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0042009889999999996 2024-05-07T14:04:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055458+0000", 2024-05-07T14:04:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.736e-05 2024-05-07T14:04:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.703 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055486+0000", 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.8914000000000001e-05 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055574+0000", 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.7120999999999995e-05 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055726+0000", 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015249600000000001 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:36.704 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.055884+0000", 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00015788900000000001 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.064235+0000", 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.008350583 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078705+0000", 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.014470129999999999 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.078900+0000", 2024-05-07T14:04:36.705 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019521799999999999 2024-05-07T14:04:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:03:46.079765+0000", 2024-05-07T14:04:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00086546799999999999 2024-05-07T14:04:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3240 3.33 3:cd111f2d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:07.788271+0000", 2024-05-07T14:04:36.706 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.880996469999999, 2024-05-07T14:04:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.026491491999999998, 2024-05-07T14:04:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3240 2024-05-07T14:04:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.707 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.788271+0000", 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.788271+0000", 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.788275+0000", 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2399999999999999e-06 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.708 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791613+0000", 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0033385329999999999 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791645+0000", 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1602e-05 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791659+0000", 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4596999999999999e-05 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.709 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791766+0000", 2024-05-07T14:04:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000106043 2024-05-07T14:04:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.791961+0000", 2024-05-07T14:04:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019581399999999999 2024-05-07T14:04:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.792139+0000", 2024-05-07T14:04:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017790899999999999 2024-05-07T14:04:36.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.804241+0000", 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012101519999999999 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.814683+0000", 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010442158999999999 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.814728+0000", 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.5456e-05 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:07.814763+0000", 2024-05-07T14:04:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.4619000000000002e-05 2024-05-07T14:04:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3277 3.b 3:d1f9c1c7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.317440+0000", 2024-05-07T14:04:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.35182833, 2024-05-07T14:04:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.025103065000000001, 2024-05-07T14:04:36.712 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3277 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.317440+0000", 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.317440+0000", 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.317443+0000", 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.2969999999999999e-06 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320371+0000", 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0029279280000000002 2024-05-07T14:04:36.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320424+0000", 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.2972e-05 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320451+0000", 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7056e-05 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320604+0000", 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000152688 2024-05-07T14:04:36.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.320950+0000", 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00034685400000000001 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.321362+0000", 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00041191300000000003 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.340027+0000", 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.018665010999999999 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342301+0000", 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022736750000000002 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342433+0000", 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000131712 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.342543+0000", 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000109959 2024-05-07T14:04:36.717 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3288 3.7 3:e3df0df9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:08.487335+0000", 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 28.181932627999998, 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022910593999999999, 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.718 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3288 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.487335+0000", 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.487335+0000", 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.487339+0000", 2024-05-07T14:04:36.719 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1139999999999999e-06 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490002+0000", 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0026621510000000002 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490040+0000", 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.8575000000000003e-05 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490058+0000", 2024-05-07T14:04:36.720 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.8077999999999999e-05 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490206+0000", 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014781899999999999 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490531+0000", 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00032532500000000001 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.490865+0000", 2024-05-07T14:04:36.721 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000333319 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.501257+0000", 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.010392083 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.509955+0000", 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0086984690000000003 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.722 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.510124+0000", 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00016896700000000001 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:08.510246+0000", 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000121694 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3913 3.8 3:1097d8db:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.035868+0000", 2024-05-07T14:04:36.723 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.6334004000000002, 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.027605465999999999, 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3913 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.035868+0000", 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.035868+0000", 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.035870+0000", 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.0439999999999998e-06 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.038072+0000", 2024-05-07T14:04:36.725 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0022028070000000002 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.038126+0000", 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.3127999999999997e-05 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.038142+0000", 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.6915999999999999e-05 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.726 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.038223+0000", 2024-05-07T14:04:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.0641000000000003e-05 2024-05-07T14:04:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.038386+0000", 2024-05-07T14:04:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000163194 2024-05-07T14:04:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.038501+0000", 2024-05-07T14:04:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000114806 2024-05-07T14:04:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.058998+0000", 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020496978999999999 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.063366+0000", 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0043684259999999999 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.063430+0000", 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.3396000000000001e-05 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.063473+0000", 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.3129e-05 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3923 3.1e 3:78b90cbf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.155280+0000", 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.5139883029999996, 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029486865000000001, 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.729 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3923 2024-05-07T14:04:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.155280+0000", 2024-05-07T14:04:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.155280+0000", 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.155282+0000", 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.2639999999999998e-06 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.156901+0000", 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016192260000000001 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.731 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.156915+0000", 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4168999999999999e-05 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.156926+0000", 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.0755e-05 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.157001+0000", 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.4443999999999994e-05 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.157207+0000", 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000206954 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.157328+0000", 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000120171 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.162796+0000", 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0054688510000000003 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.184646+0000", 2024-05-07T14:04:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.021849095999999998 2024-05-07T14:04:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.184701+0000", 2024-05-07T14:04:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.5498999999999998e-05 2024-05-07T14:04:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.184767+0000", 2024-05-07T14:04:36.734 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.5436000000000002e-05 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3928 3.1e 3:7b4ff8f9:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.204919+0000", 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.4643491749999997, 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023374621000000002, 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.735 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3928 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.204919+0000", 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.204919+0000", 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.736 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.204922+0000", 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.411e-06 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.207240+0000", 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0023177889999999998 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.207266+0000", 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.5948e-05 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.207276+0000", 2024-05-07T14:04:36.737 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.7149999999999993e-06 2024-05-07T14:04:36.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.207379+0000", 2024-05-07T14:04:36.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000103627 2024-05-07T14:04:36.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.738 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.207602+0000", 2024-05-07T14:04:36.738 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00022313699999999999 2024-05-07T14:04:36.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.738 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.207782+0000", 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00017995399999999999 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.216125+0000", 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0083425649999999997 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.228209+0000", 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.012084007000000001 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.228257+0000", 2024-05-07T14:04:36.739 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8035999999999999e-05 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.228293+0000", 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.6431999999999999e-05 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3939 3.27 3:e4a6764e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.330432+0000", 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.338835768, 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.029885104999999999, 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.740 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3939 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.330432+0000", 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.741 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.330432+0000", 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.330434+0000", 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.154e-06 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.332096+0000", 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0016616179999999999 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.742 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.332122+0000", 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.6435e-05 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.332138+0000", 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.5554e-05 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.332239+0000", 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000101056 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.743 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.332387+0000", 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014808099999999999 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.332491+0000", 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000104394 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.338170+0000", 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0056784410000000002 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.360226+0000", 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022055603999999999 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.360267+0000", 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1724000000000002e-05 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.360317+0000", 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0043999999999997e-05 2024-05-07T14:04:36.745 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.746 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.746 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.746 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:3943 3.1e 3:7846badd:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:36.746 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:32.367330+0000", 2024-05-07T14:04:36.746 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 4.3019376539999996, 2024-05-07T14:04:36.746 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.023406542999999998, 2024-05-07T14:04:36.746 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.746 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.746 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.746 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.746 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 3943 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.367330+0000", 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.367330+0000", 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.367333+0000", 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.0299999999999998e-06 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.368732+0000", 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001398968 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.368759+0000", 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7118999999999999e-05 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.368774+0000", 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4219999999999999e-05 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.368851+0000", 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.7818999999999995e-05 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.368985+0000", 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00013384099999999999 2024-05-07T14:04:36.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.369093+0000", 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000107377 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.374035+0000", 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0049426449999999999 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.390586+0000", 2024-05-07T14:04:36.750 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016550907 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.390657+0000", 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0981000000000004e-05 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:32.390737+0000", 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9635999999999994e-05 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:4272 3.38 3:1ec31d92:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_480:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:35.931035+0000", 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.73823328300000002, 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.028883934, 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 4272 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.752 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.931035+0000", 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.931035+0000", 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.931037+0000", 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.1440000000000001e-06 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.753 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.932493+0000", 2024-05-07T14:04:36.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001455869 2024-05-07T14:04:36.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.932524+0000", 2024-05-07T14:04:36.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.1681999999999999e-05 2024-05-07T14:04:36.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.754 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.754 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.932538+0000", 2024-05-07T14:04:36.754 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3636e-05 2024-05-07T14:04:36.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.932609+0000", 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0598000000000004e-05 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.932744+0000", 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000135609 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.932847+0000", 2024-05-07T14:04:36.755 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000102657 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.938980+0000", 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0061326499999999999 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.959772+0000", 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.020792241999999999 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.756 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.959848+0000", 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.6514999999999995e-05 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.959919+0000", 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.0332000000000004e-05 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:4275 3.1e 3:7bc227b7:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_483:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:35.958909+0000", 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.71035939299999995, 2024-05-07T14:04:36.757 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.024334651999999998, 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 4275 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.958909+0000", 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.958909+0000", 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.958912+0000", 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.145e-06 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.960464+0000", 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001552271 2024-05-07T14:04:36.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.960478+0000", 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.3685e-05 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.960485+0000", 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.2309999999999999e-06 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.960554+0000", 2024-05-07T14:04:36.760 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.9249000000000001e-05 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.960667+0000", 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000112593 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.960760+0000", 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 9.3158999999999994e-05 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.761 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.967044+0000", 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0062839280000000003 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.983165+0000", 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016120997000000001 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.983206+0000", 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.1041000000000002e-05 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.762 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:35.983243+0000", 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 3.7353e-05 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:4283 3.b 3:d21c722c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_491:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:36.036576+0000", 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.632691856, 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.02302821, 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.763 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.764 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.764 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.764 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.764 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 4283 2024-05-07T14:04:36.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.764 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.764 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.036576+0000", 2024-05-07T14:04:36.764 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.764 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.036576+0000", 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.036578+0000", 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.272e-06 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.038207+0000", 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.001628783 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.038232+0000", 2024-05-07T14:04:36.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.4683999999999999e-05 2024-05-07T14:04:36.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.038245+0000", 2024-05-07T14:04:36.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.2877000000000001e-05 2024-05-07T14:04:36.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.766 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.766 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.038324+0000", 2024-05-07T14:04:36.766 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 7.9538999999999999e-05 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.038509+0000", 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000184785 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.038691+0000", 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.000181559 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.055462+0000", 2024-05-07T14:04:36.767 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.016771077999999998 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.059495+0000", 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0040333770000000003 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.059556+0000", 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.0980999999999998e-05 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.768 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.059604+0000", 2024-05-07T14:04:36.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 4.8275000000000001e-05 2024-05-07T14:04:36.769 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.769 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.769 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.769 INFO:teuthology.orchestra.run.smithi106.stdout: "description": "osd_op(client.4464.0:4285 3.38 3:1fde759a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_493:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-05-07T14:04:36.769 INFO:teuthology.orchestra.run.smithi106.stdout: "initiated_at": "2024-05-07T14:04:36.057739+0000", 2024-05-07T14:04:36.769 INFO:teuthology.orchestra.run.smithi106.stdout: "age": 0.61152899800000005, 2024-05-07T14:04:36.769 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.022858740999999998, 2024-05-07T14:04:36.769 INFO:teuthology.orchestra.run.smithi106.stdout: "continuous": false, 2024-05-07T14:04:36.769 INFO:teuthology.orchestra.run.smithi106.stdout: "type_data": { 2024-05-07T14:04:36.769 INFO:teuthology.orchestra.run.smithi106.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: "client_info": { 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: "client": "client.4464", 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: "tid": 4285 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: "events": [ 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "initiated", 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.057739+0000", 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "header_read", 2024-05-07T14:04:36.770 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.057739+0000", 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "throttled", 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.057741+0000", 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.419e-06 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "all_read", 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.059095+0000", 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0013539279999999999 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.771 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "dispatched", 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.059123+0000", 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 2.7985999999999999e-05 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "queued_for_pg", 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.059138+0000", 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 1.4558e-05 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "reached_pg", 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.059221+0000", 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 8.2999999999999998e-05 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.772 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "started", 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.059417+0000", 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00019572599999999999 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.059565+0000", 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.00014829099999999999 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "op_commit", 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.066520+0000", 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.0069552069999999997 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.773 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.080481+0000", 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 0.013960649 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "commit_sent", 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.080547+0000", 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 6.6136999999999994e-05 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: "event": "done", 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: "time": "2024-05-07T14:04:36.080598+0000", 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: "duration": 5.0840000000000001e-05 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.774 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.775 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.775 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-05-07T14:04:36.775 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-05-07T14:04:36.775 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:04:36.776 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-05-07T14:04:36.777 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-07T14:04:36.787+0000 7f66d904c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25371) UID: 0 2024-05-07T14:04:36.815 DEBUG:teuthology.parallel:result is None 2024-05-07T14:04:36.815 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-07T14:04:36.869 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-07T14:04:36.869 DEBUG:teuthology.orchestra.run.smithi106:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-05-07T14:04:36.877 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-07T14:04:36.887+0000 7f8e90832640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25370) UID: 0 2024-05-07T14:04:36.906 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:36.907 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:36.907 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:36.907 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:36.921 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-05-07T14:04:36.940 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-05-07T14:04:36.940 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-05-07T14:04:36.949 INFO:tasks.thrashosds:joining thrashosds 2024-05-07T14:04:37.087 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:37.087 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:37.087 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:37.087 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:37.088 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:37.102 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-05-07T14:04:37.227 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:37.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2224 3.1a 3:5af98984:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 93.651420396999995, 2024-05-07T14:04:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027796929000000001, 2024-05-07T14:04:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2224 2024-05-07T14:04:37.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588344+0000", 2024-05-07T14:04:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.588348+0000", 2024-05-07T14:04:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1629999999999998e-06 2024-05-07T14:04:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594043+0000", 2024-05-07T14:04:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0056948950000000002 2024-05-07T14:04:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594085+0000", 2024-05-07T14:04:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1678999999999999e-05 2024-05-07T14:04:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594113+0000", 2024-05-07T14:04:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8534000000000002e-05 2024-05-07T14:04:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594221+0000", 2024-05-07T14:04:37.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107371 2024-05-07T14:04:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594405+0000", 2024-05-07T14:04:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018468099999999999 2024-05-07T14:04:37.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.594570+0000", 2024-05-07T14:04:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000165224 2024-05-07T14:04:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.603655+0000", 2024-05-07T14:04:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090846550000000005 2024-05-07T14:04:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.615968+0000", 2024-05-07T14:04:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012313199 2024-05-07T14:04:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616069+0000", 2024-05-07T14:04:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100309 2024-05-07T14:04:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.616141+0000", 2024-05-07T14:04:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2218999999999994e-05 2024-05-07T14:04:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2229 3.3 3:c26503b6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:37.235 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:37.236 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 93.580123869000005, 2024-05-07T14:04:37.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028304669000000001, 2024-05-07T14:04:37.236 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.236 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.236 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.236 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2229 2024-05-07T14:04:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:37.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659640+0000", 2024-05-07T14:04:37.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.659643+0000", 2024-05-07T14:04:37.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9129999999999999e-06 2024-05-07T14:04:37.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664151+0000", 2024-05-07T14:04:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045081189999999997 2024-05-07T14:04:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664198+0000", 2024-05-07T14:04:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6431999999999999e-05 2024-05-07T14:04:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664223+0000", 2024-05-07T14:04:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5369999999999999e-05 2024-05-07T14:04:37.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664313+0000", 2024-05-07T14:04:37.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9345999999999995e-05 2024-05-07T14:04:37.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664428+0000", 2024-05-07T14:04:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115058 2024-05-07T14:04:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.664566+0000", 2024-05-07T14:04:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000138598 2024-05-07T14:04:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.671674+0000", 2024-05-07T14:04:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071074529999999997 2024-05-07T14:04:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687772+0000", 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016098359 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687871+0000", 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9098000000000006e-05 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.687945+0000", 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3923000000000004e-05 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.245 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2684 3.24 e104/21 3:27b50b3b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_1:head v 104'6, mlcod=85'4)", 2024-05-07T14:04:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.441163408999998, 2024-05-07T14:04:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026848770000000001, 2024-05-07T14:04:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.798601+0000", 2024-05-07T14:04:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6000000000000004e-07 2024-05-07T14:04:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810718+0000", 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012116477 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810747+0000", 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8676000000000001e-05 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810791+0000", 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4415000000000001e-05 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810915+0000", 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012363399999999999 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.810950+0000", 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5812999999999997e-05 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825326+0000", 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014375852 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.825450+0000", 2024-05-07T14:04:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012334299999999999 2024-05-07T14:04:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2686 3.34 3:2ec0e822:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.431113267000001, 2024-05-07T14:04:37.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034864805999999998, 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2686 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808651+0000", 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.808656+0000", 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6029999999999998e-06 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818059+0000", 2024-05-07T14:04:37.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094034429999999992 2024-05-07T14:04:37.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818114+0000", 2024-05-07T14:04:37.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4625e-05 2024-05-07T14:04:37.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.818139+0000", 2024-05-07T14:04:37.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4850000000000001e-05 2024-05-07T14:04:37.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819387+0000", 2024-05-07T14:04:37.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012488060000000001 2024-05-07T14:04:37.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.819792+0000", 2024-05-07T14:04:37.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040472400000000002 2024-05-07T14:04:37.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:37.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.820050+0000", 2024-05-07T14:04:37.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025799800000000001 2024-05-07T14:04:37.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.833596+0000", 2024-05-07T14:04:37.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013546069000000001 2024-05-07T14:04:37.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843174+0000", 2024-05-07T14:04:37.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095773449999999993 2024-05-07T14:04:37.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:04:37.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023329199999999999 2024-05-07T14:04:37.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843516+0000", 2024-05-07T14:04:37.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109051 2024-05-07T14:04:37.257 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.258 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.258 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.258 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2799 3.9 3:9089d4c8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:37.258 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:37.258 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.227404741999997, 2024-05-07T14:04:37.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027222948, 2024-05-07T14:04:37.258 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.258 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.258 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.258 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2799 2024-05-07T14:04:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012360+0000", 2024-05-07T14:04:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.012363+0000", 2024-05-07T14:04:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6500000000000002e-06 2024-05-07T14:04:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016678+0000", 2024-05-07T14:04:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043148320000000002 2024-05-07T14:04:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016709+0000", 2024-05-07T14:04:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0953e-05 2024-05-07T14:04:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016726+0000", 2024-05-07T14:04:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7022999999999999e-05 2024-05-07T14:04:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.016864+0000", 2024-05-07T14:04:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137854 2024-05-07T14:04:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017108+0000", 2024-05-07T14:04:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024388099999999999 2024-05-07T14:04:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.017333+0000", 2024-05-07T14:04:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022492899999999999 2024-05-07T14:04:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.033051+0000", 2024-05-07T14:04:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015718352000000001 2024-05-07T14:04:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039272+0000", 2024-05-07T14:04:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0062205139999999999 2024-05-07T14:04:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039451+0000", 2024-05-07T14:04:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017928 2024-05-07T14:04:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.039583+0000", 2024-05-07T14:04:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013168000000000001 2024-05-07T14:04:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2804 3.e e105/21 3:7356dc96:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_121:head v 105'10, mlcod=105'8)", 2024-05-07T14:04:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.166467998999998, 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029282694000000001, 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073296+0000", 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.073299+0000", 2024-05-07T14:04:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:04:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076073+0000", 2024-05-07T14:04:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0027746260000000001 2024-05-07T14:04:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076118+0000", 2024-05-07T14:04:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4223e-05 2024-05-07T14:04:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076138+0000", 2024-05-07T14:04:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0622999999999999e-05 2024-05-07T14:04:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076324+0000", 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018613599999999999 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076376+0000", 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2068999999999999e-05 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102438+0000", 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026061190000000001 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.102579+0000", 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014143399999999999 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2805 3.1 e105/21 3:819b24c4:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_122:head v 105'3, mlcod=104'1)", 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.163505180000001, 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028404523000000001, 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076259+0000", 2024-05-07T14:04:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.076262+0000", 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3800000000000001e-06 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083265+0000", 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070039539999999997 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083309+0000", 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3516000000000001e-05 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083333+0000", 2024-05-07T14:04:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4471999999999999e-05 2024-05-07T14:04:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083520+0000", 2024-05-07T14:04:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018616999999999999 2024-05-07T14:04:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.083588+0000", 2024-05-07T14:04:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8405000000000007e-05 2024-05-07T14:04:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104547+0000", 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020959228 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.104664+0000", 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011639800000000001 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2832 3.1a 3:585a9fcc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.992100417000003, 2024-05-07T14:04:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030681671000000001, 2024-05-07T14:04:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2832 2024-05-07T14:04:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247664+0000", 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.247666+0000", 2024-05-07T14:04:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5569999999999998e-06 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253202+0000", 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055353900000000003 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253232+0000", 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0309000000000001e-05 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253250+0000", 2024-05-07T14:04:37.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7503000000000002e-05 2024-05-07T14:04:37.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253372+0000", 2024-05-07T14:04:37.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012255600000000001 2024-05-07T14:04:37.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253592+0000", 2024-05-07T14:04:37.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021960400000000001 2024-05-07T14:04:37.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:37.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.253831+0000", 2024-05-07T14:04:37.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000239223 2024-05-07T14:04:37.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.264040+0000", 2024-05-07T14:04:37.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010209018 2024-05-07T14:04:37.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278176+0000", 2024-05-07T14:04:37.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014135518 2024-05-07T14:04:37.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278272+0000", 2024-05-07T14:04:37.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6562000000000001e-05 2024-05-07T14:04:37.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.278346+0000", 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3430999999999995e-05 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2853 3.34 3:2c5576f8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.783406528999997, 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026917739, 2024-05-07T14:04:37.283 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2853 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456358+0000", 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.456361+0000", 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1240000000000001e-06 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460499+0000", 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041381159999999998 2024-05-07T14:04:37.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460528+0000", 2024-05-07T14:04:37.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8558999999999999e-05 2024-05-07T14:04:37.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460544+0000", 2024-05-07T14:04:37.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6200000000000001e-05 2024-05-07T14:04:37.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.460699+0000", 2024-05-07T14:04:37.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155513 2024-05-07T14:04:37.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461098+0000", 2024-05-07T14:04:37.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039883900000000001 2024-05-07T14:04:37.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:37.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.461508+0000", 2024-05-07T14:04:37.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040939399999999999 2024-05-07T14:04:37.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.474319+0000", 2024-05-07T14:04:37.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012811002 2024-05-07T14:04:37.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483036+0000", 2024-05-07T14:04:37.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087174469999999997 2024-05-07T14:04:37.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483142+0000", 2024-05-07T14:04:37.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010647800000000001 2024-05-07T14:04:37.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.483276+0000", 2024-05-07T14:04:37.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013306700000000001 2024-05-07T14:04:37.290 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.290 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.290 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.290 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3190 3.1a 3:59666d5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:37.290 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:37.290 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 29.979334953999999, 2024-05-07T14:04:37.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026496828, 2024-05-07T14:04:37.291 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.291 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.291 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.291 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.291 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.291 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.291 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3190 2024-05-07T14:04:37.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.291 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260429+0000", 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.260444+0000", 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4766000000000001e-05 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267146+0000", 2024-05-07T14:04:37.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00670179 2024-05-07T14:04:37.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267176+0000", 2024-05-07T14:04:37.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0534999999999998e-05 2024-05-07T14:04:37.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267191+0000", 2024-05-07T14:04:37.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4080000000000001e-05 2024-05-07T14:04:37.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267300+0000", 2024-05-07T14:04:37.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109962 2024-05-07T14:04:37.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267473+0000", 2024-05-07T14:04:37.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000172516 2024-05-07T14:04:37.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 1", 2024-05-07T14:04:37.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.267636+0000", 2024-05-07T14:04:37.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016309699999999999 2024-05-07T14:04:37.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.275955+0000", 2024-05-07T14:04:37.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083188399999999992 2024-05-07T14:04:37.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286699+0000", 2024-05-07T14:04:37.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010743674999999999 2024-05-07T14:04:37.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286808+0000", 2024-05-07T14:04:37.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109702 2024-05-07T14:04:37.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.286926+0000", 2024-05-07T14:04:37.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117865 2024-05-07T14:04:37.296 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.296 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.296 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.297 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3335 3.9 3:93f3a6ca:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_226:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:37.297 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:09.361724+0000", 2024-05-07T14:04:37.297 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.878040041999999, 2024-05-07T14:04:37.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027372132, 2024-05-07T14:04:37.297 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.297 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.297 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.297 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.297 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.297 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.297 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3335 2024-05-07T14:04:37.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.298 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.361724+0000", 2024-05-07T14:04:37.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.361724+0000", 2024-05-07T14:04:37.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.361930+0000", 2024-05-07T14:04:37.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000205331 2024-05-07T14:04:37.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369409+0000", 2024-05-07T14:04:37.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074794070000000004 2024-05-07T14:04:37.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369456+0000", 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7413000000000002e-05 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369483+0000", 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6366000000000001e-05 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369665+0000", 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018191799999999999 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.369944+0000", 2024-05-07T14:04:37.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027922599999999999 2024-05-07T14:04:37.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:37.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.370170+0000", 2024-05-07T14:04:37.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000226233 2024-05-07T14:04:37.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.379097+0000", 2024-05-07T14:04:37.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0089264380000000001 2024-05-07T14:04:37.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.388922+0000", 2024-05-07T14:04:37.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0098254650000000002 2024-05-07T14:04:37.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.389020+0000", 2024-05-07T14:04:37.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7663000000000003e-05 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.389096+0000", 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6672e-05 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3351 3.31 e114/21 3:8fd6054f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_242:head v 114'10, mlcod=113'8)", 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:09.578617+0000", 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 27.661146990999999, 2024-05-07T14:04:37.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024903304000000001, 2024-05-07T14:04:37.304 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.304 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.304 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.304 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.578617+0000", 2024-05-07T14:04:37.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.578617+0000", 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.578620+0000", 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3599999999999999e-06 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582736+0000", 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041163069999999996 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582774+0000", 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7944000000000001e-05 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582799+0000", 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5222e-05 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582906+0000", 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010689299999999999 2024-05-07T14:04:37.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.582933+0000", 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7192e-05 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.603465+0000", 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020531341000000002 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:09.603521+0000", 2024-05-07T14:04:37.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6045000000000003e-05 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3604 3.1c e115/21 3:3a3fe722:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_485:head v 115'10, mlcod=114'8)", 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.157830+0000", 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.081933891999999, 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032404158000000002, 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157830+0000", 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157830+0000", 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157833+0000", 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5900000000000002e-06 2024-05-07T14:04:37.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164272+0000", 2024-05-07T14:04:37.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.006439485 2024-05-07T14:04:37.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164319+0000", 2024-05-07T14:04:37.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6699000000000001e-05 2024-05-07T14:04:37.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164345+0000", 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5415999999999999e-05 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164521+0000", 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176751 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.164589+0000", 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7803000000000001e-05 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190083+0000", 2024-05-07T14:04:37.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025494176 2024-05-07T14:04:37.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190235+0000", 2024-05-07T14:04:37.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015123799999999999 2024-05-07T14:04:37.312 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.312 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.312 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.312 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3605 3.11 e115/21 3:8ac2b8fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_486:head v 115'13, mlcod=115'11)", 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.168137+0000", 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.071627414000002, 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025037206999999999, 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.168137+0000", 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.168137+0000", 2024-05-07T14:04:37.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.168140+0000", 2024-05-07T14:04:37.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6699999999999998e-06 2024-05-07T14:04:37.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173479+0000", 2024-05-07T14:04:37.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053395300000000003 2024-05-07T14:04:37.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173515+0000", 2024-05-07T14:04:37.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6273999999999999e-05 2024-05-07T14:04:37.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173533+0000", 2024-05-07T14:04:37.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7368999999999999e-05 2024-05-07T14:04:37.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173679+0000", 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000146568 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.173722+0000", 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2395999999999999e-05 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.193023+0000", 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019300955000000002 2024-05-07T14:04:37.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.193174+0000", 2024-05-07T14:04:37.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000151445 2024-05-07T14:04:37.317 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.317 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.317 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.317 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3787 3.2c e122/21 3:37fb638e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_5:head v 122'20, mlcod=114'18)", 2024-05-07T14:04:37.317 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:30.702753+0000", 2024-05-07T14:04:37.317 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.537010853, 2024-05-07T14:04:37.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034439085000000001, 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.702753+0000", 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.702753+0000", 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.702754+0000", 2024-05-07T14:04:37.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0999999999999997e-07 2024-05-07T14:04:37.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.709388+0000", 2024-05-07T14:04:37.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066337560000000002 2024-05-07T14:04:37.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.709428+0000", 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9739e-05 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.709451+0000", 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3439999999999999e-05 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.709619+0000", 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016801899999999999 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.709683+0000", 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3360000000000003e-05 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.737049+0000", 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027366898000000001 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.737193+0000", 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000143063 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.321 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3801 3.3 3:c3e58e9a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:30.843372+0000", 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.3963920820000002, 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026131714, 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3801 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.322 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.843372+0000", 2024-05-07T14:04:37.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.843372+0000", 2024-05-07T14:04:37.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.843376+0000", 2024-05-07T14:04:37.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3670000000000001e-06 2024-05-07T14:04:37.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.848171+0000", 2024-05-07T14:04:37.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047955849999999998 2024-05-07T14:04:37.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.848215+0000", 2024-05-07T14:04:37.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3980000000000002e-05 2024-05-07T14:04:37.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.848241+0000", 2024-05-07T14:04:37.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6282999999999999e-05 2024-05-07T14:04:37.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.848417+0000", 2024-05-07T14:04:37.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017529199999999999 2024-05-07T14:04:37.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.848747+0000", 2024-05-07T14:04:37.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00033069099999999998 2024-05-07T14:04:37.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:37.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.849091+0000", 2024-05-07T14:04:37.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034347799999999998 2024-05-07T14:04:37.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.860995+0000", 2024-05-07T14:04:37.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011903988000000001 2024-05-07T14:04:37.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.869315+0000", 2024-05-07T14:04:37.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083197310000000003 2024-05-07T14:04:37.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.869426+0000", 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111233 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.869504+0000", 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8085999999999997e-05 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3804 3.3 3:c3c6d8de:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:37.328 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:30.874768+0000", 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.364995907, 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034375735999999997, 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3804 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.874768+0000", 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.874768+0000", 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.874797+0000", 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8787000000000001e-05 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.879259+0000", 2024-05-07T14:04:37.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044614809999999998 2024-05-07T14:04:37.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.879296+0000", 2024-05-07T14:04:37.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7753000000000003e-05 2024-05-07T14:04:37.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.879322+0000", 2024-05-07T14:04:37.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5503e-05 2024-05-07T14:04:37.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.879500+0000", 2024-05-07T14:04:37.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017826800000000001 2024-05-07T14:04:37.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.879764+0000", 2024-05-07T14:04:37.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026383899999999998 2024-05-07T14:04:37.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:37.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.880000+0000", 2024-05-07T14:04:37.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023555200000000001 2024-05-07T14:04:37.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.889902+0000", 2024-05-07T14:04:37.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0099027969999999996 2024-05-07T14:04:37.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.908976+0000", 2024-05-07T14:04:37.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019073430999999998 2024-05-07T14:04:37.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.909071+0000", 2024-05-07T14:04:37.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.4691999999999994e-05 2024-05-07T14:04:37.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.909144+0000", 2024-05-07T14:04:37.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3633000000000005e-05 2024-05-07T14:04:37.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.335 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.335 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.335 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:4187 3.34 3:2f302ca5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_405:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-05-07T14:04:37.335 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:35.126431+0000", 2024-05-07T14:04:37.335 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 2.1133337270000001, 2024-05-07T14:04:37.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028296109, 2024-05-07T14:04:37.335 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.335 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.335 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.335 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.336 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.336 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.336 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4187 2024-05-07T14:04:37.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.336 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.126431+0000", 2024-05-07T14:04:37.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.126431+0000", 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.126433+0000", 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5670000000000002e-06 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.131760+0000", 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053266820000000001 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.131793+0000", 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3309999999999998e-05 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.131820+0000", 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6565999999999999e-05 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.131976+0000", 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015645599999999999 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.132259+0000", 2024-05-07T14:04:37.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028236800000000002 2024-05-07T14:04:37.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:37.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.132496+0000", 2024-05-07T14:04:37.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023784500000000001 2024-05-07T14:04:37.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.144529+0000", 2024-05-07T14:04:37.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012032599999999999 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.154434+0000", 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0099045599999999998 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.154607+0000", 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017383599999999999 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.154727+0000", 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000119319 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:4210 3.34 3:2c95bc68:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_418:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:35.259844+0000", 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.979920296, 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028971927000000001, 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.341 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.342 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.342 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4210 2024-05-07T14:04:37.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.342 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.259844+0000", 2024-05-07T14:04:37.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.259844+0000", 2024-05-07T14:04:37.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.259848+0000", 2024-05-07T14:04:37.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0860000000000004e-06 2024-05-07T14:04:37.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.265576+0000", 2024-05-07T14:04:37.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057275490000000002 2024-05-07T14:04:37.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.265616+0000", 2024-05-07T14:04:37.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0405999999999999e-05 2024-05-07T14:04:37.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.265635+0000", 2024-05-07T14:04:37.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9267e-05 2024-05-07T14:04:37.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.265827+0000", 2024-05-07T14:04:37.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000191755 2024-05-07T14:04:37.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.266237+0000", 2024-05-07T14:04:37.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041012699999999999 2024-05-07T14:04:37.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 6", 2024-05-07T14:04:37.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.266657+0000", 2024-05-07T14:04:37.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000419634 2024-05-07T14:04:37.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.283720+0000", 2024-05-07T14:04:37.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017062957 2024-05-07T14:04:37.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.288469+0000", 2024-05-07T14:04:37.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047489849999999998 2024-05-07T14:04:37.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.288671+0000", 2024-05-07T14:04:37.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020240500000000001 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.288816+0000", 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014475600000000001 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:4211 3.9 3:93b3ad13:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_419:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:35.270262+0000", 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.969501868, 2024-05-07T14:04:37.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026553896, 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4211 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.270262+0000", 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.270262+0000", 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.270266+0000", 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3100000000000001e-06 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.276996+0000", 2024-05-07T14:04:37.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0067299839999999996 2024-05-07T14:04:37.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.277038+0000", 2024-05-07T14:04:37.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2256000000000003e-05 2024-05-07T14:04:37.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.277058+0000", 2024-05-07T14:04:37.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9944000000000001e-05 2024-05-07T14:04:37.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.277238+0000", 2024-05-07T14:04:37.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000179722 2024-05-07T14:04:37.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.277652+0000", 2024-05-07T14:04:37.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041446700000000001 2024-05-07T14:04:37.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 2", 2024-05-07T14:04:37.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.277890+0000", 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023830499999999999 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.290505+0000", 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012614733 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.296654+0000", 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061487030000000002 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.296749+0000", 2024-05-07T14:04:37.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5198999999999994e-05 2024-05-07T14:04:37.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.296816+0000", 2024-05-07T14:04:37.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7273000000000005e-05 2024-05-07T14:04:37.353 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.353 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.353 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.353 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.353 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.353 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:37.355 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-05-07T14:04:37.481 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:37.481 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:37.482 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:37.482 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:37.495 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-05-07T14:04:37.599 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:04:37.619 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:37.620 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:37.620 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:37.620 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:37.620 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:37.634 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-05-07T14:04:37.763 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2498 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch reconnect cookie 94397682178688 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.380548833999995, 2024-05-07T14:04:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.06015305, 2024-05-07T14:04:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2498 2024-05-07T14:04:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394884+0000", 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394887+0000", 2024-05-07T14:04:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7470000000000001e-06 2024-05-07T14:04:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394900+0000", 2024-05-07T14:04:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3125999999999999e-05 2024-05-07T14:04:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394940+0000", 2024-05-07T14:04:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9579999999999997e-05 2024-05-07T14:04:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.394961+0000", 2024-05-07T14:04:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1075999999999999e-05 2024-05-07T14:04:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395122+0000", 2024-05-07T14:04:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160741 2024-05-07T14:04:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395140+0000", 2024-05-07T14:04:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8640000000000001e-05 2024-05-07T14:04:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430325+0000", 2024-05-07T14:04:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.03518512 2024-05-07T14:04:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.430355+0000", 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9181999999999999e-05 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.445424+0000", 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.015069751 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.446159+0000", 2024-05-07T14:04:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00073452200000000004 2024-05-07T14:04:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450456+0000", 2024-05-07T14:04:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0042973689999999997 2024-05-07T14:04:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450627+0000", 2024-05-07T14:04:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017032700000000001 2024-05-07T14:04:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455037+0000", 2024-05-07T14:04:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0044108690000000004 2024-05-07T14:04:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2499 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.380419785000001, 2024-05-07T14:04:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.065623158, 2024-05-07T14:04:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2499 2024-05-07T14:04:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395013+0000", 2024-05-07T14:04:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395015+0000", 2024-05-07T14:04:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.57e-06 2024-05-07T14:04:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395022+0000", 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1330000000000001e-06 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395043+0000", 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1022999999999998e-05 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395060+0000", 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6325999999999999e-05 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395199+0000", 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000139815 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.395215+0000", 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5693e-05 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413112+0000", 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017896860000000001 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.413143+0000", 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1609000000000002e-05 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.447430+0000", 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0342867060000001 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for degraded object", 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.450079+0000", 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002648386 2024-05-07T14:04:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455213+0000", 2024-05-07T14:04:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051342749999999998 2024-05-07T14:04:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.455444+0000", 2024-05-07T14:04:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023070799999999999 2024-05-07T14:04:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.460637+0000", 2024-05-07T14:04:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051930539999999999 2024-05-07T14:04:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2667 7.0 7:05bf5b68:::notify.1:head [watch reconnect cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.125175220000003, 2024-05-07T14:04:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1292758329999999, 2024-05-07T14:04:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2667 2024-05-07T14:04:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650258+0000", 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650260+0000", 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1160000000000002e-06 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650270+0000", 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0047000000000001e-05 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650296+0000", 2024-05-07T14:04:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6058999999999999e-05 2024-05-07T14:04:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.650313+0000", 2024-05-07T14:04:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6727000000000001e-05 2024-05-07T14:04:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660781+0000", 2024-05-07T14:04:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010468518 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:39.660805+0000", 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3246000000000001e-05 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776636+0000", 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.115831102 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.776958+0000", 2024-05-07T14:04:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032243199999999999 2024-05-07T14:04:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.779534+0000", 2024-05-07T14:04:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025755859999999999 2024-05-07T14:04:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2674 7.0 7:05bf5b68:::notify.1:head [watch ping cookie 94397682174080 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-05-07T14:04:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 57.579751541, 2024-05-07T14:04:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58268987500000002, 2024-05-07T14:04:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2674 2024-05-07T14:04:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195682+0000", 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195683+0000", 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2500000000000001e-06 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195689+0000", 2024-05-07T14:04:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4300000000000003e-06 2024-05-07T14:04:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195702+0000", 2024-05-07T14:04:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3026e-05 2024-05-07T14:04:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195718+0000", 2024-05-07T14:04:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5532999999999998e-05 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195943+0000", 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022518899999999999 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.195971+0000", 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7688999999999999e-05 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.777763+0000", 2024-05-07T14:04:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.58179212899999999 2024-05-07T14:04:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778060+0000", 2024-05-07T14:04:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029683599999999997 2024-05-07T14:04:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:40.778372+0000", 2024-05-07T14:04:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031179299999999999 2024-05-07T14:04:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2685 3.1c 3:39954b5b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.979902520000003, 2024-05-07T14:04:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.034286608000000003, 2024-05-07T14:04:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2685 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795531+0000", 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.795533+0000", 2024-05-07T14:04:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3929999999999998e-06 2024-05-07T14:04:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803767+0000", 2024-05-07T14:04:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082339079999999999 2024-05-07T14:04:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803810+0000", 2024-05-07T14:04:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2969000000000001e-05 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.803837+0000", 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7036e-05 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804026+0000", 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018935600000000001 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804408+0000", 2024-05-07T14:04:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038137799999999998 2024-05-07T14:04:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.804786+0000", 2024-05-07T14:04:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037841200000000001 2024-05-07T14:04:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.823281+0000", 2024-05-07T14:04:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018494561999999999 2024-05-07T14:04:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829623+0000", 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063427279999999997 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829715+0000", 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1815000000000001e-05 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.829817+0000", 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102051 2024-05-07T14:04:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2689 3.2a 3:57071f6f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.936464899999997, 2024-05-07T14:04:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032293512000000003, 2024-05-07T14:04:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2689 2024-05-07T14:04:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838968+0000", 2024-05-07T14:04:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.838972+0000", 2024-05-07T14:04:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.72e-06 2024-05-07T14:04:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843363+0000", 2024-05-07T14:04:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043909810000000004 2024-05-07T14:04:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843407+0000", 2024-05-07T14:04:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4181999999999998e-05 2024-05-07T14:04:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843430+0000", 2024-05-07T14:04:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3139999999999999e-05 2024-05-07T14:04:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.843735+0000", 2024-05-07T14:04:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030467299999999999 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844287+0000", 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055224799999999998 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.844674+0000", 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038716199999999998 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.868480+0000", 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023805639999999999 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.870993+0000", 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025130920000000002 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871151+0000", 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000158176 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.871262+0000", 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110498 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2700 3.c 3:31d135ef:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.821450521000003, 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028853172999999999, 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2700 2024-05-07T14:04:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.953983+0000", 2024-05-07T14:04:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.954040+0000", 2024-05-07T14:04:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7735000000000002e-05 2024-05-07T14:04:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958710+0000", 2024-05-07T14:04:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046694220000000003 2024-05-07T14:04:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958759+0000", 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8671999999999997e-05 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958778+0000", 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.958955+0000", 2024-05-07T14:04:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177197 2024-05-07T14:04:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959253+0000", 2024-05-07T14:04:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029744999999999999 2024-05-07T14:04:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.959545+0000", 2024-05-07T14:04:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00029215699999999997 2024-05-07T14:04:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.969251+0000", 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097062789999999999 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982559+0000", 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013307818000000001 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982721+0000", 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016221200000000001 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.982836+0000", 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114605 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2782 3.5 3:a0760020:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.951679673999998, 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029185556000000001, 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2782 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823754+0000", 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.823757+0000", 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7330000000000001e-06 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829013+0000", 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052552889999999998 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829062+0000", 2024-05-07T14:04:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9375000000000001e-05 2024-05-07T14:04:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829089+0000", 2024-05-07T14:04:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7143000000000001e-05 2024-05-07T14:04:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829248+0000", 2024-05-07T14:04:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015877 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.829262+0000", 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.365e-05 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835685+0000", 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064232339999999999 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.835910+0000", 2024-05-07T14:04:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022484800000000001 2024-05-07T14:04:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.836115+0000", 2024-05-07T14:04:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000204916 2024-05-07T14:04:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.851571+0000", 2024-05-07T14:04:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.015456634 2024-05-07T14:04:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852768+0000", 2024-05-07T14:04:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001197264 2024-05-07T14:04:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852867+0000", 2024-05-07T14:04:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9011000000000005e-05 2024-05-07T14:04:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.852939+0000", 2024-05-07T14:04:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1688999999999998e-05 2024-05-07T14:04:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2793 3.30 3:0c9cfcfb:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.826026487, 2024-05-07T14:04:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028754691999999998, 2024-05-07T14:04:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2793 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949407+0000", 2024-05-07T14:04:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.949410+0000", 2024-05-07T14:04:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7239999999999998e-06 2024-05-07T14:04:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956008+0000", 2024-05-07T14:04:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065976560000000004 2024-05-07T14:04:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956068+0000", 2024-05-07T14:04:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9781999999999998e-05 2024-05-07T14:04:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956087+0000", 2024-05-07T14:04:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9009999999999999e-05 2024-05-07T14:04:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956241+0000", 2024-05-07T14:04:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015391600000000001 2024-05-07T14:04:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956640+0000", 2024-05-07T14:04:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039917499999999999 2024-05-07T14:04:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.956860+0000", 2024-05-07T14:04:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021961499999999999 2024-05-07T14:04:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.967010+0000", 2024-05-07T14:04:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01015011 2024-05-07T14:04:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.977827+0000", 2024-05-07T14:04:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010817148 2024-05-07T14:04:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978012+0000", 2024-05-07T14:04:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018541 2024-05-07T14:04:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.978161+0000", 2024-05-07T14:04:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014914600000000001 2024-05-07T14:04:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2865 3.38 e105/21 3:1c8ffe2e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_172:head v 105'7, mlcod=104'5)", 2024-05-07T14:04:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.190406901999999, 2024-05-07T14:04:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032748549000000002, 2024-05-07T14:04:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585026+0000", 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.585029+0000", 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9639999999999999e-06 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589707+0000", 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046776889999999996 2024-05-07T14:04:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589754+0000", 2024-05-07T14:04:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7382000000000001e-05 2024-05-07T14:04:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589780+0000", 2024-05-07T14:04:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5232000000000002e-05 2024-05-07T14:04:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.589966+0000", 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000186596 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.590031+0000", 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.5038999999999999e-05 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617527+0000", 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027496216 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.617775+0000", 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000247431 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2888 3.2 e105/46 3:403cdded:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_195:head v 105'8, mlcod=104'6)", 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.934344668999998, 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.033929095999999999, 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.826 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.827 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:37.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841089+0000", 2024-05-07T14:04:37.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.841091+0000", 2024-05-07T14:04:37.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.39e-06 2024-05-07T14:04:37.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.847981+0000", 2024-05-07T14:04:37.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068900630000000001 2024-05-07T14:04:37.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848020+0000", 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8846e-05 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848039+0000", 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9626000000000001e-05 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848222+0000", 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018251300000000001 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.848268+0000", 2024-05-07T14:04:37.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5552e-05 2024-05-07T14:04:37.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.874885+0000", 2024-05-07T14:04:37.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026617335999999998 2024-05-07T14:04:37.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.875018+0000", 2024-05-07T14:04:37.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013276999999999999 2024-05-07T14:04:37.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.831 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.831 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2894 3.16 3:6aec0fdf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:37.831 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:37.831 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.861698165999996, 2024-05-07T14:04:37.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029574030000000001, 2024-05-07T14:04:37.831 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.831 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.831 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.832 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.832 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.832 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.832 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2894 2024-05-07T14:04:37.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.832 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:37.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913735+0000", 2024-05-07T14:04:37.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.913738+0000", 2024-05-07T14:04:37.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.491e-06 2024-05-07T14:04:37.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917692+0000", 2024-05-07T14:04:37.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039540799999999996 2024-05-07T14:04:37.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917718+0000", 2024-05-07T14:04:37.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6211e-05 2024-05-07T14:04:37.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917732+0000", 2024-05-07T14:04:37.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4487999999999999e-05 2024-05-07T14:04:37.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.917897+0000", 2024-05-07T14:04:37.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016455199999999999 2024-05-07T14:04:37.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918296+0000", 2024-05-07T14:04:37.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000398825 2024-05-07T14:04:37.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:37.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.918724+0000", 2024-05-07T14:04:37.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042847399999999998 2024-05-07T14:04:37.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.933484+0000", 2024-05-07T14:04:37.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014759959 2024-05-07T14:04:37.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.942986+0000", 2024-05-07T14:04:37.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095014739999999993 2024-05-07T14:04:37.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943179+0000", 2024-05-07T14:04:37.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019320200000000001 2024-05-07T14:04:37.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.943309+0000", 2024-05-07T14:04:37.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013027399999999999 2024-05-07T14:04:37.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.837 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.838 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2896 3.3a 3:5f842f5c:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_203:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:37.838 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:37.838 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.840938502999997, 2024-05-07T14:04:37.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028429466, 2024-05-07T14:04:37.838 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.838 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.838 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.838 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.839 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.839 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.839 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2896 2024-05-07T14:04:37.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.839 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:37.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934495+0000", 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.934498+0000", 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.557e-06 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939927+0000", 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054289250000000002 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939955+0000", 2024-05-07T14:04:37.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8245000000000001e-05 2024-05-07T14:04:37.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.939971+0000", 2024-05-07T14:04:37.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.504e-05 2024-05-07T14:04:37.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940161+0000", 2024-05-07T14:04:37.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019040499999999999 2024-05-07T14:04:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940562+0000", 2024-05-07T14:04:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040076800000000002 2024-05-07T14:04:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.940979+0000", 2024-05-07T14:04:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041760099999999997 2024-05-07T14:04:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.950692+0000", 2024-05-07T14:04:37.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097127529999999993 2024-05-07T14:04:37.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962768+0000", 2024-05-07T14:04:37.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012075987 2024-05-07T14:04:37.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962863+0000", 2024-05-07T14:04:37.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5103000000000001e-05 2024-05-07T14:04:37.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.962924+0000", 2024-05-07T14:04:37.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.1081999999999996e-05 2024-05-07T14:04:37.844 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.844 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.844 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.844 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3197 3.d e113/21 3:b35829be:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_89:head v 113'16, mlcod=113'14)", 2024-05-07T14:04:37.844 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:37.844 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.440254054, 2024-05-07T14:04:37.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029081169, 2024-05-07T14:04:37.845 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.845 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.845 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.845 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:37.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335179+0000", 2024-05-07T14:04:37.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.335182+0000", 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7329999999999999e-06 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338859+0000", 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0036773589999999998 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338896+0000", 2024-05-07T14:04:37.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6656000000000003e-05 2024-05-07T14:04:37.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.338922+0000", 2024-05-07T14:04:37.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5936999999999999e-05 2024-05-07T14:04:37.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339046+0000", 2024-05-07T14:04:37.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012458400000000001 2024-05-07T14:04:37.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339089+0000", 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2342999999999998e-05 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.364123+0000", 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025034187999999999 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.364260+0000", 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013736900000000001 2024-05-07T14:04:37.848 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.849 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.849 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.849 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3210 3.2f 3:f67c3789:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:37.849 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:37.849 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.308490297999999, 2024-05-07T14:04:37.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042403633000000003, 2024-05-07T14:04:37.849 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.849 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.849 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.849 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.849 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3210 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466943+0000", 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.466947+0000", 2024-05-07T14:04:37.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5669999999999999e-06 2024-05-07T14:04:37.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471128+0000", 2024-05-07T14:04:37.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041817620000000003 2024-05-07T14:04:37.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471175+0000", 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6279000000000002e-05 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471200+0000", 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5177e-05 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471361+0000", 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160848 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:37.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.471379+0000", 2024-05-07T14:04:37.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8142e-05 2024-05-07T14:04:37.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.479968+0000", 2024-05-07T14:04:37.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085897040000000001 2024-05-07T14:04:37.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.480366+0000", 2024-05-07T14:04:37.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039736399999999999 2024-05-07T14:04:37.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:37.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.480736+0000", 2024-05-07T14:04:37.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00037031899999999998 2024-05-07T14:04:37.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.495479+0000", 2024-05-07T14:04:37.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014742992 2024-05-07T14:04:37.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509169+0000", 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013690179 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509268+0000", 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8814999999999995e-05 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.509347+0000", 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8485000000000005e-05 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.855 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3604 3.1c 3:3a3fe722:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_485:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.152001+0000", 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.623431743000001, 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038767554000000003, 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.856 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3604 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.152001+0000", 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.152001+0000", 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.152004+0000", 2024-05-07T14:04:37.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8899999999999999e-06 2024-05-07T14:04:37.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.156819+0000", 2024-05-07T14:04:37.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0048148369999999998 2024-05-07T14:04:37.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.156860+0000", 2024-05-07T14:04:37.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0355999999999998e-05 2024-05-07T14:04:37.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.156878+0000", 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.878e-05 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157060+0000", 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000181991 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157341+0000", 2024-05-07T14:04:37.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028081599999999998 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.157583+0000", 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241506 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.169148+0000", 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011565242 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190604+0000", 2024-05-07T14:04:37.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.021456052 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190700+0000", 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.6164999999999998e-05 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.190769+0000", 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8918999999999995e-05 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.862 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3611 3.16 3:6a1fde75:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_492:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-05-07T14:04:37.862 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:12.231125+0000", 2024-05-07T14:04:37.862 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 25.544308039000001, 2024-05-07T14:04:37.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032234160999999997, 2024-05-07T14:04:37.862 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.862 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.862 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.862 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.862 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.862 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.862 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3611 2024-05-07T14:04:37.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.231125+0000", 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.231125+0000", 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.231130+0000", 2024-05-07T14:04:37.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9629999999999997e-06 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235158+0000", 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040282679999999998 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235197+0000", 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8654e-05 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235216+0000", 2024-05-07T14:04:37.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9099000000000001e-05 2024-05-07T14:04:37.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235350+0000", 2024-05-07T14:04:37.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013348200000000001 2024-05-07T14:04:37.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235617+0000", 2024-05-07T14:04:37.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026753900000000001 2024-05-07T14:04:37.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:37.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.235861+0000", 2024-05-07T14:04:37.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024357299999999999 2024-05-07T14:04:37.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.249418+0000", 2024-05-07T14:04:37.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013557394 2024-05-07T14:04:37.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.263075+0000", 2024-05-07T14:04:37.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013656423000000001 2024-05-07T14:04:37.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.263246+0000", 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000170944 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:12.263359+0000", 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113822 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3797 3.22 3:4492e4e3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:30.800180+0000", 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.9752535, 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.032651303, 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3797 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.800180+0000", 2024-05-07T14:04:37.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.800180+0000", 2024-05-07T14:04:37.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.800183+0000", 2024-05-07T14:04:37.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0759999999999999e-06 2024-05-07T14:04:37.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.805518+0000", 2024-05-07T14:04:37.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053347350000000002 2024-05-07T14:04:37.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.805560+0000", 2024-05-07T14:04:37.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.21e-05 2024-05-07T14:04:37.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.805579+0000", 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9193000000000001e-05 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.805725+0000", 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014649199999999999 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.805989+0000", 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026405500000000002 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:37.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.806297+0000", 2024-05-07T14:04:37.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000307201 2024-05-07T14:04:37.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.815383+0000", 2024-05-07T14:04:37.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090860969999999996 2024-05-07T14:04:37.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.832522+0000", 2024-05-07T14:04:37.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017138863000000001 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.832700+0000", 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017848199999999999 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.832831+0000", 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013100899999999999 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.874 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3866 3.5 3:a35b7c92:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:37.874 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:31.516733+0000", 2024-05-07T14:04:37.874 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.2587002290000004, 2024-05-07T14:04:37.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028115520000000001, 2024-05-07T14:04:37.874 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.874 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.874 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.874 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.874 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.874 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.874 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3866 2024-05-07T14:04:37.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.516733+0000", 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.516733+0000", 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.516737+0000", 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4970000000000001e-06 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.520765+0000", 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040286289999999997 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.520803+0000", 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7557e-05 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.520829+0000", 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5850000000000002e-05 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.520991+0000", 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016254799999999999 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.521239+0000", 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024758899999999999 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 3", 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.521465+0000", 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022615100000000001 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.530955+0000", 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0094900309999999995 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.544541+0000", 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013585836 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.544723+0000", 2024-05-07T14:04:37.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018261300000000001 2024-05-07T14:04:37.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.544849+0000", 2024-05-07T14:04:37.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012521900000000001 2024-05-07T14:04:37.879 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.879 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.879 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3912 3.3a 3:5dd9463d:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:32.023863+0000", 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.751570579, 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.039843806000000002, 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3912 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.023863+0000", 2024-05-07T14:04:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.023863+0000", 2024-05-07T14:04:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.023889+0000", 2024-05-07T14:04:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5890000000000001e-05 2024-05-07T14:04:37.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.032910+0000", 2024-05-07T14:04:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0090210370000000008 2024-05-07T14:04:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.032940+0000", 2024-05-07T14:04:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0703000000000001e-05 2024-05-07T14:04:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.032966+0000", 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5534e-05 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.033147+0000", 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018089899999999999 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.033400+0000", 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025369800000000001 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.033676+0000", 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000275908 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.044129+0000", 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010452253999999999 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.063522+0000", 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.019393081 2024-05-07T14:04:37.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.063627+0000", 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000105163 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.063706+0000", 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9639000000000001e-05 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:37.885 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:37.886 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:37.887 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-05-07T14:04:38.016 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:38.016 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:38.016 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:04:38.017 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:38.031 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-05-07T14:04:38.153 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:38.153 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:04:38.154 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-05-07T14:04:38.154 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-05-07T14:04:38.154 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:38.168 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-05-07T14:04:38.289 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:04:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-05-07T14:04:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-05-07T14:04:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-05-07T14:04:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.289 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2207 3.26 3:67b33233:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9__shadow_.ACqWJy4PSdeBAUBL_pQVTqS9z4CqdLb_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-05-07T14:04:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.961158636999997, 2024-05-07T14:04:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029257551999999999, 2024-05-07T14:04:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2207 2024-05-07T14:04:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.290 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338596+0000", 2024-05-07T14:04:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.338601+0000", 2024-05-07T14:04:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0769999999999998e-06 2024-05-07T14:04:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344166+0000", 2024-05-07T14:04:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055649139999999998 2024-05-07T14:04:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344203+0000", 2024-05-07T14:04:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7109e-05 2024-05-07T14:04:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344221+0000", 2024-05-07T14:04:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7603000000000001e-05 2024-05-07T14:04:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344394+0000", 2024-05-07T14:04:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000173208 2024-05-07T14:04:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.344788+0000", 2024-05-07T14:04:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00039418400000000001 2024-05-07T14:04:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:38.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.345265+0000", 2024-05-07T14:04:38.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047689299999999999 2024-05-07T14:04:38.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.365597+0000", 2024-05-07T14:04:38.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.020331954999999999 2024-05-07T14:04:38.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367512+0000", 2024-05-07T14:04:38.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001915237 2024-05-07T14:04:38.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367693+0000", 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018108800000000001 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:03.367853+0000", 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016028400000000001 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2507 4.27 4:e7ecbebf:::.dir.c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.9.0:head [call rgw.bucket_list in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e86)", 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.884050099000007, 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.019773713, 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2507 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:38.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415704+0000", 2024-05-07T14:04:38.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415708+0000", 2024-05-07T14:04:38.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4860000000000002e-06 2024-05-07T14:04:38.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415724+0000", 2024-05-07T14:04:38.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.643e-05 2024-05-07T14:04:38.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415759+0000", 2024-05-07T14:04:38.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4252999999999999e-05 2024-05-07T14:04:38.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.415783+0000", 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4315999999999999e-05 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419072+0000", 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032886119999999998 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:06.419099+0000", 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6956000000000001e-05 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435061+0000", 2024-05-07T14:04:38.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0159622509999999 2024-05-07T14:04:38.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435231+0000", 2024-05-07T14:04:38.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016978800000000001 2024-05-07T14:04:38.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:07.435478+0000", 2024-05-07T14:04:38.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024762100000000001 2024-05-07T14:04:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2695 3.35 3:acf2d7d8:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.398317345000002, 2024-05-07T14:04:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028454303, 2024-05-07T14:04:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.302 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2695 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901437+0000", 2024-05-07T14:04:38.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.901441+0000", 2024-05-07T14:04:38.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9600000000000002e-06 2024-05-07T14:04:38.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907573+0000", 2024-05-07T14:04:38.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061315939999999998 2024-05-07T14:04:38.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907630+0000", 2024-05-07T14:04:38.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6818999999999999e-05 2024-05-07T14:04:38.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907649+0000", 2024-05-07T14:04:38.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9859000000000001e-05 2024-05-07T14:04:38.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.907857+0000", 2024-05-07T14:04:38.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000207159 2024-05-07T14:04:38.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.908127+0000", 2024-05-07T14:04:38.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027069099999999999 2024-05-07T14:04:38.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:38.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.908468+0000", 2024-05-07T14:04:38.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00034104600000000001 2024-05-07T14:04:38.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.918062+0000", 2024-05-07T14:04:38.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095934409999999994 2024-05-07T14:04:38.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929718+0000", 2024-05-07T14:04:38.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.011656141 2024-05-07T14:04:38.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929819+0000", 2024-05-07T14:04:38.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100634 2024-05-07T14:04:38.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:43.929892+0000", 2024-05-07T14:04:38.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2959000000000004e-05 2024-05-07T14:04:38.308 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.308 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.308 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.308 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2719 3.10 3:0b5df28b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:38.308 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:38.308 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.123226948999999, 2024-05-07T14:04:38.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028912935000000001, 2024-05-07T14:04:38.310 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.310 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.310 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.310 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.310 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.310 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.310 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2719 2024-05-07T14:04:38.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.310 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176528+0000", 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.176531+0000", 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3699999999999999e-06 2024-05-07T14:04:38.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182042+0000", 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00551105 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182083+0000", 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1402000000000001e-05 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182103+0000", 2024-05-07T14:04:38.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9953e-05 2024-05-07T14:04:38.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182262+0000", 2024-05-07T14:04:38.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015816699999999999 2024-05-07T14:04:38.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182545+0000", 2024-05-07T14:04:38.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028303999999999997 2024-05-07T14:04:38.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.182779+0000", 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023474800000000001 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.195512+0000", 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012733081 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205013+0000", 2024-05-07T14:04:38.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0095007670000000002 2024-05-07T14:04:38.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205264+0000", 2024-05-07T14:04:38.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025112099999999998 2024-05-07T14:04:38.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.205441+0000", 2024-05-07T14:04:38.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176236 2024-05-07T14:04:38.315 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.315 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.315 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.316 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2734 3.a 3:5117726b:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-05-07T14:04:38.316 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:38.316 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.971105923000003, 2024-05-07T14:04:38.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026910749000000001, 2024-05-07T14:04:38.316 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.316 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.316 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.316 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.316 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.316 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.316 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2734 2024-05-07T14:04:38.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.317 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:38.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328649+0000", 2024-05-07T14:04:38.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.328652+0000", 2024-05-07T14:04:38.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.9500000000000001e-06 2024-05-07T14:04:38.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333686+0000", 2024-05-07T14:04:38.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050342010000000003 2024-05-07T14:04:38.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333726+0000", 2024-05-07T14:04:38.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9802000000000003e-05 2024-05-07T14:04:38.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333753+0000", 2024-05-07T14:04:38.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7702999999999999e-05 2024-05-07T14:04:38.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.333900+0000", 2024-05-07T14:04:38.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014663999999999999 2024-05-07T14:04:38.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.334151+0000", 2024-05-07T14:04:38.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025143799999999999 2024-05-07T14:04:38.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:38.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.334390+0000", 2024-05-07T14:04:38.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000238268 2024-05-07T14:04:38.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.346870+0000", 2024-05-07T14:04:38.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012480753000000001 2024-05-07T14:04:38.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355331+0000", 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084610090000000002 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355483+0000", 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015194000000000001 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.355559+0000", 2024-05-07T14:04:38.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6044999999999994e-05 2024-05-07T14:04:38.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.322 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.322 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2786 3.20 3:043afb92:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:38.322 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:38.322 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.427882201000003, 2024-05-07T14:04:38.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026616246, 2024-05-07T14:04:38.322 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.322 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.322 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2786 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871872+0000", 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.871877+0000", 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2969999999999997e-06 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876185+0000", 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004308503 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876223+0000", 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7852000000000003e-05 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876242+0000", 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9253999999999999e-05 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876395+0000", 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015306599999999999 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876685+0000", 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00028964699999999997 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.876925+0000", 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023967500000000001 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.885744+0000", 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008819749 2024-05-07T14:04:38.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898308+0000", 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012563710000000001 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898410+0000", 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101582 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:44.898489+0000", 2024-05-07T14:04:38.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8911000000000004e-05 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:2807 3.3f e105/21 3:fd0db1b2:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_124:head v 105'6, mlcod=85'4)", 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 53.198802401999998, 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026784641000000001, 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100952+0000", 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.100955+0000", 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8200000000000001e-06 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105915+0000", 2024-05-07T14:04:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049600290000000003 2024-05-07T14:04:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105956+0000", 2024-05-07T14:04:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1205000000000003e-05 2024-05-07T14:04:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.105973+0000", 2024-05-07T14:04:38.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7087000000000001e-05 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.106125+0000", 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015208299999999999 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.106192+0000", 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6809000000000004e-05 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.127628+0000", 2024-05-07T14:04:38.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02143579 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:45.127737+0000", 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000108818 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2912 3.36 3:6fcd222f:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_219:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.161326340999999, 2024-05-07T14:04:38.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02818507, 2024-05-07T14:04:38.333 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.333 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.333 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.333 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.333 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.333 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.333 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2912 2024-05-07T14:04:38.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.333 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:38.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138428+0000", 2024-05-07T14:04:38.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.138433+0000", 2024-05-07T14:04:38.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0069999999999997e-06 2024-05-07T14:04:38.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.143973+0000", 2024-05-07T14:04:38.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055392719999999996 2024-05-07T14:04:38.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144024+0000", 2024-05-07T14:04:38.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1128999999999998e-05 2024-05-07T14:04:38.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144044+0000", 2024-05-07T14:04:38.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0526e-05 2024-05-07T14:04:38.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144267+0000", 2024-05-07T14:04:38.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022246500000000001 2024-05-07T14:04:38.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144532+0000", 2024-05-07T14:04:38.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026575900000000001 2024-05-07T14:04:38.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:38.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.144805+0000", 2024-05-07T14:04:38.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027290000000000002 2024-05-07T14:04:38.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.162814+0000", 2024-05-07T14:04:38.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018008631000000001 2024-05-07T14:04:38.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166347+0000", 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035334429999999998 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166490+0000", 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014308699999999999 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.166613+0000", 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012285099999999999 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.338 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:2918 3.10 3:0a57f05a:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.10__shadow_.tt3iOk1kNm7YqMmDobA68B6gB86VhkK_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 52.092942753000003, 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030233789, 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 2918 2024-05-07T14:04:38.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206812+0000", 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.206816+0000", 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.6229999999999996e-06 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.210992+0000", 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0041755799999999999 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211043+0000", 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0584999999999998e-05 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211070+0000", 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7716999999999999e-05 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211251+0000", 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000180683 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.211678+0000", 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042701099999999998 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:38.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.212087+0000", 2024-05-07T14:04:38.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00040911799999999998 2024-05-07T14:04:38.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.222312+0000", 2024-05-07T14:04:38.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010224551 2024-05-07T14:04:38.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.236912+0000", 2024-05-07T14:04:38.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014600548 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.236982+0000", 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9476999999999999e-05 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:03:46.237046+0000", 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3895999999999999e-05 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.345 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3198 3.2c 3:34ce24fc:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_90:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-05-07T14:04:38.345 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:38.345 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.959840388, 2024-05-07T14:04:38.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026711016000000001, 2024-05-07T14:04:38.345 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.345 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.345 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.345 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.345 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.345 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.346 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3198 2024-05-07T14:04:38.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.346 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:38.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339914+0000", 2024-05-07T14:04:38.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.339918+0000", 2024-05-07T14:04:38.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6820000000000001e-06 2024-05-07T14:04:38.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.343982+0000", 2024-05-07T14:04:38.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040642320000000001 2024-05-07T14:04:38.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344027+0000", 2024-05-07T14:04:38.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5024999999999997e-05 2024-05-07T14:04:38.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344052+0000", 2024-05-07T14:04:38.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4603000000000001e-05 2024-05-07T14:04:38.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344190+0000", 2024-05-07T14:04:38.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013819 2024-05-07T14:04:38.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344377+0000", 2024-05-07T14:04:38.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018666200000000001 2024-05-07T14:04:38.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:38.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.344585+0000", 2024-05-07T14:04:38.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000208452 2024-05-07T14:04:38.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.362586+0000", 2024-05-07T14:04:38.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018000754000000001 2024-05-07T14:04:38.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366457+0000", 2024-05-07T14:04:38.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003871542 2024-05-07T14:04:38.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366546+0000", 2024-05-07T14:04:38.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8601000000000001e-05 2024-05-07T14:04:38.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.366625+0000", 2024-05-07T14:04:38.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9272999999999998e-05 2024-05-07T14:04:38.351 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.351 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.352 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3208 3.26 3:66fd0e21:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.11__shadow_.tYBpGKA0P0Ylok5pbMr-uKVd-WmlrbN_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-05-07T14:04:38.352 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:38.352 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 30.850502043999999, 2024-05-07T14:04:38.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041868750000000003, 2024-05-07T14:04:38.352 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.352 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.352 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.352 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.352 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.352 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3208 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449253+0000", 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.449257+0000", 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.07e-06 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455814+0000", 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065570660000000003 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455854+0000", 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0819999999999999e-05 2024-05-07T14:04:38.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.455874+0000", 2024-05-07T14:04:38.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9993e-05 2024-05-07T14:04:38.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.456063+0000", 2024-05-07T14:04:38.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018892400000000001 2024-05-07T14:04:38.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:38.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.456077+0000", 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3433e-05 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.462635+0000", 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065577869999999998 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.462869+0000", 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023394299999999999 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 7", 2024-05-07T14:04:38.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.463127+0000", 2024-05-07T14:04:38.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0002588 2024-05-07T14:04:38.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.473024+0000", 2024-05-07T14:04:38.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0098969100000000001 2024-05-07T14:04:38.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.490912+0000", 2024-05-07T14:04:38.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017887291 2024-05-07T14:04:38.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.491010+0000", 2024-05-07T14:04:38.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8041999999999994e-05 2024-05-07T14:04:38.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:07.491121+0000", 2024-05-07T14:04:38.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111671 2024-05-07T14:04:38.358 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.358 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.358 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.359 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3738 6.5 6:a60f9269:lc::lua_package_allowlist:head [watch reconnect cookie 94397699570432 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119)", 2024-05-07T14:04:38.359 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:22.471993+0000", 2024-05-07T14:04:38.359 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 15.827761201, 2024-05-07T14:04:38.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0312905320000001, 2024-05-07T14:04:38.359 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.359 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.359 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-05-07T14:04:38.359 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.359 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.359 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.359 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3738 2024-05-07T14:04:38.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.359 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.471993+0000", 2024-05-07T14:04:38.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.471993+0000", 2024-05-07T14:04:38.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.471995+0000", 2024-05-07T14:04:38.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.559e-06 2024-05-07T14:04:38.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.472002+0000", 2024-05-07T14:04:38.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5310000000000004e-06 2024-05-07T14:04:38.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.472024+0000", 2024-05-07T14:04:38.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1056e-05 2024-05-07T14:04:38.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.472037+0000", 2024-05-07T14:04:38.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3115000000000001e-05 2024-05-07T14:04:38.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.472129+0000", 2024-05-07T14:04:38.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2788000000000007e-05 2024-05-07T14:04:38.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op must wait for map", 2024-05-07T14:04:38.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.472139+0000", 2024-05-07T14:04:38.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8460000000000003e-06 2024-05-07T14:04:38.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.475635+0000", 2024-05-07T14:04:38.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003496178 2024-05-07T14:04:38.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for peered", 2024-05-07T14:04:38.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:22.475648+0000", 2024-05-07T14:04:38.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2499e-05 2024-05-07T14:04:38.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:23.498819+0000", 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023170562 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:23.499276+0000", 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00045746799999999999 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:23.503284+0000", 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0040079299999999998 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.364 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3787 3.2c 3:37fb638e:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:30.694378+0000", 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6053765670000004, 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043341109000000003, 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3787 2024-05-07T14:04:38.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.694378+0000", 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.694378+0000", 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.694381+0000", 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2799999999999999e-06 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.701712+0000", 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007330975 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.701756+0000", 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4186e-05 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.701777+0000", 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0086999999999999e-05 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.701918+0000", 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141519 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.702178+0000", 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00025992499999999999 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.702419+0000", 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024099200000000001 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.733928+0000", 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.031508797999999998 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.737550+0000", 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.003622625 2024-05-07T14:04:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.737648+0000", 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8096000000000004e-05 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.737719+0000", 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0625999999999998e-05 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3788 3.2c 3:379037a6:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:30.705206+0000", 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.5945490219999998, 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.038326198999999998, 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3788 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.705206+0000", 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.705206+0000", 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.705210+0000", 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9700000000000001e-06 2024-05-07T14:04:38.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.712301+0000", 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070913160000000003 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.712341+0000", 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9694000000000003e-05 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.712359+0000", 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8773000000000001e-05 2024-05-07T14:04:38.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.722750+0000", 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010390524 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.723289+0000", 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00053962599999999997 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.723743+0000", 2024-05-07T14:04:38.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000453747 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.739932+0000", 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016188580000000001 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.743257+0000", 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0033249249999999998 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.743416+0000", 2024-05-07T14:04:38.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015921199999999999 2024-05-07T14:04:38.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:30.743532+0000", 2024-05-07T14:04:38.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000115832 2024-05-07T14:04:38.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.376 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.376 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.376 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3827 3.36 3:6e645265:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:38.376 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:31.098916+0000", 2024-05-07T14:04:38.377 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.2008383809999996, 2024-05-07T14:04:38.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.030381939, 2024-05-07T14:04:38.377 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.377 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.377 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.377 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.377 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.377 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.377 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3827 2024-05-07T14:04:38.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.377 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.098916+0000", 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.098916+0000", 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.098920+0000", 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.467e-06 2024-05-07T14:04:38.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.102740+0000", 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0038198619999999998 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.102789+0000", 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9595999999999997e-05 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.102817+0000", 2024-05-07T14:04:38.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7416999999999999e-05 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.103019+0000", 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00020203899999999999 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.103436+0000", 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041759700000000002 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.103866+0000", 2024-05-07T14:04:38.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042964000000000001 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.128426+0000", 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024559750000000002 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.129076+0000", 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00065046400000000001 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.129164+0000", 2024-05-07T14:04:38.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7856999999999996e-05 2024-05-07T14:04:38.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.129298+0000", 2024-05-07T14:04:38.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013425000000000001 2024-05-07T14:04:38.382 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.382 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.382 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.382 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3847 3.a 3:509f0286:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122)", 2024-05-07T14:04:38.382 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:31.307514+0000", 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.992240894, 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.029016228000000002, 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3847 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.307514+0000", 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.307514+0000", 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.307517+0000", 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6200000000000001e-06 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.312446+0000", 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049291150000000004 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.312486+0000", 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9486000000000001e-05 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.312505+0000", 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8983000000000001e-05 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.312641+0000", 2024-05-07T14:04:38.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000135659 2024-05-07T14:04:38.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.312903+0000", 2024-05-07T14:04:38.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000262735 2024-05-07T14:04:38.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 4", 2024-05-07T14:04:38.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.313135+0000", 2024-05-07T14:04:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000232148 2024-05-07T14:04:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.326258+0000", 2024-05-07T14:04:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013122480000000001 2024-05-07T14:04:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.336343+0000", 2024-05-07T14:04:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010084747 2024-05-07T14:04:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.336452+0000", 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000109566 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:31.336530+0000", 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7688999999999994e-05 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.388 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3922 3.20 3:07bc31e5:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:32.146911+0000", 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.1528436160000002, 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028209136999999999, 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3922 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.146911+0000", 2024-05-07T14:04:38.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.146911+0000", 2024-05-07T14:04:38.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.146916+0000", 2024-05-07T14:04:38.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8770000000000001e-06 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.157730+0000", 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010814218 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.157782+0000", 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2203000000000001e-05 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.157810+0000", 2024-05-07T14:04:38.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7537000000000001e-05 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.157987+0000", 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00017720600000000001 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.158252+0000", 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000265331 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-05-07T14:04:38.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.158496+0000", 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024320799999999999 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.171424+0000", 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012928614 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.174944+0000", 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0035202440000000001 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.175040+0000", 2024-05-07T14:04:38.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5136000000000005e-05 2024-05-07T14:04:38.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.175120+0000", 2024-05-07T14:04:38.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0562999999999994e-05 2024-05-07T14:04:38.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.394 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.394 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4464.0:3923 3.1e e123/21 3:78b90cbf:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_141:head v 123'14, mlcod=115'12)", 2024-05-07T14:04:38.394 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:32.158011+0000", 2024-05-07T14:04:38.395 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.1417439590000003, 2024-05-07T14:04:38.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026293189000000002, 2024-05-07T14:04:38.395 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.395 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.395 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.395 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.158011+0000", 2024-05-07T14:04:38.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.158011+0000", 2024-05-07T14:04:38.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.158039+0000", 2024-05-07T14:04:38.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8408999999999999e-05 2024-05-07T14:04:38.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.167688+0000", 2024-05-07T14:04:38.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096488900000000002 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.167722+0000", 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3973000000000002e-05 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.167739+0000", 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6779999999999999e-05 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.167897+0000", 2024-05-07T14:04:38.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015854899999999999 2024-05-07T14:04:38.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.167965+0000", 2024-05-07T14:04:38.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7996000000000004e-05 2024-05-07T14:04:38.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.184211+0000", 2024-05-07T14:04:38.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016246109000000002 2024-05-07T14:04:38.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.184304+0000", 2024-05-07T14:04:38.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2483000000000002e-05 2024-05-07T14:04:38.399 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.399 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.399 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.399 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:3926 3.36 3:6d74aff1:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-05-07T14:04:38.399 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:32.185508+0000", 2024-05-07T14:04:38.399 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.1142467319999998, 2024-05-07T14:04:38.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026242286, 2024-05-07T14:04:38.399 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.400 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.400 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.400 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.400 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.400 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.400 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3926 2024-05-07T14:04:38.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.400 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.185508+0000", 2024-05-07T14:04:38.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.185508+0000", 2024-05-07T14:04:38.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.185511+0000", 2024-05-07T14:04:38.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2270000000000002e-06 2024-05-07T14:04:38.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.190572+0000", 2024-05-07T14:04:38.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050609569999999996 2024-05-07T14:04:38.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.190615+0000", 2024-05-07T14:04:38.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2669000000000001e-05 2024-05-07T14:04:38.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.190634+0000", 2024-05-07T14:04:38.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.925e-05 2024-05-07T14:04:38.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.190789+0000", 2024-05-07T14:04:38.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000155129 2024-05-07T14:04:38.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.191213+0000", 2024-05-07T14:04:38.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00042430400000000002 2024-05-07T14:04:38.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:38.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.191633+0000", 2024-05-07T14:04:38.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041943699999999999 2024-05-07T14:04:38.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.205751+0000", 2024-05-07T14:04:38.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.01411772 2024-05-07T14:04:38.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.211571+0000", 2024-05-07T14:04:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058205180000000002 2024-05-07T14:04:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.211673+0000", 2024-05-07T14:04:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101802 2024-05-07T14:04:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:32.211750+0000", 2024-05-07T14:04:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7273000000000004e-05 2024-05-07T14:04:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.405 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4464.0:4273 3.35 3:ac351fd3:::c956e04a-d9ee-4a74-8bac-922bf2eb8512.4464.12__shadow_.UxMLzhz9k5qFpayAoCTDoG71oTcnCp-_481:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-05-07T14:04:35.940868+0000", 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 2.3588861579999998, 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.027380921999999999, 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: "continuous": false, 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4464", 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "172.21.15.106:0/364235150", 2024-05-07T14:04:38.406 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 4273 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.940868+0000", 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.940868+0000", 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-05-07T14:04:38.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.940872+0000", 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6370000000000001e-06 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.944842+0000", 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039698529999999998 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.944886+0000", 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4332999999999997e-05 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.944909+0000", 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2464e-05 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.945043+0000", 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000134785 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.945305+0000", 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00026138499999999999 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 5", 2024-05-07T14:04:38.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.945530+0000", 2024-05-07T14:04:38.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022524900000000001 2024-05-07T14:04:38.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-05-07T14:04:38.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.962143+0000", 2024-05-07T14:04:38.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016612439999999999 2024-05-07T14:04:38.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-05-07T14:04:38.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.967960+0000", 2024-05-07T14:04:38.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058176010000000004 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.968115+0000", 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00015455500000000001 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-05-07T14:04:35.968249+0000", 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013462000000000001 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-05-07T14:04:38.411 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-05-07T14:04:38.412 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:04:39.623 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-05-07T14:04:40.594 INFO:teuthology.orchestra.run.smithi106.stderr:noscrub is unset 2024-05-07T14:04:40.619 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-05-07T14:04:41.598 INFO:teuthology.orchestra.run.smithi106.stderr:nodeep-scrub is unset 2024-05-07T14:04:51.874 INFO:tasks.thrashosds.thrasher:reviving osd 2024-05-07T14:04:51.875 INFO:tasks.thrashosds.thrasher:Reviving osd 7 2024-05-07T14:04:51.875 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-07T14:04:51.875 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-07T14:04:51.878 INFO:tasks.ceph.osd.7:Started 2024-05-07T14:04:51.878 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:04:52.001 INFO:teuthology.orchestra.run.smithi107.stderr:no valid command found; 10 closest matches: 2024-05-07T14:04:52.001 INFO:teuthology.orchestra.run.smithi107.stderr:0 2024-05-07T14:04:52.001 INFO:teuthology.orchestra.run.smithi107.stderr:1 2024-05-07T14:04:52.001 INFO:teuthology.orchestra.run.smithi107.stderr:2 2024-05-07T14:04:52.001 INFO:teuthology.orchestra.run.smithi107.stderr:abort 2024-05-07T14:04:52.001 INFO:teuthology.orchestra.run.smithi107.stderr:assert 2024-05-07T14:04:52.001 INFO:teuthology.orchestra.run.smithi107.stderr:config diff 2024-05-07T14:04:52.002 INFO:teuthology.orchestra.run.smithi107.stderr:config diff get 2024-05-07T14:04:52.002 INFO:teuthology.orchestra.run.smithi107.stderr:config get 2024-05-07T14:04:52.002 INFO:teuthology.orchestra.run.smithi107.stderr:config help [] 2024-05-07T14:04:52.002 INFO:teuthology.orchestra.run.smithi107.stderr:config set ... 2024-05-07T14:04:52.002 INFO:teuthology.orchestra.run.smithi107.stderr:admin_socket: invalid command 2024-05-07T14:04:52.004 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-07T14:04:52.004 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-7, ['dump_ops_in_flight'] 2024-05-07T14:04:52.501 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:52.511+0000 7f431d4187c0 -1 Falling back to public interface 2024-05-07T14:04:56.576 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:56.587+0000 7f431d4187c0 -1 osd.7 118 log_to_monitors true 2024-05-07T14:04:57.006 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:04:57.134 INFO:teuthology.orchestra.run.smithi107.stderr:no valid command found; 10 closest matches: 2024-05-07T14:04:57.134 INFO:teuthology.orchestra.run.smithi107.stderr:0 2024-05-07T14:04:57.134 INFO:teuthology.orchestra.run.smithi107.stderr:1 2024-05-07T14:04:57.134 INFO:teuthology.orchestra.run.smithi107.stderr:2 2024-05-07T14:04:57.134 INFO:teuthology.orchestra.run.smithi107.stderr:abort 2024-05-07T14:04:57.134 INFO:teuthology.orchestra.run.smithi107.stderr:assert 2024-05-07T14:04:57.135 INFO:teuthology.orchestra.run.smithi107.stderr:bluefs debug_inject_read_zeros 2024-05-07T14:04:57.135 INFO:teuthology.orchestra.run.smithi107.stderr:bluefs files list 2024-05-07T14:04:57.135 INFO:teuthology.orchestra.run.smithi107.stderr:bluefs stats 2024-05-07T14:04:57.135 INFO:teuthology.orchestra.run.smithi107.stderr:bluestore allocator dump block 2024-05-07T14:04:57.135 INFO:teuthology.orchestra.run.smithi107.stderr:bluestore allocator fragmentation block 2024-05-07T14:04:57.135 INFO:teuthology.orchestra.run.smithi107.stderr:admin_socket: invalid command 2024-05-07T14:04:57.137 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-07T14:04:57.137 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-7, ['dump_ops_in_flight'] 2024-05-07T14:04:57.432 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-07T14:04:57.439+0000 7f43111e5640 -1 osd.7 128 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-07T14:05:02.138 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-05-07T14:05:02.272 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-05-07T14:05:02.272 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-05-07T14:05:02.272 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-05-07T14:05:02.272 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-05-07T14:05:02.286 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-05-07T14:05:02.439 INFO:teuthology.orchestra.run.smithi106.stdout:mon.a: {} 2024-05-07T14:05:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-07T14:05:02.452 INFO:teuthology.orchestra.run.smithi106.stdout:mon.b: {} 2024-05-07T14:05:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-07T14:05:02.461 INFO:teuthology.orchestra.run.smithi106.stdout:mon.c: {} 2024-05-07T14:05:02.462 INFO:teuthology.orchestra.run.smithi106.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-05-07T14:05:02.478 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-05-07T14:05:03.431 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.0 to 1 (10000) 2024-05-07T14:05:03.460 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-05-07T14:05:04.446 INFO:teuthology.orchestra.run.smithi106.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-05-07T14:05:04.472 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-05-07T14:05:05.451 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.1 to 1 (10000) 2024-05-07T14:05:05.478 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-05-07T14:05:06.480 INFO:teuthology.orchestra.run.smithi106.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-05-07T14:05:06.506 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-05-07T14:05:07.476 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.2 to 1 (10000) 2024-05-07T14:05:07.502 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-05-07T14:05:08.494 INFO:teuthology.orchestra.run.smithi106.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-05-07T14:05:08.519 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-05-07T14:05:09.505 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.3 to 1 (10000) 2024-05-07T14:05:09.528 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-05-07T14:05:10.516 INFO:teuthology.orchestra.run.smithi106.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-05-07T14:05:10.542 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-05-07T14:05:11.539 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.4 to 1 (10000) 2024-05-07T14:05:11.562 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-05-07T14:05:12.538 INFO:teuthology.orchestra.run.smithi106.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-05-07T14:05:12.562 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-05-07T14:05:13.553 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.5 to 1 (10000) 2024-05-07T14:05:13.578 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-05-07T14:05:14.556 INFO:teuthology.orchestra.run.smithi106.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-05-07T14:05:14.583 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-05-07T14:05:15.567 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.6 to 1 (10000) 2024-05-07T14:05:15.595 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-05-07T14:05:16.578 INFO:teuthology.orchestra.run.smithi106.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-05-07T14:05:16.605 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-05-07T14:05:17.615 INFO:teuthology.orchestra.run.smithi106.stderr:reweighted osd.7 to 1 (10000) 2024-05-07T14:05:17.641 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-05-07T14:05:18.617 INFO:teuthology.orchestra.run.smithi106.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-05-07T14:05:18.644 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-05-07T14:05:18.645 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-05-07T14:05:18.645 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-05-07T14:05:18.645 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-05-07T14:05:18.645 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-07T14:05:18.645 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T14:05:18.947 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:05:18.947 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":146,"fsid":"0d349e2f-0c2b-4aab-8a22-181c69b40dbb","created":"2024-05-07T14:00:30.482506+0000","modified":"2024-05-07T14:05:18.618451+0000","last_up_change":"2024-05-07T14:04:58.386102+0000","last_in_change":"2024-05-07T14:00:32.857383+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T14:00:43.291253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T14:00:48.791671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-07T14:00:54.652419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-07T14:00:56.328700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-07T14:00:58.247912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-07T14:01:00.134259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-07T14:01:02.056070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-07T14:01:04.177565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e76f5d56-1400-488e-b58f-7af657fa63ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6801","nonce":3743893730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6803","nonce":3743893730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6809","nonce":3743893730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6805","nonce":3743893730}]},"public_addr":"172.21.15.106:6801/3743893730","cluster_addr":"172.21.15.106:6803/3743893730","heartbeat_back_addr":"172.21.15.106:6809/3743893730","heartbeat_front_addr":"172.21.15.106:6805/3743893730","state":["exists","up"]},{"osd":1,"uuid":"aad5864b-9a5f-426f-a8fd-15d02590106e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6817","nonce":3901521345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6819","nonce":3901521345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6823","nonce":3901521345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6821","nonce":3901521345}]},"public_addr":"172.21.15.106:6817/3901521345","cluster_addr":"172.21.15.106:6819/3901521345","heartbeat_back_addr":"172.21.15.106:6823/3901521345","heartbeat_front_addr":"172.21.15.106:6821/3901521345","state":["exists","up"]},{"osd":2,"uuid":"eea131cd-e4ca-4360-a8a0-5005a2d827d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6825","nonce":1784825450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6827","nonce":1784825450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6831","nonce":1784825450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6829","nonce":1784825450}]},"public_addr":"172.21.15.106:6825/1784825450","cluster_addr":"172.21.15.106:6827/1784825450","heartbeat_back_addr":"172.21.15.106:6831/1784825450","heartbeat_front_addr":"172.21.15.106:6829/1784825450","state":["exists","up"]},{"osd":3,"uuid":"bdcb438c-1d40-45a2-8e8a-f29ba9c98909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6808","nonce":123863977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6811","nonce":123863977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6815","nonce":123863977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6813","nonce":123863977}]},"public_addr":"172.21.15.106:6808/123863977","cluster_addr":"172.21.15.106:6811/123863977","heartbeat_back_addr":"172.21.15.106:6815/123863977","heartbeat_front_addr":"172.21.15.106:6813/123863977","state":["exists","up"]},{"osd":4,"uuid":"703f4a52-4283-4395-bc29-4de194d4a4ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6817","nonce":3575310712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6819","nonce":3575310712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6824","nonce":3575310712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6821","nonce":3575310712}]},"public_addr":"172.21.15.107:6817/3575310712","cluster_addr":"172.21.15.107:6819/3575310712","heartbeat_back_addr":"172.21.15.107:6824/3575310712","heartbeat_front_addr":"172.21.15.107:6821/3575310712","state":["exists","up"]},{"osd":5,"uuid":"8b70f365-8b0d-429e-b3f8-601a37cfb6ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6801","nonce":2178038050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6803","nonce":2178038050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6807","nonce":2178038050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6805","nonce":2178038050}]},"public_addr":"172.21.15.107:6801/2178038050","cluster_addr":"172.21.15.107:6803/2178038050","heartbeat_back_addr":"172.21.15.107:6807/2178038050","heartbeat_front_addr":"172.21.15.107:6805/2178038050","state":["exists","up"]},{"osd":6,"uuid":"b65085d6-47af-4dfc-91a8-cdc7a6fa937c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6825","nonce":3168866293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6827","nonce":3168866293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6831","nonce":3168866293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6829","nonce":3168866293}]},"public_addr":"172.21.15.107:6825/3168866293","cluster_addr":"172.21.15.107:6827/3168866293","heartbeat_back_addr":"172.21.15.107:6831/3168866293","heartbeat_front_addr":"172.21.15.107:6829/3168866293","state":["exists","up"]},{"osd":7,"uuid":"9a808e41-afba-400f-886a-8f17689bebda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":118,"up_from":129,"up_thru":129,"down_at":119,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":564060879},{"type":"v1","addr":"172.21.15.107:6809","nonce":564060879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":564060879},{"type":"v1","addr":"172.21.15.107:6811","nonce":564060879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":564060879},{"type":"v1","addr":"172.21.15.107:6815","nonce":564060879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":564060879},{"type":"v1","addr":"172.21.15.107:6813","nonce":564060879}]},"public_addr":"172.21.15.107:6809/564060879","cluster_addr":"172.21.15.107:6811/564060879","heartbeat_back_addr":"172.21.15.107:6815/564060879","heartbeat_front_addr":"172.21.15.107:6813/564060879","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.435492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.545586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.430790+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.530476+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.487321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.254353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.381089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.430233+0000","dead_epoch":119}],"pg_upmap":[{"pgid":"1.0","osds":[6,3]}],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T14:05:18.970 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-07T14:05:18.970 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T14:05:19.268 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:05:19.268 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":146,"fsid":"0d349e2f-0c2b-4aab-8a22-181c69b40dbb","created":"2024-05-07T14:00:30.482506+0000","modified":"2024-05-07T14:05:18.618451+0000","last_up_change":"2024-05-07T14:04:58.386102+0000","last_in_change":"2024-05-07T14:00:32.857383+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T14:00:43.291253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T14:00:48.791671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-07T14:00:54.652419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-07T14:00:56.328700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-07T14:00:58.247912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-07T14:01:00.134259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-07T14:01:02.056070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-07T14:01:04.177565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e76f5d56-1400-488e-b58f-7af657fa63ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6801","nonce":3743893730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6803","nonce":3743893730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6809","nonce":3743893730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6805","nonce":3743893730}]},"public_addr":"172.21.15.106:6801/3743893730","cluster_addr":"172.21.15.106:6803/3743893730","heartbeat_back_addr":"172.21.15.106:6809/3743893730","heartbeat_front_addr":"172.21.15.106:6805/3743893730","state":["exists","up"]},{"osd":1,"uuid":"aad5864b-9a5f-426f-a8fd-15d02590106e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6817","nonce":3901521345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6819","nonce":3901521345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6823","nonce":3901521345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6821","nonce":3901521345}]},"public_addr":"172.21.15.106:6817/3901521345","cluster_addr":"172.21.15.106:6819/3901521345","heartbeat_back_addr":"172.21.15.106:6823/3901521345","heartbeat_front_addr":"172.21.15.106:6821/3901521345","state":["exists","up"]},{"osd":2,"uuid":"eea131cd-e4ca-4360-a8a0-5005a2d827d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6825","nonce":1784825450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6827","nonce":1784825450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6831","nonce":1784825450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6829","nonce":1784825450}]},"public_addr":"172.21.15.106:6825/1784825450","cluster_addr":"172.21.15.106:6827/1784825450","heartbeat_back_addr":"172.21.15.106:6831/1784825450","heartbeat_front_addr":"172.21.15.106:6829/1784825450","state":["exists","up"]},{"osd":3,"uuid":"bdcb438c-1d40-45a2-8e8a-f29ba9c98909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6808","nonce":123863977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6811","nonce":123863977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6815","nonce":123863977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6813","nonce":123863977}]},"public_addr":"172.21.15.106:6808/123863977","cluster_addr":"172.21.15.106:6811/123863977","heartbeat_back_addr":"172.21.15.106:6815/123863977","heartbeat_front_addr":"172.21.15.106:6813/123863977","state":["exists","up"]},{"osd":4,"uuid":"703f4a52-4283-4395-bc29-4de194d4a4ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6817","nonce":3575310712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6819","nonce":3575310712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6824","nonce":3575310712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6821","nonce":3575310712}]},"public_addr":"172.21.15.107:6817/3575310712","cluster_addr":"172.21.15.107:6819/3575310712","heartbeat_back_addr":"172.21.15.107:6824/3575310712","heartbeat_front_addr":"172.21.15.107:6821/3575310712","state":["exists","up"]},{"osd":5,"uuid":"8b70f365-8b0d-429e-b3f8-601a37cfb6ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6801","nonce":2178038050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6803","nonce":2178038050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6807","nonce":2178038050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6805","nonce":2178038050}]},"public_addr":"172.21.15.107:6801/2178038050","cluster_addr":"172.21.15.107:6803/2178038050","heartbeat_back_addr":"172.21.15.107:6807/2178038050","heartbeat_front_addr":"172.21.15.107:6805/2178038050","state":["exists","up"]},{"osd":6,"uuid":"b65085d6-47af-4dfc-91a8-cdc7a6fa937c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6825","nonce":3168866293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6827","nonce":3168866293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6831","nonce":3168866293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6829","nonce":3168866293}]},"public_addr":"172.21.15.107:6825/3168866293","cluster_addr":"172.21.15.107:6827/3168866293","heartbeat_back_addr":"172.21.15.107:6831/3168866293","heartbeat_front_addr":"172.21.15.107:6829/3168866293","state":["exists","up"]},{"osd":7,"uuid":"9a808e41-afba-400f-886a-8f17689bebda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":118,"up_from":129,"up_thru":129,"down_at":119,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":564060879},{"type":"v1","addr":"172.21.15.107:6809","nonce":564060879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":564060879},{"type":"v1","addr":"172.21.15.107:6811","nonce":564060879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":564060879},{"type":"v1","addr":"172.21.15.107:6815","nonce":564060879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":564060879},{"type":"v1","addr":"172.21.15.107:6813","nonce":564060879}]},"public_addr":"172.21.15.107:6809/564060879","cluster_addr":"172.21.15.107:6811/564060879","heartbeat_back_addr":"172.21.15.107:6815/564060879","heartbeat_front_addr":"172.21.15.107:6813/564060879","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.435492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.545586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.430790+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.530476+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.487321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.254353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.381089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.430233+0000","dead_epoch":119}],"pg_upmap":[{"pgid":"1.0","osds":[6,3]}],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T14:05:19.288 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-07T14:05:19.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-07T14:05:19.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-07T14:05:19.290 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-07T14:05:19.290 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-07T14:05:19.291 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-07T14:05:19.291 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-07T14:05:19.291 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-07T14:05:19.547 INFO:teuthology.orchestra.run.smithi106.stdout:55834574909 2024-05-07T14:05:19.547 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-07T14:05:19.558 INFO:teuthology.orchestra.run.smithi106.stdout:55834574909 2024-05-07T14:05:19.558 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-07T14:05:19.561 INFO:teuthology.orchestra.run.smithi106.stdout:55834574908 2024-05-07T14:05:19.562 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-07T14:05:19.563 INFO:teuthology.orchestra.run.smithi106.stdout:55834574909 2024-05-07T14:05:19.563 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-07T14:05:19.571 INFO:teuthology.orchestra.run.smithi106.stdout:554050781190 2024-05-07T14:05:19.572 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-07T14:05:19.573 INFO:teuthology.orchestra.run.smithi106.stdout:55834574908 2024-05-07T14:05:19.574 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-07T14:05:19.576 INFO:teuthology.orchestra.run.smithi106.stdout:55834574907 2024-05-07T14:05:19.576 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-07T14:05:19.577 INFO:teuthology.orchestra.run.smithi106.stdout:55834574907 2024-05-07T14:05:19.578 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-07T14:05:20.064 INFO:teuthology.orchestra.run.smithi106.stdout:55834574908 2024-05-07T14:05:20.072 INFO:teuthology.orchestra.run.smithi106.stdout:55834574908 2024-05-07T14:05:20.076 INFO:teuthology.orchestra.run.smithi106.stdout:55834574907 2024-05-07T14:05:20.078 INFO:teuthology.orchestra.run.smithi106.stdout:55834574908 2024-05-07T14:05:20.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574909 got 55834574908 for osd.5 2024-05-07T14:05:20.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574909 got 55834574908 for osd.0 2024-05-07T14:05:20.107 INFO:teuthology.orchestra.run.smithi106.stdout:554050781189 2024-05-07T14:05:20.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574909 got 55834574908 for osd.2 2024-05-07T14:05:20.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574908 got 55834574907 for osd.3 2024-05-07T14:05:20.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 554050781190 got 554050781189 for osd.7 2024-05-07T14:05:20.126 INFO:teuthology.orchestra.run.smithi106.stdout:55834574906 2024-05-07T14:05:20.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574907 got 55834574906 for osd.6 2024-05-07T14:05:20.145 INFO:teuthology.orchestra.run.smithi106.stdout:55834574906 2024-05-07T14:05:20.157 INFO:teuthology.orchestra.run.smithi106.stdout:55834574907 2024-05-07T14:05:20.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574907 got 55834574906 for osd.4 2024-05-07T14:05:20.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574908 got 55834574907 for osd.1 2024-05-07T14:05:21.094 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-07T14:05:21.107 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-07T14:05:21.109 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-07T14:05:21.112 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-07T14:05:21.126 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-07T14:05:21.145 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-07T14:05:21.171 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-07T14:05:21.179 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-07T14:05:21.625 INFO:teuthology.orchestra.run.smithi106.stdout:55834574908 2024-05-07T14:05:21.640 INFO:teuthology.orchestra.run.smithi106.stdout:55834574909 2024-05-07T14:05:21.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574909 got 55834574908 for osd.2 2024-05-07T14:05:21.652 INFO:teuthology.orchestra.run.smithi106.stdout:55834574909 2024-05-07T14:05:21.655 INFO:teuthology.orchestra.run.smithi106.stdout:554050781190 2024-05-07T14:05:21.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574909 got 55834574909 for osd.5 2024-05-07T14:05:21.672 DEBUG:teuthology.parallel:result is None 2024-05-07T14:05:21.676 INFO:teuthology.orchestra.run.smithi106.stdout:55834574908 2024-05-07T14:05:21.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574909 got 55834574909 for osd.0 2024-05-07T14:05:21.684 INFO:teuthology.orchestra.run.smithi106.stdout:55834574907 2024-05-07T14:05:21.684 DEBUG:teuthology.parallel:result is None 2024-05-07T14:05:21.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 554050781190 got 554050781190 for osd.7 2024-05-07T14:05:21.686 DEBUG:teuthology.parallel:result is None 2024-05-07T14:05:21.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574908 got 55834574908 for osd.3 2024-05-07T14:05:21.698 DEBUG:teuthology.parallel:result is None 2024-05-07T14:05:21.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574907 got 55834574907 for osd.6 2024-05-07T14:05:21.703 DEBUG:teuthology.parallel:result is None 2024-05-07T14:05:21.703 INFO:teuthology.orchestra.run.smithi106.stdout:55834574908 2024-05-07T14:05:21.704 INFO:teuthology.orchestra.run.smithi106.stdout:55834574907 2024-05-07T14:05:21.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574908 got 55834574908 for osd.1 2024-05-07T14:05:21.723 DEBUG:teuthology.parallel:result is None 2024-05-07T14:05:21.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574907 got 55834574907 for osd.4 2024-05-07T14:05:21.724 DEBUG:teuthology.parallel:result is None 2024-05-07T14:05:22.652 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-07T14:05:22.942 INFO:teuthology.orchestra.run.smithi106.stdout:55834574909 2024-05-07T14:05:22.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574909 got 55834574909 for osd.2 2024-05-07T14:05:22.960 DEBUG:teuthology.parallel:result is None 2024-05-07T14:05:22.960 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-05-07T14:05:22.960 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:05:23.286 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:05:23.293 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:05:23.305 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-05-07T14:05:21.323372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819926,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3104,"num_read_kb":2790,"num_write":2847,"num_write_kb":6187914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":621470484,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3908,"ondisk_log_size":3908,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12587268,"kb_used_data":12320268,"kb_used_omap":17,"kb_used_meta":266862,"kb_avail":742387452,"statfs":{"total":773094113280,"available":760204750848,"internally_reserved":0,"allocated":12615954432,"data_stored":12610003202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17505,"internal_metadata":273267615},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.739664"},"pg_stats":[{"pgid":"3.3f","version":"124'29","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963765+0000","last_change":"2024-05-07T14:05:02.012333+0000","last_active":"2024-05-07T14:05:18.963765+0000","last_peered":"2024-05-07T14:05:18.963765+0000","last_clean":"2024-05-07T14:05:18.963765+0000","last_became_active":"2024-05-07T14:04:59.458324+0000","last_became_peered":"2024-05-07T14:04:59.458324+0000","last_unstale":"2024-05-07T14:05:18.963765+0000","last_undegraded":"2024-05-07T14:05:18.963765+0000","last_fullsized":"2024-05-07T14:05:18.963765+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:58:18.777392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719899+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:05:18.719899+0000","last_peered":"2024-05-07T14:05:18.719899+0000","last_clean":"2024-05-07T14:05:18.719899+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:05:18.719899+0000","last_undegraded":"2024-05-07T14:05:18.719899+0000","last_fullsized":"2024-05-07T14:05:18.719899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"124'29","reported_seq":133,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959961+0000","last_change":"2024-05-07T14:03:39.850495+0000","last_active":"2024-05-07T14:05:18.959961+0000","last_peered":"2024-05-07T14:05:18.959961+0000","last_clean":"2024-05-07T14:05:18.959961+0000","last_became_active":"2024-05-07T14:03:39.676092+0000","last_became_peered":"2024-05-07T14:03:39.676092+0000","last_unstale":"2024-05-07T14:05:18.959961+0000","last_undegraded":"2024-05-07T14:05:18.959961+0000","last_fullsized":"2024-05-07T14:05:18.959961+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:00.668304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"80'2","reported_seq":172,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963019+0000","last_change":"2024-05-07T14:04:59.442787+0000","last_active":"2024-05-07T14:05:18.963019+0000","last_peered":"2024-05-07T14:05:18.963019+0000","last_clean":"2024-05-07T14:05:18.963019+0000","last_became_active":"2024-05-07T14:04:59.430479+0000","last_became_peered":"2024-05-07T14:04:59.430479+0000","last_unstale":"2024-05-07T14:05:18.963019+0000","last_undegraded":"2024-05-07T14:05:18.963019+0000","last_fullsized":"2024-05-07T14:05:18.963019+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:27.875022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"124'20","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959370+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:05:18.959370+0000","last_peered":"2024-05-07T14:05:18.959370+0000","last_clean":"2024-05-07T14:05:18.959370+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:05:18.959370+0000","last_undegraded":"2024-05-07T14:05:18.959370+0000","last_fullsized":"2024-05-07T14:05:18.959370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629168+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:05:18.629168+0000","last_peered":"2024-05-07T14:05:18.629168+0000","last_clean":"2024-05-07T14:05:18.629168+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:05:18.629168+0000","last_undegraded":"2024-05-07T14:05:18.629168+0000","last_fullsized":"2024-05-07T14:05:18.629168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"124'25","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721240+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:05:18.721240+0000","last_peered":"2024-05-07T14:05:18.721240+0000","last_clean":"2024-05-07T14:05:18.721240+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:05:18.721240+0000","last_undegraded":"2024-05-07T14:05:18.721240+0000","last_fullsized":"2024-05-07T14:05:18.721240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"81'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960256+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:05:18.960256+0000","last_peered":"2024-05-07T14:05:18.960256+0000","last_clean":"2024-05-07T14:05:18.960256+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:05:18.960256+0000","last_undegraded":"2024-05-07T14:05:18.960256+0000","last_fullsized":"2024-05-07T14:05:18.960256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"124'24","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961071+0000","last_change":"2024-05-07T14:05:01.033639+0000","last_active":"2024-05-07T14:05:18.961071+0000","last_peered":"2024-05-07T14:05:18.961071+0000","last_clean":"2024-05-07T14:05:18.961071+0000","last_became_active":"2024-05-07T14:04:59.455288+0000","last_became_peered":"2024-05-07T14:04:59.455288+0000","last_unstale":"2024-05-07T14:05:18.961071+0000","last_undegraded":"2024-05-07T14:05:18.961071+0000","last_fullsized":"2024-05-07T14:05:18.961071+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:06:05.572323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"115'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960336+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:05:18.960336+0000","last_peered":"2024-05-07T14:05:18.960336+0000","last_clean":"2024-05-07T14:05:18.960336+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:05:18.960336+0000","last_undegraded":"2024-05-07T14:05:18.960336+0000","last_fullsized":"2024-05-07T14:05:18.960336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"124'19","reported_seq":275,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720428+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:05:18.720428+0000","last_peered":"2024-05-07T14:05:18.720428+0000","last_clean":"2024-05-07T14:05:18.720428+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:05:18.720428+0000","last_undegraded":"2024-05-07T14:05:18.720428+0000","last_fullsized":"2024-05-07T14:05:18.720428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"115'4","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630099+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:05:18.630099+0000","last_peered":"2024-05-07T14:05:18.630099+0000","last_clean":"2024-05-07T14:05:18.630099+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:05:18.630099+0000","last_undegraded":"2024-05-07T14:05:18.630099+0000","last_fullsized":"2024-05-07T14:05:18.630099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"124'25","reported_seq":274,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962077+0000","last_change":"2024-05-07T14:05:00.220571+0000","last_active":"2024-05-07T14:05:18.962077+0000","last_peered":"2024-05-07T14:05:18.962077+0000","last_clean":"2024-05-07T14:05:18.962077+0000","last_became_active":"2024-05-07T14:04:59.444214+0000","last_became_peered":"2024-05-07T14:04:59.444214+0000","last_unstale":"2024-05-07T14:05:18.962077+0000","last_undegraded":"2024-05-07T14:05:18.962077+0000","last_fullsized":"2024-05-07T14:05:18.962077+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:18:23.503893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"81'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721808+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:05:18.721808+0000","last_peered":"2024-05-07T14:05:18.721808+0000","last_clean":"2024-05-07T14:05:18.721808+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:05:18.721808+0000","last_undegraded":"2024-05-07T14:05:18.721808+0000","last_fullsized":"2024-05-07T14:05:18.721808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"124'23","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959282+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:05:18.959282+0000","last_peered":"2024-05-07T14:05:18.959282+0000","last_clean":"2024-05-07T14:05:18.959282+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:05:18.959282+0000","last_undegraded":"2024-05-07T14:05:18.959282+0000","last_fullsized":"2024-05-07T14:05:18.959282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"124'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630377+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:05:18.630377+0000","last_peered":"2024-05-07T14:05:18.630377+0000","last_clean":"2024-05-07T14:05:18.630377+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:05:18.630377+0000","last_undegraded":"2024-05-07T14:05:18.630377+0000","last_fullsized":"2024-05-07T14:05:18.630377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628673+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:05:18.628673+0000","last_peered":"2024-05-07T14:05:18.628673+0000","last_clean":"2024-05-07T14:05:18.628673+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:05:18.628673+0000","last_undegraded":"2024-05-07T14:05:18.628673+0000","last_fullsized":"2024-05-07T14:05:18.628673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"124'23","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961950+0000","last_change":"2024-05-07T14:05:01.245123+0000","last_active":"2024-05-07T14:05:18.961950+0000","last_peered":"2024-05-07T14:05:18.961950+0000","last_clean":"2024-05-07T14:05:18.961950+0000","last_became_active":"2024-05-07T14:04:59.452315+0000","last_became_peered":"2024-05-07T14:04:59.452315+0000","last_unstale":"2024-05-07T14:05:18.961950+0000","last_undegraded":"2024-05-07T14:05:18.961950+0000","last_fullsized":"2024-05-07T14:05:18.961950+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:20:40.045208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962499+0000","last_change":"2024-05-07T14:04:59.435447+0000","last_active":"2024-05-07T14:05:18.962499+0000","last_peered":"2024-05-07T14:05:18.962499+0000","last_clean":"2024-05-07T14:05:18.962499+0000","last_became_active":"2024-05-07T14:04:59.429254+0000","last_became_peered":"2024-05-07T14:04:59.429254+0000","last_unstale":"2024-05-07T14:05:18.962499+0000","last_undegraded":"2024-05-07T14:05:18.962499+0000","last_fullsized":"2024-05-07T14:05:18.962499+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:42:46.014749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"124'23","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961038+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:05:18.961038+0000","last_peered":"2024-05-07T14:05:18.961038+0000","last_clean":"2024-05-07T14:05:18.961038+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:05:18.961038+0000","last_undegraded":"2024-05-07T14:05:18.961038+0000","last_fullsized":"2024-05-07T14:05:18.961038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":252,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720762+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:05:18.720762+0000","last_peered":"2024-05-07T14:05:18.720762+0000","last_clean":"2024-05-07T14:05:18.720762+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:05:18.720762+0000","last_undegraded":"2024-05-07T14:05:18.720762+0000","last_fullsized":"2024-05-07T14:05:18.720762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"124'31","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963739+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:05:18.963739+0000","last_peered":"2024-05-07T14:05:18.963739+0000","last_clean":"2024-05-07T14:05:18.963739+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:05:18.963739+0000","last_undegraded":"2024-05-07T14:05:18.963739+0000","last_fullsized":"2024-05-07T14:05:18.963739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"124'10","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629192+0000","last_change":"2024-05-07T14:01:37.318563+0000","last_active":"2024-05-07T14:05:18.629192+0000","last_peered":"2024-05-07T14:05:18.629192+0000","last_clean":"2024-05-07T14:05:18.629192+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:05:18.629192+0000","last_undegraded":"2024-05-07T14:05:18.629192+0000","last_fullsized":"2024-05-07T14:05:18.629192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:27.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629565+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:05:18.629565+0000","last_peered":"2024-05-07T14:05:18.629565+0000","last_clean":"2024-05-07T14:05:18.629565+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:05:18.629565+0000","last_undegraded":"2024-05-07T14:05:18.629565+0000","last_fullsized":"2024-05-07T14:05:18.629565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"106'8","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629560+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:05:18.629560+0000","last_peered":"2024-05-07T14:05:18.629560+0000","last_clean":"2024-05-07T14:05:18.629560+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:05:18.629560+0000","last_undegraded":"2024-05-07T14:05:18.629560+0000","last_fullsized":"2024-05-07T14:05:18.629560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"124'32","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964588+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:05:18.964588+0000","last_peered":"2024-05-07T14:05:18.964588+0000","last_clean":"2024-05-07T14:05:18.964588+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:05:18.964588+0000","last_undegraded":"2024-05-07T14:05:18.964588+0000","last_fullsized":"2024-05-07T14:05:18.964588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"106'2","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630109+0000","last_change":"2024-05-07T14:03:39.848413+0000","last_active":"2024-05-07T14:05:18.630109+0000","last_peered":"2024-05-07T14:05:18.630109+0000","last_clean":"2024-05-07T14:05:18.630109+0000","last_became_active":"2024-05-07T14:03:39.663590+0000","last_became_peered":"2024-05-07T14:03:39.663590+0000","last_unstale":"2024-05-07T14:05:18.630109+0000","last_undegraded":"2024-05-07T14:05:18.630109+0000","last_fullsized":"2024-05-07T14:05:18.630109+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:02.675624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"124'19","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959332+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:05:18.959332+0000","last_peered":"2024-05-07T14:05:18.959332+0000","last_clean":"2024-05-07T14:05:18.959332+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:05:18.959332+0000","last_undegraded":"2024-05-07T14:05:18.959332+0000","last_fullsized":"2024-05-07T14:05:18.959332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628129+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:05:18.628129+0000","last_peered":"2024-05-07T14:05:18.628129+0000","last_clean":"2024-05-07T14:05:18.628129+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:05:18.628129+0000","last_undegraded":"2024-05-07T14:05:18.628129+0000","last_fullsized":"2024-05-07T14:05:18.628129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"81'2","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963957+0000","last_change":"2024-05-07T14:03:39.857355+0000","last_active":"2024-05-07T14:05:18.963957+0000","last_peered":"2024-05-07T14:05:18.963957+0000","last_clean":"2024-05-07T14:05:18.963957+0000","last_became_active":"2024-05-07T14:03:39.680721+0000","last_became_peered":"2024-05-07T14:03:39.680721+0000","last_unstale":"2024-05-07T14:05:18.963957+0000","last_undegraded":"2024-05-07T14:05:18.963957+0000","last_fullsized":"2024-05-07T14:05:18.963957+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:36.092563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"124'19","reported_seq":224,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629050+0000","last_change":"2024-05-07T14:01:37.311718+0000","last_active":"2024-05-07T14:05:18.629050+0000","last_peered":"2024-05-07T14:05:18.629050+0000","last_clean":"2024-05-07T14:05:18.629050+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:05:18.629050+0000","last_undegraded":"2024-05-07T14:05:18.629050+0000","last_fullsized":"2024-05-07T14:05:18.629050+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:24.211300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721497+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:05:18.721497+0000","last_peered":"2024-05-07T14:05:18.721497+0000","last_clean":"2024-05-07T14:05:18.721497+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:05:18.721497+0000","last_undegraded":"2024-05-07T14:05:18.721497+0000","last_fullsized":"2024-05-07T14:05:18.721497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"124'17","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961100+0000","last_change":"2024-05-07T14:04:59.457299+0000","last_active":"2024-05-07T14:05:18.961100+0000","last_peered":"2024-05-07T14:05:18.961100+0000","last_clean":"2024-05-07T14:05:18.961100+0000","last_became_active":"2024-05-07T14:04:59.455429+0000","last_became_peered":"2024-05-07T14:04:59.455429+0000","last_unstale":"2024-05-07T14:05:18.961100+0000","last_undegraded":"2024-05-07T14:05:18.961100+0000","last_fullsized":"2024-05-07T14:05:18.961100+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:29.054055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964269+0000","last_change":"2024-05-07T14:04:59.462184+0000","last_active":"2024-05-07T14:05:18.964269+0000","last_peered":"2024-05-07T14:05:18.964269+0000","last_clean":"2024-05-07T14:05:18.964269+0000","last_became_active":"2024-05-07T14:04:59.456374+0000","last_became_peered":"2024-05-07T14:04:59.456374+0000","last_unstale":"2024-05-07T14:05:18.964269+0000","last_undegraded":"2024-05-07T14:05:18.964269+0000","last_fullsized":"2024-05-07T14:05:18.964269+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:06.581660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"124'50","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719930+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:05:18.719930+0000","last_peered":"2024-05-07T14:05:18.719930+0000","last_clean":"2024-05-07T14:05:18.719930+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:05:18.719930+0000","last_undegraded":"2024-05-07T14:05:18.719930+0000","last_fullsized":"2024-05-07T14:05:18.719930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"81'6","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722091+0000","last_change":"2024-05-07T14:04:59.467076+0000","last_active":"2024-05-07T14:05:18.722091+0000","last_peered":"2024-05-07T14:05:18.722091+0000","last_clean":"2024-05-07T14:05:18.722091+0000","last_became_active":"2024-05-07T14:04:59.466480+0000","last_became_peered":"2024-05-07T14:04:59.466480+0000","last_unstale":"2024-05-07T14:05:18.722091+0000","last_undegraded":"2024-05-07T14:05:18.722091+0000","last_fullsized":"2024-05-07T14:05:18.722091+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:02.334693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"124'20","reported_seq":301,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959429+0000","last_change":"2024-05-07T14:05:00.106363+0000","last_active":"2024-05-07T14:05:18.959429+0000","last_peered":"2024-05-07T14:05:18.959429+0000","last_clean":"2024-05-07T14:05:18.959429+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:18.959429+0000","last_undegraded":"2024-05-07T14:05:18.959429+0000","last_fullsized":"2024-05-07T14:05:18.959429+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:03.250892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81788928,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964245+0000","last_change":"2024-05-07T14:04:59.446944+0000","last_active":"2024-05-07T14:05:18.964245+0000","last_peered":"2024-05-07T14:05:18.964245+0000","last_clean":"2024-05-07T14:05:18.964245+0000","last_became_active":"2024-05-07T14:04:59.445994+0000","last_became_peered":"2024-05-07T14:04:59.445994+0000","last_unstale":"2024-05-07T14:05:18.964245+0000","last_undegraded":"2024-05-07T14:05:18.964245+0000","last_fullsized":"2024-05-07T14:05:18.964245+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:08.275415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"81'7","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630813+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:05:18.630813+0000","last_peered":"2024-05-07T14:05:18.630813+0000","last_clean":"2024-05-07T14:05:18.630813+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:05:18.630813+0000","last_undegraded":"2024-05-07T14:05:18.630813+0000","last_fullsized":"2024-05-07T14:05:18.630813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629526+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:05:18.629526+0000","last_peered":"2024-05-07T14:05:18.629526+0000","last_clean":"2024-05-07T14:05:18.629526+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:05:18.629526+0000","last_undegraded":"2024-05-07T14:05:18.629526+0000","last_fullsized":"2024-05-07T14:05:18.629526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"115'8","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959036+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:05:18.959036+0000","last_peered":"2024-05-07T14:05:18.959036+0000","last_clean":"2024-05-07T14:05:18.959036+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:05:18.959036+0000","last_undegraded":"2024-05-07T14:05:18.959036+0000","last_fullsized":"2024-05-07T14:05:18.959036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"81'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962932+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:05:18.962932+0000","last_peered":"2024-05-07T14:05:18.962932+0000","last_clean":"2024-05-07T14:05:18.962932+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:05:18.962932+0000","last_undegraded":"2024-05-07T14:05:18.962932+0000","last_fullsized":"2024-05-07T14:05:18.962932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"124'16","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961915+0000","last_change":"2024-05-07T14:04:59.911990+0000","last_active":"2024-05-07T14:05:18.961915+0000","last_peered":"2024-05-07T14:05:18.961915+0000","last_clean":"2024-05-07T14:05:18.961915+0000","last_became_active":"2024-05-07T14:04:59.436710+0000","last_became_peered":"2024-05-07T14:04:59.436710+0000","last_unstale":"2024-05-07T14:05:18.961915+0000","last_undegraded":"2024-05-07T14:05:18.961915+0000","last_fullsized":"2024-05-07T14:05:18.961915+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:27:02.713493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964441+0000","last_change":"2024-05-07T14:03:39.680812+0000","last_active":"2024-05-07T14:05:18.964441+0000","last_peered":"2024-05-07T14:05:18.964441+0000","last_clean":"2024-05-07T14:05:18.964441+0000","last_became_active":"2024-05-07T14:03:39.680482+0000","last_became_peered":"2024-05-07T14:03:39.680482+0000","last_unstale":"2024-05-07T14:05:18.964441+0000","last_undegraded":"2024-05-07T14:05:18.964441+0000","last_fullsized":"2024-05-07T14:05:18.964441+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:07.705255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"81'13","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629238+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:05:18.629238+0000","last_peered":"2024-05-07T14:05:18.629238+0000","last_clean":"2024-05-07T14:05:18.629238+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:05:18.629238+0000","last_undegraded":"2024-05-07T14:05:18.629238+0000","last_fullsized":"2024-05-07T14:05:18.629238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"130'140","reported_seq":411,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962683+0000","last_change":"2024-05-07T14:05:02.234601+0000","last_active":"2024-05-07T14:05:18.962683+0000","last_peered":"2024-05-07T14:05:18.962683+0000","last_clean":"2024-05-07T14:05:18.962683+0000","last_became_active":"2024-05-07T14:04:59.463533+0000","last_became_peered":"2024-05-07T14:04:59.463533+0000","last_unstale":"2024-05-07T14:05:18.962683+0000","last_undegraded":"2024-05-07T14:05:18.962683+0000","last_fullsized":"2024-05-07T14:05:18.962683+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:50:50.067203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628944+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:05:18.628944+0000","last_peered":"2024-05-07T14:05:18.628944+0000","last_clean":"2024-05-07T14:05:18.628944+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:05:18.628944+0000","last_undegraded":"2024-05-07T14:05:18.628944+0000","last_fullsized":"2024-05-07T14:05:18.628944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"87'16","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963783+0000","last_change":"2024-05-07T14:04:59.462968+0000","last_active":"2024-05-07T14:05:18.963783+0000","last_peered":"2024-05-07T14:05:18.963783+0000","last_clean":"2024-05-07T14:05:18.963783+0000","last_became_active":"2024-05-07T14:04:59.461575+0000","last_became_peered":"2024-05-07T14:04:59.461575+0000","last_unstale":"2024-05-07T14:05:18.963783+0000","last_undegraded":"2024-05-07T14:05:18.963783+0000","last_fullsized":"2024-05-07T14:05:18.963783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:36.220334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"123'26","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959411+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:05:18.959411+0000","last_peered":"2024-05-07T14:05:18.959411+0000","last_clean":"2024-05-07T14:05:18.959411+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:05:18.959411+0000","last_undegraded":"2024-05-07T14:05:18.959411+0000","last_fullsized":"2024-05-07T14:05:18.959411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721681+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:05:18.721681+0000","last_peered":"2024-05-07T14:05:18.721681+0000","last_clean":"2024-05-07T14:05:18.721681+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:05:18.721681+0000","last_undegraded":"2024-05-07T14:05:18.721681+0000","last_fullsized":"2024-05-07T14:05:18.721681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"124'17","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962423+0000","last_change":"2024-05-07T14:04:59.462754+0000","last_active":"2024-05-07T14:05:18.962423+0000","last_peered":"2024-05-07T14:05:18.962423+0000","last_clean":"2024-05-07T14:05:18.962423+0000","last_became_active":"2024-05-07T14:04:59.459905+0000","last_became_peered":"2024-05-07T14:04:59.459905+0000","last_unstale":"2024-05-07T14:05:18.962423+0000","last_undegraded":"2024-05-07T14:05:18.962423+0000","last_fullsized":"2024-05-07T14:05:18.962423+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:02:35.111917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"124'134","reported_seq":426,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964625+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:05:18.964625+0000","last_peered":"2024-05-07T14:05:18.964625+0000","last_clean":"2024-05-07T14:05:18.964625+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:05:18.964625+0000","last_undegraded":"2024-05-07T14:05:18.964625+0000","last_fullsized":"2024-05-07T14:05:18.964625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"81'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720435+0000","last_change":"2024-05-07T14:04:59.447718+0000","last_active":"2024-05-07T14:05:18.720435+0000","last_peered":"2024-05-07T14:05:18.720435+0000","last_clean":"2024-05-07T14:05:18.720435+0000","last_became_active":"2024-05-07T14:04:59.446891+0000","last_became_peered":"2024-05-07T14:04:59.446891+0000","last_unstale":"2024-05-07T14:05:18.720435+0000","last_undegraded":"2024-05-07T14:05:18.720435+0000","last_fullsized":"2024-05-07T14:05:18.720435+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:42.667572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"124'33","reported_seq":286,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964093+0000","last_change":"2024-05-07T14:05:01.651799+0000","last_active":"2024-05-07T14:05:18.964093+0000","last_peered":"2024-05-07T14:05:18.964093+0000","last_clean":"2024-05-07T14:05:18.964093+0000","last_became_active":"2024-05-07T14:04:59.452426+0000","last_became_peered":"2024-05-07T14:04:59.452426+0000","last_unstale":"2024-05-07T14:05:18.964093+0000","last_undegraded":"2024-05-07T14:05:18.964093+0000","last_fullsized":"2024-05-07T14:05:18.964093+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:49.540606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963448+0000","last_change":"2024-05-07T14:04:59.445984+0000","last_active":"2024-05-07T14:05:18.963448+0000","last_peered":"2024-05-07T14:05:18.963448+0000","last_clean":"2024-05-07T14:05:18.963448+0000","last_became_active":"2024-05-07T14:04:59.445281+0000","last_became_peered":"2024-05-07T14:04:59.445281+0000","last_unstale":"2024-05-07T14:05:18.963448+0000","last_undegraded":"2024-05-07T14:05:18.963448+0000","last_fullsized":"2024-05-07T14:05:18.963448+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:59:14.548669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"124'28","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720038+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:05:18.720038+0000","last_peered":"2024-05-07T14:05:18.720038+0000","last_clean":"2024-05-07T14:05:18.720038+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:05:18.720038+0000","last_undegraded":"2024-05-07T14:05:18.720038+0000","last_fullsized":"2024-05-07T14:05:18.720038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960274+0000","last_change":"2024-05-07T14:03:39.666526+0000","last_active":"2024-05-07T14:05:18.960274+0000","last_peered":"2024-05-07T14:05:18.960274+0000","last_clean":"2024-05-07T14:05:18.960274+0000","last_became_active":"2024-05-07T14:03:39.666160+0000","last_became_peered":"2024-05-07T14:03:39.666160+0000","last_unstale":"2024-05-07T14:05:18.960274+0000","last_undegraded":"2024-05-07T14:05:18.960274+0000","last_fullsized":"2024-05-07T14:05:18.960274+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:44.560061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720476+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:05:18.720476+0000","last_peered":"2024-05-07T14:05:18.720476+0000","last_clean":"2024-05-07T14:05:18.720476+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:05:18.720476+0000","last_undegraded":"2024-05-07T14:05:18.720476+0000","last_fullsized":"2024-05-07T14:05:18.720476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630857+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:05:18.630857+0000","last_peered":"2024-05-07T14:05:18.630857+0000","last_clean":"2024-05-07T14:05:18.630857+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:05:18.630857+0000","last_undegraded":"2024-05-07T14:05:18.630857+0000","last_fullsized":"2024-05-07T14:05:18.630857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"124'27","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962532+0000","last_change":"2024-05-07T14:04:59.801081+0000","last_active":"2024-05-07T14:05:18.962532+0000","last_peered":"2024-05-07T14:05:18.962532+0000","last_clean":"2024-05-07T14:05:18.962532+0000","last_became_active":"2024-05-07T14:04:59.421863+0000","last_became_peered":"2024-05-07T14:04:59.421863+0000","last_unstale":"2024-05-07T14:05:18.962532+0000","last_undegraded":"2024-05-07T14:05:18.962532+0000","last_fullsized":"2024-05-07T14:05:18.962532+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:48.094723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":337,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628056+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:05:18.628056+0000","last_peered":"2024-05-07T14:05:18.628056+0000","last_clean":"2024-05-07T14:05:18.628056+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:05:18.628056+0000","last_undegraded":"2024-05-07T14:05:18.628056+0000","last_fullsized":"2024-05-07T14:05:18.628056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"124'17","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965471+0000","last_change":"2024-05-07T14:04:59.447540+0000","last_active":"2024-05-07T14:05:18.965471+0000","last_peered":"2024-05-07T14:05:18.965471+0000","last_clean":"2024-05-07T14:05:18.965471+0000","last_became_active":"2024-05-07T14:04:59.446737+0000","last_became_peered":"2024-05-07T14:04:59.446737+0000","last_unstale":"2024-05-07T14:05:18.965471+0000","last_undegraded":"2024-05-07T14:05:18.965471+0000","last_fullsized":"2024-05-07T14:05:18.965471+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.352935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963609+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:05:18.963609+0000","last_peered":"2024-05-07T14:05:18.963609+0000","last_clean":"2024-05-07T14:05:18.963609+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:05:18.963609+0000","last_undegraded":"2024-05-07T14:05:18.963609+0000","last_fullsized":"2024-05-07T14:05:18.963609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"115'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962438+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:05:18.962438+0000","last_peered":"2024-05-07T14:05:18.962438+0000","last_clean":"2024-05-07T14:05:18.962438+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:05:18.962438+0000","last_undegraded":"2024-05-07T14:05:18.962438+0000","last_fullsized":"2024-05-07T14:05:18.962438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"81'6","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959923+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:05:18.959923+0000","last_peered":"2024-05-07T14:05:18.959923+0000","last_clean":"2024-05-07T14:05:18.959923+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:05:18.959923+0000","last_undegraded":"2024-05-07T14:05:18.959923+0000","last_fullsized":"2024-05-07T14:05:18.959923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"124'29","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961785+0000","last_change":"2024-05-07T14:05:00.740552+0000","last_active":"2024-05-07T14:05:18.961785+0000","last_peered":"2024-05-07T14:05:18.961785+0000","last_clean":"2024-05-07T14:05:18.961785+0000","last_became_active":"2024-05-07T14:04:59.449454+0000","last_became_peered":"2024-05-07T14:04:59.449454+0000","last_unstale":"2024-05-07T14:05:18.961785+0000","last_undegraded":"2024-05-07T14:05:18.961785+0000","last_fullsized":"2024-05-07T14:05:18.961785+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:28:19.138204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629731+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:05:18.629731+0000","last_peered":"2024-05-07T14:05:18.629731+0000","last_clean":"2024-05-07T14:05:18.629731+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:05:18.629731+0000","last_undegraded":"2024-05-07T14:05:18.629731+0000","last_fullsized":"2024-05-07T14:05:18.629731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"124'23","reported_seq":258,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961377+0000","last_change":"2024-05-07T14:04:59.459984+0000","last_active":"2024-05-07T14:05:18.961377+0000","last_peered":"2024-05-07T14:05:18.961377+0000","last_clean":"2024-05-07T14:05:18.961377+0000","last_became_active":"2024-05-07T14:04:59.458512+0000","last_became_peered":"2024-05-07T14:04:59.458512+0000","last_unstale":"2024-05-07T14:05:18.961377+0000","last_undegraded":"2024-05-07T14:05:18.961377+0000","last_fullsized":"2024-05-07T14:05:18.961377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:11:09.127149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"124'138","reported_seq":450,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958386+0000","last_change":"2024-05-07T14:03:42.700808+0000","last_active":"2024-05-07T14:05:18.958386+0000","last_peered":"2024-05-07T14:05:18.958386+0000","last_clean":"2024-05-07T14:05:18.958386+0000","last_became_active":"2024-05-07T14:03:42.700324+0000","last_became_peered":"2024-05-07T14:03:42.700324+0000","last_unstale":"2024-05-07T14:05:18.958386+0000","last_undegraded":"2024-05-07T14:05:18.958386+0000","last_fullsized":"2024-05-07T14:05:18.958386+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:47.369543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961340+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:05:18.961340+0000","last_peered":"2024-05-07T14:05:18.961340+0000","last_clean":"2024-05-07T14:05:18.961340+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:05:18.961340+0000","last_undegraded":"2024-05-07T14:05:18.961340+0000","last_fullsized":"2024-05-07T14:05:18.961340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"124'10","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960686+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:05:18.960686+0000","last_peered":"2024-05-07T14:05:18.960686+0000","last_clean":"2024-05-07T14:05:18.960686+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:05:18.960686+0000","last_undegraded":"2024-05-07T14:05:18.960686+0000","last_fullsized":"2024-05-07T14:05:18.960686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"124'36","reported_seq":292,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721589+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:05:18.721589+0000","last_peered":"2024-05-07T14:05:18.721589+0000","last_clean":"2024-05-07T14:05:18.721589+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:05:18.721589+0000","last_undegraded":"2024-05-07T14:05:18.721589+0000","last_fullsized":"2024-05-07T14:05:18.721589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629009+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:05:18.629009+0000","last_peered":"2024-05-07T14:05:18.629009+0000","last_clean":"2024-05-07T14:05:18.629009+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:05:18.629009+0000","last_undegraded":"2024-05-07T14:05:18.629009+0000","last_fullsized":"2024-05-07T14:05:18.629009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"124'29","reported_seq":293,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958552+0000","last_change":"2024-05-07T14:04:59.456274+0000","last_active":"2024-05-07T14:05:18.958552+0000","last_peered":"2024-05-07T14:05:18.958552+0000","last_clean":"2024-05-07T14:05:18.958552+0000","last_became_active":"2024-05-07T14:04:59.455284+0000","last_became_peered":"2024-05-07T14:04:59.455284+0000","last_unstale":"2024-05-07T14:05:18.958552+0000","last_undegraded":"2024-05-07T14:05:18.958552+0000","last_fullsized":"2024-05-07T14:05:18.958552+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:44:18.184158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":246,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.627848+0000","last_change":"2024-05-07T14:04:59.467425+0000","last_active":"2024-05-07T14:05:18.627848+0000","last_peered":"2024-05-07T14:05:18.627848+0000","last_clean":"2024-05-07T14:05:18.627848+0000","last_became_active":"2024-05-07T14:04:59.466731+0000","last_became_peered":"2024-05-07T14:04:59.466731+0000","last_unstale":"2024-05-07T14:05:18.627848+0000","last_undegraded":"2024-05-07T14:05:18.627848+0000","last_fullsized":"2024-05-07T14:05:18.627848+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:57.541122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"121'5","reported_seq":111,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960905+0000","last_change":"2024-05-07T14:03:39.802033+0000","last_active":"2024-05-07T14:05:18.960905+0000","last_peered":"2024-05-07T14:05:18.960905+0000","last_clean":"2024-05-07T14:05:18.960905+0000","last_became_active":"2024-05-07T14:03:39.675695+0000","last_became_peered":"2024-05-07T14:03:39.675695+0000","last_unstale":"2024-05-07T14:05:18.960905+0000","last_undegraded":"2024-05-07T14:05:18.960905+0000","last_fullsized":"2024-05-07T14:05:18.960905+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:22:02.594405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"87'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629999+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:05:18.629999+0000","last_peered":"2024-05-07T14:05:18.629999+0000","last_clean":"2024-05-07T14:05:18.629999+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:05:18.629999+0000","last_undegraded":"2024-05-07T14:05:18.629999+0000","last_fullsized":"2024-05-07T14:05:18.629999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"124'26","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963623+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:05:18.963623+0000","last_peered":"2024-05-07T14:05:18.963623+0000","last_clean":"2024-05-07T14:05:18.963623+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:05:18.963623+0000","last_undegraded":"2024-05-07T14:05:18.963623+0000","last_fullsized":"2024-05-07T14:05:18.963623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":254,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629414+0000","last_change":"2024-05-07T14:04:59.468095+0000","last_active":"2024-05-07T14:05:18.629414+0000","last_peered":"2024-05-07T14:05:18.629414+0000","last_clean":"2024-05-07T14:05:18.629414+0000","last_became_active":"2024-05-07T14:04:59.467463+0000","last_became_peered":"2024-05-07T14:04:59.467463+0000","last_unstale":"2024-05-07T14:05:18.629414+0000","last_undegraded":"2024-05-07T14:05:18.629414+0000","last_fullsized":"2024-05-07T14:05:18.629414+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:38.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"124'21","reported_seq":309,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629398+0000","last_change":"2024-05-07T14:03:39.698456+0000","last_active":"2024-05-07T14:05:18.629398+0000","last_peered":"2024-05-07T14:05:18.629398+0000","last_clean":"2024-05-07T14:05:18.629398+0000","last_became_active":"2024-05-07T14:03:39.663223+0000","last_became_peered":"2024-05-07T14:03:39.663223+0000","last_unstale":"2024-05-07T14:05:18.629398+0000","last_undegraded":"2024-05-07T14:05:18.629398+0000","last_fullsized":"2024-05-07T14:05:18.629398+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:58.582121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959866+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:05:18.959866+0000","last_peered":"2024-05-07T14:05:18.959866+0000","last_clean":"2024-05-07T14:05:18.959866+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:05:18.959866+0000","last_undegraded":"2024-05-07T14:05:18.959866+0000","last_fullsized":"2024-05-07T14:05:18.959866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"106'6","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959722+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:05:18.959722+0000","last_peered":"2024-05-07T14:05:18.959722+0000","last_clean":"2024-05-07T14:05:18.959722+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:05:18.959722+0000","last_undegraded":"2024-05-07T14:05:18.959722+0000","last_fullsized":"2024-05-07T14:05:18.959722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"106'12","reported_seq":306,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630411+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:05:18.630411+0000","last_peered":"2024-05-07T14:05:18.630411+0000","last_clean":"2024-05-07T14:05:18.630411+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:05:18.630411+0000","last_undegraded":"2024-05-07T14:05:18.630411+0000","last_fullsized":"2024-05-07T14:05:18.630411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"124'16","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960175+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:05:18.960175+0000","last_peered":"2024-05-07T14:05:18.960175+0000","last_clean":"2024-05-07T14:05:18.960175+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:05:18.960175+0000","last_undegraded":"2024-05-07T14:05:18.960175+0000","last_fullsized":"2024-05-07T14:05:18.960175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":124,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961556+0000","last_change":"2024-05-07T14:03:39.714297+0000","last_active":"2024-05-07T14:05:18.961556+0000","last_peered":"2024-05-07T14:05:18.961556+0000","last_clean":"2024-05-07T14:05:18.961556+0000","last_became_active":"2024-05-07T14:03:39.663013+0000","last_became_peered":"2024-05-07T14:03:39.663013+0000","last_unstale":"2024-05-07T14:05:18.961556+0000","last_undegraded":"2024-05-07T14:05:18.961556+0000","last_fullsized":"2024-05-07T14:05:18.961556+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:40:56.207747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"124'24","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629991+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:05:18.629991+0000","last_peered":"2024-05-07T14:05:18.629991+0000","last_clean":"2024-05-07T14:05:18.629991+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:05:18.629991+0000","last_undegraded":"2024-05-07T14:05:18.629991+0000","last_fullsized":"2024-05-07T14:05:18.629991+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"124'134","reported_seq":439,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629702+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:05:18.629702+0000","last_peered":"2024-05-07T14:05:18.629702+0000","last_clean":"2024-05-07T14:05:18.629702+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:05:18.629702+0000","last_undegraded":"2024-05-07T14:05:18.629702+0000","last_fullsized":"2024-05-07T14:05:18.629702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"87'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962770+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:05:18.962770+0000","last_peered":"2024-05-07T14:05:18.962770+0000","last_clean":"2024-05-07T14:05:18.962770+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:05:18.962770+0000","last_undegraded":"2024-05-07T14:05:18.962770+0000","last_fullsized":"2024-05-07T14:05:18.962770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"106'8","reported_seq":288,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630803+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:05:18.630803+0000","last_peered":"2024-05-07T14:05:18.630803+0000","last_clean":"2024-05-07T14:05:18.630803+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:05:18.630803+0000","last_undegraded":"2024-05-07T14:05:18.630803+0000","last_fullsized":"2024-05-07T14:05:18.630803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"124'20","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631050+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:05:18.631050+0000","last_peered":"2024-05-07T14:05:18.631050+0000","last_clean":"2024-05-07T14:05:18.631050+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:05:18.631050+0000","last_undegraded":"2024-05-07T14:05:18.631050+0000","last_fullsized":"2024-05-07T14:05:18.631050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":428,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721954+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:05:18.721954+0000","last_peered":"2024-05-07T14:05:18.721954+0000","last_clean":"2024-05-07T14:05:18.721954+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:05:18.721954+0000","last_undegraded":"2024-05-07T14:05:18.721954+0000","last_fullsized":"2024-05-07T14:05:18.721954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":260,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964564+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:05:18.964564+0000","last_peered":"2024-05-07T14:05:18.964564+0000","last_clean":"2024-05-07T14:05:18.964564+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:05:18.964564+0000","last_undegraded":"2024-05-07T14:05:18.964564+0000","last_fullsized":"2024-05-07T14:05:18.964564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"124'134","reported_seq":428,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962881+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:05:18.962881+0000","last_peered":"2024-05-07T14:05:18.962881+0000","last_clean":"2024-05-07T14:05:18.962881+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:05:18.962881+0000","last_undegraded":"2024-05-07T14:05:18.962881+0000","last_fullsized":"2024-05-07T14:05:18.962881+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"87'6","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629046+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:05:18.629046+0000","last_peered":"2024-05-07T14:05:18.629046+0000","last_clean":"2024-05-07T14:05:18.629046+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:05:18.629046+0000","last_undegraded":"2024-05-07T14:05:18.629046+0000","last_fullsized":"2024-05-07T14:05:18.629046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"124'6","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961229+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:05:18.961229+0000","last_peered":"2024-05-07T14:05:18.961229+0000","last_clean":"2024-05-07T14:05:18.961229+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:05:18.961229+0000","last_undegraded":"2024-05-07T14:05:18.961229+0000","last_fullsized":"2024-05-07T14:05:18.961229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"124'24","reported_seq":316,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959048+0000","last_change":"2024-05-07T14:03:39.814768+0000","last_active":"2024-05-07T14:05:18.959048+0000","last_peered":"2024-05-07T14:05:18.959048+0000","last_clean":"2024-05-07T14:05:18.959048+0000","last_became_active":"2024-05-07T14:03:39.666192+0000","last_became_peered":"2024-05-07T14:03:39.666192+0000","last_unstale":"2024-05-07T14:05:18.959048+0000","last_undegraded":"2024-05-07T14:05:18.959048+0000","last_fullsized":"2024-05-07T14:05:18.959048+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:10.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630568+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:05:18.630568+0000","last_peered":"2024-05-07T14:05:18.630568+0000","last_clean":"2024-05-07T14:05:18.630568+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:05:18.630568+0000","last_undegraded":"2024-05-07T14:05:18.630568+0000","last_fullsized":"2024-05-07T14:05:18.630568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"124'25","reported_seq":326,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721237+0000","last_change":"2024-05-07T14:03:39.845058+0000","last_active":"2024-05-07T14:05:18.721237+0000","last_peered":"2024-05-07T14:05:18.721237+0000","last_clean":"2024-05-07T14:05:18.721237+0000","last_became_active":"2024-05-07T14:03:39.673995+0000","last_became_peered":"2024-05-07T14:03:39.673995+0000","last_unstale":"2024-05-07T14:05:18.721237+0000","last_undegraded":"2024-05-07T14:05:18.721237+0000","last_fullsized":"2024-05-07T14:05:18.721237+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:43.919444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959774+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:05:18.959774+0000","last_peered":"2024-05-07T14:05:18.959774+0000","last_clean":"2024-05-07T14:05:18.959774+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:05:18.959774+0000","last_undegraded":"2024-05-07T14:05:18.959774+0000","last_fullsized":"2024-05-07T14:05:18.959774+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"124'2","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960409+0000","last_change":"2024-05-07T14:03:39.666268+0000","last_active":"2024-05-07T14:05:18.960409+0000","last_peered":"2024-05-07T14:05:18.960409+0000","last_clean":"2024-05-07T14:05:18.960409+0000","last_became_active":"2024-05-07T14:03:39.665838+0000","last_became_peered":"2024-05-07T14:03:39.665838+0000","last_unstale":"2024-05-07T14:05:18.960409+0000","last_undegraded":"2024-05-07T14:05:18.960409+0000","last_fullsized":"2024-05-07T14:05:18.960409+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:54:00.122392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963437+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:05:18.963437+0000","last_peered":"2024-05-07T14:05:18.963437+0000","last_clean":"2024-05-07T14:05:18.963437+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:05:18.963437+0000","last_undegraded":"2024-05-07T14:05:18.963437+0000","last_fullsized":"2024-05-07T14:05:18.963437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":313,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958642+0000","last_change":"2024-05-07T14:02:39.729323+0000","last_active":"2024-05-07T14:05:18.958642+0000","last_peered":"2024-05-07T14:05:18.958642+0000","last_clean":"2024-05-07T14:05:18.958642+0000","last_became_active":"2024-05-07T14:02:39.728189+0000","last_became_peered":"2024-05-07T14:02:39.728189+0000","last_unstale":"2024-05-07T14:05:18.958642+0000","last_undegraded":"2024-05-07T14:05:18.958642+0000","last_fullsized":"2024-05-07T14:05:18.958642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:53:59.368912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721172+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:05:18.721172+0000","last_peered":"2024-05-07T14:05:18.721172+0000","last_clean":"2024-05-07T14:05:18.721172+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:05:18.721172+0000","last_undegraded":"2024-05-07T14:05:18.721172+0000","last_fullsized":"2024-05-07T14:05:18.721172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"124'21","reported_seq":227,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628487+0000","last_change":"2024-05-07T14:01:37.317794+0000","last_active":"2024-05-07T14:05:18.628487+0000","last_peered":"2024-05-07T14:05:18.628487+0000","last_clean":"2024-05-07T14:05:18.628487+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:05:18.628487+0000","last_undegraded":"2024-05-07T14:05:18.628487+0000","last_fullsized":"2024-05-07T14:05:18.628487+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:17.582561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":31,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962017+0000","last_change":"2024-05-07T14:04:59.458347+0000","last_active":"2024-05-07T14:05:18.962017+0000","last_peered":"2024-05-07T14:05:18.962017+0000","last_clean":"2024-05-07T14:05:18.962017+0000","last_became_active":"2024-05-07T14:04:59.453884+0000","last_became_peered":"2024-05-07T14:04:59.453884+0000","last_unstale":"2024-05-07T14:05:18.962017+0000","last_undegraded":"2024-05-07T14:05:18.962017+0000","last_fullsized":"2024-05-07T14:05:18.962017+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.867992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"124'38","reported_seq":296,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722284+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:05:18.722284+0000","last_peered":"2024-05-07T14:05:18.722284+0000","last_clean":"2024-05-07T14:05:18.722284+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:05:18.722284+0000","last_undegraded":"2024-05-07T14:05:18.722284+0000","last_fullsized":"2024-05-07T14:05:18.722284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961568+0000","last_change":"2024-05-07T14:04:59.457814+0000","last_active":"2024-05-07T14:05:18.961568+0000","last_peered":"2024-05-07T14:05:18.961568+0000","last_clean":"2024-05-07T14:05:18.961568+0000","last_became_active":"2024-05-07T14:04:59.456477+0000","last_became_peered":"2024-05-07T14:04:59.456477+0000","last_unstale":"2024-05-07T14:05:18.961568+0000","last_undegraded":"2024-05-07T14:05:18.961568+0000","last_fullsized":"2024-05-07T14:05:18.961568+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:10:28.939206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":236,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958860+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:05:18.958860+0000","last_peered":"2024-05-07T14:05:18.958860+0000","last_clean":"2024-05-07T14:05:18.958860+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:05:18.958860+0000","last_undegraded":"2024-05-07T14:05:18.958860+0000","last_fullsized":"2024-05-07T14:05:18.958860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962392+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:05:18.962392+0000","last_peered":"2024-05-07T14:05:18.962392+0000","last_clean":"2024-05-07T14:05:18.962392+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:05:18.962392+0000","last_undegraded":"2024-05-07T14:05:18.962392+0000","last_fullsized":"2024-05-07T14:05:18.962392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":224,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961946+0000","last_change":"2024-05-07T14:04:59.425099+0000","last_active":"2024-05-07T14:05:18.961946+0000","last_peered":"2024-05-07T14:05:18.961946+0000","last_clean":"2024-05-07T14:05:18.961946+0000","last_became_active":"2024-05-07T14:04:59.422224+0000","last_became_peered":"2024-05-07T14:04:59.422224+0000","last_unstale":"2024-05-07T14:05:18.961946+0000","last_undegraded":"2024-05-07T14:05:18.961946+0000","last_fullsized":"2024-05-07T14:05:18.961946+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:23.398977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"124'22","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958651+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:05:18.958651+0000","last_peered":"2024-05-07T14:05:18.958651+0000","last_clean":"2024-05-07T14:05:18.958651+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:05:18.958651+0000","last_undegraded":"2024-05-07T14:05:18.958651+0000","last_fullsized":"2024-05-07T14:05:18.958651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722556+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:05:18.722556+0000","last_peered":"2024-05-07T14:05:18.722556+0000","last_clean":"2024-05-07T14:05:18.722556+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:05:18.722556+0000","last_undegraded":"2024-05-07T14:05:18.722556+0000","last_fullsized":"2024-05-07T14:05:18.722556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"124'140","reported_seq":513,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961708+0000","last_change":"2024-05-07T14:03:42.708479+0000","last_active":"2024-05-07T14:05:18.961708+0000","last_peered":"2024-05-07T14:05:18.961708+0000","last_clean":"2024-05-07T14:05:18.961708+0000","last_became_active":"2024-05-07T14:03:42.708117+0000","last_became_peered":"2024-05-07T14:03:42.708117+0000","last_unstale":"2024-05-07T14:05:18.961708+0000","last_undegraded":"2024-05-07T14:05:18.961708+0000","last_fullsized":"2024-05-07T14:05:18.961708+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:19:35.961283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5457,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962840+0000","last_change":"2024-05-07T14:04:59.462996+0000","last_active":"2024-05-07T14:05:18.962840+0000","last_peered":"2024-05-07T14:05:18.962840+0000","last_clean":"2024-05-07T14:05:18.962840+0000","last_became_active":"2024-05-07T14:04:59.461354+0000","last_became_peered":"2024-05-07T14:04:59.461354+0000","last_unstale":"2024-05-07T14:05:18.962840+0000","last_undegraded":"2024-05-07T14:05:18.962840+0000","last_fullsized":"2024-05-07T14:05:18.962840+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:55.900168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"80'4","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962201+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:05:18.962201+0000","last_peered":"2024-05-07T14:05:18.962201+0000","last_clean":"2024-05-07T14:05:18.962201+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:05:18.962201+0000","last_undegraded":"2024-05-07T14:05:18.962201+0000","last_fullsized":"2024-05-07T14:05:18.962201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"81'2","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960614+0000","last_change":"2024-05-07T14:03:39.711373+0000","last_active":"2024-05-07T14:05:18.960614+0000","last_peered":"2024-05-07T14:05:18.960614+0000","last_clean":"2024-05-07T14:05:18.960614+0000","last_became_active":"2024-05-07T14:03:39.667130+0000","last_became_peered":"2024-05-07T14:03:39.667130+0000","last_unstale":"2024-05-07T14:05:18.960614+0000","last_undegraded":"2024-05-07T14:05:18.960614+0000","last_fullsized":"2024-05-07T14:05:18.960614+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:36.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628882+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:05:18.628882+0000","last_peered":"2024-05-07T14:05:18.628882+0000","last_clean":"2024-05-07T14:05:18.628882+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:05:18.628882+0000","last_undegraded":"2024-05-07T14:05:18.628882+0000","last_fullsized":"2024-05-07T14:05:18.628882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"124'27","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963322+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:05:18.963322+0000","last_peered":"2024-05-07T14:05:18.963322+0000","last_clean":"2024-05-07T14:05:18.963322+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:05:18.963322+0000","last_undegraded":"2024-05-07T14:05:18.963322+0000","last_fullsized":"2024-05-07T14:05:18.963322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630125+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:05:18.630125+0000","last_peered":"2024-05-07T14:05:18.630125+0000","last_clean":"2024-05-07T14:05:18.630125+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:05:18.630125+0000","last_undegraded":"2024-05-07T14:05:18.630125+0000","last_fullsized":"2024-05-07T14:05:18.630125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"130'18","reported_seq":290,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962985+0000","last_change":"2024-05-07T14:04:59.461913+0000","last_active":"2024-05-07T14:05:18.962985+0000","last_peered":"2024-05-07T14:05:18.962985+0000","last_clean":"2024-05-07T14:05:18.962985+0000","last_became_active":"2024-05-07T14:04:59.456018+0000","last_became_peered":"2024-05-07T14:04:59.456018+0000","last_unstale":"2024-05-07T14:05:18.962985+0000","last_undegraded":"2024-05-07T14:05:18.962985+0000","last_fullsized":"2024-05-07T14:05:18.962985+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:42:03.359344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959826+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:05:18.959826+0000","last_peered":"2024-05-07T14:05:18.959826+0000","last_clean":"2024-05-07T14:05:18.959826+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:05:18.959826+0000","last_undegraded":"2024-05-07T14:05:18.959826+0000","last_fullsized":"2024-05-07T14:05:18.959826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965082+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:05:18.965082+0000","last_peered":"2024-05-07T14:05:18.965082+0000","last_clean":"2024-05-07T14:05:18.965082+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:05:18.965082+0000","last_undegraded":"2024-05-07T14:05:18.965082+0000","last_fullsized":"2024-05-07T14:05:18.965082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"81'4","reported_seq":106,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961642+0000","last_change":"2024-05-07T14:03:39.687600+0000","last_active":"2024-05-07T14:05:18.961642+0000","last_peered":"2024-05-07T14:05:18.961642+0000","last_clean":"2024-05-07T14:05:18.961642+0000","last_became_active":"2024-05-07T14:03:39.661295+0000","last_became_peered":"2024-05-07T14:03:39.661295+0000","last_unstale":"2024-05-07T14:05:18.961642+0000","last_undegraded":"2024-05-07T14:05:18.961642+0000","last_fullsized":"2024-05-07T14:05:18.961642+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:17:58.416324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721116+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:05:18.721116+0000","last_peered":"2024-05-07T14:05:18.721116+0000","last_clean":"2024-05-07T14:05:18.721116+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:05:18.721116+0000","last_undegraded":"2024-05-07T14:05:18.721116+0000","last_fullsized":"2024-05-07T14:05:18.721116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"123'15","reported_seq":275,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629754+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:05:18.629754+0000","last_peered":"2024-05-07T14:05:18.629754+0000","last_clean":"2024-05-07T14:05:18.629754+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:05:18.629754+0000","last_undegraded":"2024-05-07T14:05:18.629754+0000","last_fullsized":"2024-05-07T14:05:18.629754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52428800,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":25,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959150+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:05:18.959150+0000","last_peered":"2024-05-07T14:05:18.959150+0000","last_clean":"2024-05-07T14:05:18.959150+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:05:18.959150+0000","last_undegraded":"2024-05-07T14:05:18.959150+0000","last_fullsized":"2024-05-07T14:05:18.959150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964612+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:05:18.964612+0000","last_peered":"2024-05-07T14:05:18.964612+0000","last_clean":"2024-05-07T14:05:18.964612+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:05:18.964612+0000","last_undegraded":"2024-05-07T14:05:18.964612+0000","last_fullsized":"2024-05-07T14:05:18.964612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960613+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:05:18.960613+0000","last_peered":"2024-05-07T14:05:18.960613+0000","last_clean":"2024-05-07T14:05:18.960613+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:05:18.960613+0000","last_undegraded":"2024-05-07T14:05:18.960613+0000","last_fullsized":"2024-05-07T14:05:18.960613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":236,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719678+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:05:18.719678+0000","last_peered":"2024-05-07T14:05:18.719678+0000","last_clean":"2024-05-07T14:05:18.719678+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:05:18.719678+0000","last_undegraded":"2024-05-07T14:05:18.719678+0000","last_fullsized":"2024-05-07T14:05:18.719678+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962141+0000","last_change":"2024-05-07T14:03:39.659916+0000","last_active":"2024-05-07T14:05:18.962141+0000","last_peered":"2024-05-07T14:05:18.962141+0000","last_clean":"2024-05-07T14:05:18.962141+0000","last_became_active":"2024-05-07T14:03:39.659515+0000","last_became_peered":"2024-05-07T14:03:39.659515+0000","last_unstale":"2024-05-07T14:05:18.962141+0000","last_undegraded":"2024-05-07T14:05:18.962141+0000","last_fullsized":"2024-05-07T14:05:18.962141+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:49:16.796937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"123'19","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722362+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:05:18.722362+0000","last_peered":"2024-05-07T14:05:18.722362+0000","last_clean":"2024-05-07T14:05:18.722362+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:05:18.722362+0000","last_undegraded":"2024-05-07T14:05:18.722362+0000","last_fullsized":"2024-05-07T14:05:18.722362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961947+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:05:18.961947+0000","last_peered":"2024-05-07T14:05:18.961947+0000","last_clean":"2024-05-07T14:05:18.961947+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:05:18.961947+0000","last_undegraded":"2024-05-07T14:05:18.961947+0000","last_fullsized":"2024-05-07T14:05:18.961947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960414+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:05:18.960414+0000","last_peered":"2024-05-07T14:05:18.960414+0000","last_clean":"2024-05-07T14:05:18.960414+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:05:18.960414+0000","last_undegraded":"2024-05-07T14:05:18.960414+0000","last_fullsized":"2024-05-07T14:05:18.960414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'36","reported_seq":296,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958943+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:05:18.958943+0000","last_peered":"2024-05-07T14:05:18.958943+0000","last_clean":"2024-05-07T14:05:18.958943+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:05:18.958943+0000","last_undegraded":"2024-05-07T14:05:18.958943+0000","last_fullsized":"2024-05-07T14:05:18.958943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628294+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:05:18.628294+0000","last_peered":"2024-05-07T14:05:18.628294+0000","last_clean":"2024-05-07T14:05:18.628294+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:05:18.628294+0000","last_undegraded":"2024-05-07T14:05:18.628294+0000","last_fullsized":"2024-05-07T14:05:18.628294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960715+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:05:18.960715+0000","last_peered":"2024-05-07T14:05:18.960715+0000","last_clean":"2024-05-07T14:05:18.960715+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:05:18.960715+0000","last_undegraded":"2024-05-07T14:05:18.960715+0000","last_fullsized":"2024-05-07T14:05:18.960715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":254,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960639+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:05:18.960639+0000","last_peered":"2024-05-07T14:05:18.960639+0000","last_clean":"2024-05-07T14:05:18.960639+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:05:18.960639+0000","last_undegraded":"2024-05-07T14:05:18.960639+0000","last_fullsized":"2024-05-07T14:05:18.960639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"124'23","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961817+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:05:18.961817+0000","last_peered":"2024-05-07T14:05:18.961817+0000","last_clean":"2024-05-07T14:05:18.961817+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:05:18.961817+0000","last_undegraded":"2024-05-07T14:05:18.961817+0000","last_fullsized":"2024-05-07T14:05:18.961817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961641+0000","last_change":"2024-05-07T14:04:59.452453+0000","last_active":"2024-05-07T14:05:18.961641+0000","last_peered":"2024-05-07T14:05:18.961641+0000","last_clean":"2024-05-07T14:05:18.961641+0000","last_became_active":"2024-05-07T14:04:59.451719+0000","last_became_peered":"2024-05-07T14:04:59.451719+0000","last_unstale":"2024-05-07T14:05:18.961641+0000","last_undegraded":"2024-05-07T14:05:18.961641+0000","last_fullsized":"2024-05-07T14:05:18.961641+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:58:01.882244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959572+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:05:18.959572+0000","last_peered":"2024-05-07T14:05:18.959572+0000","last_clean":"2024-05-07T14:05:18.959572+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:05:18.959572+0000","last_undegraded":"2024-05-07T14:05:18.959572+0000","last_fullsized":"2024-05-07T14:05:18.959572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":116,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962572+0000","last_change":"2024-05-07T14:03:39.707679+0000","last_active":"2024-05-07T14:05:18.962572+0000","last_peered":"2024-05-07T14:05:18.962572+0000","last_clean":"2024-05-07T14:05:18.962572+0000","last_became_active":"2024-05-07T14:03:39.664751+0000","last_became_peered":"2024-05-07T14:03:39.664751+0000","last_unstale":"2024-05-07T14:05:18.962572+0000","last_undegraded":"2024-05-07T14:05:18.962572+0000","last_fullsized":"2024-05-07T14:05:18.962572+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:55.535011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"124'138","reported_seq":480,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720061+0000","last_change":"2024-05-07T14:03:42.707530+0000","last_active":"2024-05-07T14:05:18.720061+0000","last_peered":"2024-05-07T14:05:18.720061+0000","last_clean":"2024-05-07T14:05:18.720061+0000","last_became_active":"2024-05-07T14:03:42.707207+0000","last_became_peered":"2024-05-07T14:03:42.707207+0000","last_unstale":"2024-05-07T14:05:18.720061+0000","last_undegraded":"2024-05-07T14:05:18.720061+0000","last_fullsized":"2024-05-07T14:05:18.720061+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:20:22.698141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964049+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:05:18.964049+0000","last_peered":"2024-05-07T14:05:18.964049+0000","last_clean":"2024-05-07T14:05:18.964049+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:05:18.964049+0000","last_undegraded":"2024-05-07T14:05:18.964049+0000","last_fullsized":"2024-05-07T14:05:18.964049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"115'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959440+0000","last_change":"2024-05-07T14:04:59.447585+0000","last_active":"2024-05-07T14:05:18.959440+0000","last_peered":"2024-05-07T14:05:18.959440+0000","last_clean":"2024-05-07T14:05:18.959440+0000","last_became_active":"2024-05-07T14:04:59.446674+0000","last_became_peered":"2024-05-07T14:04:59.446674+0000","last_unstale":"2024-05-07T14:05:18.959440+0000","last_undegraded":"2024-05-07T14:05:18.959440+0000","last_fullsized":"2024-05-07T14:05:18.959440+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:35.485711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"124'18","reported_seq":301,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963635+0000","last_change":"2024-05-07T14:05:00.492095+0000","last_active":"2024-05-07T14:05:18.963635+0000","last_peered":"2024-05-07T14:05:18.963635+0000","last_clean":"2024-05-07T14:05:18.963635+0000","last_became_active":"2024-05-07T14:04:59.460381+0000","last_became_peered":"2024-05-07T14:04:59.460381+0000","last_unstale":"2024-05-07T14:05:18.963635+0000","last_undegraded":"2024-05-07T14:05:18.963635+0000","last_fullsized":"2024-05-07T14:05:18.963635+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:12:40.498963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959581+0000","last_change":"2024-05-07T14:03:39.672724+0000","last_active":"2024-05-07T14:05:18.959581+0000","last_peered":"2024-05-07T14:05:18.959581+0000","last_clean":"2024-05-07T14:05:18.959581+0000","last_became_active":"2024-05-07T14:03:39.671518+0000","last_became_peered":"2024-05-07T14:03:39.671518+0000","last_unstale":"2024-05-07T14:05:18.959581+0000","last_undegraded":"2024-05-07T14:05:18.959581+0000","last_fullsized":"2024-05-07T14:05:18.959581+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:25.485797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":251,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628580+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:05:18.628580+0000","last_peered":"2024-05-07T14:05:18.628580+0000","last_clean":"2024-05-07T14:05:18.628580+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:05:18.628580+0000","last_undegraded":"2024-05-07T14:05:18.628580+0000","last_fullsized":"2024-05-07T14:05:18.628580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629354+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:05:18.629354+0000","last_peered":"2024-05-07T14:05:18.629354+0000","last_clean":"2024-05-07T14:05:18.629354+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:05:18.629354+0000","last_undegraded":"2024-05-07T14:05:18.629354+0000","last_fullsized":"2024-05-07T14:05:18.629354+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"124'134","reported_seq":475,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965634+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:05:18.965634+0000","last_peered":"2024-05-07T14:05:18.965634+0000","last_clean":"2024-05-07T14:05:18.965634+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:05:18.965634+0000","last_undegraded":"2024-05-07T14:05:18.965634+0000","last_fullsized":"2024-05-07T14:05:18.965634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"81'3","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960070+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:05:18.960070+0000","last_peered":"2024-05-07T14:05:18.960070+0000","last_clean":"2024-05-07T14:05:18.960070+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:05:18.960070+0000","last_undegraded":"2024-05-07T14:05:18.960070+0000","last_fullsized":"2024-05-07T14:05:18.960070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"124'4","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630423+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:05:18.630423+0000","last_peered":"2024-05-07T14:05:18.630423+0000","last_clean":"2024-05-07T14:05:18.630423+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:05:18.630423+0000","last_undegraded":"2024-05-07T14:05:18.630423+0000","last_fullsized":"2024-05-07T14:05:18.630423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"124'23","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962938+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:05:18.962938+0000","last_peered":"2024-05-07T14:05:18.962938+0000","last_clean":"2024-05-07T14:05:18.962938+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:05:18.962938+0000","last_undegraded":"2024-05-07T14:05:18.962938+0000","last_fullsized":"2024-05-07T14:05:18.962938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964431+0000","last_change":"2024-05-07T14:04:59.469514+0000","last_active":"2024-05-07T14:05:18.964431+0000","last_peered":"2024-05-07T14:05:18.964431+0000","last_clean":"2024-05-07T14:05:18.964431+0000","last_became_active":"2024-05-07T14:04:59.469021+0000","last_became_peered":"2024-05-07T14:04:59.469021+0000","last_unstale":"2024-05-07T14:05:18.964431+0000","last_undegraded":"2024-05-07T14:05:18.964431+0000","last_fullsized":"2024-05-07T14:05:18.964431+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:17:47.533593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959578+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:05:18.959578+0000","last_peered":"2024-05-07T14:05:18.959578+0000","last_clean":"2024-05-07T14:05:18.959578+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:05:18.959578+0000","last_undegraded":"2024-05-07T14:05:18.959578+0000","last_fullsized":"2024-05-07T14:05:18.959578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"124'45","reported_seq":288,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961605+0000","last_change":"2024-05-07T14:04:59.918491+0000","last_active":"2024-05-07T14:05:18.961605+0000","last_peered":"2024-05-07T14:05:18.961605+0000","last_clean":"2024-05-07T14:05:18.961605+0000","last_became_active":"2024-05-07T14:04:59.442492+0000","last_became_peered":"2024-05-07T14:04:59.442492+0000","last_unstale":"2024-05-07T14:05:18.961605+0000","last_undegraded":"2024-05-07T14:05:18.961605+0000","last_fullsized":"2024-05-07T14:05:18.961605+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:58.713363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120967,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":40,"num_read_kb":26,"num_write":24,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":116761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":252,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963779+0000","last_change":"2024-05-07T14:03:39.665240+0000","last_active":"2024-05-07T14:05:18.963779+0000","last_peered":"2024-05-07T14:05:18.963779+0000","last_clean":"2024-05-07T14:05:18.963779+0000","last_became_active":"2024-05-07T14:03:39.664810+0000","last_became_peered":"2024-05-07T14:03:39.664810+0000","last_unstale":"2024-05-07T14:05:18.963779+0000","last_undegraded":"2024-05-07T14:05:18.963779+0000","last_fullsized":"2024-05-07T14:05:18.963779+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:18:01.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721214+0000","last_change":"2024-05-07T14:04:59.465509+0000","last_active":"2024-05-07T14:05:18.721214+0000","last_peered":"2024-05-07T14:05:18.721214+0000","last_clean":"2024-05-07T14:05:18.721214+0000","last_became_active":"2024-05-07T14:04:59.464840+0000","last_became_peered":"2024-05-07T14:04:59.464840+0000","last_unstale":"2024-05-07T14:05:18.721214+0000","last_undegraded":"2024-05-07T14:05:18.721214+0000","last_fullsized":"2024-05-07T14:05:18.721214+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:42.823262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959673+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:05:18.959673+0000","last_peered":"2024-05-07T14:05:18.959673+0000","last_clean":"2024-05-07T14:05:18.959673+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:05:18.959673+0000","last_undegraded":"2024-05-07T14:05:18.959673+0000","last_fullsized":"2024-05-07T14:05:18.959673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'8","reported_seq":290,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629203+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:05:18.629203+0000","last_peered":"2024-05-07T14:05:18.629203+0000","last_clean":"2024-05-07T14:05:18.629203+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:05:18.629203+0000","last_undegraded":"2024-05-07T14:05:18.629203+0000","last_fullsized":"2024-05-07T14:05:18.629203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"124'23","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629269+0000","last_change":"2024-05-07T14:04:59.669798+0000","last_active":"2024-05-07T14:05:18.629269+0000","last_peered":"2024-05-07T14:05:18.629269+0000","last_clean":"2024-05-07T14:05:18.629269+0000","last_became_active":"2024-05-07T14:04:59.428245+0000","last_became_peered":"2024-05-07T14:04:59.428245+0000","last_unstale":"2024-05-07T14:05:18.629269+0000","last_undegraded":"2024-05-07T14:05:18.629269+0000","last_fullsized":"2024-05-07T14:05:18.629269+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:40.955811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962422+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:05:18.962422+0000","last_peered":"2024-05-07T14:05:18.962422+0000","last_clean":"2024-05-07T14:05:18.962422+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:05:18.962422+0000","last_undegraded":"2024-05-07T14:05:18.962422+0000","last_fullsized":"2024-05-07T14:05:18.962422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"124'20","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959837+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:05:18.959837+0000","last_peered":"2024-05-07T14:05:18.959837+0000","last_clean":"2024-05-07T14:05:18.959837+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:05:18.959837+0000","last_undegraded":"2024-05-07T14:05:18.959837+0000","last_fullsized":"2024-05-07T14:05:18.959837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959679+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:05:18.959679+0000","last_peered":"2024-05-07T14:05:18.959679+0000","last_clean":"2024-05-07T14:05:18.959679+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:05:18.959679+0000","last_undegraded":"2024-05-07T14:05:18.959679+0000","last_fullsized":"2024-05-07T14:05:18.959679+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":245,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963898+0000","last_change":"2024-05-07T14:04:59.447528+0000","last_active":"2024-05-07T14:05:18.963898+0000","last_peered":"2024-05-07T14:05:18.963898+0000","last_clean":"2024-05-07T14:05:18.963898+0000","last_became_active":"2024-05-07T14:04:59.446699+0000","last_became_peered":"2024-05-07T14:04:59.446699+0000","last_unstale":"2024-05-07T14:05:18.963898+0000","last_undegraded":"2024-05-07T14:05:18.963898+0000","last_fullsized":"2024-05-07T14:05:18.963898+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:42.823262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"115'8","reported_seq":129,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962079+0000","last_change":"2024-05-07T14:03:39.692877+0000","last_active":"2024-05-07T14:05:18.962079+0000","last_peered":"2024-05-07T14:05:18.962079+0000","last_clean":"2024-05-07T14:05:18.962079+0000","last_became_active":"2024-05-07T14:03:39.663976+0000","last_became_peered":"2024-05-07T14:03:39.663976+0000","last_unstale":"2024-05-07T14:05:18.962079+0000","last_undegraded":"2024-05-07T14:05:18.962079+0000","last_fullsized":"2024-05-07T14:05:18.962079+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:36.548454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"123'21","reported_seq":267,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961132+0000","last_change":"2024-05-07T14:05:00.456893+0000","last_active":"2024-05-07T14:05:18.961132+0000","last_peered":"2024-05-07T14:05:18.961132+0000","last_clean":"2024-05-07T14:05:18.961132+0000","last_became_active":"2024-05-07T14:04:59.445956+0000","last_became_peered":"2024-05-07T14:04:59.445956+0000","last_unstale":"2024-05-07T14:05:18.961132+0000","last_undegraded":"2024-05-07T14:05:18.961132+0000","last_fullsized":"2024-05-07T14:05:18.961132+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:07.979587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964857+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:05:18.964857+0000","last_peered":"2024-05-07T14:05:18.964857+0000","last_clean":"2024-05-07T14:05:18.964857+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:05:18.964857+0000","last_undegraded":"2024-05-07T14:05:18.964857+0000","last_fullsized":"2024-05-07T14:05:18.964857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"124'9","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958697+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:05:18.958697+0000","last_peered":"2024-05-07T14:05:18.958697+0000","last_clean":"2024-05-07T14:05:18.958697+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:05:18.958697+0000","last_undegraded":"2024-05-07T14:05:18.958697+0000","last_fullsized":"2024-05-07T14:05:18.958697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962740+0000","last_change":"2024-05-07T14:04:59.445953+0000","last_active":"2024-05-07T14:05:18.962740+0000","last_peered":"2024-05-07T14:05:18.962740+0000","last_clean":"2024-05-07T14:05:18.962740+0000","last_became_active":"2024-05-07T14:04:59.444830+0000","last_became_peered":"2024-05-07T14:04:59.444830+0000","last_unstale":"2024-05-07T14:05:18.962740+0000","last_undegraded":"2024-05-07T14:05:18.962740+0000","last_fullsized":"2024-05-07T14:05:18.962740+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:10:54.814821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"106'2","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959004+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:05:18.959004+0000","last_peered":"2024-05-07T14:05:18.959004+0000","last_clean":"2024-05-07T14:05:18.959004+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:05:18.959004+0000","last_undegraded":"2024-05-07T14:05:18.959004+0000","last_fullsized":"2024-05-07T14:05:18.959004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"81'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960024+0000","last_change":"2024-05-07T14:04:59.460718+0000","last_active":"2024-05-07T14:05:18.960024+0000","last_peered":"2024-05-07T14:05:18.960024+0000","last_clean":"2024-05-07T14:05:18.960024+0000","last_became_active":"2024-05-07T14:04:59.460037+0000","last_became_peered":"2024-05-07T14:04:59.460037+0000","last_unstale":"2024-05-07T14:05:18.960024+0000","last_undegraded":"2024-05-07T14:05:18.960024+0000","last_fullsized":"2024-05-07T14:05:18.960024+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:28.266490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"124'21","reported_seq":305,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722278+0000","last_change":"2024-05-07T14:05:00.840128+0000","last_active":"2024-05-07T14:05:18.722278+0000","last_peered":"2024-05-07T14:05:18.722278+0000","last_clean":"2024-05-07T14:05:18.722278+0000","last_became_active":"2024-05-07T14:04:59.460944+0000","last_became_peered":"2024-05-07T14:04:59.460944+0000","last_unstale":"2024-05-07T14:05:18.722278+0000","last_undegraded":"2024-05-07T14:05:18.722278+0000","last_fullsized":"2024-05-07T14:05:18.722278+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:26.259170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960783+0000","last_change":"2024-05-07T14:04:59.431660+0000","last_active":"2024-05-07T14:05:18.960783+0000","last_peered":"2024-05-07T14:05:18.960783+0000","last_clean":"2024-05-07T14:05:18.960783+0000","last_became_active":"2024-05-07T14:04:59.430654+0000","last_became_peered":"2024-05-07T14:04:59.430654+0000","last_unstale":"2024-05-07T14:05:18.960783+0000","last_undegraded":"2024-05-07T14:05:18.960783+0000","last_fullsized":"2024-05-07T14:05:18.960783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:27:01.765321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"124'20","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963938+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:05:18.963938+0000","last_peered":"2024-05-07T14:05:18.963938+0000","last_clean":"2024-05-07T14:05:18.963938+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:05:18.963938+0000","last_undegraded":"2024-05-07T14:05:18.963938+0000","last_fullsized":"2024-05-07T14:05:18.963938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959502+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:05:18.959502+0000","last_peered":"2024-05-07T14:05:18.959502+0000","last_clean":"2024-05-07T14:05:18.959502+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:05:18.959502+0000","last_undegraded":"2024-05-07T14:05:18.959502+0000","last_fullsized":"2024-05-07T14:05:18.959502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720402+0000","last_change":"2024-05-07T14:04:59.444373+0000","last_active":"2024-05-07T14:05:18.720402+0000","last_peered":"2024-05-07T14:05:18.720402+0000","last_clean":"2024-05-07T14:05:18.720402+0000","last_became_active":"2024-05-07T14:04:59.443620+0000","last_became_peered":"2024-05-07T14:04:59.443620+0000","last_unstale":"2024-05-07T14:05:18.720402+0000","last_undegraded":"2024-05-07T14:05:18.720402+0000","last_fullsized":"2024-05-07T14:05:18.720402+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:44:00.772402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"124'4","reported_seq":94,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958941+0000","last_change":"2024-05-07T14:03:52.789742+0000","last_active":"2024-05-07T14:05:18.958941+0000","last_peered":"2024-05-07T14:05:18.958941+0000","last_clean":"2024-05-07T14:05:18.958941+0000","last_became_active":"2024-05-07T14:03:52.787675+0000","last_became_peered":"2024-05-07T14:03:52.787675+0000","last_unstale":"2024-05-07T14:05:18.958941+0000","last_undegraded":"2024-05-07T14:05:18.958941+0000","last_fullsized":"2024-05-07T14:05:18.958941+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:39.000431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"124'24","reported_seq":229,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630088+0000","last_change":"2024-05-07T14:01:37.318408+0000","last_active":"2024-05-07T14:05:18.630088+0000","last_peered":"2024-05-07T14:05:18.630088+0000","last_clean":"2024-05-07T14:05:18.630088+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:05:18.630088+0000","last_undegraded":"2024-05-07T14:05:18.630088+0000","last_fullsized":"2024-05-07T14:05:18.630088+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:43.643434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959480+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:05:18.959480+0000","last_peered":"2024-05-07T14:05:18.959480+0000","last_clean":"2024-05-07T14:05:18.959480+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:05:18.959480+0000","last_undegraded":"2024-05-07T14:05:18.959480+0000","last_fullsized":"2024-05-07T14:05:18.959480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"124'17","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961550+0000","last_change":"2024-05-07T14:04:59.459641+0000","last_active":"2024-05-07T14:05:18.961550+0000","last_peered":"2024-05-07T14:05:18.961550+0000","last_clean":"2024-05-07T14:05:18.961550+0000","last_became_active":"2024-05-07T14:04:59.459102+0000","last_became_peered":"2024-05-07T14:04:59.459102+0000","last_unstale":"2024-05-07T14:05:18.961550+0000","last_undegraded":"2024-05-07T14:05:18.961550+0000","last_fullsized":"2024-05-07T14:05:18.961550+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:09:18.267555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958858+0000","last_change":"2024-05-07T14:04:59.449322+0000","last_active":"2024-05-07T14:05:18.958858+0000","last_peered":"2024-05-07T14:05:18.958858+0000","last_clean":"2024-05-07T14:05:18.958858+0000","last_became_active":"2024-05-07T14:04:59.448594+0000","last_became_peered":"2024-05-07T14:04:59.448594+0000","last_unstale":"2024-05-07T14:05:18.958858+0000","last_undegraded":"2024-05-07T14:05:18.958858+0000","last_fullsized":"2024-05-07T14:05:18.958858+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:32.423884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"115'6","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964236+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:05:18.964236+0000","last_peered":"2024-05-07T14:05:18.964236+0000","last_clean":"2024-05-07T14:05:18.964236+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:05:18.964236+0000","last_undegraded":"2024-05-07T14:05:18.964236+0000","last_fullsized":"2024-05-07T14:05:18.964236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959138+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:05:18.959138+0000","last_peered":"2024-05-07T14:05:18.959138+0000","last_clean":"2024-05-07T14:05:18.959138+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:05:18.959138+0000","last_undegraded":"2024-05-07T14:05:18.959138+0000","last_fullsized":"2024-05-07T14:05:18.959138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":257,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961778+0000","last_change":"2024-05-07T14:04:59.457249+0000","last_active":"2024-05-07T14:05:18.961778+0000","last_peered":"2024-05-07T14:05:18.961778+0000","last_clean":"2024-05-07T14:05:18.961778+0000","last_became_active":"2024-05-07T14:04:59.455608+0000","last_became_peered":"2024-05-07T14:04:59.455608+0000","last_unstale":"2024-05-07T14:05:18.961778+0000","last_undegraded":"2024-05-07T14:05:18.961778+0000","last_fullsized":"2024-05-07T14:05:18.961778+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:55:28.165004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"124'29","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963612+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:05:18.963612+0000","last_peered":"2024-05-07T14:05:18.963612+0000","last_clean":"2024-05-07T14:05:18.963612+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:05:18.963612+0000","last_undegraded":"2024-05-07T14:05:18.963612+0000","last_fullsized":"2024-05-07T14:05:18.963612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120857,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720945+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:05:18.720945+0000","last_peered":"2024-05-07T14:05:18.720945+0000","last_clean":"2024-05-07T14:05:18.720945+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:05:18.720945+0000","last_undegraded":"2024-05-07T14:05:18.720945+0000","last_fullsized":"2024-05-07T14:05:18.720945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"81'2","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963561+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:05:18.963561+0000","last_peered":"2024-05-07T14:05:18.963561+0000","last_clean":"2024-05-07T14:05:18.963561+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:05:18.963561+0000","last_undegraded":"2024-05-07T14:05:18.963561+0000","last_fullsized":"2024-05-07T14:05:18.963561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"115'8","reported_seq":295,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962152+0000","last_change":"2024-05-07T14:04:59.457999+0000","last_active":"2024-05-07T14:05:18.962152+0000","last_peered":"2024-05-07T14:05:18.962152+0000","last_clean":"2024-05-07T14:05:18.962152+0000","last_became_active":"2024-05-07T14:04:59.456492+0000","last_became_peered":"2024-05-07T14:04:59.456492+0000","last_unstale":"2024-05-07T14:05:18.962152+0000","last_undegraded":"2024-05-07T14:05:18.962152+0000","last_fullsized":"2024-05-07T14:05:18.962152+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:41.936460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"124'22","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963224+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:05:18.963224+0000","last_peered":"2024-05-07T14:05:18.963224+0000","last_clean":"2024-05-07T14:05:18.963224+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:05:18.963224+0000","last_undegraded":"2024-05-07T14:05:18.963224+0000","last_fullsized":"2024-05-07T14:05:18.963224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960857+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:05:18.960857+0000","last_peered":"2024-05-07T14:05:18.960857+0000","last_clean":"2024-05-07T14:05:18.960857+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:05:18.960857+0000","last_undegraded":"2024-05-07T14:05:18.960857+0000","last_fullsized":"2024-05-07T14:05:18.960857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"124'23","reported_seq":258,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962735+0000","last_change":"2024-05-07T14:04:59.440283+0000","last_active":"2024-05-07T14:05:18.962735+0000","last_peered":"2024-05-07T14:05:18.962735+0000","last_clean":"2024-05-07T14:05:18.962735+0000","last_became_active":"2024-05-07T14:04:59.439603+0000","last_became_peered":"2024-05-07T14:04:59.439603+0000","last_unstale":"2024-05-07T14:05:18.962735+0000","last_undegraded":"2024-05-07T14:05:18.962735+0000","last_fullsized":"2024-05-07T14:05:18.962735+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:19.505619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964150+0000","last_change":"2024-05-07T14:03:39.667564+0000","last_active":"2024-05-07T14:05:18.964150+0000","last_peered":"2024-05-07T14:05:18.964150+0000","last_clean":"2024-05-07T14:05:18.964150+0000","last_became_active":"2024-05-07T14:03:39.666888+0000","last_became_peered":"2024-05-07T14:03:39.666888+0000","last_unstale":"2024-05-07T14:05:18.964150+0000","last_undegraded":"2024-05-07T14:05:18.964150+0000","last_fullsized":"2024-05-07T14:05:18.964150+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:33.367980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959043+0000","last_change":"2024-05-07T14:04:59.456030+0000","last_active":"2024-05-07T14:05:18.959043+0000","last_peered":"2024-05-07T14:05:18.959043+0000","last_clean":"2024-05-07T14:05:18.959043+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:18.959043+0000","last_undegraded":"2024-05-07T14:05:18.959043+0000","last_fullsized":"2024-05-07T14:05:18.959043+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:20:24.704314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"81'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963522+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:05:18.963522+0000","last_peered":"2024-05-07T14:05:18.963522+0000","last_clean":"2024-05-07T14:05:18.963522+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:05:18.963522+0000","last_undegraded":"2024-05-07T14:05:18.963522+0000","last_fullsized":"2024-05-07T14:05:18.963522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629964+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:05:18.629964+0000","last_peered":"2024-05-07T14:05:18.629964+0000","last_clean":"2024-05-07T14:05:18.629964+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:05:18.629964+0000","last_undegraded":"2024-05-07T14:05:18.629964+0000","last_fullsized":"2024-05-07T14:05:18.629964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631091+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:05:18.631091+0000","last_peered":"2024-05-07T14:05:18.631091+0000","last_clean":"2024-05-07T14:05:18.631091+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:05:18.631091+0000","last_undegraded":"2024-05-07T14:05:18.631091+0000","last_fullsized":"2024-05-07T14:05:18.631091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"124'19","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964240+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:05:18.964240+0000","last_peered":"2024-05-07T14:05:18.964240+0000","last_clean":"2024-05-07T14:05:18.964240+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:05:18.964240+0000","last_undegraded":"2024-05-07T14:05:18.964240+0000","last_fullsized":"2024-05-07T14:05:18.964240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960106+0000","last_change":"2024-05-07T14:03:39.664184+0000","last_active":"2024-05-07T14:05:18.960106+0000","last_peered":"2024-05-07T14:05:18.960106+0000","last_clean":"2024-05-07T14:05:18.960106+0000","last_became_active":"2024-05-07T14:03:39.663569+0000","last_became_peered":"2024-05-07T14:03:39.663569+0000","last_unstale":"2024-05-07T14:05:18.960106+0000","last_undegraded":"2024-05-07T14:05:18.960106+0000","last_fullsized":"2024-05-07T14:05:18.960106+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:51.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720030+0000","last_change":"2024-05-07T14:04:59.447765+0000","last_active":"2024-05-07T14:05:18.720030+0000","last_peered":"2024-05-07T14:05:18.720030+0000","last_clean":"2024-05-07T14:05:18.720030+0000","last_became_active":"2024-05-07T14:04:59.447025+0000","last_became_peered":"2024-05-07T14:04:59.447025+0000","last_unstale":"2024-05-07T14:05:18.720030+0000","last_undegraded":"2024-05-07T14:05:18.720030+0000","last_fullsized":"2024-05-07T14:05:18.720030+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:14.299214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"124'14","reported_seq":298,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629778+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:05:18.629778+0000","last_peered":"2024-05-07T14:05:18.629778+0000","last_clean":"2024-05-07T14:05:18.629778+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:05:18.629778+0000","last_undegraded":"2024-05-07T14:05:18.629778+0000","last_fullsized":"2024-05-07T14:05:18.629778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"124'20","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960254+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:05:18.960254+0000","last_peered":"2024-05-07T14:05:18.960254+0000","last_clean":"2024-05-07T14:05:18.960254+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:05:18.960254+0000","last_undegraded":"2024-05-07T14:05:18.960254+0000","last_fullsized":"2024-05-07T14:05:18.960254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964629+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:05:18.964629+0000","last_peered":"2024-05-07T14:05:18.964629+0000","last_clean":"2024-05-07T14:05:18.964629+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:05:18.964629+0000","last_undegraded":"2024-05-07T14:05:18.964629+0000","last_fullsized":"2024-05-07T14:05:18.964629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630297+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:05:18.630297+0000","last_peered":"2024-05-07T14:05:18.630297+0000","last_clean":"2024-05-07T14:05:18.630297+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:05:18.630297+0000","last_undegraded":"2024-05-07T14:05:18.630297+0000","last_fullsized":"2024-05-07T14:05:18.630297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"124'134","reported_seq":504,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960210+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:05:18.960210+0000","last_peered":"2024-05-07T14:05:18.960210+0000","last_clean":"2024-05-07T14:05:18.960210+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:05:18.960210+0000","last_undegraded":"2024-05-07T14:05:18.960210+0000","last_fullsized":"2024-05-07T14:05:18.960210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"81'7","reported_seq":161,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961656+0000","last_change":"2024-05-07T14:04:59.448265+0000","last_active":"2024-05-07T14:05:18.961656+0000","last_peered":"2024-05-07T14:05:18.961656+0000","last_clean":"2024-05-07T14:05:18.961656+0000","last_became_active":"2024-05-07T14:04:59.444580+0000","last_became_peered":"2024-05-07T14:04:59.444580+0000","last_unstale":"2024-05-07T14:05:18.961656+0000","last_undegraded":"2024-05-07T14:05:18.961656+0000","last_fullsized":"2024-05-07T14:05:18.961656+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:54.087416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"124'8","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629103+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:05:18.629103+0000","last_peered":"2024-05-07T14:05:18.629103+0000","last_clean":"2024-05-07T14:05:18.629103+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:05:18.629103+0000","last_undegraded":"2024-05-07T14:05:18.629103+0000","last_fullsized":"2024-05-07T14:05:18.629103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"124'20","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721314+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:05:18.721314+0000","last_peered":"2024-05-07T14:05:18.721314+0000","last_clean":"2024-05-07T14:05:18.721314+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:05:18.721314+0000","last_undegraded":"2024-05-07T14:05:18.721314+0000","last_fullsized":"2024-05-07T14:05:18.721314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961289+0000","last_change":"2024-05-07T14:04:59.425730+0000","last_active":"2024-05-07T14:05:18.961289+0000","last_peered":"2024-05-07T14:05:18.961289+0000","last_clean":"2024-05-07T14:05:18.961289+0000","last_became_active":"2024-05-07T14:04:59.421636+0000","last_became_peered":"2024-05-07T14:04:59.421636+0000","last_unstale":"2024-05-07T14:05:18.961289+0000","last_undegraded":"2024-05-07T14:05:18.961289+0000","last_fullsized":"2024-05-07T14:05:18.961289+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:15:27.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"124'23","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720578+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:05:18.720578+0000","last_peered":"2024-05-07T14:05:18.720578+0000","last_clean":"2024-05-07T14:05:18.720578+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:05:18.720578+0000","last_undegraded":"2024-05-07T14:05:18.720578+0000","last_fullsized":"2024-05-07T14:05:18.720578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958232+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:05:18.958232+0000","last_peered":"2024-05-07T14:05:18.958232+0000","last_clean":"2024-05-07T14:05:18.958232+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:05:18.958232+0000","last_undegraded":"2024-05-07T14:05:18.958232+0000","last_fullsized":"2024-05-07T14:05:18.958232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"124'7","reported_seq":157,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964433+0000","last_change":"2024-05-07T14:05:02.242073+0000","last_active":"2024-05-07T14:05:18.964433+0000","last_peered":"2024-05-07T14:05:18.964433+0000","last_clean":"2024-05-07T14:05:18.964433+0000","last_became_active":"2024-05-07T14:04:59.467712+0000","last_became_peered":"2024-05-07T14:04:59.467712+0000","last_unstale":"2024-05-07T14:05:18.964433+0000","last_undegraded":"2024-05-07T14:05:18.964433+0000","last_fullsized":"2024-05-07T14:05:18.964433+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:31.624262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"115'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629455+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:05:18.629455+0000","last_peered":"2024-05-07T14:05:18.629455+0000","last_clean":"2024-05-07T14:05:18.629455+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:05:18.629455+0000","last_undegraded":"2024-05-07T14:05:18.629455+0000","last_fullsized":"2024-05-07T14:05:18.629455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"124'26","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722184+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:05:18.722184+0000","last_peered":"2024-05-07T14:05:18.722184+0000","last_clean":"2024-05-07T14:05:18.722184+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:05:18.722184+0000","last_undegraded":"2024-05-07T14:05:18.722184+0000","last_fullsized":"2024-05-07T14:05:18.722184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720667+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:05:18.720667+0000","last_peered":"2024-05-07T14:05:18.720667+0000","last_clean":"2024-05-07T14:05:18.720667+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:05:18.720667+0000","last_undegraded":"2024-05-07T14:05:18.720667+0000","last_fullsized":"2024-05-07T14:05:18.720667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"124'17","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958238+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:05:18.958238+0000","last_peered":"2024-05-07T14:05:18.958238+0000","last_clean":"2024-05-07T14:05:18.958238+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:05:18.958238+0000","last_undegraded":"2024-05-07T14:05:18.958238+0000","last_fullsized":"2024-05-07T14:05:18.958238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959103+0000","last_change":"2024-05-07T14:04:59.466240+0000","last_active":"2024-05-07T14:05:18.959103+0000","last_peered":"2024-05-07T14:05:18.959103+0000","last_clean":"2024-05-07T14:05:18.959103+0000","last_became_active":"2024-05-07T14:04:59.465509+0000","last_became_peered":"2024-05-07T14:04:59.465509+0000","last_unstale":"2024-05-07T14:05:18.959103+0000","last_undegraded":"2024-05-07T14:05:18.959103+0000","last_fullsized":"2024-05-07T14:05:18.959103+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:28:23.609814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964136+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:05:18.964136+0000","last_peered":"2024-05-07T14:05:18.964136+0000","last_clean":"2024-05-07T14:05:18.964136+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:05:18.964136+0000","last_undegraded":"2024-05-07T14:05:18.964136+0000","last_fullsized":"2024-05-07T14:05:18.964136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"87'6","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960098+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:05:18.960098+0000","last_peered":"2024-05-07T14:05:18.960098+0000","last_clean":"2024-05-07T14:05:18.960098+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:05:18.960098+0000","last_undegraded":"2024-05-07T14:05:18.960098+0000","last_fullsized":"2024-05-07T14:05:18.960098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"124'19","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964959+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:05:18.964959+0000","last_peered":"2024-05-07T14:05:18.964959+0000","last_clean":"2024-05-07T14:05:18.964959+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:05:18.964959+0000","last_undegraded":"2024-05-07T14:05:18.964959+0000","last_fullsized":"2024-05-07T14:05:18.964959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628160+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:05:18.628160+0000","last_peered":"2024-05-07T14:05:18.628160+0000","last_clean":"2024-05-07T14:05:18.628160+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:05:18.628160+0000","last_undegraded":"2024-05-07T14:05:18.628160+0000","last_fullsized":"2024-05-07T14:05:18.628160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"124'13","reported_seq":271,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965528+0000","last_change":"2024-05-07T14:04:59.460738+0000","last_active":"2024-05-07T14:05:18.965528+0000","last_peered":"2024-05-07T14:05:18.965528+0000","last_clean":"2024-05-07T14:05:18.965528+0000","last_became_active":"2024-05-07T14:04:59.459963+0000","last_became_peered":"2024-05-07T14:04:59.459963+0000","last_unstale":"2024-05-07T14:05:18.965528+0000","last_undegraded":"2024-05-07T14:05:18.965528+0000","last_fullsized":"2024-05-07T14:05:18.965528+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:14:25.517514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628526+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:05:18.628526+0000","last_peered":"2024-05-07T14:05:18.628526+0000","last_clean":"2024-05-07T14:05:18.628526+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:05:18.628526+0000","last_undegraded":"2024-05-07T14:05:18.628526+0000","last_fullsized":"2024-05-07T14:05:18.628526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"81'8","reported_seq":222,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963108+0000","last_change":"2024-05-07T14:04:59.462387+0000","last_active":"2024-05-07T14:05:18.963108+0000","last_peered":"2024-05-07T14:05:18.963108+0000","last_clean":"2024-05-07T14:05:18.963108+0000","last_became_active":"2024-05-07T14:04:59.456842+0000","last_became_peered":"2024-05-07T14:04:59.456842+0000","last_unstale":"2024-05-07T14:05:18.963108+0000","last_undegraded":"2024-05-07T14:05:18.963108+0000","last_fullsized":"2024-05-07T14:05:18.963108+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:43:26.257882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"115'10","reported_seq":294,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628969+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:05:18.628969+0000","last_peered":"2024-05-07T14:05:18.628969+0000","last_clean":"2024-05-07T14:05:18.628969+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:05:18.628969+0000","last_undegraded":"2024-05-07T14:05:18.628969+0000","last_fullsized":"2024-05-07T14:05:18.628969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"124'22","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960298+0000","last_change":"2024-05-07T14:01:37.554242+0000","last_active":"2024-05-07T14:05:18.960298+0000","last_peered":"2024-05-07T14:05:18.960298+0000","last_clean":"2024-05-07T14:05:18.960298+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:05:18.960298+0000","last_undegraded":"2024-05-07T14:05:18.960298+0000","last_fullsized":"2024-05-07T14:05:18.960298+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:16:22.149514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962634+0000","last_change":"2024-05-07T14:03:39.674947+0000","last_active":"2024-05-07T14:05:18.962634+0000","last_peered":"2024-05-07T14:05:18.962634+0000","last_clean":"2024-05-07T14:05:18.962634+0000","last_became_active":"2024-05-07T14:03:39.659887+0000","last_became_peered":"2024-05-07T14:03:39.659887+0000","last_unstale":"2024-05-07T14:05:18.962634+0000","last_undegraded":"2024-05-07T14:05:18.962634+0000","last_fullsized":"2024-05-07T14:05:18.962634+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:18:06.217561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"124'17","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628561+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:05:18.628561+0000","last_peered":"2024-05-07T14:05:18.628561+0000","last_clean":"2024-05-07T14:05:18.628561+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:05:18.628561+0000","last_undegraded":"2024-05-07T14:05:18.628561+0000","last_fullsized":"2024-05-07T14:05:18.628561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958734+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:05:18.958734+0000","last_peered":"2024-05-07T14:05:18.958734+0000","last_clean":"2024-05-07T14:05:18.958734+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:05:18.958734+0000","last_undegraded":"2024-05-07T14:05:18.958734+0000","last_fullsized":"2024-05-07T14:05:18.958734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631326+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:05:18.631326+0000","last_peered":"2024-05-07T14:05:18.631326+0000","last_clean":"2024-05-07T14:05:18.631326+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:05:18.631326+0000","last_undegraded":"2024-05-07T14:05:18.631326+0000","last_fullsized":"2024-05-07T14:05:18.631326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"87'16","reported_seq":110,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960757+0000","last_change":"2024-05-07T14:03:39.799013+0000","last_active":"2024-05-07T14:05:18.960757+0000","last_peered":"2024-05-07T14:05:18.960757+0000","last_clean":"2024-05-07T14:05:18.960757+0000","last_became_active":"2024-05-07T14:03:39.671068+0000","last_became_peered":"2024-05-07T14:03:39.671068+0000","last_unstale":"2024-05-07T14:05:18.960757+0000","last_undegraded":"2024-05-07T14:05:18.960757+0000","last_fullsized":"2024-05-07T14:05:18.960757+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:13.746128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"124'22","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959122+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:05:18.959122+0000","last_peered":"2024-05-07T14:05:18.959122+0000","last_clean":"2024-05-07T14:05:18.959122+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:05:18.959122+0000","last_undegraded":"2024-05-07T14:05:18.959122+0000","last_fullsized":"2024-05-07T14:05:18.959122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959826+0000","last_change":"2024-05-07T14:03:39.661724+0000","last_active":"2024-05-07T14:05:18.959826+0000","last_peered":"2024-05-07T14:05:18.959826+0000","last_clean":"2024-05-07T14:05:18.959826+0000","last_became_active":"2024-05-07T14:03:39.661339+0000","last_became_peered":"2024-05-07T14:03:39.661339+0000","last_unstale":"2024-05-07T14:05:18.959826+0000","last_undegraded":"2024-05-07T14:05:18.959826+0000","last_fullsized":"2024-05-07T14:05:18.959826+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:34.633849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"123'17","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628556+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:05:18.628556+0000","last_peered":"2024-05-07T14:05:18.628556+0000","last_clean":"2024-05-07T14:05:18.628556+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:05:18.628556+0000","last_undegraded":"2024-05-07T14:05:18.628556+0000","last_fullsized":"2024-05-07T14:05:18.628556+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:01.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"81'6","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721729+0000","last_change":"2024-05-07T14:04:59.467441+0000","last_active":"2024-05-07T14:05:18.721729+0000","last_peered":"2024-05-07T14:05:18.721729+0000","last_clean":"2024-05-07T14:05:18.721729+0000","last_became_active":"2024-05-07T14:04:59.466443+0000","last_became_peered":"2024-05-07T14:04:59.466443+0000","last_unstale":"2024-05-07T14:05:18.721729+0000","last_undegraded":"2024-05-07T14:05:18.721729+0000","last_fullsized":"2024-05-07T14:05:18.721729+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:35.485711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"124'25","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721037+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:05:18.721037+0000","last_peered":"2024-05-07T14:05:18.721037+0000","last_clean":"2024-05-07T14:05:18.721037+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:05:18.721037+0000","last_undegraded":"2024-05-07T14:05:18.721037+0000","last_fullsized":"2024-05-07T14:05:18.721037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"124'4","reported_seq":124,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961882+0000","last_change":"2024-05-07T14:04:59.861145+0000","last_active":"2024-05-07T14:05:18.961882+0000","last_peered":"2024-05-07T14:05:18.961882+0000","last_clean":"2024-05-07T14:05:18.961882+0000","last_became_active":"2024-05-07T14:04:59.445932+0000","last_became_peered":"2024-05-07T14:04:59.445932+0000","last_unstale":"2024-05-07T14:05:18.961882+0000","last_undegraded":"2024-05-07T14:05:18.961882+0000","last_fullsized":"2024-05-07T14:05:18.961882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:42.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"124'28","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960357+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:05:18.960357+0000","last_peered":"2024-05-07T14:05:18.960357+0000","last_clean":"2024-05-07T14:05:18.960357+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:05:18.960357+0000","last_undegraded":"2024-05-07T14:05:18.960357+0000","last_fullsized":"2024-05-07T14:05:18.960357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"81'2","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965417+0000","last_change":"2024-05-07T14:04:59.448690+0000","last_active":"2024-05-07T14:05:18.965417+0000","last_peered":"2024-05-07T14:05:18.965417+0000","last_clean":"2024-05-07T14:05:18.965417+0000","last_became_active":"2024-05-07T14:04:59.447844+0000","last_became_peered":"2024-05-07T14:04:59.447844+0000","last_unstale":"2024-05-07T14:05:18.965417+0000","last_undegraded":"2024-05-07T14:05:18.965417+0000","last_fullsized":"2024-05-07T14:05:18.965417+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:48:36.699391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"124'21","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964522+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:05:18.964522+0000","last_peered":"2024-05-07T14:05:18.964522+0000","last_clean":"2024-05-07T14:05:18.964522+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:05:18.964522+0000","last_undegraded":"2024-05-07T14:05:18.964522+0000","last_fullsized":"2024-05-07T14:05:18.964522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629774+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:05:18.629774+0000","last_peered":"2024-05-07T14:05:18.629774+0000","last_clean":"2024-05-07T14:05:18.629774+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:05:18.629774+0000","last_undegraded":"2024-05-07T14:05:18.629774+0000","last_fullsized":"2024-05-07T14:05:18.629774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"124'28","reported_seq":133,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965151+0000","last_change":"2024-05-07T14:03:39.789159+0000","last_active":"2024-05-07T14:05:18.965151+0000","last_peered":"2024-05-07T14:05:18.965151+0000","last_clean":"2024-05-07T14:05:18.965151+0000","last_became_active":"2024-05-07T14:03:39.668790+0000","last_became_peered":"2024-05-07T14:03:39.668790+0000","last_unstale":"2024-05-07T14:05:18.965151+0000","last_undegraded":"2024-05-07T14:05:18.965151+0000","last_fullsized":"2024-05-07T14:05:18.965151+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:14.798045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"81'8","reported_seq":319,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959979+0000","last_change":"2024-05-07T14:03:39.855375+0000","last_active":"2024-05-07T14:05:18.959979+0000","last_peered":"2024-05-07T14:05:18.959979+0000","last_clean":"2024-05-07T14:05:18.959979+0000","last_became_active":"2024-05-07T14:03:39.666451+0000","last_became_peered":"2024-05-07T14:03:39.666451+0000","last_unstale":"2024-05-07T14:05:18.959979+0000","last_undegraded":"2024-05-07T14:05:18.959979+0000","last_fullsized":"2024-05-07T14:05:18.959979+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:37.171990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"124'22","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961451+0000","last_change":"2024-05-07T14:05:00.248173+0000","last_active":"2024-05-07T14:05:18.961451+0000","last_peered":"2024-05-07T14:05:18.961451+0000","last_clean":"2024-05-07T14:05:18.961451+0000","last_became_active":"2024-05-07T14:04:59.455622+0000","last_became_peered":"2024-05-07T14:04:59.455622+0000","last_unstale":"2024-05-07T14:05:18.961451+0000","last_undegraded":"2024-05-07T14:05:18.961451+0000","last_fullsized":"2024-05-07T14:05:18.961451+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:03.691207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"115'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959101+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:05:18.959101+0000","last_peered":"2024-05-07T14:05:18.959101+0000","last_clean":"2024-05-07T14:05:18.959101+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:05:18.959101+0000","last_undegraded":"2024-05-07T14:05:18.959101+0000","last_fullsized":"2024-05-07T14:05:18.959101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"124'20","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963922+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:05:18.963922+0000","last_peered":"2024-05-07T14:05:18.963922+0000","last_clean":"2024-05-07T14:05:18.963922+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:05:18.963922+0000","last_undegraded":"2024-05-07T14:05:18.963922+0000","last_fullsized":"2024-05-07T14:05:18.963922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"106'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960114+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:05:18.960114+0000","last_peered":"2024-05-07T14:05:18.960114+0000","last_clean":"2024-05-07T14:05:18.960114+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:05:18.960114+0000","last_undegraded":"2024-05-07T14:05:18.960114+0000","last_fullsized":"2024-05-07T14:05:18.960114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"124'29","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720842+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:05:18.720842+0000","last_peered":"2024-05-07T14:05:18.720842+0000","last_clean":"2024-05-07T14:05:18.720842+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:05:18.720842+0000","last_undegraded":"2024-05-07T14:05:18.720842+0000","last_fullsized":"2024-05-07T14:05:18.720842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":39,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630722+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:05:18.630722+0000","last_peered":"2024-05-07T14:05:18.630722+0000","last_clean":"2024-05-07T14:05:18.630722+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:05:18.630722+0000","last_undegraded":"2024-05-07T14:05:18.630722+0000","last_fullsized":"2024-05-07T14:05:18.630722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"124'24","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960142+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:05:18.960142+0000","last_peered":"2024-05-07T14:05:18.960142+0000","last_clean":"2024-05-07T14:05:18.960142+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:05:18.960142+0000","last_undegraded":"2024-05-07T14:05:18.960142+0000","last_fullsized":"2024-05-07T14:05:18.960142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"106'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629998+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:05:18.629998+0000","last_peered":"2024-05-07T14:05:18.629998+0000","last_clean":"2024-05-07T14:05:18.629998+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:05:18.629998+0000","last_undegraded":"2024-05-07T14:05:18.629998+0000","last_fullsized":"2024-05-07T14:05:18.629998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"124'27","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720756+0000","last_change":"2024-05-07T14:04:59.856502+0000","last_active":"2024-05-07T14:05:18.720756+0000","last_peered":"2024-05-07T14:05:18.720756+0000","last_clean":"2024-05-07T14:05:18.720756+0000","last_became_active":"2024-05-07T14:04:59.443769+0000","last_became_peered":"2024-05-07T14:04:59.443769+0000","last_unstale":"2024-05-07T14:05:18.720756+0000","last_undegraded":"2024-05-07T14:05:18.720756+0000","last_fullsized":"2024-05-07T14:05:18.720756+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:48:34.692070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":254,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631223+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:05:18.631223+0000","last_peered":"2024-05-07T14:05:18.631223+0000","last_clean":"2024-05-07T14:05:18.631223+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:05:18.631223+0000","last_undegraded":"2024-05-07T14:05:18.631223+0000","last_fullsized":"2024-05-07T14:05:18.631223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"124'27","reported_seq":308,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960464+0000","last_change":"2024-05-07T14:05:01.098433+0000","last_active":"2024-05-07T14:05:18.960464+0000","last_peered":"2024-05-07T14:05:18.960464+0000","last_clean":"2024-05-07T14:05:18.960464+0000","last_became_active":"2024-05-07T14:04:59.458388+0000","last_became_peered":"2024-05-07T14:04:59.458388+0000","last_unstale":"2024-05-07T14:05:18.960464+0000","last_undegraded":"2024-05-07T14:05:18.960464+0000","last_fullsized":"2024-05-07T14:05:18.960464+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:29:00.050525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"81'6","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961340+0000","last_change":"2024-05-07T14:04:59.449854+0000","last_active":"2024-05-07T14:05:18.961340+0000","last_peered":"2024-05-07T14:05:18.961340+0000","last_clean":"2024-05-07T14:05:18.961340+0000","last_became_active":"2024-05-07T14:04:59.448913+0000","last_became_peered":"2024-05-07T14:04:59.448913+0000","last_unstale":"2024-05-07T14:05:18.961340+0000","last_undegraded":"2024-05-07T14:05:18.961340+0000","last_fullsized":"2024-05-07T14:05:18.961340+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:39.717523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"124'29","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960607+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:05:18.960607+0000","last_peered":"2024-05-07T14:05:18.960607+0000","last_clean":"2024-05-07T14:05:18.960607+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:05:18.960607+0000","last_undegraded":"2024-05-07T14:05:18.960607+0000","last_fullsized":"2024-05-07T14:05:18.960607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119537664,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"87'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958936+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:05:18.958936+0000","last_peered":"2024-05-07T14:05:18.958936+0000","last_clean":"2024-05-07T14:05:18.958936+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:05:18.958936+0000","last_undegraded":"2024-05-07T14:05:18.958936+0000","last_fullsized":"2024-05-07T14:05:18.958936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"123'23","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961924+0000","last_change":"2024-05-07T14:05:02.233669+0000","last_active":"2024-05-07T14:05:18.961924+0000","last_peered":"2024-05-07T14:05:18.961924+0000","last_clean":"2024-05-07T14:05:18.961924+0000","last_became_active":"2024-05-07T14:04:59.459490+0000","last_became_peered":"2024-05-07T14:04:59.459490+0000","last_unstale":"2024-05-07T14:05:18.961924+0000","last_undegraded":"2024-05-07T14:05:18.961924+0000","last_fullsized":"2024-05-07T14:05:18.961924+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:24.042272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"81'6","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959934+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:05:18.959934+0000","last_peered":"2024-05-07T14:05:18.959934+0000","last_clean":"2024-05-07T14:05:18.959934+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:05:18.959934+0000","last_undegraded":"2024-05-07T14:05:18.959934+0000","last_fullsized":"2024-05-07T14:05:18.959934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"124'26","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630545+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:05:18.630545+0000","last_peered":"2024-05-07T14:05:18.630545+0000","last_clean":"2024-05-07T14:05:18.630545+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:05:18.630545+0000","last_undegraded":"2024-05-07T14:05:18.630545+0000","last_fullsized":"2024-05-07T14:05:18.630545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"124'6","reported_seq":199,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960492+0000","last_change":"2024-05-07T14:05:00.223495+0000","last_active":"2024-05-07T14:05:18.960492+0000","last_peered":"2024-05-07T14:05:18.960492+0000","last_clean":"2024-05-07T14:05:18.960492+0000","last_became_active":"2024-05-07T14:04:59.442569+0000","last_became_peered":"2024-05-07T14:04:59.442569+0000","last_unstale":"2024-05-07T14:05:18.960492+0000","last_undegraded":"2024-05-07T14:05:18.960492+0000","last_fullsized":"2024-05-07T14:05:18.960492+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:10.158704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"124'26","reported_seq":300,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722687+0000","last_change":"2024-05-07T14:05:01.256475+0000","last_active":"2024-05-07T14:05:18.722687+0000","last_peered":"2024-05-07T14:05:18.722687+0000","last_clean":"2024-05-07T14:05:18.722687+0000","last_became_active":"2024-05-07T14:04:59.461335+0000","last_became_peered":"2024-05-07T14:04:59.461335+0000","last_unstale":"2024-05-07T14:05:18.722687+0000","last_undegraded":"2024-05-07T14:05:18.722687+0000","last_fullsized":"2024-05-07T14:05:18.722687+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:34.213014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"124'24","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720700+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:05:18.720700+0000","last_peered":"2024-05-07T14:05:18.720700+0000","last_clean":"2024-05-07T14:05:18.720700+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:05:18.720700+0000","last_undegraded":"2024-05-07T14:05:18.720700+0000","last_fullsized":"2024-05-07T14:05:18.720700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"124'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959984+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:05:18.959984+0000","last_peered":"2024-05-07T14:05:18.959984+0000","last_clean":"2024-05-07T14:05:18.959984+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:05:18.959984+0000","last_undegraded":"2024-05-07T14:05:18.959984+0000","last_fullsized":"2024-05-07T14:05:18.959984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"124'21","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963118+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:05:18.963118+0000","last_peered":"2024-05-07T14:05:18.963118+0000","last_clean":"2024-05-07T14:05:18.963118+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:05:18.963118+0000","last_undegraded":"2024-05-07T14:05:18.963118+0000","last_fullsized":"2024-05-07T14:05:18.963118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"106'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722115+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:05:18.722115+0000","last_peered":"2024-05-07T14:05:18.722115+0000","last_clean":"2024-05-07T14:05:18.722115+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:05:18.722115+0000","last_undegraded":"2024-05-07T14:05:18.722115+0000","last_fullsized":"2024-05-07T14:05:18.722115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":313,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1086,"ondisk_log_size":1086,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382934,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":846,"num_read_kb":608,"num_write":467,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":121255,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":761,"ondisk_log_size":761,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":341,"num_read_kb":341,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1436,"num_read_kb":1404,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":620756992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":129,"seq":554050781190,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1805588,"kb_used_data":1769352,"kb_used_omap":6,"kb_used_meta":36217,"kb_avail":92566252,"statfs":{"total":96636764160,"available":94787842048,"internally_reserved":0,"allocated":1811816448,"data_stored":1811065904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6345,"internal_metadata":37087031},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1266516,"kb_used_data":1235332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93105324,"statfs":{"total":96636764160,"available":95339851776,"internally_reserved":0,"allocated":1264979968,"data_stored":1264248696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1941872,"kb_used_data":1906532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92429968,"statfs":{"total":96636764160,"available":94648287232,"internally_reserved":0,"allocated":1952288768,"data_stored":1951518219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1749132,"kb_used_data":1717948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92622708,"statfs":{"total":96636764160,"available":94845652992,"internally_reserved":0,"allocated":1759178752,"data_stored":1758462690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1917812,"kb_used_data":1882468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92454028,"statfs":{"total":96636764160,"available":94672924672,"internally_reserved":0,"allocated":1927647232,"data_stored":1926891074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1015960,"kb_used_data":984776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93355880,"statfs":{"total":96636764160,"available":95596421120,"internally_reserved":0,"allocated":1008410624,"data_stored":1007689142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1192308,"kb_used_data":1156960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93179532,"statfs":{"total":96636764160,"available":95415840768,"internally_reserved":0,"allocated":1184727040,"data_stored":1183969856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1698080,"kb_used_data":1666900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92673760,"statfs":{"total":96636764160,"available":94897930240,"internally_reserved":0,"allocated":1706905600,"data_stored":1706157621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1704984576,"data_stored":1704984576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1182793728,"data_stored":1182793728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1006632960,"data_stored":1006632960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1925185536,"data_stored":1925185536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1757413376,"data_stored":1757413376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1950351360,"data_stored":1950351360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1262485504,"data_stored":1262485504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1809842176,"data_stored":1809842176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":117239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":119338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":119222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":117465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":176275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:05:23.317 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:05:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:05:23.694 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:05:23.701 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-05-07T14:05:23.324457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819926,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3104,"num_read_kb":2790,"num_write":2847,"num_write_kb":6187914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":621470484,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3908,"ondisk_log_size":3908,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12587316,"kb_used_data":12320304,"kb_used_omap":17,"kb_used_meta":266862,"kb_avail":742387404,"statfs":{"total":773094113280,"available":760204701696,"internally_reserved":0,"allocated":12615991296,"data_stored":12610026920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17505,"internal_metadata":273267615},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.727954"},"pg_stats":[{"pgid":"3.3f","version":"124'29","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963765+0000","last_change":"2024-05-07T14:05:02.012333+0000","last_active":"2024-05-07T14:05:18.963765+0000","last_peered":"2024-05-07T14:05:18.963765+0000","last_clean":"2024-05-07T14:05:18.963765+0000","last_became_active":"2024-05-07T14:04:59.458324+0000","last_became_peered":"2024-05-07T14:04:59.458324+0000","last_unstale":"2024-05-07T14:05:18.963765+0000","last_undegraded":"2024-05-07T14:05:18.963765+0000","last_fullsized":"2024-05-07T14:05:18.963765+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:58:18.777392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719899+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:05:18.719899+0000","last_peered":"2024-05-07T14:05:18.719899+0000","last_clean":"2024-05-07T14:05:18.719899+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:05:18.719899+0000","last_undegraded":"2024-05-07T14:05:18.719899+0000","last_fullsized":"2024-05-07T14:05:18.719899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"124'29","reported_seq":133,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959961+0000","last_change":"2024-05-07T14:03:39.850495+0000","last_active":"2024-05-07T14:05:18.959961+0000","last_peered":"2024-05-07T14:05:18.959961+0000","last_clean":"2024-05-07T14:05:18.959961+0000","last_became_active":"2024-05-07T14:03:39.676092+0000","last_became_peered":"2024-05-07T14:03:39.676092+0000","last_unstale":"2024-05-07T14:05:18.959961+0000","last_undegraded":"2024-05-07T14:05:18.959961+0000","last_fullsized":"2024-05-07T14:05:18.959961+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:00.668304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"80'2","reported_seq":172,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963019+0000","last_change":"2024-05-07T14:04:59.442787+0000","last_active":"2024-05-07T14:05:18.963019+0000","last_peered":"2024-05-07T14:05:18.963019+0000","last_clean":"2024-05-07T14:05:18.963019+0000","last_became_active":"2024-05-07T14:04:59.430479+0000","last_became_peered":"2024-05-07T14:04:59.430479+0000","last_unstale":"2024-05-07T14:05:18.963019+0000","last_undegraded":"2024-05-07T14:05:18.963019+0000","last_fullsized":"2024-05-07T14:05:18.963019+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:27.875022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"124'20","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959370+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:05:18.959370+0000","last_peered":"2024-05-07T14:05:18.959370+0000","last_clean":"2024-05-07T14:05:18.959370+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:05:18.959370+0000","last_undegraded":"2024-05-07T14:05:18.959370+0000","last_fullsized":"2024-05-07T14:05:18.959370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629168+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:05:18.629168+0000","last_peered":"2024-05-07T14:05:18.629168+0000","last_clean":"2024-05-07T14:05:18.629168+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:05:18.629168+0000","last_undegraded":"2024-05-07T14:05:18.629168+0000","last_fullsized":"2024-05-07T14:05:18.629168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"124'25","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721240+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:05:18.721240+0000","last_peered":"2024-05-07T14:05:18.721240+0000","last_clean":"2024-05-07T14:05:18.721240+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:05:18.721240+0000","last_undegraded":"2024-05-07T14:05:18.721240+0000","last_fullsized":"2024-05-07T14:05:18.721240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"81'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960256+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:05:18.960256+0000","last_peered":"2024-05-07T14:05:18.960256+0000","last_clean":"2024-05-07T14:05:18.960256+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:05:18.960256+0000","last_undegraded":"2024-05-07T14:05:18.960256+0000","last_fullsized":"2024-05-07T14:05:18.960256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"124'24","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961071+0000","last_change":"2024-05-07T14:05:01.033639+0000","last_active":"2024-05-07T14:05:18.961071+0000","last_peered":"2024-05-07T14:05:18.961071+0000","last_clean":"2024-05-07T14:05:18.961071+0000","last_became_active":"2024-05-07T14:04:59.455288+0000","last_became_peered":"2024-05-07T14:04:59.455288+0000","last_unstale":"2024-05-07T14:05:18.961071+0000","last_undegraded":"2024-05-07T14:05:18.961071+0000","last_fullsized":"2024-05-07T14:05:18.961071+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:06:05.572323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"115'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960336+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:05:18.960336+0000","last_peered":"2024-05-07T14:05:18.960336+0000","last_clean":"2024-05-07T14:05:18.960336+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:05:18.960336+0000","last_undegraded":"2024-05-07T14:05:18.960336+0000","last_fullsized":"2024-05-07T14:05:18.960336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"124'19","reported_seq":275,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720428+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:05:18.720428+0000","last_peered":"2024-05-07T14:05:18.720428+0000","last_clean":"2024-05-07T14:05:18.720428+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:05:18.720428+0000","last_undegraded":"2024-05-07T14:05:18.720428+0000","last_fullsized":"2024-05-07T14:05:18.720428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"115'4","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630099+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:05:18.630099+0000","last_peered":"2024-05-07T14:05:18.630099+0000","last_clean":"2024-05-07T14:05:18.630099+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:05:18.630099+0000","last_undegraded":"2024-05-07T14:05:18.630099+0000","last_fullsized":"2024-05-07T14:05:18.630099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"124'25","reported_seq":274,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962077+0000","last_change":"2024-05-07T14:05:00.220571+0000","last_active":"2024-05-07T14:05:18.962077+0000","last_peered":"2024-05-07T14:05:18.962077+0000","last_clean":"2024-05-07T14:05:18.962077+0000","last_became_active":"2024-05-07T14:04:59.444214+0000","last_became_peered":"2024-05-07T14:04:59.444214+0000","last_unstale":"2024-05-07T14:05:18.962077+0000","last_undegraded":"2024-05-07T14:05:18.962077+0000","last_fullsized":"2024-05-07T14:05:18.962077+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:18:23.503893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"81'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721808+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:05:18.721808+0000","last_peered":"2024-05-07T14:05:18.721808+0000","last_clean":"2024-05-07T14:05:18.721808+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:05:18.721808+0000","last_undegraded":"2024-05-07T14:05:18.721808+0000","last_fullsized":"2024-05-07T14:05:18.721808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"124'23","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959282+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:05:18.959282+0000","last_peered":"2024-05-07T14:05:18.959282+0000","last_clean":"2024-05-07T14:05:18.959282+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:05:18.959282+0000","last_undegraded":"2024-05-07T14:05:18.959282+0000","last_fullsized":"2024-05-07T14:05:18.959282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"124'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630377+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:05:18.630377+0000","last_peered":"2024-05-07T14:05:18.630377+0000","last_clean":"2024-05-07T14:05:18.630377+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:05:18.630377+0000","last_undegraded":"2024-05-07T14:05:18.630377+0000","last_fullsized":"2024-05-07T14:05:18.630377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628673+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:05:18.628673+0000","last_peered":"2024-05-07T14:05:18.628673+0000","last_clean":"2024-05-07T14:05:18.628673+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:05:18.628673+0000","last_undegraded":"2024-05-07T14:05:18.628673+0000","last_fullsized":"2024-05-07T14:05:18.628673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"124'23","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961950+0000","last_change":"2024-05-07T14:05:01.245123+0000","last_active":"2024-05-07T14:05:18.961950+0000","last_peered":"2024-05-07T14:05:18.961950+0000","last_clean":"2024-05-07T14:05:18.961950+0000","last_became_active":"2024-05-07T14:04:59.452315+0000","last_became_peered":"2024-05-07T14:04:59.452315+0000","last_unstale":"2024-05-07T14:05:18.961950+0000","last_undegraded":"2024-05-07T14:05:18.961950+0000","last_fullsized":"2024-05-07T14:05:18.961950+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:20:40.045208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962499+0000","last_change":"2024-05-07T14:04:59.435447+0000","last_active":"2024-05-07T14:05:18.962499+0000","last_peered":"2024-05-07T14:05:18.962499+0000","last_clean":"2024-05-07T14:05:18.962499+0000","last_became_active":"2024-05-07T14:04:59.429254+0000","last_became_peered":"2024-05-07T14:04:59.429254+0000","last_unstale":"2024-05-07T14:05:18.962499+0000","last_undegraded":"2024-05-07T14:05:18.962499+0000","last_fullsized":"2024-05-07T14:05:18.962499+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:42:46.014749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"124'23","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961038+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:05:18.961038+0000","last_peered":"2024-05-07T14:05:18.961038+0000","last_clean":"2024-05-07T14:05:18.961038+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:05:18.961038+0000","last_undegraded":"2024-05-07T14:05:18.961038+0000","last_fullsized":"2024-05-07T14:05:18.961038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":252,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720762+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:05:18.720762+0000","last_peered":"2024-05-07T14:05:18.720762+0000","last_clean":"2024-05-07T14:05:18.720762+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:05:18.720762+0000","last_undegraded":"2024-05-07T14:05:18.720762+0000","last_fullsized":"2024-05-07T14:05:18.720762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"124'31","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963739+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:05:18.963739+0000","last_peered":"2024-05-07T14:05:18.963739+0000","last_clean":"2024-05-07T14:05:18.963739+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:05:18.963739+0000","last_undegraded":"2024-05-07T14:05:18.963739+0000","last_fullsized":"2024-05-07T14:05:18.963739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"124'10","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629192+0000","last_change":"2024-05-07T14:01:37.318563+0000","last_active":"2024-05-07T14:05:18.629192+0000","last_peered":"2024-05-07T14:05:18.629192+0000","last_clean":"2024-05-07T14:05:18.629192+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:05:18.629192+0000","last_undegraded":"2024-05-07T14:05:18.629192+0000","last_fullsized":"2024-05-07T14:05:18.629192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:27.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629565+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:05:18.629565+0000","last_peered":"2024-05-07T14:05:18.629565+0000","last_clean":"2024-05-07T14:05:18.629565+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:05:18.629565+0000","last_undegraded":"2024-05-07T14:05:18.629565+0000","last_fullsized":"2024-05-07T14:05:18.629565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"106'8","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629560+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:05:18.629560+0000","last_peered":"2024-05-07T14:05:18.629560+0000","last_clean":"2024-05-07T14:05:18.629560+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:05:18.629560+0000","last_undegraded":"2024-05-07T14:05:18.629560+0000","last_fullsized":"2024-05-07T14:05:18.629560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"124'32","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964588+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:05:18.964588+0000","last_peered":"2024-05-07T14:05:18.964588+0000","last_clean":"2024-05-07T14:05:18.964588+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:05:18.964588+0000","last_undegraded":"2024-05-07T14:05:18.964588+0000","last_fullsized":"2024-05-07T14:05:18.964588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"106'2","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630109+0000","last_change":"2024-05-07T14:03:39.848413+0000","last_active":"2024-05-07T14:05:18.630109+0000","last_peered":"2024-05-07T14:05:18.630109+0000","last_clean":"2024-05-07T14:05:18.630109+0000","last_became_active":"2024-05-07T14:03:39.663590+0000","last_became_peered":"2024-05-07T14:03:39.663590+0000","last_unstale":"2024-05-07T14:05:18.630109+0000","last_undegraded":"2024-05-07T14:05:18.630109+0000","last_fullsized":"2024-05-07T14:05:18.630109+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:02.675624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"124'19","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959332+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:05:18.959332+0000","last_peered":"2024-05-07T14:05:18.959332+0000","last_clean":"2024-05-07T14:05:18.959332+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:05:18.959332+0000","last_undegraded":"2024-05-07T14:05:18.959332+0000","last_fullsized":"2024-05-07T14:05:18.959332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628129+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:05:18.628129+0000","last_peered":"2024-05-07T14:05:18.628129+0000","last_clean":"2024-05-07T14:05:18.628129+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:05:18.628129+0000","last_undegraded":"2024-05-07T14:05:18.628129+0000","last_fullsized":"2024-05-07T14:05:18.628129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"81'2","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963957+0000","last_change":"2024-05-07T14:03:39.857355+0000","last_active":"2024-05-07T14:05:18.963957+0000","last_peered":"2024-05-07T14:05:18.963957+0000","last_clean":"2024-05-07T14:05:18.963957+0000","last_became_active":"2024-05-07T14:03:39.680721+0000","last_became_peered":"2024-05-07T14:03:39.680721+0000","last_unstale":"2024-05-07T14:05:18.963957+0000","last_undegraded":"2024-05-07T14:05:18.963957+0000","last_fullsized":"2024-05-07T14:05:18.963957+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:36.092563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"124'19","reported_seq":224,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629050+0000","last_change":"2024-05-07T14:01:37.311718+0000","last_active":"2024-05-07T14:05:18.629050+0000","last_peered":"2024-05-07T14:05:18.629050+0000","last_clean":"2024-05-07T14:05:18.629050+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:05:18.629050+0000","last_undegraded":"2024-05-07T14:05:18.629050+0000","last_fullsized":"2024-05-07T14:05:18.629050+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:24.211300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721497+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:05:18.721497+0000","last_peered":"2024-05-07T14:05:18.721497+0000","last_clean":"2024-05-07T14:05:18.721497+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:05:18.721497+0000","last_undegraded":"2024-05-07T14:05:18.721497+0000","last_fullsized":"2024-05-07T14:05:18.721497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"124'17","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961100+0000","last_change":"2024-05-07T14:04:59.457299+0000","last_active":"2024-05-07T14:05:18.961100+0000","last_peered":"2024-05-07T14:05:18.961100+0000","last_clean":"2024-05-07T14:05:18.961100+0000","last_became_active":"2024-05-07T14:04:59.455429+0000","last_became_peered":"2024-05-07T14:04:59.455429+0000","last_unstale":"2024-05-07T14:05:18.961100+0000","last_undegraded":"2024-05-07T14:05:18.961100+0000","last_fullsized":"2024-05-07T14:05:18.961100+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:29.054055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964269+0000","last_change":"2024-05-07T14:04:59.462184+0000","last_active":"2024-05-07T14:05:18.964269+0000","last_peered":"2024-05-07T14:05:18.964269+0000","last_clean":"2024-05-07T14:05:18.964269+0000","last_became_active":"2024-05-07T14:04:59.456374+0000","last_became_peered":"2024-05-07T14:04:59.456374+0000","last_unstale":"2024-05-07T14:05:18.964269+0000","last_undegraded":"2024-05-07T14:05:18.964269+0000","last_fullsized":"2024-05-07T14:05:18.964269+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:06.581660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"124'50","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719930+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:05:18.719930+0000","last_peered":"2024-05-07T14:05:18.719930+0000","last_clean":"2024-05-07T14:05:18.719930+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:05:18.719930+0000","last_undegraded":"2024-05-07T14:05:18.719930+0000","last_fullsized":"2024-05-07T14:05:18.719930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"81'6","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722091+0000","last_change":"2024-05-07T14:04:59.467076+0000","last_active":"2024-05-07T14:05:18.722091+0000","last_peered":"2024-05-07T14:05:18.722091+0000","last_clean":"2024-05-07T14:05:18.722091+0000","last_became_active":"2024-05-07T14:04:59.466480+0000","last_became_peered":"2024-05-07T14:04:59.466480+0000","last_unstale":"2024-05-07T14:05:18.722091+0000","last_undegraded":"2024-05-07T14:05:18.722091+0000","last_fullsized":"2024-05-07T14:05:18.722091+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:02.334693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"124'20","reported_seq":301,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959429+0000","last_change":"2024-05-07T14:05:00.106363+0000","last_active":"2024-05-07T14:05:18.959429+0000","last_peered":"2024-05-07T14:05:18.959429+0000","last_clean":"2024-05-07T14:05:18.959429+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:18.959429+0000","last_undegraded":"2024-05-07T14:05:18.959429+0000","last_fullsized":"2024-05-07T14:05:18.959429+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:03.250892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81788928,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964245+0000","last_change":"2024-05-07T14:04:59.446944+0000","last_active":"2024-05-07T14:05:18.964245+0000","last_peered":"2024-05-07T14:05:18.964245+0000","last_clean":"2024-05-07T14:05:18.964245+0000","last_became_active":"2024-05-07T14:04:59.445994+0000","last_became_peered":"2024-05-07T14:04:59.445994+0000","last_unstale":"2024-05-07T14:05:18.964245+0000","last_undegraded":"2024-05-07T14:05:18.964245+0000","last_fullsized":"2024-05-07T14:05:18.964245+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:08.275415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"81'7","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630813+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:05:18.630813+0000","last_peered":"2024-05-07T14:05:18.630813+0000","last_clean":"2024-05-07T14:05:18.630813+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:05:18.630813+0000","last_undegraded":"2024-05-07T14:05:18.630813+0000","last_fullsized":"2024-05-07T14:05:18.630813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629526+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:05:18.629526+0000","last_peered":"2024-05-07T14:05:18.629526+0000","last_clean":"2024-05-07T14:05:18.629526+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:05:18.629526+0000","last_undegraded":"2024-05-07T14:05:18.629526+0000","last_fullsized":"2024-05-07T14:05:18.629526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"115'8","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959036+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:05:18.959036+0000","last_peered":"2024-05-07T14:05:18.959036+0000","last_clean":"2024-05-07T14:05:18.959036+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:05:18.959036+0000","last_undegraded":"2024-05-07T14:05:18.959036+0000","last_fullsized":"2024-05-07T14:05:18.959036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"81'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962932+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:05:18.962932+0000","last_peered":"2024-05-07T14:05:18.962932+0000","last_clean":"2024-05-07T14:05:18.962932+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:05:18.962932+0000","last_undegraded":"2024-05-07T14:05:18.962932+0000","last_fullsized":"2024-05-07T14:05:18.962932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"124'16","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961915+0000","last_change":"2024-05-07T14:04:59.911990+0000","last_active":"2024-05-07T14:05:18.961915+0000","last_peered":"2024-05-07T14:05:18.961915+0000","last_clean":"2024-05-07T14:05:18.961915+0000","last_became_active":"2024-05-07T14:04:59.436710+0000","last_became_peered":"2024-05-07T14:04:59.436710+0000","last_unstale":"2024-05-07T14:05:18.961915+0000","last_undegraded":"2024-05-07T14:05:18.961915+0000","last_fullsized":"2024-05-07T14:05:18.961915+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:27:02.713493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964441+0000","last_change":"2024-05-07T14:03:39.680812+0000","last_active":"2024-05-07T14:05:18.964441+0000","last_peered":"2024-05-07T14:05:18.964441+0000","last_clean":"2024-05-07T14:05:18.964441+0000","last_became_active":"2024-05-07T14:03:39.680482+0000","last_became_peered":"2024-05-07T14:03:39.680482+0000","last_unstale":"2024-05-07T14:05:18.964441+0000","last_undegraded":"2024-05-07T14:05:18.964441+0000","last_fullsized":"2024-05-07T14:05:18.964441+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:07.705255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"81'13","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629238+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:05:18.629238+0000","last_peered":"2024-05-07T14:05:18.629238+0000","last_clean":"2024-05-07T14:05:18.629238+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:05:18.629238+0000","last_undegraded":"2024-05-07T14:05:18.629238+0000","last_fullsized":"2024-05-07T14:05:18.629238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"130'140","reported_seq":412,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962819+0000","last_change":"2024-05-07T14:05:02.234601+0000","last_active":"2024-05-07T14:05:18.962819+0000","last_peered":"2024-05-07T14:05:18.962819+0000","last_clean":"2024-05-07T14:05:18.962819+0000","last_became_active":"2024-05-07T14:04:59.463533+0000","last_became_peered":"2024-05-07T14:04:59.463533+0000","last_unstale":"2024-05-07T14:05:18.962819+0000","last_undegraded":"2024-05-07T14:05:18.962819+0000","last_fullsized":"2024-05-07T14:05:18.962819+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:50:50.067203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628944+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:05:18.628944+0000","last_peered":"2024-05-07T14:05:18.628944+0000","last_clean":"2024-05-07T14:05:18.628944+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:05:18.628944+0000","last_undegraded":"2024-05-07T14:05:18.628944+0000","last_fullsized":"2024-05-07T14:05:18.628944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"87'16","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963783+0000","last_change":"2024-05-07T14:04:59.462968+0000","last_active":"2024-05-07T14:05:18.963783+0000","last_peered":"2024-05-07T14:05:18.963783+0000","last_clean":"2024-05-07T14:05:18.963783+0000","last_became_active":"2024-05-07T14:04:59.461575+0000","last_became_peered":"2024-05-07T14:04:59.461575+0000","last_unstale":"2024-05-07T14:05:18.963783+0000","last_undegraded":"2024-05-07T14:05:18.963783+0000","last_fullsized":"2024-05-07T14:05:18.963783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:36.220334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"123'26","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959411+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:05:18.959411+0000","last_peered":"2024-05-07T14:05:18.959411+0000","last_clean":"2024-05-07T14:05:18.959411+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:05:18.959411+0000","last_undegraded":"2024-05-07T14:05:18.959411+0000","last_fullsized":"2024-05-07T14:05:18.959411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721681+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:05:18.721681+0000","last_peered":"2024-05-07T14:05:18.721681+0000","last_clean":"2024-05-07T14:05:18.721681+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:05:18.721681+0000","last_undegraded":"2024-05-07T14:05:18.721681+0000","last_fullsized":"2024-05-07T14:05:18.721681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"124'17","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962423+0000","last_change":"2024-05-07T14:04:59.462754+0000","last_active":"2024-05-07T14:05:18.962423+0000","last_peered":"2024-05-07T14:05:18.962423+0000","last_clean":"2024-05-07T14:05:18.962423+0000","last_became_active":"2024-05-07T14:04:59.459905+0000","last_became_peered":"2024-05-07T14:04:59.459905+0000","last_unstale":"2024-05-07T14:05:18.962423+0000","last_undegraded":"2024-05-07T14:05:18.962423+0000","last_fullsized":"2024-05-07T14:05:18.962423+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:02:35.111917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"124'134","reported_seq":427,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964658+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:05:18.964658+0000","last_peered":"2024-05-07T14:05:18.964658+0000","last_clean":"2024-05-07T14:05:18.964658+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:05:18.964658+0000","last_undegraded":"2024-05-07T14:05:18.964658+0000","last_fullsized":"2024-05-07T14:05:18.964658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"81'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720435+0000","last_change":"2024-05-07T14:04:59.447718+0000","last_active":"2024-05-07T14:05:18.720435+0000","last_peered":"2024-05-07T14:05:18.720435+0000","last_clean":"2024-05-07T14:05:18.720435+0000","last_became_active":"2024-05-07T14:04:59.446891+0000","last_became_peered":"2024-05-07T14:04:59.446891+0000","last_unstale":"2024-05-07T14:05:18.720435+0000","last_undegraded":"2024-05-07T14:05:18.720435+0000","last_fullsized":"2024-05-07T14:05:18.720435+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:42.667572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"124'33","reported_seq":286,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964093+0000","last_change":"2024-05-07T14:05:01.651799+0000","last_active":"2024-05-07T14:05:18.964093+0000","last_peered":"2024-05-07T14:05:18.964093+0000","last_clean":"2024-05-07T14:05:18.964093+0000","last_became_active":"2024-05-07T14:04:59.452426+0000","last_became_peered":"2024-05-07T14:04:59.452426+0000","last_unstale":"2024-05-07T14:05:18.964093+0000","last_undegraded":"2024-05-07T14:05:18.964093+0000","last_fullsized":"2024-05-07T14:05:18.964093+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:49.540606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963448+0000","last_change":"2024-05-07T14:04:59.445984+0000","last_active":"2024-05-07T14:05:18.963448+0000","last_peered":"2024-05-07T14:05:18.963448+0000","last_clean":"2024-05-07T14:05:18.963448+0000","last_became_active":"2024-05-07T14:04:59.445281+0000","last_became_peered":"2024-05-07T14:04:59.445281+0000","last_unstale":"2024-05-07T14:05:18.963448+0000","last_undegraded":"2024-05-07T14:05:18.963448+0000","last_fullsized":"2024-05-07T14:05:18.963448+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:59:14.548669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"124'28","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720191+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:05:18.720191+0000","last_peered":"2024-05-07T14:05:18.720191+0000","last_clean":"2024-05-07T14:05:18.720191+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:05:18.720191+0000","last_undegraded":"2024-05-07T14:05:18.720191+0000","last_fullsized":"2024-05-07T14:05:18.720191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960274+0000","last_change":"2024-05-07T14:03:39.666526+0000","last_active":"2024-05-07T14:05:18.960274+0000","last_peered":"2024-05-07T14:05:18.960274+0000","last_clean":"2024-05-07T14:05:18.960274+0000","last_became_active":"2024-05-07T14:03:39.666160+0000","last_became_peered":"2024-05-07T14:03:39.666160+0000","last_unstale":"2024-05-07T14:05:18.960274+0000","last_undegraded":"2024-05-07T14:05:18.960274+0000","last_fullsized":"2024-05-07T14:05:18.960274+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:44.560061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720476+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:05:18.720476+0000","last_peered":"2024-05-07T14:05:18.720476+0000","last_clean":"2024-05-07T14:05:18.720476+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:05:18.720476+0000","last_undegraded":"2024-05-07T14:05:18.720476+0000","last_fullsized":"2024-05-07T14:05:18.720476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630857+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:05:18.630857+0000","last_peered":"2024-05-07T14:05:18.630857+0000","last_clean":"2024-05-07T14:05:18.630857+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:05:18.630857+0000","last_undegraded":"2024-05-07T14:05:18.630857+0000","last_fullsized":"2024-05-07T14:05:18.630857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"124'27","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962532+0000","last_change":"2024-05-07T14:04:59.801081+0000","last_active":"2024-05-07T14:05:18.962532+0000","last_peered":"2024-05-07T14:05:18.962532+0000","last_clean":"2024-05-07T14:05:18.962532+0000","last_became_active":"2024-05-07T14:04:59.421863+0000","last_became_peered":"2024-05-07T14:04:59.421863+0000","last_unstale":"2024-05-07T14:05:18.962532+0000","last_undegraded":"2024-05-07T14:05:18.962532+0000","last_fullsized":"2024-05-07T14:05:18.962532+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:48.094723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":338,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628182+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:05:18.628182+0000","last_peered":"2024-05-07T14:05:18.628182+0000","last_clean":"2024-05-07T14:05:18.628182+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:05:18.628182+0000","last_undegraded":"2024-05-07T14:05:18.628182+0000","last_fullsized":"2024-05-07T14:05:18.628182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"124'17","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965471+0000","last_change":"2024-05-07T14:04:59.447540+0000","last_active":"2024-05-07T14:05:18.965471+0000","last_peered":"2024-05-07T14:05:18.965471+0000","last_clean":"2024-05-07T14:05:18.965471+0000","last_became_active":"2024-05-07T14:04:59.446737+0000","last_became_peered":"2024-05-07T14:04:59.446737+0000","last_unstale":"2024-05-07T14:05:18.965471+0000","last_undegraded":"2024-05-07T14:05:18.965471+0000","last_fullsized":"2024-05-07T14:05:18.965471+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.352935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963609+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:05:18.963609+0000","last_peered":"2024-05-07T14:05:18.963609+0000","last_clean":"2024-05-07T14:05:18.963609+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:05:18.963609+0000","last_undegraded":"2024-05-07T14:05:18.963609+0000","last_fullsized":"2024-05-07T14:05:18.963609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"115'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962438+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:05:18.962438+0000","last_peered":"2024-05-07T14:05:18.962438+0000","last_clean":"2024-05-07T14:05:18.962438+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:05:18.962438+0000","last_undegraded":"2024-05-07T14:05:18.962438+0000","last_fullsized":"2024-05-07T14:05:18.962438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"81'6","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959923+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:05:18.959923+0000","last_peered":"2024-05-07T14:05:18.959923+0000","last_clean":"2024-05-07T14:05:18.959923+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:05:18.959923+0000","last_undegraded":"2024-05-07T14:05:18.959923+0000","last_fullsized":"2024-05-07T14:05:18.959923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"124'29","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961785+0000","last_change":"2024-05-07T14:05:00.740552+0000","last_active":"2024-05-07T14:05:18.961785+0000","last_peered":"2024-05-07T14:05:18.961785+0000","last_clean":"2024-05-07T14:05:18.961785+0000","last_became_active":"2024-05-07T14:04:59.449454+0000","last_became_peered":"2024-05-07T14:04:59.449454+0000","last_unstale":"2024-05-07T14:05:18.961785+0000","last_undegraded":"2024-05-07T14:05:18.961785+0000","last_fullsized":"2024-05-07T14:05:18.961785+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:28:19.138204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629731+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:05:18.629731+0000","last_peered":"2024-05-07T14:05:18.629731+0000","last_clean":"2024-05-07T14:05:18.629731+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:05:18.629731+0000","last_undegraded":"2024-05-07T14:05:18.629731+0000","last_fullsized":"2024-05-07T14:05:18.629731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"124'23","reported_seq":258,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961377+0000","last_change":"2024-05-07T14:04:59.459984+0000","last_active":"2024-05-07T14:05:18.961377+0000","last_peered":"2024-05-07T14:05:18.961377+0000","last_clean":"2024-05-07T14:05:18.961377+0000","last_became_active":"2024-05-07T14:04:59.458512+0000","last_became_peered":"2024-05-07T14:04:59.458512+0000","last_unstale":"2024-05-07T14:05:18.961377+0000","last_undegraded":"2024-05-07T14:05:18.961377+0000","last_fullsized":"2024-05-07T14:05:18.961377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:11:09.127149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"124'138","reported_seq":451,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958435+0000","last_change":"2024-05-07T14:03:42.700808+0000","last_active":"2024-05-07T14:05:18.958435+0000","last_peered":"2024-05-07T14:05:18.958435+0000","last_clean":"2024-05-07T14:05:18.958435+0000","last_became_active":"2024-05-07T14:03:42.700324+0000","last_became_peered":"2024-05-07T14:03:42.700324+0000","last_unstale":"2024-05-07T14:05:18.958435+0000","last_undegraded":"2024-05-07T14:05:18.958435+0000","last_fullsized":"2024-05-07T14:05:18.958435+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:47.369543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961340+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:05:18.961340+0000","last_peered":"2024-05-07T14:05:18.961340+0000","last_clean":"2024-05-07T14:05:18.961340+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:05:18.961340+0000","last_undegraded":"2024-05-07T14:05:18.961340+0000","last_fullsized":"2024-05-07T14:05:18.961340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"124'10","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960686+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:05:18.960686+0000","last_peered":"2024-05-07T14:05:18.960686+0000","last_clean":"2024-05-07T14:05:18.960686+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:05:18.960686+0000","last_undegraded":"2024-05-07T14:05:18.960686+0000","last_fullsized":"2024-05-07T14:05:18.960686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"124'36","reported_seq":292,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721589+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:05:18.721589+0000","last_peered":"2024-05-07T14:05:18.721589+0000","last_clean":"2024-05-07T14:05:18.721589+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:05:18.721589+0000","last_undegraded":"2024-05-07T14:05:18.721589+0000","last_fullsized":"2024-05-07T14:05:18.721589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629126+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:05:18.629126+0000","last_peered":"2024-05-07T14:05:18.629126+0000","last_clean":"2024-05-07T14:05:18.629126+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:05:18.629126+0000","last_undegraded":"2024-05-07T14:05:18.629126+0000","last_fullsized":"2024-05-07T14:05:18.629126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"124'29","reported_seq":294,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958596+0000","last_change":"2024-05-07T14:04:59.456274+0000","last_active":"2024-05-07T14:05:18.958596+0000","last_peered":"2024-05-07T14:05:18.958596+0000","last_clean":"2024-05-07T14:05:18.958596+0000","last_became_active":"2024-05-07T14:04:59.455284+0000","last_became_peered":"2024-05-07T14:04:59.455284+0000","last_unstale":"2024-05-07T14:05:18.958596+0000","last_undegraded":"2024-05-07T14:05:18.958596+0000","last_fullsized":"2024-05-07T14:05:18.958596+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:44:18.184158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":246,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.627848+0000","last_change":"2024-05-07T14:04:59.467425+0000","last_active":"2024-05-07T14:05:18.627848+0000","last_peered":"2024-05-07T14:05:18.627848+0000","last_clean":"2024-05-07T14:05:18.627848+0000","last_became_active":"2024-05-07T14:04:59.466731+0000","last_became_peered":"2024-05-07T14:04:59.466731+0000","last_unstale":"2024-05-07T14:05:18.627848+0000","last_undegraded":"2024-05-07T14:05:18.627848+0000","last_fullsized":"2024-05-07T14:05:18.627848+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:57.541122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"121'5","reported_seq":111,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960905+0000","last_change":"2024-05-07T14:03:39.802033+0000","last_active":"2024-05-07T14:05:18.960905+0000","last_peered":"2024-05-07T14:05:18.960905+0000","last_clean":"2024-05-07T14:05:18.960905+0000","last_became_active":"2024-05-07T14:03:39.675695+0000","last_became_peered":"2024-05-07T14:03:39.675695+0000","last_unstale":"2024-05-07T14:05:18.960905+0000","last_undegraded":"2024-05-07T14:05:18.960905+0000","last_fullsized":"2024-05-07T14:05:18.960905+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:22:02.594405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"87'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629999+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:05:18.629999+0000","last_peered":"2024-05-07T14:05:18.629999+0000","last_clean":"2024-05-07T14:05:18.629999+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:05:18.629999+0000","last_undegraded":"2024-05-07T14:05:18.629999+0000","last_fullsized":"2024-05-07T14:05:18.629999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"124'26","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963623+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:05:18.963623+0000","last_peered":"2024-05-07T14:05:18.963623+0000","last_clean":"2024-05-07T14:05:18.963623+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:05:18.963623+0000","last_undegraded":"2024-05-07T14:05:18.963623+0000","last_fullsized":"2024-05-07T14:05:18.963623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":254,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629414+0000","last_change":"2024-05-07T14:04:59.468095+0000","last_active":"2024-05-07T14:05:18.629414+0000","last_peered":"2024-05-07T14:05:18.629414+0000","last_clean":"2024-05-07T14:05:18.629414+0000","last_became_active":"2024-05-07T14:04:59.467463+0000","last_became_peered":"2024-05-07T14:04:59.467463+0000","last_unstale":"2024-05-07T14:05:18.629414+0000","last_undegraded":"2024-05-07T14:05:18.629414+0000","last_fullsized":"2024-05-07T14:05:18.629414+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:38.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"124'21","reported_seq":309,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629398+0000","last_change":"2024-05-07T14:03:39.698456+0000","last_active":"2024-05-07T14:05:18.629398+0000","last_peered":"2024-05-07T14:05:18.629398+0000","last_clean":"2024-05-07T14:05:18.629398+0000","last_became_active":"2024-05-07T14:03:39.663223+0000","last_became_peered":"2024-05-07T14:03:39.663223+0000","last_unstale":"2024-05-07T14:05:18.629398+0000","last_undegraded":"2024-05-07T14:05:18.629398+0000","last_fullsized":"2024-05-07T14:05:18.629398+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:58.582121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959866+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:05:18.959866+0000","last_peered":"2024-05-07T14:05:18.959866+0000","last_clean":"2024-05-07T14:05:18.959866+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:05:18.959866+0000","last_undegraded":"2024-05-07T14:05:18.959866+0000","last_fullsized":"2024-05-07T14:05:18.959866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"106'6","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959722+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:05:18.959722+0000","last_peered":"2024-05-07T14:05:18.959722+0000","last_clean":"2024-05-07T14:05:18.959722+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:05:18.959722+0000","last_undegraded":"2024-05-07T14:05:18.959722+0000","last_fullsized":"2024-05-07T14:05:18.959722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"106'12","reported_seq":306,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630411+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:05:18.630411+0000","last_peered":"2024-05-07T14:05:18.630411+0000","last_clean":"2024-05-07T14:05:18.630411+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:05:18.630411+0000","last_undegraded":"2024-05-07T14:05:18.630411+0000","last_fullsized":"2024-05-07T14:05:18.630411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"124'16","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960175+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:05:18.960175+0000","last_peered":"2024-05-07T14:05:18.960175+0000","last_clean":"2024-05-07T14:05:18.960175+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:05:18.960175+0000","last_undegraded":"2024-05-07T14:05:18.960175+0000","last_fullsized":"2024-05-07T14:05:18.960175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":124,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961556+0000","last_change":"2024-05-07T14:03:39.714297+0000","last_active":"2024-05-07T14:05:18.961556+0000","last_peered":"2024-05-07T14:05:18.961556+0000","last_clean":"2024-05-07T14:05:18.961556+0000","last_became_active":"2024-05-07T14:03:39.663013+0000","last_became_peered":"2024-05-07T14:03:39.663013+0000","last_unstale":"2024-05-07T14:05:18.961556+0000","last_undegraded":"2024-05-07T14:05:18.961556+0000","last_fullsized":"2024-05-07T14:05:18.961556+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:40:56.207747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"124'24","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629991+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:05:18.629991+0000","last_peered":"2024-05-07T14:05:18.629991+0000","last_clean":"2024-05-07T14:05:18.629991+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:05:18.629991+0000","last_undegraded":"2024-05-07T14:05:18.629991+0000","last_fullsized":"2024-05-07T14:05:18.629991+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"124'134","reported_seq":440,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629860+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:05:18.629860+0000","last_peered":"2024-05-07T14:05:18.629860+0000","last_clean":"2024-05-07T14:05:18.629860+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:05:18.629860+0000","last_undegraded":"2024-05-07T14:05:18.629860+0000","last_fullsized":"2024-05-07T14:05:18.629860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"87'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962770+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:05:18.962770+0000","last_peered":"2024-05-07T14:05:18.962770+0000","last_clean":"2024-05-07T14:05:18.962770+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:05:18.962770+0000","last_undegraded":"2024-05-07T14:05:18.962770+0000","last_fullsized":"2024-05-07T14:05:18.962770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"106'8","reported_seq":288,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630803+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:05:18.630803+0000","last_peered":"2024-05-07T14:05:18.630803+0000","last_clean":"2024-05-07T14:05:18.630803+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:05:18.630803+0000","last_undegraded":"2024-05-07T14:05:18.630803+0000","last_fullsized":"2024-05-07T14:05:18.630803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"124'20","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631050+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:05:18.631050+0000","last_peered":"2024-05-07T14:05:18.631050+0000","last_clean":"2024-05-07T14:05:18.631050+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:05:18.631050+0000","last_undegraded":"2024-05-07T14:05:18.631050+0000","last_fullsized":"2024-05-07T14:05:18.631050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":428,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721954+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:05:18.721954+0000","last_peered":"2024-05-07T14:05:18.721954+0000","last_clean":"2024-05-07T14:05:18.721954+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:05:18.721954+0000","last_undegraded":"2024-05-07T14:05:18.721954+0000","last_fullsized":"2024-05-07T14:05:18.721954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":260,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964564+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:05:18.964564+0000","last_peered":"2024-05-07T14:05:18.964564+0000","last_clean":"2024-05-07T14:05:18.964564+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:05:18.964564+0000","last_undegraded":"2024-05-07T14:05:18.964564+0000","last_fullsized":"2024-05-07T14:05:18.964564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"124'134","reported_seq":429,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963004+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:05:18.963004+0000","last_peered":"2024-05-07T14:05:18.963004+0000","last_clean":"2024-05-07T14:05:18.963004+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:05:18.963004+0000","last_undegraded":"2024-05-07T14:05:18.963004+0000","last_fullsized":"2024-05-07T14:05:18.963004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"87'6","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629046+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:05:18.629046+0000","last_peered":"2024-05-07T14:05:18.629046+0000","last_clean":"2024-05-07T14:05:18.629046+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:05:18.629046+0000","last_undegraded":"2024-05-07T14:05:18.629046+0000","last_fullsized":"2024-05-07T14:05:18.629046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"124'6","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961229+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:05:18.961229+0000","last_peered":"2024-05-07T14:05:18.961229+0000","last_clean":"2024-05-07T14:05:18.961229+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:05:18.961229+0000","last_undegraded":"2024-05-07T14:05:18.961229+0000","last_fullsized":"2024-05-07T14:05:18.961229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"124'24","reported_seq":316,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959048+0000","last_change":"2024-05-07T14:03:39.814768+0000","last_active":"2024-05-07T14:05:18.959048+0000","last_peered":"2024-05-07T14:05:18.959048+0000","last_clean":"2024-05-07T14:05:18.959048+0000","last_became_active":"2024-05-07T14:03:39.666192+0000","last_became_peered":"2024-05-07T14:03:39.666192+0000","last_unstale":"2024-05-07T14:05:18.959048+0000","last_undegraded":"2024-05-07T14:05:18.959048+0000","last_fullsized":"2024-05-07T14:05:18.959048+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:10.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630568+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:05:18.630568+0000","last_peered":"2024-05-07T14:05:18.630568+0000","last_clean":"2024-05-07T14:05:18.630568+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:05:18.630568+0000","last_undegraded":"2024-05-07T14:05:18.630568+0000","last_fullsized":"2024-05-07T14:05:18.630568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"124'25","reported_seq":326,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721237+0000","last_change":"2024-05-07T14:03:39.845058+0000","last_active":"2024-05-07T14:05:18.721237+0000","last_peered":"2024-05-07T14:05:18.721237+0000","last_clean":"2024-05-07T14:05:18.721237+0000","last_became_active":"2024-05-07T14:03:39.673995+0000","last_became_peered":"2024-05-07T14:03:39.673995+0000","last_unstale":"2024-05-07T14:05:18.721237+0000","last_undegraded":"2024-05-07T14:05:18.721237+0000","last_fullsized":"2024-05-07T14:05:18.721237+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:43.919444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959774+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:05:18.959774+0000","last_peered":"2024-05-07T14:05:18.959774+0000","last_clean":"2024-05-07T14:05:18.959774+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:05:18.959774+0000","last_undegraded":"2024-05-07T14:05:18.959774+0000","last_fullsized":"2024-05-07T14:05:18.959774+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"124'2","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960409+0000","last_change":"2024-05-07T14:03:39.666268+0000","last_active":"2024-05-07T14:05:18.960409+0000","last_peered":"2024-05-07T14:05:18.960409+0000","last_clean":"2024-05-07T14:05:18.960409+0000","last_became_active":"2024-05-07T14:03:39.665838+0000","last_became_peered":"2024-05-07T14:03:39.665838+0000","last_unstale":"2024-05-07T14:05:18.960409+0000","last_undegraded":"2024-05-07T14:05:18.960409+0000","last_fullsized":"2024-05-07T14:05:18.960409+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:54:00.122392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963437+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:05:18.963437+0000","last_peered":"2024-05-07T14:05:18.963437+0000","last_clean":"2024-05-07T14:05:18.963437+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:05:18.963437+0000","last_undegraded":"2024-05-07T14:05:18.963437+0000","last_fullsized":"2024-05-07T14:05:18.963437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":313,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958642+0000","last_change":"2024-05-07T14:02:39.729323+0000","last_active":"2024-05-07T14:05:18.958642+0000","last_peered":"2024-05-07T14:05:18.958642+0000","last_clean":"2024-05-07T14:05:18.958642+0000","last_became_active":"2024-05-07T14:02:39.728189+0000","last_became_peered":"2024-05-07T14:02:39.728189+0000","last_unstale":"2024-05-07T14:05:18.958642+0000","last_undegraded":"2024-05-07T14:05:18.958642+0000","last_fullsized":"2024-05-07T14:05:18.958642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:53:59.368912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721172+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:05:18.721172+0000","last_peered":"2024-05-07T14:05:18.721172+0000","last_clean":"2024-05-07T14:05:18.721172+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:05:18.721172+0000","last_undegraded":"2024-05-07T14:05:18.721172+0000","last_fullsized":"2024-05-07T14:05:18.721172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"124'21","reported_seq":227,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628487+0000","last_change":"2024-05-07T14:01:37.317794+0000","last_active":"2024-05-07T14:05:18.628487+0000","last_peered":"2024-05-07T14:05:18.628487+0000","last_clean":"2024-05-07T14:05:18.628487+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:05:18.628487+0000","last_undegraded":"2024-05-07T14:05:18.628487+0000","last_fullsized":"2024-05-07T14:05:18.628487+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:17.582561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":31,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962017+0000","last_change":"2024-05-07T14:04:59.458347+0000","last_active":"2024-05-07T14:05:18.962017+0000","last_peered":"2024-05-07T14:05:18.962017+0000","last_clean":"2024-05-07T14:05:18.962017+0000","last_became_active":"2024-05-07T14:04:59.453884+0000","last_became_peered":"2024-05-07T14:04:59.453884+0000","last_unstale":"2024-05-07T14:05:18.962017+0000","last_undegraded":"2024-05-07T14:05:18.962017+0000","last_fullsized":"2024-05-07T14:05:18.962017+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.867992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"124'38","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722420+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:05:18.722420+0000","last_peered":"2024-05-07T14:05:18.722420+0000","last_clean":"2024-05-07T14:05:18.722420+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:05:18.722420+0000","last_undegraded":"2024-05-07T14:05:18.722420+0000","last_fullsized":"2024-05-07T14:05:18.722420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961568+0000","last_change":"2024-05-07T14:04:59.457814+0000","last_active":"2024-05-07T14:05:18.961568+0000","last_peered":"2024-05-07T14:05:18.961568+0000","last_clean":"2024-05-07T14:05:18.961568+0000","last_became_active":"2024-05-07T14:04:59.456477+0000","last_became_peered":"2024-05-07T14:04:59.456477+0000","last_unstale":"2024-05-07T14:05:18.961568+0000","last_undegraded":"2024-05-07T14:05:18.961568+0000","last_fullsized":"2024-05-07T14:05:18.961568+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:10:28.939206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":236,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958860+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:05:18.958860+0000","last_peered":"2024-05-07T14:05:18.958860+0000","last_clean":"2024-05-07T14:05:18.958860+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:05:18.958860+0000","last_undegraded":"2024-05-07T14:05:18.958860+0000","last_fullsized":"2024-05-07T14:05:18.958860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962392+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:05:18.962392+0000","last_peered":"2024-05-07T14:05:18.962392+0000","last_clean":"2024-05-07T14:05:18.962392+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:05:18.962392+0000","last_undegraded":"2024-05-07T14:05:18.962392+0000","last_fullsized":"2024-05-07T14:05:18.962392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":224,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961946+0000","last_change":"2024-05-07T14:04:59.425099+0000","last_active":"2024-05-07T14:05:18.961946+0000","last_peered":"2024-05-07T14:05:18.961946+0000","last_clean":"2024-05-07T14:05:18.961946+0000","last_became_active":"2024-05-07T14:04:59.422224+0000","last_became_peered":"2024-05-07T14:04:59.422224+0000","last_unstale":"2024-05-07T14:05:18.961946+0000","last_undegraded":"2024-05-07T14:05:18.961946+0000","last_fullsized":"2024-05-07T14:05:18.961946+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:23.398977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"124'22","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958651+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:05:18.958651+0000","last_peered":"2024-05-07T14:05:18.958651+0000","last_clean":"2024-05-07T14:05:18.958651+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:05:18.958651+0000","last_undegraded":"2024-05-07T14:05:18.958651+0000","last_fullsized":"2024-05-07T14:05:18.958651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722613+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:05:18.722613+0000","last_peered":"2024-05-07T14:05:18.722613+0000","last_clean":"2024-05-07T14:05:18.722613+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:05:18.722613+0000","last_undegraded":"2024-05-07T14:05:18.722613+0000","last_fullsized":"2024-05-07T14:05:18.722613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"124'140","reported_seq":514,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961739+0000","last_change":"2024-05-07T14:03:42.708479+0000","last_active":"2024-05-07T14:05:18.961739+0000","last_peered":"2024-05-07T14:05:18.961739+0000","last_clean":"2024-05-07T14:05:18.961739+0000","last_became_active":"2024-05-07T14:03:42.708117+0000","last_became_peered":"2024-05-07T14:03:42.708117+0000","last_unstale":"2024-05-07T14:05:18.961739+0000","last_undegraded":"2024-05-07T14:05:18.961739+0000","last_fullsized":"2024-05-07T14:05:18.961739+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:19:35.961283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5457,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962840+0000","last_change":"2024-05-07T14:04:59.462996+0000","last_active":"2024-05-07T14:05:18.962840+0000","last_peered":"2024-05-07T14:05:18.962840+0000","last_clean":"2024-05-07T14:05:18.962840+0000","last_became_active":"2024-05-07T14:04:59.461354+0000","last_became_peered":"2024-05-07T14:04:59.461354+0000","last_unstale":"2024-05-07T14:05:18.962840+0000","last_undegraded":"2024-05-07T14:05:18.962840+0000","last_fullsized":"2024-05-07T14:05:18.962840+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:55.900168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"80'4","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962201+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:05:18.962201+0000","last_peered":"2024-05-07T14:05:18.962201+0000","last_clean":"2024-05-07T14:05:18.962201+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:05:18.962201+0000","last_undegraded":"2024-05-07T14:05:18.962201+0000","last_fullsized":"2024-05-07T14:05:18.962201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"81'2","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960614+0000","last_change":"2024-05-07T14:03:39.711373+0000","last_active":"2024-05-07T14:05:18.960614+0000","last_peered":"2024-05-07T14:05:18.960614+0000","last_clean":"2024-05-07T14:05:18.960614+0000","last_became_active":"2024-05-07T14:03:39.667130+0000","last_became_peered":"2024-05-07T14:03:39.667130+0000","last_unstale":"2024-05-07T14:05:18.960614+0000","last_undegraded":"2024-05-07T14:05:18.960614+0000","last_fullsized":"2024-05-07T14:05:18.960614+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:36.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628882+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:05:18.628882+0000","last_peered":"2024-05-07T14:05:18.628882+0000","last_clean":"2024-05-07T14:05:18.628882+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:05:18.628882+0000","last_undegraded":"2024-05-07T14:05:18.628882+0000","last_fullsized":"2024-05-07T14:05:18.628882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"124'27","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963322+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:05:18.963322+0000","last_peered":"2024-05-07T14:05:18.963322+0000","last_clean":"2024-05-07T14:05:18.963322+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:05:18.963322+0000","last_undegraded":"2024-05-07T14:05:18.963322+0000","last_fullsized":"2024-05-07T14:05:18.963322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630125+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:05:18.630125+0000","last_peered":"2024-05-07T14:05:18.630125+0000","last_clean":"2024-05-07T14:05:18.630125+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:05:18.630125+0000","last_undegraded":"2024-05-07T14:05:18.630125+0000","last_fullsized":"2024-05-07T14:05:18.630125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"130'18","reported_seq":291,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963116+0000","last_change":"2024-05-07T14:04:59.461913+0000","last_active":"2024-05-07T14:05:18.963116+0000","last_peered":"2024-05-07T14:05:18.963116+0000","last_clean":"2024-05-07T14:05:18.963116+0000","last_became_active":"2024-05-07T14:04:59.456018+0000","last_became_peered":"2024-05-07T14:04:59.456018+0000","last_unstale":"2024-05-07T14:05:18.963116+0000","last_undegraded":"2024-05-07T14:05:18.963116+0000","last_fullsized":"2024-05-07T14:05:18.963116+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:42:03.359344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959826+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:05:18.959826+0000","last_peered":"2024-05-07T14:05:18.959826+0000","last_clean":"2024-05-07T14:05:18.959826+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:05:18.959826+0000","last_undegraded":"2024-05-07T14:05:18.959826+0000","last_fullsized":"2024-05-07T14:05:18.959826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965082+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:05:18.965082+0000","last_peered":"2024-05-07T14:05:18.965082+0000","last_clean":"2024-05-07T14:05:18.965082+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:05:18.965082+0000","last_undegraded":"2024-05-07T14:05:18.965082+0000","last_fullsized":"2024-05-07T14:05:18.965082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"81'4","reported_seq":106,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961642+0000","last_change":"2024-05-07T14:03:39.687600+0000","last_active":"2024-05-07T14:05:18.961642+0000","last_peered":"2024-05-07T14:05:18.961642+0000","last_clean":"2024-05-07T14:05:18.961642+0000","last_became_active":"2024-05-07T14:03:39.661295+0000","last_became_peered":"2024-05-07T14:03:39.661295+0000","last_unstale":"2024-05-07T14:05:18.961642+0000","last_undegraded":"2024-05-07T14:05:18.961642+0000","last_fullsized":"2024-05-07T14:05:18.961642+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:17:58.416324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721116+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:05:18.721116+0000","last_peered":"2024-05-07T14:05:18.721116+0000","last_clean":"2024-05-07T14:05:18.721116+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:05:18.721116+0000","last_undegraded":"2024-05-07T14:05:18.721116+0000","last_fullsized":"2024-05-07T14:05:18.721116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"123'15","reported_seq":275,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629754+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:05:18.629754+0000","last_peered":"2024-05-07T14:05:18.629754+0000","last_clean":"2024-05-07T14:05:18.629754+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:05:18.629754+0000","last_undegraded":"2024-05-07T14:05:18.629754+0000","last_fullsized":"2024-05-07T14:05:18.629754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52428800,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":25,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959150+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:05:18.959150+0000","last_peered":"2024-05-07T14:05:18.959150+0000","last_clean":"2024-05-07T14:05:18.959150+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:05:18.959150+0000","last_undegraded":"2024-05-07T14:05:18.959150+0000","last_fullsized":"2024-05-07T14:05:18.959150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964612+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:05:18.964612+0000","last_peered":"2024-05-07T14:05:18.964612+0000","last_clean":"2024-05-07T14:05:18.964612+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:05:18.964612+0000","last_undegraded":"2024-05-07T14:05:18.964612+0000","last_fullsized":"2024-05-07T14:05:18.964612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960613+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:05:18.960613+0000","last_peered":"2024-05-07T14:05:18.960613+0000","last_clean":"2024-05-07T14:05:18.960613+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:05:18.960613+0000","last_undegraded":"2024-05-07T14:05:18.960613+0000","last_fullsized":"2024-05-07T14:05:18.960613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":236,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719678+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:05:18.719678+0000","last_peered":"2024-05-07T14:05:18.719678+0000","last_clean":"2024-05-07T14:05:18.719678+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:05:18.719678+0000","last_undegraded":"2024-05-07T14:05:18.719678+0000","last_fullsized":"2024-05-07T14:05:18.719678+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962141+0000","last_change":"2024-05-07T14:03:39.659916+0000","last_active":"2024-05-07T14:05:18.962141+0000","last_peered":"2024-05-07T14:05:18.962141+0000","last_clean":"2024-05-07T14:05:18.962141+0000","last_became_active":"2024-05-07T14:03:39.659515+0000","last_became_peered":"2024-05-07T14:03:39.659515+0000","last_unstale":"2024-05-07T14:05:18.962141+0000","last_undegraded":"2024-05-07T14:05:18.962141+0000","last_fullsized":"2024-05-07T14:05:18.962141+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:49:16.796937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"123'19","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722362+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:05:18.722362+0000","last_peered":"2024-05-07T14:05:18.722362+0000","last_clean":"2024-05-07T14:05:18.722362+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:05:18.722362+0000","last_undegraded":"2024-05-07T14:05:18.722362+0000","last_fullsized":"2024-05-07T14:05:18.722362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961947+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:05:18.961947+0000","last_peered":"2024-05-07T14:05:18.961947+0000","last_clean":"2024-05-07T14:05:18.961947+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:05:18.961947+0000","last_undegraded":"2024-05-07T14:05:18.961947+0000","last_fullsized":"2024-05-07T14:05:18.961947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960414+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:05:18.960414+0000","last_peered":"2024-05-07T14:05:18.960414+0000","last_clean":"2024-05-07T14:05:18.960414+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:05:18.960414+0000","last_undegraded":"2024-05-07T14:05:18.960414+0000","last_fullsized":"2024-05-07T14:05:18.960414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'36","reported_seq":296,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958943+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:05:18.958943+0000","last_peered":"2024-05-07T14:05:18.958943+0000","last_clean":"2024-05-07T14:05:18.958943+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:05:18.958943+0000","last_undegraded":"2024-05-07T14:05:18.958943+0000","last_fullsized":"2024-05-07T14:05:18.958943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628294+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:05:18.628294+0000","last_peered":"2024-05-07T14:05:18.628294+0000","last_clean":"2024-05-07T14:05:18.628294+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:05:18.628294+0000","last_undegraded":"2024-05-07T14:05:18.628294+0000","last_fullsized":"2024-05-07T14:05:18.628294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960715+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:05:18.960715+0000","last_peered":"2024-05-07T14:05:18.960715+0000","last_clean":"2024-05-07T14:05:18.960715+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:05:18.960715+0000","last_undegraded":"2024-05-07T14:05:18.960715+0000","last_fullsized":"2024-05-07T14:05:18.960715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":254,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960639+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:05:18.960639+0000","last_peered":"2024-05-07T14:05:18.960639+0000","last_clean":"2024-05-07T14:05:18.960639+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:05:18.960639+0000","last_undegraded":"2024-05-07T14:05:18.960639+0000","last_fullsized":"2024-05-07T14:05:18.960639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"124'23","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961817+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:05:18.961817+0000","last_peered":"2024-05-07T14:05:18.961817+0000","last_clean":"2024-05-07T14:05:18.961817+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:05:18.961817+0000","last_undegraded":"2024-05-07T14:05:18.961817+0000","last_fullsized":"2024-05-07T14:05:18.961817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961641+0000","last_change":"2024-05-07T14:04:59.452453+0000","last_active":"2024-05-07T14:05:18.961641+0000","last_peered":"2024-05-07T14:05:18.961641+0000","last_clean":"2024-05-07T14:05:18.961641+0000","last_became_active":"2024-05-07T14:04:59.451719+0000","last_became_peered":"2024-05-07T14:04:59.451719+0000","last_unstale":"2024-05-07T14:05:18.961641+0000","last_undegraded":"2024-05-07T14:05:18.961641+0000","last_fullsized":"2024-05-07T14:05:18.961641+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:58:01.882244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959572+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:05:18.959572+0000","last_peered":"2024-05-07T14:05:18.959572+0000","last_clean":"2024-05-07T14:05:18.959572+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:05:18.959572+0000","last_undegraded":"2024-05-07T14:05:18.959572+0000","last_fullsized":"2024-05-07T14:05:18.959572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":116,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962572+0000","last_change":"2024-05-07T14:03:39.707679+0000","last_active":"2024-05-07T14:05:18.962572+0000","last_peered":"2024-05-07T14:05:18.962572+0000","last_clean":"2024-05-07T14:05:18.962572+0000","last_became_active":"2024-05-07T14:03:39.664751+0000","last_became_peered":"2024-05-07T14:03:39.664751+0000","last_unstale":"2024-05-07T14:05:18.962572+0000","last_undegraded":"2024-05-07T14:05:18.962572+0000","last_fullsized":"2024-05-07T14:05:18.962572+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:55.535011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"124'138","reported_seq":481,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720219+0000","last_change":"2024-05-07T14:03:42.707530+0000","last_active":"2024-05-07T14:05:18.720219+0000","last_peered":"2024-05-07T14:05:18.720219+0000","last_clean":"2024-05-07T14:05:18.720219+0000","last_became_active":"2024-05-07T14:03:42.707207+0000","last_became_peered":"2024-05-07T14:03:42.707207+0000","last_unstale":"2024-05-07T14:05:18.720219+0000","last_undegraded":"2024-05-07T14:05:18.720219+0000","last_fullsized":"2024-05-07T14:05:18.720219+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:20:22.698141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964049+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:05:18.964049+0000","last_peered":"2024-05-07T14:05:18.964049+0000","last_clean":"2024-05-07T14:05:18.964049+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:05:18.964049+0000","last_undegraded":"2024-05-07T14:05:18.964049+0000","last_fullsized":"2024-05-07T14:05:18.964049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"115'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959440+0000","last_change":"2024-05-07T14:04:59.447585+0000","last_active":"2024-05-07T14:05:18.959440+0000","last_peered":"2024-05-07T14:05:18.959440+0000","last_clean":"2024-05-07T14:05:18.959440+0000","last_became_active":"2024-05-07T14:04:59.446674+0000","last_became_peered":"2024-05-07T14:04:59.446674+0000","last_unstale":"2024-05-07T14:05:18.959440+0000","last_undegraded":"2024-05-07T14:05:18.959440+0000","last_fullsized":"2024-05-07T14:05:18.959440+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:35.485711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"124'18","reported_seq":301,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963635+0000","last_change":"2024-05-07T14:05:00.492095+0000","last_active":"2024-05-07T14:05:18.963635+0000","last_peered":"2024-05-07T14:05:18.963635+0000","last_clean":"2024-05-07T14:05:18.963635+0000","last_became_active":"2024-05-07T14:04:59.460381+0000","last_became_peered":"2024-05-07T14:04:59.460381+0000","last_unstale":"2024-05-07T14:05:18.963635+0000","last_undegraded":"2024-05-07T14:05:18.963635+0000","last_fullsized":"2024-05-07T14:05:18.963635+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:12:40.498963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959581+0000","last_change":"2024-05-07T14:03:39.672724+0000","last_active":"2024-05-07T14:05:18.959581+0000","last_peered":"2024-05-07T14:05:18.959581+0000","last_clean":"2024-05-07T14:05:18.959581+0000","last_became_active":"2024-05-07T14:03:39.671518+0000","last_became_peered":"2024-05-07T14:03:39.671518+0000","last_unstale":"2024-05-07T14:05:18.959581+0000","last_undegraded":"2024-05-07T14:05:18.959581+0000","last_fullsized":"2024-05-07T14:05:18.959581+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:25.485797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":251,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628580+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:05:18.628580+0000","last_peered":"2024-05-07T14:05:18.628580+0000","last_clean":"2024-05-07T14:05:18.628580+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:05:18.628580+0000","last_undegraded":"2024-05-07T14:05:18.628580+0000","last_fullsized":"2024-05-07T14:05:18.628580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629354+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:05:18.629354+0000","last_peered":"2024-05-07T14:05:18.629354+0000","last_clean":"2024-05-07T14:05:18.629354+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:05:18.629354+0000","last_undegraded":"2024-05-07T14:05:18.629354+0000","last_fullsized":"2024-05-07T14:05:18.629354+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"124'134","reported_seq":476,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965678+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:05:18.965678+0000","last_peered":"2024-05-07T14:05:18.965678+0000","last_clean":"2024-05-07T14:05:18.965678+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:05:18.965678+0000","last_undegraded":"2024-05-07T14:05:18.965678+0000","last_fullsized":"2024-05-07T14:05:18.965678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"81'3","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960070+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:05:18.960070+0000","last_peered":"2024-05-07T14:05:18.960070+0000","last_clean":"2024-05-07T14:05:18.960070+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:05:18.960070+0000","last_undegraded":"2024-05-07T14:05:18.960070+0000","last_fullsized":"2024-05-07T14:05:18.960070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"124'4","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630423+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:05:18.630423+0000","last_peered":"2024-05-07T14:05:18.630423+0000","last_clean":"2024-05-07T14:05:18.630423+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:05:18.630423+0000","last_undegraded":"2024-05-07T14:05:18.630423+0000","last_fullsized":"2024-05-07T14:05:18.630423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"124'23","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962938+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:05:18.962938+0000","last_peered":"2024-05-07T14:05:18.962938+0000","last_clean":"2024-05-07T14:05:18.962938+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:05:18.962938+0000","last_undegraded":"2024-05-07T14:05:18.962938+0000","last_fullsized":"2024-05-07T14:05:18.962938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964431+0000","last_change":"2024-05-07T14:04:59.469514+0000","last_active":"2024-05-07T14:05:18.964431+0000","last_peered":"2024-05-07T14:05:18.964431+0000","last_clean":"2024-05-07T14:05:18.964431+0000","last_became_active":"2024-05-07T14:04:59.469021+0000","last_became_peered":"2024-05-07T14:04:59.469021+0000","last_unstale":"2024-05-07T14:05:18.964431+0000","last_undegraded":"2024-05-07T14:05:18.964431+0000","last_fullsized":"2024-05-07T14:05:18.964431+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:17:47.533593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959578+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:05:18.959578+0000","last_peered":"2024-05-07T14:05:18.959578+0000","last_clean":"2024-05-07T14:05:18.959578+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:05:18.959578+0000","last_undegraded":"2024-05-07T14:05:18.959578+0000","last_fullsized":"2024-05-07T14:05:18.959578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"124'45","reported_seq":288,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961605+0000","last_change":"2024-05-07T14:04:59.918491+0000","last_active":"2024-05-07T14:05:18.961605+0000","last_peered":"2024-05-07T14:05:18.961605+0000","last_clean":"2024-05-07T14:05:18.961605+0000","last_became_active":"2024-05-07T14:04:59.442492+0000","last_became_peered":"2024-05-07T14:04:59.442492+0000","last_unstale":"2024-05-07T14:05:18.961605+0000","last_undegraded":"2024-05-07T14:05:18.961605+0000","last_fullsized":"2024-05-07T14:05:18.961605+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:58.713363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120967,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":40,"num_read_kb":26,"num_write":24,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":116761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":252,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963779+0000","last_change":"2024-05-07T14:03:39.665240+0000","last_active":"2024-05-07T14:05:18.963779+0000","last_peered":"2024-05-07T14:05:18.963779+0000","last_clean":"2024-05-07T14:05:18.963779+0000","last_became_active":"2024-05-07T14:03:39.664810+0000","last_became_peered":"2024-05-07T14:03:39.664810+0000","last_unstale":"2024-05-07T14:05:18.963779+0000","last_undegraded":"2024-05-07T14:05:18.963779+0000","last_fullsized":"2024-05-07T14:05:18.963779+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:18:01.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721214+0000","last_change":"2024-05-07T14:04:59.465509+0000","last_active":"2024-05-07T14:05:18.721214+0000","last_peered":"2024-05-07T14:05:18.721214+0000","last_clean":"2024-05-07T14:05:18.721214+0000","last_became_active":"2024-05-07T14:04:59.464840+0000","last_became_peered":"2024-05-07T14:04:59.464840+0000","last_unstale":"2024-05-07T14:05:18.721214+0000","last_undegraded":"2024-05-07T14:05:18.721214+0000","last_fullsized":"2024-05-07T14:05:18.721214+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:42.823262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959673+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:05:18.959673+0000","last_peered":"2024-05-07T14:05:18.959673+0000","last_clean":"2024-05-07T14:05:18.959673+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:05:18.959673+0000","last_undegraded":"2024-05-07T14:05:18.959673+0000","last_fullsized":"2024-05-07T14:05:18.959673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'8","reported_seq":290,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629203+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:05:18.629203+0000","last_peered":"2024-05-07T14:05:18.629203+0000","last_clean":"2024-05-07T14:05:18.629203+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:05:18.629203+0000","last_undegraded":"2024-05-07T14:05:18.629203+0000","last_fullsized":"2024-05-07T14:05:18.629203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"124'23","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629269+0000","last_change":"2024-05-07T14:04:59.669798+0000","last_active":"2024-05-07T14:05:18.629269+0000","last_peered":"2024-05-07T14:05:18.629269+0000","last_clean":"2024-05-07T14:05:18.629269+0000","last_became_active":"2024-05-07T14:04:59.428245+0000","last_became_peered":"2024-05-07T14:04:59.428245+0000","last_unstale":"2024-05-07T14:05:18.629269+0000","last_undegraded":"2024-05-07T14:05:18.629269+0000","last_fullsized":"2024-05-07T14:05:18.629269+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:40.955811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962422+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:05:18.962422+0000","last_peered":"2024-05-07T14:05:18.962422+0000","last_clean":"2024-05-07T14:05:18.962422+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:05:18.962422+0000","last_undegraded":"2024-05-07T14:05:18.962422+0000","last_fullsized":"2024-05-07T14:05:18.962422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"124'20","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959837+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:05:18.959837+0000","last_peered":"2024-05-07T14:05:18.959837+0000","last_clean":"2024-05-07T14:05:18.959837+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:05:18.959837+0000","last_undegraded":"2024-05-07T14:05:18.959837+0000","last_fullsized":"2024-05-07T14:05:18.959837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959679+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:05:18.959679+0000","last_peered":"2024-05-07T14:05:18.959679+0000","last_clean":"2024-05-07T14:05:18.959679+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:05:18.959679+0000","last_undegraded":"2024-05-07T14:05:18.959679+0000","last_fullsized":"2024-05-07T14:05:18.959679+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":245,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963898+0000","last_change":"2024-05-07T14:04:59.447528+0000","last_active":"2024-05-07T14:05:18.963898+0000","last_peered":"2024-05-07T14:05:18.963898+0000","last_clean":"2024-05-07T14:05:18.963898+0000","last_became_active":"2024-05-07T14:04:59.446699+0000","last_became_peered":"2024-05-07T14:04:59.446699+0000","last_unstale":"2024-05-07T14:05:18.963898+0000","last_undegraded":"2024-05-07T14:05:18.963898+0000","last_fullsized":"2024-05-07T14:05:18.963898+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:42.823262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"115'8","reported_seq":129,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962079+0000","last_change":"2024-05-07T14:03:39.692877+0000","last_active":"2024-05-07T14:05:18.962079+0000","last_peered":"2024-05-07T14:05:18.962079+0000","last_clean":"2024-05-07T14:05:18.962079+0000","last_became_active":"2024-05-07T14:03:39.663976+0000","last_became_peered":"2024-05-07T14:03:39.663976+0000","last_unstale":"2024-05-07T14:05:18.962079+0000","last_undegraded":"2024-05-07T14:05:18.962079+0000","last_fullsized":"2024-05-07T14:05:18.962079+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:36.548454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"123'21","reported_seq":267,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961132+0000","last_change":"2024-05-07T14:05:00.456893+0000","last_active":"2024-05-07T14:05:18.961132+0000","last_peered":"2024-05-07T14:05:18.961132+0000","last_clean":"2024-05-07T14:05:18.961132+0000","last_became_active":"2024-05-07T14:04:59.445956+0000","last_became_peered":"2024-05-07T14:04:59.445956+0000","last_unstale":"2024-05-07T14:05:18.961132+0000","last_undegraded":"2024-05-07T14:05:18.961132+0000","last_fullsized":"2024-05-07T14:05:18.961132+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:07.979587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964857+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:05:18.964857+0000","last_peered":"2024-05-07T14:05:18.964857+0000","last_clean":"2024-05-07T14:05:18.964857+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:05:18.964857+0000","last_undegraded":"2024-05-07T14:05:18.964857+0000","last_fullsized":"2024-05-07T14:05:18.964857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"124'9","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958697+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:05:18.958697+0000","last_peered":"2024-05-07T14:05:18.958697+0000","last_clean":"2024-05-07T14:05:18.958697+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:05:18.958697+0000","last_undegraded":"2024-05-07T14:05:18.958697+0000","last_fullsized":"2024-05-07T14:05:18.958697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962740+0000","last_change":"2024-05-07T14:04:59.445953+0000","last_active":"2024-05-07T14:05:18.962740+0000","last_peered":"2024-05-07T14:05:18.962740+0000","last_clean":"2024-05-07T14:05:18.962740+0000","last_became_active":"2024-05-07T14:04:59.444830+0000","last_became_peered":"2024-05-07T14:04:59.444830+0000","last_unstale":"2024-05-07T14:05:18.962740+0000","last_undegraded":"2024-05-07T14:05:18.962740+0000","last_fullsized":"2024-05-07T14:05:18.962740+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:10:54.814821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"106'2","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959004+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:05:18.959004+0000","last_peered":"2024-05-07T14:05:18.959004+0000","last_clean":"2024-05-07T14:05:18.959004+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:05:18.959004+0000","last_undegraded":"2024-05-07T14:05:18.959004+0000","last_fullsized":"2024-05-07T14:05:18.959004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"81'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960024+0000","last_change":"2024-05-07T14:04:59.460718+0000","last_active":"2024-05-07T14:05:18.960024+0000","last_peered":"2024-05-07T14:05:18.960024+0000","last_clean":"2024-05-07T14:05:18.960024+0000","last_became_active":"2024-05-07T14:04:59.460037+0000","last_became_peered":"2024-05-07T14:04:59.460037+0000","last_unstale":"2024-05-07T14:05:18.960024+0000","last_undegraded":"2024-05-07T14:05:18.960024+0000","last_fullsized":"2024-05-07T14:05:18.960024+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:28.266490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"124'21","reported_seq":305,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722278+0000","last_change":"2024-05-07T14:05:00.840128+0000","last_active":"2024-05-07T14:05:18.722278+0000","last_peered":"2024-05-07T14:05:18.722278+0000","last_clean":"2024-05-07T14:05:18.722278+0000","last_became_active":"2024-05-07T14:04:59.460944+0000","last_became_peered":"2024-05-07T14:04:59.460944+0000","last_unstale":"2024-05-07T14:05:18.722278+0000","last_undegraded":"2024-05-07T14:05:18.722278+0000","last_fullsized":"2024-05-07T14:05:18.722278+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:26.259170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960783+0000","last_change":"2024-05-07T14:04:59.431660+0000","last_active":"2024-05-07T14:05:18.960783+0000","last_peered":"2024-05-07T14:05:18.960783+0000","last_clean":"2024-05-07T14:05:18.960783+0000","last_became_active":"2024-05-07T14:04:59.430654+0000","last_became_peered":"2024-05-07T14:04:59.430654+0000","last_unstale":"2024-05-07T14:05:18.960783+0000","last_undegraded":"2024-05-07T14:05:18.960783+0000","last_fullsized":"2024-05-07T14:05:18.960783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:27:01.765321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"124'20","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963938+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:05:18.963938+0000","last_peered":"2024-05-07T14:05:18.963938+0000","last_clean":"2024-05-07T14:05:18.963938+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:05:18.963938+0000","last_undegraded":"2024-05-07T14:05:18.963938+0000","last_fullsized":"2024-05-07T14:05:18.963938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959502+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:05:18.959502+0000","last_peered":"2024-05-07T14:05:18.959502+0000","last_clean":"2024-05-07T14:05:18.959502+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:05:18.959502+0000","last_undegraded":"2024-05-07T14:05:18.959502+0000","last_fullsized":"2024-05-07T14:05:18.959502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720402+0000","last_change":"2024-05-07T14:04:59.444373+0000","last_active":"2024-05-07T14:05:18.720402+0000","last_peered":"2024-05-07T14:05:18.720402+0000","last_clean":"2024-05-07T14:05:18.720402+0000","last_became_active":"2024-05-07T14:04:59.443620+0000","last_became_peered":"2024-05-07T14:04:59.443620+0000","last_unstale":"2024-05-07T14:05:18.720402+0000","last_undegraded":"2024-05-07T14:05:18.720402+0000","last_fullsized":"2024-05-07T14:05:18.720402+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:44:00.772402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"124'4","reported_seq":94,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958941+0000","last_change":"2024-05-07T14:03:52.789742+0000","last_active":"2024-05-07T14:05:18.958941+0000","last_peered":"2024-05-07T14:05:18.958941+0000","last_clean":"2024-05-07T14:05:18.958941+0000","last_became_active":"2024-05-07T14:03:52.787675+0000","last_became_peered":"2024-05-07T14:03:52.787675+0000","last_unstale":"2024-05-07T14:05:18.958941+0000","last_undegraded":"2024-05-07T14:05:18.958941+0000","last_fullsized":"2024-05-07T14:05:18.958941+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:39.000431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"124'24","reported_seq":229,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630088+0000","last_change":"2024-05-07T14:01:37.318408+0000","last_active":"2024-05-07T14:05:18.630088+0000","last_peered":"2024-05-07T14:05:18.630088+0000","last_clean":"2024-05-07T14:05:18.630088+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:05:18.630088+0000","last_undegraded":"2024-05-07T14:05:18.630088+0000","last_fullsized":"2024-05-07T14:05:18.630088+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:43.643434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959480+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:05:18.959480+0000","last_peered":"2024-05-07T14:05:18.959480+0000","last_clean":"2024-05-07T14:05:18.959480+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:05:18.959480+0000","last_undegraded":"2024-05-07T14:05:18.959480+0000","last_fullsized":"2024-05-07T14:05:18.959480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"124'17","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961550+0000","last_change":"2024-05-07T14:04:59.459641+0000","last_active":"2024-05-07T14:05:18.961550+0000","last_peered":"2024-05-07T14:05:18.961550+0000","last_clean":"2024-05-07T14:05:18.961550+0000","last_became_active":"2024-05-07T14:04:59.459102+0000","last_became_peered":"2024-05-07T14:04:59.459102+0000","last_unstale":"2024-05-07T14:05:18.961550+0000","last_undegraded":"2024-05-07T14:05:18.961550+0000","last_fullsized":"2024-05-07T14:05:18.961550+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:09:18.267555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958858+0000","last_change":"2024-05-07T14:04:59.449322+0000","last_active":"2024-05-07T14:05:18.958858+0000","last_peered":"2024-05-07T14:05:18.958858+0000","last_clean":"2024-05-07T14:05:18.958858+0000","last_became_active":"2024-05-07T14:04:59.448594+0000","last_became_peered":"2024-05-07T14:04:59.448594+0000","last_unstale":"2024-05-07T14:05:18.958858+0000","last_undegraded":"2024-05-07T14:05:18.958858+0000","last_fullsized":"2024-05-07T14:05:18.958858+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:32.423884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"115'6","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964236+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:05:18.964236+0000","last_peered":"2024-05-07T14:05:18.964236+0000","last_clean":"2024-05-07T14:05:18.964236+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:05:18.964236+0000","last_undegraded":"2024-05-07T14:05:18.964236+0000","last_fullsized":"2024-05-07T14:05:18.964236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959138+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:05:18.959138+0000","last_peered":"2024-05-07T14:05:18.959138+0000","last_clean":"2024-05-07T14:05:18.959138+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:05:18.959138+0000","last_undegraded":"2024-05-07T14:05:18.959138+0000","last_fullsized":"2024-05-07T14:05:18.959138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":257,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961778+0000","last_change":"2024-05-07T14:04:59.457249+0000","last_active":"2024-05-07T14:05:18.961778+0000","last_peered":"2024-05-07T14:05:18.961778+0000","last_clean":"2024-05-07T14:05:18.961778+0000","last_became_active":"2024-05-07T14:04:59.455608+0000","last_became_peered":"2024-05-07T14:04:59.455608+0000","last_unstale":"2024-05-07T14:05:18.961778+0000","last_undegraded":"2024-05-07T14:05:18.961778+0000","last_fullsized":"2024-05-07T14:05:18.961778+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:55:28.165004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"124'29","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963612+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:05:18.963612+0000","last_peered":"2024-05-07T14:05:18.963612+0000","last_clean":"2024-05-07T14:05:18.963612+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:05:18.963612+0000","last_undegraded":"2024-05-07T14:05:18.963612+0000","last_fullsized":"2024-05-07T14:05:18.963612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120857,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720945+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:05:18.720945+0000","last_peered":"2024-05-07T14:05:18.720945+0000","last_clean":"2024-05-07T14:05:18.720945+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:05:18.720945+0000","last_undegraded":"2024-05-07T14:05:18.720945+0000","last_fullsized":"2024-05-07T14:05:18.720945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"81'2","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963561+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:05:18.963561+0000","last_peered":"2024-05-07T14:05:18.963561+0000","last_clean":"2024-05-07T14:05:18.963561+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:05:18.963561+0000","last_undegraded":"2024-05-07T14:05:18.963561+0000","last_fullsized":"2024-05-07T14:05:18.963561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"115'8","reported_seq":295,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962152+0000","last_change":"2024-05-07T14:04:59.457999+0000","last_active":"2024-05-07T14:05:18.962152+0000","last_peered":"2024-05-07T14:05:18.962152+0000","last_clean":"2024-05-07T14:05:18.962152+0000","last_became_active":"2024-05-07T14:04:59.456492+0000","last_became_peered":"2024-05-07T14:04:59.456492+0000","last_unstale":"2024-05-07T14:05:18.962152+0000","last_undegraded":"2024-05-07T14:05:18.962152+0000","last_fullsized":"2024-05-07T14:05:18.962152+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:41.936460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"124'22","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963224+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:05:18.963224+0000","last_peered":"2024-05-07T14:05:18.963224+0000","last_clean":"2024-05-07T14:05:18.963224+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:05:18.963224+0000","last_undegraded":"2024-05-07T14:05:18.963224+0000","last_fullsized":"2024-05-07T14:05:18.963224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960857+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:05:18.960857+0000","last_peered":"2024-05-07T14:05:18.960857+0000","last_clean":"2024-05-07T14:05:18.960857+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:05:18.960857+0000","last_undegraded":"2024-05-07T14:05:18.960857+0000","last_fullsized":"2024-05-07T14:05:18.960857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"124'23","reported_seq":258,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962735+0000","last_change":"2024-05-07T14:04:59.440283+0000","last_active":"2024-05-07T14:05:18.962735+0000","last_peered":"2024-05-07T14:05:18.962735+0000","last_clean":"2024-05-07T14:05:18.962735+0000","last_became_active":"2024-05-07T14:04:59.439603+0000","last_became_peered":"2024-05-07T14:04:59.439603+0000","last_unstale":"2024-05-07T14:05:18.962735+0000","last_undegraded":"2024-05-07T14:05:18.962735+0000","last_fullsized":"2024-05-07T14:05:18.962735+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:19.505619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964150+0000","last_change":"2024-05-07T14:03:39.667564+0000","last_active":"2024-05-07T14:05:18.964150+0000","last_peered":"2024-05-07T14:05:18.964150+0000","last_clean":"2024-05-07T14:05:18.964150+0000","last_became_active":"2024-05-07T14:03:39.666888+0000","last_became_peered":"2024-05-07T14:03:39.666888+0000","last_unstale":"2024-05-07T14:05:18.964150+0000","last_undegraded":"2024-05-07T14:05:18.964150+0000","last_fullsized":"2024-05-07T14:05:18.964150+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:33.367980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959043+0000","last_change":"2024-05-07T14:04:59.456030+0000","last_active":"2024-05-07T14:05:18.959043+0000","last_peered":"2024-05-07T14:05:18.959043+0000","last_clean":"2024-05-07T14:05:18.959043+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:18.959043+0000","last_undegraded":"2024-05-07T14:05:18.959043+0000","last_fullsized":"2024-05-07T14:05:18.959043+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:20:24.704314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"81'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963522+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:05:18.963522+0000","last_peered":"2024-05-07T14:05:18.963522+0000","last_clean":"2024-05-07T14:05:18.963522+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:05:18.963522+0000","last_undegraded":"2024-05-07T14:05:18.963522+0000","last_fullsized":"2024-05-07T14:05:18.963522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629964+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:05:18.629964+0000","last_peered":"2024-05-07T14:05:18.629964+0000","last_clean":"2024-05-07T14:05:18.629964+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:05:18.629964+0000","last_undegraded":"2024-05-07T14:05:18.629964+0000","last_fullsized":"2024-05-07T14:05:18.629964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631091+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:05:18.631091+0000","last_peered":"2024-05-07T14:05:18.631091+0000","last_clean":"2024-05-07T14:05:18.631091+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:05:18.631091+0000","last_undegraded":"2024-05-07T14:05:18.631091+0000","last_fullsized":"2024-05-07T14:05:18.631091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"124'19","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964240+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:05:18.964240+0000","last_peered":"2024-05-07T14:05:18.964240+0000","last_clean":"2024-05-07T14:05:18.964240+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:05:18.964240+0000","last_undegraded":"2024-05-07T14:05:18.964240+0000","last_fullsized":"2024-05-07T14:05:18.964240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960106+0000","last_change":"2024-05-07T14:03:39.664184+0000","last_active":"2024-05-07T14:05:18.960106+0000","last_peered":"2024-05-07T14:05:18.960106+0000","last_clean":"2024-05-07T14:05:18.960106+0000","last_became_active":"2024-05-07T14:03:39.663569+0000","last_became_peered":"2024-05-07T14:03:39.663569+0000","last_unstale":"2024-05-07T14:05:18.960106+0000","last_undegraded":"2024-05-07T14:05:18.960106+0000","last_fullsized":"2024-05-07T14:05:18.960106+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:51.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720030+0000","last_change":"2024-05-07T14:04:59.447765+0000","last_active":"2024-05-07T14:05:18.720030+0000","last_peered":"2024-05-07T14:05:18.720030+0000","last_clean":"2024-05-07T14:05:18.720030+0000","last_became_active":"2024-05-07T14:04:59.447025+0000","last_became_peered":"2024-05-07T14:04:59.447025+0000","last_unstale":"2024-05-07T14:05:18.720030+0000","last_undegraded":"2024-05-07T14:05:18.720030+0000","last_fullsized":"2024-05-07T14:05:18.720030+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:14.299214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"124'14","reported_seq":298,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629778+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:05:18.629778+0000","last_peered":"2024-05-07T14:05:18.629778+0000","last_clean":"2024-05-07T14:05:18.629778+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:05:18.629778+0000","last_undegraded":"2024-05-07T14:05:18.629778+0000","last_fullsized":"2024-05-07T14:05:18.629778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"124'20","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960254+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:05:18.960254+0000","last_peered":"2024-05-07T14:05:18.960254+0000","last_clean":"2024-05-07T14:05:18.960254+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:05:18.960254+0000","last_undegraded":"2024-05-07T14:05:18.960254+0000","last_fullsized":"2024-05-07T14:05:18.960254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964629+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:05:18.964629+0000","last_peered":"2024-05-07T14:05:18.964629+0000","last_clean":"2024-05-07T14:05:18.964629+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:05:18.964629+0000","last_undegraded":"2024-05-07T14:05:18.964629+0000","last_fullsized":"2024-05-07T14:05:18.964629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630297+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:05:18.630297+0000","last_peered":"2024-05-07T14:05:18.630297+0000","last_clean":"2024-05-07T14:05:18.630297+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:05:18.630297+0000","last_undegraded":"2024-05-07T14:05:18.630297+0000","last_fullsized":"2024-05-07T14:05:18.630297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"124'134","reported_seq":505,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960331+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:05:18.960331+0000","last_peered":"2024-05-07T14:05:18.960331+0000","last_clean":"2024-05-07T14:05:18.960331+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:05:18.960331+0000","last_undegraded":"2024-05-07T14:05:18.960331+0000","last_fullsized":"2024-05-07T14:05:18.960331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"81'7","reported_seq":161,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961656+0000","last_change":"2024-05-07T14:04:59.448265+0000","last_active":"2024-05-07T14:05:18.961656+0000","last_peered":"2024-05-07T14:05:18.961656+0000","last_clean":"2024-05-07T14:05:18.961656+0000","last_became_active":"2024-05-07T14:04:59.444580+0000","last_became_peered":"2024-05-07T14:04:59.444580+0000","last_unstale":"2024-05-07T14:05:18.961656+0000","last_undegraded":"2024-05-07T14:05:18.961656+0000","last_fullsized":"2024-05-07T14:05:18.961656+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:54.087416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"124'8","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629103+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:05:18.629103+0000","last_peered":"2024-05-07T14:05:18.629103+0000","last_clean":"2024-05-07T14:05:18.629103+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:05:18.629103+0000","last_undegraded":"2024-05-07T14:05:18.629103+0000","last_fullsized":"2024-05-07T14:05:18.629103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"124'20","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721314+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:05:18.721314+0000","last_peered":"2024-05-07T14:05:18.721314+0000","last_clean":"2024-05-07T14:05:18.721314+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:05:18.721314+0000","last_undegraded":"2024-05-07T14:05:18.721314+0000","last_fullsized":"2024-05-07T14:05:18.721314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961289+0000","last_change":"2024-05-07T14:04:59.425730+0000","last_active":"2024-05-07T14:05:18.961289+0000","last_peered":"2024-05-07T14:05:18.961289+0000","last_clean":"2024-05-07T14:05:18.961289+0000","last_became_active":"2024-05-07T14:04:59.421636+0000","last_became_peered":"2024-05-07T14:04:59.421636+0000","last_unstale":"2024-05-07T14:05:18.961289+0000","last_undegraded":"2024-05-07T14:05:18.961289+0000","last_fullsized":"2024-05-07T14:05:18.961289+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:15:27.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"124'23","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720578+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:05:18.720578+0000","last_peered":"2024-05-07T14:05:18.720578+0000","last_clean":"2024-05-07T14:05:18.720578+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:05:18.720578+0000","last_undegraded":"2024-05-07T14:05:18.720578+0000","last_fullsized":"2024-05-07T14:05:18.720578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958232+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:05:18.958232+0000","last_peered":"2024-05-07T14:05:18.958232+0000","last_clean":"2024-05-07T14:05:18.958232+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:05:18.958232+0000","last_undegraded":"2024-05-07T14:05:18.958232+0000","last_fullsized":"2024-05-07T14:05:18.958232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"124'7","reported_seq":157,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964433+0000","last_change":"2024-05-07T14:05:02.242073+0000","last_active":"2024-05-07T14:05:18.964433+0000","last_peered":"2024-05-07T14:05:18.964433+0000","last_clean":"2024-05-07T14:05:18.964433+0000","last_became_active":"2024-05-07T14:04:59.467712+0000","last_became_peered":"2024-05-07T14:04:59.467712+0000","last_unstale":"2024-05-07T14:05:18.964433+0000","last_undegraded":"2024-05-07T14:05:18.964433+0000","last_fullsized":"2024-05-07T14:05:18.964433+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:31.624262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"115'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629455+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:05:18.629455+0000","last_peered":"2024-05-07T14:05:18.629455+0000","last_clean":"2024-05-07T14:05:18.629455+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:05:18.629455+0000","last_undegraded":"2024-05-07T14:05:18.629455+0000","last_fullsized":"2024-05-07T14:05:18.629455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"124'26","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722184+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:05:18.722184+0000","last_peered":"2024-05-07T14:05:18.722184+0000","last_clean":"2024-05-07T14:05:18.722184+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:05:18.722184+0000","last_undegraded":"2024-05-07T14:05:18.722184+0000","last_fullsized":"2024-05-07T14:05:18.722184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720667+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:05:18.720667+0000","last_peered":"2024-05-07T14:05:18.720667+0000","last_clean":"2024-05-07T14:05:18.720667+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:05:18.720667+0000","last_undegraded":"2024-05-07T14:05:18.720667+0000","last_fullsized":"2024-05-07T14:05:18.720667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"124'17","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958238+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:05:18.958238+0000","last_peered":"2024-05-07T14:05:18.958238+0000","last_clean":"2024-05-07T14:05:18.958238+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:05:18.958238+0000","last_undegraded":"2024-05-07T14:05:18.958238+0000","last_fullsized":"2024-05-07T14:05:18.958238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959103+0000","last_change":"2024-05-07T14:04:59.466240+0000","last_active":"2024-05-07T14:05:18.959103+0000","last_peered":"2024-05-07T14:05:18.959103+0000","last_clean":"2024-05-07T14:05:18.959103+0000","last_became_active":"2024-05-07T14:04:59.465509+0000","last_became_peered":"2024-05-07T14:04:59.465509+0000","last_unstale":"2024-05-07T14:05:18.959103+0000","last_undegraded":"2024-05-07T14:05:18.959103+0000","last_fullsized":"2024-05-07T14:05:18.959103+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:28:23.609814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964136+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:05:18.964136+0000","last_peered":"2024-05-07T14:05:18.964136+0000","last_clean":"2024-05-07T14:05:18.964136+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:05:18.964136+0000","last_undegraded":"2024-05-07T14:05:18.964136+0000","last_fullsized":"2024-05-07T14:05:18.964136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"87'6","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960098+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:05:18.960098+0000","last_peered":"2024-05-07T14:05:18.960098+0000","last_clean":"2024-05-07T14:05:18.960098+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:05:18.960098+0000","last_undegraded":"2024-05-07T14:05:18.960098+0000","last_fullsized":"2024-05-07T14:05:18.960098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"124'19","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964959+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:05:18.964959+0000","last_peered":"2024-05-07T14:05:18.964959+0000","last_clean":"2024-05-07T14:05:18.964959+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:05:18.964959+0000","last_undegraded":"2024-05-07T14:05:18.964959+0000","last_fullsized":"2024-05-07T14:05:18.964959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628160+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:05:18.628160+0000","last_peered":"2024-05-07T14:05:18.628160+0000","last_clean":"2024-05-07T14:05:18.628160+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:05:18.628160+0000","last_undegraded":"2024-05-07T14:05:18.628160+0000","last_fullsized":"2024-05-07T14:05:18.628160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"124'13","reported_seq":271,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965528+0000","last_change":"2024-05-07T14:04:59.460738+0000","last_active":"2024-05-07T14:05:18.965528+0000","last_peered":"2024-05-07T14:05:18.965528+0000","last_clean":"2024-05-07T14:05:18.965528+0000","last_became_active":"2024-05-07T14:04:59.459963+0000","last_became_peered":"2024-05-07T14:04:59.459963+0000","last_unstale":"2024-05-07T14:05:18.965528+0000","last_undegraded":"2024-05-07T14:05:18.965528+0000","last_fullsized":"2024-05-07T14:05:18.965528+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:14:25.517514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628526+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:05:18.628526+0000","last_peered":"2024-05-07T14:05:18.628526+0000","last_clean":"2024-05-07T14:05:18.628526+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:05:18.628526+0000","last_undegraded":"2024-05-07T14:05:18.628526+0000","last_fullsized":"2024-05-07T14:05:18.628526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"81'8","reported_seq":222,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963108+0000","last_change":"2024-05-07T14:04:59.462387+0000","last_active":"2024-05-07T14:05:18.963108+0000","last_peered":"2024-05-07T14:05:18.963108+0000","last_clean":"2024-05-07T14:05:18.963108+0000","last_became_active":"2024-05-07T14:04:59.456842+0000","last_became_peered":"2024-05-07T14:04:59.456842+0000","last_unstale":"2024-05-07T14:05:18.963108+0000","last_undegraded":"2024-05-07T14:05:18.963108+0000","last_fullsized":"2024-05-07T14:05:18.963108+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:43:26.257882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"115'10","reported_seq":294,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628969+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:05:18.628969+0000","last_peered":"2024-05-07T14:05:18.628969+0000","last_clean":"2024-05-07T14:05:18.628969+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:05:18.628969+0000","last_undegraded":"2024-05-07T14:05:18.628969+0000","last_fullsized":"2024-05-07T14:05:18.628969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"124'22","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960298+0000","last_change":"2024-05-07T14:01:37.554242+0000","last_active":"2024-05-07T14:05:18.960298+0000","last_peered":"2024-05-07T14:05:18.960298+0000","last_clean":"2024-05-07T14:05:18.960298+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:05:18.960298+0000","last_undegraded":"2024-05-07T14:05:18.960298+0000","last_fullsized":"2024-05-07T14:05:18.960298+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:16:22.149514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962634+0000","last_change":"2024-05-07T14:03:39.674947+0000","last_active":"2024-05-07T14:05:18.962634+0000","last_peered":"2024-05-07T14:05:18.962634+0000","last_clean":"2024-05-07T14:05:18.962634+0000","last_became_active":"2024-05-07T14:03:39.659887+0000","last_became_peered":"2024-05-07T14:03:39.659887+0000","last_unstale":"2024-05-07T14:05:18.962634+0000","last_undegraded":"2024-05-07T14:05:18.962634+0000","last_fullsized":"2024-05-07T14:05:18.962634+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:18:06.217561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"124'17","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628561+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:05:18.628561+0000","last_peered":"2024-05-07T14:05:18.628561+0000","last_clean":"2024-05-07T14:05:18.628561+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:05:18.628561+0000","last_undegraded":"2024-05-07T14:05:18.628561+0000","last_fullsized":"2024-05-07T14:05:18.628561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958734+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:05:18.958734+0000","last_peered":"2024-05-07T14:05:18.958734+0000","last_clean":"2024-05-07T14:05:18.958734+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:05:18.958734+0000","last_undegraded":"2024-05-07T14:05:18.958734+0000","last_fullsized":"2024-05-07T14:05:18.958734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631326+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:05:18.631326+0000","last_peered":"2024-05-07T14:05:18.631326+0000","last_clean":"2024-05-07T14:05:18.631326+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:05:18.631326+0000","last_undegraded":"2024-05-07T14:05:18.631326+0000","last_fullsized":"2024-05-07T14:05:18.631326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"87'16","reported_seq":110,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960757+0000","last_change":"2024-05-07T14:03:39.799013+0000","last_active":"2024-05-07T14:05:18.960757+0000","last_peered":"2024-05-07T14:05:18.960757+0000","last_clean":"2024-05-07T14:05:18.960757+0000","last_became_active":"2024-05-07T14:03:39.671068+0000","last_became_peered":"2024-05-07T14:03:39.671068+0000","last_unstale":"2024-05-07T14:05:18.960757+0000","last_undegraded":"2024-05-07T14:05:18.960757+0000","last_fullsized":"2024-05-07T14:05:18.960757+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:13.746128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"124'22","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959122+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:05:18.959122+0000","last_peered":"2024-05-07T14:05:18.959122+0000","last_clean":"2024-05-07T14:05:18.959122+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:05:18.959122+0000","last_undegraded":"2024-05-07T14:05:18.959122+0000","last_fullsized":"2024-05-07T14:05:18.959122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959826+0000","last_change":"2024-05-07T14:03:39.661724+0000","last_active":"2024-05-07T14:05:18.959826+0000","last_peered":"2024-05-07T14:05:18.959826+0000","last_clean":"2024-05-07T14:05:18.959826+0000","last_became_active":"2024-05-07T14:03:39.661339+0000","last_became_peered":"2024-05-07T14:03:39.661339+0000","last_unstale":"2024-05-07T14:05:18.959826+0000","last_undegraded":"2024-05-07T14:05:18.959826+0000","last_fullsized":"2024-05-07T14:05:18.959826+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:34.633849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"123'17","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628556+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:05:18.628556+0000","last_peered":"2024-05-07T14:05:18.628556+0000","last_clean":"2024-05-07T14:05:18.628556+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:05:18.628556+0000","last_undegraded":"2024-05-07T14:05:18.628556+0000","last_fullsized":"2024-05-07T14:05:18.628556+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:01.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"81'6","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721729+0000","last_change":"2024-05-07T14:04:59.467441+0000","last_active":"2024-05-07T14:05:18.721729+0000","last_peered":"2024-05-07T14:05:18.721729+0000","last_clean":"2024-05-07T14:05:18.721729+0000","last_became_active":"2024-05-07T14:04:59.466443+0000","last_became_peered":"2024-05-07T14:04:59.466443+0000","last_unstale":"2024-05-07T14:05:18.721729+0000","last_undegraded":"2024-05-07T14:05:18.721729+0000","last_fullsized":"2024-05-07T14:05:18.721729+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:35.485711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"124'25","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721037+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:05:18.721037+0000","last_peered":"2024-05-07T14:05:18.721037+0000","last_clean":"2024-05-07T14:05:18.721037+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:05:18.721037+0000","last_undegraded":"2024-05-07T14:05:18.721037+0000","last_fullsized":"2024-05-07T14:05:18.721037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"124'4","reported_seq":124,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961882+0000","last_change":"2024-05-07T14:04:59.861145+0000","last_active":"2024-05-07T14:05:18.961882+0000","last_peered":"2024-05-07T14:05:18.961882+0000","last_clean":"2024-05-07T14:05:18.961882+0000","last_became_active":"2024-05-07T14:04:59.445932+0000","last_became_peered":"2024-05-07T14:04:59.445932+0000","last_unstale":"2024-05-07T14:05:18.961882+0000","last_undegraded":"2024-05-07T14:05:18.961882+0000","last_fullsized":"2024-05-07T14:05:18.961882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:42.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"124'28","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960357+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:05:18.960357+0000","last_peered":"2024-05-07T14:05:18.960357+0000","last_clean":"2024-05-07T14:05:18.960357+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:05:18.960357+0000","last_undegraded":"2024-05-07T14:05:18.960357+0000","last_fullsized":"2024-05-07T14:05:18.960357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"81'2","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965417+0000","last_change":"2024-05-07T14:04:59.448690+0000","last_active":"2024-05-07T14:05:18.965417+0000","last_peered":"2024-05-07T14:05:18.965417+0000","last_clean":"2024-05-07T14:05:18.965417+0000","last_became_active":"2024-05-07T14:04:59.447844+0000","last_became_peered":"2024-05-07T14:04:59.447844+0000","last_unstale":"2024-05-07T14:05:18.965417+0000","last_undegraded":"2024-05-07T14:05:18.965417+0000","last_fullsized":"2024-05-07T14:05:18.965417+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:48:36.699391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"124'21","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964522+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:05:18.964522+0000","last_peered":"2024-05-07T14:05:18.964522+0000","last_clean":"2024-05-07T14:05:18.964522+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:05:18.964522+0000","last_undegraded":"2024-05-07T14:05:18.964522+0000","last_fullsized":"2024-05-07T14:05:18.964522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629774+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:05:18.629774+0000","last_peered":"2024-05-07T14:05:18.629774+0000","last_clean":"2024-05-07T14:05:18.629774+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:05:18.629774+0000","last_undegraded":"2024-05-07T14:05:18.629774+0000","last_fullsized":"2024-05-07T14:05:18.629774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"124'28","reported_seq":133,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965151+0000","last_change":"2024-05-07T14:03:39.789159+0000","last_active":"2024-05-07T14:05:18.965151+0000","last_peered":"2024-05-07T14:05:18.965151+0000","last_clean":"2024-05-07T14:05:18.965151+0000","last_became_active":"2024-05-07T14:03:39.668790+0000","last_became_peered":"2024-05-07T14:03:39.668790+0000","last_unstale":"2024-05-07T14:05:18.965151+0000","last_undegraded":"2024-05-07T14:05:18.965151+0000","last_fullsized":"2024-05-07T14:05:18.965151+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:14.798045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"81'8","reported_seq":319,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959979+0000","last_change":"2024-05-07T14:03:39.855375+0000","last_active":"2024-05-07T14:05:18.959979+0000","last_peered":"2024-05-07T14:05:18.959979+0000","last_clean":"2024-05-07T14:05:18.959979+0000","last_became_active":"2024-05-07T14:03:39.666451+0000","last_became_peered":"2024-05-07T14:03:39.666451+0000","last_unstale":"2024-05-07T14:05:18.959979+0000","last_undegraded":"2024-05-07T14:05:18.959979+0000","last_fullsized":"2024-05-07T14:05:18.959979+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:37.171990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"124'22","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961451+0000","last_change":"2024-05-07T14:05:00.248173+0000","last_active":"2024-05-07T14:05:18.961451+0000","last_peered":"2024-05-07T14:05:18.961451+0000","last_clean":"2024-05-07T14:05:18.961451+0000","last_became_active":"2024-05-07T14:04:59.455622+0000","last_became_peered":"2024-05-07T14:04:59.455622+0000","last_unstale":"2024-05-07T14:05:18.961451+0000","last_undegraded":"2024-05-07T14:05:18.961451+0000","last_fullsized":"2024-05-07T14:05:18.961451+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:03.691207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"115'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959101+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:05:18.959101+0000","last_peered":"2024-05-07T14:05:18.959101+0000","last_clean":"2024-05-07T14:05:18.959101+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:05:18.959101+0000","last_undegraded":"2024-05-07T14:05:18.959101+0000","last_fullsized":"2024-05-07T14:05:18.959101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"124'20","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963922+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:05:18.963922+0000","last_peered":"2024-05-07T14:05:18.963922+0000","last_clean":"2024-05-07T14:05:18.963922+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:05:18.963922+0000","last_undegraded":"2024-05-07T14:05:18.963922+0000","last_fullsized":"2024-05-07T14:05:18.963922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"106'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960114+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:05:18.960114+0000","last_peered":"2024-05-07T14:05:18.960114+0000","last_clean":"2024-05-07T14:05:18.960114+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:05:18.960114+0000","last_undegraded":"2024-05-07T14:05:18.960114+0000","last_fullsized":"2024-05-07T14:05:18.960114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"124'29","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720842+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:05:18.720842+0000","last_peered":"2024-05-07T14:05:18.720842+0000","last_clean":"2024-05-07T14:05:18.720842+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:05:18.720842+0000","last_undegraded":"2024-05-07T14:05:18.720842+0000","last_fullsized":"2024-05-07T14:05:18.720842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":39,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630722+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:05:18.630722+0000","last_peered":"2024-05-07T14:05:18.630722+0000","last_clean":"2024-05-07T14:05:18.630722+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:05:18.630722+0000","last_undegraded":"2024-05-07T14:05:18.630722+0000","last_fullsized":"2024-05-07T14:05:18.630722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"124'24","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960142+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:05:18.960142+0000","last_peered":"2024-05-07T14:05:18.960142+0000","last_clean":"2024-05-07T14:05:18.960142+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:05:18.960142+0000","last_undegraded":"2024-05-07T14:05:18.960142+0000","last_fullsized":"2024-05-07T14:05:18.960142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"106'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629998+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:05:18.629998+0000","last_peered":"2024-05-07T14:05:18.629998+0000","last_clean":"2024-05-07T14:05:18.629998+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:05:18.629998+0000","last_undegraded":"2024-05-07T14:05:18.629998+0000","last_fullsized":"2024-05-07T14:05:18.629998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"124'27","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720756+0000","last_change":"2024-05-07T14:04:59.856502+0000","last_active":"2024-05-07T14:05:18.720756+0000","last_peered":"2024-05-07T14:05:18.720756+0000","last_clean":"2024-05-07T14:05:18.720756+0000","last_became_active":"2024-05-07T14:04:59.443769+0000","last_became_peered":"2024-05-07T14:04:59.443769+0000","last_unstale":"2024-05-07T14:05:18.720756+0000","last_undegraded":"2024-05-07T14:05:18.720756+0000","last_fullsized":"2024-05-07T14:05:18.720756+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:48:34.692070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":254,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631223+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:05:18.631223+0000","last_peered":"2024-05-07T14:05:18.631223+0000","last_clean":"2024-05-07T14:05:18.631223+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:05:18.631223+0000","last_undegraded":"2024-05-07T14:05:18.631223+0000","last_fullsized":"2024-05-07T14:05:18.631223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"124'27","reported_seq":308,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960464+0000","last_change":"2024-05-07T14:05:01.098433+0000","last_active":"2024-05-07T14:05:18.960464+0000","last_peered":"2024-05-07T14:05:18.960464+0000","last_clean":"2024-05-07T14:05:18.960464+0000","last_became_active":"2024-05-07T14:04:59.458388+0000","last_became_peered":"2024-05-07T14:04:59.458388+0000","last_unstale":"2024-05-07T14:05:18.960464+0000","last_undegraded":"2024-05-07T14:05:18.960464+0000","last_fullsized":"2024-05-07T14:05:18.960464+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:29:00.050525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"81'6","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961340+0000","last_change":"2024-05-07T14:04:59.449854+0000","last_active":"2024-05-07T14:05:18.961340+0000","last_peered":"2024-05-07T14:05:18.961340+0000","last_clean":"2024-05-07T14:05:18.961340+0000","last_became_active":"2024-05-07T14:04:59.448913+0000","last_became_peered":"2024-05-07T14:04:59.448913+0000","last_unstale":"2024-05-07T14:05:18.961340+0000","last_undegraded":"2024-05-07T14:05:18.961340+0000","last_fullsized":"2024-05-07T14:05:18.961340+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:39.717523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"124'29","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960607+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:05:18.960607+0000","last_peered":"2024-05-07T14:05:18.960607+0000","last_clean":"2024-05-07T14:05:18.960607+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:05:18.960607+0000","last_undegraded":"2024-05-07T14:05:18.960607+0000","last_fullsized":"2024-05-07T14:05:18.960607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119537664,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"87'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958936+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:05:18.958936+0000","last_peered":"2024-05-07T14:05:18.958936+0000","last_clean":"2024-05-07T14:05:18.958936+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:05:18.958936+0000","last_undegraded":"2024-05-07T14:05:18.958936+0000","last_fullsized":"2024-05-07T14:05:18.958936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"123'23","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961924+0000","last_change":"2024-05-07T14:05:02.233669+0000","last_active":"2024-05-07T14:05:18.961924+0000","last_peered":"2024-05-07T14:05:18.961924+0000","last_clean":"2024-05-07T14:05:18.961924+0000","last_became_active":"2024-05-07T14:04:59.459490+0000","last_became_peered":"2024-05-07T14:04:59.459490+0000","last_unstale":"2024-05-07T14:05:18.961924+0000","last_undegraded":"2024-05-07T14:05:18.961924+0000","last_fullsized":"2024-05-07T14:05:18.961924+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:24.042272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"81'6","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959934+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:05:18.959934+0000","last_peered":"2024-05-07T14:05:18.959934+0000","last_clean":"2024-05-07T14:05:18.959934+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:05:18.959934+0000","last_undegraded":"2024-05-07T14:05:18.959934+0000","last_fullsized":"2024-05-07T14:05:18.959934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"124'26","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630545+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:05:18.630545+0000","last_peered":"2024-05-07T14:05:18.630545+0000","last_clean":"2024-05-07T14:05:18.630545+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:05:18.630545+0000","last_undegraded":"2024-05-07T14:05:18.630545+0000","last_fullsized":"2024-05-07T14:05:18.630545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"124'6","reported_seq":199,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960492+0000","last_change":"2024-05-07T14:05:00.223495+0000","last_active":"2024-05-07T14:05:18.960492+0000","last_peered":"2024-05-07T14:05:18.960492+0000","last_clean":"2024-05-07T14:05:18.960492+0000","last_became_active":"2024-05-07T14:04:59.442569+0000","last_became_peered":"2024-05-07T14:04:59.442569+0000","last_unstale":"2024-05-07T14:05:18.960492+0000","last_undegraded":"2024-05-07T14:05:18.960492+0000","last_fullsized":"2024-05-07T14:05:18.960492+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:10.158704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"124'26","reported_seq":300,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722687+0000","last_change":"2024-05-07T14:05:01.256475+0000","last_active":"2024-05-07T14:05:18.722687+0000","last_peered":"2024-05-07T14:05:18.722687+0000","last_clean":"2024-05-07T14:05:18.722687+0000","last_became_active":"2024-05-07T14:04:59.461335+0000","last_became_peered":"2024-05-07T14:04:59.461335+0000","last_unstale":"2024-05-07T14:05:18.722687+0000","last_undegraded":"2024-05-07T14:05:18.722687+0000","last_fullsized":"2024-05-07T14:05:18.722687+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:34.213014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"124'24","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720700+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:05:18.720700+0000","last_peered":"2024-05-07T14:05:18.720700+0000","last_clean":"2024-05-07T14:05:18.720700+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:05:18.720700+0000","last_undegraded":"2024-05-07T14:05:18.720700+0000","last_fullsized":"2024-05-07T14:05:18.720700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"124'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959984+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:05:18.959984+0000","last_peered":"2024-05-07T14:05:18.959984+0000","last_clean":"2024-05-07T14:05:18.959984+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:05:18.959984+0000","last_undegraded":"2024-05-07T14:05:18.959984+0000","last_fullsized":"2024-05-07T14:05:18.959984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"124'21","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963118+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:05:18.963118+0000","last_peered":"2024-05-07T14:05:18.963118+0000","last_clean":"2024-05-07T14:05:18.963118+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:05:18.963118+0000","last_undegraded":"2024-05-07T14:05:18.963118+0000","last_fullsized":"2024-05-07T14:05:18.963118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"106'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722115+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:05:18.722115+0000","last_peered":"2024-05-07T14:05:18.722115+0000","last_clean":"2024-05-07T14:05:18.722115+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:05:18.722115+0000","last_undegraded":"2024-05-07T14:05:18.722115+0000","last_fullsized":"2024-05-07T14:05:18.722115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":313,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1086,"ondisk_log_size":1086,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382934,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":846,"num_read_kb":608,"num_write":467,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":121255,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":761,"ondisk_log_size":761,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":341,"num_read_kb":341,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1436,"num_read_kb":1404,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":620756992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":129,"seq":554050781191,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1805604,"kb_used_data":1769364,"kb_used_omap":6,"kb_used_meta":36217,"kb_avail":92566236,"statfs":{"total":96636764160,"available":94787825664,"internally_reserved":0,"allocated":1811828736,"data_stored":1811073810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6345,"internal_metadata":37087031},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1266516,"kb_used_data":1235332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93105324,"statfs":{"total":96636764160,"available":95339851776,"internally_reserved":0,"allocated":1264979968,"data_stored":1264248696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1941888,"kb_used_data":1906544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92429952,"statfs":{"total":96636764160,"available":94648270848,"internally_reserved":0,"allocated":1952301056,"data_stored":1951526125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1749148,"kb_used_data":1717960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92622692,"statfs":{"total":96636764160,"available":94845636608,"internally_reserved":0,"allocated":1759191040,"data_stored":1758470596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1917812,"kb_used_data":1882468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92454028,"statfs":{"total":96636764160,"available":94672924672,"internally_reserved":0,"allocated":1927647232,"data_stored":1926891074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1015960,"kb_used_data":984776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93355880,"statfs":{"total":96636764160,"available":95596421120,"internally_reserved":0,"allocated":1008410624,"data_stored":1007689142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1192308,"kb_used_data":1156960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93179532,"statfs":{"total":96636764160,"available":95415840768,"internally_reserved":0,"allocated":1184727040,"data_stored":1183969856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1698080,"kb_used_data":1666900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92673760,"statfs":{"total":96636764160,"available":94897930240,"internally_reserved":0,"allocated":1706905600,"data_stored":1706157621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1704984576,"data_stored":1704984576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1182793728,"data_stored":1182793728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1006632960,"data_stored":1006632960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1925185536,"data_stored":1925185536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1757413376,"data_stored":1757413376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1950351360,"data_stored":1950351360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1262485504,"data_stored":1262485504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1809842176,"data_stored":1809842176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":117239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":119338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":119222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":117465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":176275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:05:23.713 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-05-07T14:05:23.714 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-05-07T14:05:24.074 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-07T14:05:24.083 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-07T14:05:24.083 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:05:24.084 INFO:tasks.rgw.client.0.smithi106.stdout:2024-05-07T14:05:24.093+0000 7f9890b59640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 31971) UID: 0 2024-05-07T14:05:24.084 INFO:tasks.rgw.client.0.smithi106.stdout:2024-05-07T14:05:24.093+0000 7f98943a1a40 -1 shutting down 2024-05-07T14:05:29.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-05-07T14:05:30.184 INFO:tasks.rgw.client.0:Stopped 2024-05-07T14:05:30.184 DEBUG:teuthology.orchestra.run.smithi106:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-07T14:05:30.190 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f /etc/ceph/vault-root-token 2024-05-07T14:05:30.245 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-07T14:05:30.300 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-07T14:05:30.300 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-07T14:05:30.300 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-07T14:05:31.664 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-07T14:05:31.674 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-07T14:05:31.675 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:05:31.988 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:05:31.994 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:05:32.006 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-05-07T14:05:31.328855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819926,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3104,"num_read_kb":2790,"num_write":2847,"num_write_kb":6187914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":621470484,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3918,"ondisk_log_size":3918,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12587264,"kb_used_data":12320304,"kb_used_omap":17,"kb_used_meta":266862,"kb_avail":742387456,"statfs":{"total":773094113280,"available":760204754944,"internally_reserved":0,"allocated":12615991296,"data_stored":12610026920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17505,"internal_metadata":273267615},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005951"},"pg_stats":[{"pgid":"3.3f","version":"124'29","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963765+0000","last_change":"2024-05-07T14:05:02.012333+0000","last_active":"2024-05-07T14:05:18.963765+0000","last_peered":"2024-05-07T14:05:18.963765+0000","last_clean":"2024-05-07T14:05:18.963765+0000","last_became_active":"2024-05-07T14:04:59.458324+0000","last_became_peered":"2024-05-07T14:04:59.458324+0000","last_unstale":"2024-05-07T14:05:18.963765+0000","last_undegraded":"2024-05-07T14:05:18.963765+0000","last_fullsized":"2024-05-07T14:05:18.963765+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:58:18.777392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719899+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:05:18.719899+0000","last_peered":"2024-05-07T14:05:18.719899+0000","last_clean":"2024-05-07T14:05:18.719899+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:05:18.719899+0000","last_undegraded":"2024-05-07T14:05:18.719899+0000","last_fullsized":"2024-05-07T14:05:18.719899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"124'29","reported_seq":133,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959961+0000","last_change":"2024-05-07T14:03:39.850495+0000","last_active":"2024-05-07T14:05:18.959961+0000","last_peered":"2024-05-07T14:05:18.959961+0000","last_clean":"2024-05-07T14:05:18.959961+0000","last_became_active":"2024-05-07T14:03:39.676092+0000","last_became_peered":"2024-05-07T14:03:39.676092+0000","last_unstale":"2024-05-07T14:05:18.959961+0000","last_undegraded":"2024-05-07T14:05:18.959961+0000","last_fullsized":"2024-05-07T14:05:18.959961+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:00.668304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"80'2","reported_seq":172,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963019+0000","last_change":"2024-05-07T14:04:59.442787+0000","last_active":"2024-05-07T14:05:18.963019+0000","last_peered":"2024-05-07T14:05:18.963019+0000","last_clean":"2024-05-07T14:05:18.963019+0000","last_became_active":"2024-05-07T14:04:59.430479+0000","last_became_peered":"2024-05-07T14:04:59.430479+0000","last_unstale":"2024-05-07T14:05:18.963019+0000","last_undegraded":"2024-05-07T14:05:18.963019+0000","last_fullsized":"2024-05-07T14:05:18.963019+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:27.875022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"124'20","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959370+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:05:18.959370+0000","last_peered":"2024-05-07T14:05:18.959370+0000","last_clean":"2024-05-07T14:05:18.959370+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:05:18.959370+0000","last_undegraded":"2024-05-07T14:05:18.959370+0000","last_fullsized":"2024-05-07T14:05:18.959370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629168+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:05:18.629168+0000","last_peered":"2024-05-07T14:05:18.629168+0000","last_clean":"2024-05-07T14:05:18.629168+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:05:18.629168+0000","last_undegraded":"2024-05-07T14:05:18.629168+0000","last_fullsized":"2024-05-07T14:05:18.629168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"124'25","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721240+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:05:18.721240+0000","last_peered":"2024-05-07T14:05:18.721240+0000","last_clean":"2024-05-07T14:05:18.721240+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:05:18.721240+0000","last_undegraded":"2024-05-07T14:05:18.721240+0000","last_fullsized":"2024-05-07T14:05:18.721240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"81'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960256+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:05:18.960256+0000","last_peered":"2024-05-07T14:05:18.960256+0000","last_clean":"2024-05-07T14:05:18.960256+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:05:18.960256+0000","last_undegraded":"2024-05-07T14:05:18.960256+0000","last_fullsized":"2024-05-07T14:05:18.960256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"124'24","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961071+0000","last_change":"2024-05-07T14:05:01.033639+0000","last_active":"2024-05-07T14:05:18.961071+0000","last_peered":"2024-05-07T14:05:18.961071+0000","last_clean":"2024-05-07T14:05:18.961071+0000","last_became_active":"2024-05-07T14:04:59.455288+0000","last_became_peered":"2024-05-07T14:04:59.455288+0000","last_unstale":"2024-05-07T14:05:18.961071+0000","last_undegraded":"2024-05-07T14:05:18.961071+0000","last_fullsized":"2024-05-07T14:05:18.961071+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:06:05.572323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"115'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960336+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:05:18.960336+0000","last_peered":"2024-05-07T14:05:18.960336+0000","last_clean":"2024-05-07T14:05:18.960336+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:05:18.960336+0000","last_undegraded":"2024-05-07T14:05:18.960336+0000","last_fullsized":"2024-05-07T14:05:18.960336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"124'19","reported_seq":275,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720428+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:05:18.720428+0000","last_peered":"2024-05-07T14:05:18.720428+0000","last_clean":"2024-05-07T14:05:18.720428+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:05:18.720428+0000","last_undegraded":"2024-05-07T14:05:18.720428+0000","last_fullsized":"2024-05-07T14:05:18.720428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"115'4","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630099+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:05:18.630099+0000","last_peered":"2024-05-07T14:05:18.630099+0000","last_clean":"2024-05-07T14:05:18.630099+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:05:18.630099+0000","last_undegraded":"2024-05-07T14:05:18.630099+0000","last_fullsized":"2024-05-07T14:05:18.630099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"124'25","reported_seq":274,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962077+0000","last_change":"2024-05-07T14:05:00.220571+0000","last_active":"2024-05-07T14:05:18.962077+0000","last_peered":"2024-05-07T14:05:18.962077+0000","last_clean":"2024-05-07T14:05:18.962077+0000","last_became_active":"2024-05-07T14:04:59.444214+0000","last_became_peered":"2024-05-07T14:04:59.444214+0000","last_unstale":"2024-05-07T14:05:18.962077+0000","last_undegraded":"2024-05-07T14:05:18.962077+0000","last_fullsized":"2024-05-07T14:05:18.962077+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:18:23.503893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"81'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721808+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:05:18.721808+0000","last_peered":"2024-05-07T14:05:18.721808+0000","last_clean":"2024-05-07T14:05:18.721808+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:05:18.721808+0000","last_undegraded":"2024-05-07T14:05:18.721808+0000","last_fullsized":"2024-05-07T14:05:18.721808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"124'23","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959282+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:05:18.959282+0000","last_peered":"2024-05-07T14:05:18.959282+0000","last_clean":"2024-05-07T14:05:18.959282+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:05:18.959282+0000","last_undegraded":"2024-05-07T14:05:18.959282+0000","last_fullsized":"2024-05-07T14:05:18.959282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"124'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630377+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:05:18.630377+0000","last_peered":"2024-05-07T14:05:18.630377+0000","last_clean":"2024-05-07T14:05:18.630377+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:05:18.630377+0000","last_undegraded":"2024-05-07T14:05:18.630377+0000","last_fullsized":"2024-05-07T14:05:18.630377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628673+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:05:18.628673+0000","last_peered":"2024-05-07T14:05:18.628673+0000","last_clean":"2024-05-07T14:05:18.628673+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:05:18.628673+0000","last_undegraded":"2024-05-07T14:05:18.628673+0000","last_fullsized":"2024-05-07T14:05:18.628673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"124'23","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961950+0000","last_change":"2024-05-07T14:05:01.245123+0000","last_active":"2024-05-07T14:05:18.961950+0000","last_peered":"2024-05-07T14:05:18.961950+0000","last_clean":"2024-05-07T14:05:18.961950+0000","last_became_active":"2024-05-07T14:04:59.452315+0000","last_became_peered":"2024-05-07T14:04:59.452315+0000","last_unstale":"2024-05-07T14:05:18.961950+0000","last_undegraded":"2024-05-07T14:05:18.961950+0000","last_fullsized":"2024-05-07T14:05:18.961950+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:20:40.045208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962499+0000","last_change":"2024-05-07T14:04:59.435447+0000","last_active":"2024-05-07T14:05:18.962499+0000","last_peered":"2024-05-07T14:05:18.962499+0000","last_clean":"2024-05-07T14:05:18.962499+0000","last_became_active":"2024-05-07T14:04:59.429254+0000","last_became_peered":"2024-05-07T14:04:59.429254+0000","last_unstale":"2024-05-07T14:05:18.962499+0000","last_undegraded":"2024-05-07T14:05:18.962499+0000","last_fullsized":"2024-05-07T14:05:18.962499+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:42:46.014749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"124'23","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961038+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:05:18.961038+0000","last_peered":"2024-05-07T14:05:18.961038+0000","last_clean":"2024-05-07T14:05:18.961038+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:05:18.961038+0000","last_undegraded":"2024-05-07T14:05:18.961038+0000","last_fullsized":"2024-05-07T14:05:18.961038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":252,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720762+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:05:18.720762+0000","last_peered":"2024-05-07T14:05:18.720762+0000","last_clean":"2024-05-07T14:05:18.720762+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:05:18.720762+0000","last_undegraded":"2024-05-07T14:05:18.720762+0000","last_fullsized":"2024-05-07T14:05:18.720762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"124'31","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963739+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:05:18.963739+0000","last_peered":"2024-05-07T14:05:18.963739+0000","last_clean":"2024-05-07T14:05:18.963739+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:05:18.963739+0000","last_undegraded":"2024-05-07T14:05:18.963739+0000","last_fullsized":"2024-05-07T14:05:18.963739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"124'10","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629192+0000","last_change":"2024-05-07T14:01:37.318563+0000","last_active":"2024-05-07T14:05:18.629192+0000","last_peered":"2024-05-07T14:05:18.629192+0000","last_clean":"2024-05-07T14:05:18.629192+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:05:18.629192+0000","last_undegraded":"2024-05-07T14:05:18.629192+0000","last_fullsized":"2024-05-07T14:05:18.629192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:27.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629565+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:05:18.629565+0000","last_peered":"2024-05-07T14:05:18.629565+0000","last_clean":"2024-05-07T14:05:18.629565+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:05:18.629565+0000","last_undegraded":"2024-05-07T14:05:18.629565+0000","last_fullsized":"2024-05-07T14:05:18.629565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"106'8","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629560+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:05:18.629560+0000","last_peered":"2024-05-07T14:05:18.629560+0000","last_clean":"2024-05-07T14:05:18.629560+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:05:18.629560+0000","last_undegraded":"2024-05-07T14:05:18.629560+0000","last_fullsized":"2024-05-07T14:05:18.629560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"124'32","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964588+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:05:18.964588+0000","last_peered":"2024-05-07T14:05:18.964588+0000","last_clean":"2024-05-07T14:05:18.964588+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:05:18.964588+0000","last_undegraded":"2024-05-07T14:05:18.964588+0000","last_fullsized":"2024-05-07T14:05:18.964588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"106'2","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630109+0000","last_change":"2024-05-07T14:03:39.848413+0000","last_active":"2024-05-07T14:05:18.630109+0000","last_peered":"2024-05-07T14:05:18.630109+0000","last_clean":"2024-05-07T14:05:18.630109+0000","last_became_active":"2024-05-07T14:03:39.663590+0000","last_became_peered":"2024-05-07T14:03:39.663590+0000","last_unstale":"2024-05-07T14:05:18.630109+0000","last_undegraded":"2024-05-07T14:05:18.630109+0000","last_fullsized":"2024-05-07T14:05:18.630109+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:02.675624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"124'19","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959332+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:05:18.959332+0000","last_peered":"2024-05-07T14:05:18.959332+0000","last_clean":"2024-05-07T14:05:18.959332+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:05:18.959332+0000","last_undegraded":"2024-05-07T14:05:18.959332+0000","last_fullsized":"2024-05-07T14:05:18.959332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628129+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:05:18.628129+0000","last_peered":"2024-05-07T14:05:18.628129+0000","last_clean":"2024-05-07T14:05:18.628129+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:05:18.628129+0000","last_undegraded":"2024-05-07T14:05:18.628129+0000","last_fullsized":"2024-05-07T14:05:18.628129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"81'2","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963957+0000","last_change":"2024-05-07T14:03:39.857355+0000","last_active":"2024-05-07T14:05:18.963957+0000","last_peered":"2024-05-07T14:05:18.963957+0000","last_clean":"2024-05-07T14:05:18.963957+0000","last_became_active":"2024-05-07T14:03:39.680721+0000","last_became_peered":"2024-05-07T14:03:39.680721+0000","last_unstale":"2024-05-07T14:05:18.963957+0000","last_undegraded":"2024-05-07T14:05:18.963957+0000","last_fullsized":"2024-05-07T14:05:18.963957+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:36.092563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"124'19","reported_seq":224,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629050+0000","last_change":"2024-05-07T14:01:37.311718+0000","last_active":"2024-05-07T14:05:18.629050+0000","last_peered":"2024-05-07T14:05:18.629050+0000","last_clean":"2024-05-07T14:05:18.629050+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:05:18.629050+0000","last_undegraded":"2024-05-07T14:05:18.629050+0000","last_fullsized":"2024-05-07T14:05:18.629050+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:24.211300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721497+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:05:18.721497+0000","last_peered":"2024-05-07T14:05:18.721497+0000","last_clean":"2024-05-07T14:05:18.721497+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:05:18.721497+0000","last_undegraded":"2024-05-07T14:05:18.721497+0000","last_fullsized":"2024-05-07T14:05:18.721497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"124'17","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961100+0000","last_change":"2024-05-07T14:04:59.457299+0000","last_active":"2024-05-07T14:05:18.961100+0000","last_peered":"2024-05-07T14:05:18.961100+0000","last_clean":"2024-05-07T14:05:18.961100+0000","last_became_active":"2024-05-07T14:04:59.455429+0000","last_became_peered":"2024-05-07T14:04:59.455429+0000","last_unstale":"2024-05-07T14:05:18.961100+0000","last_undegraded":"2024-05-07T14:05:18.961100+0000","last_fullsized":"2024-05-07T14:05:18.961100+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:29.054055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964269+0000","last_change":"2024-05-07T14:04:59.462184+0000","last_active":"2024-05-07T14:05:18.964269+0000","last_peered":"2024-05-07T14:05:18.964269+0000","last_clean":"2024-05-07T14:05:18.964269+0000","last_became_active":"2024-05-07T14:04:59.456374+0000","last_became_peered":"2024-05-07T14:04:59.456374+0000","last_unstale":"2024-05-07T14:05:18.964269+0000","last_undegraded":"2024-05-07T14:05:18.964269+0000","last_fullsized":"2024-05-07T14:05:18.964269+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:06.581660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"124'50","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719930+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:05:18.719930+0000","last_peered":"2024-05-07T14:05:18.719930+0000","last_clean":"2024-05-07T14:05:18.719930+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:05:18.719930+0000","last_undegraded":"2024-05-07T14:05:18.719930+0000","last_fullsized":"2024-05-07T14:05:18.719930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"81'6","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722091+0000","last_change":"2024-05-07T14:04:59.467076+0000","last_active":"2024-05-07T14:05:18.722091+0000","last_peered":"2024-05-07T14:05:18.722091+0000","last_clean":"2024-05-07T14:05:18.722091+0000","last_became_active":"2024-05-07T14:04:59.466480+0000","last_became_peered":"2024-05-07T14:04:59.466480+0000","last_unstale":"2024-05-07T14:05:18.722091+0000","last_undegraded":"2024-05-07T14:05:18.722091+0000","last_fullsized":"2024-05-07T14:05:18.722091+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:02.334693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"124'20","reported_seq":301,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959429+0000","last_change":"2024-05-07T14:05:00.106363+0000","last_active":"2024-05-07T14:05:18.959429+0000","last_peered":"2024-05-07T14:05:18.959429+0000","last_clean":"2024-05-07T14:05:18.959429+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:18.959429+0000","last_undegraded":"2024-05-07T14:05:18.959429+0000","last_fullsized":"2024-05-07T14:05:18.959429+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:03.250892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81788928,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964245+0000","last_change":"2024-05-07T14:04:59.446944+0000","last_active":"2024-05-07T14:05:18.964245+0000","last_peered":"2024-05-07T14:05:18.964245+0000","last_clean":"2024-05-07T14:05:18.964245+0000","last_became_active":"2024-05-07T14:04:59.445994+0000","last_became_peered":"2024-05-07T14:04:59.445994+0000","last_unstale":"2024-05-07T14:05:18.964245+0000","last_undegraded":"2024-05-07T14:05:18.964245+0000","last_fullsized":"2024-05-07T14:05:18.964245+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:08.275415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"81'7","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630813+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:05:18.630813+0000","last_peered":"2024-05-07T14:05:18.630813+0000","last_clean":"2024-05-07T14:05:18.630813+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:05:18.630813+0000","last_undegraded":"2024-05-07T14:05:18.630813+0000","last_fullsized":"2024-05-07T14:05:18.630813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629526+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:05:18.629526+0000","last_peered":"2024-05-07T14:05:18.629526+0000","last_clean":"2024-05-07T14:05:18.629526+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:05:18.629526+0000","last_undegraded":"2024-05-07T14:05:18.629526+0000","last_fullsized":"2024-05-07T14:05:18.629526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"115'8","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959036+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:05:18.959036+0000","last_peered":"2024-05-07T14:05:18.959036+0000","last_clean":"2024-05-07T14:05:18.959036+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:05:18.959036+0000","last_undegraded":"2024-05-07T14:05:18.959036+0000","last_fullsized":"2024-05-07T14:05:18.959036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"81'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962932+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:05:18.962932+0000","last_peered":"2024-05-07T14:05:18.962932+0000","last_clean":"2024-05-07T14:05:18.962932+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:05:18.962932+0000","last_undegraded":"2024-05-07T14:05:18.962932+0000","last_fullsized":"2024-05-07T14:05:18.962932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"124'16","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961915+0000","last_change":"2024-05-07T14:04:59.911990+0000","last_active":"2024-05-07T14:05:18.961915+0000","last_peered":"2024-05-07T14:05:18.961915+0000","last_clean":"2024-05-07T14:05:18.961915+0000","last_became_active":"2024-05-07T14:04:59.436710+0000","last_became_peered":"2024-05-07T14:04:59.436710+0000","last_unstale":"2024-05-07T14:05:18.961915+0000","last_undegraded":"2024-05-07T14:05:18.961915+0000","last_fullsized":"2024-05-07T14:05:18.961915+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:27:02.713493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964441+0000","last_change":"2024-05-07T14:03:39.680812+0000","last_active":"2024-05-07T14:05:18.964441+0000","last_peered":"2024-05-07T14:05:18.964441+0000","last_clean":"2024-05-07T14:05:18.964441+0000","last_became_active":"2024-05-07T14:03:39.680482+0000","last_became_peered":"2024-05-07T14:03:39.680482+0000","last_unstale":"2024-05-07T14:05:18.964441+0000","last_undegraded":"2024-05-07T14:05:18.964441+0000","last_fullsized":"2024-05-07T14:05:18.964441+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:07.705255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"81'13","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629238+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:05:18.629238+0000","last_peered":"2024-05-07T14:05:18.629238+0000","last_clean":"2024-05-07T14:05:18.629238+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:05:18.629238+0000","last_undegraded":"2024-05-07T14:05:18.629238+0000","last_fullsized":"2024-05-07T14:05:18.629238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"146'141","reported_seq":413,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.273181+0000","last_change":"2024-05-07T14:05:02.234601+0000","last_active":"2024-05-07T14:05:20.273181+0000","last_peered":"2024-05-07T14:05:20.273181+0000","last_clean":"2024-05-07T14:05:20.273181+0000","last_became_active":"2024-05-07T14:04:59.463533+0000","last_became_peered":"2024-05-07T14:04:59.463533+0000","last_unstale":"2024-05-07T14:05:20.273181+0000","last_undegraded":"2024-05-07T14:05:20.273181+0000","last_fullsized":"2024-05-07T14:05:20.273181+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:50:50.067203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628944+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:05:18.628944+0000","last_peered":"2024-05-07T14:05:18.628944+0000","last_clean":"2024-05-07T14:05:18.628944+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:05:18.628944+0000","last_undegraded":"2024-05-07T14:05:18.628944+0000","last_fullsized":"2024-05-07T14:05:18.628944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"87'16","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963783+0000","last_change":"2024-05-07T14:04:59.462968+0000","last_active":"2024-05-07T14:05:18.963783+0000","last_peered":"2024-05-07T14:05:18.963783+0000","last_clean":"2024-05-07T14:05:18.963783+0000","last_became_active":"2024-05-07T14:04:59.461575+0000","last_became_peered":"2024-05-07T14:04:59.461575+0000","last_unstale":"2024-05-07T14:05:18.963783+0000","last_undegraded":"2024-05-07T14:05:18.963783+0000","last_fullsized":"2024-05-07T14:05:18.963783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:36.220334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"123'26","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959411+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:05:18.959411+0000","last_peered":"2024-05-07T14:05:18.959411+0000","last_clean":"2024-05-07T14:05:18.959411+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:05:18.959411+0000","last_undegraded":"2024-05-07T14:05:18.959411+0000","last_fullsized":"2024-05-07T14:05:18.959411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721681+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:05:18.721681+0000","last_peered":"2024-05-07T14:05:18.721681+0000","last_clean":"2024-05-07T14:05:18.721681+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:05:18.721681+0000","last_undegraded":"2024-05-07T14:05:18.721681+0000","last_fullsized":"2024-05-07T14:05:18.721681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"124'17","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962423+0000","last_change":"2024-05-07T14:04:59.462754+0000","last_active":"2024-05-07T14:05:18.962423+0000","last_peered":"2024-05-07T14:05:18.962423+0000","last_clean":"2024-05-07T14:05:18.962423+0000","last_became_active":"2024-05-07T14:04:59.459905+0000","last_became_peered":"2024-05-07T14:04:59.459905+0000","last_unstale":"2024-05-07T14:05:18.962423+0000","last_undegraded":"2024-05-07T14:05:18.962423+0000","last_fullsized":"2024-05-07T14:05:18.962423+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:02:35.111917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"146'135","reported_seq":428,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272020+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:05:20.272020+0000","last_peered":"2024-05-07T14:05:20.272020+0000","last_clean":"2024-05-07T14:05:20.272020+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:05:20.272020+0000","last_undegraded":"2024-05-07T14:05:20.272020+0000","last_fullsized":"2024-05-07T14:05:20.272020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"81'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720435+0000","last_change":"2024-05-07T14:04:59.447718+0000","last_active":"2024-05-07T14:05:18.720435+0000","last_peered":"2024-05-07T14:05:18.720435+0000","last_clean":"2024-05-07T14:05:18.720435+0000","last_became_active":"2024-05-07T14:04:59.446891+0000","last_became_peered":"2024-05-07T14:04:59.446891+0000","last_unstale":"2024-05-07T14:05:18.720435+0000","last_undegraded":"2024-05-07T14:05:18.720435+0000","last_fullsized":"2024-05-07T14:05:18.720435+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:42.667572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"124'33","reported_seq":286,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964093+0000","last_change":"2024-05-07T14:05:01.651799+0000","last_active":"2024-05-07T14:05:18.964093+0000","last_peered":"2024-05-07T14:05:18.964093+0000","last_clean":"2024-05-07T14:05:18.964093+0000","last_became_active":"2024-05-07T14:04:59.452426+0000","last_became_peered":"2024-05-07T14:04:59.452426+0000","last_unstale":"2024-05-07T14:05:18.964093+0000","last_undegraded":"2024-05-07T14:05:18.964093+0000","last_fullsized":"2024-05-07T14:05:18.964093+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:49.540606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963448+0000","last_change":"2024-05-07T14:04:59.445984+0000","last_active":"2024-05-07T14:05:18.963448+0000","last_peered":"2024-05-07T14:05:18.963448+0000","last_clean":"2024-05-07T14:05:18.963448+0000","last_became_active":"2024-05-07T14:04:59.445281+0000","last_became_peered":"2024-05-07T14:04:59.445281+0000","last_unstale":"2024-05-07T14:05:18.963448+0000","last_undegraded":"2024-05-07T14:05:18.963448+0000","last_fullsized":"2024-05-07T14:05:18.963448+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:59:14.548669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"124'28","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720191+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:05:18.720191+0000","last_peered":"2024-05-07T14:05:18.720191+0000","last_clean":"2024-05-07T14:05:18.720191+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:05:18.720191+0000","last_undegraded":"2024-05-07T14:05:18.720191+0000","last_fullsized":"2024-05-07T14:05:18.720191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960274+0000","last_change":"2024-05-07T14:03:39.666526+0000","last_active":"2024-05-07T14:05:18.960274+0000","last_peered":"2024-05-07T14:05:18.960274+0000","last_clean":"2024-05-07T14:05:18.960274+0000","last_became_active":"2024-05-07T14:03:39.666160+0000","last_became_peered":"2024-05-07T14:03:39.666160+0000","last_unstale":"2024-05-07T14:05:18.960274+0000","last_undegraded":"2024-05-07T14:05:18.960274+0000","last_fullsized":"2024-05-07T14:05:18.960274+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:44.560061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720476+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:05:18.720476+0000","last_peered":"2024-05-07T14:05:18.720476+0000","last_clean":"2024-05-07T14:05:18.720476+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:05:18.720476+0000","last_undegraded":"2024-05-07T14:05:18.720476+0000","last_fullsized":"2024-05-07T14:05:18.720476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630857+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:05:18.630857+0000","last_peered":"2024-05-07T14:05:18.630857+0000","last_clean":"2024-05-07T14:05:18.630857+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:05:18.630857+0000","last_undegraded":"2024-05-07T14:05:18.630857+0000","last_fullsized":"2024-05-07T14:05:18.630857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"124'27","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962532+0000","last_change":"2024-05-07T14:04:59.801081+0000","last_active":"2024-05-07T14:05:18.962532+0000","last_peered":"2024-05-07T14:05:18.962532+0000","last_clean":"2024-05-07T14:05:18.962532+0000","last_became_active":"2024-05-07T14:04:59.421863+0000","last_became_peered":"2024-05-07T14:04:59.421863+0000","last_unstale":"2024-05-07T14:05:18.962532+0000","last_undegraded":"2024-05-07T14:05:18.962532+0000","last_fullsized":"2024-05-07T14:05:18.962532+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:48.094723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":338,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628182+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:05:18.628182+0000","last_peered":"2024-05-07T14:05:18.628182+0000","last_clean":"2024-05-07T14:05:18.628182+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:05:18.628182+0000","last_undegraded":"2024-05-07T14:05:18.628182+0000","last_fullsized":"2024-05-07T14:05:18.628182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"124'17","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965471+0000","last_change":"2024-05-07T14:04:59.447540+0000","last_active":"2024-05-07T14:05:18.965471+0000","last_peered":"2024-05-07T14:05:18.965471+0000","last_clean":"2024-05-07T14:05:18.965471+0000","last_became_active":"2024-05-07T14:04:59.446737+0000","last_became_peered":"2024-05-07T14:04:59.446737+0000","last_unstale":"2024-05-07T14:05:18.965471+0000","last_undegraded":"2024-05-07T14:05:18.965471+0000","last_fullsized":"2024-05-07T14:05:18.965471+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.352935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964757+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:05:18.964757+0000","last_peered":"2024-05-07T14:05:18.964757+0000","last_clean":"2024-05-07T14:05:18.964757+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:05:18.964757+0000","last_undegraded":"2024-05-07T14:05:18.964757+0000","last_fullsized":"2024-05-07T14:05:18.964757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"115'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962438+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:05:18.962438+0000","last_peered":"2024-05-07T14:05:18.962438+0000","last_clean":"2024-05-07T14:05:18.962438+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:05:18.962438+0000","last_undegraded":"2024-05-07T14:05:18.962438+0000","last_fullsized":"2024-05-07T14:05:18.962438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"81'6","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959923+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:05:18.959923+0000","last_peered":"2024-05-07T14:05:18.959923+0000","last_clean":"2024-05-07T14:05:18.959923+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:05:18.959923+0000","last_undegraded":"2024-05-07T14:05:18.959923+0000","last_fullsized":"2024-05-07T14:05:18.959923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"124'29","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961785+0000","last_change":"2024-05-07T14:05:00.740552+0000","last_active":"2024-05-07T14:05:18.961785+0000","last_peered":"2024-05-07T14:05:18.961785+0000","last_clean":"2024-05-07T14:05:18.961785+0000","last_became_active":"2024-05-07T14:04:59.449454+0000","last_became_peered":"2024-05-07T14:04:59.449454+0000","last_unstale":"2024-05-07T14:05:18.961785+0000","last_undegraded":"2024-05-07T14:05:18.961785+0000","last_fullsized":"2024-05-07T14:05:18.961785+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:28:19.138204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629731+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:05:18.629731+0000","last_peered":"2024-05-07T14:05:18.629731+0000","last_clean":"2024-05-07T14:05:18.629731+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:05:18.629731+0000","last_undegraded":"2024-05-07T14:05:18.629731+0000","last_fullsized":"2024-05-07T14:05:18.629731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"124'23","reported_seq":258,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961377+0000","last_change":"2024-05-07T14:04:59.459984+0000","last_active":"2024-05-07T14:05:18.961377+0000","last_peered":"2024-05-07T14:05:18.961377+0000","last_clean":"2024-05-07T14:05:18.961377+0000","last_became_active":"2024-05-07T14:04:59.458512+0000","last_became_peered":"2024-05-07T14:04:59.458512+0000","last_unstale":"2024-05-07T14:05:18.961377+0000","last_undegraded":"2024-05-07T14:05:18.961377+0000","last_fullsized":"2024-05-07T14:05:18.961377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:11:09.127149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"146'139","reported_seq":453,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:24.296925+0000","last_change":"2024-05-07T14:03:42.700808+0000","last_active":"2024-05-07T14:05:24.296925+0000","last_peered":"2024-05-07T14:05:24.296925+0000","last_clean":"2024-05-07T14:05:24.296925+0000","last_became_active":"2024-05-07T14:03:42.700324+0000","last_became_peered":"2024-05-07T14:03:42.700324+0000","last_unstale":"2024-05-07T14:05:24.296925+0000","last_undegraded":"2024-05-07T14:05:24.296925+0000","last_fullsized":"2024-05-07T14:05:24.296925+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:47.369543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961454+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:05:18.961454+0000","last_peered":"2024-05-07T14:05:18.961454+0000","last_clean":"2024-05-07T14:05:18.961454+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:05:18.961454+0000","last_undegraded":"2024-05-07T14:05:18.961454+0000","last_fullsized":"2024-05-07T14:05:18.961454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"124'10","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960707+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:05:18.960707+0000","last_peered":"2024-05-07T14:05:18.960707+0000","last_clean":"2024-05-07T14:05:18.960707+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:05:18.960707+0000","last_undegraded":"2024-05-07T14:05:18.960707+0000","last_fullsized":"2024-05-07T14:05:18.960707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"124'36","reported_seq":293,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721736+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:05:18.721736+0000","last_peered":"2024-05-07T14:05:18.721736+0000","last_clean":"2024-05-07T14:05:18.721736+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:05:18.721736+0000","last_undegraded":"2024-05-07T14:05:18.721736+0000","last_fullsized":"2024-05-07T14:05:18.721736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629126+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:05:18.629126+0000","last_peered":"2024-05-07T14:05:18.629126+0000","last_clean":"2024-05-07T14:05:18.629126+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:05:18.629126+0000","last_undegraded":"2024-05-07T14:05:18.629126+0000","last_fullsized":"2024-05-07T14:05:18.629126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"124'29","reported_seq":294,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958596+0000","last_change":"2024-05-07T14:04:59.456274+0000","last_active":"2024-05-07T14:05:18.958596+0000","last_peered":"2024-05-07T14:05:18.958596+0000","last_clean":"2024-05-07T14:05:18.958596+0000","last_became_active":"2024-05-07T14:04:59.455284+0000","last_became_peered":"2024-05-07T14:04:59.455284+0000","last_unstale":"2024-05-07T14:05:18.958596+0000","last_undegraded":"2024-05-07T14:05:18.958596+0000","last_fullsized":"2024-05-07T14:05:18.958596+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:44:18.184158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.627987+0000","last_change":"2024-05-07T14:04:59.467425+0000","last_active":"2024-05-07T14:05:18.627987+0000","last_peered":"2024-05-07T14:05:18.627987+0000","last_clean":"2024-05-07T14:05:18.627987+0000","last_became_active":"2024-05-07T14:04:59.466731+0000","last_became_peered":"2024-05-07T14:04:59.466731+0000","last_unstale":"2024-05-07T14:05:18.627987+0000","last_undegraded":"2024-05-07T14:05:18.627987+0000","last_fullsized":"2024-05-07T14:05:18.627987+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:57.541122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"121'5","reported_seq":111,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960905+0000","last_change":"2024-05-07T14:03:39.802033+0000","last_active":"2024-05-07T14:05:18.960905+0000","last_peered":"2024-05-07T14:05:18.960905+0000","last_clean":"2024-05-07T14:05:18.960905+0000","last_became_active":"2024-05-07T14:03:39.675695+0000","last_became_peered":"2024-05-07T14:03:39.675695+0000","last_unstale":"2024-05-07T14:05:18.960905+0000","last_undegraded":"2024-05-07T14:05:18.960905+0000","last_fullsized":"2024-05-07T14:05:18.960905+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:22:02.594405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"87'2","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630116+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:05:18.630116+0000","last_peered":"2024-05-07T14:05:18.630116+0000","last_clean":"2024-05-07T14:05:18.630116+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:05:18.630116+0000","last_undegraded":"2024-05-07T14:05:18.630116+0000","last_fullsized":"2024-05-07T14:05:18.630116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"124'26","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963663+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:05:18.963663+0000","last_peered":"2024-05-07T14:05:18.963663+0000","last_clean":"2024-05-07T14:05:18.963663+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:05:18.963663+0000","last_undegraded":"2024-05-07T14:05:18.963663+0000","last_fullsized":"2024-05-07T14:05:18.963663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":254,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629414+0000","last_change":"2024-05-07T14:04:59.468095+0000","last_active":"2024-05-07T14:05:18.629414+0000","last_peered":"2024-05-07T14:05:18.629414+0000","last_clean":"2024-05-07T14:05:18.629414+0000","last_became_active":"2024-05-07T14:04:59.467463+0000","last_became_peered":"2024-05-07T14:04:59.467463+0000","last_unstale":"2024-05-07T14:05:18.629414+0000","last_undegraded":"2024-05-07T14:05:18.629414+0000","last_fullsized":"2024-05-07T14:05:18.629414+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:38.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"124'21","reported_seq":309,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629398+0000","last_change":"2024-05-07T14:03:39.698456+0000","last_active":"2024-05-07T14:05:18.629398+0000","last_peered":"2024-05-07T14:05:18.629398+0000","last_clean":"2024-05-07T14:05:18.629398+0000","last_became_active":"2024-05-07T14:03:39.663223+0000","last_became_peered":"2024-05-07T14:03:39.663223+0000","last_unstale":"2024-05-07T14:05:18.629398+0000","last_undegraded":"2024-05-07T14:05:18.629398+0000","last_fullsized":"2024-05-07T14:05:18.629398+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:58.582121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959866+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:05:18.959866+0000","last_peered":"2024-05-07T14:05:18.959866+0000","last_clean":"2024-05-07T14:05:18.959866+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:05:18.959866+0000","last_undegraded":"2024-05-07T14:05:18.959866+0000","last_fullsized":"2024-05-07T14:05:18.959866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"106'6","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959722+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:05:18.959722+0000","last_peered":"2024-05-07T14:05:18.959722+0000","last_clean":"2024-05-07T14:05:18.959722+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:05:18.959722+0000","last_undegraded":"2024-05-07T14:05:18.959722+0000","last_fullsized":"2024-05-07T14:05:18.959722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"106'12","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630558+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:05:18.630558+0000","last_peered":"2024-05-07T14:05:18.630558+0000","last_clean":"2024-05-07T14:05:18.630558+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:05:18.630558+0000","last_undegraded":"2024-05-07T14:05:18.630558+0000","last_fullsized":"2024-05-07T14:05:18.630558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"124'16","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960175+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:05:18.960175+0000","last_peered":"2024-05-07T14:05:18.960175+0000","last_clean":"2024-05-07T14:05:18.960175+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:05:18.960175+0000","last_undegraded":"2024-05-07T14:05:18.960175+0000","last_fullsized":"2024-05-07T14:05:18.960175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":124,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961556+0000","last_change":"2024-05-07T14:03:39.714297+0000","last_active":"2024-05-07T14:05:18.961556+0000","last_peered":"2024-05-07T14:05:18.961556+0000","last_clean":"2024-05-07T14:05:18.961556+0000","last_became_active":"2024-05-07T14:03:39.663013+0000","last_became_peered":"2024-05-07T14:03:39.663013+0000","last_unstale":"2024-05-07T14:05:18.961556+0000","last_undegraded":"2024-05-07T14:05:18.961556+0000","last_fullsized":"2024-05-07T14:05:18.961556+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:40:56.207747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"124'24","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629991+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:05:18.629991+0000","last_peered":"2024-05-07T14:05:18.629991+0000","last_clean":"2024-05-07T14:05:18.629991+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:05:18.629991+0000","last_undegraded":"2024-05-07T14:05:18.629991+0000","last_fullsized":"2024-05-07T14:05:18.629991+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"146'135","reported_seq":441,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272092+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:05:20.272092+0000","last_peered":"2024-05-07T14:05:20.272092+0000","last_clean":"2024-05-07T14:05:20.272092+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:05:20.272092+0000","last_undegraded":"2024-05-07T14:05:20.272092+0000","last_fullsized":"2024-05-07T14:05:20.272092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"87'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962770+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:05:18.962770+0000","last_peered":"2024-05-07T14:05:18.962770+0000","last_clean":"2024-05-07T14:05:18.962770+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:05:18.962770+0000","last_undegraded":"2024-05-07T14:05:18.962770+0000","last_fullsized":"2024-05-07T14:05:18.962770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"106'8","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630951+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:05:18.630951+0000","last_peered":"2024-05-07T14:05:18.630951+0000","last_clean":"2024-05-07T14:05:18.630951+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:05:18.630951+0000","last_undegraded":"2024-05-07T14:05:18.630951+0000","last_fullsized":"2024-05-07T14:05:18.630951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"124'20","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631050+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:05:18.631050+0000","last_peered":"2024-05-07T14:05:18.631050+0000","last_clean":"2024-05-07T14:05:18.631050+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:05:18.631050+0000","last_undegraded":"2024-05-07T14:05:18.631050+0000","last_fullsized":"2024-05-07T14:05:18.631050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":428,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721954+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:05:18.721954+0000","last_peered":"2024-05-07T14:05:18.721954+0000","last_clean":"2024-05-07T14:05:18.721954+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:05:18.721954+0000","last_undegraded":"2024-05-07T14:05:18.721954+0000","last_fullsized":"2024-05-07T14:05:18.721954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":260,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964564+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:05:18.964564+0000","last_peered":"2024-05-07T14:05:18.964564+0000","last_clean":"2024-05-07T14:05:18.964564+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:05:18.964564+0000","last_undegraded":"2024-05-07T14:05:18.964564+0000","last_fullsized":"2024-05-07T14:05:18.964564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"146'135","reported_seq":430,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272661+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:05:20.272661+0000","last_peered":"2024-05-07T14:05:20.272661+0000","last_clean":"2024-05-07T14:05:20.272661+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:05:20.272661+0000","last_undegraded":"2024-05-07T14:05:20.272661+0000","last_fullsized":"2024-05-07T14:05:20.272661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"87'6","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629046+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:05:18.629046+0000","last_peered":"2024-05-07T14:05:18.629046+0000","last_clean":"2024-05-07T14:05:18.629046+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:05:18.629046+0000","last_undegraded":"2024-05-07T14:05:18.629046+0000","last_fullsized":"2024-05-07T14:05:18.629046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"124'6","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961297+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:05:18.961297+0000","last_peered":"2024-05-07T14:05:18.961297+0000","last_clean":"2024-05-07T14:05:18.961297+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:05:18.961297+0000","last_undegraded":"2024-05-07T14:05:18.961297+0000","last_fullsized":"2024-05-07T14:05:18.961297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"124'24","reported_seq":316,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959048+0000","last_change":"2024-05-07T14:03:39.814768+0000","last_active":"2024-05-07T14:05:18.959048+0000","last_peered":"2024-05-07T14:05:18.959048+0000","last_clean":"2024-05-07T14:05:18.959048+0000","last_became_active":"2024-05-07T14:03:39.666192+0000","last_became_peered":"2024-05-07T14:03:39.666192+0000","last_unstale":"2024-05-07T14:05:18.959048+0000","last_undegraded":"2024-05-07T14:05:18.959048+0000","last_fullsized":"2024-05-07T14:05:18.959048+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:10.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630568+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:05:18.630568+0000","last_peered":"2024-05-07T14:05:18.630568+0000","last_clean":"2024-05-07T14:05:18.630568+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:05:18.630568+0000","last_undegraded":"2024-05-07T14:05:18.630568+0000","last_fullsized":"2024-05-07T14:05:18.630568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"124'25","reported_seq":326,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721237+0000","last_change":"2024-05-07T14:03:39.845058+0000","last_active":"2024-05-07T14:05:18.721237+0000","last_peered":"2024-05-07T14:05:18.721237+0000","last_clean":"2024-05-07T14:05:18.721237+0000","last_became_active":"2024-05-07T14:03:39.673995+0000","last_became_peered":"2024-05-07T14:03:39.673995+0000","last_unstale":"2024-05-07T14:05:18.721237+0000","last_undegraded":"2024-05-07T14:05:18.721237+0000","last_fullsized":"2024-05-07T14:05:18.721237+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:43.919444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959774+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:05:18.959774+0000","last_peered":"2024-05-07T14:05:18.959774+0000","last_clean":"2024-05-07T14:05:18.959774+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:05:18.959774+0000","last_undegraded":"2024-05-07T14:05:18.959774+0000","last_fullsized":"2024-05-07T14:05:18.959774+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"124'2","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960409+0000","last_change":"2024-05-07T14:03:39.666268+0000","last_active":"2024-05-07T14:05:18.960409+0000","last_peered":"2024-05-07T14:05:18.960409+0000","last_clean":"2024-05-07T14:05:18.960409+0000","last_became_active":"2024-05-07T14:03:39.665838+0000","last_became_peered":"2024-05-07T14:03:39.665838+0000","last_unstale":"2024-05-07T14:05:18.960409+0000","last_undegraded":"2024-05-07T14:05:18.960409+0000","last_fullsized":"2024-05-07T14:05:18.960409+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:54:00.122392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963437+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:05:18.963437+0000","last_peered":"2024-05-07T14:05:18.963437+0000","last_clean":"2024-05-07T14:05:18.963437+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:05:18.963437+0000","last_undegraded":"2024-05-07T14:05:18.963437+0000","last_fullsized":"2024-05-07T14:05:18.963437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":313,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958642+0000","last_change":"2024-05-07T14:02:39.729323+0000","last_active":"2024-05-07T14:05:18.958642+0000","last_peered":"2024-05-07T14:05:18.958642+0000","last_clean":"2024-05-07T14:05:18.958642+0000","last_became_active":"2024-05-07T14:02:39.728189+0000","last_became_peered":"2024-05-07T14:02:39.728189+0000","last_unstale":"2024-05-07T14:05:18.958642+0000","last_undegraded":"2024-05-07T14:05:18.958642+0000","last_fullsized":"2024-05-07T14:05:18.958642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:53:59.368912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721172+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:05:18.721172+0000","last_peered":"2024-05-07T14:05:18.721172+0000","last_clean":"2024-05-07T14:05:18.721172+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:05:18.721172+0000","last_undegraded":"2024-05-07T14:05:18.721172+0000","last_fullsized":"2024-05-07T14:05:18.721172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"124'21","reported_seq":227,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628487+0000","last_change":"2024-05-07T14:01:37.317794+0000","last_active":"2024-05-07T14:05:18.628487+0000","last_peered":"2024-05-07T14:05:18.628487+0000","last_clean":"2024-05-07T14:05:18.628487+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:05:18.628487+0000","last_undegraded":"2024-05-07T14:05:18.628487+0000","last_fullsized":"2024-05-07T14:05:18.628487+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:17.582561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":31,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962017+0000","last_change":"2024-05-07T14:04:59.458347+0000","last_active":"2024-05-07T14:05:18.962017+0000","last_peered":"2024-05-07T14:05:18.962017+0000","last_clean":"2024-05-07T14:05:18.962017+0000","last_became_active":"2024-05-07T14:04:59.453884+0000","last_became_peered":"2024-05-07T14:04:59.453884+0000","last_unstale":"2024-05-07T14:05:18.962017+0000","last_undegraded":"2024-05-07T14:05:18.962017+0000","last_fullsized":"2024-05-07T14:05:18.962017+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.867992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"124'38","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722420+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:05:18.722420+0000","last_peered":"2024-05-07T14:05:18.722420+0000","last_clean":"2024-05-07T14:05:18.722420+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:05:18.722420+0000","last_undegraded":"2024-05-07T14:05:18.722420+0000","last_fullsized":"2024-05-07T14:05:18.722420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961662+0000","last_change":"2024-05-07T14:04:59.457814+0000","last_active":"2024-05-07T14:05:18.961662+0000","last_peered":"2024-05-07T14:05:18.961662+0000","last_clean":"2024-05-07T14:05:18.961662+0000","last_became_active":"2024-05-07T14:04:59.456477+0000","last_became_peered":"2024-05-07T14:04:59.456477+0000","last_unstale":"2024-05-07T14:05:18.961662+0000","last_undegraded":"2024-05-07T14:05:18.961662+0000","last_fullsized":"2024-05-07T14:05:18.961662+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:10:28.939206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959013+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:05:18.959013+0000","last_peered":"2024-05-07T14:05:18.959013+0000","last_clean":"2024-05-07T14:05:18.959013+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:05:18.959013+0000","last_undegraded":"2024-05-07T14:05:18.959013+0000","last_fullsized":"2024-05-07T14:05:18.959013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962392+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:05:18.962392+0000","last_peered":"2024-05-07T14:05:18.962392+0000","last_clean":"2024-05-07T14:05:18.962392+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:05:18.962392+0000","last_undegraded":"2024-05-07T14:05:18.962392+0000","last_fullsized":"2024-05-07T14:05:18.962392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":224,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961946+0000","last_change":"2024-05-07T14:04:59.425099+0000","last_active":"2024-05-07T14:05:18.961946+0000","last_peered":"2024-05-07T14:05:18.961946+0000","last_clean":"2024-05-07T14:05:18.961946+0000","last_became_active":"2024-05-07T14:04:59.422224+0000","last_became_peered":"2024-05-07T14:04:59.422224+0000","last_unstale":"2024-05-07T14:05:18.961946+0000","last_undegraded":"2024-05-07T14:05:18.961946+0000","last_fullsized":"2024-05-07T14:05:18.961946+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:23.398977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"124'22","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958651+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:05:18.958651+0000","last_peered":"2024-05-07T14:05:18.958651+0000","last_clean":"2024-05-07T14:05:18.958651+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:05:18.958651+0000","last_undegraded":"2024-05-07T14:05:18.958651+0000","last_fullsized":"2024-05-07T14:05:18.958651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722613+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:05:18.722613+0000","last_peered":"2024-05-07T14:05:18.722613+0000","last_clean":"2024-05-07T14:05:18.722613+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:05:18.722613+0000","last_undegraded":"2024-05-07T14:05:18.722613+0000","last_fullsized":"2024-05-07T14:05:18.722613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"146'141","reported_seq":515,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272410+0000","last_change":"2024-05-07T14:03:42.708479+0000","last_active":"2024-05-07T14:05:20.272410+0000","last_peered":"2024-05-07T14:05:20.272410+0000","last_clean":"2024-05-07T14:05:20.272410+0000","last_became_active":"2024-05-07T14:03:42.708117+0000","last_became_peered":"2024-05-07T14:03:42.708117+0000","last_unstale":"2024-05-07T14:05:20.272410+0000","last_undegraded":"2024-05-07T14:05:20.272410+0000","last_fullsized":"2024-05-07T14:05:20.272410+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:19:35.961283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5457,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962840+0000","last_change":"2024-05-07T14:04:59.462996+0000","last_active":"2024-05-07T14:05:18.962840+0000","last_peered":"2024-05-07T14:05:18.962840+0000","last_clean":"2024-05-07T14:05:18.962840+0000","last_became_active":"2024-05-07T14:04:59.461354+0000","last_became_peered":"2024-05-07T14:04:59.461354+0000","last_unstale":"2024-05-07T14:05:18.962840+0000","last_undegraded":"2024-05-07T14:05:18.962840+0000","last_fullsized":"2024-05-07T14:05:18.962840+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:55.900168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"80'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962268+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:05:18.962268+0000","last_peered":"2024-05-07T14:05:18.962268+0000","last_clean":"2024-05-07T14:05:18.962268+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:05:18.962268+0000","last_undegraded":"2024-05-07T14:05:18.962268+0000","last_fullsized":"2024-05-07T14:05:18.962268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"81'2","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960614+0000","last_change":"2024-05-07T14:03:39.711373+0000","last_active":"2024-05-07T14:05:18.960614+0000","last_peered":"2024-05-07T14:05:18.960614+0000","last_clean":"2024-05-07T14:05:18.960614+0000","last_became_active":"2024-05-07T14:03:39.667130+0000","last_became_peered":"2024-05-07T14:03:39.667130+0000","last_unstale":"2024-05-07T14:05:18.960614+0000","last_undegraded":"2024-05-07T14:05:18.960614+0000","last_fullsized":"2024-05-07T14:05:18.960614+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:36.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628882+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:05:18.628882+0000","last_peered":"2024-05-07T14:05:18.628882+0000","last_clean":"2024-05-07T14:05:18.628882+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:05:18.628882+0000","last_undegraded":"2024-05-07T14:05:18.628882+0000","last_fullsized":"2024-05-07T14:05:18.628882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"124'27","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963322+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:05:18.963322+0000","last_peered":"2024-05-07T14:05:18.963322+0000","last_clean":"2024-05-07T14:05:18.963322+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:05:18.963322+0000","last_undegraded":"2024-05-07T14:05:18.963322+0000","last_fullsized":"2024-05-07T14:05:18.963322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630125+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:05:18.630125+0000","last_peered":"2024-05-07T14:05:18.630125+0000","last_clean":"2024-05-07T14:05:18.630125+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:05:18.630125+0000","last_undegraded":"2024-05-07T14:05:18.630125+0000","last_fullsized":"2024-05-07T14:05:18.630125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"146'19","reported_seq":292,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272772+0000","last_change":"2024-05-07T14:04:59.461913+0000","last_active":"2024-05-07T14:05:20.272772+0000","last_peered":"2024-05-07T14:05:20.272772+0000","last_clean":"2024-05-07T14:05:20.272772+0000","last_became_active":"2024-05-07T14:04:59.456018+0000","last_became_peered":"2024-05-07T14:04:59.456018+0000","last_unstale":"2024-05-07T14:05:20.272772+0000","last_undegraded":"2024-05-07T14:05:20.272772+0000","last_fullsized":"2024-05-07T14:05:20.272772+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:42:03.359344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959826+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:05:18.959826+0000","last_peered":"2024-05-07T14:05:18.959826+0000","last_clean":"2024-05-07T14:05:18.959826+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:05:18.959826+0000","last_undegraded":"2024-05-07T14:05:18.959826+0000","last_fullsized":"2024-05-07T14:05:18.959826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965082+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:05:18.965082+0000","last_peered":"2024-05-07T14:05:18.965082+0000","last_clean":"2024-05-07T14:05:18.965082+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:05:18.965082+0000","last_undegraded":"2024-05-07T14:05:18.965082+0000","last_fullsized":"2024-05-07T14:05:18.965082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"81'4","reported_seq":106,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961642+0000","last_change":"2024-05-07T14:03:39.687600+0000","last_active":"2024-05-07T14:05:18.961642+0000","last_peered":"2024-05-07T14:05:18.961642+0000","last_clean":"2024-05-07T14:05:18.961642+0000","last_became_active":"2024-05-07T14:03:39.661295+0000","last_became_peered":"2024-05-07T14:03:39.661295+0000","last_unstale":"2024-05-07T14:05:18.961642+0000","last_undegraded":"2024-05-07T14:05:18.961642+0000","last_fullsized":"2024-05-07T14:05:18.961642+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:17:58.416324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721116+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:05:18.721116+0000","last_peered":"2024-05-07T14:05:18.721116+0000","last_clean":"2024-05-07T14:05:18.721116+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:05:18.721116+0000","last_undegraded":"2024-05-07T14:05:18.721116+0000","last_fullsized":"2024-05-07T14:05:18.721116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"123'15","reported_seq":275,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629754+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:05:18.629754+0000","last_peered":"2024-05-07T14:05:18.629754+0000","last_clean":"2024-05-07T14:05:18.629754+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:05:18.629754+0000","last_undegraded":"2024-05-07T14:05:18.629754+0000","last_fullsized":"2024-05-07T14:05:18.629754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52428800,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":25,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959150+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:05:18.959150+0000","last_peered":"2024-05-07T14:05:18.959150+0000","last_clean":"2024-05-07T14:05:18.959150+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:05:18.959150+0000","last_undegraded":"2024-05-07T14:05:18.959150+0000","last_fullsized":"2024-05-07T14:05:18.959150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964612+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:05:18.964612+0000","last_peered":"2024-05-07T14:05:18.964612+0000","last_clean":"2024-05-07T14:05:18.964612+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:05:18.964612+0000","last_undegraded":"2024-05-07T14:05:18.964612+0000","last_fullsized":"2024-05-07T14:05:18.964612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960727+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:05:18.960727+0000","last_peered":"2024-05-07T14:05:18.960727+0000","last_clean":"2024-05-07T14:05:18.960727+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:05:18.960727+0000","last_undegraded":"2024-05-07T14:05:18.960727+0000","last_fullsized":"2024-05-07T14:05:18.960727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719766+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:05:18.719766+0000","last_peered":"2024-05-07T14:05:18.719766+0000","last_clean":"2024-05-07T14:05:18.719766+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:05:18.719766+0000","last_undegraded":"2024-05-07T14:05:18.719766+0000","last_fullsized":"2024-05-07T14:05:18.719766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962141+0000","last_change":"2024-05-07T14:03:39.659916+0000","last_active":"2024-05-07T14:05:18.962141+0000","last_peered":"2024-05-07T14:05:18.962141+0000","last_clean":"2024-05-07T14:05:18.962141+0000","last_became_active":"2024-05-07T14:03:39.659515+0000","last_became_peered":"2024-05-07T14:03:39.659515+0000","last_unstale":"2024-05-07T14:05:18.962141+0000","last_undegraded":"2024-05-07T14:05:18.962141+0000","last_fullsized":"2024-05-07T14:05:18.962141+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:49:16.796937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"123'19","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722362+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:05:18.722362+0000","last_peered":"2024-05-07T14:05:18.722362+0000","last_clean":"2024-05-07T14:05:18.722362+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:05:18.722362+0000","last_undegraded":"2024-05-07T14:05:18.722362+0000","last_fullsized":"2024-05-07T14:05:18.722362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961947+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:05:18.961947+0000","last_peered":"2024-05-07T14:05:18.961947+0000","last_clean":"2024-05-07T14:05:18.961947+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:05:18.961947+0000","last_undegraded":"2024-05-07T14:05:18.961947+0000","last_fullsized":"2024-05-07T14:05:18.961947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960414+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:05:18.960414+0000","last_peered":"2024-05-07T14:05:18.960414+0000","last_clean":"2024-05-07T14:05:18.960414+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:05:18.960414+0000","last_undegraded":"2024-05-07T14:05:18.960414+0000","last_fullsized":"2024-05-07T14:05:18.960414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'36","reported_seq":296,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958943+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:05:18.958943+0000","last_peered":"2024-05-07T14:05:18.958943+0000","last_clean":"2024-05-07T14:05:18.958943+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:05:18.958943+0000","last_undegraded":"2024-05-07T14:05:18.958943+0000","last_fullsized":"2024-05-07T14:05:18.958943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628294+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:05:18.628294+0000","last_peered":"2024-05-07T14:05:18.628294+0000","last_clean":"2024-05-07T14:05:18.628294+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:05:18.628294+0000","last_undegraded":"2024-05-07T14:05:18.628294+0000","last_fullsized":"2024-05-07T14:05:18.628294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960715+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:05:18.960715+0000","last_peered":"2024-05-07T14:05:18.960715+0000","last_clean":"2024-05-07T14:05:18.960715+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:05:18.960715+0000","last_undegraded":"2024-05-07T14:05:18.960715+0000","last_fullsized":"2024-05-07T14:05:18.960715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":254,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960639+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:05:18.960639+0000","last_peered":"2024-05-07T14:05:18.960639+0000","last_clean":"2024-05-07T14:05:18.960639+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:05:18.960639+0000","last_undegraded":"2024-05-07T14:05:18.960639+0000","last_fullsized":"2024-05-07T14:05:18.960639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"124'23","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961817+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:05:18.961817+0000","last_peered":"2024-05-07T14:05:18.961817+0000","last_clean":"2024-05-07T14:05:18.961817+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:05:18.961817+0000","last_undegraded":"2024-05-07T14:05:18.961817+0000","last_fullsized":"2024-05-07T14:05:18.961817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961641+0000","last_change":"2024-05-07T14:04:59.452453+0000","last_active":"2024-05-07T14:05:18.961641+0000","last_peered":"2024-05-07T14:05:18.961641+0000","last_clean":"2024-05-07T14:05:18.961641+0000","last_became_active":"2024-05-07T14:04:59.451719+0000","last_became_peered":"2024-05-07T14:04:59.451719+0000","last_unstale":"2024-05-07T14:05:18.961641+0000","last_undegraded":"2024-05-07T14:05:18.961641+0000","last_fullsized":"2024-05-07T14:05:18.961641+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:58:01.882244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959572+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:05:18.959572+0000","last_peered":"2024-05-07T14:05:18.959572+0000","last_clean":"2024-05-07T14:05:18.959572+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:05:18.959572+0000","last_undegraded":"2024-05-07T14:05:18.959572+0000","last_fullsized":"2024-05-07T14:05:18.959572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":116,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962572+0000","last_change":"2024-05-07T14:03:39.707679+0000","last_active":"2024-05-07T14:05:18.962572+0000","last_peered":"2024-05-07T14:05:18.962572+0000","last_clean":"2024-05-07T14:05:18.962572+0000","last_became_active":"2024-05-07T14:03:39.664751+0000","last_became_peered":"2024-05-07T14:03:39.664751+0000","last_unstale":"2024-05-07T14:05:18.962572+0000","last_undegraded":"2024-05-07T14:05:18.962572+0000","last_fullsized":"2024-05-07T14:05:18.962572+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:55.535011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"146'139","reported_seq":482,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.273267+0000","last_change":"2024-05-07T14:03:42.707530+0000","last_active":"2024-05-07T14:05:20.273267+0000","last_peered":"2024-05-07T14:05:20.273267+0000","last_clean":"2024-05-07T14:05:20.273267+0000","last_became_active":"2024-05-07T14:03:42.707207+0000","last_became_peered":"2024-05-07T14:03:42.707207+0000","last_unstale":"2024-05-07T14:05:20.273267+0000","last_undegraded":"2024-05-07T14:05:20.273267+0000","last_fullsized":"2024-05-07T14:05:20.273267+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:20:22.698141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964049+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:05:18.964049+0000","last_peered":"2024-05-07T14:05:18.964049+0000","last_clean":"2024-05-07T14:05:18.964049+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:05:18.964049+0000","last_undegraded":"2024-05-07T14:05:18.964049+0000","last_fullsized":"2024-05-07T14:05:18.964049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"115'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959440+0000","last_change":"2024-05-07T14:04:59.447585+0000","last_active":"2024-05-07T14:05:18.959440+0000","last_peered":"2024-05-07T14:05:18.959440+0000","last_clean":"2024-05-07T14:05:18.959440+0000","last_became_active":"2024-05-07T14:04:59.446674+0000","last_became_peered":"2024-05-07T14:04:59.446674+0000","last_unstale":"2024-05-07T14:05:18.959440+0000","last_undegraded":"2024-05-07T14:05:18.959440+0000","last_fullsized":"2024-05-07T14:05:18.959440+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:35.485711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"124'18","reported_seq":301,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963635+0000","last_change":"2024-05-07T14:05:00.492095+0000","last_active":"2024-05-07T14:05:18.963635+0000","last_peered":"2024-05-07T14:05:18.963635+0000","last_clean":"2024-05-07T14:05:18.963635+0000","last_became_active":"2024-05-07T14:04:59.460381+0000","last_became_peered":"2024-05-07T14:04:59.460381+0000","last_unstale":"2024-05-07T14:05:18.963635+0000","last_undegraded":"2024-05-07T14:05:18.963635+0000","last_fullsized":"2024-05-07T14:05:18.963635+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:12:40.498963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959581+0000","last_change":"2024-05-07T14:03:39.672724+0000","last_active":"2024-05-07T14:05:18.959581+0000","last_peered":"2024-05-07T14:05:18.959581+0000","last_clean":"2024-05-07T14:05:18.959581+0000","last_became_active":"2024-05-07T14:03:39.671518+0000","last_became_peered":"2024-05-07T14:03:39.671518+0000","last_unstale":"2024-05-07T14:05:18.959581+0000","last_undegraded":"2024-05-07T14:05:18.959581+0000","last_fullsized":"2024-05-07T14:05:18.959581+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:25.485797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":251,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628580+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:05:18.628580+0000","last_peered":"2024-05-07T14:05:18.628580+0000","last_clean":"2024-05-07T14:05:18.628580+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:05:18.628580+0000","last_undegraded":"2024-05-07T14:05:18.628580+0000","last_fullsized":"2024-05-07T14:05:18.628580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629354+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:05:18.629354+0000","last_peered":"2024-05-07T14:05:18.629354+0000","last_clean":"2024-05-07T14:05:18.629354+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:05:18.629354+0000","last_undegraded":"2024-05-07T14:05:18.629354+0000","last_fullsized":"2024-05-07T14:05:18.629354+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"146'135","reported_seq":477,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272789+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:05:20.272789+0000","last_peered":"2024-05-07T14:05:20.272789+0000","last_clean":"2024-05-07T14:05:20.272789+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:05:20.272789+0000","last_undegraded":"2024-05-07T14:05:20.272789+0000","last_fullsized":"2024-05-07T14:05:20.272789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"81'3","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960070+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:05:18.960070+0000","last_peered":"2024-05-07T14:05:18.960070+0000","last_clean":"2024-05-07T14:05:18.960070+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:05:18.960070+0000","last_undegraded":"2024-05-07T14:05:18.960070+0000","last_fullsized":"2024-05-07T14:05:18.960070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"124'4","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630423+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:05:18.630423+0000","last_peered":"2024-05-07T14:05:18.630423+0000","last_clean":"2024-05-07T14:05:18.630423+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:05:18.630423+0000","last_undegraded":"2024-05-07T14:05:18.630423+0000","last_fullsized":"2024-05-07T14:05:18.630423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"124'23","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962938+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:05:18.962938+0000","last_peered":"2024-05-07T14:05:18.962938+0000","last_clean":"2024-05-07T14:05:18.962938+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:05:18.962938+0000","last_undegraded":"2024-05-07T14:05:18.962938+0000","last_fullsized":"2024-05-07T14:05:18.962938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964431+0000","last_change":"2024-05-07T14:04:59.469514+0000","last_active":"2024-05-07T14:05:18.964431+0000","last_peered":"2024-05-07T14:05:18.964431+0000","last_clean":"2024-05-07T14:05:18.964431+0000","last_became_active":"2024-05-07T14:04:59.469021+0000","last_became_peered":"2024-05-07T14:04:59.469021+0000","last_unstale":"2024-05-07T14:05:18.964431+0000","last_undegraded":"2024-05-07T14:05:18.964431+0000","last_fullsized":"2024-05-07T14:05:18.964431+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:17:47.533593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959578+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:05:18.959578+0000","last_peered":"2024-05-07T14:05:18.959578+0000","last_clean":"2024-05-07T14:05:18.959578+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:05:18.959578+0000","last_undegraded":"2024-05-07T14:05:18.959578+0000","last_fullsized":"2024-05-07T14:05:18.959578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"124'45","reported_seq":288,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961605+0000","last_change":"2024-05-07T14:04:59.918491+0000","last_active":"2024-05-07T14:05:18.961605+0000","last_peered":"2024-05-07T14:05:18.961605+0000","last_clean":"2024-05-07T14:05:18.961605+0000","last_became_active":"2024-05-07T14:04:59.442492+0000","last_became_peered":"2024-05-07T14:04:59.442492+0000","last_unstale":"2024-05-07T14:05:18.961605+0000","last_undegraded":"2024-05-07T14:05:18.961605+0000","last_fullsized":"2024-05-07T14:05:18.961605+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:58.713363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120967,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":40,"num_read_kb":26,"num_write":24,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":116761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":252,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963779+0000","last_change":"2024-05-07T14:03:39.665240+0000","last_active":"2024-05-07T14:05:18.963779+0000","last_peered":"2024-05-07T14:05:18.963779+0000","last_clean":"2024-05-07T14:05:18.963779+0000","last_became_active":"2024-05-07T14:03:39.664810+0000","last_became_peered":"2024-05-07T14:03:39.664810+0000","last_unstale":"2024-05-07T14:05:18.963779+0000","last_undegraded":"2024-05-07T14:05:18.963779+0000","last_fullsized":"2024-05-07T14:05:18.963779+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:18:01.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721214+0000","last_change":"2024-05-07T14:04:59.465509+0000","last_active":"2024-05-07T14:05:18.721214+0000","last_peered":"2024-05-07T14:05:18.721214+0000","last_clean":"2024-05-07T14:05:18.721214+0000","last_became_active":"2024-05-07T14:04:59.464840+0000","last_became_peered":"2024-05-07T14:04:59.464840+0000","last_unstale":"2024-05-07T14:05:18.721214+0000","last_undegraded":"2024-05-07T14:05:18.721214+0000","last_fullsized":"2024-05-07T14:05:18.721214+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:42.823262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959673+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:05:18.959673+0000","last_peered":"2024-05-07T14:05:18.959673+0000","last_clean":"2024-05-07T14:05:18.959673+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:05:18.959673+0000","last_undegraded":"2024-05-07T14:05:18.959673+0000","last_fullsized":"2024-05-07T14:05:18.959673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'8","reported_seq":290,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629203+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:05:18.629203+0000","last_peered":"2024-05-07T14:05:18.629203+0000","last_clean":"2024-05-07T14:05:18.629203+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:05:18.629203+0000","last_undegraded":"2024-05-07T14:05:18.629203+0000","last_fullsized":"2024-05-07T14:05:18.629203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"124'23","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629269+0000","last_change":"2024-05-07T14:04:59.669798+0000","last_active":"2024-05-07T14:05:18.629269+0000","last_peered":"2024-05-07T14:05:18.629269+0000","last_clean":"2024-05-07T14:05:18.629269+0000","last_became_active":"2024-05-07T14:04:59.428245+0000","last_became_peered":"2024-05-07T14:04:59.428245+0000","last_unstale":"2024-05-07T14:05:18.629269+0000","last_undegraded":"2024-05-07T14:05:18.629269+0000","last_fullsized":"2024-05-07T14:05:18.629269+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:40.955811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962422+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:05:18.962422+0000","last_peered":"2024-05-07T14:05:18.962422+0000","last_clean":"2024-05-07T14:05:18.962422+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:05:18.962422+0000","last_undegraded":"2024-05-07T14:05:18.962422+0000","last_fullsized":"2024-05-07T14:05:18.962422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"124'20","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959837+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:05:18.959837+0000","last_peered":"2024-05-07T14:05:18.959837+0000","last_clean":"2024-05-07T14:05:18.959837+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:05:18.959837+0000","last_undegraded":"2024-05-07T14:05:18.959837+0000","last_fullsized":"2024-05-07T14:05:18.959837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959679+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:05:18.959679+0000","last_peered":"2024-05-07T14:05:18.959679+0000","last_clean":"2024-05-07T14:05:18.959679+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:05:18.959679+0000","last_undegraded":"2024-05-07T14:05:18.959679+0000","last_fullsized":"2024-05-07T14:05:18.959679+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":245,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963898+0000","last_change":"2024-05-07T14:04:59.447528+0000","last_active":"2024-05-07T14:05:18.963898+0000","last_peered":"2024-05-07T14:05:18.963898+0000","last_clean":"2024-05-07T14:05:18.963898+0000","last_became_active":"2024-05-07T14:04:59.446699+0000","last_became_peered":"2024-05-07T14:04:59.446699+0000","last_unstale":"2024-05-07T14:05:18.963898+0000","last_undegraded":"2024-05-07T14:05:18.963898+0000","last_fullsized":"2024-05-07T14:05:18.963898+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:42.823262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"115'8","reported_seq":129,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962079+0000","last_change":"2024-05-07T14:03:39.692877+0000","last_active":"2024-05-07T14:05:18.962079+0000","last_peered":"2024-05-07T14:05:18.962079+0000","last_clean":"2024-05-07T14:05:18.962079+0000","last_became_active":"2024-05-07T14:03:39.663976+0000","last_became_peered":"2024-05-07T14:03:39.663976+0000","last_unstale":"2024-05-07T14:05:18.962079+0000","last_undegraded":"2024-05-07T14:05:18.962079+0000","last_fullsized":"2024-05-07T14:05:18.962079+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:36.548454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"123'21","reported_seq":267,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961132+0000","last_change":"2024-05-07T14:05:00.456893+0000","last_active":"2024-05-07T14:05:18.961132+0000","last_peered":"2024-05-07T14:05:18.961132+0000","last_clean":"2024-05-07T14:05:18.961132+0000","last_became_active":"2024-05-07T14:04:59.445956+0000","last_became_peered":"2024-05-07T14:04:59.445956+0000","last_unstale":"2024-05-07T14:05:18.961132+0000","last_undegraded":"2024-05-07T14:05:18.961132+0000","last_fullsized":"2024-05-07T14:05:18.961132+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:07.979587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964857+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:05:18.964857+0000","last_peered":"2024-05-07T14:05:18.964857+0000","last_clean":"2024-05-07T14:05:18.964857+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:05:18.964857+0000","last_undegraded":"2024-05-07T14:05:18.964857+0000","last_fullsized":"2024-05-07T14:05:18.964857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"124'9","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958697+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:05:18.958697+0000","last_peered":"2024-05-07T14:05:18.958697+0000","last_clean":"2024-05-07T14:05:18.958697+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:05:18.958697+0000","last_undegraded":"2024-05-07T14:05:18.958697+0000","last_fullsized":"2024-05-07T14:05:18.958697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962740+0000","last_change":"2024-05-07T14:04:59.445953+0000","last_active":"2024-05-07T14:05:18.962740+0000","last_peered":"2024-05-07T14:05:18.962740+0000","last_clean":"2024-05-07T14:05:18.962740+0000","last_became_active":"2024-05-07T14:04:59.444830+0000","last_became_peered":"2024-05-07T14:04:59.444830+0000","last_unstale":"2024-05-07T14:05:18.962740+0000","last_undegraded":"2024-05-07T14:05:18.962740+0000","last_fullsized":"2024-05-07T14:05:18.962740+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:10:54.814821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"106'2","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959004+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:05:18.959004+0000","last_peered":"2024-05-07T14:05:18.959004+0000","last_clean":"2024-05-07T14:05:18.959004+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:05:18.959004+0000","last_undegraded":"2024-05-07T14:05:18.959004+0000","last_fullsized":"2024-05-07T14:05:18.959004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"81'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960024+0000","last_change":"2024-05-07T14:04:59.460718+0000","last_active":"2024-05-07T14:05:18.960024+0000","last_peered":"2024-05-07T14:05:18.960024+0000","last_clean":"2024-05-07T14:05:18.960024+0000","last_became_active":"2024-05-07T14:04:59.460037+0000","last_became_peered":"2024-05-07T14:04:59.460037+0000","last_unstale":"2024-05-07T14:05:18.960024+0000","last_undegraded":"2024-05-07T14:05:18.960024+0000","last_fullsized":"2024-05-07T14:05:18.960024+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:28.266490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"124'21","reported_seq":305,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722278+0000","last_change":"2024-05-07T14:05:00.840128+0000","last_active":"2024-05-07T14:05:18.722278+0000","last_peered":"2024-05-07T14:05:18.722278+0000","last_clean":"2024-05-07T14:05:18.722278+0000","last_became_active":"2024-05-07T14:04:59.460944+0000","last_became_peered":"2024-05-07T14:04:59.460944+0000","last_unstale":"2024-05-07T14:05:18.722278+0000","last_undegraded":"2024-05-07T14:05:18.722278+0000","last_fullsized":"2024-05-07T14:05:18.722278+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:26.259170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960783+0000","last_change":"2024-05-07T14:04:59.431660+0000","last_active":"2024-05-07T14:05:18.960783+0000","last_peered":"2024-05-07T14:05:18.960783+0000","last_clean":"2024-05-07T14:05:18.960783+0000","last_became_active":"2024-05-07T14:04:59.430654+0000","last_became_peered":"2024-05-07T14:04:59.430654+0000","last_unstale":"2024-05-07T14:05:18.960783+0000","last_undegraded":"2024-05-07T14:05:18.960783+0000","last_fullsized":"2024-05-07T14:05:18.960783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:27:01.765321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"124'20","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963938+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:05:18.963938+0000","last_peered":"2024-05-07T14:05:18.963938+0000","last_clean":"2024-05-07T14:05:18.963938+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:05:18.963938+0000","last_undegraded":"2024-05-07T14:05:18.963938+0000","last_fullsized":"2024-05-07T14:05:18.963938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959502+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:05:18.959502+0000","last_peered":"2024-05-07T14:05:18.959502+0000","last_clean":"2024-05-07T14:05:18.959502+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:05:18.959502+0000","last_undegraded":"2024-05-07T14:05:18.959502+0000","last_fullsized":"2024-05-07T14:05:18.959502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720402+0000","last_change":"2024-05-07T14:04:59.444373+0000","last_active":"2024-05-07T14:05:18.720402+0000","last_peered":"2024-05-07T14:05:18.720402+0000","last_clean":"2024-05-07T14:05:18.720402+0000","last_became_active":"2024-05-07T14:04:59.443620+0000","last_became_peered":"2024-05-07T14:04:59.443620+0000","last_unstale":"2024-05-07T14:05:18.720402+0000","last_undegraded":"2024-05-07T14:05:18.720402+0000","last_fullsized":"2024-05-07T14:05:18.720402+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:44:00.772402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"124'4","reported_seq":94,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958941+0000","last_change":"2024-05-07T14:03:52.789742+0000","last_active":"2024-05-07T14:05:18.958941+0000","last_peered":"2024-05-07T14:05:18.958941+0000","last_clean":"2024-05-07T14:05:18.958941+0000","last_became_active":"2024-05-07T14:03:52.787675+0000","last_became_peered":"2024-05-07T14:03:52.787675+0000","last_unstale":"2024-05-07T14:05:18.958941+0000","last_undegraded":"2024-05-07T14:05:18.958941+0000","last_fullsized":"2024-05-07T14:05:18.958941+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:39.000431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"124'24","reported_seq":229,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630088+0000","last_change":"2024-05-07T14:01:37.318408+0000","last_active":"2024-05-07T14:05:18.630088+0000","last_peered":"2024-05-07T14:05:18.630088+0000","last_clean":"2024-05-07T14:05:18.630088+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:05:18.630088+0000","last_undegraded":"2024-05-07T14:05:18.630088+0000","last_fullsized":"2024-05-07T14:05:18.630088+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:43.643434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959480+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:05:18.959480+0000","last_peered":"2024-05-07T14:05:18.959480+0000","last_clean":"2024-05-07T14:05:18.959480+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:05:18.959480+0000","last_undegraded":"2024-05-07T14:05:18.959480+0000","last_fullsized":"2024-05-07T14:05:18.959480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"124'17","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961550+0000","last_change":"2024-05-07T14:04:59.459641+0000","last_active":"2024-05-07T14:05:18.961550+0000","last_peered":"2024-05-07T14:05:18.961550+0000","last_clean":"2024-05-07T14:05:18.961550+0000","last_became_active":"2024-05-07T14:04:59.459102+0000","last_became_peered":"2024-05-07T14:04:59.459102+0000","last_unstale":"2024-05-07T14:05:18.961550+0000","last_undegraded":"2024-05-07T14:05:18.961550+0000","last_fullsized":"2024-05-07T14:05:18.961550+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:09:18.267555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958858+0000","last_change":"2024-05-07T14:04:59.449322+0000","last_active":"2024-05-07T14:05:18.958858+0000","last_peered":"2024-05-07T14:05:18.958858+0000","last_clean":"2024-05-07T14:05:18.958858+0000","last_became_active":"2024-05-07T14:04:59.448594+0000","last_became_peered":"2024-05-07T14:04:59.448594+0000","last_unstale":"2024-05-07T14:05:18.958858+0000","last_undegraded":"2024-05-07T14:05:18.958858+0000","last_fullsized":"2024-05-07T14:05:18.958858+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:32.423884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"115'6","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964236+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:05:18.964236+0000","last_peered":"2024-05-07T14:05:18.964236+0000","last_clean":"2024-05-07T14:05:18.964236+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:05:18.964236+0000","last_undegraded":"2024-05-07T14:05:18.964236+0000","last_fullsized":"2024-05-07T14:05:18.964236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959138+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:05:18.959138+0000","last_peered":"2024-05-07T14:05:18.959138+0000","last_clean":"2024-05-07T14:05:18.959138+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:05:18.959138+0000","last_undegraded":"2024-05-07T14:05:18.959138+0000","last_fullsized":"2024-05-07T14:05:18.959138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":257,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961778+0000","last_change":"2024-05-07T14:04:59.457249+0000","last_active":"2024-05-07T14:05:18.961778+0000","last_peered":"2024-05-07T14:05:18.961778+0000","last_clean":"2024-05-07T14:05:18.961778+0000","last_became_active":"2024-05-07T14:04:59.455608+0000","last_became_peered":"2024-05-07T14:04:59.455608+0000","last_unstale":"2024-05-07T14:05:18.961778+0000","last_undegraded":"2024-05-07T14:05:18.961778+0000","last_fullsized":"2024-05-07T14:05:18.961778+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:55:28.165004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"124'29","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963612+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:05:18.963612+0000","last_peered":"2024-05-07T14:05:18.963612+0000","last_clean":"2024-05-07T14:05:18.963612+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:05:18.963612+0000","last_undegraded":"2024-05-07T14:05:18.963612+0000","last_fullsized":"2024-05-07T14:05:18.963612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120857,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720945+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:05:18.720945+0000","last_peered":"2024-05-07T14:05:18.720945+0000","last_clean":"2024-05-07T14:05:18.720945+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:05:18.720945+0000","last_undegraded":"2024-05-07T14:05:18.720945+0000","last_fullsized":"2024-05-07T14:05:18.720945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"81'2","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963561+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:05:18.963561+0000","last_peered":"2024-05-07T14:05:18.963561+0000","last_clean":"2024-05-07T14:05:18.963561+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:05:18.963561+0000","last_undegraded":"2024-05-07T14:05:18.963561+0000","last_fullsized":"2024-05-07T14:05:18.963561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"115'8","reported_seq":295,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962152+0000","last_change":"2024-05-07T14:04:59.457999+0000","last_active":"2024-05-07T14:05:18.962152+0000","last_peered":"2024-05-07T14:05:18.962152+0000","last_clean":"2024-05-07T14:05:18.962152+0000","last_became_active":"2024-05-07T14:04:59.456492+0000","last_became_peered":"2024-05-07T14:04:59.456492+0000","last_unstale":"2024-05-07T14:05:18.962152+0000","last_undegraded":"2024-05-07T14:05:18.962152+0000","last_fullsized":"2024-05-07T14:05:18.962152+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:41.936460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"124'22","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963224+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:05:18.963224+0000","last_peered":"2024-05-07T14:05:18.963224+0000","last_clean":"2024-05-07T14:05:18.963224+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:05:18.963224+0000","last_undegraded":"2024-05-07T14:05:18.963224+0000","last_fullsized":"2024-05-07T14:05:18.963224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960857+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:05:18.960857+0000","last_peered":"2024-05-07T14:05:18.960857+0000","last_clean":"2024-05-07T14:05:18.960857+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:05:18.960857+0000","last_undegraded":"2024-05-07T14:05:18.960857+0000","last_fullsized":"2024-05-07T14:05:18.960857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"124'23","reported_seq":258,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962735+0000","last_change":"2024-05-07T14:04:59.440283+0000","last_active":"2024-05-07T14:05:18.962735+0000","last_peered":"2024-05-07T14:05:18.962735+0000","last_clean":"2024-05-07T14:05:18.962735+0000","last_became_active":"2024-05-07T14:04:59.439603+0000","last_became_peered":"2024-05-07T14:04:59.439603+0000","last_unstale":"2024-05-07T14:05:18.962735+0000","last_undegraded":"2024-05-07T14:05:18.962735+0000","last_fullsized":"2024-05-07T14:05:18.962735+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:19.505619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964150+0000","last_change":"2024-05-07T14:03:39.667564+0000","last_active":"2024-05-07T14:05:18.964150+0000","last_peered":"2024-05-07T14:05:18.964150+0000","last_clean":"2024-05-07T14:05:18.964150+0000","last_became_active":"2024-05-07T14:03:39.666888+0000","last_became_peered":"2024-05-07T14:03:39.666888+0000","last_unstale":"2024-05-07T14:05:18.964150+0000","last_undegraded":"2024-05-07T14:05:18.964150+0000","last_fullsized":"2024-05-07T14:05:18.964150+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:33.367980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959043+0000","last_change":"2024-05-07T14:04:59.456030+0000","last_active":"2024-05-07T14:05:18.959043+0000","last_peered":"2024-05-07T14:05:18.959043+0000","last_clean":"2024-05-07T14:05:18.959043+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:18.959043+0000","last_undegraded":"2024-05-07T14:05:18.959043+0000","last_fullsized":"2024-05-07T14:05:18.959043+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:20:24.704314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"81'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963522+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:05:18.963522+0000","last_peered":"2024-05-07T14:05:18.963522+0000","last_clean":"2024-05-07T14:05:18.963522+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:05:18.963522+0000","last_undegraded":"2024-05-07T14:05:18.963522+0000","last_fullsized":"2024-05-07T14:05:18.963522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629964+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:05:18.629964+0000","last_peered":"2024-05-07T14:05:18.629964+0000","last_clean":"2024-05-07T14:05:18.629964+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:05:18.629964+0000","last_undegraded":"2024-05-07T14:05:18.629964+0000","last_fullsized":"2024-05-07T14:05:18.629964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631091+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:05:18.631091+0000","last_peered":"2024-05-07T14:05:18.631091+0000","last_clean":"2024-05-07T14:05:18.631091+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:05:18.631091+0000","last_undegraded":"2024-05-07T14:05:18.631091+0000","last_fullsized":"2024-05-07T14:05:18.631091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"124'19","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964240+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:05:18.964240+0000","last_peered":"2024-05-07T14:05:18.964240+0000","last_clean":"2024-05-07T14:05:18.964240+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:05:18.964240+0000","last_undegraded":"2024-05-07T14:05:18.964240+0000","last_fullsized":"2024-05-07T14:05:18.964240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960106+0000","last_change":"2024-05-07T14:03:39.664184+0000","last_active":"2024-05-07T14:05:18.960106+0000","last_peered":"2024-05-07T14:05:18.960106+0000","last_clean":"2024-05-07T14:05:18.960106+0000","last_became_active":"2024-05-07T14:03:39.663569+0000","last_became_peered":"2024-05-07T14:03:39.663569+0000","last_unstale":"2024-05-07T14:05:18.960106+0000","last_undegraded":"2024-05-07T14:05:18.960106+0000","last_fullsized":"2024-05-07T14:05:18.960106+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:51.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720030+0000","last_change":"2024-05-07T14:04:59.447765+0000","last_active":"2024-05-07T14:05:18.720030+0000","last_peered":"2024-05-07T14:05:18.720030+0000","last_clean":"2024-05-07T14:05:18.720030+0000","last_became_active":"2024-05-07T14:04:59.447025+0000","last_became_peered":"2024-05-07T14:04:59.447025+0000","last_unstale":"2024-05-07T14:05:18.720030+0000","last_undegraded":"2024-05-07T14:05:18.720030+0000","last_fullsized":"2024-05-07T14:05:18.720030+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:14.299214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"124'14","reported_seq":298,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629778+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:05:18.629778+0000","last_peered":"2024-05-07T14:05:18.629778+0000","last_clean":"2024-05-07T14:05:18.629778+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:05:18.629778+0000","last_undegraded":"2024-05-07T14:05:18.629778+0000","last_fullsized":"2024-05-07T14:05:18.629778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"124'20","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960254+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:05:18.960254+0000","last_peered":"2024-05-07T14:05:18.960254+0000","last_clean":"2024-05-07T14:05:18.960254+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:05:18.960254+0000","last_undegraded":"2024-05-07T14:05:18.960254+0000","last_fullsized":"2024-05-07T14:05:18.960254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964629+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:05:18.964629+0000","last_peered":"2024-05-07T14:05:18.964629+0000","last_clean":"2024-05-07T14:05:18.964629+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:05:18.964629+0000","last_undegraded":"2024-05-07T14:05:18.964629+0000","last_fullsized":"2024-05-07T14:05:18.964629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630297+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:05:18.630297+0000","last_peered":"2024-05-07T14:05:18.630297+0000","last_clean":"2024-05-07T14:05:18.630297+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:05:18.630297+0000","last_undegraded":"2024-05-07T14:05:18.630297+0000","last_fullsized":"2024-05-07T14:05:18.630297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"146'135","reported_seq":506,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.273174+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:05:20.273174+0000","last_peered":"2024-05-07T14:05:20.273174+0000","last_clean":"2024-05-07T14:05:20.273174+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:05:20.273174+0000","last_undegraded":"2024-05-07T14:05:20.273174+0000","last_fullsized":"2024-05-07T14:05:20.273174+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"81'7","reported_seq":161,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961656+0000","last_change":"2024-05-07T14:04:59.448265+0000","last_active":"2024-05-07T14:05:18.961656+0000","last_peered":"2024-05-07T14:05:18.961656+0000","last_clean":"2024-05-07T14:05:18.961656+0000","last_became_active":"2024-05-07T14:04:59.444580+0000","last_became_peered":"2024-05-07T14:04:59.444580+0000","last_unstale":"2024-05-07T14:05:18.961656+0000","last_undegraded":"2024-05-07T14:05:18.961656+0000","last_fullsized":"2024-05-07T14:05:18.961656+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:54.087416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"124'8","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629103+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:05:18.629103+0000","last_peered":"2024-05-07T14:05:18.629103+0000","last_clean":"2024-05-07T14:05:18.629103+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:05:18.629103+0000","last_undegraded":"2024-05-07T14:05:18.629103+0000","last_fullsized":"2024-05-07T14:05:18.629103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"124'20","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721314+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:05:18.721314+0000","last_peered":"2024-05-07T14:05:18.721314+0000","last_clean":"2024-05-07T14:05:18.721314+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:05:18.721314+0000","last_undegraded":"2024-05-07T14:05:18.721314+0000","last_fullsized":"2024-05-07T14:05:18.721314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961289+0000","last_change":"2024-05-07T14:04:59.425730+0000","last_active":"2024-05-07T14:05:18.961289+0000","last_peered":"2024-05-07T14:05:18.961289+0000","last_clean":"2024-05-07T14:05:18.961289+0000","last_became_active":"2024-05-07T14:04:59.421636+0000","last_became_peered":"2024-05-07T14:04:59.421636+0000","last_unstale":"2024-05-07T14:05:18.961289+0000","last_undegraded":"2024-05-07T14:05:18.961289+0000","last_fullsized":"2024-05-07T14:05:18.961289+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:15:27.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"124'23","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720578+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:05:18.720578+0000","last_peered":"2024-05-07T14:05:18.720578+0000","last_clean":"2024-05-07T14:05:18.720578+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:05:18.720578+0000","last_undegraded":"2024-05-07T14:05:18.720578+0000","last_fullsized":"2024-05-07T14:05:18.720578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958232+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:05:18.958232+0000","last_peered":"2024-05-07T14:05:18.958232+0000","last_clean":"2024-05-07T14:05:18.958232+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:05:18.958232+0000","last_undegraded":"2024-05-07T14:05:18.958232+0000","last_fullsized":"2024-05-07T14:05:18.958232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"124'7","reported_seq":157,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964433+0000","last_change":"2024-05-07T14:05:02.242073+0000","last_active":"2024-05-07T14:05:18.964433+0000","last_peered":"2024-05-07T14:05:18.964433+0000","last_clean":"2024-05-07T14:05:18.964433+0000","last_became_active":"2024-05-07T14:04:59.467712+0000","last_became_peered":"2024-05-07T14:04:59.467712+0000","last_unstale":"2024-05-07T14:05:18.964433+0000","last_undegraded":"2024-05-07T14:05:18.964433+0000","last_fullsized":"2024-05-07T14:05:18.964433+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:31.624262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"115'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629455+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:05:18.629455+0000","last_peered":"2024-05-07T14:05:18.629455+0000","last_clean":"2024-05-07T14:05:18.629455+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:05:18.629455+0000","last_undegraded":"2024-05-07T14:05:18.629455+0000","last_fullsized":"2024-05-07T14:05:18.629455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"124'26","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722184+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:05:18.722184+0000","last_peered":"2024-05-07T14:05:18.722184+0000","last_clean":"2024-05-07T14:05:18.722184+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:05:18.722184+0000","last_undegraded":"2024-05-07T14:05:18.722184+0000","last_fullsized":"2024-05-07T14:05:18.722184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720667+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:05:18.720667+0000","last_peered":"2024-05-07T14:05:18.720667+0000","last_clean":"2024-05-07T14:05:18.720667+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:05:18.720667+0000","last_undegraded":"2024-05-07T14:05:18.720667+0000","last_fullsized":"2024-05-07T14:05:18.720667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"124'17","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958238+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:05:18.958238+0000","last_peered":"2024-05-07T14:05:18.958238+0000","last_clean":"2024-05-07T14:05:18.958238+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:05:18.958238+0000","last_undegraded":"2024-05-07T14:05:18.958238+0000","last_fullsized":"2024-05-07T14:05:18.958238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959103+0000","last_change":"2024-05-07T14:04:59.466240+0000","last_active":"2024-05-07T14:05:18.959103+0000","last_peered":"2024-05-07T14:05:18.959103+0000","last_clean":"2024-05-07T14:05:18.959103+0000","last_became_active":"2024-05-07T14:04:59.465509+0000","last_became_peered":"2024-05-07T14:04:59.465509+0000","last_unstale":"2024-05-07T14:05:18.959103+0000","last_undegraded":"2024-05-07T14:05:18.959103+0000","last_fullsized":"2024-05-07T14:05:18.959103+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:28:23.609814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964136+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:05:18.964136+0000","last_peered":"2024-05-07T14:05:18.964136+0000","last_clean":"2024-05-07T14:05:18.964136+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:05:18.964136+0000","last_undegraded":"2024-05-07T14:05:18.964136+0000","last_fullsized":"2024-05-07T14:05:18.964136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"87'6","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960098+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:05:18.960098+0000","last_peered":"2024-05-07T14:05:18.960098+0000","last_clean":"2024-05-07T14:05:18.960098+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:05:18.960098+0000","last_undegraded":"2024-05-07T14:05:18.960098+0000","last_fullsized":"2024-05-07T14:05:18.960098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"124'19","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964959+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:05:18.964959+0000","last_peered":"2024-05-07T14:05:18.964959+0000","last_clean":"2024-05-07T14:05:18.964959+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:05:18.964959+0000","last_undegraded":"2024-05-07T14:05:18.964959+0000","last_fullsized":"2024-05-07T14:05:18.964959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628160+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:05:18.628160+0000","last_peered":"2024-05-07T14:05:18.628160+0000","last_clean":"2024-05-07T14:05:18.628160+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:05:18.628160+0000","last_undegraded":"2024-05-07T14:05:18.628160+0000","last_fullsized":"2024-05-07T14:05:18.628160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"124'13","reported_seq":271,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965528+0000","last_change":"2024-05-07T14:04:59.460738+0000","last_active":"2024-05-07T14:05:18.965528+0000","last_peered":"2024-05-07T14:05:18.965528+0000","last_clean":"2024-05-07T14:05:18.965528+0000","last_became_active":"2024-05-07T14:04:59.459963+0000","last_became_peered":"2024-05-07T14:04:59.459963+0000","last_unstale":"2024-05-07T14:05:18.965528+0000","last_undegraded":"2024-05-07T14:05:18.965528+0000","last_fullsized":"2024-05-07T14:05:18.965528+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:14:25.517514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628526+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:05:18.628526+0000","last_peered":"2024-05-07T14:05:18.628526+0000","last_clean":"2024-05-07T14:05:18.628526+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:05:18.628526+0000","last_undegraded":"2024-05-07T14:05:18.628526+0000","last_fullsized":"2024-05-07T14:05:18.628526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"81'8","reported_seq":222,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963108+0000","last_change":"2024-05-07T14:04:59.462387+0000","last_active":"2024-05-07T14:05:18.963108+0000","last_peered":"2024-05-07T14:05:18.963108+0000","last_clean":"2024-05-07T14:05:18.963108+0000","last_became_active":"2024-05-07T14:04:59.456842+0000","last_became_peered":"2024-05-07T14:04:59.456842+0000","last_unstale":"2024-05-07T14:05:18.963108+0000","last_undegraded":"2024-05-07T14:05:18.963108+0000","last_fullsized":"2024-05-07T14:05:18.963108+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:43:26.257882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"115'10","reported_seq":294,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628969+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:05:18.628969+0000","last_peered":"2024-05-07T14:05:18.628969+0000","last_clean":"2024-05-07T14:05:18.628969+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:05:18.628969+0000","last_undegraded":"2024-05-07T14:05:18.628969+0000","last_fullsized":"2024-05-07T14:05:18.628969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"124'22","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960298+0000","last_change":"2024-05-07T14:01:37.554242+0000","last_active":"2024-05-07T14:05:18.960298+0000","last_peered":"2024-05-07T14:05:18.960298+0000","last_clean":"2024-05-07T14:05:18.960298+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:05:18.960298+0000","last_undegraded":"2024-05-07T14:05:18.960298+0000","last_fullsized":"2024-05-07T14:05:18.960298+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:16:22.149514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962634+0000","last_change":"2024-05-07T14:03:39.674947+0000","last_active":"2024-05-07T14:05:18.962634+0000","last_peered":"2024-05-07T14:05:18.962634+0000","last_clean":"2024-05-07T14:05:18.962634+0000","last_became_active":"2024-05-07T14:03:39.659887+0000","last_became_peered":"2024-05-07T14:03:39.659887+0000","last_unstale":"2024-05-07T14:05:18.962634+0000","last_undegraded":"2024-05-07T14:05:18.962634+0000","last_fullsized":"2024-05-07T14:05:18.962634+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:18:06.217561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"124'17","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628561+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:05:18.628561+0000","last_peered":"2024-05-07T14:05:18.628561+0000","last_clean":"2024-05-07T14:05:18.628561+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:05:18.628561+0000","last_undegraded":"2024-05-07T14:05:18.628561+0000","last_fullsized":"2024-05-07T14:05:18.628561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958734+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:05:18.958734+0000","last_peered":"2024-05-07T14:05:18.958734+0000","last_clean":"2024-05-07T14:05:18.958734+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:05:18.958734+0000","last_undegraded":"2024-05-07T14:05:18.958734+0000","last_fullsized":"2024-05-07T14:05:18.958734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631326+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:05:18.631326+0000","last_peered":"2024-05-07T14:05:18.631326+0000","last_clean":"2024-05-07T14:05:18.631326+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:05:18.631326+0000","last_undegraded":"2024-05-07T14:05:18.631326+0000","last_fullsized":"2024-05-07T14:05:18.631326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"87'16","reported_seq":110,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960757+0000","last_change":"2024-05-07T14:03:39.799013+0000","last_active":"2024-05-07T14:05:18.960757+0000","last_peered":"2024-05-07T14:05:18.960757+0000","last_clean":"2024-05-07T14:05:18.960757+0000","last_became_active":"2024-05-07T14:03:39.671068+0000","last_became_peered":"2024-05-07T14:03:39.671068+0000","last_unstale":"2024-05-07T14:05:18.960757+0000","last_undegraded":"2024-05-07T14:05:18.960757+0000","last_fullsized":"2024-05-07T14:05:18.960757+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:13.746128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"124'22","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959122+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:05:18.959122+0000","last_peered":"2024-05-07T14:05:18.959122+0000","last_clean":"2024-05-07T14:05:18.959122+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:05:18.959122+0000","last_undegraded":"2024-05-07T14:05:18.959122+0000","last_fullsized":"2024-05-07T14:05:18.959122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959826+0000","last_change":"2024-05-07T14:03:39.661724+0000","last_active":"2024-05-07T14:05:18.959826+0000","last_peered":"2024-05-07T14:05:18.959826+0000","last_clean":"2024-05-07T14:05:18.959826+0000","last_became_active":"2024-05-07T14:03:39.661339+0000","last_became_peered":"2024-05-07T14:03:39.661339+0000","last_unstale":"2024-05-07T14:05:18.959826+0000","last_undegraded":"2024-05-07T14:05:18.959826+0000","last_fullsized":"2024-05-07T14:05:18.959826+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:34.633849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"123'17","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628556+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:05:18.628556+0000","last_peered":"2024-05-07T14:05:18.628556+0000","last_clean":"2024-05-07T14:05:18.628556+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:05:18.628556+0000","last_undegraded":"2024-05-07T14:05:18.628556+0000","last_fullsized":"2024-05-07T14:05:18.628556+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:01.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"81'6","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721729+0000","last_change":"2024-05-07T14:04:59.467441+0000","last_active":"2024-05-07T14:05:18.721729+0000","last_peered":"2024-05-07T14:05:18.721729+0000","last_clean":"2024-05-07T14:05:18.721729+0000","last_became_active":"2024-05-07T14:04:59.466443+0000","last_became_peered":"2024-05-07T14:04:59.466443+0000","last_unstale":"2024-05-07T14:05:18.721729+0000","last_undegraded":"2024-05-07T14:05:18.721729+0000","last_fullsized":"2024-05-07T14:05:18.721729+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:35.485711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"124'25","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721037+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:05:18.721037+0000","last_peered":"2024-05-07T14:05:18.721037+0000","last_clean":"2024-05-07T14:05:18.721037+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:05:18.721037+0000","last_undegraded":"2024-05-07T14:05:18.721037+0000","last_fullsized":"2024-05-07T14:05:18.721037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"124'4","reported_seq":124,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961882+0000","last_change":"2024-05-07T14:04:59.861145+0000","last_active":"2024-05-07T14:05:18.961882+0000","last_peered":"2024-05-07T14:05:18.961882+0000","last_clean":"2024-05-07T14:05:18.961882+0000","last_became_active":"2024-05-07T14:04:59.445932+0000","last_became_peered":"2024-05-07T14:04:59.445932+0000","last_unstale":"2024-05-07T14:05:18.961882+0000","last_undegraded":"2024-05-07T14:05:18.961882+0000","last_fullsized":"2024-05-07T14:05:18.961882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:42.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"124'28","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960357+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:05:18.960357+0000","last_peered":"2024-05-07T14:05:18.960357+0000","last_clean":"2024-05-07T14:05:18.960357+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:05:18.960357+0000","last_undegraded":"2024-05-07T14:05:18.960357+0000","last_fullsized":"2024-05-07T14:05:18.960357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"81'2","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965417+0000","last_change":"2024-05-07T14:04:59.448690+0000","last_active":"2024-05-07T14:05:18.965417+0000","last_peered":"2024-05-07T14:05:18.965417+0000","last_clean":"2024-05-07T14:05:18.965417+0000","last_became_active":"2024-05-07T14:04:59.447844+0000","last_became_peered":"2024-05-07T14:04:59.447844+0000","last_unstale":"2024-05-07T14:05:18.965417+0000","last_undegraded":"2024-05-07T14:05:18.965417+0000","last_fullsized":"2024-05-07T14:05:18.965417+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:48:36.699391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"124'21","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964522+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:05:18.964522+0000","last_peered":"2024-05-07T14:05:18.964522+0000","last_clean":"2024-05-07T14:05:18.964522+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:05:18.964522+0000","last_undegraded":"2024-05-07T14:05:18.964522+0000","last_fullsized":"2024-05-07T14:05:18.964522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629774+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:05:18.629774+0000","last_peered":"2024-05-07T14:05:18.629774+0000","last_clean":"2024-05-07T14:05:18.629774+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:05:18.629774+0000","last_undegraded":"2024-05-07T14:05:18.629774+0000","last_fullsized":"2024-05-07T14:05:18.629774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"124'28","reported_seq":133,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965151+0000","last_change":"2024-05-07T14:03:39.789159+0000","last_active":"2024-05-07T14:05:18.965151+0000","last_peered":"2024-05-07T14:05:18.965151+0000","last_clean":"2024-05-07T14:05:18.965151+0000","last_became_active":"2024-05-07T14:03:39.668790+0000","last_became_peered":"2024-05-07T14:03:39.668790+0000","last_unstale":"2024-05-07T14:05:18.965151+0000","last_undegraded":"2024-05-07T14:05:18.965151+0000","last_fullsized":"2024-05-07T14:05:18.965151+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:14.798045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"81'8","reported_seq":319,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959979+0000","last_change":"2024-05-07T14:03:39.855375+0000","last_active":"2024-05-07T14:05:18.959979+0000","last_peered":"2024-05-07T14:05:18.959979+0000","last_clean":"2024-05-07T14:05:18.959979+0000","last_became_active":"2024-05-07T14:03:39.666451+0000","last_became_peered":"2024-05-07T14:03:39.666451+0000","last_unstale":"2024-05-07T14:05:18.959979+0000","last_undegraded":"2024-05-07T14:05:18.959979+0000","last_fullsized":"2024-05-07T14:05:18.959979+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:37.171990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"124'22","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961451+0000","last_change":"2024-05-07T14:05:00.248173+0000","last_active":"2024-05-07T14:05:18.961451+0000","last_peered":"2024-05-07T14:05:18.961451+0000","last_clean":"2024-05-07T14:05:18.961451+0000","last_became_active":"2024-05-07T14:04:59.455622+0000","last_became_peered":"2024-05-07T14:04:59.455622+0000","last_unstale":"2024-05-07T14:05:18.961451+0000","last_undegraded":"2024-05-07T14:05:18.961451+0000","last_fullsized":"2024-05-07T14:05:18.961451+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:03.691207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"115'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959101+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:05:18.959101+0000","last_peered":"2024-05-07T14:05:18.959101+0000","last_clean":"2024-05-07T14:05:18.959101+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:05:18.959101+0000","last_undegraded":"2024-05-07T14:05:18.959101+0000","last_fullsized":"2024-05-07T14:05:18.959101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"124'20","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963922+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:05:18.963922+0000","last_peered":"2024-05-07T14:05:18.963922+0000","last_clean":"2024-05-07T14:05:18.963922+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:05:18.963922+0000","last_undegraded":"2024-05-07T14:05:18.963922+0000","last_fullsized":"2024-05-07T14:05:18.963922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"106'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960114+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:05:18.960114+0000","last_peered":"2024-05-07T14:05:18.960114+0000","last_clean":"2024-05-07T14:05:18.960114+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:05:18.960114+0000","last_undegraded":"2024-05-07T14:05:18.960114+0000","last_fullsized":"2024-05-07T14:05:18.960114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"124'29","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720842+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:05:18.720842+0000","last_peered":"2024-05-07T14:05:18.720842+0000","last_clean":"2024-05-07T14:05:18.720842+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:05:18.720842+0000","last_undegraded":"2024-05-07T14:05:18.720842+0000","last_fullsized":"2024-05-07T14:05:18.720842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":39,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630722+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:05:18.630722+0000","last_peered":"2024-05-07T14:05:18.630722+0000","last_clean":"2024-05-07T14:05:18.630722+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:05:18.630722+0000","last_undegraded":"2024-05-07T14:05:18.630722+0000","last_fullsized":"2024-05-07T14:05:18.630722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"124'24","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960162+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:05:18.960162+0000","last_peered":"2024-05-07T14:05:18.960162+0000","last_clean":"2024-05-07T14:05:18.960162+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:05:18.960162+0000","last_undegraded":"2024-05-07T14:05:18.960162+0000","last_fullsized":"2024-05-07T14:05:18.960162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"106'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630125+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:05:18.630125+0000","last_peered":"2024-05-07T14:05:18.630125+0000","last_clean":"2024-05-07T14:05:18.630125+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:05:18.630125+0000","last_undegraded":"2024-05-07T14:05:18.630125+0000","last_fullsized":"2024-05-07T14:05:18.630125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"124'27","reported_seq":304,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720928+0000","last_change":"2024-05-07T14:04:59.856502+0000","last_active":"2024-05-07T14:05:18.720928+0000","last_peered":"2024-05-07T14:05:18.720928+0000","last_clean":"2024-05-07T14:05:18.720928+0000","last_became_active":"2024-05-07T14:04:59.443769+0000","last_became_peered":"2024-05-07T14:04:59.443769+0000","last_unstale":"2024-05-07T14:05:18.720928+0000","last_undegraded":"2024-05-07T14:05:18.720928+0000","last_fullsized":"2024-05-07T14:05:18.720928+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:48:34.692070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631323+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:05:18.631323+0000","last_peered":"2024-05-07T14:05:18.631323+0000","last_clean":"2024-05-07T14:05:18.631323+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:05:18.631323+0000","last_undegraded":"2024-05-07T14:05:18.631323+0000","last_fullsized":"2024-05-07T14:05:18.631323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"124'27","reported_seq":309,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960488+0000","last_change":"2024-05-07T14:05:01.098433+0000","last_active":"2024-05-07T14:05:18.960488+0000","last_peered":"2024-05-07T14:05:18.960488+0000","last_clean":"2024-05-07T14:05:18.960488+0000","last_became_active":"2024-05-07T14:04:59.458388+0000","last_became_peered":"2024-05-07T14:04:59.458388+0000","last_unstale":"2024-05-07T14:05:18.960488+0000","last_undegraded":"2024-05-07T14:05:18.960488+0000","last_fullsized":"2024-05-07T14:05:18.960488+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:29:00.050525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"81'6","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961340+0000","last_change":"2024-05-07T14:04:59.449854+0000","last_active":"2024-05-07T14:05:18.961340+0000","last_peered":"2024-05-07T14:05:18.961340+0000","last_clean":"2024-05-07T14:05:18.961340+0000","last_became_active":"2024-05-07T14:04:59.448913+0000","last_became_peered":"2024-05-07T14:04:59.448913+0000","last_unstale":"2024-05-07T14:05:18.961340+0000","last_undegraded":"2024-05-07T14:05:18.961340+0000","last_fullsized":"2024-05-07T14:05:18.961340+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:39.717523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"124'29","reported_seq":286,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960737+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:05:18.960737+0000","last_peered":"2024-05-07T14:05:18.960737+0000","last_clean":"2024-05-07T14:05:18.960737+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:05:18.960737+0000","last_undegraded":"2024-05-07T14:05:18.960737+0000","last_fullsized":"2024-05-07T14:05:18.960737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119537664,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"87'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958982+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:05:18.958982+0000","last_peered":"2024-05-07T14:05:18.958982+0000","last_clean":"2024-05-07T14:05:18.958982+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:05:18.958982+0000","last_undegraded":"2024-05-07T14:05:18.958982+0000","last_fullsized":"2024-05-07T14:05:18.958982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"123'23","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961924+0000","last_change":"2024-05-07T14:05:02.233669+0000","last_active":"2024-05-07T14:05:18.961924+0000","last_peered":"2024-05-07T14:05:18.961924+0000","last_clean":"2024-05-07T14:05:18.961924+0000","last_became_active":"2024-05-07T14:04:59.459490+0000","last_became_peered":"2024-05-07T14:04:59.459490+0000","last_unstale":"2024-05-07T14:05:18.961924+0000","last_undegraded":"2024-05-07T14:05:18.961924+0000","last_fullsized":"2024-05-07T14:05:18.961924+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:24.042272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"81'6","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959954+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:05:18.959954+0000","last_peered":"2024-05-07T14:05:18.959954+0000","last_clean":"2024-05-07T14:05:18.959954+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:05:18.959954+0000","last_undegraded":"2024-05-07T14:05:18.959954+0000","last_fullsized":"2024-05-07T14:05:18.959954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"124'26","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630545+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:05:18.630545+0000","last_peered":"2024-05-07T14:05:18.630545+0000","last_clean":"2024-05-07T14:05:18.630545+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:05:18.630545+0000","last_undegraded":"2024-05-07T14:05:18.630545+0000","last_fullsized":"2024-05-07T14:05:18.630545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"124'6","reported_seq":199,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960492+0000","last_change":"2024-05-07T14:05:00.223495+0000","last_active":"2024-05-07T14:05:18.960492+0000","last_peered":"2024-05-07T14:05:18.960492+0000","last_clean":"2024-05-07T14:05:18.960492+0000","last_became_active":"2024-05-07T14:04:59.442569+0000","last_became_peered":"2024-05-07T14:04:59.442569+0000","last_unstale":"2024-05-07T14:05:18.960492+0000","last_undegraded":"2024-05-07T14:05:18.960492+0000","last_fullsized":"2024-05-07T14:05:18.960492+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:10.158704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"124'26","reported_seq":300,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722687+0000","last_change":"2024-05-07T14:05:01.256475+0000","last_active":"2024-05-07T14:05:18.722687+0000","last_peered":"2024-05-07T14:05:18.722687+0000","last_clean":"2024-05-07T14:05:18.722687+0000","last_became_active":"2024-05-07T14:04:59.461335+0000","last_became_peered":"2024-05-07T14:04:59.461335+0000","last_unstale":"2024-05-07T14:05:18.722687+0000","last_undegraded":"2024-05-07T14:05:18.722687+0000","last_fullsized":"2024-05-07T14:05:18.722687+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:34.213014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"124'24","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720700+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:05:18.720700+0000","last_peered":"2024-05-07T14:05:18.720700+0000","last_clean":"2024-05-07T14:05:18.720700+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:05:18.720700+0000","last_undegraded":"2024-05-07T14:05:18.720700+0000","last_fullsized":"2024-05-07T14:05:18.720700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"124'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959984+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:05:18.959984+0000","last_peered":"2024-05-07T14:05:18.959984+0000","last_clean":"2024-05-07T14:05:18.959984+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:05:18.959984+0000","last_undegraded":"2024-05-07T14:05:18.959984+0000","last_fullsized":"2024-05-07T14:05:18.959984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"124'21","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963118+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:05:18.963118+0000","last_peered":"2024-05-07T14:05:18.963118+0000","last_clean":"2024-05-07T14:05:18.963118+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:05:18.963118+0000","last_undegraded":"2024-05-07T14:05:18.963118+0000","last_fullsized":"2024-05-07T14:05:18.963118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"106'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722115+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:05:18.722115+0000","last_peered":"2024-05-07T14:05:18.722115+0000","last_clean":"2024-05-07T14:05:18.722115+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:05:18.722115+0000","last_undegraded":"2024-05-07T14:05:18.722115+0000","last_fullsized":"2024-05-07T14:05:18.722115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":313,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1094,"ondisk_log_size":1094,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382934,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":846,"num_read_kb":608,"num_write":467,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":121255,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":763,"ondisk_log_size":763,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":341,"num_read_kb":341,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1436,"num_read_kb":1404,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":620756992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":129,"seq":554050781192,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1805596,"kb_used_data":1769364,"kb_used_omap":6,"kb_used_meta":36217,"kb_avail":92566244,"statfs":{"total":96636764160,"available":94787833856,"internally_reserved":0,"allocated":1811828736,"data_stored":1811073810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6345,"internal_metadata":37087031},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1266508,"kb_used_data":1235332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93105332,"statfs":{"total":96636764160,"available":95339859968,"internally_reserved":0,"allocated":1264979968,"data_stored":1264248696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1941880,"kb_used_data":1906544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92429960,"statfs":{"total":96636764160,"available":94648279040,"internally_reserved":0,"allocated":1952301056,"data_stored":1951526125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1749148,"kb_used_data":1717960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92622692,"statfs":{"total":96636764160,"available":94845636608,"internally_reserved":0,"allocated":1759191040,"data_stored":1758470596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1917804,"kb_used_data":1882468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92454036,"statfs":{"total":96636764160,"available":94672932864,"internally_reserved":0,"allocated":1927647232,"data_stored":1926891074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1015952,"kb_used_data":984776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93355888,"statfs":{"total":96636764160,"available":95596429312,"internally_reserved":0,"allocated":1008410624,"data_stored":1007689142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1192296,"kb_used_data":1156960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93179544,"statfs":{"total":96636764160,"available":95415853056,"internally_reserved":0,"allocated":1184727040,"data_stored":1183969856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1698080,"kb_used_data":1666900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92673760,"statfs":{"total":96636764160,"available":94897930240,"internally_reserved":0,"allocated":1706905600,"data_stored":1706157621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1704984576,"data_stored":1704984576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1182793728,"data_stored":1182793728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1006632960,"data_stored":1006632960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1925185536,"data_stored":1925185536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1757413376,"data_stored":1757413376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1950351360,"data_stored":1950351360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1262485504,"data_stored":1262485504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1809842176,"data_stored":1809842176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":117239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":119338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":119222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":117465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":176275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:05:32.016 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:05:32.400 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:05:32.407 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:05:32.423 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-05-07T14:05:31.328855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819926,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3104,"num_read_kb":2790,"num_write":2847,"num_write_kb":6187914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":621470484,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3918,"ondisk_log_size":3918,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12587264,"kb_used_data":12320304,"kb_used_omap":17,"kb_used_meta":266862,"kb_avail":742387456,"statfs":{"total":773094113280,"available":760204754944,"internally_reserved":0,"allocated":12615991296,"data_stored":12610026920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17505,"internal_metadata":273267615},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005951"},"pg_stats":[{"pgid":"3.3f","version":"124'29","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963765+0000","last_change":"2024-05-07T14:05:02.012333+0000","last_active":"2024-05-07T14:05:18.963765+0000","last_peered":"2024-05-07T14:05:18.963765+0000","last_clean":"2024-05-07T14:05:18.963765+0000","last_became_active":"2024-05-07T14:04:59.458324+0000","last_became_peered":"2024-05-07T14:04:59.458324+0000","last_unstale":"2024-05-07T14:05:18.963765+0000","last_undegraded":"2024-05-07T14:05:18.963765+0000","last_fullsized":"2024-05-07T14:05:18.963765+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:58:18.777392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719899+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:05:18.719899+0000","last_peered":"2024-05-07T14:05:18.719899+0000","last_clean":"2024-05-07T14:05:18.719899+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:05:18.719899+0000","last_undegraded":"2024-05-07T14:05:18.719899+0000","last_fullsized":"2024-05-07T14:05:18.719899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"124'29","reported_seq":133,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959961+0000","last_change":"2024-05-07T14:03:39.850495+0000","last_active":"2024-05-07T14:05:18.959961+0000","last_peered":"2024-05-07T14:05:18.959961+0000","last_clean":"2024-05-07T14:05:18.959961+0000","last_became_active":"2024-05-07T14:03:39.676092+0000","last_became_peered":"2024-05-07T14:03:39.676092+0000","last_unstale":"2024-05-07T14:05:18.959961+0000","last_undegraded":"2024-05-07T14:05:18.959961+0000","last_fullsized":"2024-05-07T14:05:18.959961+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:00.668304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"80'2","reported_seq":172,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963019+0000","last_change":"2024-05-07T14:04:59.442787+0000","last_active":"2024-05-07T14:05:18.963019+0000","last_peered":"2024-05-07T14:05:18.963019+0000","last_clean":"2024-05-07T14:05:18.963019+0000","last_became_active":"2024-05-07T14:04:59.430479+0000","last_became_peered":"2024-05-07T14:04:59.430479+0000","last_unstale":"2024-05-07T14:05:18.963019+0000","last_undegraded":"2024-05-07T14:05:18.963019+0000","last_fullsized":"2024-05-07T14:05:18.963019+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:27.875022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"124'20","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959370+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:05:18.959370+0000","last_peered":"2024-05-07T14:05:18.959370+0000","last_clean":"2024-05-07T14:05:18.959370+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:05:18.959370+0000","last_undegraded":"2024-05-07T14:05:18.959370+0000","last_fullsized":"2024-05-07T14:05:18.959370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629168+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:05:18.629168+0000","last_peered":"2024-05-07T14:05:18.629168+0000","last_clean":"2024-05-07T14:05:18.629168+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:05:18.629168+0000","last_undegraded":"2024-05-07T14:05:18.629168+0000","last_fullsized":"2024-05-07T14:05:18.629168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"124'25","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721240+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:05:18.721240+0000","last_peered":"2024-05-07T14:05:18.721240+0000","last_clean":"2024-05-07T14:05:18.721240+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:05:18.721240+0000","last_undegraded":"2024-05-07T14:05:18.721240+0000","last_fullsized":"2024-05-07T14:05:18.721240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"81'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960256+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:05:18.960256+0000","last_peered":"2024-05-07T14:05:18.960256+0000","last_clean":"2024-05-07T14:05:18.960256+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:05:18.960256+0000","last_undegraded":"2024-05-07T14:05:18.960256+0000","last_fullsized":"2024-05-07T14:05:18.960256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"124'24","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961071+0000","last_change":"2024-05-07T14:05:01.033639+0000","last_active":"2024-05-07T14:05:18.961071+0000","last_peered":"2024-05-07T14:05:18.961071+0000","last_clean":"2024-05-07T14:05:18.961071+0000","last_became_active":"2024-05-07T14:04:59.455288+0000","last_became_peered":"2024-05-07T14:04:59.455288+0000","last_unstale":"2024-05-07T14:05:18.961071+0000","last_undegraded":"2024-05-07T14:05:18.961071+0000","last_fullsized":"2024-05-07T14:05:18.961071+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:06:05.572323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"115'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960336+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:05:18.960336+0000","last_peered":"2024-05-07T14:05:18.960336+0000","last_clean":"2024-05-07T14:05:18.960336+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:05:18.960336+0000","last_undegraded":"2024-05-07T14:05:18.960336+0000","last_fullsized":"2024-05-07T14:05:18.960336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"124'19","reported_seq":275,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720428+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:05:18.720428+0000","last_peered":"2024-05-07T14:05:18.720428+0000","last_clean":"2024-05-07T14:05:18.720428+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:05:18.720428+0000","last_undegraded":"2024-05-07T14:05:18.720428+0000","last_fullsized":"2024-05-07T14:05:18.720428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"115'4","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630099+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:05:18.630099+0000","last_peered":"2024-05-07T14:05:18.630099+0000","last_clean":"2024-05-07T14:05:18.630099+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:05:18.630099+0000","last_undegraded":"2024-05-07T14:05:18.630099+0000","last_fullsized":"2024-05-07T14:05:18.630099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"124'25","reported_seq":274,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962077+0000","last_change":"2024-05-07T14:05:00.220571+0000","last_active":"2024-05-07T14:05:18.962077+0000","last_peered":"2024-05-07T14:05:18.962077+0000","last_clean":"2024-05-07T14:05:18.962077+0000","last_became_active":"2024-05-07T14:04:59.444214+0000","last_became_peered":"2024-05-07T14:04:59.444214+0000","last_unstale":"2024-05-07T14:05:18.962077+0000","last_undegraded":"2024-05-07T14:05:18.962077+0000","last_fullsized":"2024-05-07T14:05:18.962077+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:18:23.503893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"81'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721808+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:05:18.721808+0000","last_peered":"2024-05-07T14:05:18.721808+0000","last_clean":"2024-05-07T14:05:18.721808+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:05:18.721808+0000","last_undegraded":"2024-05-07T14:05:18.721808+0000","last_fullsized":"2024-05-07T14:05:18.721808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"124'23","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959282+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:05:18.959282+0000","last_peered":"2024-05-07T14:05:18.959282+0000","last_clean":"2024-05-07T14:05:18.959282+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:05:18.959282+0000","last_undegraded":"2024-05-07T14:05:18.959282+0000","last_fullsized":"2024-05-07T14:05:18.959282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"124'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630377+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:05:18.630377+0000","last_peered":"2024-05-07T14:05:18.630377+0000","last_clean":"2024-05-07T14:05:18.630377+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:05:18.630377+0000","last_undegraded":"2024-05-07T14:05:18.630377+0000","last_fullsized":"2024-05-07T14:05:18.630377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628673+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:05:18.628673+0000","last_peered":"2024-05-07T14:05:18.628673+0000","last_clean":"2024-05-07T14:05:18.628673+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:05:18.628673+0000","last_undegraded":"2024-05-07T14:05:18.628673+0000","last_fullsized":"2024-05-07T14:05:18.628673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"124'23","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961950+0000","last_change":"2024-05-07T14:05:01.245123+0000","last_active":"2024-05-07T14:05:18.961950+0000","last_peered":"2024-05-07T14:05:18.961950+0000","last_clean":"2024-05-07T14:05:18.961950+0000","last_became_active":"2024-05-07T14:04:59.452315+0000","last_became_peered":"2024-05-07T14:04:59.452315+0000","last_unstale":"2024-05-07T14:05:18.961950+0000","last_undegraded":"2024-05-07T14:05:18.961950+0000","last_fullsized":"2024-05-07T14:05:18.961950+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:20:40.045208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962499+0000","last_change":"2024-05-07T14:04:59.435447+0000","last_active":"2024-05-07T14:05:18.962499+0000","last_peered":"2024-05-07T14:05:18.962499+0000","last_clean":"2024-05-07T14:05:18.962499+0000","last_became_active":"2024-05-07T14:04:59.429254+0000","last_became_peered":"2024-05-07T14:04:59.429254+0000","last_unstale":"2024-05-07T14:05:18.962499+0000","last_undegraded":"2024-05-07T14:05:18.962499+0000","last_fullsized":"2024-05-07T14:05:18.962499+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:42:46.014749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"124'23","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961038+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:05:18.961038+0000","last_peered":"2024-05-07T14:05:18.961038+0000","last_clean":"2024-05-07T14:05:18.961038+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:05:18.961038+0000","last_undegraded":"2024-05-07T14:05:18.961038+0000","last_fullsized":"2024-05-07T14:05:18.961038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":252,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720762+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:05:18.720762+0000","last_peered":"2024-05-07T14:05:18.720762+0000","last_clean":"2024-05-07T14:05:18.720762+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:05:18.720762+0000","last_undegraded":"2024-05-07T14:05:18.720762+0000","last_fullsized":"2024-05-07T14:05:18.720762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"124'31","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963739+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:05:18.963739+0000","last_peered":"2024-05-07T14:05:18.963739+0000","last_clean":"2024-05-07T14:05:18.963739+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:05:18.963739+0000","last_undegraded":"2024-05-07T14:05:18.963739+0000","last_fullsized":"2024-05-07T14:05:18.963739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"124'10","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629192+0000","last_change":"2024-05-07T14:01:37.318563+0000","last_active":"2024-05-07T14:05:18.629192+0000","last_peered":"2024-05-07T14:05:18.629192+0000","last_clean":"2024-05-07T14:05:18.629192+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:05:18.629192+0000","last_undegraded":"2024-05-07T14:05:18.629192+0000","last_fullsized":"2024-05-07T14:05:18.629192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:27.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629565+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:05:18.629565+0000","last_peered":"2024-05-07T14:05:18.629565+0000","last_clean":"2024-05-07T14:05:18.629565+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:05:18.629565+0000","last_undegraded":"2024-05-07T14:05:18.629565+0000","last_fullsized":"2024-05-07T14:05:18.629565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"106'8","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629560+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:05:18.629560+0000","last_peered":"2024-05-07T14:05:18.629560+0000","last_clean":"2024-05-07T14:05:18.629560+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:05:18.629560+0000","last_undegraded":"2024-05-07T14:05:18.629560+0000","last_fullsized":"2024-05-07T14:05:18.629560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"124'32","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964588+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:05:18.964588+0000","last_peered":"2024-05-07T14:05:18.964588+0000","last_clean":"2024-05-07T14:05:18.964588+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:05:18.964588+0000","last_undegraded":"2024-05-07T14:05:18.964588+0000","last_fullsized":"2024-05-07T14:05:18.964588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"106'2","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630109+0000","last_change":"2024-05-07T14:03:39.848413+0000","last_active":"2024-05-07T14:05:18.630109+0000","last_peered":"2024-05-07T14:05:18.630109+0000","last_clean":"2024-05-07T14:05:18.630109+0000","last_became_active":"2024-05-07T14:03:39.663590+0000","last_became_peered":"2024-05-07T14:03:39.663590+0000","last_unstale":"2024-05-07T14:05:18.630109+0000","last_undegraded":"2024-05-07T14:05:18.630109+0000","last_fullsized":"2024-05-07T14:05:18.630109+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:02.675624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"124'19","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959332+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:05:18.959332+0000","last_peered":"2024-05-07T14:05:18.959332+0000","last_clean":"2024-05-07T14:05:18.959332+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:05:18.959332+0000","last_undegraded":"2024-05-07T14:05:18.959332+0000","last_fullsized":"2024-05-07T14:05:18.959332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628129+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:05:18.628129+0000","last_peered":"2024-05-07T14:05:18.628129+0000","last_clean":"2024-05-07T14:05:18.628129+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:05:18.628129+0000","last_undegraded":"2024-05-07T14:05:18.628129+0000","last_fullsized":"2024-05-07T14:05:18.628129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"81'2","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963957+0000","last_change":"2024-05-07T14:03:39.857355+0000","last_active":"2024-05-07T14:05:18.963957+0000","last_peered":"2024-05-07T14:05:18.963957+0000","last_clean":"2024-05-07T14:05:18.963957+0000","last_became_active":"2024-05-07T14:03:39.680721+0000","last_became_peered":"2024-05-07T14:03:39.680721+0000","last_unstale":"2024-05-07T14:05:18.963957+0000","last_undegraded":"2024-05-07T14:05:18.963957+0000","last_fullsized":"2024-05-07T14:05:18.963957+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:36.092563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"124'19","reported_seq":224,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629050+0000","last_change":"2024-05-07T14:01:37.311718+0000","last_active":"2024-05-07T14:05:18.629050+0000","last_peered":"2024-05-07T14:05:18.629050+0000","last_clean":"2024-05-07T14:05:18.629050+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:05:18.629050+0000","last_undegraded":"2024-05-07T14:05:18.629050+0000","last_fullsized":"2024-05-07T14:05:18.629050+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:24.211300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721497+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:05:18.721497+0000","last_peered":"2024-05-07T14:05:18.721497+0000","last_clean":"2024-05-07T14:05:18.721497+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:05:18.721497+0000","last_undegraded":"2024-05-07T14:05:18.721497+0000","last_fullsized":"2024-05-07T14:05:18.721497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"124'17","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961100+0000","last_change":"2024-05-07T14:04:59.457299+0000","last_active":"2024-05-07T14:05:18.961100+0000","last_peered":"2024-05-07T14:05:18.961100+0000","last_clean":"2024-05-07T14:05:18.961100+0000","last_became_active":"2024-05-07T14:04:59.455429+0000","last_became_peered":"2024-05-07T14:04:59.455429+0000","last_unstale":"2024-05-07T14:05:18.961100+0000","last_undegraded":"2024-05-07T14:05:18.961100+0000","last_fullsized":"2024-05-07T14:05:18.961100+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:29.054055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964269+0000","last_change":"2024-05-07T14:04:59.462184+0000","last_active":"2024-05-07T14:05:18.964269+0000","last_peered":"2024-05-07T14:05:18.964269+0000","last_clean":"2024-05-07T14:05:18.964269+0000","last_became_active":"2024-05-07T14:04:59.456374+0000","last_became_peered":"2024-05-07T14:04:59.456374+0000","last_unstale":"2024-05-07T14:05:18.964269+0000","last_undegraded":"2024-05-07T14:05:18.964269+0000","last_fullsized":"2024-05-07T14:05:18.964269+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:06.581660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"124'50","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719930+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:05:18.719930+0000","last_peered":"2024-05-07T14:05:18.719930+0000","last_clean":"2024-05-07T14:05:18.719930+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:05:18.719930+0000","last_undegraded":"2024-05-07T14:05:18.719930+0000","last_fullsized":"2024-05-07T14:05:18.719930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"81'6","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722091+0000","last_change":"2024-05-07T14:04:59.467076+0000","last_active":"2024-05-07T14:05:18.722091+0000","last_peered":"2024-05-07T14:05:18.722091+0000","last_clean":"2024-05-07T14:05:18.722091+0000","last_became_active":"2024-05-07T14:04:59.466480+0000","last_became_peered":"2024-05-07T14:04:59.466480+0000","last_unstale":"2024-05-07T14:05:18.722091+0000","last_undegraded":"2024-05-07T14:05:18.722091+0000","last_fullsized":"2024-05-07T14:05:18.722091+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:02.334693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"124'20","reported_seq":301,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959429+0000","last_change":"2024-05-07T14:05:00.106363+0000","last_active":"2024-05-07T14:05:18.959429+0000","last_peered":"2024-05-07T14:05:18.959429+0000","last_clean":"2024-05-07T14:05:18.959429+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:18.959429+0000","last_undegraded":"2024-05-07T14:05:18.959429+0000","last_fullsized":"2024-05-07T14:05:18.959429+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:03.250892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81788928,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964245+0000","last_change":"2024-05-07T14:04:59.446944+0000","last_active":"2024-05-07T14:05:18.964245+0000","last_peered":"2024-05-07T14:05:18.964245+0000","last_clean":"2024-05-07T14:05:18.964245+0000","last_became_active":"2024-05-07T14:04:59.445994+0000","last_became_peered":"2024-05-07T14:04:59.445994+0000","last_unstale":"2024-05-07T14:05:18.964245+0000","last_undegraded":"2024-05-07T14:05:18.964245+0000","last_fullsized":"2024-05-07T14:05:18.964245+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:08.275415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"81'7","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630813+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:05:18.630813+0000","last_peered":"2024-05-07T14:05:18.630813+0000","last_clean":"2024-05-07T14:05:18.630813+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:05:18.630813+0000","last_undegraded":"2024-05-07T14:05:18.630813+0000","last_fullsized":"2024-05-07T14:05:18.630813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629526+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:05:18.629526+0000","last_peered":"2024-05-07T14:05:18.629526+0000","last_clean":"2024-05-07T14:05:18.629526+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:05:18.629526+0000","last_undegraded":"2024-05-07T14:05:18.629526+0000","last_fullsized":"2024-05-07T14:05:18.629526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"115'8","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959036+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:05:18.959036+0000","last_peered":"2024-05-07T14:05:18.959036+0000","last_clean":"2024-05-07T14:05:18.959036+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:05:18.959036+0000","last_undegraded":"2024-05-07T14:05:18.959036+0000","last_fullsized":"2024-05-07T14:05:18.959036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"81'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962932+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:05:18.962932+0000","last_peered":"2024-05-07T14:05:18.962932+0000","last_clean":"2024-05-07T14:05:18.962932+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:05:18.962932+0000","last_undegraded":"2024-05-07T14:05:18.962932+0000","last_fullsized":"2024-05-07T14:05:18.962932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"124'16","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961915+0000","last_change":"2024-05-07T14:04:59.911990+0000","last_active":"2024-05-07T14:05:18.961915+0000","last_peered":"2024-05-07T14:05:18.961915+0000","last_clean":"2024-05-07T14:05:18.961915+0000","last_became_active":"2024-05-07T14:04:59.436710+0000","last_became_peered":"2024-05-07T14:04:59.436710+0000","last_unstale":"2024-05-07T14:05:18.961915+0000","last_undegraded":"2024-05-07T14:05:18.961915+0000","last_fullsized":"2024-05-07T14:05:18.961915+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:27:02.713493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964441+0000","last_change":"2024-05-07T14:03:39.680812+0000","last_active":"2024-05-07T14:05:18.964441+0000","last_peered":"2024-05-07T14:05:18.964441+0000","last_clean":"2024-05-07T14:05:18.964441+0000","last_became_active":"2024-05-07T14:03:39.680482+0000","last_became_peered":"2024-05-07T14:03:39.680482+0000","last_unstale":"2024-05-07T14:05:18.964441+0000","last_undegraded":"2024-05-07T14:05:18.964441+0000","last_fullsized":"2024-05-07T14:05:18.964441+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:07.705255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"81'13","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629238+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:05:18.629238+0000","last_peered":"2024-05-07T14:05:18.629238+0000","last_clean":"2024-05-07T14:05:18.629238+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:05:18.629238+0000","last_undegraded":"2024-05-07T14:05:18.629238+0000","last_fullsized":"2024-05-07T14:05:18.629238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"146'141","reported_seq":413,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.273181+0000","last_change":"2024-05-07T14:05:02.234601+0000","last_active":"2024-05-07T14:05:20.273181+0000","last_peered":"2024-05-07T14:05:20.273181+0000","last_clean":"2024-05-07T14:05:20.273181+0000","last_became_active":"2024-05-07T14:04:59.463533+0000","last_became_peered":"2024-05-07T14:04:59.463533+0000","last_unstale":"2024-05-07T14:05:20.273181+0000","last_undegraded":"2024-05-07T14:05:20.273181+0000","last_fullsized":"2024-05-07T14:05:20.273181+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:50:50.067203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628944+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:05:18.628944+0000","last_peered":"2024-05-07T14:05:18.628944+0000","last_clean":"2024-05-07T14:05:18.628944+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:05:18.628944+0000","last_undegraded":"2024-05-07T14:05:18.628944+0000","last_fullsized":"2024-05-07T14:05:18.628944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"87'16","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963783+0000","last_change":"2024-05-07T14:04:59.462968+0000","last_active":"2024-05-07T14:05:18.963783+0000","last_peered":"2024-05-07T14:05:18.963783+0000","last_clean":"2024-05-07T14:05:18.963783+0000","last_became_active":"2024-05-07T14:04:59.461575+0000","last_became_peered":"2024-05-07T14:04:59.461575+0000","last_unstale":"2024-05-07T14:05:18.963783+0000","last_undegraded":"2024-05-07T14:05:18.963783+0000","last_fullsized":"2024-05-07T14:05:18.963783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:36.220334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"123'26","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959411+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:05:18.959411+0000","last_peered":"2024-05-07T14:05:18.959411+0000","last_clean":"2024-05-07T14:05:18.959411+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:05:18.959411+0000","last_undegraded":"2024-05-07T14:05:18.959411+0000","last_fullsized":"2024-05-07T14:05:18.959411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721681+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:05:18.721681+0000","last_peered":"2024-05-07T14:05:18.721681+0000","last_clean":"2024-05-07T14:05:18.721681+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:05:18.721681+0000","last_undegraded":"2024-05-07T14:05:18.721681+0000","last_fullsized":"2024-05-07T14:05:18.721681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"124'17","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962423+0000","last_change":"2024-05-07T14:04:59.462754+0000","last_active":"2024-05-07T14:05:18.962423+0000","last_peered":"2024-05-07T14:05:18.962423+0000","last_clean":"2024-05-07T14:05:18.962423+0000","last_became_active":"2024-05-07T14:04:59.459905+0000","last_became_peered":"2024-05-07T14:04:59.459905+0000","last_unstale":"2024-05-07T14:05:18.962423+0000","last_undegraded":"2024-05-07T14:05:18.962423+0000","last_fullsized":"2024-05-07T14:05:18.962423+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:02:35.111917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"146'135","reported_seq":428,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272020+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:05:20.272020+0000","last_peered":"2024-05-07T14:05:20.272020+0000","last_clean":"2024-05-07T14:05:20.272020+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:05:20.272020+0000","last_undegraded":"2024-05-07T14:05:20.272020+0000","last_fullsized":"2024-05-07T14:05:20.272020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"81'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720435+0000","last_change":"2024-05-07T14:04:59.447718+0000","last_active":"2024-05-07T14:05:18.720435+0000","last_peered":"2024-05-07T14:05:18.720435+0000","last_clean":"2024-05-07T14:05:18.720435+0000","last_became_active":"2024-05-07T14:04:59.446891+0000","last_became_peered":"2024-05-07T14:04:59.446891+0000","last_unstale":"2024-05-07T14:05:18.720435+0000","last_undegraded":"2024-05-07T14:05:18.720435+0000","last_fullsized":"2024-05-07T14:05:18.720435+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:42.667572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"124'33","reported_seq":286,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964093+0000","last_change":"2024-05-07T14:05:01.651799+0000","last_active":"2024-05-07T14:05:18.964093+0000","last_peered":"2024-05-07T14:05:18.964093+0000","last_clean":"2024-05-07T14:05:18.964093+0000","last_became_active":"2024-05-07T14:04:59.452426+0000","last_became_peered":"2024-05-07T14:04:59.452426+0000","last_unstale":"2024-05-07T14:05:18.964093+0000","last_undegraded":"2024-05-07T14:05:18.964093+0000","last_fullsized":"2024-05-07T14:05:18.964093+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:49.540606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963448+0000","last_change":"2024-05-07T14:04:59.445984+0000","last_active":"2024-05-07T14:05:18.963448+0000","last_peered":"2024-05-07T14:05:18.963448+0000","last_clean":"2024-05-07T14:05:18.963448+0000","last_became_active":"2024-05-07T14:04:59.445281+0000","last_became_peered":"2024-05-07T14:04:59.445281+0000","last_unstale":"2024-05-07T14:05:18.963448+0000","last_undegraded":"2024-05-07T14:05:18.963448+0000","last_fullsized":"2024-05-07T14:05:18.963448+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:59:14.548669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"124'28","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720191+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:05:18.720191+0000","last_peered":"2024-05-07T14:05:18.720191+0000","last_clean":"2024-05-07T14:05:18.720191+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:05:18.720191+0000","last_undegraded":"2024-05-07T14:05:18.720191+0000","last_fullsized":"2024-05-07T14:05:18.720191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960274+0000","last_change":"2024-05-07T14:03:39.666526+0000","last_active":"2024-05-07T14:05:18.960274+0000","last_peered":"2024-05-07T14:05:18.960274+0000","last_clean":"2024-05-07T14:05:18.960274+0000","last_became_active":"2024-05-07T14:03:39.666160+0000","last_became_peered":"2024-05-07T14:03:39.666160+0000","last_unstale":"2024-05-07T14:05:18.960274+0000","last_undegraded":"2024-05-07T14:05:18.960274+0000","last_fullsized":"2024-05-07T14:05:18.960274+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:44.560061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720476+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:05:18.720476+0000","last_peered":"2024-05-07T14:05:18.720476+0000","last_clean":"2024-05-07T14:05:18.720476+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:05:18.720476+0000","last_undegraded":"2024-05-07T14:05:18.720476+0000","last_fullsized":"2024-05-07T14:05:18.720476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630857+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:05:18.630857+0000","last_peered":"2024-05-07T14:05:18.630857+0000","last_clean":"2024-05-07T14:05:18.630857+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:05:18.630857+0000","last_undegraded":"2024-05-07T14:05:18.630857+0000","last_fullsized":"2024-05-07T14:05:18.630857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"124'27","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962532+0000","last_change":"2024-05-07T14:04:59.801081+0000","last_active":"2024-05-07T14:05:18.962532+0000","last_peered":"2024-05-07T14:05:18.962532+0000","last_clean":"2024-05-07T14:05:18.962532+0000","last_became_active":"2024-05-07T14:04:59.421863+0000","last_became_peered":"2024-05-07T14:04:59.421863+0000","last_unstale":"2024-05-07T14:05:18.962532+0000","last_undegraded":"2024-05-07T14:05:18.962532+0000","last_fullsized":"2024-05-07T14:05:18.962532+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:48.094723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":338,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628182+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:05:18.628182+0000","last_peered":"2024-05-07T14:05:18.628182+0000","last_clean":"2024-05-07T14:05:18.628182+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:05:18.628182+0000","last_undegraded":"2024-05-07T14:05:18.628182+0000","last_fullsized":"2024-05-07T14:05:18.628182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"124'17","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965471+0000","last_change":"2024-05-07T14:04:59.447540+0000","last_active":"2024-05-07T14:05:18.965471+0000","last_peered":"2024-05-07T14:05:18.965471+0000","last_clean":"2024-05-07T14:05:18.965471+0000","last_became_active":"2024-05-07T14:04:59.446737+0000","last_became_peered":"2024-05-07T14:04:59.446737+0000","last_unstale":"2024-05-07T14:05:18.965471+0000","last_undegraded":"2024-05-07T14:05:18.965471+0000","last_fullsized":"2024-05-07T14:05:18.965471+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.352935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964757+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:05:18.964757+0000","last_peered":"2024-05-07T14:05:18.964757+0000","last_clean":"2024-05-07T14:05:18.964757+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:05:18.964757+0000","last_undegraded":"2024-05-07T14:05:18.964757+0000","last_fullsized":"2024-05-07T14:05:18.964757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"115'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962438+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:05:18.962438+0000","last_peered":"2024-05-07T14:05:18.962438+0000","last_clean":"2024-05-07T14:05:18.962438+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:05:18.962438+0000","last_undegraded":"2024-05-07T14:05:18.962438+0000","last_fullsized":"2024-05-07T14:05:18.962438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"81'6","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959923+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:05:18.959923+0000","last_peered":"2024-05-07T14:05:18.959923+0000","last_clean":"2024-05-07T14:05:18.959923+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:05:18.959923+0000","last_undegraded":"2024-05-07T14:05:18.959923+0000","last_fullsized":"2024-05-07T14:05:18.959923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"124'29","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961785+0000","last_change":"2024-05-07T14:05:00.740552+0000","last_active":"2024-05-07T14:05:18.961785+0000","last_peered":"2024-05-07T14:05:18.961785+0000","last_clean":"2024-05-07T14:05:18.961785+0000","last_became_active":"2024-05-07T14:04:59.449454+0000","last_became_peered":"2024-05-07T14:04:59.449454+0000","last_unstale":"2024-05-07T14:05:18.961785+0000","last_undegraded":"2024-05-07T14:05:18.961785+0000","last_fullsized":"2024-05-07T14:05:18.961785+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:28:19.138204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629731+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:05:18.629731+0000","last_peered":"2024-05-07T14:05:18.629731+0000","last_clean":"2024-05-07T14:05:18.629731+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:05:18.629731+0000","last_undegraded":"2024-05-07T14:05:18.629731+0000","last_fullsized":"2024-05-07T14:05:18.629731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"124'23","reported_seq":258,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961377+0000","last_change":"2024-05-07T14:04:59.459984+0000","last_active":"2024-05-07T14:05:18.961377+0000","last_peered":"2024-05-07T14:05:18.961377+0000","last_clean":"2024-05-07T14:05:18.961377+0000","last_became_active":"2024-05-07T14:04:59.458512+0000","last_became_peered":"2024-05-07T14:04:59.458512+0000","last_unstale":"2024-05-07T14:05:18.961377+0000","last_undegraded":"2024-05-07T14:05:18.961377+0000","last_fullsized":"2024-05-07T14:05:18.961377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:11:09.127149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"146'139","reported_seq":453,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:24.296925+0000","last_change":"2024-05-07T14:03:42.700808+0000","last_active":"2024-05-07T14:05:24.296925+0000","last_peered":"2024-05-07T14:05:24.296925+0000","last_clean":"2024-05-07T14:05:24.296925+0000","last_became_active":"2024-05-07T14:03:42.700324+0000","last_became_peered":"2024-05-07T14:03:42.700324+0000","last_unstale":"2024-05-07T14:05:24.296925+0000","last_undegraded":"2024-05-07T14:05:24.296925+0000","last_fullsized":"2024-05-07T14:05:24.296925+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:47.369543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961454+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:05:18.961454+0000","last_peered":"2024-05-07T14:05:18.961454+0000","last_clean":"2024-05-07T14:05:18.961454+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:05:18.961454+0000","last_undegraded":"2024-05-07T14:05:18.961454+0000","last_fullsized":"2024-05-07T14:05:18.961454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"124'10","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960707+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:05:18.960707+0000","last_peered":"2024-05-07T14:05:18.960707+0000","last_clean":"2024-05-07T14:05:18.960707+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:05:18.960707+0000","last_undegraded":"2024-05-07T14:05:18.960707+0000","last_fullsized":"2024-05-07T14:05:18.960707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"124'36","reported_seq":293,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721736+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:05:18.721736+0000","last_peered":"2024-05-07T14:05:18.721736+0000","last_clean":"2024-05-07T14:05:18.721736+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:05:18.721736+0000","last_undegraded":"2024-05-07T14:05:18.721736+0000","last_fullsized":"2024-05-07T14:05:18.721736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629126+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:05:18.629126+0000","last_peered":"2024-05-07T14:05:18.629126+0000","last_clean":"2024-05-07T14:05:18.629126+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:05:18.629126+0000","last_undegraded":"2024-05-07T14:05:18.629126+0000","last_fullsized":"2024-05-07T14:05:18.629126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"124'29","reported_seq":294,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958596+0000","last_change":"2024-05-07T14:04:59.456274+0000","last_active":"2024-05-07T14:05:18.958596+0000","last_peered":"2024-05-07T14:05:18.958596+0000","last_clean":"2024-05-07T14:05:18.958596+0000","last_became_active":"2024-05-07T14:04:59.455284+0000","last_became_peered":"2024-05-07T14:04:59.455284+0000","last_unstale":"2024-05-07T14:05:18.958596+0000","last_undegraded":"2024-05-07T14:05:18.958596+0000","last_fullsized":"2024-05-07T14:05:18.958596+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:44:18.184158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.627987+0000","last_change":"2024-05-07T14:04:59.467425+0000","last_active":"2024-05-07T14:05:18.627987+0000","last_peered":"2024-05-07T14:05:18.627987+0000","last_clean":"2024-05-07T14:05:18.627987+0000","last_became_active":"2024-05-07T14:04:59.466731+0000","last_became_peered":"2024-05-07T14:04:59.466731+0000","last_unstale":"2024-05-07T14:05:18.627987+0000","last_undegraded":"2024-05-07T14:05:18.627987+0000","last_fullsized":"2024-05-07T14:05:18.627987+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:57.541122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"121'5","reported_seq":111,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960905+0000","last_change":"2024-05-07T14:03:39.802033+0000","last_active":"2024-05-07T14:05:18.960905+0000","last_peered":"2024-05-07T14:05:18.960905+0000","last_clean":"2024-05-07T14:05:18.960905+0000","last_became_active":"2024-05-07T14:03:39.675695+0000","last_became_peered":"2024-05-07T14:03:39.675695+0000","last_unstale":"2024-05-07T14:05:18.960905+0000","last_undegraded":"2024-05-07T14:05:18.960905+0000","last_fullsized":"2024-05-07T14:05:18.960905+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:22:02.594405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"87'2","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630116+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:05:18.630116+0000","last_peered":"2024-05-07T14:05:18.630116+0000","last_clean":"2024-05-07T14:05:18.630116+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:05:18.630116+0000","last_undegraded":"2024-05-07T14:05:18.630116+0000","last_fullsized":"2024-05-07T14:05:18.630116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"124'26","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963663+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:05:18.963663+0000","last_peered":"2024-05-07T14:05:18.963663+0000","last_clean":"2024-05-07T14:05:18.963663+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:05:18.963663+0000","last_undegraded":"2024-05-07T14:05:18.963663+0000","last_fullsized":"2024-05-07T14:05:18.963663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":254,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629414+0000","last_change":"2024-05-07T14:04:59.468095+0000","last_active":"2024-05-07T14:05:18.629414+0000","last_peered":"2024-05-07T14:05:18.629414+0000","last_clean":"2024-05-07T14:05:18.629414+0000","last_became_active":"2024-05-07T14:04:59.467463+0000","last_became_peered":"2024-05-07T14:04:59.467463+0000","last_unstale":"2024-05-07T14:05:18.629414+0000","last_undegraded":"2024-05-07T14:05:18.629414+0000","last_fullsized":"2024-05-07T14:05:18.629414+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:38.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"124'21","reported_seq":309,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629398+0000","last_change":"2024-05-07T14:03:39.698456+0000","last_active":"2024-05-07T14:05:18.629398+0000","last_peered":"2024-05-07T14:05:18.629398+0000","last_clean":"2024-05-07T14:05:18.629398+0000","last_became_active":"2024-05-07T14:03:39.663223+0000","last_became_peered":"2024-05-07T14:03:39.663223+0000","last_unstale":"2024-05-07T14:05:18.629398+0000","last_undegraded":"2024-05-07T14:05:18.629398+0000","last_fullsized":"2024-05-07T14:05:18.629398+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:58.582121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959866+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:05:18.959866+0000","last_peered":"2024-05-07T14:05:18.959866+0000","last_clean":"2024-05-07T14:05:18.959866+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:05:18.959866+0000","last_undegraded":"2024-05-07T14:05:18.959866+0000","last_fullsized":"2024-05-07T14:05:18.959866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"106'6","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959722+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:05:18.959722+0000","last_peered":"2024-05-07T14:05:18.959722+0000","last_clean":"2024-05-07T14:05:18.959722+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:05:18.959722+0000","last_undegraded":"2024-05-07T14:05:18.959722+0000","last_fullsized":"2024-05-07T14:05:18.959722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"106'12","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630558+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:05:18.630558+0000","last_peered":"2024-05-07T14:05:18.630558+0000","last_clean":"2024-05-07T14:05:18.630558+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:05:18.630558+0000","last_undegraded":"2024-05-07T14:05:18.630558+0000","last_fullsized":"2024-05-07T14:05:18.630558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"124'16","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960175+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:05:18.960175+0000","last_peered":"2024-05-07T14:05:18.960175+0000","last_clean":"2024-05-07T14:05:18.960175+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:05:18.960175+0000","last_undegraded":"2024-05-07T14:05:18.960175+0000","last_fullsized":"2024-05-07T14:05:18.960175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":124,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961556+0000","last_change":"2024-05-07T14:03:39.714297+0000","last_active":"2024-05-07T14:05:18.961556+0000","last_peered":"2024-05-07T14:05:18.961556+0000","last_clean":"2024-05-07T14:05:18.961556+0000","last_became_active":"2024-05-07T14:03:39.663013+0000","last_became_peered":"2024-05-07T14:03:39.663013+0000","last_unstale":"2024-05-07T14:05:18.961556+0000","last_undegraded":"2024-05-07T14:05:18.961556+0000","last_fullsized":"2024-05-07T14:05:18.961556+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:40:56.207747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"124'24","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629991+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:05:18.629991+0000","last_peered":"2024-05-07T14:05:18.629991+0000","last_clean":"2024-05-07T14:05:18.629991+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:05:18.629991+0000","last_undegraded":"2024-05-07T14:05:18.629991+0000","last_fullsized":"2024-05-07T14:05:18.629991+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"146'135","reported_seq":441,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272092+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:05:20.272092+0000","last_peered":"2024-05-07T14:05:20.272092+0000","last_clean":"2024-05-07T14:05:20.272092+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:05:20.272092+0000","last_undegraded":"2024-05-07T14:05:20.272092+0000","last_fullsized":"2024-05-07T14:05:20.272092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"87'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962770+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:05:18.962770+0000","last_peered":"2024-05-07T14:05:18.962770+0000","last_clean":"2024-05-07T14:05:18.962770+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:05:18.962770+0000","last_undegraded":"2024-05-07T14:05:18.962770+0000","last_fullsized":"2024-05-07T14:05:18.962770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"106'8","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630951+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:05:18.630951+0000","last_peered":"2024-05-07T14:05:18.630951+0000","last_clean":"2024-05-07T14:05:18.630951+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:05:18.630951+0000","last_undegraded":"2024-05-07T14:05:18.630951+0000","last_fullsized":"2024-05-07T14:05:18.630951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"124'20","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631050+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:05:18.631050+0000","last_peered":"2024-05-07T14:05:18.631050+0000","last_clean":"2024-05-07T14:05:18.631050+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:05:18.631050+0000","last_undegraded":"2024-05-07T14:05:18.631050+0000","last_fullsized":"2024-05-07T14:05:18.631050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":428,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721954+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:05:18.721954+0000","last_peered":"2024-05-07T14:05:18.721954+0000","last_clean":"2024-05-07T14:05:18.721954+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:05:18.721954+0000","last_undegraded":"2024-05-07T14:05:18.721954+0000","last_fullsized":"2024-05-07T14:05:18.721954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":260,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964564+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:05:18.964564+0000","last_peered":"2024-05-07T14:05:18.964564+0000","last_clean":"2024-05-07T14:05:18.964564+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:05:18.964564+0000","last_undegraded":"2024-05-07T14:05:18.964564+0000","last_fullsized":"2024-05-07T14:05:18.964564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"146'135","reported_seq":430,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272661+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:05:20.272661+0000","last_peered":"2024-05-07T14:05:20.272661+0000","last_clean":"2024-05-07T14:05:20.272661+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:05:20.272661+0000","last_undegraded":"2024-05-07T14:05:20.272661+0000","last_fullsized":"2024-05-07T14:05:20.272661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"87'6","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629046+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:05:18.629046+0000","last_peered":"2024-05-07T14:05:18.629046+0000","last_clean":"2024-05-07T14:05:18.629046+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:05:18.629046+0000","last_undegraded":"2024-05-07T14:05:18.629046+0000","last_fullsized":"2024-05-07T14:05:18.629046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"124'6","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961297+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:05:18.961297+0000","last_peered":"2024-05-07T14:05:18.961297+0000","last_clean":"2024-05-07T14:05:18.961297+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:05:18.961297+0000","last_undegraded":"2024-05-07T14:05:18.961297+0000","last_fullsized":"2024-05-07T14:05:18.961297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"124'24","reported_seq":316,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959048+0000","last_change":"2024-05-07T14:03:39.814768+0000","last_active":"2024-05-07T14:05:18.959048+0000","last_peered":"2024-05-07T14:05:18.959048+0000","last_clean":"2024-05-07T14:05:18.959048+0000","last_became_active":"2024-05-07T14:03:39.666192+0000","last_became_peered":"2024-05-07T14:03:39.666192+0000","last_unstale":"2024-05-07T14:05:18.959048+0000","last_undegraded":"2024-05-07T14:05:18.959048+0000","last_fullsized":"2024-05-07T14:05:18.959048+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:10.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630568+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:05:18.630568+0000","last_peered":"2024-05-07T14:05:18.630568+0000","last_clean":"2024-05-07T14:05:18.630568+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:05:18.630568+0000","last_undegraded":"2024-05-07T14:05:18.630568+0000","last_fullsized":"2024-05-07T14:05:18.630568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"124'25","reported_seq":326,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721237+0000","last_change":"2024-05-07T14:03:39.845058+0000","last_active":"2024-05-07T14:05:18.721237+0000","last_peered":"2024-05-07T14:05:18.721237+0000","last_clean":"2024-05-07T14:05:18.721237+0000","last_became_active":"2024-05-07T14:03:39.673995+0000","last_became_peered":"2024-05-07T14:03:39.673995+0000","last_unstale":"2024-05-07T14:05:18.721237+0000","last_undegraded":"2024-05-07T14:05:18.721237+0000","last_fullsized":"2024-05-07T14:05:18.721237+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:43.919444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959774+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:05:18.959774+0000","last_peered":"2024-05-07T14:05:18.959774+0000","last_clean":"2024-05-07T14:05:18.959774+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:05:18.959774+0000","last_undegraded":"2024-05-07T14:05:18.959774+0000","last_fullsized":"2024-05-07T14:05:18.959774+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"124'2","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960409+0000","last_change":"2024-05-07T14:03:39.666268+0000","last_active":"2024-05-07T14:05:18.960409+0000","last_peered":"2024-05-07T14:05:18.960409+0000","last_clean":"2024-05-07T14:05:18.960409+0000","last_became_active":"2024-05-07T14:03:39.665838+0000","last_became_peered":"2024-05-07T14:03:39.665838+0000","last_unstale":"2024-05-07T14:05:18.960409+0000","last_undegraded":"2024-05-07T14:05:18.960409+0000","last_fullsized":"2024-05-07T14:05:18.960409+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:54:00.122392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963437+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:05:18.963437+0000","last_peered":"2024-05-07T14:05:18.963437+0000","last_clean":"2024-05-07T14:05:18.963437+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:05:18.963437+0000","last_undegraded":"2024-05-07T14:05:18.963437+0000","last_fullsized":"2024-05-07T14:05:18.963437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":313,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958642+0000","last_change":"2024-05-07T14:02:39.729323+0000","last_active":"2024-05-07T14:05:18.958642+0000","last_peered":"2024-05-07T14:05:18.958642+0000","last_clean":"2024-05-07T14:05:18.958642+0000","last_became_active":"2024-05-07T14:02:39.728189+0000","last_became_peered":"2024-05-07T14:02:39.728189+0000","last_unstale":"2024-05-07T14:05:18.958642+0000","last_undegraded":"2024-05-07T14:05:18.958642+0000","last_fullsized":"2024-05-07T14:05:18.958642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:53:59.368912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721172+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:05:18.721172+0000","last_peered":"2024-05-07T14:05:18.721172+0000","last_clean":"2024-05-07T14:05:18.721172+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:05:18.721172+0000","last_undegraded":"2024-05-07T14:05:18.721172+0000","last_fullsized":"2024-05-07T14:05:18.721172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"124'21","reported_seq":227,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628487+0000","last_change":"2024-05-07T14:01:37.317794+0000","last_active":"2024-05-07T14:05:18.628487+0000","last_peered":"2024-05-07T14:05:18.628487+0000","last_clean":"2024-05-07T14:05:18.628487+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:05:18.628487+0000","last_undegraded":"2024-05-07T14:05:18.628487+0000","last_fullsized":"2024-05-07T14:05:18.628487+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:17.582561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":31,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962017+0000","last_change":"2024-05-07T14:04:59.458347+0000","last_active":"2024-05-07T14:05:18.962017+0000","last_peered":"2024-05-07T14:05:18.962017+0000","last_clean":"2024-05-07T14:05:18.962017+0000","last_became_active":"2024-05-07T14:04:59.453884+0000","last_became_peered":"2024-05-07T14:04:59.453884+0000","last_unstale":"2024-05-07T14:05:18.962017+0000","last_undegraded":"2024-05-07T14:05:18.962017+0000","last_fullsized":"2024-05-07T14:05:18.962017+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.867992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"124'38","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722420+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:05:18.722420+0000","last_peered":"2024-05-07T14:05:18.722420+0000","last_clean":"2024-05-07T14:05:18.722420+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:05:18.722420+0000","last_undegraded":"2024-05-07T14:05:18.722420+0000","last_fullsized":"2024-05-07T14:05:18.722420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961662+0000","last_change":"2024-05-07T14:04:59.457814+0000","last_active":"2024-05-07T14:05:18.961662+0000","last_peered":"2024-05-07T14:05:18.961662+0000","last_clean":"2024-05-07T14:05:18.961662+0000","last_became_active":"2024-05-07T14:04:59.456477+0000","last_became_peered":"2024-05-07T14:04:59.456477+0000","last_unstale":"2024-05-07T14:05:18.961662+0000","last_undegraded":"2024-05-07T14:05:18.961662+0000","last_fullsized":"2024-05-07T14:05:18.961662+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:10:28.939206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959013+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:05:18.959013+0000","last_peered":"2024-05-07T14:05:18.959013+0000","last_clean":"2024-05-07T14:05:18.959013+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:05:18.959013+0000","last_undegraded":"2024-05-07T14:05:18.959013+0000","last_fullsized":"2024-05-07T14:05:18.959013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962392+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:05:18.962392+0000","last_peered":"2024-05-07T14:05:18.962392+0000","last_clean":"2024-05-07T14:05:18.962392+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:05:18.962392+0000","last_undegraded":"2024-05-07T14:05:18.962392+0000","last_fullsized":"2024-05-07T14:05:18.962392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":224,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961946+0000","last_change":"2024-05-07T14:04:59.425099+0000","last_active":"2024-05-07T14:05:18.961946+0000","last_peered":"2024-05-07T14:05:18.961946+0000","last_clean":"2024-05-07T14:05:18.961946+0000","last_became_active":"2024-05-07T14:04:59.422224+0000","last_became_peered":"2024-05-07T14:04:59.422224+0000","last_unstale":"2024-05-07T14:05:18.961946+0000","last_undegraded":"2024-05-07T14:05:18.961946+0000","last_fullsized":"2024-05-07T14:05:18.961946+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:23.398977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"124'22","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958651+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:05:18.958651+0000","last_peered":"2024-05-07T14:05:18.958651+0000","last_clean":"2024-05-07T14:05:18.958651+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:05:18.958651+0000","last_undegraded":"2024-05-07T14:05:18.958651+0000","last_fullsized":"2024-05-07T14:05:18.958651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722613+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:05:18.722613+0000","last_peered":"2024-05-07T14:05:18.722613+0000","last_clean":"2024-05-07T14:05:18.722613+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:05:18.722613+0000","last_undegraded":"2024-05-07T14:05:18.722613+0000","last_fullsized":"2024-05-07T14:05:18.722613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"146'141","reported_seq":515,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272410+0000","last_change":"2024-05-07T14:03:42.708479+0000","last_active":"2024-05-07T14:05:20.272410+0000","last_peered":"2024-05-07T14:05:20.272410+0000","last_clean":"2024-05-07T14:05:20.272410+0000","last_became_active":"2024-05-07T14:03:42.708117+0000","last_became_peered":"2024-05-07T14:03:42.708117+0000","last_unstale":"2024-05-07T14:05:20.272410+0000","last_undegraded":"2024-05-07T14:05:20.272410+0000","last_fullsized":"2024-05-07T14:05:20.272410+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:19:35.961283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5457,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962840+0000","last_change":"2024-05-07T14:04:59.462996+0000","last_active":"2024-05-07T14:05:18.962840+0000","last_peered":"2024-05-07T14:05:18.962840+0000","last_clean":"2024-05-07T14:05:18.962840+0000","last_became_active":"2024-05-07T14:04:59.461354+0000","last_became_peered":"2024-05-07T14:04:59.461354+0000","last_unstale":"2024-05-07T14:05:18.962840+0000","last_undegraded":"2024-05-07T14:05:18.962840+0000","last_fullsized":"2024-05-07T14:05:18.962840+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:55.900168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"80'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962268+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:05:18.962268+0000","last_peered":"2024-05-07T14:05:18.962268+0000","last_clean":"2024-05-07T14:05:18.962268+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:05:18.962268+0000","last_undegraded":"2024-05-07T14:05:18.962268+0000","last_fullsized":"2024-05-07T14:05:18.962268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"81'2","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960614+0000","last_change":"2024-05-07T14:03:39.711373+0000","last_active":"2024-05-07T14:05:18.960614+0000","last_peered":"2024-05-07T14:05:18.960614+0000","last_clean":"2024-05-07T14:05:18.960614+0000","last_became_active":"2024-05-07T14:03:39.667130+0000","last_became_peered":"2024-05-07T14:03:39.667130+0000","last_unstale":"2024-05-07T14:05:18.960614+0000","last_undegraded":"2024-05-07T14:05:18.960614+0000","last_fullsized":"2024-05-07T14:05:18.960614+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:36.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628882+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:05:18.628882+0000","last_peered":"2024-05-07T14:05:18.628882+0000","last_clean":"2024-05-07T14:05:18.628882+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:05:18.628882+0000","last_undegraded":"2024-05-07T14:05:18.628882+0000","last_fullsized":"2024-05-07T14:05:18.628882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"124'27","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963322+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:05:18.963322+0000","last_peered":"2024-05-07T14:05:18.963322+0000","last_clean":"2024-05-07T14:05:18.963322+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:05:18.963322+0000","last_undegraded":"2024-05-07T14:05:18.963322+0000","last_fullsized":"2024-05-07T14:05:18.963322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630125+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:05:18.630125+0000","last_peered":"2024-05-07T14:05:18.630125+0000","last_clean":"2024-05-07T14:05:18.630125+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:05:18.630125+0000","last_undegraded":"2024-05-07T14:05:18.630125+0000","last_fullsized":"2024-05-07T14:05:18.630125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"146'19","reported_seq":292,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272772+0000","last_change":"2024-05-07T14:04:59.461913+0000","last_active":"2024-05-07T14:05:20.272772+0000","last_peered":"2024-05-07T14:05:20.272772+0000","last_clean":"2024-05-07T14:05:20.272772+0000","last_became_active":"2024-05-07T14:04:59.456018+0000","last_became_peered":"2024-05-07T14:04:59.456018+0000","last_unstale":"2024-05-07T14:05:20.272772+0000","last_undegraded":"2024-05-07T14:05:20.272772+0000","last_fullsized":"2024-05-07T14:05:20.272772+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:42:03.359344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959826+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:05:18.959826+0000","last_peered":"2024-05-07T14:05:18.959826+0000","last_clean":"2024-05-07T14:05:18.959826+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:05:18.959826+0000","last_undegraded":"2024-05-07T14:05:18.959826+0000","last_fullsized":"2024-05-07T14:05:18.959826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965082+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:05:18.965082+0000","last_peered":"2024-05-07T14:05:18.965082+0000","last_clean":"2024-05-07T14:05:18.965082+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:05:18.965082+0000","last_undegraded":"2024-05-07T14:05:18.965082+0000","last_fullsized":"2024-05-07T14:05:18.965082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"81'4","reported_seq":106,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961642+0000","last_change":"2024-05-07T14:03:39.687600+0000","last_active":"2024-05-07T14:05:18.961642+0000","last_peered":"2024-05-07T14:05:18.961642+0000","last_clean":"2024-05-07T14:05:18.961642+0000","last_became_active":"2024-05-07T14:03:39.661295+0000","last_became_peered":"2024-05-07T14:03:39.661295+0000","last_unstale":"2024-05-07T14:05:18.961642+0000","last_undegraded":"2024-05-07T14:05:18.961642+0000","last_fullsized":"2024-05-07T14:05:18.961642+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:17:58.416324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721116+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:05:18.721116+0000","last_peered":"2024-05-07T14:05:18.721116+0000","last_clean":"2024-05-07T14:05:18.721116+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:05:18.721116+0000","last_undegraded":"2024-05-07T14:05:18.721116+0000","last_fullsized":"2024-05-07T14:05:18.721116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"123'15","reported_seq":275,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629754+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:05:18.629754+0000","last_peered":"2024-05-07T14:05:18.629754+0000","last_clean":"2024-05-07T14:05:18.629754+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:05:18.629754+0000","last_undegraded":"2024-05-07T14:05:18.629754+0000","last_fullsized":"2024-05-07T14:05:18.629754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52428800,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":25,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959150+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:05:18.959150+0000","last_peered":"2024-05-07T14:05:18.959150+0000","last_clean":"2024-05-07T14:05:18.959150+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:05:18.959150+0000","last_undegraded":"2024-05-07T14:05:18.959150+0000","last_fullsized":"2024-05-07T14:05:18.959150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964612+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:05:18.964612+0000","last_peered":"2024-05-07T14:05:18.964612+0000","last_clean":"2024-05-07T14:05:18.964612+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:05:18.964612+0000","last_undegraded":"2024-05-07T14:05:18.964612+0000","last_fullsized":"2024-05-07T14:05:18.964612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960727+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:05:18.960727+0000","last_peered":"2024-05-07T14:05:18.960727+0000","last_clean":"2024-05-07T14:05:18.960727+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:05:18.960727+0000","last_undegraded":"2024-05-07T14:05:18.960727+0000","last_fullsized":"2024-05-07T14:05:18.960727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719766+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:05:18.719766+0000","last_peered":"2024-05-07T14:05:18.719766+0000","last_clean":"2024-05-07T14:05:18.719766+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:05:18.719766+0000","last_undegraded":"2024-05-07T14:05:18.719766+0000","last_fullsized":"2024-05-07T14:05:18.719766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962141+0000","last_change":"2024-05-07T14:03:39.659916+0000","last_active":"2024-05-07T14:05:18.962141+0000","last_peered":"2024-05-07T14:05:18.962141+0000","last_clean":"2024-05-07T14:05:18.962141+0000","last_became_active":"2024-05-07T14:03:39.659515+0000","last_became_peered":"2024-05-07T14:03:39.659515+0000","last_unstale":"2024-05-07T14:05:18.962141+0000","last_undegraded":"2024-05-07T14:05:18.962141+0000","last_fullsized":"2024-05-07T14:05:18.962141+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:49:16.796937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"123'19","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722362+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:05:18.722362+0000","last_peered":"2024-05-07T14:05:18.722362+0000","last_clean":"2024-05-07T14:05:18.722362+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:05:18.722362+0000","last_undegraded":"2024-05-07T14:05:18.722362+0000","last_fullsized":"2024-05-07T14:05:18.722362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961947+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:05:18.961947+0000","last_peered":"2024-05-07T14:05:18.961947+0000","last_clean":"2024-05-07T14:05:18.961947+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:05:18.961947+0000","last_undegraded":"2024-05-07T14:05:18.961947+0000","last_fullsized":"2024-05-07T14:05:18.961947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960414+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:05:18.960414+0000","last_peered":"2024-05-07T14:05:18.960414+0000","last_clean":"2024-05-07T14:05:18.960414+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:05:18.960414+0000","last_undegraded":"2024-05-07T14:05:18.960414+0000","last_fullsized":"2024-05-07T14:05:18.960414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'36","reported_seq":296,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958943+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:05:18.958943+0000","last_peered":"2024-05-07T14:05:18.958943+0000","last_clean":"2024-05-07T14:05:18.958943+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:05:18.958943+0000","last_undegraded":"2024-05-07T14:05:18.958943+0000","last_fullsized":"2024-05-07T14:05:18.958943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628294+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:05:18.628294+0000","last_peered":"2024-05-07T14:05:18.628294+0000","last_clean":"2024-05-07T14:05:18.628294+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:05:18.628294+0000","last_undegraded":"2024-05-07T14:05:18.628294+0000","last_fullsized":"2024-05-07T14:05:18.628294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960715+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:05:18.960715+0000","last_peered":"2024-05-07T14:05:18.960715+0000","last_clean":"2024-05-07T14:05:18.960715+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:05:18.960715+0000","last_undegraded":"2024-05-07T14:05:18.960715+0000","last_fullsized":"2024-05-07T14:05:18.960715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":254,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960639+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:05:18.960639+0000","last_peered":"2024-05-07T14:05:18.960639+0000","last_clean":"2024-05-07T14:05:18.960639+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:05:18.960639+0000","last_undegraded":"2024-05-07T14:05:18.960639+0000","last_fullsized":"2024-05-07T14:05:18.960639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"124'23","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961817+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:05:18.961817+0000","last_peered":"2024-05-07T14:05:18.961817+0000","last_clean":"2024-05-07T14:05:18.961817+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:05:18.961817+0000","last_undegraded":"2024-05-07T14:05:18.961817+0000","last_fullsized":"2024-05-07T14:05:18.961817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961641+0000","last_change":"2024-05-07T14:04:59.452453+0000","last_active":"2024-05-07T14:05:18.961641+0000","last_peered":"2024-05-07T14:05:18.961641+0000","last_clean":"2024-05-07T14:05:18.961641+0000","last_became_active":"2024-05-07T14:04:59.451719+0000","last_became_peered":"2024-05-07T14:04:59.451719+0000","last_unstale":"2024-05-07T14:05:18.961641+0000","last_undegraded":"2024-05-07T14:05:18.961641+0000","last_fullsized":"2024-05-07T14:05:18.961641+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:58:01.882244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959572+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:05:18.959572+0000","last_peered":"2024-05-07T14:05:18.959572+0000","last_clean":"2024-05-07T14:05:18.959572+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:05:18.959572+0000","last_undegraded":"2024-05-07T14:05:18.959572+0000","last_fullsized":"2024-05-07T14:05:18.959572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":116,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962572+0000","last_change":"2024-05-07T14:03:39.707679+0000","last_active":"2024-05-07T14:05:18.962572+0000","last_peered":"2024-05-07T14:05:18.962572+0000","last_clean":"2024-05-07T14:05:18.962572+0000","last_became_active":"2024-05-07T14:03:39.664751+0000","last_became_peered":"2024-05-07T14:03:39.664751+0000","last_unstale":"2024-05-07T14:05:18.962572+0000","last_undegraded":"2024-05-07T14:05:18.962572+0000","last_fullsized":"2024-05-07T14:05:18.962572+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:55.535011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"146'139","reported_seq":482,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.273267+0000","last_change":"2024-05-07T14:03:42.707530+0000","last_active":"2024-05-07T14:05:20.273267+0000","last_peered":"2024-05-07T14:05:20.273267+0000","last_clean":"2024-05-07T14:05:20.273267+0000","last_became_active":"2024-05-07T14:03:42.707207+0000","last_became_peered":"2024-05-07T14:03:42.707207+0000","last_unstale":"2024-05-07T14:05:20.273267+0000","last_undegraded":"2024-05-07T14:05:20.273267+0000","last_fullsized":"2024-05-07T14:05:20.273267+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:20:22.698141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964049+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:05:18.964049+0000","last_peered":"2024-05-07T14:05:18.964049+0000","last_clean":"2024-05-07T14:05:18.964049+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:05:18.964049+0000","last_undegraded":"2024-05-07T14:05:18.964049+0000","last_fullsized":"2024-05-07T14:05:18.964049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"115'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959440+0000","last_change":"2024-05-07T14:04:59.447585+0000","last_active":"2024-05-07T14:05:18.959440+0000","last_peered":"2024-05-07T14:05:18.959440+0000","last_clean":"2024-05-07T14:05:18.959440+0000","last_became_active":"2024-05-07T14:04:59.446674+0000","last_became_peered":"2024-05-07T14:04:59.446674+0000","last_unstale":"2024-05-07T14:05:18.959440+0000","last_undegraded":"2024-05-07T14:05:18.959440+0000","last_fullsized":"2024-05-07T14:05:18.959440+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:35.485711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"124'18","reported_seq":301,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963635+0000","last_change":"2024-05-07T14:05:00.492095+0000","last_active":"2024-05-07T14:05:18.963635+0000","last_peered":"2024-05-07T14:05:18.963635+0000","last_clean":"2024-05-07T14:05:18.963635+0000","last_became_active":"2024-05-07T14:04:59.460381+0000","last_became_peered":"2024-05-07T14:04:59.460381+0000","last_unstale":"2024-05-07T14:05:18.963635+0000","last_undegraded":"2024-05-07T14:05:18.963635+0000","last_fullsized":"2024-05-07T14:05:18.963635+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:12:40.498963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959581+0000","last_change":"2024-05-07T14:03:39.672724+0000","last_active":"2024-05-07T14:05:18.959581+0000","last_peered":"2024-05-07T14:05:18.959581+0000","last_clean":"2024-05-07T14:05:18.959581+0000","last_became_active":"2024-05-07T14:03:39.671518+0000","last_became_peered":"2024-05-07T14:03:39.671518+0000","last_unstale":"2024-05-07T14:05:18.959581+0000","last_undegraded":"2024-05-07T14:05:18.959581+0000","last_fullsized":"2024-05-07T14:05:18.959581+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:25.485797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":251,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628580+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:05:18.628580+0000","last_peered":"2024-05-07T14:05:18.628580+0000","last_clean":"2024-05-07T14:05:18.628580+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:05:18.628580+0000","last_undegraded":"2024-05-07T14:05:18.628580+0000","last_fullsized":"2024-05-07T14:05:18.628580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629354+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:05:18.629354+0000","last_peered":"2024-05-07T14:05:18.629354+0000","last_clean":"2024-05-07T14:05:18.629354+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:05:18.629354+0000","last_undegraded":"2024-05-07T14:05:18.629354+0000","last_fullsized":"2024-05-07T14:05:18.629354+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"146'135","reported_seq":477,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272789+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:05:20.272789+0000","last_peered":"2024-05-07T14:05:20.272789+0000","last_clean":"2024-05-07T14:05:20.272789+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:05:20.272789+0000","last_undegraded":"2024-05-07T14:05:20.272789+0000","last_fullsized":"2024-05-07T14:05:20.272789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"81'3","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960070+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:05:18.960070+0000","last_peered":"2024-05-07T14:05:18.960070+0000","last_clean":"2024-05-07T14:05:18.960070+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:05:18.960070+0000","last_undegraded":"2024-05-07T14:05:18.960070+0000","last_fullsized":"2024-05-07T14:05:18.960070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"124'4","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630423+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:05:18.630423+0000","last_peered":"2024-05-07T14:05:18.630423+0000","last_clean":"2024-05-07T14:05:18.630423+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:05:18.630423+0000","last_undegraded":"2024-05-07T14:05:18.630423+0000","last_fullsized":"2024-05-07T14:05:18.630423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"124'23","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962938+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:05:18.962938+0000","last_peered":"2024-05-07T14:05:18.962938+0000","last_clean":"2024-05-07T14:05:18.962938+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:05:18.962938+0000","last_undegraded":"2024-05-07T14:05:18.962938+0000","last_fullsized":"2024-05-07T14:05:18.962938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964431+0000","last_change":"2024-05-07T14:04:59.469514+0000","last_active":"2024-05-07T14:05:18.964431+0000","last_peered":"2024-05-07T14:05:18.964431+0000","last_clean":"2024-05-07T14:05:18.964431+0000","last_became_active":"2024-05-07T14:04:59.469021+0000","last_became_peered":"2024-05-07T14:04:59.469021+0000","last_unstale":"2024-05-07T14:05:18.964431+0000","last_undegraded":"2024-05-07T14:05:18.964431+0000","last_fullsized":"2024-05-07T14:05:18.964431+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:17:47.533593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959578+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:05:18.959578+0000","last_peered":"2024-05-07T14:05:18.959578+0000","last_clean":"2024-05-07T14:05:18.959578+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:05:18.959578+0000","last_undegraded":"2024-05-07T14:05:18.959578+0000","last_fullsized":"2024-05-07T14:05:18.959578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"124'45","reported_seq":288,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961605+0000","last_change":"2024-05-07T14:04:59.918491+0000","last_active":"2024-05-07T14:05:18.961605+0000","last_peered":"2024-05-07T14:05:18.961605+0000","last_clean":"2024-05-07T14:05:18.961605+0000","last_became_active":"2024-05-07T14:04:59.442492+0000","last_became_peered":"2024-05-07T14:04:59.442492+0000","last_unstale":"2024-05-07T14:05:18.961605+0000","last_undegraded":"2024-05-07T14:05:18.961605+0000","last_fullsized":"2024-05-07T14:05:18.961605+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:58.713363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120967,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":40,"num_read_kb":26,"num_write":24,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":116761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":252,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963779+0000","last_change":"2024-05-07T14:03:39.665240+0000","last_active":"2024-05-07T14:05:18.963779+0000","last_peered":"2024-05-07T14:05:18.963779+0000","last_clean":"2024-05-07T14:05:18.963779+0000","last_became_active":"2024-05-07T14:03:39.664810+0000","last_became_peered":"2024-05-07T14:03:39.664810+0000","last_unstale":"2024-05-07T14:05:18.963779+0000","last_undegraded":"2024-05-07T14:05:18.963779+0000","last_fullsized":"2024-05-07T14:05:18.963779+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:18:01.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721214+0000","last_change":"2024-05-07T14:04:59.465509+0000","last_active":"2024-05-07T14:05:18.721214+0000","last_peered":"2024-05-07T14:05:18.721214+0000","last_clean":"2024-05-07T14:05:18.721214+0000","last_became_active":"2024-05-07T14:04:59.464840+0000","last_became_peered":"2024-05-07T14:04:59.464840+0000","last_unstale":"2024-05-07T14:05:18.721214+0000","last_undegraded":"2024-05-07T14:05:18.721214+0000","last_fullsized":"2024-05-07T14:05:18.721214+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:42.823262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959673+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:05:18.959673+0000","last_peered":"2024-05-07T14:05:18.959673+0000","last_clean":"2024-05-07T14:05:18.959673+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:05:18.959673+0000","last_undegraded":"2024-05-07T14:05:18.959673+0000","last_fullsized":"2024-05-07T14:05:18.959673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'8","reported_seq":290,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629203+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:05:18.629203+0000","last_peered":"2024-05-07T14:05:18.629203+0000","last_clean":"2024-05-07T14:05:18.629203+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:05:18.629203+0000","last_undegraded":"2024-05-07T14:05:18.629203+0000","last_fullsized":"2024-05-07T14:05:18.629203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"124'23","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629269+0000","last_change":"2024-05-07T14:04:59.669798+0000","last_active":"2024-05-07T14:05:18.629269+0000","last_peered":"2024-05-07T14:05:18.629269+0000","last_clean":"2024-05-07T14:05:18.629269+0000","last_became_active":"2024-05-07T14:04:59.428245+0000","last_became_peered":"2024-05-07T14:04:59.428245+0000","last_unstale":"2024-05-07T14:05:18.629269+0000","last_undegraded":"2024-05-07T14:05:18.629269+0000","last_fullsized":"2024-05-07T14:05:18.629269+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:40.955811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962422+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:05:18.962422+0000","last_peered":"2024-05-07T14:05:18.962422+0000","last_clean":"2024-05-07T14:05:18.962422+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:05:18.962422+0000","last_undegraded":"2024-05-07T14:05:18.962422+0000","last_fullsized":"2024-05-07T14:05:18.962422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"124'20","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959837+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:05:18.959837+0000","last_peered":"2024-05-07T14:05:18.959837+0000","last_clean":"2024-05-07T14:05:18.959837+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:05:18.959837+0000","last_undegraded":"2024-05-07T14:05:18.959837+0000","last_fullsized":"2024-05-07T14:05:18.959837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959679+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:05:18.959679+0000","last_peered":"2024-05-07T14:05:18.959679+0000","last_clean":"2024-05-07T14:05:18.959679+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:05:18.959679+0000","last_undegraded":"2024-05-07T14:05:18.959679+0000","last_fullsized":"2024-05-07T14:05:18.959679+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":245,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963898+0000","last_change":"2024-05-07T14:04:59.447528+0000","last_active":"2024-05-07T14:05:18.963898+0000","last_peered":"2024-05-07T14:05:18.963898+0000","last_clean":"2024-05-07T14:05:18.963898+0000","last_became_active":"2024-05-07T14:04:59.446699+0000","last_became_peered":"2024-05-07T14:04:59.446699+0000","last_unstale":"2024-05-07T14:05:18.963898+0000","last_undegraded":"2024-05-07T14:05:18.963898+0000","last_fullsized":"2024-05-07T14:05:18.963898+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:42.823262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"115'8","reported_seq":129,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962079+0000","last_change":"2024-05-07T14:03:39.692877+0000","last_active":"2024-05-07T14:05:18.962079+0000","last_peered":"2024-05-07T14:05:18.962079+0000","last_clean":"2024-05-07T14:05:18.962079+0000","last_became_active":"2024-05-07T14:03:39.663976+0000","last_became_peered":"2024-05-07T14:03:39.663976+0000","last_unstale":"2024-05-07T14:05:18.962079+0000","last_undegraded":"2024-05-07T14:05:18.962079+0000","last_fullsized":"2024-05-07T14:05:18.962079+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:36.548454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"123'21","reported_seq":267,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961132+0000","last_change":"2024-05-07T14:05:00.456893+0000","last_active":"2024-05-07T14:05:18.961132+0000","last_peered":"2024-05-07T14:05:18.961132+0000","last_clean":"2024-05-07T14:05:18.961132+0000","last_became_active":"2024-05-07T14:04:59.445956+0000","last_became_peered":"2024-05-07T14:04:59.445956+0000","last_unstale":"2024-05-07T14:05:18.961132+0000","last_undegraded":"2024-05-07T14:05:18.961132+0000","last_fullsized":"2024-05-07T14:05:18.961132+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:07.979587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964857+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:05:18.964857+0000","last_peered":"2024-05-07T14:05:18.964857+0000","last_clean":"2024-05-07T14:05:18.964857+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:05:18.964857+0000","last_undegraded":"2024-05-07T14:05:18.964857+0000","last_fullsized":"2024-05-07T14:05:18.964857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"124'9","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958697+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:05:18.958697+0000","last_peered":"2024-05-07T14:05:18.958697+0000","last_clean":"2024-05-07T14:05:18.958697+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:05:18.958697+0000","last_undegraded":"2024-05-07T14:05:18.958697+0000","last_fullsized":"2024-05-07T14:05:18.958697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962740+0000","last_change":"2024-05-07T14:04:59.445953+0000","last_active":"2024-05-07T14:05:18.962740+0000","last_peered":"2024-05-07T14:05:18.962740+0000","last_clean":"2024-05-07T14:05:18.962740+0000","last_became_active":"2024-05-07T14:04:59.444830+0000","last_became_peered":"2024-05-07T14:04:59.444830+0000","last_unstale":"2024-05-07T14:05:18.962740+0000","last_undegraded":"2024-05-07T14:05:18.962740+0000","last_fullsized":"2024-05-07T14:05:18.962740+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:10:54.814821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"106'2","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959004+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:05:18.959004+0000","last_peered":"2024-05-07T14:05:18.959004+0000","last_clean":"2024-05-07T14:05:18.959004+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:05:18.959004+0000","last_undegraded":"2024-05-07T14:05:18.959004+0000","last_fullsized":"2024-05-07T14:05:18.959004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"81'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960024+0000","last_change":"2024-05-07T14:04:59.460718+0000","last_active":"2024-05-07T14:05:18.960024+0000","last_peered":"2024-05-07T14:05:18.960024+0000","last_clean":"2024-05-07T14:05:18.960024+0000","last_became_active":"2024-05-07T14:04:59.460037+0000","last_became_peered":"2024-05-07T14:04:59.460037+0000","last_unstale":"2024-05-07T14:05:18.960024+0000","last_undegraded":"2024-05-07T14:05:18.960024+0000","last_fullsized":"2024-05-07T14:05:18.960024+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:28.266490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"124'21","reported_seq":305,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722278+0000","last_change":"2024-05-07T14:05:00.840128+0000","last_active":"2024-05-07T14:05:18.722278+0000","last_peered":"2024-05-07T14:05:18.722278+0000","last_clean":"2024-05-07T14:05:18.722278+0000","last_became_active":"2024-05-07T14:04:59.460944+0000","last_became_peered":"2024-05-07T14:04:59.460944+0000","last_unstale":"2024-05-07T14:05:18.722278+0000","last_undegraded":"2024-05-07T14:05:18.722278+0000","last_fullsized":"2024-05-07T14:05:18.722278+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:26.259170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960783+0000","last_change":"2024-05-07T14:04:59.431660+0000","last_active":"2024-05-07T14:05:18.960783+0000","last_peered":"2024-05-07T14:05:18.960783+0000","last_clean":"2024-05-07T14:05:18.960783+0000","last_became_active":"2024-05-07T14:04:59.430654+0000","last_became_peered":"2024-05-07T14:04:59.430654+0000","last_unstale":"2024-05-07T14:05:18.960783+0000","last_undegraded":"2024-05-07T14:05:18.960783+0000","last_fullsized":"2024-05-07T14:05:18.960783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:27:01.765321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"124'20","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963938+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:05:18.963938+0000","last_peered":"2024-05-07T14:05:18.963938+0000","last_clean":"2024-05-07T14:05:18.963938+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:05:18.963938+0000","last_undegraded":"2024-05-07T14:05:18.963938+0000","last_fullsized":"2024-05-07T14:05:18.963938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959502+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:05:18.959502+0000","last_peered":"2024-05-07T14:05:18.959502+0000","last_clean":"2024-05-07T14:05:18.959502+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:05:18.959502+0000","last_undegraded":"2024-05-07T14:05:18.959502+0000","last_fullsized":"2024-05-07T14:05:18.959502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720402+0000","last_change":"2024-05-07T14:04:59.444373+0000","last_active":"2024-05-07T14:05:18.720402+0000","last_peered":"2024-05-07T14:05:18.720402+0000","last_clean":"2024-05-07T14:05:18.720402+0000","last_became_active":"2024-05-07T14:04:59.443620+0000","last_became_peered":"2024-05-07T14:04:59.443620+0000","last_unstale":"2024-05-07T14:05:18.720402+0000","last_undegraded":"2024-05-07T14:05:18.720402+0000","last_fullsized":"2024-05-07T14:05:18.720402+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:44:00.772402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"124'4","reported_seq":94,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958941+0000","last_change":"2024-05-07T14:03:52.789742+0000","last_active":"2024-05-07T14:05:18.958941+0000","last_peered":"2024-05-07T14:05:18.958941+0000","last_clean":"2024-05-07T14:05:18.958941+0000","last_became_active":"2024-05-07T14:03:52.787675+0000","last_became_peered":"2024-05-07T14:03:52.787675+0000","last_unstale":"2024-05-07T14:05:18.958941+0000","last_undegraded":"2024-05-07T14:05:18.958941+0000","last_fullsized":"2024-05-07T14:05:18.958941+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:39.000431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"124'24","reported_seq":229,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630088+0000","last_change":"2024-05-07T14:01:37.318408+0000","last_active":"2024-05-07T14:05:18.630088+0000","last_peered":"2024-05-07T14:05:18.630088+0000","last_clean":"2024-05-07T14:05:18.630088+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:05:18.630088+0000","last_undegraded":"2024-05-07T14:05:18.630088+0000","last_fullsized":"2024-05-07T14:05:18.630088+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:43.643434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959480+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:05:18.959480+0000","last_peered":"2024-05-07T14:05:18.959480+0000","last_clean":"2024-05-07T14:05:18.959480+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:05:18.959480+0000","last_undegraded":"2024-05-07T14:05:18.959480+0000","last_fullsized":"2024-05-07T14:05:18.959480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"124'17","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961550+0000","last_change":"2024-05-07T14:04:59.459641+0000","last_active":"2024-05-07T14:05:18.961550+0000","last_peered":"2024-05-07T14:05:18.961550+0000","last_clean":"2024-05-07T14:05:18.961550+0000","last_became_active":"2024-05-07T14:04:59.459102+0000","last_became_peered":"2024-05-07T14:04:59.459102+0000","last_unstale":"2024-05-07T14:05:18.961550+0000","last_undegraded":"2024-05-07T14:05:18.961550+0000","last_fullsized":"2024-05-07T14:05:18.961550+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:09:18.267555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958858+0000","last_change":"2024-05-07T14:04:59.449322+0000","last_active":"2024-05-07T14:05:18.958858+0000","last_peered":"2024-05-07T14:05:18.958858+0000","last_clean":"2024-05-07T14:05:18.958858+0000","last_became_active":"2024-05-07T14:04:59.448594+0000","last_became_peered":"2024-05-07T14:04:59.448594+0000","last_unstale":"2024-05-07T14:05:18.958858+0000","last_undegraded":"2024-05-07T14:05:18.958858+0000","last_fullsized":"2024-05-07T14:05:18.958858+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:32.423884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"115'6","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964236+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:05:18.964236+0000","last_peered":"2024-05-07T14:05:18.964236+0000","last_clean":"2024-05-07T14:05:18.964236+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:05:18.964236+0000","last_undegraded":"2024-05-07T14:05:18.964236+0000","last_fullsized":"2024-05-07T14:05:18.964236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959138+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:05:18.959138+0000","last_peered":"2024-05-07T14:05:18.959138+0000","last_clean":"2024-05-07T14:05:18.959138+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:05:18.959138+0000","last_undegraded":"2024-05-07T14:05:18.959138+0000","last_fullsized":"2024-05-07T14:05:18.959138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":257,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961778+0000","last_change":"2024-05-07T14:04:59.457249+0000","last_active":"2024-05-07T14:05:18.961778+0000","last_peered":"2024-05-07T14:05:18.961778+0000","last_clean":"2024-05-07T14:05:18.961778+0000","last_became_active":"2024-05-07T14:04:59.455608+0000","last_became_peered":"2024-05-07T14:04:59.455608+0000","last_unstale":"2024-05-07T14:05:18.961778+0000","last_undegraded":"2024-05-07T14:05:18.961778+0000","last_fullsized":"2024-05-07T14:05:18.961778+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:55:28.165004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"124'29","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963612+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:05:18.963612+0000","last_peered":"2024-05-07T14:05:18.963612+0000","last_clean":"2024-05-07T14:05:18.963612+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:05:18.963612+0000","last_undegraded":"2024-05-07T14:05:18.963612+0000","last_fullsized":"2024-05-07T14:05:18.963612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120857,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720945+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:05:18.720945+0000","last_peered":"2024-05-07T14:05:18.720945+0000","last_clean":"2024-05-07T14:05:18.720945+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:05:18.720945+0000","last_undegraded":"2024-05-07T14:05:18.720945+0000","last_fullsized":"2024-05-07T14:05:18.720945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"81'2","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963561+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:05:18.963561+0000","last_peered":"2024-05-07T14:05:18.963561+0000","last_clean":"2024-05-07T14:05:18.963561+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:05:18.963561+0000","last_undegraded":"2024-05-07T14:05:18.963561+0000","last_fullsized":"2024-05-07T14:05:18.963561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"115'8","reported_seq":295,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962152+0000","last_change":"2024-05-07T14:04:59.457999+0000","last_active":"2024-05-07T14:05:18.962152+0000","last_peered":"2024-05-07T14:05:18.962152+0000","last_clean":"2024-05-07T14:05:18.962152+0000","last_became_active":"2024-05-07T14:04:59.456492+0000","last_became_peered":"2024-05-07T14:04:59.456492+0000","last_unstale":"2024-05-07T14:05:18.962152+0000","last_undegraded":"2024-05-07T14:05:18.962152+0000","last_fullsized":"2024-05-07T14:05:18.962152+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:41.936460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"124'22","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963224+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:05:18.963224+0000","last_peered":"2024-05-07T14:05:18.963224+0000","last_clean":"2024-05-07T14:05:18.963224+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:05:18.963224+0000","last_undegraded":"2024-05-07T14:05:18.963224+0000","last_fullsized":"2024-05-07T14:05:18.963224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960857+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:05:18.960857+0000","last_peered":"2024-05-07T14:05:18.960857+0000","last_clean":"2024-05-07T14:05:18.960857+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:05:18.960857+0000","last_undegraded":"2024-05-07T14:05:18.960857+0000","last_fullsized":"2024-05-07T14:05:18.960857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"124'23","reported_seq":258,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962735+0000","last_change":"2024-05-07T14:04:59.440283+0000","last_active":"2024-05-07T14:05:18.962735+0000","last_peered":"2024-05-07T14:05:18.962735+0000","last_clean":"2024-05-07T14:05:18.962735+0000","last_became_active":"2024-05-07T14:04:59.439603+0000","last_became_peered":"2024-05-07T14:04:59.439603+0000","last_unstale":"2024-05-07T14:05:18.962735+0000","last_undegraded":"2024-05-07T14:05:18.962735+0000","last_fullsized":"2024-05-07T14:05:18.962735+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:19.505619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964150+0000","last_change":"2024-05-07T14:03:39.667564+0000","last_active":"2024-05-07T14:05:18.964150+0000","last_peered":"2024-05-07T14:05:18.964150+0000","last_clean":"2024-05-07T14:05:18.964150+0000","last_became_active":"2024-05-07T14:03:39.666888+0000","last_became_peered":"2024-05-07T14:03:39.666888+0000","last_unstale":"2024-05-07T14:05:18.964150+0000","last_undegraded":"2024-05-07T14:05:18.964150+0000","last_fullsized":"2024-05-07T14:05:18.964150+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:33.367980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959043+0000","last_change":"2024-05-07T14:04:59.456030+0000","last_active":"2024-05-07T14:05:18.959043+0000","last_peered":"2024-05-07T14:05:18.959043+0000","last_clean":"2024-05-07T14:05:18.959043+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:18.959043+0000","last_undegraded":"2024-05-07T14:05:18.959043+0000","last_fullsized":"2024-05-07T14:05:18.959043+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:20:24.704314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"81'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963522+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:05:18.963522+0000","last_peered":"2024-05-07T14:05:18.963522+0000","last_clean":"2024-05-07T14:05:18.963522+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:05:18.963522+0000","last_undegraded":"2024-05-07T14:05:18.963522+0000","last_fullsized":"2024-05-07T14:05:18.963522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629964+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:05:18.629964+0000","last_peered":"2024-05-07T14:05:18.629964+0000","last_clean":"2024-05-07T14:05:18.629964+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:05:18.629964+0000","last_undegraded":"2024-05-07T14:05:18.629964+0000","last_fullsized":"2024-05-07T14:05:18.629964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631091+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:05:18.631091+0000","last_peered":"2024-05-07T14:05:18.631091+0000","last_clean":"2024-05-07T14:05:18.631091+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:05:18.631091+0000","last_undegraded":"2024-05-07T14:05:18.631091+0000","last_fullsized":"2024-05-07T14:05:18.631091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"124'19","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964240+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:05:18.964240+0000","last_peered":"2024-05-07T14:05:18.964240+0000","last_clean":"2024-05-07T14:05:18.964240+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:05:18.964240+0000","last_undegraded":"2024-05-07T14:05:18.964240+0000","last_fullsized":"2024-05-07T14:05:18.964240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960106+0000","last_change":"2024-05-07T14:03:39.664184+0000","last_active":"2024-05-07T14:05:18.960106+0000","last_peered":"2024-05-07T14:05:18.960106+0000","last_clean":"2024-05-07T14:05:18.960106+0000","last_became_active":"2024-05-07T14:03:39.663569+0000","last_became_peered":"2024-05-07T14:03:39.663569+0000","last_unstale":"2024-05-07T14:05:18.960106+0000","last_undegraded":"2024-05-07T14:05:18.960106+0000","last_fullsized":"2024-05-07T14:05:18.960106+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:51.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720030+0000","last_change":"2024-05-07T14:04:59.447765+0000","last_active":"2024-05-07T14:05:18.720030+0000","last_peered":"2024-05-07T14:05:18.720030+0000","last_clean":"2024-05-07T14:05:18.720030+0000","last_became_active":"2024-05-07T14:04:59.447025+0000","last_became_peered":"2024-05-07T14:04:59.447025+0000","last_unstale":"2024-05-07T14:05:18.720030+0000","last_undegraded":"2024-05-07T14:05:18.720030+0000","last_fullsized":"2024-05-07T14:05:18.720030+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:14.299214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"124'14","reported_seq":298,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629778+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:05:18.629778+0000","last_peered":"2024-05-07T14:05:18.629778+0000","last_clean":"2024-05-07T14:05:18.629778+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:05:18.629778+0000","last_undegraded":"2024-05-07T14:05:18.629778+0000","last_fullsized":"2024-05-07T14:05:18.629778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"124'20","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960254+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:05:18.960254+0000","last_peered":"2024-05-07T14:05:18.960254+0000","last_clean":"2024-05-07T14:05:18.960254+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:05:18.960254+0000","last_undegraded":"2024-05-07T14:05:18.960254+0000","last_fullsized":"2024-05-07T14:05:18.960254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964629+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:05:18.964629+0000","last_peered":"2024-05-07T14:05:18.964629+0000","last_clean":"2024-05-07T14:05:18.964629+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:05:18.964629+0000","last_undegraded":"2024-05-07T14:05:18.964629+0000","last_fullsized":"2024-05-07T14:05:18.964629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630297+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:05:18.630297+0000","last_peered":"2024-05-07T14:05:18.630297+0000","last_clean":"2024-05-07T14:05:18.630297+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:05:18.630297+0000","last_undegraded":"2024-05-07T14:05:18.630297+0000","last_fullsized":"2024-05-07T14:05:18.630297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"146'135","reported_seq":506,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.273174+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:05:20.273174+0000","last_peered":"2024-05-07T14:05:20.273174+0000","last_clean":"2024-05-07T14:05:20.273174+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:05:20.273174+0000","last_undegraded":"2024-05-07T14:05:20.273174+0000","last_fullsized":"2024-05-07T14:05:20.273174+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"81'7","reported_seq":161,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961656+0000","last_change":"2024-05-07T14:04:59.448265+0000","last_active":"2024-05-07T14:05:18.961656+0000","last_peered":"2024-05-07T14:05:18.961656+0000","last_clean":"2024-05-07T14:05:18.961656+0000","last_became_active":"2024-05-07T14:04:59.444580+0000","last_became_peered":"2024-05-07T14:04:59.444580+0000","last_unstale":"2024-05-07T14:05:18.961656+0000","last_undegraded":"2024-05-07T14:05:18.961656+0000","last_fullsized":"2024-05-07T14:05:18.961656+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:54.087416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"124'8","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629103+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:05:18.629103+0000","last_peered":"2024-05-07T14:05:18.629103+0000","last_clean":"2024-05-07T14:05:18.629103+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:05:18.629103+0000","last_undegraded":"2024-05-07T14:05:18.629103+0000","last_fullsized":"2024-05-07T14:05:18.629103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"124'20","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721314+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:05:18.721314+0000","last_peered":"2024-05-07T14:05:18.721314+0000","last_clean":"2024-05-07T14:05:18.721314+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:05:18.721314+0000","last_undegraded":"2024-05-07T14:05:18.721314+0000","last_fullsized":"2024-05-07T14:05:18.721314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961289+0000","last_change":"2024-05-07T14:04:59.425730+0000","last_active":"2024-05-07T14:05:18.961289+0000","last_peered":"2024-05-07T14:05:18.961289+0000","last_clean":"2024-05-07T14:05:18.961289+0000","last_became_active":"2024-05-07T14:04:59.421636+0000","last_became_peered":"2024-05-07T14:04:59.421636+0000","last_unstale":"2024-05-07T14:05:18.961289+0000","last_undegraded":"2024-05-07T14:05:18.961289+0000","last_fullsized":"2024-05-07T14:05:18.961289+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:15:27.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"124'23","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720578+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:05:18.720578+0000","last_peered":"2024-05-07T14:05:18.720578+0000","last_clean":"2024-05-07T14:05:18.720578+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:05:18.720578+0000","last_undegraded":"2024-05-07T14:05:18.720578+0000","last_fullsized":"2024-05-07T14:05:18.720578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958232+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:05:18.958232+0000","last_peered":"2024-05-07T14:05:18.958232+0000","last_clean":"2024-05-07T14:05:18.958232+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:05:18.958232+0000","last_undegraded":"2024-05-07T14:05:18.958232+0000","last_fullsized":"2024-05-07T14:05:18.958232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"124'7","reported_seq":157,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964433+0000","last_change":"2024-05-07T14:05:02.242073+0000","last_active":"2024-05-07T14:05:18.964433+0000","last_peered":"2024-05-07T14:05:18.964433+0000","last_clean":"2024-05-07T14:05:18.964433+0000","last_became_active":"2024-05-07T14:04:59.467712+0000","last_became_peered":"2024-05-07T14:04:59.467712+0000","last_unstale":"2024-05-07T14:05:18.964433+0000","last_undegraded":"2024-05-07T14:05:18.964433+0000","last_fullsized":"2024-05-07T14:05:18.964433+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:31.624262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"115'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629455+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:05:18.629455+0000","last_peered":"2024-05-07T14:05:18.629455+0000","last_clean":"2024-05-07T14:05:18.629455+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:05:18.629455+0000","last_undegraded":"2024-05-07T14:05:18.629455+0000","last_fullsized":"2024-05-07T14:05:18.629455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"124'26","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722184+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:05:18.722184+0000","last_peered":"2024-05-07T14:05:18.722184+0000","last_clean":"2024-05-07T14:05:18.722184+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:05:18.722184+0000","last_undegraded":"2024-05-07T14:05:18.722184+0000","last_fullsized":"2024-05-07T14:05:18.722184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720667+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:05:18.720667+0000","last_peered":"2024-05-07T14:05:18.720667+0000","last_clean":"2024-05-07T14:05:18.720667+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:05:18.720667+0000","last_undegraded":"2024-05-07T14:05:18.720667+0000","last_fullsized":"2024-05-07T14:05:18.720667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"124'17","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958238+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:05:18.958238+0000","last_peered":"2024-05-07T14:05:18.958238+0000","last_clean":"2024-05-07T14:05:18.958238+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:05:18.958238+0000","last_undegraded":"2024-05-07T14:05:18.958238+0000","last_fullsized":"2024-05-07T14:05:18.958238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959103+0000","last_change":"2024-05-07T14:04:59.466240+0000","last_active":"2024-05-07T14:05:18.959103+0000","last_peered":"2024-05-07T14:05:18.959103+0000","last_clean":"2024-05-07T14:05:18.959103+0000","last_became_active":"2024-05-07T14:04:59.465509+0000","last_became_peered":"2024-05-07T14:04:59.465509+0000","last_unstale":"2024-05-07T14:05:18.959103+0000","last_undegraded":"2024-05-07T14:05:18.959103+0000","last_fullsized":"2024-05-07T14:05:18.959103+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:28:23.609814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964136+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:05:18.964136+0000","last_peered":"2024-05-07T14:05:18.964136+0000","last_clean":"2024-05-07T14:05:18.964136+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:05:18.964136+0000","last_undegraded":"2024-05-07T14:05:18.964136+0000","last_fullsized":"2024-05-07T14:05:18.964136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"87'6","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960098+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:05:18.960098+0000","last_peered":"2024-05-07T14:05:18.960098+0000","last_clean":"2024-05-07T14:05:18.960098+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:05:18.960098+0000","last_undegraded":"2024-05-07T14:05:18.960098+0000","last_fullsized":"2024-05-07T14:05:18.960098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"124'19","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964959+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:05:18.964959+0000","last_peered":"2024-05-07T14:05:18.964959+0000","last_clean":"2024-05-07T14:05:18.964959+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:05:18.964959+0000","last_undegraded":"2024-05-07T14:05:18.964959+0000","last_fullsized":"2024-05-07T14:05:18.964959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628160+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:05:18.628160+0000","last_peered":"2024-05-07T14:05:18.628160+0000","last_clean":"2024-05-07T14:05:18.628160+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:05:18.628160+0000","last_undegraded":"2024-05-07T14:05:18.628160+0000","last_fullsized":"2024-05-07T14:05:18.628160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"124'13","reported_seq":271,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965528+0000","last_change":"2024-05-07T14:04:59.460738+0000","last_active":"2024-05-07T14:05:18.965528+0000","last_peered":"2024-05-07T14:05:18.965528+0000","last_clean":"2024-05-07T14:05:18.965528+0000","last_became_active":"2024-05-07T14:04:59.459963+0000","last_became_peered":"2024-05-07T14:04:59.459963+0000","last_unstale":"2024-05-07T14:05:18.965528+0000","last_undegraded":"2024-05-07T14:05:18.965528+0000","last_fullsized":"2024-05-07T14:05:18.965528+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:14:25.517514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628526+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:05:18.628526+0000","last_peered":"2024-05-07T14:05:18.628526+0000","last_clean":"2024-05-07T14:05:18.628526+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:05:18.628526+0000","last_undegraded":"2024-05-07T14:05:18.628526+0000","last_fullsized":"2024-05-07T14:05:18.628526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"81'8","reported_seq":222,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963108+0000","last_change":"2024-05-07T14:04:59.462387+0000","last_active":"2024-05-07T14:05:18.963108+0000","last_peered":"2024-05-07T14:05:18.963108+0000","last_clean":"2024-05-07T14:05:18.963108+0000","last_became_active":"2024-05-07T14:04:59.456842+0000","last_became_peered":"2024-05-07T14:04:59.456842+0000","last_unstale":"2024-05-07T14:05:18.963108+0000","last_undegraded":"2024-05-07T14:05:18.963108+0000","last_fullsized":"2024-05-07T14:05:18.963108+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:43:26.257882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"115'10","reported_seq":294,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628969+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:05:18.628969+0000","last_peered":"2024-05-07T14:05:18.628969+0000","last_clean":"2024-05-07T14:05:18.628969+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:05:18.628969+0000","last_undegraded":"2024-05-07T14:05:18.628969+0000","last_fullsized":"2024-05-07T14:05:18.628969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"124'22","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960298+0000","last_change":"2024-05-07T14:01:37.554242+0000","last_active":"2024-05-07T14:05:18.960298+0000","last_peered":"2024-05-07T14:05:18.960298+0000","last_clean":"2024-05-07T14:05:18.960298+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:05:18.960298+0000","last_undegraded":"2024-05-07T14:05:18.960298+0000","last_fullsized":"2024-05-07T14:05:18.960298+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:16:22.149514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962634+0000","last_change":"2024-05-07T14:03:39.674947+0000","last_active":"2024-05-07T14:05:18.962634+0000","last_peered":"2024-05-07T14:05:18.962634+0000","last_clean":"2024-05-07T14:05:18.962634+0000","last_became_active":"2024-05-07T14:03:39.659887+0000","last_became_peered":"2024-05-07T14:03:39.659887+0000","last_unstale":"2024-05-07T14:05:18.962634+0000","last_undegraded":"2024-05-07T14:05:18.962634+0000","last_fullsized":"2024-05-07T14:05:18.962634+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:18:06.217561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"124'17","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628561+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:05:18.628561+0000","last_peered":"2024-05-07T14:05:18.628561+0000","last_clean":"2024-05-07T14:05:18.628561+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:05:18.628561+0000","last_undegraded":"2024-05-07T14:05:18.628561+0000","last_fullsized":"2024-05-07T14:05:18.628561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958734+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:05:18.958734+0000","last_peered":"2024-05-07T14:05:18.958734+0000","last_clean":"2024-05-07T14:05:18.958734+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:05:18.958734+0000","last_undegraded":"2024-05-07T14:05:18.958734+0000","last_fullsized":"2024-05-07T14:05:18.958734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631326+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:05:18.631326+0000","last_peered":"2024-05-07T14:05:18.631326+0000","last_clean":"2024-05-07T14:05:18.631326+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:05:18.631326+0000","last_undegraded":"2024-05-07T14:05:18.631326+0000","last_fullsized":"2024-05-07T14:05:18.631326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"87'16","reported_seq":110,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960757+0000","last_change":"2024-05-07T14:03:39.799013+0000","last_active":"2024-05-07T14:05:18.960757+0000","last_peered":"2024-05-07T14:05:18.960757+0000","last_clean":"2024-05-07T14:05:18.960757+0000","last_became_active":"2024-05-07T14:03:39.671068+0000","last_became_peered":"2024-05-07T14:03:39.671068+0000","last_unstale":"2024-05-07T14:05:18.960757+0000","last_undegraded":"2024-05-07T14:05:18.960757+0000","last_fullsized":"2024-05-07T14:05:18.960757+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:13.746128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"124'22","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959122+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:05:18.959122+0000","last_peered":"2024-05-07T14:05:18.959122+0000","last_clean":"2024-05-07T14:05:18.959122+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:05:18.959122+0000","last_undegraded":"2024-05-07T14:05:18.959122+0000","last_fullsized":"2024-05-07T14:05:18.959122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959826+0000","last_change":"2024-05-07T14:03:39.661724+0000","last_active":"2024-05-07T14:05:18.959826+0000","last_peered":"2024-05-07T14:05:18.959826+0000","last_clean":"2024-05-07T14:05:18.959826+0000","last_became_active":"2024-05-07T14:03:39.661339+0000","last_became_peered":"2024-05-07T14:03:39.661339+0000","last_unstale":"2024-05-07T14:05:18.959826+0000","last_undegraded":"2024-05-07T14:05:18.959826+0000","last_fullsized":"2024-05-07T14:05:18.959826+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:34.633849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"123'17","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628556+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:05:18.628556+0000","last_peered":"2024-05-07T14:05:18.628556+0000","last_clean":"2024-05-07T14:05:18.628556+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:05:18.628556+0000","last_undegraded":"2024-05-07T14:05:18.628556+0000","last_fullsized":"2024-05-07T14:05:18.628556+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:01.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"81'6","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721729+0000","last_change":"2024-05-07T14:04:59.467441+0000","last_active":"2024-05-07T14:05:18.721729+0000","last_peered":"2024-05-07T14:05:18.721729+0000","last_clean":"2024-05-07T14:05:18.721729+0000","last_became_active":"2024-05-07T14:04:59.466443+0000","last_became_peered":"2024-05-07T14:04:59.466443+0000","last_unstale":"2024-05-07T14:05:18.721729+0000","last_undegraded":"2024-05-07T14:05:18.721729+0000","last_fullsized":"2024-05-07T14:05:18.721729+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:35.485711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"124'25","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721037+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:05:18.721037+0000","last_peered":"2024-05-07T14:05:18.721037+0000","last_clean":"2024-05-07T14:05:18.721037+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:05:18.721037+0000","last_undegraded":"2024-05-07T14:05:18.721037+0000","last_fullsized":"2024-05-07T14:05:18.721037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"124'4","reported_seq":124,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961882+0000","last_change":"2024-05-07T14:04:59.861145+0000","last_active":"2024-05-07T14:05:18.961882+0000","last_peered":"2024-05-07T14:05:18.961882+0000","last_clean":"2024-05-07T14:05:18.961882+0000","last_became_active":"2024-05-07T14:04:59.445932+0000","last_became_peered":"2024-05-07T14:04:59.445932+0000","last_unstale":"2024-05-07T14:05:18.961882+0000","last_undegraded":"2024-05-07T14:05:18.961882+0000","last_fullsized":"2024-05-07T14:05:18.961882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:42.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"124'28","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960357+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:05:18.960357+0000","last_peered":"2024-05-07T14:05:18.960357+0000","last_clean":"2024-05-07T14:05:18.960357+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:05:18.960357+0000","last_undegraded":"2024-05-07T14:05:18.960357+0000","last_fullsized":"2024-05-07T14:05:18.960357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"81'2","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965417+0000","last_change":"2024-05-07T14:04:59.448690+0000","last_active":"2024-05-07T14:05:18.965417+0000","last_peered":"2024-05-07T14:05:18.965417+0000","last_clean":"2024-05-07T14:05:18.965417+0000","last_became_active":"2024-05-07T14:04:59.447844+0000","last_became_peered":"2024-05-07T14:04:59.447844+0000","last_unstale":"2024-05-07T14:05:18.965417+0000","last_undegraded":"2024-05-07T14:05:18.965417+0000","last_fullsized":"2024-05-07T14:05:18.965417+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:48:36.699391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"124'21","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964522+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:05:18.964522+0000","last_peered":"2024-05-07T14:05:18.964522+0000","last_clean":"2024-05-07T14:05:18.964522+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:05:18.964522+0000","last_undegraded":"2024-05-07T14:05:18.964522+0000","last_fullsized":"2024-05-07T14:05:18.964522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629774+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:05:18.629774+0000","last_peered":"2024-05-07T14:05:18.629774+0000","last_clean":"2024-05-07T14:05:18.629774+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:05:18.629774+0000","last_undegraded":"2024-05-07T14:05:18.629774+0000","last_fullsized":"2024-05-07T14:05:18.629774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"124'28","reported_seq":133,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965151+0000","last_change":"2024-05-07T14:03:39.789159+0000","last_active":"2024-05-07T14:05:18.965151+0000","last_peered":"2024-05-07T14:05:18.965151+0000","last_clean":"2024-05-07T14:05:18.965151+0000","last_became_active":"2024-05-07T14:03:39.668790+0000","last_became_peered":"2024-05-07T14:03:39.668790+0000","last_unstale":"2024-05-07T14:05:18.965151+0000","last_undegraded":"2024-05-07T14:05:18.965151+0000","last_fullsized":"2024-05-07T14:05:18.965151+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:14.798045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"81'8","reported_seq":319,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959979+0000","last_change":"2024-05-07T14:03:39.855375+0000","last_active":"2024-05-07T14:05:18.959979+0000","last_peered":"2024-05-07T14:05:18.959979+0000","last_clean":"2024-05-07T14:05:18.959979+0000","last_became_active":"2024-05-07T14:03:39.666451+0000","last_became_peered":"2024-05-07T14:03:39.666451+0000","last_unstale":"2024-05-07T14:05:18.959979+0000","last_undegraded":"2024-05-07T14:05:18.959979+0000","last_fullsized":"2024-05-07T14:05:18.959979+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:37.171990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"124'22","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961451+0000","last_change":"2024-05-07T14:05:00.248173+0000","last_active":"2024-05-07T14:05:18.961451+0000","last_peered":"2024-05-07T14:05:18.961451+0000","last_clean":"2024-05-07T14:05:18.961451+0000","last_became_active":"2024-05-07T14:04:59.455622+0000","last_became_peered":"2024-05-07T14:04:59.455622+0000","last_unstale":"2024-05-07T14:05:18.961451+0000","last_undegraded":"2024-05-07T14:05:18.961451+0000","last_fullsized":"2024-05-07T14:05:18.961451+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:03.691207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"115'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959101+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:05:18.959101+0000","last_peered":"2024-05-07T14:05:18.959101+0000","last_clean":"2024-05-07T14:05:18.959101+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:05:18.959101+0000","last_undegraded":"2024-05-07T14:05:18.959101+0000","last_fullsized":"2024-05-07T14:05:18.959101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"124'20","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963922+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:05:18.963922+0000","last_peered":"2024-05-07T14:05:18.963922+0000","last_clean":"2024-05-07T14:05:18.963922+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:05:18.963922+0000","last_undegraded":"2024-05-07T14:05:18.963922+0000","last_fullsized":"2024-05-07T14:05:18.963922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"106'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960114+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:05:18.960114+0000","last_peered":"2024-05-07T14:05:18.960114+0000","last_clean":"2024-05-07T14:05:18.960114+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:05:18.960114+0000","last_undegraded":"2024-05-07T14:05:18.960114+0000","last_fullsized":"2024-05-07T14:05:18.960114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"124'29","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720842+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:05:18.720842+0000","last_peered":"2024-05-07T14:05:18.720842+0000","last_clean":"2024-05-07T14:05:18.720842+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:05:18.720842+0000","last_undegraded":"2024-05-07T14:05:18.720842+0000","last_fullsized":"2024-05-07T14:05:18.720842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":39,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630722+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:05:18.630722+0000","last_peered":"2024-05-07T14:05:18.630722+0000","last_clean":"2024-05-07T14:05:18.630722+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:05:18.630722+0000","last_undegraded":"2024-05-07T14:05:18.630722+0000","last_fullsized":"2024-05-07T14:05:18.630722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"124'24","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960162+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:05:18.960162+0000","last_peered":"2024-05-07T14:05:18.960162+0000","last_clean":"2024-05-07T14:05:18.960162+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:05:18.960162+0000","last_undegraded":"2024-05-07T14:05:18.960162+0000","last_fullsized":"2024-05-07T14:05:18.960162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"106'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630125+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:05:18.630125+0000","last_peered":"2024-05-07T14:05:18.630125+0000","last_clean":"2024-05-07T14:05:18.630125+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:05:18.630125+0000","last_undegraded":"2024-05-07T14:05:18.630125+0000","last_fullsized":"2024-05-07T14:05:18.630125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"124'27","reported_seq":304,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720928+0000","last_change":"2024-05-07T14:04:59.856502+0000","last_active":"2024-05-07T14:05:18.720928+0000","last_peered":"2024-05-07T14:05:18.720928+0000","last_clean":"2024-05-07T14:05:18.720928+0000","last_became_active":"2024-05-07T14:04:59.443769+0000","last_became_peered":"2024-05-07T14:04:59.443769+0000","last_unstale":"2024-05-07T14:05:18.720928+0000","last_undegraded":"2024-05-07T14:05:18.720928+0000","last_fullsized":"2024-05-07T14:05:18.720928+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:48:34.692070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631323+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:05:18.631323+0000","last_peered":"2024-05-07T14:05:18.631323+0000","last_clean":"2024-05-07T14:05:18.631323+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:05:18.631323+0000","last_undegraded":"2024-05-07T14:05:18.631323+0000","last_fullsized":"2024-05-07T14:05:18.631323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"124'27","reported_seq":309,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960488+0000","last_change":"2024-05-07T14:05:01.098433+0000","last_active":"2024-05-07T14:05:18.960488+0000","last_peered":"2024-05-07T14:05:18.960488+0000","last_clean":"2024-05-07T14:05:18.960488+0000","last_became_active":"2024-05-07T14:04:59.458388+0000","last_became_peered":"2024-05-07T14:04:59.458388+0000","last_unstale":"2024-05-07T14:05:18.960488+0000","last_undegraded":"2024-05-07T14:05:18.960488+0000","last_fullsized":"2024-05-07T14:05:18.960488+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:29:00.050525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"81'6","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961340+0000","last_change":"2024-05-07T14:04:59.449854+0000","last_active":"2024-05-07T14:05:18.961340+0000","last_peered":"2024-05-07T14:05:18.961340+0000","last_clean":"2024-05-07T14:05:18.961340+0000","last_became_active":"2024-05-07T14:04:59.448913+0000","last_became_peered":"2024-05-07T14:04:59.448913+0000","last_unstale":"2024-05-07T14:05:18.961340+0000","last_undegraded":"2024-05-07T14:05:18.961340+0000","last_fullsized":"2024-05-07T14:05:18.961340+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:39.717523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"124'29","reported_seq":286,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960737+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:05:18.960737+0000","last_peered":"2024-05-07T14:05:18.960737+0000","last_clean":"2024-05-07T14:05:18.960737+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:05:18.960737+0000","last_undegraded":"2024-05-07T14:05:18.960737+0000","last_fullsized":"2024-05-07T14:05:18.960737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119537664,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"87'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958982+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:05:18.958982+0000","last_peered":"2024-05-07T14:05:18.958982+0000","last_clean":"2024-05-07T14:05:18.958982+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:05:18.958982+0000","last_undegraded":"2024-05-07T14:05:18.958982+0000","last_fullsized":"2024-05-07T14:05:18.958982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"123'23","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961924+0000","last_change":"2024-05-07T14:05:02.233669+0000","last_active":"2024-05-07T14:05:18.961924+0000","last_peered":"2024-05-07T14:05:18.961924+0000","last_clean":"2024-05-07T14:05:18.961924+0000","last_became_active":"2024-05-07T14:04:59.459490+0000","last_became_peered":"2024-05-07T14:04:59.459490+0000","last_unstale":"2024-05-07T14:05:18.961924+0000","last_undegraded":"2024-05-07T14:05:18.961924+0000","last_fullsized":"2024-05-07T14:05:18.961924+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:24.042272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"81'6","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959954+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:05:18.959954+0000","last_peered":"2024-05-07T14:05:18.959954+0000","last_clean":"2024-05-07T14:05:18.959954+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:05:18.959954+0000","last_undegraded":"2024-05-07T14:05:18.959954+0000","last_fullsized":"2024-05-07T14:05:18.959954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"124'26","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630545+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:05:18.630545+0000","last_peered":"2024-05-07T14:05:18.630545+0000","last_clean":"2024-05-07T14:05:18.630545+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:05:18.630545+0000","last_undegraded":"2024-05-07T14:05:18.630545+0000","last_fullsized":"2024-05-07T14:05:18.630545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"124'6","reported_seq":199,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960492+0000","last_change":"2024-05-07T14:05:00.223495+0000","last_active":"2024-05-07T14:05:18.960492+0000","last_peered":"2024-05-07T14:05:18.960492+0000","last_clean":"2024-05-07T14:05:18.960492+0000","last_became_active":"2024-05-07T14:04:59.442569+0000","last_became_peered":"2024-05-07T14:04:59.442569+0000","last_unstale":"2024-05-07T14:05:18.960492+0000","last_undegraded":"2024-05-07T14:05:18.960492+0000","last_fullsized":"2024-05-07T14:05:18.960492+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:10.158704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"124'26","reported_seq":300,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722687+0000","last_change":"2024-05-07T14:05:01.256475+0000","last_active":"2024-05-07T14:05:18.722687+0000","last_peered":"2024-05-07T14:05:18.722687+0000","last_clean":"2024-05-07T14:05:18.722687+0000","last_became_active":"2024-05-07T14:04:59.461335+0000","last_became_peered":"2024-05-07T14:04:59.461335+0000","last_unstale":"2024-05-07T14:05:18.722687+0000","last_undegraded":"2024-05-07T14:05:18.722687+0000","last_fullsized":"2024-05-07T14:05:18.722687+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:34.213014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"124'24","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720700+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:05:18.720700+0000","last_peered":"2024-05-07T14:05:18.720700+0000","last_clean":"2024-05-07T14:05:18.720700+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:05:18.720700+0000","last_undegraded":"2024-05-07T14:05:18.720700+0000","last_fullsized":"2024-05-07T14:05:18.720700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"124'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959984+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:05:18.959984+0000","last_peered":"2024-05-07T14:05:18.959984+0000","last_clean":"2024-05-07T14:05:18.959984+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:05:18.959984+0000","last_undegraded":"2024-05-07T14:05:18.959984+0000","last_fullsized":"2024-05-07T14:05:18.959984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"124'21","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963118+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:05:18.963118+0000","last_peered":"2024-05-07T14:05:18.963118+0000","last_clean":"2024-05-07T14:05:18.963118+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:05:18.963118+0000","last_undegraded":"2024-05-07T14:05:18.963118+0000","last_fullsized":"2024-05-07T14:05:18.963118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"106'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722115+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:05:18.722115+0000","last_peered":"2024-05-07T14:05:18.722115+0000","last_clean":"2024-05-07T14:05:18.722115+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:05:18.722115+0000","last_undegraded":"2024-05-07T14:05:18.722115+0000","last_fullsized":"2024-05-07T14:05:18.722115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":313,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1094,"ondisk_log_size":1094,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382934,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":846,"num_read_kb":608,"num_write":467,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":121255,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":763,"ondisk_log_size":763,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":341,"num_read_kb":341,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1436,"num_read_kb":1404,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":620756992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":129,"seq":554050781192,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1805596,"kb_used_data":1769364,"kb_used_omap":6,"kb_used_meta":36217,"kb_avail":92566244,"statfs":{"total":96636764160,"available":94787833856,"internally_reserved":0,"allocated":1811828736,"data_stored":1811073810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6345,"internal_metadata":37087031},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1266508,"kb_used_data":1235332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93105332,"statfs":{"total":96636764160,"available":95339859968,"internally_reserved":0,"allocated":1264979968,"data_stored":1264248696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1941880,"kb_used_data":1906544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92429960,"statfs":{"total":96636764160,"available":94648279040,"internally_reserved":0,"allocated":1952301056,"data_stored":1951526125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1749148,"kb_used_data":1717960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92622692,"statfs":{"total":96636764160,"available":94845636608,"internally_reserved":0,"allocated":1759191040,"data_stored":1758470596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1917804,"kb_used_data":1882468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92454036,"statfs":{"total":96636764160,"available":94672932864,"internally_reserved":0,"allocated":1927647232,"data_stored":1926891074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1015952,"kb_used_data":984776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93355888,"statfs":{"total":96636764160,"available":95596429312,"internally_reserved":0,"allocated":1008410624,"data_stored":1007689142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1192296,"kb_used_data":1156960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93179544,"statfs":{"total":96636764160,"available":95415853056,"internally_reserved":0,"allocated":1184727040,"data_stored":1183969856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1698080,"kb_used_data":1666900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92673760,"statfs":{"total":96636764160,"available":94897930240,"internally_reserved":0,"allocated":1706905600,"data_stored":1706157621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1704984576,"data_stored":1704984576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1182793728,"data_stored":1182793728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1006632960,"data_stored":1006632960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1925185536,"data_stored":1925185536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1757413376,"data_stored":1757413376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1950351360,"data_stored":1950351360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1262485504,"data_stored":1262485504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1809842176,"data_stored":1809842176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":117239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":119338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":119222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":117465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":176275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:05:32.433 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-07T14:05:32.433 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:05:32.805 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:05:32.811 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:05:32.825 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-05-07T14:05:31.328855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300819926,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3104,"num_read_kb":2790,"num_write":2847,"num_write_kb":6187914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":621470484,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3918,"ondisk_log_size":3918,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12587264,"kb_used_data":12320304,"kb_used_omap":17,"kb_used_meta":266862,"kb_avail":742387456,"statfs":{"total":773094113280,"available":760204754944,"internally_reserved":0,"allocated":12615991296,"data_stored":12610026920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17505,"internal_metadata":273267615},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005951"},"pg_stats":[{"pgid":"3.3f","version":"124'29","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963765+0000","last_change":"2024-05-07T14:05:02.012333+0000","last_active":"2024-05-07T14:05:18.963765+0000","last_peered":"2024-05-07T14:05:18.963765+0000","last_clean":"2024-05-07T14:05:18.963765+0000","last_became_active":"2024-05-07T14:04:59.458324+0000","last_became_peered":"2024-05-07T14:04:59.458324+0000","last_unstale":"2024-05-07T14:05:18.963765+0000","last_undegraded":"2024-05-07T14:05:18.963765+0000","last_fullsized":"2024-05-07T14:05:18.963765+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:58:18.777392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719899+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:05:18.719899+0000","last_peered":"2024-05-07T14:05:18.719899+0000","last_clean":"2024-05-07T14:05:18.719899+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:05:18.719899+0000","last_undegraded":"2024-05-07T14:05:18.719899+0000","last_fullsized":"2024-05-07T14:05:18.719899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"124'29","reported_seq":133,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959961+0000","last_change":"2024-05-07T14:03:39.850495+0000","last_active":"2024-05-07T14:05:18.959961+0000","last_peered":"2024-05-07T14:05:18.959961+0000","last_clean":"2024-05-07T14:05:18.959961+0000","last_became_active":"2024-05-07T14:03:39.676092+0000","last_became_peered":"2024-05-07T14:03:39.676092+0000","last_unstale":"2024-05-07T14:05:18.959961+0000","last_undegraded":"2024-05-07T14:05:18.959961+0000","last_fullsized":"2024-05-07T14:05:18.959961+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:00.668304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"80'2","reported_seq":172,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963019+0000","last_change":"2024-05-07T14:04:59.442787+0000","last_active":"2024-05-07T14:05:18.963019+0000","last_peered":"2024-05-07T14:05:18.963019+0000","last_clean":"2024-05-07T14:05:18.963019+0000","last_became_active":"2024-05-07T14:04:59.430479+0000","last_became_peered":"2024-05-07T14:04:59.430479+0000","last_unstale":"2024-05-07T14:05:18.963019+0000","last_undegraded":"2024-05-07T14:05:18.963019+0000","last_fullsized":"2024-05-07T14:05:18.963019+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:27.875022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"124'20","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959370+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:05:18.959370+0000","last_peered":"2024-05-07T14:05:18.959370+0000","last_clean":"2024-05-07T14:05:18.959370+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:05:18.959370+0000","last_undegraded":"2024-05-07T14:05:18.959370+0000","last_fullsized":"2024-05-07T14:05:18.959370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629168+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:05:18.629168+0000","last_peered":"2024-05-07T14:05:18.629168+0000","last_clean":"2024-05-07T14:05:18.629168+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:05:18.629168+0000","last_undegraded":"2024-05-07T14:05:18.629168+0000","last_fullsized":"2024-05-07T14:05:18.629168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"124'25","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721240+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:05:18.721240+0000","last_peered":"2024-05-07T14:05:18.721240+0000","last_clean":"2024-05-07T14:05:18.721240+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:05:18.721240+0000","last_undegraded":"2024-05-07T14:05:18.721240+0000","last_fullsized":"2024-05-07T14:05:18.721240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"81'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960256+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:05:18.960256+0000","last_peered":"2024-05-07T14:05:18.960256+0000","last_clean":"2024-05-07T14:05:18.960256+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:05:18.960256+0000","last_undegraded":"2024-05-07T14:05:18.960256+0000","last_fullsized":"2024-05-07T14:05:18.960256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"124'24","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961071+0000","last_change":"2024-05-07T14:05:01.033639+0000","last_active":"2024-05-07T14:05:18.961071+0000","last_peered":"2024-05-07T14:05:18.961071+0000","last_clean":"2024-05-07T14:05:18.961071+0000","last_became_active":"2024-05-07T14:04:59.455288+0000","last_became_peered":"2024-05-07T14:04:59.455288+0000","last_unstale":"2024-05-07T14:05:18.961071+0000","last_undegraded":"2024-05-07T14:05:18.961071+0000","last_fullsized":"2024-05-07T14:05:18.961071+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:06:05.572323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"115'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960336+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:05:18.960336+0000","last_peered":"2024-05-07T14:05:18.960336+0000","last_clean":"2024-05-07T14:05:18.960336+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:05:18.960336+0000","last_undegraded":"2024-05-07T14:05:18.960336+0000","last_fullsized":"2024-05-07T14:05:18.960336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"124'19","reported_seq":275,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720428+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:05:18.720428+0000","last_peered":"2024-05-07T14:05:18.720428+0000","last_clean":"2024-05-07T14:05:18.720428+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:05:18.720428+0000","last_undegraded":"2024-05-07T14:05:18.720428+0000","last_fullsized":"2024-05-07T14:05:18.720428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"115'4","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630099+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:05:18.630099+0000","last_peered":"2024-05-07T14:05:18.630099+0000","last_clean":"2024-05-07T14:05:18.630099+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:05:18.630099+0000","last_undegraded":"2024-05-07T14:05:18.630099+0000","last_fullsized":"2024-05-07T14:05:18.630099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"124'25","reported_seq":274,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962077+0000","last_change":"2024-05-07T14:05:00.220571+0000","last_active":"2024-05-07T14:05:18.962077+0000","last_peered":"2024-05-07T14:05:18.962077+0000","last_clean":"2024-05-07T14:05:18.962077+0000","last_became_active":"2024-05-07T14:04:59.444214+0000","last_became_peered":"2024-05-07T14:04:59.444214+0000","last_unstale":"2024-05-07T14:05:18.962077+0000","last_undegraded":"2024-05-07T14:05:18.962077+0000","last_fullsized":"2024-05-07T14:05:18.962077+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:18:23.503893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"81'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721808+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:05:18.721808+0000","last_peered":"2024-05-07T14:05:18.721808+0000","last_clean":"2024-05-07T14:05:18.721808+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:05:18.721808+0000","last_undegraded":"2024-05-07T14:05:18.721808+0000","last_fullsized":"2024-05-07T14:05:18.721808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"124'23","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959282+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:05:18.959282+0000","last_peered":"2024-05-07T14:05:18.959282+0000","last_clean":"2024-05-07T14:05:18.959282+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:05:18.959282+0000","last_undegraded":"2024-05-07T14:05:18.959282+0000","last_fullsized":"2024-05-07T14:05:18.959282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"124'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630377+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:05:18.630377+0000","last_peered":"2024-05-07T14:05:18.630377+0000","last_clean":"2024-05-07T14:05:18.630377+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:05:18.630377+0000","last_undegraded":"2024-05-07T14:05:18.630377+0000","last_fullsized":"2024-05-07T14:05:18.630377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628673+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:05:18.628673+0000","last_peered":"2024-05-07T14:05:18.628673+0000","last_clean":"2024-05-07T14:05:18.628673+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:05:18.628673+0000","last_undegraded":"2024-05-07T14:05:18.628673+0000","last_fullsized":"2024-05-07T14:05:18.628673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"124'23","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961950+0000","last_change":"2024-05-07T14:05:01.245123+0000","last_active":"2024-05-07T14:05:18.961950+0000","last_peered":"2024-05-07T14:05:18.961950+0000","last_clean":"2024-05-07T14:05:18.961950+0000","last_became_active":"2024-05-07T14:04:59.452315+0000","last_became_peered":"2024-05-07T14:04:59.452315+0000","last_unstale":"2024-05-07T14:05:18.961950+0000","last_undegraded":"2024-05-07T14:05:18.961950+0000","last_fullsized":"2024-05-07T14:05:18.961950+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:20:40.045208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962499+0000","last_change":"2024-05-07T14:04:59.435447+0000","last_active":"2024-05-07T14:05:18.962499+0000","last_peered":"2024-05-07T14:05:18.962499+0000","last_clean":"2024-05-07T14:05:18.962499+0000","last_became_active":"2024-05-07T14:04:59.429254+0000","last_became_peered":"2024-05-07T14:04:59.429254+0000","last_unstale":"2024-05-07T14:05:18.962499+0000","last_undegraded":"2024-05-07T14:05:18.962499+0000","last_fullsized":"2024-05-07T14:05:18.962499+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:42:46.014749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"124'23","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961038+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:05:18.961038+0000","last_peered":"2024-05-07T14:05:18.961038+0000","last_clean":"2024-05-07T14:05:18.961038+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:05:18.961038+0000","last_undegraded":"2024-05-07T14:05:18.961038+0000","last_fullsized":"2024-05-07T14:05:18.961038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":252,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720762+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:05:18.720762+0000","last_peered":"2024-05-07T14:05:18.720762+0000","last_clean":"2024-05-07T14:05:18.720762+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:05:18.720762+0000","last_undegraded":"2024-05-07T14:05:18.720762+0000","last_fullsized":"2024-05-07T14:05:18.720762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"124'31","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963739+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:05:18.963739+0000","last_peered":"2024-05-07T14:05:18.963739+0000","last_clean":"2024-05-07T14:05:18.963739+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:05:18.963739+0000","last_undegraded":"2024-05-07T14:05:18.963739+0000","last_fullsized":"2024-05-07T14:05:18.963739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"124'10","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629192+0000","last_change":"2024-05-07T14:01:37.318563+0000","last_active":"2024-05-07T14:05:18.629192+0000","last_peered":"2024-05-07T14:05:18.629192+0000","last_clean":"2024-05-07T14:05:18.629192+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:05:18.629192+0000","last_undegraded":"2024-05-07T14:05:18.629192+0000","last_fullsized":"2024-05-07T14:05:18.629192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:27.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629565+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:05:18.629565+0000","last_peered":"2024-05-07T14:05:18.629565+0000","last_clean":"2024-05-07T14:05:18.629565+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:05:18.629565+0000","last_undegraded":"2024-05-07T14:05:18.629565+0000","last_fullsized":"2024-05-07T14:05:18.629565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"106'8","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629560+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:05:18.629560+0000","last_peered":"2024-05-07T14:05:18.629560+0000","last_clean":"2024-05-07T14:05:18.629560+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:05:18.629560+0000","last_undegraded":"2024-05-07T14:05:18.629560+0000","last_fullsized":"2024-05-07T14:05:18.629560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"124'32","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964588+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:05:18.964588+0000","last_peered":"2024-05-07T14:05:18.964588+0000","last_clean":"2024-05-07T14:05:18.964588+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:05:18.964588+0000","last_undegraded":"2024-05-07T14:05:18.964588+0000","last_fullsized":"2024-05-07T14:05:18.964588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"106'2","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630109+0000","last_change":"2024-05-07T14:03:39.848413+0000","last_active":"2024-05-07T14:05:18.630109+0000","last_peered":"2024-05-07T14:05:18.630109+0000","last_clean":"2024-05-07T14:05:18.630109+0000","last_became_active":"2024-05-07T14:03:39.663590+0000","last_became_peered":"2024-05-07T14:03:39.663590+0000","last_unstale":"2024-05-07T14:05:18.630109+0000","last_undegraded":"2024-05-07T14:05:18.630109+0000","last_fullsized":"2024-05-07T14:05:18.630109+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:02.675624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"124'19","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959332+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:05:18.959332+0000","last_peered":"2024-05-07T14:05:18.959332+0000","last_clean":"2024-05-07T14:05:18.959332+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:05:18.959332+0000","last_undegraded":"2024-05-07T14:05:18.959332+0000","last_fullsized":"2024-05-07T14:05:18.959332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628129+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:05:18.628129+0000","last_peered":"2024-05-07T14:05:18.628129+0000","last_clean":"2024-05-07T14:05:18.628129+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:05:18.628129+0000","last_undegraded":"2024-05-07T14:05:18.628129+0000","last_fullsized":"2024-05-07T14:05:18.628129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"81'2","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963957+0000","last_change":"2024-05-07T14:03:39.857355+0000","last_active":"2024-05-07T14:05:18.963957+0000","last_peered":"2024-05-07T14:05:18.963957+0000","last_clean":"2024-05-07T14:05:18.963957+0000","last_became_active":"2024-05-07T14:03:39.680721+0000","last_became_peered":"2024-05-07T14:03:39.680721+0000","last_unstale":"2024-05-07T14:05:18.963957+0000","last_undegraded":"2024-05-07T14:05:18.963957+0000","last_fullsized":"2024-05-07T14:05:18.963957+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:36.092563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"124'19","reported_seq":224,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629050+0000","last_change":"2024-05-07T14:01:37.311718+0000","last_active":"2024-05-07T14:05:18.629050+0000","last_peered":"2024-05-07T14:05:18.629050+0000","last_clean":"2024-05-07T14:05:18.629050+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:05:18.629050+0000","last_undegraded":"2024-05-07T14:05:18.629050+0000","last_fullsized":"2024-05-07T14:05:18.629050+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:24.211300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721497+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:05:18.721497+0000","last_peered":"2024-05-07T14:05:18.721497+0000","last_clean":"2024-05-07T14:05:18.721497+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:05:18.721497+0000","last_undegraded":"2024-05-07T14:05:18.721497+0000","last_fullsized":"2024-05-07T14:05:18.721497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"124'17","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961100+0000","last_change":"2024-05-07T14:04:59.457299+0000","last_active":"2024-05-07T14:05:18.961100+0000","last_peered":"2024-05-07T14:05:18.961100+0000","last_clean":"2024-05-07T14:05:18.961100+0000","last_became_active":"2024-05-07T14:04:59.455429+0000","last_became_peered":"2024-05-07T14:04:59.455429+0000","last_unstale":"2024-05-07T14:05:18.961100+0000","last_undegraded":"2024-05-07T14:05:18.961100+0000","last_fullsized":"2024-05-07T14:05:18.961100+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:29.054055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964269+0000","last_change":"2024-05-07T14:04:59.462184+0000","last_active":"2024-05-07T14:05:18.964269+0000","last_peered":"2024-05-07T14:05:18.964269+0000","last_clean":"2024-05-07T14:05:18.964269+0000","last_became_active":"2024-05-07T14:04:59.456374+0000","last_became_peered":"2024-05-07T14:04:59.456374+0000","last_unstale":"2024-05-07T14:05:18.964269+0000","last_undegraded":"2024-05-07T14:05:18.964269+0000","last_fullsized":"2024-05-07T14:05:18.964269+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:06.581660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"124'50","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719930+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:05:18.719930+0000","last_peered":"2024-05-07T14:05:18.719930+0000","last_clean":"2024-05-07T14:05:18.719930+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:05:18.719930+0000","last_undegraded":"2024-05-07T14:05:18.719930+0000","last_fullsized":"2024-05-07T14:05:18.719930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"81'6","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722091+0000","last_change":"2024-05-07T14:04:59.467076+0000","last_active":"2024-05-07T14:05:18.722091+0000","last_peered":"2024-05-07T14:05:18.722091+0000","last_clean":"2024-05-07T14:05:18.722091+0000","last_became_active":"2024-05-07T14:04:59.466480+0000","last_became_peered":"2024-05-07T14:04:59.466480+0000","last_unstale":"2024-05-07T14:05:18.722091+0000","last_undegraded":"2024-05-07T14:05:18.722091+0000","last_fullsized":"2024-05-07T14:05:18.722091+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:02.334693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"124'20","reported_seq":301,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959429+0000","last_change":"2024-05-07T14:05:00.106363+0000","last_active":"2024-05-07T14:05:18.959429+0000","last_peered":"2024-05-07T14:05:18.959429+0000","last_clean":"2024-05-07T14:05:18.959429+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:18.959429+0000","last_undegraded":"2024-05-07T14:05:18.959429+0000","last_fullsized":"2024-05-07T14:05:18.959429+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:03.250892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81788928,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964245+0000","last_change":"2024-05-07T14:04:59.446944+0000","last_active":"2024-05-07T14:05:18.964245+0000","last_peered":"2024-05-07T14:05:18.964245+0000","last_clean":"2024-05-07T14:05:18.964245+0000","last_became_active":"2024-05-07T14:04:59.445994+0000","last_became_peered":"2024-05-07T14:04:59.445994+0000","last_unstale":"2024-05-07T14:05:18.964245+0000","last_undegraded":"2024-05-07T14:05:18.964245+0000","last_fullsized":"2024-05-07T14:05:18.964245+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:08.275415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"81'7","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630813+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:05:18.630813+0000","last_peered":"2024-05-07T14:05:18.630813+0000","last_clean":"2024-05-07T14:05:18.630813+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:05:18.630813+0000","last_undegraded":"2024-05-07T14:05:18.630813+0000","last_fullsized":"2024-05-07T14:05:18.630813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629526+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:05:18.629526+0000","last_peered":"2024-05-07T14:05:18.629526+0000","last_clean":"2024-05-07T14:05:18.629526+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:05:18.629526+0000","last_undegraded":"2024-05-07T14:05:18.629526+0000","last_fullsized":"2024-05-07T14:05:18.629526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"115'8","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959036+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:05:18.959036+0000","last_peered":"2024-05-07T14:05:18.959036+0000","last_clean":"2024-05-07T14:05:18.959036+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:05:18.959036+0000","last_undegraded":"2024-05-07T14:05:18.959036+0000","last_fullsized":"2024-05-07T14:05:18.959036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"81'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962932+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:05:18.962932+0000","last_peered":"2024-05-07T14:05:18.962932+0000","last_clean":"2024-05-07T14:05:18.962932+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:05:18.962932+0000","last_undegraded":"2024-05-07T14:05:18.962932+0000","last_fullsized":"2024-05-07T14:05:18.962932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"124'16","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961915+0000","last_change":"2024-05-07T14:04:59.911990+0000","last_active":"2024-05-07T14:05:18.961915+0000","last_peered":"2024-05-07T14:05:18.961915+0000","last_clean":"2024-05-07T14:05:18.961915+0000","last_became_active":"2024-05-07T14:04:59.436710+0000","last_became_peered":"2024-05-07T14:04:59.436710+0000","last_unstale":"2024-05-07T14:05:18.961915+0000","last_undegraded":"2024-05-07T14:05:18.961915+0000","last_fullsized":"2024-05-07T14:05:18.961915+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:27:02.713493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964441+0000","last_change":"2024-05-07T14:03:39.680812+0000","last_active":"2024-05-07T14:05:18.964441+0000","last_peered":"2024-05-07T14:05:18.964441+0000","last_clean":"2024-05-07T14:05:18.964441+0000","last_became_active":"2024-05-07T14:03:39.680482+0000","last_became_peered":"2024-05-07T14:03:39.680482+0000","last_unstale":"2024-05-07T14:05:18.964441+0000","last_undegraded":"2024-05-07T14:05:18.964441+0000","last_fullsized":"2024-05-07T14:05:18.964441+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:07.705255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"81'13","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629238+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:05:18.629238+0000","last_peered":"2024-05-07T14:05:18.629238+0000","last_clean":"2024-05-07T14:05:18.629238+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:05:18.629238+0000","last_undegraded":"2024-05-07T14:05:18.629238+0000","last_fullsized":"2024-05-07T14:05:18.629238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"146'141","reported_seq":413,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.273181+0000","last_change":"2024-05-07T14:05:02.234601+0000","last_active":"2024-05-07T14:05:20.273181+0000","last_peered":"2024-05-07T14:05:20.273181+0000","last_clean":"2024-05-07T14:05:20.273181+0000","last_became_active":"2024-05-07T14:04:59.463533+0000","last_became_peered":"2024-05-07T14:04:59.463533+0000","last_unstale":"2024-05-07T14:05:20.273181+0000","last_undegraded":"2024-05-07T14:05:20.273181+0000","last_fullsized":"2024-05-07T14:05:20.273181+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:50:50.067203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628944+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:05:18.628944+0000","last_peered":"2024-05-07T14:05:18.628944+0000","last_clean":"2024-05-07T14:05:18.628944+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:05:18.628944+0000","last_undegraded":"2024-05-07T14:05:18.628944+0000","last_fullsized":"2024-05-07T14:05:18.628944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"87'16","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963783+0000","last_change":"2024-05-07T14:04:59.462968+0000","last_active":"2024-05-07T14:05:18.963783+0000","last_peered":"2024-05-07T14:05:18.963783+0000","last_clean":"2024-05-07T14:05:18.963783+0000","last_became_active":"2024-05-07T14:04:59.461575+0000","last_became_peered":"2024-05-07T14:04:59.461575+0000","last_unstale":"2024-05-07T14:05:18.963783+0000","last_undegraded":"2024-05-07T14:05:18.963783+0000","last_fullsized":"2024-05-07T14:05:18.963783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:36.220334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"123'26","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959411+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:05:18.959411+0000","last_peered":"2024-05-07T14:05:18.959411+0000","last_clean":"2024-05-07T14:05:18.959411+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:05:18.959411+0000","last_undegraded":"2024-05-07T14:05:18.959411+0000","last_fullsized":"2024-05-07T14:05:18.959411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721681+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:05:18.721681+0000","last_peered":"2024-05-07T14:05:18.721681+0000","last_clean":"2024-05-07T14:05:18.721681+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:05:18.721681+0000","last_undegraded":"2024-05-07T14:05:18.721681+0000","last_fullsized":"2024-05-07T14:05:18.721681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"124'17","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962423+0000","last_change":"2024-05-07T14:04:59.462754+0000","last_active":"2024-05-07T14:05:18.962423+0000","last_peered":"2024-05-07T14:05:18.962423+0000","last_clean":"2024-05-07T14:05:18.962423+0000","last_became_active":"2024-05-07T14:04:59.459905+0000","last_became_peered":"2024-05-07T14:04:59.459905+0000","last_unstale":"2024-05-07T14:05:18.962423+0000","last_undegraded":"2024-05-07T14:05:18.962423+0000","last_fullsized":"2024-05-07T14:05:18.962423+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:02:35.111917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"146'135","reported_seq":428,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272020+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:05:20.272020+0000","last_peered":"2024-05-07T14:05:20.272020+0000","last_clean":"2024-05-07T14:05:20.272020+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:05:20.272020+0000","last_undegraded":"2024-05-07T14:05:20.272020+0000","last_fullsized":"2024-05-07T14:05:20.272020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"81'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720435+0000","last_change":"2024-05-07T14:04:59.447718+0000","last_active":"2024-05-07T14:05:18.720435+0000","last_peered":"2024-05-07T14:05:18.720435+0000","last_clean":"2024-05-07T14:05:18.720435+0000","last_became_active":"2024-05-07T14:04:59.446891+0000","last_became_peered":"2024-05-07T14:04:59.446891+0000","last_unstale":"2024-05-07T14:05:18.720435+0000","last_undegraded":"2024-05-07T14:05:18.720435+0000","last_fullsized":"2024-05-07T14:05:18.720435+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:42.667572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"124'33","reported_seq":286,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964093+0000","last_change":"2024-05-07T14:05:01.651799+0000","last_active":"2024-05-07T14:05:18.964093+0000","last_peered":"2024-05-07T14:05:18.964093+0000","last_clean":"2024-05-07T14:05:18.964093+0000","last_became_active":"2024-05-07T14:04:59.452426+0000","last_became_peered":"2024-05-07T14:04:59.452426+0000","last_unstale":"2024-05-07T14:05:18.964093+0000","last_undegraded":"2024-05-07T14:05:18.964093+0000","last_fullsized":"2024-05-07T14:05:18.964093+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:49.540606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963448+0000","last_change":"2024-05-07T14:04:59.445984+0000","last_active":"2024-05-07T14:05:18.963448+0000","last_peered":"2024-05-07T14:05:18.963448+0000","last_clean":"2024-05-07T14:05:18.963448+0000","last_became_active":"2024-05-07T14:04:59.445281+0000","last_became_peered":"2024-05-07T14:04:59.445281+0000","last_unstale":"2024-05-07T14:05:18.963448+0000","last_undegraded":"2024-05-07T14:05:18.963448+0000","last_fullsized":"2024-05-07T14:05:18.963448+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:59:14.548669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"124'28","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720191+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:05:18.720191+0000","last_peered":"2024-05-07T14:05:18.720191+0000","last_clean":"2024-05-07T14:05:18.720191+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:05:18.720191+0000","last_undegraded":"2024-05-07T14:05:18.720191+0000","last_fullsized":"2024-05-07T14:05:18.720191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960274+0000","last_change":"2024-05-07T14:03:39.666526+0000","last_active":"2024-05-07T14:05:18.960274+0000","last_peered":"2024-05-07T14:05:18.960274+0000","last_clean":"2024-05-07T14:05:18.960274+0000","last_became_active":"2024-05-07T14:03:39.666160+0000","last_became_peered":"2024-05-07T14:03:39.666160+0000","last_unstale":"2024-05-07T14:05:18.960274+0000","last_undegraded":"2024-05-07T14:05:18.960274+0000","last_fullsized":"2024-05-07T14:05:18.960274+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:44.560061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720476+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:05:18.720476+0000","last_peered":"2024-05-07T14:05:18.720476+0000","last_clean":"2024-05-07T14:05:18.720476+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:05:18.720476+0000","last_undegraded":"2024-05-07T14:05:18.720476+0000","last_fullsized":"2024-05-07T14:05:18.720476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630857+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:05:18.630857+0000","last_peered":"2024-05-07T14:05:18.630857+0000","last_clean":"2024-05-07T14:05:18.630857+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:05:18.630857+0000","last_undegraded":"2024-05-07T14:05:18.630857+0000","last_fullsized":"2024-05-07T14:05:18.630857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"124'27","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962532+0000","last_change":"2024-05-07T14:04:59.801081+0000","last_active":"2024-05-07T14:05:18.962532+0000","last_peered":"2024-05-07T14:05:18.962532+0000","last_clean":"2024-05-07T14:05:18.962532+0000","last_became_active":"2024-05-07T14:04:59.421863+0000","last_became_peered":"2024-05-07T14:04:59.421863+0000","last_unstale":"2024-05-07T14:05:18.962532+0000","last_undegraded":"2024-05-07T14:05:18.962532+0000","last_fullsized":"2024-05-07T14:05:18.962532+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:48.094723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":338,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628182+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:05:18.628182+0000","last_peered":"2024-05-07T14:05:18.628182+0000","last_clean":"2024-05-07T14:05:18.628182+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:05:18.628182+0000","last_undegraded":"2024-05-07T14:05:18.628182+0000","last_fullsized":"2024-05-07T14:05:18.628182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"124'17","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965471+0000","last_change":"2024-05-07T14:04:59.447540+0000","last_active":"2024-05-07T14:05:18.965471+0000","last_peered":"2024-05-07T14:05:18.965471+0000","last_clean":"2024-05-07T14:05:18.965471+0000","last_became_active":"2024-05-07T14:04:59.446737+0000","last_became_peered":"2024-05-07T14:04:59.446737+0000","last_unstale":"2024-05-07T14:05:18.965471+0000","last_undegraded":"2024-05-07T14:05:18.965471+0000","last_fullsized":"2024-05-07T14:05:18.965471+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.352935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964757+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:05:18.964757+0000","last_peered":"2024-05-07T14:05:18.964757+0000","last_clean":"2024-05-07T14:05:18.964757+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:05:18.964757+0000","last_undegraded":"2024-05-07T14:05:18.964757+0000","last_fullsized":"2024-05-07T14:05:18.964757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"115'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962438+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:05:18.962438+0000","last_peered":"2024-05-07T14:05:18.962438+0000","last_clean":"2024-05-07T14:05:18.962438+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:05:18.962438+0000","last_undegraded":"2024-05-07T14:05:18.962438+0000","last_fullsized":"2024-05-07T14:05:18.962438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"81'6","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959923+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:05:18.959923+0000","last_peered":"2024-05-07T14:05:18.959923+0000","last_clean":"2024-05-07T14:05:18.959923+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:05:18.959923+0000","last_undegraded":"2024-05-07T14:05:18.959923+0000","last_fullsized":"2024-05-07T14:05:18.959923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"124'29","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961785+0000","last_change":"2024-05-07T14:05:00.740552+0000","last_active":"2024-05-07T14:05:18.961785+0000","last_peered":"2024-05-07T14:05:18.961785+0000","last_clean":"2024-05-07T14:05:18.961785+0000","last_became_active":"2024-05-07T14:04:59.449454+0000","last_became_peered":"2024-05-07T14:04:59.449454+0000","last_unstale":"2024-05-07T14:05:18.961785+0000","last_undegraded":"2024-05-07T14:05:18.961785+0000","last_fullsized":"2024-05-07T14:05:18.961785+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:28:19.138204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629731+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:05:18.629731+0000","last_peered":"2024-05-07T14:05:18.629731+0000","last_clean":"2024-05-07T14:05:18.629731+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:05:18.629731+0000","last_undegraded":"2024-05-07T14:05:18.629731+0000","last_fullsized":"2024-05-07T14:05:18.629731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"124'23","reported_seq":258,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961377+0000","last_change":"2024-05-07T14:04:59.459984+0000","last_active":"2024-05-07T14:05:18.961377+0000","last_peered":"2024-05-07T14:05:18.961377+0000","last_clean":"2024-05-07T14:05:18.961377+0000","last_became_active":"2024-05-07T14:04:59.458512+0000","last_became_peered":"2024-05-07T14:04:59.458512+0000","last_unstale":"2024-05-07T14:05:18.961377+0000","last_undegraded":"2024-05-07T14:05:18.961377+0000","last_fullsized":"2024-05-07T14:05:18.961377+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:11:09.127149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"146'139","reported_seq":453,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:24.296925+0000","last_change":"2024-05-07T14:03:42.700808+0000","last_active":"2024-05-07T14:05:24.296925+0000","last_peered":"2024-05-07T14:05:24.296925+0000","last_clean":"2024-05-07T14:05:24.296925+0000","last_became_active":"2024-05-07T14:03:42.700324+0000","last_became_peered":"2024-05-07T14:03:42.700324+0000","last_unstale":"2024-05-07T14:05:24.296925+0000","last_undegraded":"2024-05-07T14:05:24.296925+0000","last_fullsized":"2024-05-07T14:05:24.296925+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:47.369543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961454+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:05:18.961454+0000","last_peered":"2024-05-07T14:05:18.961454+0000","last_clean":"2024-05-07T14:05:18.961454+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:05:18.961454+0000","last_undegraded":"2024-05-07T14:05:18.961454+0000","last_fullsized":"2024-05-07T14:05:18.961454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"124'10","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960707+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:05:18.960707+0000","last_peered":"2024-05-07T14:05:18.960707+0000","last_clean":"2024-05-07T14:05:18.960707+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:05:18.960707+0000","last_undegraded":"2024-05-07T14:05:18.960707+0000","last_fullsized":"2024-05-07T14:05:18.960707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"124'36","reported_seq":293,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721736+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:05:18.721736+0000","last_peered":"2024-05-07T14:05:18.721736+0000","last_clean":"2024-05-07T14:05:18.721736+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:05:18.721736+0000","last_undegraded":"2024-05-07T14:05:18.721736+0000","last_fullsized":"2024-05-07T14:05:18.721736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150994944,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629126+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:05:18.629126+0000","last_peered":"2024-05-07T14:05:18.629126+0000","last_clean":"2024-05-07T14:05:18.629126+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:05:18.629126+0000","last_undegraded":"2024-05-07T14:05:18.629126+0000","last_fullsized":"2024-05-07T14:05:18.629126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"124'29","reported_seq":294,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958596+0000","last_change":"2024-05-07T14:04:59.456274+0000","last_active":"2024-05-07T14:05:18.958596+0000","last_peered":"2024-05-07T14:05:18.958596+0000","last_clean":"2024-05-07T14:05:18.958596+0000","last_became_active":"2024-05-07T14:04:59.455284+0000","last_became_peered":"2024-05-07T14:04:59.455284+0000","last_unstale":"2024-05-07T14:05:18.958596+0000","last_undegraded":"2024-05-07T14:05:18.958596+0000","last_fullsized":"2024-05-07T14:05:18.958596+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:44:18.184158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62356,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.627987+0000","last_change":"2024-05-07T14:04:59.467425+0000","last_active":"2024-05-07T14:05:18.627987+0000","last_peered":"2024-05-07T14:05:18.627987+0000","last_clean":"2024-05-07T14:05:18.627987+0000","last_became_active":"2024-05-07T14:04:59.466731+0000","last_became_peered":"2024-05-07T14:04:59.466731+0000","last_unstale":"2024-05-07T14:05:18.627987+0000","last_undegraded":"2024-05-07T14:05:18.627987+0000","last_fullsized":"2024-05-07T14:05:18.627987+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:57.541122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"121'5","reported_seq":111,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960905+0000","last_change":"2024-05-07T14:03:39.802033+0000","last_active":"2024-05-07T14:05:18.960905+0000","last_peered":"2024-05-07T14:05:18.960905+0000","last_clean":"2024-05-07T14:05:18.960905+0000","last_became_active":"2024-05-07T14:03:39.675695+0000","last_became_peered":"2024-05-07T14:03:39.675695+0000","last_unstale":"2024-05-07T14:05:18.960905+0000","last_undegraded":"2024-05-07T14:05:18.960905+0000","last_fullsized":"2024-05-07T14:05:18.960905+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:22:02.594405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"87'2","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630116+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:05:18.630116+0000","last_peered":"2024-05-07T14:05:18.630116+0000","last_clean":"2024-05-07T14:05:18.630116+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:05:18.630116+0000","last_undegraded":"2024-05-07T14:05:18.630116+0000","last_fullsized":"2024-05-07T14:05:18.630116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"124'26","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963663+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:05:18.963663+0000","last_peered":"2024-05-07T14:05:18.963663+0000","last_clean":"2024-05-07T14:05:18.963663+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:05:18.963663+0000","last_undegraded":"2024-05-07T14:05:18.963663+0000","last_fullsized":"2024-05-07T14:05:18.963663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":254,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629414+0000","last_change":"2024-05-07T14:04:59.468095+0000","last_active":"2024-05-07T14:05:18.629414+0000","last_peered":"2024-05-07T14:05:18.629414+0000","last_clean":"2024-05-07T14:05:18.629414+0000","last_became_active":"2024-05-07T14:04:59.467463+0000","last_became_peered":"2024-05-07T14:04:59.467463+0000","last_unstale":"2024-05-07T14:05:18.629414+0000","last_undegraded":"2024-05-07T14:05:18.629414+0000","last_fullsized":"2024-05-07T14:05:18.629414+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:38.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"124'21","reported_seq":309,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629398+0000","last_change":"2024-05-07T14:03:39.698456+0000","last_active":"2024-05-07T14:05:18.629398+0000","last_peered":"2024-05-07T14:05:18.629398+0000","last_clean":"2024-05-07T14:05:18.629398+0000","last_became_active":"2024-05-07T14:03:39.663223+0000","last_became_peered":"2024-05-07T14:03:39.663223+0000","last_unstale":"2024-05-07T14:05:18.629398+0000","last_undegraded":"2024-05-07T14:05:18.629398+0000","last_fullsized":"2024-05-07T14:05:18.629398+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:58.582121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959866+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:05:18.959866+0000","last_peered":"2024-05-07T14:05:18.959866+0000","last_clean":"2024-05-07T14:05:18.959866+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:05:18.959866+0000","last_undegraded":"2024-05-07T14:05:18.959866+0000","last_fullsized":"2024-05-07T14:05:18.959866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"106'6","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959722+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:05:18.959722+0000","last_peered":"2024-05-07T14:05:18.959722+0000","last_clean":"2024-05-07T14:05:18.959722+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:05:18.959722+0000","last_undegraded":"2024-05-07T14:05:18.959722+0000","last_fullsized":"2024-05-07T14:05:18.959722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"106'12","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630558+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:05:18.630558+0000","last_peered":"2024-05-07T14:05:18.630558+0000","last_clean":"2024-05-07T14:05:18.630558+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:05:18.630558+0000","last_undegraded":"2024-05-07T14:05:18.630558+0000","last_fullsized":"2024-05-07T14:05:18.630558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"124'16","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960175+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:05:18.960175+0000","last_peered":"2024-05-07T14:05:18.960175+0000","last_clean":"2024-05-07T14:05:18.960175+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:05:18.960175+0000","last_undegraded":"2024-05-07T14:05:18.960175+0000","last_fullsized":"2024-05-07T14:05:18.960175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":124,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961556+0000","last_change":"2024-05-07T14:03:39.714297+0000","last_active":"2024-05-07T14:05:18.961556+0000","last_peered":"2024-05-07T14:05:18.961556+0000","last_clean":"2024-05-07T14:05:18.961556+0000","last_became_active":"2024-05-07T14:03:39.663013+0000","last_became_peered":"2024-05-07T14:03:39.663013+0000","last_unstale":"2024-05-07T14:05:18.961556+0000","last_undegraded":"2024-05-07T14:05:18.961556+0000","last_fullsized":"2024-05-07T14:05:18.961556+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:40:56.207747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"124'24","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629991+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:05:18.629991+0000","last_peered":"2024-05-07T14:05:18.629991+0000","last_clean":"2024-05-07T14:05:18.629991+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:05:18.629991+0000","last_undegraded":"2024-05-07T14:05:18.629991+0000","last_fullsized":"2024-05-07T14:05:18.629991+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"146'135","reported_seq":441,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272092+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:05:20.272092+0000","last_peered":"2024-05-07T14:05:20.272092+0000","last_clean":"2024-05-07T14:05:20.272092+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:05:20.272092+0000","last_undegraded":"2024-05-07T14:05:20.272092+0000","last_fullsized":"2024-05-07T14:05:20.272092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"87'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962770+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:05:18.962770+0000","last_peered":"2024-05-07T14:05:18.962770+0000","last_clean":"2024-05-07T14:05:18.962770+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:05:18.962770+0000","last_undegraded":"2024-05-07T14:05:18.962770+0000","last_fullsized":"2024-05-07T14:05:18.962770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"106'8","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630951+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:05:18.630951+0000","last_peered":"2024-05-07T14:05:18.630951+0000","last_clean":"2024-05-07T14:05:18.630951+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:05:18.630951+0000","last_undegraded":"2024-05-07T14:05:18.630951+0000","last_fullsized":"2024-05-07T14:05:18.630951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"124'20","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631050+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:05:18.631050+0000","last_peered":"2024-05-07T14:05:18.631050+0000","last_clean":"2024-05-07T14:05:18.631050+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:05:18.631050+0000","last_undegraded":"2024-05-07T14:05:18.631050+0000","last_fullsized":"2024-05-07T14:05:18.631050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":428,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721954+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:05:18.721954+0000","last_peered":"2024-05-07T14:05:18.721954+0000","last_clean":"2024-05-07T14:05:18.721954+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:05:18.721954+0000","last_undegraded":"2024-05-07T14:05:18.721954+0000","last_fullsized":"2024-05-07T14:05:18.721954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":178,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":260,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964564+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:05:18.964564+0000","last_peered":"2024-05-07T14:05:18.964564+0000","last_clean":"2024-05-07T14:05:18.964564+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:05:18.964564+0000","last_undegraded":"2024-05-07T14:05:18.964564+0000","last_fullsized":"2024-05-07T14:05:18.964564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"146'135","reported_seq":430,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272661+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:05:20.272661+0000","last_peered":"2024-05-07T14:05:20.272661+0000","last_clean":"2024-05-07T14:05:20.272661+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:05:20.272661+0000","last_undegraded":"2024-05-07T14:05:20.272661+0000","last_fullsized":"2024-05-07T14:05:20.272661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"87'6","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629046+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:05:18.629046+0000","last_peered":"2024-05-07T14:05:18.629046+0000","last_clean":"2024-05-07T14:05:18.629046+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:05:18.629046+0000","last_undegraded":"2024-05-07T14:05:18.629046+0000","last_fullsized":"2024-05-07T14:05:18.629046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"124'6","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961297+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:05:18.961297+0000","last_peered":"2024-05-07T14:05:18.961297+0000","last_clean":"2024-05-07T14:05:18.961297+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:05:18.961297+0000","last_undegraded":"2024-05-07T14:05:18.961297+0000","last_fullsized":"2024-05-07T14:05:18.961297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"124'24","reported_seq":316,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959048+0000","last_change":"2024-05-07T14:03:39.814768+0000","last_active":"2024-05-07T14:05:18.959048+0000","last_peered":"2024-05-07T14:05:18.959048+0000","last_clean":"2024-05-07T14:05:18.959048+0000","last_became_active":"2024-05-07T14:03:39.666192+0000","last_became_peered":"2024-05-07T14:03:39.666192+0000","last_unstale":"2024-05-07T14:05:18.959048+0000","last_undegraded":"2024-05-07T14:05:18.959048+0000","last_fullsized":"2024-05-07T14:05:18.959048+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:10.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630568+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:05:18.630568+0000","last_peered":"2024-05-07T14:05:18.630568+0000","last_clean":"2024-05-07T14:05:18.630568+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:05:18.630568+0000","last_undegraded":"2024-05-07T14:05:18.630568+0000","last_fullsized":"2024-05-07T14:05:18.630568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"124'25","reported_seq":326,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721237+0000","last_change":"2024-05-07T14:03:39.845058+0000","last_active":"2024-05-07T14:05:18.721237+0000","last_peered":"2024-05-07T14:05:18.721237+0000","last_clean":"2024-05-07T14:05:18.721237+0000","last_became_active":"2024-05-07T14:03:39.673995+0000","last_became_peered":"2024-05-07T14:03:39.673995+0000","last_unstale":"2024-05-07T14:05:18.721237+0000","last_undegraded":"2024-05-07T14:05:18.721237+0000","last_fullsized":"2024-05-07T14:05:18.721237+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:43.919444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959774+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:05:18.959774+0000","last_peered":"2024-05-07T14:05:18.959774+0000","last_clean":"2024-05-07T14:05:18.959774+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:05:18.959774+0000","last_undegraded":"2024-05-07T14:05:18.959774+0000","last_fullsized":"2024-05-07T14:05:18.959774+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"124'2","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960409+0000","last_change":"2024-05-07T14:03:39.666268+0000","last_active":"2024-05-07T14:05:18.960409+0000","last_peered":"2024-05-07T14:05:18.960409+0000","last_clean":"2024-05-07T14:05:18.960409+0000","last_became_active":"2024-05-07T14:03:39.665838+0000","last_became_peered":"2024-05-07T14:03:39.665838+0000","last_unstale":"2024-05-07T14:05:18.960409+0000","last_undegraded":"2024-05-07T14:05:18.960409+0000","last_fullsized":"2024-05-07T14:05:18.960409+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:54:00.122392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963437+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:05:18.963437+0000","last_peered":"2024-05-07T14:05:18.963437+0000","last_clean":"2024-05-07T14:05:18.963437+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:05:18.963437+0000","last_undegraded":"2024-05-07T14:05:18.963437+0000","last_fullsized":"2024-05-07T14:05:18.963437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":313,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958642+0000","last_change":"2024-05-07T14:02:39.729323+0000","last_active":"2024-05-07T14:05:18.958642+0000","last_peered":"2024-05-07T14:05:18.958642+0000","last_clean":"2024-05-07T14:05:18.958642+0000","last_became_active":"2024-05-07T14:02:39.728189+0000","last_became_peered":"2024-05-07T14:02:39.728189+0000","last_unstale":"2024-05-07T14:05:18.958642+0000","last_undegraded":"2024-05-07T14:05:18.958642+0000","last_fullsized":"2024-05-07T14:05:18.958642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:53:59.368912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721172+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:05:18.721172+0000","last_peered":"2024-05-07T14:05:18.721172+0000","last_clean":"2024-05-07T14:05:18.721172+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:05:18.721172+0000","last_undegraded":"2024-05-07T14:05:18.721172+0000","last_fullsized":"2024-05-07T14:05:18.721172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"124'21","reported_seq":227,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628487+0000","last_change":"2024-05-07T14:01:37.317794+0000","last_active":"2024-05-07T14:05:18.628487+0000","last_peered":"2024-05-07T14:05:18.628487+0000","last_clean":"2024-05-07T14:05:18.628487+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:05:18.628487+0000","last_undegraded":"2024-05-07T14:05:18.628487+0000","last_fullsized":"2024-05-07T14:05:18.628487+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:17.582561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":31,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962017+0000","last_change":"2024-05-07T14:04:59.458347+0000","last_active":"2024-05-07T14:05:18.962017+0000","last_peered":"2024-05-07T14:05:18.962017+0000","last_clean":"2024-05-07T14:05:18.962017+0000","last_became_active":"2024-05-07T14:04:59.453884+0000","last_became_peered":"2024-05-07T14:04:59.453884+0000","last_unstale":"2024-05-07T14:05:18.962017+0000","last_undegraded":"2024-05-07T14:05:18.962017+0000","last_fullsized":"2024-05-07T14:05:18.962017+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.867992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"124'38","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722420+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:05:18.722420+0000","last_peered":"2024-05-07T14:05:18.722420+0000","last_clean":"2024-05-07T14:05:18.722420+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:05:18.722420+0000","last_undegraded":"2024-05-07T14:05:18.722420+0000","last_fullsized":"2024-05-07T14:05:18.722420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961662+0000","last_change":"2024-05-07T14:04:59.457814+0000","last_active":"2024-05-07T14:05:18.961662+0000","last_peered":"2024-05-07T14:05:18.961662+0000","last_clean":"2024-05-07T14:05:18.961662+0000","last_became_active":"2024-05-07T14:04:59.456477+0000","last_became_peered":"2024-05-07T14:04:59.456477+0000","last_unstale":"2024-05-07T14:05:18.961662+0000","last_undegraded":"2024-05-07T14:05:18.961662+0000","last_fullsized":"2024-05-07T14:05:18.961662+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:10:28.939206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959013+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:05:18.959013+0000","last_peered":"2024-05-07T14:05:18.959013+0000","last_clean":"2024-05-07T14:05:18.959013+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:05:18.959013+0000","last_undegraded":"2024-05-07T14:05:18.959013+0000","last_fullsized":"2024-05-07T14:05:18.959013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962392+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:05:18.962392+0000","last_peered":"2024-05-07T14:05:18.962392+0000","last_clean":"2024-05-07T14:05:18.962392+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:05:18.962392+0000","last_undegraded":"2024-05-07T14:05:18.962392+0000","last_fullsized":"2024-05-07T14:05:18.962392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":224,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961946+0000","last_change":"2024-05-07T14:04:59.425099+0000","last_active":"2024-05-07T14:05:18.961946+0000","last_peered":"2024-05-07T14:05:18.961946+0000","last_clean":"2024-05-07T14:05:18.961946+0000","last_became_active":"2024-05-07T14:04:59.422224+0000","last_became_peered":"2024-05-07T14:04:59.422224+0000","last_unstale":"2024-05-07T14:05:18.961946+0000","last_undegraded":"2024-05-07T14:05:18.961946+0000","last_fullsized":"2024-05-07T14:05:18.961946+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:23.398977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"124'22","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958651+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:05:18.958651+0000","last_peered":"2024-05-07T14:05:18.958651+0000","last_clean":"2024-05-07T14:05:18.958651+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:05:18.958651+0000","last_undegraded":"2024-05-07T14:05:18.958651+0000","last_fullsized":"2024-05-07T14:05:18.958651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722613+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:05:18.722613+0000","last_peered":"2024-05-07T14:05:18.722613+0000","last_clean":"2024-05-07T14:05:18.722613+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:05:18.722613+0000","last_undegraded":"2024-05-07T14:05:18.722613+0000","last_fullsized":"2024-05-07T14:05:18.722613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"146'141","reported_seq":515,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272410+0000","last_change":"2024-05-07T14:03:42.708479+0000","last_active":"2024-05-07T14:05:20.272410+0000","last_peered":"2024-05-07T14:05:20.272410+0000","last_clean":"2024-05-07T14:05:20.272410+0000","last_became_active":"2024-05-07T14:03:42.708117+0000","last_became_peered":"2024-05-07T14:03:42.708117+0000","last_unstale":"2024-05-07T14:05:20.272410+0000","last_undegraded":"2024-05-07T14:05:20.272410+0000","last_fullsized":"2024-05-07T14:05:20.272410+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:19:35.961283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5457,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":178,"num_read_kb":166,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962840+0000","last_change":"2024-05-07T14:04:59.462996+0000","last_active":"2024-05-07T14:05:18.962840+0000","last_peered":"2024-05-07T14:05:18.962840+0000","last_clean":"2024-05-07T14:05:18.962840+0000","last_became_active":"2024-05-07T14:04:59.461354+0000","last_became_peered":"2024-05-07T14:04:59.461354+0000","last_unstale":"2024-05-07T14:05:18.962840+0000","last_undegraded":"2024-05-07T14:05:18.962840+0000","last_fullsized":"2024-05-07T14:05:18.962840+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:55.900168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"80'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962268+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:05:18.962268+0000","last_peered":"2024-05-07T14:05:18.962268+0000","last_clean":"2024-05-07T14:05:18.962268+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:05:18.962268+0000","last_undegraded":"2024-05-07T14:05:18.962268+0000","last_fullsized":"2024-05-07T14:05:18.962268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"81'2","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960614+0000","last_change":"2024-05-07T14:03:39.711373+0000","last_active":"2024-05-07T14:05:18.960614+0000","last_peered":"2024-05-07T14:05:18.960614+0000","last_clean":"2024-05-07T14:05:18.960614+0000","last_became_active":"2024-05-07T14:03:39.667130+0000","last_became_peered":"2024-05-07T14:03:39.667130+0000","last_unstale":"2024-05-07T14:05:18.960614+0000","last_undegraded":"2024-05-07T14:05:18.960614+0000","last_fullsized":"2024-05-07T14:05:18.960614+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:36.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628882+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:05:18.628882+0000","last_peered":"2024-05-07T14:05:18.628882+0000","last_clean":"2024-05-07T14:05:18.628882+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:05:18.628882+0000","last_undegraded":"2024-05-07T14:05:18.628882+0000","last_fullsized":"2024-05-07T14:05:18.628882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"124'27","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963322+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:05:18.963322+0000","last_peered":"2024-05-07T14:05:18.963322+0000","last_clean":"2024-05-07T14:05:18.963322+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:05:18.963322+0000","last_undegraded":"2024-05-07T14:05:18.963322+0000","last_fullsized":"2024-05-07T14:05:18.963322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630125+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:05:18.630125+0000","last_peered":"2024-05-07T14:05:18.630125+0000","last_clean":"2024-05-07T14:05:18.630125+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:05:18.630125+0000","last_undegraded":"2024-05-07T14:05:18.630125+0000","last_fullsized":"2024-05-07T14:05:18.630125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"146'19","reported_seq":292,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272772+0000","last_change":"2024-05-07T14:04:59.461913+0000","last_active":"2024-05-07T14:05:20.272772+0000","last_peered":"2024-05-07T14:05:20.272772+0000","last_clean":"2024-05-07T14:05:20.272772+0000","last_became_active":"2024-05-07T14:04:59.456018+0000","last_became_peered":"2024-05-07T14:04:59.456018+0000","last_unstale":"2024-05-07T14:05:20.272772+0000","last_undegraded":"2024-05-07T14:05:20.272772+0000","last_fullsized":"2024-05-07T14:05:20.272772+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:42:03.359344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959826+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:05:18.959826+0000","last_peered":"2024-05-07T14:05:18.959826+0000","last_clean":"2024-05-07T14:05:18.959826+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:05:18.959826+0000","last_undegraded":"2024-05-07T14:05:18.959826+0000","last_fullsized":"2024-05-07T14:05:18.959826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965082+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:05:18.965082+0000","last_peered":"2024-05-07T14:05:18.965082+0000","last_clean":"2024-05-07T14:05:18.965082+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:05:18.965082+0000","last_undegraded":"2024-05-07T14:05:18.965082+0000","last_fullsized":"2024-05-07T14:05:18.965082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"81'4","reported_seq":106,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961642+0000","last_change":"2024-05-07T14:03:39.687600+0000","last_active":"2024-05-07T14:05:18.961642+0000","last_peered":"2024-05-07T14:05:18.961642+0000","last_clean":"2024-05-07T14:05:18.961642+0000","last_became_active":"2024-05-07T14:03:39.661295+0000","last_became_peered":"2024-05-07T14:03:39.661295+0000","last_unstale":"2024-05-07T14:05:18.961642+0000","last_undegraded":"2024-05-07T14:05:18.961642+0000","last_fullsized":"2024-05-07T14:05:18.961642+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:17:58.416324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721116+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:05:18.721116+0000","last_peered":"2024-05-07T14:05:18.721116+0000","last_clean":"2024-05-07T14:05:18.721116+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:05:18.721116+0000","last_undegraded":"2024-05-07T14:05:18.721116+0000","last_fullsized":"2024-05-07T14:05:18.721116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"123'15","reported_seq":275,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629754+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:05:18.629754+0000","last_peered":"2024-05-07T14:05:18.629754+0000","last_clean":"2024-05-07T14:05:18.629754+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:05:18.629754+0000","last_undegraded":"2024-05-07T14:05:18.629754+0000","last_fullsized":"2024-05-07T14:05:18.629754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52428800,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":25,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959150+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:05:18.959150+0000","last_peered":"2024-05-07T14:05:18.959150+0000","last_clean":"2024-05-07T14:05:18.959150+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:05:18.959150+0000","last_undegraded":"2024-05-07T14:05:18.959150+0000","last_fullsized":"2024-05-07T14:05:18.959150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964612+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:05:18.964612+0000","last_peered":"2024-05-07T14:05:18.964612+0000","last_clean":"2024-05-07T14:05:18.964612+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:05:18.964612+0000","last_undegraded":"2024-05-07T14:05:18.964612+0000","last_fullsized":"2024-05-07T14:05:18.964612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960727+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:05:18.960727+0000","last_peered":"2024-05-07T14:05:18.960727+0000","last_clean":"2024-05-07T14:05:18.960727+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:05:18.960727+0000","last_undegraded":"2024-05-07T14:05:18.960727+0000","last_fullsized":"2024-05-07T14:05:18.960727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719766+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:05:18.719766+0000","last_peered":"2024-05-07T14:05:18.719766+0000","last_clean":"2024-05-07T14:05:18.719766+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:05:18.719766+0000","last_undegraded":"2024-05-07T14:05:18.719766+0000","last_fullsized":"2024-05-07T14:05:18.719766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962141+0000","last_change":"2024-05-07T14:03:39.659916+0000","last_active":"2024-05-07T14:05:18.962141+0000","last_peered":"2024-05-07T14:05:18.962141+0000","last_clean":"2024-05-07T14:05:18.962141+0000","last_became_active":"2024-05-07T14:03:39.659515+0000","last_became_peered":"2024-05-07T14:03:39.659515+0000","last_unstale":"2024-05-07T14:05:18.962141+0000","last_undegraded":"2024-05-07T14:05:18.962141+0000","last_fullsized":"2024-05-07T14:05:18.962141+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:49:16.796937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"123'19","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722362+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:05:18.722362+0000","last_peered":"2024-05-07T14:05:18.722362+0000","last_clean":"2024-05-07T14:05:18.722362+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:05:18.722362+0000","last_undegraded":"2024-05-07T14:05:18.722362+0000","last_fullsized":"2024-05-07T14:05:18.722362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961947+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:05:18.961947+0000","last_peered":"2024-05-07T14:05:18.961947+0000","last_clean":"2024-05-07T14:05:18.961947+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:05:18.961947+0000","last_undegraded":"2024-05-07T14:05:18.961947+0000","last_fullsized":"2024-05-07T14:05:18.961947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960414+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:05:18.960414+0000","last_peered":"2024-05-07T14:05:18.960414+0000","last_clean":"2024-05-07T14:05:18.960414+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:05:18.960414+0000","last_undegraded":"2024-05-07T14:05:18.960414+0000","last_fullsized":"2024-05-07T14:05:18.960414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"124'36","reported_seq":296,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958943+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:05:18.958943+0000","last_peered":"2024-05-07T14:05:18.958943+0000","last_clean":"2024-05-07T14:05:18.958943+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:05:18.958943+0000","last_undegraded":"2024-05-07T14:05:18.958943+0000","last_fullsized":"2024-05-07T14:05:18.958943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628294+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:05:18.628294+0000","last_peered":"2024-05-07T14:05:18.628294+0000","last_clean":"2024-05-07T14:05:18.628294+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:05:18.628294+0000","last_undegraded":"2024-05-07T14:05:18.628294+0000","last_fullsized":"2024-05-07T14:05:18.628294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960715+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:05:18.960715+0000","last_peered":"2024-05-07T14:05:18.960715+0000","last_clean":"2024-05-07T14:05:18.960715+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:05:18.960715+0000","last_undegraded":"2024-05-07T14:05:18.960715+0000","last_fullsized":"2024-05-07T14:05:18.960715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":254,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960639+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:05:18.960639+0000","last_peered":"2024-05-07T14:05:18.960639+0000","last_clean":"2024-05-07T14:05:18.960639+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:05:18.960639+0000","last_undegraded":"2024-05-07T14:05:18.960639+0000","last_fullsized":"2024-05-07T14:05:18.960639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"124'23","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961817+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:05:18.961817+0000","last_peered":"2024-05-07T14:05:18.961817+0000","last_clean":"2024-05-07T14:05:18.961817+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:05:18.961817+0000","last_undegraded":"2024-05-07T14:05:18.961817+0000","last_fullsized":"2024-05-07T14:05:18.961817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961641+0000","last_change":"2024-05-07T14:04:59.452453+0000","last_active":"2024-05-07T14:05:18.961641+0000","last_peered":"2024-05-07T14:05:18.961641+0000","last_clean":"2024-05-07T14:05:18.961641+0000","last_became_active":"2024-05-07T14:04:59.451719+0000","last_became_peered":"2024-05-07T14:04:59.451719+0000","last_unstale":"2024-05-07T14:05:18.961641+0000","last_undegraded":"2024-05-07T14:05:18.961641+0000","last_fullsized":"2024-05-07T14:05:18.961641+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:58:01.882244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959572+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:05:18.959572+0000","last_peered":"2024-05-07T14:05:18.959572+0000","last_clean":"2024-05-07T14:05:18.959572+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:05:18.959572+0000","last_undegraded":"2024-05-07T14:05:18.959572+0000","last_fullsized":"2024-05-07T14:05:18.959572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":116,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962572+0000","last_change":"2024-05-07T14:03:39.707679+0000","last_active":"2024-05-07T14:05:18.962572+0000","last_peered":"2024-05-07T14:05:18.962572+0000","last_clean":"2024-05-07T14:05:18.962572+0000","last_became_active":"2024-05-07T14:03:39.664751+0000","last_became_peered":"2024-05-07T14:03:39.664751+0000","last_unstale":"2024-05-07T14:05:18.962572+0000","last_undegraded":"2024-05-07T14:05:18.962572+0000","last_fullsized":"2024-05-07T14:05:18.962572+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:55.535011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"146'139","reported_seq":482,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.273267+0000","last_change":"2024-05-07T14:03:42.707530+0000","last_active":"2024-05-07T14:05:20.273267+0000","last_peered":"2024-05-07T14:05:20.273267+0000","last_clean":"2024-05-07T14:05:20.273267+0000","last_became_active":"2024-05-07T14:03:42.707207+0000","last_became_peered":"2024-05-07T14:03:42.707207+0000","last_unstale":"2024-05-07T14:05:20.273267+0000","last_undegraded":"2024-05-07T14:05:20.273267+0000","last_fullsized":"2024-05-07T14:05:20.273267+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:20:22.698141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964049+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:05:18.964049+0000","last_peered":"2024-05-07T14:05:18.964049+0000","last_clean":"2024-05-07T14:05:18.964049+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:05:18.964049+0000","last_undegraded":"2024-05-07T14:05:18.964049+0000","last_fullsized":"2024-05-07T14:05:18.964049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"115'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959440+0000","last_change":"2024-05-07T14:04:59.447585+0000","last_active":"2024-05-07T14:05:18.959440+0000","last_peered":"2024-05-07T14:05:18.959440+0000","last_clean":"2024-05-07T14:05:18.959440+0000","last_became_active":"2024-05-07T14:04:59.446674+0000","last_became_peered":"2024-05-07T14:04:59.446674+0000","last_unstale":"2024-05-07T14:05:18.959440+0000","last_undegraded":"2024-05-07T14:05:18.959440+0000","last_fullsized":"2024-05-07T14:05:18.959440+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:35.485711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"124'18","reported_seq":301,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963635+0000","last_change":"2024-05-07T14:05:00.492095+0000","last_active":"2024-05-07T14:05:18.963635+0000","last_peered":"2024-05-07T14:05:18.963635+0000","last_clean":"2024-05-07T14:05:18.963635+0000","last_became_active":"2024-05-07T14:04:59.460381+0000","last_became_peered":"2024-05-07T14:04:59.460381+0000","last_unstale":"2024-05-07T14:05:18.963635+0000","last_undegraded":"2024-05-07T14:05:18.963635+0000","last_fullsized":"2024-05-07T14:05:18.963635+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:12:40.498963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959581+0000","last_change":"2024-05-07T14:03:39.672724+0000","last_active":"2024-05-07T14:05:18.959581+0000","last_peered":"2024-05-07T14:05:18.959581+0000","last_clean":"2024-05-07T14:05:18.959581+0000","last_became_active":"2024-05-07T14:03:39.671518+0000","last_became_peered":"2024-05-07T14:03:39.671518+0000","last_unstale":"2024-05-07T14:05:18.959581+0000","last_undegraded":"2024-05-07T14:05:18.959581+0000","last_fullsized":"2024-05-07T14:05:18.959581+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:25.485797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":251,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628580+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:05:18.628580+0000","last_peered":"2024-05-07T14:05:18.628580+0000","last_clean":"2024-05-07T14:05:18.628580+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:05:18.628580+0000","last_undegraded":"2024-05-07T14:05:18.628580+0000","last_fullsized":"2024-05-07T14:05:18.628580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629354+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:05:18.629354+0000","last_peered":"2024-05-07T14:05:18.629354+0000","last_clean":"2024-05-07T14:05:18.629354+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:05:18.629354+0000","last_undegraded":"2024-05-07T14:05:18.629354+0000","last_fullsized":"2024-05-07T14:05:18.629354+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"146'135","reported_seq":477,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272789+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:05:20.272789+0000","last_peered":"2024-05-07T14:05:20.272789+0000","last_clean":"2024-05-07T14:05:20.272789+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:05:20.272789+0000","last_undegraded":"2024-05-07T14:05:20.272789+0000","last_fullsized":"2024-05-07T14:05:20.272789+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"81'3","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960070+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:05:18.960070+0000","last_peered":"2024-05-07T14:05:18.960070+0000","last_clean":"2024-05-07T14:05:18.960070+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:05:18.960070+0000","last_undegraded":"2024-05-07T14:05:18.960070+0000","last_fullsized":"2024-05-07T14:05:18.960070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"124'4","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630423+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:05:18.630423+0000","last_peered":"2024-05-07T14:05:18.630423+0000","last_clean":"2024-05-07T14:05:18.630423+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:05:18.630423+0000","last_undegraded":"2024-05-07T14:05:18.630423+0000","last_fullsized":"2024-05-07T14:05:18.630423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"124'23","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962938+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:05:18.962938+0000","last_peered":"2024-05-07T14:05:18.962938+0000","last_clean":"2024-05-07T14:05:18.962938+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:05:18.962938+0000","last_undegraded":"2024-05-07T14:05:18.962938+0000","last_fullsized":"2024-05-07T14:05:18.962938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964431+0000","last_change":"2024-05-07T14:04:59.469514+0000","last_active":"2024-05-07T14:05:18.964431+0000","last_peered":"2024-05-07T14:05:18.964431+0000","last_clean":"2024-05-07T14:05:18.964431+0000","last_became_active":"2024-05-07T14:04:59.469021+0000","last_became_peered":"2024-05-07T14:04:59.469021+0000","last_unstale":"2024-05-07T14:05:18.964431+0000","last_undegraded":"2024-05-07T14:05:18.964431+0000","last_fullsized":"2024-05-07T14:05:18.964431+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:17:47.533593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959578+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:05:18.959578+0000","last_peered":"2024-05-07T14:05:18.959578+0000","last_clean":"2024-05-07T14:05:18.959578+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:05:18.959578+0000","last_undegraded":"2024-05-07T14:05:18.959578+0000","last_fullsized":"2024-05-07T14:05:18.959578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"124'45","reported_seq":288,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961605+0000","last_change":"2024-05-07T14:04:59.918491+0000","last_active":"2024-05-07T14:05:18.961605+0000","last_peered":"2024-05-07T14:05:18.961605+0000","last_clean":"2024-05-07T14:05:18.961605+0000","last_became_active":"2024-05-07T14:04:59.442492+0000","last_became_peered":"2024-05-07T14:04:59.442492+0000","last_unstale":"2024-05-07T14:05:18.961605+0000","last_undegraded":"2024-05-07T14:05:18.961605+0000","last_fullsized":"2024-05-07T14:05:18.961605+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:58.713363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120967,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":40,"num_read_kb":26,"num_write":24,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":116761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":252,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963779+0000","last_change":"2024-05-07T14:03:39.665240+0000","last_active":"2024-05-07T14:05:18.963779+0000","last_peered":"2024-05-07T14:05:18.963779+0000","last_clean":"2024-05-07T14:05:18.963779+0000","last_became_active":"2024-05-07T14:03:39.664810+0000","last_became_peered":"2024-05-07T14:03:39.664810+0000","last_unstale":"2024-05-07T14:05:18.963779+0000","last_undegraded":"2024-05-07T14:05:18.963779+0000","last_fullsized":"2024-05-07T14:05:18.963779+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:18:01.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721214+0000","last_change":"2024-05-07T14:04:59.465509+0000","last_active":"2024-05-07T14:05:18.721214+0000","last_peered":"2024-05-07T14:05:18.721214+0000","last_clean":"2024-05-07T14:05:18.721214+0000","last_became_active":"2024-05-07T14:04:59.464840+0000","last_became_peered":"2024-05-07T14:04:59.464840+0000","last_unstale":"2024-05-07T14:05:18.721214+0000","last_undegraded":"2024-05-07T14:05:18.721214+0000","last_fullsized":"2024-05-07T14:05:18.721214+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:42.823262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959673+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:05:18.959673+0000","last_peered":"2024-05-07T14:05:18.959673+0000","last_clean":"2024-05-07T14:05:18.959673+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:05:18.959673+0000","last_undegraded":"2024-05-07T14:05:18.959673+0000","last_fullsized":"2024-05-07T14:05:18.959673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'8","reported_seq":290,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629203+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:05:18.629203+0000","last_peered":"2024-05-07T14:05:18.629203+0000","last_clean":"2024-05-07T14:05:18.629203+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:05:18.629203+0000","last_undegraded":"2024-05-07T14:05:18.629203+0000","last_fullsized":"2024-05-07T14:05:18.629203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"124'23","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629269+0000","last_change":"2024-05-07T14:04:59.669798+0000","last_active":"2024-05-07T14:05:18.629269+0000","last_peered":"2024-05-07T14:05:18.629269+0000","last_clean":"2024-05-07T14:05:18.629269+0000","last_became_active":"2024-05-07T14:04:59.428245+0000","last_became_peered":"2024-05-07T14:04:59.428245+0000","last_unstale":"2024-05-07T14:05:18.629269+0000","last_undegraded":"2024-05-07T14:05:18.629269+0000","last_fullsized":"2024-05-07T14:05:18.629269+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:40.955811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962422+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:05:18.962422+0000","last_peered":"2024-05-07T14:05:18.962422+0000","last_clean":"2024-05-07T14:05:18.962422+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:05:18.962422+0000","last_undegraded":"2024-05-07T14:05:18.962422+0000","last_fullsized":"2024-05-07T14:05:18.962422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"124'20","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959837+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:05:18.959837+0000","last_peered":"2024-05-07T14:05:18.959837+0000","last_clean":"2024-05-07T14:05:18.959837+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:05:18.959837+0000","last_undegraded":"2024-05-07T14:05:18.959837+0000","last_fullsized":"2024-05-07T14:05:18.959837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959679+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:05:18.959679+0000","last_peered":"2024-05-07T14:05:18.959679+0000","last_clean":"2024-05-07T14:05:18.959679+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:05:18.959679+0000","last_undegraded":"2024-05-07T14:05:18.959679+0000","last_fullsized":"2024-05-07T14:05:18.959679+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":245,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963898+0000","last_change":"2024-05-07T14:04:59.447528+0000","last_active":"2024-05-07T14:05:18.963898+0000","last_peered":"2024-05-07T14:05:18.963898+0000","last_clean":"2024-05-07T14:05:18.963898+0000","last_became_active":"2024-05-07T14:04:59.446699+0000","last_became_peered":"2024-05-07T14:04:59.446699+0000","last_unstale":"2024-05-07T14:05:18.963898+0000","last_undegraded":"2024-05-07T14:05:18.963898+0000","last_fullsized":"2024-05-07T14:05:18.963898+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:42.823262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"115'8","reported_seq":129,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962079+0000","last_change":"2024-05-07T14:03:39.692877+0000","last_active":"2024-05-07T14:05:18.962079+0000","last_peered":"2024-05-07T14:05:18.962079+0000","last_clean":"2024-05-07T14:05:18.962079+0000","last_became_active":"2024-05-07T14:03:39.663976+0000","last_became_peered":"2024-05-07T14:03:39.663976+0000","last_unstale":"2024-05-07T14:05:18.962079+0000","last_undegraded":"2024-05-07T14:05:18.962079+0000","last_fullsized":"2024-05-07T14:05:18.962079+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:36.548454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"123'21","reported_seq":267,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961132+0000","last_change":"2024-05-07T14:05:00.456893+0000","last_active":"2024-05-07T14:05:18.961132+0000","last_peered":"2024-05-07T14:05:18.961132+0000","last_clean":"2024-05-07T14:05:18.961132+0000","last_became_active":"2024-05-07T14:04:59.445956+0000","last_became_peered":"2024-05-07T14:04:59.445956+0000","last_unstale":"2024-05-07T14:05:18.961132+0000","last_undegraded":"2024-05-07T14:05:18.961132+0000","last_fullsized":"2024-05-07T14:05:18.961132+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:07.979587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964857+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:05:18.964857+0000","last_peered":"2024-05-07T14:05:18.964857+0000","last_clean":"2024-05-07T14:05:18.964857+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:05:18.964857+0000","last_undegraded":"2024-05-07T14:05:18.964857+0000","last_fullsized":"2024-05-07T14:05:18.964857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"124'9","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958697+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:05:18.958697+0000","last_peered":"2024-05-07T14:05:18.958697+0000","last_clean":"2024-05-07T14:05:18.958697+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:05:18.958697+0000","last_undegraded":"2024-05-07T14:05:18.958697+0000","last_fullsized":"2024-05-07T14:05:18.958697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962740+0000","last_change":"2024-05-07T14:04:59.445953+0000","last_active":"2024-05-07T14:05:18.962740+0000","last_peered":"2024-05-07T14:05:18.962740+0000","last_clean":"2024-05-07T14:05:18.962740+0000","last_became_active":"2024-05-07T14:04:59.444830+0000","last_became_peered":"2024-05-07T14:04:59.444830+0000","last_unstale":"2024-05-07T14:05:18.962740+0000","last_undegraded":"2024-05-07T14:05:18.962740+0000","last_fullsized":"2024-05-07T14:05:18.962740+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:10:54.814821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"106'2","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959004+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:05:18.959004+0000","last_peered":"2024-05-07T14:05:18.959004+0000","last_clean":"2024-05-07T14:05:18.959004+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:05:18.959004+0000","last_undegraded":"2024-05-07T14:05:18.959004+0000","last_fullsized":"2024-05-07T14:05:18.959004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"81'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960024+0000","last_change":"2024-05-07T14:04:59.460718+0000","last_active":"2024-05-07T14:05:18.960024+0000","last_peered":"2024-05-07T14:05:18.960024+0000","last_clean":"2024-05-07T14:05:18.960024+0000","last_became_active":"2024-05-07T14:04:59.460037+0000","last_became_peered":"2024-05-07T14:04:59.460037+0000","last_unstale":"2024-05-07T14:05:18.960024+0000","last_undegraded":"2024-05-07T14:05:18.960024+0000","last_fullsized":"2024-05-07T14:05:18.960024+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:28.266490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"124'21","reported_seq":305,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722278+0000","last_change":"2024-05-07T14:05:00.840128+0000","last_active":"2024-05-07T14:05:18.722278+0000","last_peered":"2024-05-07T14:05:18.722278+0000","last_clean":"2024-05-07T14:05:18.722278+0000","last_became_active":"2024-05-07T14:04:59.460944+0000","last_became_peered":"2024-05-07T14:04:59.460944+0000","last_unstale":"2024-05-07T14:05:18.722278+0000","last_undegraded":"2024-05-07T14:05:18.722278+0000","last_fullsized":"2024-05-07T14:05:18.722278+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:26.259170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960783+0000","last_change":"2024-05-07T14:04:59.431660+0000","last_active":"2024-05-07T14:05:18.960783+0000","last_peered":"2024-05-07T14:05:18.960783+0000","last_clean":"2024-05-07T14:05:18.960783+0000","last_became_active":"2024-05-07T14:04:59.430654+0000","last_became_peered":"2024-05-07T14:04:59.430654+0000","last_unstale":"2024-05-07T14:05:18.960783+0000","last_undegraded":"2024-05-07T14:05:18.960783+0000","last_fullsized":"2024-05-07T14:05:18.960783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:27:01.765321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"124'20","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963938+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:05:18.963938+0000","last_peered":"2024-05-07T14:05:18.963938+0000","last_clean":"2024-05-07T14:05:18.963938+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:05:18.963938+0000","last_undegraded":"2024-05-07T14:05:18.963938+0000","last_fullsized":"2024-05-07T14:05:18.963938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959502+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:05:18.959502+0000","last_peered":"2024-05-07T14:05:18.959502+0000","last_clean":"2024-05-07T14:05:18.959502+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:05:18.959502+0000","last_undegraded":"2024-05-07T14:05:18.959502+0000","last_fullsized":"2024-05-07T14:05:18.959502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720402+0000","last_change":"2024-05-07T14:04:59.444373+0000","last_active":"2024-05-07T14:05:18.720402+0000","last_peered":"2024-05-07T14:05:18.720402+0000","last_clean":"2024-05-07T14:05:18.720402+0000","last_became_active":"2024-05-07T14:04:59.443620+0000","last_became_peered":"2024-05-07T14:04:59.443620+0000","last_unstale":"2024-05-07T14:05:18.720402+0000","last_undegraded":"2024-05-07T14:05:18.720402+0000","last_fullsized":"2024-05-07T14:05:18.720402+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:44:00.772402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"124'4","reported_seq":94,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958941+0000","last_change":"2024-05-07T14:03:52.789742+0000","last_active":"2024-05-07T14:05:18.958941+0000","last_peered":"2024-05-07T14:05:18.958941+0000","last_clean":"2024-05-07T14:05:18.958941+0000","last_became_active":"2024-05-07T14:03:52.787675+0000","last_became_peered":"2024-05-07T14:03:52.787675+0000","last_unstale":"2024-05-07T14:05:18.958941+0000","last_undegraded":"2024-05-07T14:05:18.958941+0000","last_fullsized":"2024-05-07T14:05:18.958941+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:39.000431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"124'24","reported_seq":229,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630088+0000","last_change":"2024-05-07T14:01:37.318408+0000","last_active":"2024-05-07T14:05:18.630088+0000","last_peered":"2024-05-07T14:05:18.630088+0000","last_clean":"2024-05-07T14:05:18.630088+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:05:18.630088+0000","last_undegraded":"2024-05-07T14:05:18.630088+0000","last_fullsized":"2024-05-07T14:05:18.630088+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:43.643434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959480+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:05:18.959480+0000","last_peered":"2024-05-07T14:05:18.959480+0000","last_clean":"2024-05-07T14:05:18.959480+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:05:18.959480+0000","last_undegraded":"2024-05-07T14:05:18.959480+0000","last_fullsized":"2024-05-07T14:05:18.959480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"124'17","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961550+0000","last_change":"2024-05-07T14:04:59.459641+0000","last_active":"2024-05-07T14:05:18.961550+0000","last_peered":"2024-05-07T14:05:18.961550+0000","last_clean":"2024-05-07T14:05:18.961550+0000","last_became_active":"2024-05-07T14:04:59.459102+0000","last_became_peered":"2024-05-07T14:04:59.459102+0000","last_unstale":"2024-05-07T14:05:18.961550+0000","last_undegraded":"2024-05-07T14:05:18.961550+0000","last_fullsized":"2024-05-07T14:05:18.961550+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:09:18.267555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958858+0000","last_change":"2024-05-07T14:04:59.449322+0000","last_active":"2024-05-07T14:05:18.958858+0000","last_peered":"2024-05-07T14:05:18.958858+0000","last_clean":"2024-05-07T14:05:18.958858+0000","last_became_active":"2024-05-07T14:04:59.448594+0000","last_became_peered":"2024-05-07T14:04:59.448594+0000","last_unstale":"2024-05-07T14:05:18.958858+0000","last_undegraded":"2024-05-07T14:05:18.958858+0000","last_fullsized":"2024-05-07T14:05:18.958858+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:32.423884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"115'6","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964236+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:05:18.964236+0000","last_peered":"2024-05-07T14:05:18.964236+0000","last_clean":"2024-05-07T14:05:18.964236+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:05:18.964236+0000","last_undegraded":"2024-05-07T14:05:18.964236+0000","last_fullsized":"2024-05-07T14:05:18.964236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959138+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:05:18.959138+0000","last_peered":"2024-05-07T14:05:18.959138+0000","last_clean":"2024-05-07T14:05:18.959138+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:05:18.959138+0000","last_undegraded":"2024-05-07T14:05:18.959138+0000","last_fullsized":"2024-05-07T14:05:18.959138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":257,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961778+0000","last_change":"2024-05-07T14:04:59.457249+0000","last_active":"2024-05-07T14:05:18.961778+0000","last_peered":"2024-05-07T14:05:18.961778+0000","last_clean":"2024-05-07T14:05:18.961778+0000","last_became_active":"2024-05-07T14:04:59.455608+0000","last_became_peered":"2024-05-07T14:04:59.455608+0000","last_unstale":"2024-05-07T14:05:18.961778+0000","last_undegraded":"2024-05-07T14:05:18.961778+0000","last_fullsized":"2024-05-07T14:05:18.961778+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:55:28.165004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"124'29","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963612+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:05:18.963612+0000","last_peered":"2024-05-07T14:05:18.963612+0000","last_clean":"2024-05-07T14:05:18.963612+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:05:18.963612+0000","last_undegraded":"2024-05-07T14:05:18.963612+0000","last_fullsized":"2024-05-07T14:05:18.963612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120857,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720945+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:05:18.720945+0000","last_peered":"2024-05-07T14:05:18.720945+0000","last_clean":"2024-05-07T14:05:18.720945+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:05:18.720945+0000","last_undegraded":"2024-05-07T14:05:18.720945+0000","last_fullsized":"2024-05-07T14:05:18.720945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"81'2","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963561+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:05:18.963561+0000","last_peered":"2024-05-07T14:05:18.963561+0000","last_clean":"2024-05-07T14:05:18.963561+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:05:18.963561+0000","last_undegraded":"2024-05-07T14:05:18.963561+0000","last_fullsized":"2024-05-07T14:05:18.963561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"115'8","reported_seq":295,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962152+0000","last_change":"2024-05-07T14:04:59.457999+0000","last_active":"2024-05-07T14:05:18.962152+0000","last_peered":"2024-05-07T14:05:18.962152+0000","last_clean":"2024-05-07T14:05:18.962152+0000","last_became_active":"2024-05-07T14:04:59.456492+0000","last_became_peered":"2024-05-07T14:04:59.456492+0000","last_unstale":"2024-05-07T14:05:18.962152+0000","last_undegraded":"2024-05-07T14:05:18.962152+0000","last_fullsized":"2024-05-07T14:05:18.962152+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:41.936460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"124'22","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963224+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:05:18.963224+0000","last_peered":"2024-05-07T14:05:18.963224+0000","last_clean":"2024-05-07T14:05:18.963224+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:05:18.963224+0000","last_undegraded":"2024-05-07T14:05:18.963224+0000","last_fullsized":"2024-05-07T14:05:18.963224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960857+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:05:18.960857+0000","last_peered":"2024-05-07T14:05:18.960857+0000","last_clean":"2024-05-07T14:05:18.960857+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:05:18.960857+0000","last_undegraded":"2024-05-07T14:05:18.960857+0000","last_fullsized":"2024-05-07T14:05:18.960857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"124'23","reported_seq":258,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962735+0000","last_change":"2024-05-07T14:04:59.440283+0000","last_active":"2024-05-07T14:05:18.962735+0000","last_peered":"2024-05-07T14:05:18.962735+0000","last_clean":"2024-05-07T14:05:18.962735+0000","last_became_active":"2024-05-07T14:04:59.439603+0000","last_became_peered":"2024-05-07T14:04:59.439603+0000","last_unstale":"2024-05-07T14:05:18.962735+0000","last_undegraded":"2024-05-07T14:05:18.962735+0000","last_fullsized":"2024-05-07T14:05:18.962735+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:19.505619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964150+0000","last_change":"2024-05-07T14:03:39.667564+0000","last_active":"2024-05-07T14:05:18.964150+0000","last_peered":"2024-05-07T14:05:18.964150+0000","last_clean":"2024-05-07T14:05:18.964150+0000","last_became_active":"2024-05-07T14:03:39.666888+0000","last_became_peered":"2024-05-07T14:03:39.666888+0000","last_unstale":"2024-05-07T14:05:18.964150+0000","last_undegraded":"2024-05-07T14:05:18.964150+0000","last_fullsized":"2024-05-07T14:05:18.964150+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:33.367980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959043+0000","last_change":"2024-05-07T14:04:59.456030+0000","last_active":"2024-05-07T14:05:18.959043+0000","last_peered":"2024-05-07T14:05:18.959043+0000","last_clean":"2024-05-07T14:05:18.959043+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:18.959043+0000","last_undegraded":"2024-05-07T14:05:18.959043+0000","last_fullsized":"2024-05-07T14:05:18.959043+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:20:24.704314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"81'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963522+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:05:18.963522+0000","last_peered":"2024-05-07T14:05:18.963522+0000","last_clean":"2024-05-07T14:05:18.963522+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:05:18.963522+0000","last_undegraded":"2024-05-07T14:05:18.963522+0000","last_fullsized":"2024-05-07T14:05:18.963522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"124'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629964+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:05:18.629964+0000","last_peered":"2024-05-07T14:05:18.629964+0000","last_clean":"2024-05-07T14:05:18.629964+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:05:18.629964+0000","last_undegraded":"2024-05-07T14:05:18.629964+0000","last_fullsized":"2024-05-07T14:05:18.629964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631091+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:05:18.631091+0000","last_peered":"2024-05-07T14:05:18.631091+0000","last_clean":"2024-05-07T14:05:18.631091+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:05:18.631091+0000","last_undegraded":"2024-05-07T14:05:18.631091+0000","last_fullsized":"2024-05-07T14:05:18.631091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"124'19","reported_seq":273,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964240+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:05:18.964240+0000","last_peered":"2024-05-07T14:05:18.964240+0000","last_clean":"2024-05-07T14:05:18.964240+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:05:18.964240+0000","last_undegraded":"2024-05-07T14:05:18.964240+0000","last_fullsized":"2024-05-07T14:05:18.964240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960106+0000","last_change":"2024-05-07T14:03:39.664184+0000","last_active":"2024-05-07T14:05:18.960106+0000","last_peered":"2024-05-07T14:05:18.960106+0000","last_clean":"2024-05-07T14:05:18.960106+0000","last_became_active":"2024-05-07T14:03:39.663569+0000","last_became_peered":"2024-05-07T14:03:39.663569+0000","last_unstale":"2024-05-07T14:05:18.960106+0000","last_undegraded":"2024-05-07T14:05:18.960106+0000","last_fullsized":"2024-05-07T14:05:18.960106+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:51.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720030+0000","last_change":"2024-05-07T14:04:59.447765+0000","last_active":"2024-05-07T14:05:18.720030+0000","last_peered":"2024-05-07T14:05:18.720030+0000","last_clean":"2024-05-07T14:05:18.720030+0000","last_became_active":"2024-05-07T14:04:59.447025+0000","last_became_peered":"2024-05-07T14:04:59.447025+0000","last_unstale":"2024-05-07T14:05:18.720030+0000","last_undegraded":"2024-05-07T14:05:18.720030+0000","last_fullsized":"2024-05-07T14:05:18.720030+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:14.299214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"124'14","reported_seq":298,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629778+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:05:18.629778+0000","last_peered":"2024-05-07T14:05:18.629778+0000","last_clean":"2024-05-07T14:05:18.629778+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:05:18.629778+0000","last_undegraded":"2024-05-07T14:05:18.629778+0000","last_fullsized":"2024-05-07T14:05:18.629778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"124'20","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960254+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:05:18.960254+0000","last_peered":"2024-05-07T14:05:18.960254+0000","last_clean":"2024-05-07T14:05:18.960254+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:05:18.960254+0000","last_undegraded":"2024-05-07T14:05:18.960254+0000","last_fullsized":"2024-05-07T14:05:18.960254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964629+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:05:18.964629+0000","last_peered":"2024-05-07T14:05:18.964629+0000","last_clean":"2024-05-07T14:05:18.964629+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:05:18.964629+0000","last_undegraded":"2024-05-07T14:05:18.964629+0000","last_fullsized":"2024-05-07T14:05:18.964629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630297+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:05:18.630297+0000","last_peered":"2024-05-07T14:05:18.630297+0000","last_clean":"2024-05-07T14:05:18.630297+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:05:18.630297+0000","last_undegraded":"2024-05-07T14:05:18.630297+0000","last_fullsized":"2024-05-07T14:05:18.630297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"146'135","reported_seq":506,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.273174+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:05:20.273174+0000","last_peered":"2024-05-07T14:05:20.273174+0000","last_clean":"2024-05-07T14:05:20.273174+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:05:20.273174+0000","last_undegraded":"2024-05-07T14:05:20.273174+0000","last_fullsized":"2024-05-07T14:05:20.273174+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"81'7","reported_seq":161,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961656+0000","last_change":"2024-05-07T14:04:59.448265+0000","last_active":"2024-05-07T14:05:18.961656+0000","last_peered":"2024-05-07T14:05:18.961656+0000","last_clean":"2024-05-07T14:05:18.961656+0000","last_became_active":"2024-05-07T14:04:59.444580+0000","last_became_peered":"2024-05-07T14:04:59.444580+0000","last_unstale":"2024-05-07T14:05:18.961656+0000","last_undegraded":"2024-05-07T14:05:18.961656+0000","last_fullsized":"2024-05-07T14:05:18.961656+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:54.087416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"124'8","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629103+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:05:18.629103+0000","last_peered":"2024-05-07T14:05:18.629103+0000","last_clean":"2024-05-07T14:05:18.629103+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:05:18.629103+0000","last_undegraded":"2024-05-07T14:05:18.629103+0000","last_fullsized":"2024-05-07T14:05:18.629103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"124'20","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721314+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:05:18.721314+0000","last_peered":"2024-05-07T14:05:18.721314+0000","last_clean":"2024-05-07T14:05:18.721314+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:05:18.721314+0000","last_undegraded":"2024-05-07T14:05:18.721314+0000","last_fullsized":"2024-05-07T14:05:18.721314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961289+0000","last_change":"2024-05-07T14:04:59.425730+0000","last_active":"2024-05-07T14:05:18.961289+0000","last_peered":"2024-05-07T14:05:18.961289+0000","last_clean":"2024-05-07T14:05:18.961289+0000","last_became_active":"2024-05-07T14:04:59.421636+0000","last_became_peered":"2024-05-07T14:04:59.421636+0000","last_unstale":"2024-05-07T14:05:18.961289+0000","last_undegraded":"2024-05-07T14:05:18.961289+0000","last_fullsized":"2024-05-07T14:05:18.961289+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:15:27.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"124'23","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720578+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:05:18.720578+0000","last_peered":"2024-05-07T14:05:18.720578+0000","last_clean":"2024-05-07T14:05:18.720578+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:05:18.720578+0000","last_undegraded":"2024-05-07T14:05:18.720578+0000","last_fullsized":"2024-05-07T14:05:18.720578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958232+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:05:18.958232+0000","last_peered":"2024-05-07T14:05:18.958232+0000","last_clean":"2024-05-07T14:05:18.958232+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:05:18.958232+0000","last_undegraded":"2024-05-07T14:05:18.958232+0000","last_fullsized":"2024-05-07T14:05:18.958232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"124'7","reported_seq":157,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964433+0000","last_change":"2024-05-07T14:05:02.242073+0000","last_active":"2024-05-07T14:05:18.964433+0000","last_peered":"2024-05-07T14:05:18.964433+0000","last_clean":"2024-05-07T14:05:18.964433+0000","last_became_active":"2024-05-07T14:04:59.467712+0000","last_became_peered":"2024-05-07T14:04:59.467712+0000","last_unstale":"2024-05-07T14:05:18.964433+0000","last_undegraded":"2024-05-07T14:05:18.964433+0000","last_fullsized":"2024-05-07T14:05:18.964433+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:31.624262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"115'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629455+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:05:18.629455+0000","last_peered":"2024-05-07T14:05:18.629455+0000","last_clean":"2024-05-07T14:05:18.629455+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:05:18.629455+0000","last_undegraded":"2024-05-07T14:05:18.629455+0000","last_fullsized":"2024-05-07T14:05:18.629455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"124'26","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722184+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:05:18.722184+0000","last_peered":"2024-05-07T14:05:18.722184+0000","last_clean":"2024-05-07T14:05:18.722184+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:05:18.722184+0000","last_undegraded":"2024-05-07T14:05:18.722184+0000","last_fullsized":"2024-05-07T14:05:18.722184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720667+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:05:18.720667+0000","last_peered":"2024-05-07T14:05:18.720667+0000","last_clean":"2024-05-07T14:05:18.720667+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:05:18.720667+0000","last_undegraded":"2024-05-07T14:05:18.720667+0000","last_fullsized":"2024-05-07T14:05:18.720667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"124'17","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958238+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:05:18.958238+0000","last_peered":"2024-05-07T14:05:18.958238+0000","last_clean":"2024-05-07T14:05:18.958238+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:05:18.958238+0000","last_undegraded":"2024-05-07T14:05:18.958238+0000","last_fullsized":"2024-05-07T14:05:18.958238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959103+0000","last_change":"2024-05-07T14:04:59.466240+0000","last_active":"2024-05-07T14:05:18.959103+0000","last_peered":"2024-05-07T14:05:18.959103+0000","last_clean":"2024-05-07T14:05:18.959103+0000","last_became_active":"2024-05-07T14:04:59.465509+0000","last_became_peered":"2024-05-07T14:04:59.465509+0000","last_unstale":"2024-05-07T14:05:18.959103+0000","last_undegraded":"2024-05-07T14:05:18.959103+0000","last_fullsized":"2024-05-07T14:05:18.959103+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:28:23.609814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964136+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:05:18.964136+0000","last_peered":"2024-05-07T14:05:18.964136+0000","last_clean":"2024-05-07T14:05:18.964136+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:05:18.964136+0000","last_undegraded":"2024-05-07T14:05:18.964136+0000","last_fullsized":"2024-05-07T14:05:18.964136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"87'6","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960098+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:05:18.960098+0000","last_peered":"2024-05-07T14:05:18.960098+0000","last_clean":"2024-05-07T14:05:18.960098+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:05:18.960098+0000","last_undegraded":"2024-05-07T14:05:18.960098+0000","last_fullsized":"2024-05-07T14:05:18.960098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"124'19","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964959+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:05:18.964959+0000","last_peered":"2024-05-07T14:05:18.964959+0000","last_clean":"2024-05-07T14:05:18.964959+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:05:18.964959+0000","last_undegraded":"2024-05-07T14:05:18.964959+0000","last_fullsized":"2024-05-07T14:05:18.964959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628160+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:05:18.628160+0000","last_peered":"2024-05-07T14:05:18.628160+0000","last_clean":"2024-05-07T14:05:18.628160+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:05:18.628160+0000","last_undegraded":"2024-05-07T14:05:18.628160+0000","last_fullsized":"2024-05-07T14:05:18.628160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"124'13","reported_seq":271,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965528+0000","last_change":"2024-05-07T14:04:59.460738+0000","last_active":"2024-05-07T14:05:18.965528+0000","last_peered":"2024-05-07T14:05:18.965528+0000","last_clean":"2024-05-07T14:05:18.965528+0000","last_became_active":"2024-05-07T14:04:59.459963+0000","last_became_peered":"2024-05-07T14:04:59.459963+0000","last_unstale":"2024-05-07T14:05:18.965528+0000","last_undegraded":"2024-05-07T14:05:18.965528+0000","last_fullsized":"2024-05-07T14:05:18.965528+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:14:25.517514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628526+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:05:18.628526+0000","last_peered":"2024-05-07T14:05:18.628526+0000","last_clean":"2024-05-07T14:05:18.628526+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:05:18.628526+0000","last_undegraded":"2024-05-07T14:05:18.628526+0000","last_fullsized":"2024-05-07T14:05:18.628526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"81'8","reported_seq":222,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963108+0000","last_change":"2024-05-07T14:04:59.462387+0000","last_active":"2024-05-07T14:05:18.963108+0000","last_peered":"2024-05-07T14:05:18.963108+0000","last_clean":"2024-05-07T14:05:18.963108+0000","last_became_active":"2024-05-07T14:04:59.456842+0000","last_became_peered":"2024-05-07T14:04:59.456842+0000","last_unstale":"2024-05-07T14:05:18.963108+0000","last_undegraded":"2024-05-07T14:05:18.963108+0000","last_fullsized":"2024-05-07T14:05:18.963108+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:43:26.257882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"115'10","reported_seq":294,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628969+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:05:18.628969+0000","last_peered":"2024-05-07T14:05:18.628969+0000","last_clean":"2024-05-07T14:05:18.628969+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:05:18.628969+0000","last_undegraded":"2024-05-07T14:05:18.628969+0000","last_fullsized":"2024-05-07T14:05:18.628969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"124'22","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960298+0000","last_change":"2024-05-07T14:01:37.554242+0000","last_active":"2024-05-07T14:05:18.960298+0000","last_peered":"2024-05-07T14:05:18.960298+0000","last_clean":"2024-05-07T14:05:18.960298+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:05:18.960298+0000","last_undegraded":"2024-05-07T14:05:18.960298+0000","last_fullsized":"2024-05-07T14:05:18.960298+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:16:22.149514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962634+0000","last_change":"2024-05-07T14:03:39.674947+0000","last_active":"2024-05-07T14:05:18.962634+0000","last_peered":"2024-05-07T14:05:18.962634+0000","last_clean":"2024-05-07T14:05:18.962634+0000","last_became_active":"2024-05-07T14:03:39.659887+0000","last_became_peered":"2024-05-07T14:03:39.659887+0000","last_unstale":"2024-05-07T14:05:18.962634+0000","last_undegraded":"2024-05-07T14:05:18.962634+0000","last_fullsized":"2024-05-07T14:05:18.962634+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:18:06.217561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"124'17","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628561+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:05:18.628561+0000","last_peered":"2024-05-07T14:05:18.628561+0000","last_clean":"2024-05-07T14:05:18.628561+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:05:18.628561+0000","last_undegraded":"2024-05-07T14:05:18.628561+0000","last_fullsized":"2024-05-07T14:05:18.628561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958734+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:05:18.958734+0000","last_peered":"2024-05-07T14:05:18.958734+0000","last_clean":"2024-05-07T14:05:18.958734+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:05:18.958734+0000","last_undegraded":"2024-05-07T14:05:18.958734+0000","last_fullsized":"2024-05-07T14:05:18.958734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631326+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:05:18.631326+0000","last_peered":"2024-05-07T14:05:18.631326+0000","last_clean":"2024-05-07T14:05:18.631326+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:05:18.631326+0000","last_undegraded":"2024-05-07T14:05:18.631326+0000","last_fullsized":"2024-05-07T14:05:18.631326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"87'16","reported_seq":110,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960757+0000","last_change":"2024-05-07T14:03:39.799013+0000","last_active":"2024-05-07T14:05:18.960757+0000","last_peered":"2024-05-07T14:05:18.960757+0000","last_clean":"2024-05-07T14:05:18.960757+0000","last_became_active":"2024-05-07T14:03:39.671068+0000","last_became_peered":"2024-05-07T14:03:39.671068+0000","last_unstale":"2024-05-07T14:05:18.960757+0000","last_undegraded":"2024-05-07T14:05:18.960757+0000","last_fullsized":"2024-05-07T14:05:18.960757+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:13.746128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"124'22","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959122+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:05:18.959122+0000","last_peered":"2024-05-07T14:05:18.959122+0000","last_clean":"2024-05-07T14:05:18.959122+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:05:18.959122+0000","last_undegraded":"2024-05-07T14:05:18.959122+0000","last_fullsized":"2024-05-07T14:05:18.959122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90177536,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959826+0000","last_change":"2024-05-07T14:03:39.661724+0000","last_active":"2024-05-07T14:05:18.959826+0000","last_peered":"2024-05-07T14:05:18.959826+0000","last_clean":"2024-05-07T14:05:18.959826+0000","last_became_active":"2024-05-07T14:03:39.661339+0000","last_became_peered":"2024-05-07T14:03:39.661339+0000","last_unstale":"2024-05-07T14:05:18.959826+0000","last_undegraded":"2024-05-07T14:05:18.959826+0000","last_fullsized":"2024-05-07T14:05:18.959826+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:34.633849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"123'17","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628556+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:05:18.628556+0000","last_peered":"2024-05-07T14:05:18.628556+0000","last_clean":"2024-05-07T14:05:18.628556+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:05:18.628556+0000","last_undegraded":"2024-05-07T14:05:18.628556+0000","last_fullsized":"2024-05-07T14:05:18.628556+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:01.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"81'6","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721729+0000","last_change":"2024-05-07T14:04:59.467441+0000","last_active":"2024-05-07T14:05:18.721729+0000","last_peered":"2024-05-07T14:05:18.721729+0000","last_clean":"2024-05-07T14:05:18.721729+0000","last_became_active":"2024-05-07T14:04:59.466443+0000","last_became_peered":"2024-05-07T14:04:59.466443+0000","last_unstale":"2024-05-07T14:05:18.721729+0000","last_undegraded":"2024-05-07T14:05:18.721729+0000","last_fullsized":"2024-05-07T14:05:18.721729+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:35.485711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"124'25","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721037+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:05:18.721037+0000","last_peered":"2024-05-07T14:05:18.721037+0000","last_clean":"2024-05-07T14:05:18.721037+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:05:18.721037+0000","last_undegraded":"2024-05-07T14:05:18.721037+0000","last_fullsized":"2024-05-07T14:05:18.721037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"124'4","reported_seq":124,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961882+0000","last_change":"2024-05-07T14:04:59.861145+0000","last_active":"2024-05-07T14:05:18.961882+0000","last_peered":"2024-05-07T14:05:18.961882+0000","last_clean":"2024-05-07T14:05:18.961882+0000","last_became_active":"2024-05-07T14:04:59.445932+0000","last_became_peered":"2024-05-07T14:04:59.445932+0000","last_unstale":"2024-05-07T14:05:18.961882+0000","last_undegraded":"2024-05-07T14:05:18.961882+0000","last_fullsized":"2024-05-07T14:05:18.961882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:42.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"124'28","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960357+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:05:18.960357+0000","last_peered":"2024-05-07T14:05:18.960357+0000","last_clean":"2024-05-07T14:05:18.960357+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:05:18.960357+0000","last_undegraded":"2024-05-07T14:05:18.960357+0000","last_fullsized":"2024-05-07T14:05:18.960357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"81'2","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965417+0000","last_change":"2024-05-07T14:04:59.448690+0000","last_active":"2024-05-07T14:05:18.965417+0000","last_peered":"2024-05-07T14:05:18.965417+0000","last_clean":"2024-05-07T14:05:18.965417+0000","last_became_active":"2024-05-07T14:04:59.447844+0000","last_became_peered":"2024-05-07T14:04:59.447844+0000","last_unstale":"2024-05-07T14:05:18.965417+0000","last_undegraded":"2024-05-07T14:05:18.965417+0000","last_fullsized":"2024-05-07T14:05:18.965417+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:48:36.699391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"124'21","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964522+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:05:18.964522+0000","last_peered":"2024-05-07T14:05:18.964522+0000","last_clean":"2024-05-07T14:05:18.964522+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:05:18.964522+0000","last_undegraded":"2024-05-07T14:05:18.964522+0000","last_fullsized":"2024-05-07T14:05:18.964522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629774+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:05:18.629774+0000","last_peered":"2024-05-07T14:05:18.629774+0000","last_clean":"2024-05-07T14:05:18.629774+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:05:18.629774+0000","last_undegraded":"2024-05-07T14:05:18.629774+0000","last_fullsized":"2024-05-07T14:05:18.629774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"124'28","reported_seq":133,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965151+0000","last_change":"2024-05-07T14:03:39.789159+0000","last_active":"2024-05-07T14:05:18.965151+0000","last_peered":"2024-05-07T14:05:18.965151+0000","last_clean":"2024-05-07T14:05:18.965151+0000","last_became_active":"2024-05-07T14:03:39.668790+0000","last_became_peered":"2024-05-07T14:03:39.668790+0000","last_unstale":"2024-05-07T14:05:18.965151+0000","last_undegraded":"2024-05-07T14:05:18.965151+0000","last_fullsized":"2024-05-07T14:05:18.965151+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:14.798045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"81'8","reported_seq":319,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959979+0000","last_change":"2024-05-07T14:03:39.855375+0000","last_active":"2024-05-07T14:05:18.959979+0000","last_peered":"2024-05-07T14:05:18.959979+0000","last_clean":"2024-05-07T14:05:18.959979+0000","last_became_active":"2024-05-07T14:03:39.666451+0000","last_became_peered":"2024-05-07T14:03:39.666451+0000","last_unstale":"2024-05-07T14:05:18.959979+0000","last_undegraded":"2024-05-07T14:05:18.959979+0000","last_fullsized":"2024-05-07T14:05:18.959979+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:37.171990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"124'22","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961451+0000","last_change":"2024-05-07T14:05:00.248173+0000","last_active":"2024-05-07T14:05:18.961451+0000","last_peered":"2024-05-07T14:05:18.961451+0000","last_clean":"2024-05-07T14:05:18.961451+0000","last_became_active":"2024-05-07T14:04:59.455622+0000","last_became_peered":"2024-05-07T14:04:59.455622+0000","last_unstale":"2024-05-07T14:05:18.961451+0000","last_undegraded":"2024-05-07T14:05:18.961451+0000","last_fullsized":"2024-05-07T14:05:18.961451+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:03.691207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"115'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959101+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:05:18.959101+0000","last_peered":"2024-05-07T14:05:18.959101+0000","last_clean":"2024-05-07T14:05:18.959101+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:05:18.959101+0000","last_undegraded":"2024-05-07T14:05:18.959101+0000","last_fullsized":"2024-05-07T14:05:18.959101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"124'20","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963922+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:05:18.963922+0000","last_peered":"2024-05-07T14:05:18.963922+0000","last_clean":"2024-05-07T14:05:18.963922+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:05:18.963922+0000","last_undegraded":"2024-05-07T14:05:18.963922+0000","last_fullsized":"2024-05-07T14:05:18.963922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"106'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960114+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:05:18.960114+0000","last_peered":"2024-05-07T14:05:18.960114+0000","last_clean":"2024-05-07T14:05:18.960114+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:05:18.960114+0000","last_undegraded":"2024-05-07T14:05:18.960114+0000","last_fullsized":"2024-05-07T14:05:18.960114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"124'29","reported_seq":287,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720842+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:05:18.720842+0000","last_peered":"2024-05-07T14:05:18.720842+0000","last_clean":"2024-05-07T14:05:18.720842+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:05:18.720842+0000","last_undegraded":"2024-05-07T14:05:18.720842+0000","last_fullsized":"2024-05-07T14:05:18.720842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":39,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630722+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:05:18.630722+0000","last_peered":"2024-05-07T14:05:18.630722+0000","last_clean":"2024-05-07T14:05:18.630722+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:05:18.630722+0000","last_undegraded":"2024-05-07T14:05:18.630722+0000","last_fullsized":"2024-05-07T14:05:18.630722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"124'24","reported_seq":282,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960162+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:05:18.960162+0000","last_peered":"2024-05-07T14:05:18.960162+0000","last_clean":"2024-05-07T14:05:18.960162+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:05:18.960162+0000","last_undegraded":"2024-05-07T14:05:18.960162+0000","last_fullsized":"2024-05-07T14:05:18.960162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"106'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630125+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:05:18.630125+0000","last_peered":"2024-05-07T14:05:18.630125+0000","last_clean":"2024-05-07T14:05:18.630125+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:05:18.630125+0000","last_undegraded":"2024-05-07T14:05:18.630125+0000","last_fullsized":"2024-05-07T14:05:18.630125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"124'27","reported_seq":304,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720928+0000","last_change":"2024-05-07T14:04:59.856502+0000","last_active":"2024-05-07T14:05:18.720928+0000","last_peered":"2024-05-07T14:05:18.720928+0000","last_clean":"2024-05-07T14:05:18.720928+0000","last_became_active":"2024-05-07T14:04:59.443769+0000","last_became_peered":"2024-05-07T14:04:59.443769+0000","last_unstale":"2024-05-07T14:05:18.720928+0000","last_undegraded":"2024-05-07T14:05:18.720928+0000","last_fullsized":"2024-05-07T14:05:18.720928+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:48:34.692070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631323+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:05:18.631323+0000","last_peered":"2024-05-07T14:05:18.631323+0000","last_clean":"2024-05-07T14:05:18.631323+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:05:18.631323+0000","last_undegraded":"2024-05-07T14:05:18.631323+0000","last_fullsized":"2024-05-07T14:05:18.631323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"124'27","reported_seq":309,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960488+0000","last_change":"2024-05-07T14:05:01.098433+0000","last_active":"2024-05-07T14:05:18.960488+0000","last_peered":"2024-05-07T14:05:18.960488+0000","last_clean":"2024-05-07T14:05:18.960488+0000","last_became_active":"2024-05-07T14:04:59.458388+0000","last_became_peered":"2024-05-07T14:04:59.458388+0000","last_unstale":"2024-05-07T14:05:18.960488+0000","last_undegraded":"2024-05-07T14:05:18.960488+0000","last_fullsized":"2024-05-07T14:05:18.960488+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:29:00.050525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"81'6","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961340+0000","last_change":"2024-05-07T14:04:59.449854+0000","last_active":"2024-05-07T14:05:18.961340+0000","last_peered":"2024-05-07T14:05:18.961340+0000","last_clean":"2024-05-07T14:05:18.961340+0000","last_became_active":"2024-05-07T14:04:59.448913+0000","last_became_peered":"2024-05-07T14:04:59.448913+0000","last_unstale":"2024-05-07T14:05:18.961340+0000","last_undegraded":"2024-05-07T14:05:18.961340+0000","last_fullsized":"2024-05-07T14:05:18.961340+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:39.717523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"124'29","reported_seq":286,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960737+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:05:18.960737+0000","last_peered":"2024-05-07T14:05:18.960737+0000","last_clean":"2024-05-07T14:05:18.960737+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:05:18.960737+0000","last_undegraded":"2024-05-07T14:05:18.960737+0000","last_fullsized":"2024-05-07T14:05:18.960737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":119537664,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"87'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958982+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:05:18.958982+0000","last_peered":"2024-05-07T14:05:18.958982+0000","last_clean":"2024-05-07T14:05:18.958982+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:05:18.958982+0000","last_undegraded":"2024-05-07T14:05:18.958982+0000","last_fullsized":"2024-05-07T14:05:18.958982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"123'23","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961924+0000","last_change":"2024-05-07T14:05:02.233669+0000","last_active":"2024-05-07T14:05:18.961924+0000","last_peered":"2024-05-07T14:05:18.961924+0000","last_clean":"2024-05-07T14:05:18.961924+0000","last_became_active":"2024-05-07T14:04:59.459490+0000","last_became_peered":"2024-05-07T14:04:59.459490+0000","last_unstale":"2024-05-07T14:05:18.961924+0000","last_undegraded":"2024-05-07T14:05:18.961924+0000","last_fullsized":"2024-05-07T14:05:18.961924+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:24.042272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"81'6","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959954+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:05:18.959954+0000","last_peered":"2024-05-07T14:05:18.959954+0000","last_clean":"2024-05-07T14:05:18.959954+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:05:18.959954+0000","last_undegraded":"2024-05-07T14:05:18.959954+0000","last_fullsized":"2024-05-07T14:05:18.959954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"124'26","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630545+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:05:18.630545+0000","last_peered":"2024-05-07T14:05:18.630545+0000","last_clean":"2024-05-07T14:05:18.630545+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:05:18.630545+0000","last_undegraded":"2024-05-07T14:05:18.630545+0000","last_fullsized":"2024-05-07T14:05:18.630545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"124'6","reported_seq":199,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960492+0000","last_change":"2024-05-07T14:05:00.223495+0000","last_active":"2024-05-07T14:05:18.960492+0000","last_peered":"2024-05-07T14:05:18.960492+0000","last_clean":"2024-05-07T14:05:18.960492+0000","last_became_active":"2024-05-07T14:04:59.442569+0000","last_became_peered":"2024-05-07T14:04:59.442569+0000","last_unstale":"2024-05-07T14:05:18.960492+0000","last_undegraded":"2024-05-07T14:05:18.960492+0000","last_fullsized":"2024-05-07T14:05:18.960492+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:10.158704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"124'26","reported_seq":300,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722687+0000","last_change":"2024-05-07T14:05:01.256475+0000","last_active":"2024-05-07T14:05:18.722687+0000","last_peered":"2024-05-07T14:05:18.722687+0000","last_clean":"2024-05-07T14:05:18.722687+0000","last_became_active":"2024-05-07T14:04:59.461335+0000","last_became_peered":"2024-05-07T14:04:59.461335+0000","last_unstale":"2024-05-07T14:05:18.722687+0000","last_undegraded":"2024-05-07T14:05:18.722687+0000","last_fullsized":"2024-05-07T14:05:18.722687+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:34.213014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"124'24","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720700+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:05:18.720700+0000","last_peered":"2024-05-07T14:05:18.720700+0000","last_clean":"2024-05-07T14:05:18.720700+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:05:18.720700+0000","last_undegraded":"2024-05-07T14:05:18.720700+0000","last_fullsized":"2024-05-07T14:05:18.720700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"124'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959984+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:05:18.959984+0000","last_peered":"2024-05-07T14:05:18.959984+0000","last_clean":"2024-05-07T14:05:18.959984+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:05:18.959984+0000","last_undegraded":"2024-05-07T14:05:18.959984+0000","last_fullsized":"2024-05-07T14:05:18.959984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"124'21","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963118+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:05:18.963118+0000","last_peered":"2024-05-07T14:05:18.963118+0000","last_clean":"2024-05-07T14:05:18.963118+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:05:18.963118+0000","last_undegraded":"2024-05-07T14:05:18.963118+0000","last_fullsized":"2024-05-07T14:05:18.963118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"106'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722115+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:05:18.722115+0000","last_peered":"2024-05-07T14:05:18.722115+0000","last_clean":"2024-05-07T14:05:18.722115+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:05:18.722115+0000","last_undegraded":"2024-05-07T14:05:18.722115+0000","last_fullsized":"2024-05-07T14:05:18.722115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":313,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1094,"ondisk_log_size":1094,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382934,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":846,"num_read_kb":608,"num_write":467,"num_write_kb":422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":121255,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1024000,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":763,"ondisk_log_size":763,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":341,"num_read_kb":341,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1436,"num_read_kb":1404,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":620756992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":129,"seq":554050781192,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1805596,"kb_used_data":1769364,"kb_used_omap":6,"kb_used_meta":36217,"kb_avail":92566244,"statfs":{"total":96636764160,"available":94787833856,"internally_reserved":0,"allocated":1811828736,"data_stored":1811073810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6345,"internal_metadata":37087031},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1266508,"kb_used_data":1235332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93105332,"statfs":{"total":96636764160,"available":95339859968,"internally_reserved":0,"allocated":1264979968,"data_stored":1264248696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1941880,"kb_used_data":1906544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92429960,"statfs":{"total":96636764160,"available":94648279040,"internally_reserved":0,"allocated":1952301056,"data_stored":1951526125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574909,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1749148,"kb_used_data":1717960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92622692,"statfs":{"total":96636764160,"available":94845636608,"internally_reserved":0,"allocated":1759191040,"data_stored":1758470596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1917804,"kb_used_data":1882468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92454036,"statfs":{"total":96636764160,"available":94672932864,"internally_reserved":0,"allocated":1927647232,"data_stored":1926891074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1015952,"kb_used_data":984776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93355888,"statfs":{"total":96636764160,"available":95596429312,"internally_reserved":0,"allocated":1008410624,"data_stored":1007689142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1192296,"kb_used_data":1156960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93179544,"statfs":{"total":96636764160,"available":95415853056,"internally_reserved":0,"allocated":1184727040,"data_stored":1183969856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1698080,"kb_used_data":1666900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92673760,"statfs":{"total":96636764160,"available":94897930240,"internally_reserved":0,"allocated":1706905600,"data_stored":1706157621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1704984576,"data_stored":1704984576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1182793728,"data_stored":1182793728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1006632960,"data_stored":1006632960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1925185536,"data_stored":1925185536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1757413376,"data_stored":1757413376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1950351360,"data_stored":1950351360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1262485504,"data_stored":1262485504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1809842176,"data_stored":1809842176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":117239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":119338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":119222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":117465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":176275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:05:32.834 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-07T14:05:33.168 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:05:33.168 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":146,"fsid":"0d349e2f-0c2b-4aab-8a22-181c69b40dbb","created":"2024-05-07T14:00:30.482506+0000","modified":"2024-05-07T14:05:18.618451+0000","last_up_change":"2024-05-07T14:04:58.386102+0000","last_in_change":"2024-05-07T14:00:32.857383+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-07T14:00:43.291253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-07T14:00:48.791671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-07T14:00:54.652419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-07T14:00:56.328700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-07T14:00:58.247912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-07T14:01:00.134259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-07T14:01:02.056070+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-07T14:01:04.177565+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e76f5d56-1400-488e-b58f-7af657fa63ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6801","nonce":3743893730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6803","nonce":3743893730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6807","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6809","nonce":3743893730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":3743893730},{"type":"v1","addr":"172.21.15.106:6805","nonce":3743893730}]},"public_addr":"172.21.15.106:6801/3743893730","cluster_addr":"172.21.15.106:6803/3743893730","heartbeat_back_addr":"172.21.15.106:6809/3743893730","heartbeat_front_addr":"172.21.15.106:6805/3743893730","state":["exists","up"]},{"osd":1,"uuid":"aad5864b-9a5f-426f-a8fd-15d02590106e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6817","nonce":3901521345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6819","nonce":3901521345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6823","nonce":3901521345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":3901521345},{"type":"v1","addr":"172.21.15.106:6821","nonce":3901521345}]},"public_addr":"172.21.15.106:6817/3901521345","cluster_addr":"172.21.15.106:6819/3901521345","heartbeat_back_addr":"172.21.15.106:6823/3901521345","heartbeat_front_addr":"172.21.15.106:6821/3901521345","state":["exists","up"]},{"osd":2,"uuid":"eea131cd-e4ca-4360-a8a0-5005a2d827d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6825","nonce":1784825450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6827","nonce":1784825450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6831","nonce":1784825450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":1784825450},{"type":"v1","addr":"172.21.15.106:6829","nonce":1784825450}]},"public_addr":"172.21.15.106:6825/1784825450","cluster_addr":"172.21.15.106:6827/1784825450","heartbeat_back_addr":"172.21.15.106:6831/1784825450","heartbeat_front_addr":"172.21.15.106:6829/1784825450","state":["exists","up"]},{"osd":3,"uuid":"bdcb438c-1d40-45a2-8e8a-f29ba9c98909","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6808","nonce":123863977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6811","nonce":123863977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6815","nonce":123863977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":123863977},{"type":"v1","addr":"172.21.15.106:6813","nonce":123863977}]},"public_addr":"172.21.15.106:6808/123863977","cluster_addr":"172.21.15.106:6811/123863977","heartbeat_back_addr":"172.21.15.106:6815/123863977","heartbeat_front_addr":"172.21.15.106:6813/123863977","state":["exists","up"]},{"osd":4,"uuid":"703f4a52-4283-4395-bc29-4de194d4a4ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6817","nonce":3575310712}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6819","nonce":3575310712}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6824","nonce":3575310712}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3575310712},{"type":"v1","addr":"172.21.15.107:6821","nonce":3575310712}]},"public_addr":"172.21.15.107:6817/3575310712","cluster_addr":"172.21.15.107:6819/3575310712","heartbeat_back_addr":"172.21.15.107:6824/3575310712","heartbeat_front_addr":"172.21.15.107:6821/3575310712","state":["exists","up"]},{"osd":5,"uuid":"8b70f365-8b0d-429e-b3f8-601a37cfb6ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6801","nonce":2178038050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6803","nonce":2178038050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6807","nonce":2178038050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2178038050},{"type":"v1","addr":"172.21.15.107:6805","nonce":2178038050}]},"public_addr":"172.21.15.107:6801/2178038050","cluster_addr":"172.21.15.107:6803/2178038050","heartbeat_back_addr":"172.21.15.107:6807/2178038050","heartbeat_front_addr":"172.21.15.107:6805/2178038050","state":["exists","up"]},{"osd":6,"uuid":"b65085d6-47af-4dfc-91a8-cdc7a6fa937c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6823","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6825","nonce":3168866293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6827","nonce":3168866293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6831","nonce":3168866293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":3168866293},{"type":"v1","addr":"172.21.15.107:6829","nonce":3168866293}]},"public_addr":"172.21.15.107:6825/3168866293","cluster_addr":"172.21.15.107:6827/3168866293","heartbeat_back_addr":"172.21.15.107:6831/3168866293","heartbeat_front_addr":"172.21.15.107:6829/3168866293","state":["exists","up"]},{"osd":7,"uuid":"9a808e41-afba-400f-886a-8f17689bebda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":118,"up_from":129,"up_thru":129,"down_at":119,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":564060879},{"type":"v1","addr":"172.21.15.107:6809","nonce":564060879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":564060879},{"type":"v1","addr":"172.21.15.107:6811","nonce":564060879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":564060879},{"type":"v1","addr":"172.21.15.107:6815","nonce":564060879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":564060879},{"type":"v1","addr":"172.21.15.107:6813","nonce":564060879}]},"public_addr":"172.21.15.107:6809/564060879","cluster_addr":"172.21.15.107:6811/564060879","heartbeat_back_addr":"172.21.15.107:6815/564060879","heartbeat_front_addr":"172.21.15.107:6813/564060879","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.435492+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.545586+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.430790+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.530476+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.487321+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.254353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.381089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-07T14:00:38.430233+0000","dead_epoch":119}],"pg_upmap":[{"pgid":"1.0","osds":[6,3]}],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-07T14:05:34.186 INFO:tasks.ceph:Scrubbing osd.0 2024-05-07T14:05:34.187 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-07T14:05:34.345 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:05:34.345 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-07T14:05:34.345 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:05:34.363 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-07T14:05:34.641 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 0 to deep-scrub 2024-05-07T14:05:34.660 INFO:tasks.ceph:Scrubbing osd.1 2024-05-07T14:05:34.660 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-07T14:05:34.794 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:05:34.794 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-07T14:05:34.794 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:05:34.808 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-07T14:05:35.087 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 1 to deep-scrub 2024-05-07T14:05:35.105 INFO:tasks.ceph:Scrubbing osd.2 2024-05-07T14:05:35.106 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-07T14:05:35.240 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:05:35.240 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-07T14:05:35.240 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:05:35.255 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-07T14:05:35.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-05-07T14:05:35.519 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 2 to deep-scrub 2024-05-07T14:05:35.537 INFO:tasks.ceph:Scrubbing osd.3 2024-05-07T14:05:35.537 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-07T14:05:35.674 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:05:35.674 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-07T14:05:35.674 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:05:35.689 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-07T14:05:35.951 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 3 to deep-scrub 2024-05-07T14:05:35.970 INFO:tasks.ceph:Scrubbing osd.4 2024-05-07T14:05:35.971 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-07T14:05:36.112 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:05:36.112 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-07T14:05:36.112 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:05:36.127 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-07T14:05:36.390 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 4 to deep-scrub 2024-05-07T14:05:36.410 INFO:tasks.ceph:Scrubbing osd.5 2024-05-07T14:05:36.410 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-07T14:05:36.560 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:05:36.560 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-07T14:05:36.560 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:05:36.576 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-07T14:05:36.851 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 5 to deep-scrub 2024-05-07T14:05:36.869 INFO:tasks.ceph:Scrubbing osd.6 2024-05-07T14:05:36.869 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-07T14:05:37.018 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:05:37.019 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-07T14:05:37.019 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:05:37.032 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-07T14:05:37.313 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 6 to deep-scrub 2024-05-07T14:05:37.331 INFO:tasks.ceph:Scrubbing osd.7 2024-05-07T14:05:37.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-07T14:05:37.478 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-05-07T14:05:37.478 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-05-07T14:05:37.478 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-05-07T14:05:37.493 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-07T14:05:37.762 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 7 to deep-scrub 2024-05-07T14:05:37.780 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:05:38.127 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:05:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:05:38.151 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-05-07T14:05:37.421105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":623988,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4834,"num_read_kb":3736,"num_write":4429,"num_write_kb":6187921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":252,"num_bytes_recovered":621470484,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5551,"ondisk_log_size":5551,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":299268,"kb_used_data":15192,"kb_used_omap":17,"kb_used_meta":283502,"kb_avail":754675452,"statfs":{"total":773094113280,"available":772787662848,"internally_reserved":0,"allocated":15556608,"data_stored":9635044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17505,"internal_metadata":290306975},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6300195938,"num_objects":-1504,"num_object_clones":0,"num_object_copies":-3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1504,"num_whiteouts":0,"num_read":1730,"num_read_kb":946,"num_write":1582,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.094492"},"pg_stats":[{"pgid":"3.3f","version":"146'58","reported_seq":310,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.611902+0000","last_change":"2024-05-07T14:05:02.012333+0000","last_active":"2024-05-07T14:05:31.611902+0000","last_peered":"2024-05-07T14:05:31.611902+0000","last_clean":"2024-05-07T14:05:31.611902+0000","last_became_active":"2024-05-07T14:04:59.458324+0000","last_became_peered":"2024-05-07T14:04:59.458324+0000","last_unstale":"2024-05-07T14:05:31.611902+0000","last_undegraded":"2024-05-07T14:05:31.611902+0000","last_fullsized":"2024-05-07T14:05:31.611902+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:58:18.777392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719899+0000","last_change":"2024-05-07T14:00:58.007260+0000","last_active":"2024-05-07T14:05:18.719899+0000","last_peered":"2024-05-07T14:05:18.719899+0000","last_clean":"2024-05-07T14:05:18.719899+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:05:18.719899+0000","last_undegraded":"2024-05-07T14:05:18.719899+0000","last_fullsized":"2024-05-07T14:05:18.719899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"146'58","reported_seq":162,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.605778+0000","last_change":"2024-05-07T14:03:39.850495+0000","last_active":"2024-05-07T14:05:31.605778+0000","last_peered":"2024-05-07T14:05:31.605778+0000","last_clean":"2024-05-07T14:05:31.605778+0000","last_became_active":"2024-05-07T14:03:39.676092+0000","last_became_peered":"2024-05-07T14:03:39.676092+0000","last_unstale":"2024-05-07T14:05:31.605778+0000","last_undegraded":"2024-05-07T14:05:31.605778+0000","last_fullsized":"2024-05-07T14:05:31.605778+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:00.668304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"80'2","reported_seq":172,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963019+0000","last_change":"2024-05-07T14:04:59.442787+0000","last_active":"2024-05-07T14:05:18.963019+0000","last_peered":"2024-05-07T14:05:18.963019+0000","last_clean":"2024-05-07T14:05:18.963019+0000","last_became_active":"2024-05-07T14:04:59.430479+0000","last_became_peered":"2024-05-07T14:04:59.430479+0000","last_unstale":"2024-05-07T14:05:18.963019+0000","last_undegraded":"2024-05-07T14:05:18.963019+0000","last_fullsized":"2024-05-07T14:05:18.963019+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:27.875022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"146'40","reported_seq":298,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.516117+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:05:31.516117+0000","last_peered":"2024-05-07T14:05:31.516117+0000","last_clean":"2024-05-07T14:05:31.516117+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:05:31.516117+0000","last_undegraded":"2024-05-07T14:05:31.516117+0000","last_fullsized":"2024-05-07T14:05:31.516117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629168+0000","last_change":"2024-05-07T14:00:58.003940+0000","last_active":"2024-05-07T14:05:18.629168+0000","last_peered":"2024-05-07T14:05:18.629168+0000","last_clean":"2024-05-07T14:05:18.629168+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:05:18.629168+0000","last_undegraded":"2024-05-07T14:05:18.629168+0000","last_fullsized":"2024-05-07T14:05:18.629168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:34.461047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"146'50","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.522338+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:05:31.522338+0000","last_peered":"2024-05-07T14:05:31.522338+0000","last_clean":"2024-05-07T14:05:31.522338+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:05:31.522338+0000","last_undegraded":"2024-05-07T14:05:31.522338+0000","last_fullsized":"2024-05-07T14:05:31.522338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"81'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960256+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:05:18.960256+0000","last_peered":"2024-05-07T14:05:18.960256+0000","last_clean":"2024-05-07T14:05:18.960256+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:05:18.960256+0000","last_undegraded":"2024-05-07T14:05:18.960256+0000","last_fullsized":"2024-05-07T14:05:18.960256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"146'48","reported_seq":296,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.530336+0000","last_change":"2024-05-07T14:05:01.033639+0000","last_active":"2024-05-07T14:05:31.530336+0000","last_peered":"2024-05-07T14:05:31.530336+0000","last_clean":"2024-05-07T14:05:31.530336+0000","last_became_active":"2024-05-07T14:04:59.455288+0000","last_became_peered":"2024-05-07T14:04:59.455288+0000","last_unstale":"2024-05-07T14:05:31.530336+0000","last_undegraded":"2024-05-07T14:05:31.530336+0000","last_fullsized":"2024-05-07T14:05:31.530336+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:06:05.572323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"115'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960336+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:05:18.960336+0000","last_peered":"2024-05-07T14:05:18.960336+0000","last_clean":"2024-05-07T14:05:18.960336+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:05:18.960336+0000","last_undegraded":"2024-05-07T14:05:18.960336+0000","last_fullsized":"2024-05-07T14:05:18.960336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:17.633928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"146'38","reported_seq":294,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.620337+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:05:31.620337+0000","last_peered":"2024-05-07T14:05:31.620337+0000","last_clean":"2024-05-07T14:05:31.620337+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:05:31.620337+0000","last_undegraded":"2024-05-07T14:05:31.620337+0000","last_fullsized":"2024-05-07T14:05:31.620337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"115'4","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630099+0000","last_change":"2024-05-07T14:00:58.002770+0000","last_active":"2024-05-07T14:05:18.630099+0000","last_peered":"2024-05-07T14:05:18.630099+0000","last_clean":"2024-05-07T14:05:18.630099+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:05:18.630099+0000","last_undegraded":"2024-05-07T14:05:18.630099+0000","last_fullsized":"2024-05-07T14:05:18.630099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"146'50","reported_seq":299,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.595479+0000","last_change":"2024-05-07T14:05:00.220571+0000","last_active":"2024-05-07T14:05:31.595479+0000","last_peered":"2024-05-07T14:05:31.595479+0000","last_clean":"2024-05-07T14:05:31.595479+0000","last_became_active":"2024-05-07T14:04:59.444214+0000","last_became_peered":"2024-05-07T14:04:59.444214+0000","last_unstale":"2024-05-07T14:05:31.595479+0000","last_undegraded":"2024-05-07T14:05:31.595479+0000","last_fullsized":"2024-05-07T14:05:31.595479+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:18:23.503893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"81'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721808+0000","last_change":"2024-05-07T14:00:57.989712+0000","last_active":"2024-05-07T14:05:18.721808+0000","last_peered":"2024-05-07T14:05:18.721808+0000","last_clean":"2024-05-07T14:05:18.721808+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:05:18.721808+0000","last_undegraded":"2024-05-07T14:05:18.721808+0000","last_fullsized":"2024-05-07T14:05:18.721808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"146'46","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.625132+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:05:31.625132+0000","last_peered":"2024-05-07T14:05:31.625132+0000","last_clean":"2024-05-07T14:05:31.625132+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:05:31.625132+0000","last_undegraded":"2024-05-07T14:05:31.625132+0000","last_fullsized":"2024-05-07T14:05:31.625132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"124'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630377+0000","last_change":"2024-05-07T14:00:57.996549+0000","last_active":"2024-05-07T14:05:18.630377+0000","last_peered":"2024-05-07T14:05:18.630377+0000","last_clean":"2024-05-07T14:05:18.630377+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:05:18.630377+0000","last_undegraded":"2024-05-07T14:05:18.630377+0000","last_fullsized":"2024-05-07T14:05:18.630377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:40.896772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628673+0000","last_change":"2024-05-07T14:00:58.005817+0000","last_active":"2024-05-07T14:05:18.628673+0000","last_peered":"2024-05-07T14:05:18.628673+0000","last_clean":"2024-05-07T14:05:18.628673+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:05:18.628673+0000","last_undegraded":"2024-05-07T14:05:18.628673+0000","last_fullsized":"2024-05-07T14:05:18.628673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"146'46","reported_seq":292,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.635365+0000","last_change":"2024-05-07T14:05:01.245123+0000","last_active":"2024-05-07T14:05:31.635365+0000","last_peered":"2024-05-07T14:05:31.635365+0000","last_clean":"2024-05-07T14:05:31.635365+0000","last_became_active":"2024-05-07T14:04:59.452315+0000","last_became_peered":"2024-05-07T14:04:59.452315+0000","last_unstale":"2024-05-07T14:05:31.635365+0000","last_undegraded":"2024-05-07T14:05:31.635365+0000","last_fullsized":"2024-05-07T14:05:31.635365+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:20:40.045208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962499+0000","last_change":"2024-05-07T14:04:59.435447+0000","last_active":"2024-05-07T14:05:18.962499+0000","last_peered":"2024-05-07T14:05:18.962499+0000","last_clean":"2024-05-07T14:05:18.962499+0000","last_became_active":"2024-05-07T14:04:59.429254+0000","last_became_peered":"2024-05-07T14:04:59.429254+0000","last_unstale":"2024-05-07T14:05:18.962499+0000","last_undegraded":"2024-05-07T14:05:18.962499+0000","last_fullsized":"2024-05-07T14:05:18.962499+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:42:46.014749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"146'46","reported_seq":302,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.579122+0000","last_change":"2024-05-07T14:00:56.008166+0000","last_active":"2024-05-07T14:05:31.579122+0000","last_peered":"2024-05-07T14:05:31.579122+0000","last_clean":"2024-05-07T14:05:31.579122+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:05:31.579122+0000","last_undegraded":"2024-05-07T14:05:31.579122+0000","last_fullsized":"2024-05-07T14:05:31.579122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":252,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720762+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:05:18.720762+0000","last_peered":"2024-05-07T14:05:18.720762+0000","last_clean":"2024-05-07T14:05:18.720762+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:05:18.720762+0000","last_undegraded":"2024-05-07T14:05:18.720762+0000","last_fullsized":"2024-05-07T14:05:18.720762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"146'62","reported_seq":318,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.577031+0000","last_change":"2024-05-07T14:00:56.007946+0000","last_active":"2024-05-07T14:05:31.577031+0000","last_peered":"2024-05-07T14:05:31.577031+0000","last_clean":"2024-05-07T14:05:31.577031+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:05:31.577031+0000","last_undegraded":"2024-05-07T14:05:31.577031+0000","last_fullsized":"2024-05-07T14:05:31.577031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"124'10","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629192+0000","last_change":"2024-05-07T14:01:37.318563+0000","last_active":"2024-05-07T14:05:18.629192+0000","last_peered":"2024-05-07T14:05:18.629192+0000","last_clean":"2024-05-07T14:05:18.629192+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:05:18.629192+0000","last_undegraded":"2024-05-07T14:05:18.629192+0000","last_fullsized":"2024-05-07T14:05:18.629192+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:27.423500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"146'54","reported_seq":312,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.588645+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:05:31.588645+0000","last_peered":"2024-05-07T14:05:31.588645+0000","last_clean":"2024-05-07T14:05:31.588645+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:05:31.588645+0000","last_undegraded":"2024-05-07T14:05:31.588645+0000","last_fullsized":"2024-05-07T14:05:31.588645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"106'8","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629560+0000","last_change":"2024-05-07T14:00:58.006204+0000","last_active":"2024-05-07T14:05:18.629560+0000","last_peered":"2024-05-07T14:05:18.629560+0000","last_clean":"2024-05-07T14:05:18.629560+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:05:18.629560+0000","last_undegraded":"2024-05-07T14:05:18.629560+0000","last_fullsized":"2024-05-07T14:05:18.629560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:37.547803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"146'64","reported_seq":321,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.451334+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:05:31.451334+0000","last_peered":"2024-05-07T14:05:31.451334+0000","last_clean":"2024-05-07T14:05:31.451334+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:05:31.451334+0000","last_undegraded":"2024-05-07T14:05:31.451334+0000","last_fullsized":"2024-05-07T14:05:31.451334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:16.462932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"106'2","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630109+0000","last_change":"2024-05-07T14:03:39.848413+0000","last_active":"2024-05-07T14:05:18.630109+0000","last_peered":"2024-05-07T14:05:18.630109+0000","last_clean":"2024-05-07T14:05:18.630109+0000","last_became_active":"2024-05-07T14:03:39.663590+0000","last_became_peered":"2024-05-07T14:03:39.663590+0000","last_unstale":"2024-05-07T14:05:18.630109+0000","last_undegraded":"2024-05-07T14:05:18.630109+0000","last_fullsized":"2024-05-07T14:05:18.630109+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:02.675624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"146'38","reported_seq":295,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.336704+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:05:31.336704+0000","last_peered":"2024-05-07T14:05:31.336704+0000","last_clean":"2024-05-07T14:05:31.336704+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:05:31.336704+0000","last_undegraded":"2024-05-07T14:05:31.336704+0000","last_fullsized":"2024-05-07T14:05:31.336704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:44:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628129+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:05:18.628129+0000","last_peered":"2024-05-07T14:05:18.628129+0000","last_clean":"2024-05-07T14:05:18.628129+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:05:18.628129+0000","last_undegraded":"2024-05-07T14:05:18.628129+0000","last_fullsized":"2024-05-07T14:05:18.628129+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"81'2","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963957+0000","last_change":"2024-05-07T14:03:39.857355+0000","last_active":"2024-05-07T14:05:18.963957+0000","last_peered":"2024-05-07T14:05:18.963957+0000","last_clean":"2024-05-07T14:05:18.963957+0000","last_became_active":"2024-05-07T14:03:39.680721+0000","last_became_peered":"2024-05-07T14:03:39.680721+0000","last_unstale":"2024-05-07T14:05:18.963957+0000","last_undegraded":"2024-05-07T14:05:18.963957+0000","last_fullsized":"2024-05-07T14:05:18.963957+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:19:36.092563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"146'38","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.458705+0000","last_change":"2024-05-07T14:01:37.311718+0000","last_active":"2024-05-07T14:05:31.458705+0000","last_peered":"2024-05-07T14:05:31.458705+0000","last_clean":"2024-05-07T14:05:31.458705+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:05:31.458705+0000","last_undegraded":"2024-05-07T14:05:31.458705+0000","last_fullsized":"2024-05-07T14:05:31.458705+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:24.211300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721497+0000","last_change":"2024-05-07T14:01:00.002733+0000","last_active":"2024-05-07T14:05:18.721497+0000","last_peered":"2024-05-07T14:05:18.721497+0000","last_clean":"2024-05-07T14:05:18.721497+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:05:18.721497+0000","last_undegraded":"2024-05-07T14:05:18.721497+0000","last_fullsized":"2024-05-07T14:05:18.721497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"146'20","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.942718+0000","last_change":"2024-05-07T14:04:59.457299+0000","last_active":"2024-05-07T14:05:30.942718+0000","last_peered":"2024-05-07T14:05:30.942718+0000","last_clean":"2024-05-07T14:05:30.942718+0000","last_became_active":"2024-05-07T14:04:59.455429+0000","last_became_peered":"2024-05-07T14:04:59.455429+0000","last_unstale":"2024-05-07T14:05:30.942718+0000","last_undegraded":"2024-05-07T14:05:30.942718+0000","last_fullsized":"2024-05-07T14:05:30.942718+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:29.054055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964269+0000","last_change":"2024-05-07T14:04:59.462184+0000","last_active":"2024-05-07T14:05:18.964269+0000","last_peered":"2024-05-07T14:05:18.964269+0000","last_clean":"2024-05-07T14:05:18.964269+0000","last_became_active":"2024-05-07T14:04:59.456374+0000","last_became_peered":"2024-05-07T14:04:59.456374+0000","last_unstale":"2024-05-07T14:05:18.964269+0000","last_undegraded":"2024-05-07T14:05:18.964269+0000","last_fullsized":"2024-05-07T14:05:18.964269+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:47:06.581660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"124'50","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719930+0000","last_change":"2024-05-07T14:01:06.038281+0000","last_active":"2024-05-07T14:05:18.719930+0000","last_peered":"2024-05-07T14:05:18.719930+0000","last_clean":"2024-05-07T14:05:18.719930+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:05:18.719930+0000","last_undegraded":"2024-05-07T14:05:18.719930+0000","last_fullsized":"2024-05-07T14:05:18.719930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"81'6","reported_seq":283,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722091+0000","last_change":"2024-05-07T14:04:59.467076+0000","last_active":"2024-05-07T14:05:18.722091+0000","last_peered":"2024-05-07T14:05:18.722091+0000","last_clean":"2024-05-07T14:05:18.722091+0000","last_became_active":"2024-05-07T14:04:59.466480+0000","last_became_peered":"2024-05-07T14:04:59.466480+0000","last_unstale":"2024-05-07T14:05:18.722091+0000","last_undegraded":"2024-05-07T14:05:18.722091+0000","last_fullsized":"2024-05-07T14:05:18.722091+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:02.334693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"146'40","reported_seq":321,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.543539+0000","last_change":"2024-05-07T14:05:00.106363+0000","last_active":"2024-05-07T14:05:31.543539+0000","last_peered":"2024-05-07T14:05:31.543539+0000","last_clean":"2024-05-07T14:05:31.543539+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:31.543539+0000","last_undegraded":"2024-05-07T14:05:31.543539+0000","last_fullsized":"2024-05-07T14:05:31.543539+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:34:03.250892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964245+0000","last_change":"2024-05-07T14:04:59.446944+0000","last_active":"2024-05-07T14:05:18.964245+0000","last_peered":"2024-05-07T14:05:18.964245+0000","last_clean":"2024-05-07T14:05:18.964245+0000","last_became_active":"2024-05-07T14:04:59.445994+0000","last_became_peered":"2024-05-07T14:04:59.445994+0000","last_unstale":"2024-05-07T14:05:18.964245+0000","last_undegraded":"2024-05-07T14:05:18.964245+0000","last_fullsized":"2024-05-07T14:05:18.964245+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:08.275415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"81'7","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630813+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:05:18.630813+0000","last_peered":"2024-05-07T14:05:18.630813+0000","last_clean":"2024-05-07T14:05:18.630813+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:05:18.630813+0000","last_undegraded":"2024-05-07T14:05:18.630813+0000","last_fullsized":"2024-05-07T14:05:18.630813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629526+0000","last_change":"2024-05-07T14:01:03.998752+0000","last_active":"2024-05-07T14:05:18.629526+0000","last_peered":"2024-05-07T14:05:18.629526+0000","last_clean":"2024-05-07T14:05:18.629526+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:05:18.629526+0000","last_undegraded":"2024-05-07T14:05:18.629526+0000","last_fullsized":"2024-05-07T14:05:18.629526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"115'8","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959036+0000","last_change":"2024-05-07T14:01:06.026744+0000","last_active":"2024-05-07T14:05:18.959036+0000","last_peered":"2024-05-07T14:05:18.959036+0000","last_clean":"2024-05-07T14:05:18.959036+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:05:18.959036+0000","last_undegraded":"2024-05-07T14:05:18.959036+0000","last_fullsized":"2024-05-07T14:05:18.959036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:16:28.749790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"81'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962932+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:05:18.962932+0000","last_peered":"2024-05-07T14:05:18.962932+0000","last_clean":"2024-05-07T14:05:18.962932+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:05:18.962932+0000","last_undegraded":"2024-05-07T14:05:18.962932+0000","last_fullsized":"2024-05-07T14:05:18.962932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"146'32","reported_seq":275,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.516066+0000","last_change":"2024-05-07T14:04:59.911990+0000","last_active":"2024-05-07T14:05:31.516066+0000","last_peered":"2024-05-07T14:05:31.516066+0000","last_clean":"2024-05-07T14:05:31.516066+0000","last_became_active":"2024-05-07T14:04:59.436710+0000","last_became_peered":"2024-05-07T14:04:59.436710+0000","last_unstale":"2024-05-07T14:05:31.516066+0000","last_undegraded":"2024-05-07T14:05:31.516066+0000","last_fullsized":"2024-05-07T14:05:31.516066+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:27:02.713493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":259,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964441+0000","last_change":"2024-05-07T14:03:39.680812+0000","last_active":"2024-05-07T14:05:18.964441+0000","last_peered":"2024-05-07T14:05:18.964441+0000","last_clean":"2024-05-07T14:05:18.964441+0000","last_became_active":"2024-05-07T14:03:39.680482+0000","last_became_peered":"2024-05-07T14:03:39.680482+0000","last_unstale":"2024-05-07T14:05:18.964441+0000","last_undegraded":"2024-05-07T14:05:18.964441+0000","last_fullsized":"2024-05-07T14:05:18.964441+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:07.705255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"81'13","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629238+0000","last_change":"2024-05-07T14:01:01.996897+0000","last_active":"2024-05-07T14:05:18.629238+0000","last_peered":"2024-05-07T14:05:18.629238+0000","last_clean":"2024-05-07T14:05:18.629238+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:05:18.629238+0000","last_undegraded":"2024-05-07T14:05:18.629238+0000","last_fullsized":"2024-05-07T14:05:18.629238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:58.543841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"146'144","reported_seq":416,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.475428+0000","last_change":"2024-05-07T14:05:02.234601+0000","last_active":"2024-05-07T14:05:30.475428+0000","last_peered":"2024-05-07T14:05:30.475428+0000","last_clean":"2024-05-07T14:05:30.475428+0000","last_became_active":"2024-05-07T14:04:59.463533+0000","last_became_peered":"2024-05-07T14:04:59.463533+0000","last_unstale":"2024-05-07T14:05:30.475428+0000","last_undegraded":"2024-05-07T14:05:30.475428+0000","last_fullsized":"2024-05-07T14:05:30.475428+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:50:50.067203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628944+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:05:18.628944+0000","last_peered":"2024-05-07T14:05:18.628944+0000","last_clean":"2024-05-07T14:05:18.628944+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:05:18.628944+0000","last_undegraded":"2024-05-07T14:05:18.628944+0000","last_fullsized":"2024-05-07T14:05:18.628944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:00.638675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"87'16","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963783+0000","last_change":"2024-05-07T14:04:59.462968+0000","last_active":"2024-05-07T14:05:18.963783+0000","last_peered":"2024-05-07T14:05:18.963783+0000","last_clean":"2024-05-07T14:05:18.963783+0000","last_became_active":"2024-05-07T14:04:59.461575+0000","last_became_peered":"2024-05-07T14:04:59.461575+0000","last_unstale":"2024-05-07T14:05:18.963783+0000","last_undegraded":"2024-05-07T14:05:18.963783+0000","last_fullsized":"2024-05-07T14:05:18.963783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:36.220334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"146'52","reported_seq":308,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.620355+0000","last_change":"2024-05-07T14:00:55.978117+0000","last_active":"2024-05-07T14:05:31.620355+0000","last_peered":"2024-05-07T14:05:31.620355+0000","last_clean":"2024-05-07T14:05:31.620355+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:05:31.620355+0000","last_undegraded":"2024-05-07T14:05:31.620355+0000","last_fullsized":"2024-05-07T14:05:31.620355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721681+0000","last_change":"2024-05-07T14:01:00.001635+0000","last_active":"2024-05-07T14:05:18.721681+0000","last_peered":"2024-05-07T14:05:18.721681+0000","last_clean":"2024-05-07T14:05:18.721681+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:05:18.721681+0000","last_undegraded":"2024-05-07T14:05:18.721681+0000","last_fullsized":"2024-05-07T14:05:18.721681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"146'20","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.924596+0000","last_change":"2024-05-07T14:04:59.462754+0000","last_active":"2024-05-07T14:05:30.924596+0000","last_peered":"2024-05-07T14:05:30.924596+0000","last_clean":"2024-05-07T14:05:30.924596+0000","last_became_active":"2024-05-07T14:04:59.459905+0000","last_became_peered":"2024-05-07T14:04:59.459905+0000","last_unstale":"2024-05-07T14:05:30.924596+0000","last_undegraded":"2024-05-07T14:05:30.924596+0000","last_fullsized":"2024-05-07T14:05:30.924596+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:02:35.111917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"146'138","reported_seq":431,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.483169+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:05:30.483169+0000","last_peered":"2024-05-07T14:05:30.483169+0000","last_clean":"2024-05-07T14:05:30.483169+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:05:30.483169+0000","last_undegraded":"2024-05-07T14:05:30.483169+0000","last_fullsized":"2024-05-07T14:05:30.483169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:17.507434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"81'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720435+0000","last_change":"2024-05-07T14:04:59.447718+0000","last_active":"2024-05-07T14:05:18.720435+0000","last_peered":"2024-05-07T14:05:18.720435+0000","last_clean":"2024-05-07T14:05:18.720435+0000","last_became_active":"2024-05-07T14:04:59.446891+0000","last_became_peered":"2024-05-07T14:04:59.446891+0000","last_unstale":"2024-05-07T14:05:18.720435+0000","last_undegraded":"2024-05-07T14:05:18.720435+0000","last_fullsized":"2024-05-07T14:05:18.720435+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:42.667572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"146'66","reported_seq":319,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.588070+0000","last_change":"2024-05-07T14:05:01.651799+0000","last_active":"2024-05-07T14:05:31.588070+0000","last_peered":"2024-05-07T14:05:31.588070+0000","last_clean":"2024-05-07T14:05:31.588070+0000","last_became_active":"2024-05-07T14:04:59.452426+0000","last_became_peered":"2024-05-07T14:04:59.452426+0000","last_unstale":"2024-05-07T14:05:31.588070+0000","last_undegraded":"2024-05-07T14:05:31.588070+0000","last_fullsized":"2024-05-07T14:05:31.588070+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:49.540606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963448+0000","last_change":"2024-05-07T14:04:59.445984+0000","last_active":"2024-05-07T14:05:18.963448+0000","last_peered":"2024-05-07T14:05:18.963448+0000","last_clean":"2024-05-07T14:05:18.963448+0000","last_became_active":"2024-05-07T14:04:59.445281+0000","last_became_peered":"2024-05-07T14:04:59.445281+0000","last_unstale":"2024-05-07T14:05:18.963448+0000","last_undegraded":"2024-05-07T14:05:18.963448+0000","last_fullsized":"2024-05-07T14:05:18.963448+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:59:14.548669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"146'31","reported_seq":292,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.957269+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:05:30.957269+0000","last_peered":"2024-05-07T14:05:30.957269+0000","last_clean":"2024-05-07T14:05:30.957269+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:05:30.957269+0000","last_undegraded":"2024-05-07T14:05:30.957269+0000","last_fullsized":"2024-05-07T14:05:30.957269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960274+0000","last_change":"2024-05-07T14:03:39.666526+0000","last_active":"2024-05-07T14:05:18.960274+0000","last_peered":"2024-05-07T14:05:18.960274+0000","last_clean":"2024-05-07T14:05:18.960274+0000","last_became_active":"2024-05-07T14:03:39.666160+0000","last_became_peered":"2024-05-07T14:03:39.666160+0000","last_unstale":"2024-05-07T14:05:18.960274+0000","last_undegraded":"2024-05-07T14:05:18.960274+0000","last_fullsized":"2024-05-07T14:05:18.960274+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:36:44.560061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720476+0000","last_change":"2024-05-07T14:01:06.038734+0000","last_active":"2024-05-07T14:05:18.720476+0000","last_peered":"2024-05-07T14:05:18.720476+0000","last_clean":"2024-05-07T14:05:18.720476+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:05:18.720476+0000","last_undegraded":"2024-05-07T14:05:18.720476+0000","last_fullsized":"2024-05-07T14:05:18.720476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630857+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:05:18.630857+0000","last_peered":"2024-05-07T14:05:18.630857+0000","last_clean":"2024-05-07T14:05:18.630857+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:05:18.630857+0000","last_undegraded":"2024-05-07T14:05:18.630857+0000","last_fullsized":"2024-05-07T14:05:18.630857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"146'54","reported_seq":304,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.613490+0000","last_change":"2024-05-07T14:04:59.801081+0000","last_active":"2024-05-07T14:05:31.613490+0000","last_peered":"2024-05-07T14:05:31.613490+0000","last_clean":"2024-05-07T14:05:31.613490+0000","last_became_active":"2024-05-07T14:04:59.421863+0000","last_became_peered":"2024-05-07T14:04:59.421863+0000","last_unstale":"2024-05-07T14:05:31.613490+0000","last_undegraded":"2024-05-07T14:05:31.613490+0000","last_fullsized":"2024-05-07T14:05:31.613490+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:48.094723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"26'1","reported_seq":340,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.426815+0000","last_change":"2024-05-07T14:00:59.991076+0000","last_active":"2024-05-07T14:05:30.426815+0000","last_peered":"2024-05-07T14:05:30.426815+0000","last_clean":"2024-05-07T14:05:30.426815+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:05:30.426815+0000","last_undegraded":"2024-05-07T14:05:30.426815+0000","last_fullsized":"2024-05-07T14:05:30.426815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:56.750207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"146'20","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.486480+0000","last_change":"2024-05-07T14:04:59.447540+0000","last_active":"2024-05-07T14:05:31.486480+0000","last_peered":"2024-05-07T14:05:31.486480+0000","last_clean":"2024-05-07T14:05:31.486480+0000","last_became_active":"2024-05-07T14:04:59.446737+0000","last_became_peered":"2024-05-07T14:04:59.446737+0000","last_unstale":"2024-05-07T14:05:31.486480+0000","last_undegraded":"2024-05-07T14:05:31.486480+0000","last_fullsized":"2024-05-07T14:05:31.486480+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:20:06.352935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964757+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:05:18.964757+0000","last_peered":"2024-05-07T14:05:18.964757+0000","last_clean":"2024-05-07T14:05:18.964757+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:05:18.964757+0000","last_undegraded":"2024-05-07T14:05:18.964757+0000","last_fullsized":"2024-05-07T14:05:18.964757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:28.806250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"115'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962438+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:05:18.962438+0000","last_peered":"2024-05-07T14:05:18.962438+0000","last_clean":"2024-05-07T14:05:18.962438+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:05:18.962438+0000","last_undegraded":"2024-05-07T14:05:18.962438+0000","last_fullsized":"2024-05-07T14:05:18.962438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:56.601456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"81'6","reported_seq":279,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959923+0000","last_change":"2024-05-07T14:00:57.986962+0000","last_active":"2024-05-07T14:05:18.959923+0000","last_peered":"2024-05-07T14:05:18.959923+0000","last_clean":"2024-05-07T14:05:18.959923+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:05:18.959923+0000","last_undegraded":"2024-05-07T14:05:18.959923+0000","last_fullsized":"2024-05-07T14:05:18.959923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:59.382845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"146'58","reported_seq":305,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.627652+0000","last_change":"2024-05-07T14:05:00.740552+0000","last_active":"2024-05-07T14:05:31.627652+0000","last_peered":"2024-05-07T14:05:31.627652+0000","last_clean":"2024-05-07T14:05:31.627652+0000","last_became_active":"2024-05-07T14:04:59.449454+0000","last_became_peered":"2024-05-07T14:04:59.449454+0000","last_unstale":"2024-05-07T14:05:31.627652+0000","last_undegraded":"2024-05-07T14:05:31.627652+0000","last_fullsized":"2024-05-07T14:05:31.627652+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:28:19.138204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629879+0000","last_change":"2024-05-07T14:00:59.995217+0000","last_active":"2024-05-07T14:05:18.629879+0000","last_peered":"2024-05-07T14:05:18.629879+0000","last_clean":"2024-05-07T14:05:18.629879+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:05:18.629879+0000","last_undegraded":"2024-05-07T14:05:18.629879+0000","last_fullsized":"2024-05-07T14:05:18.629879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:19.640656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"146'26","reported_seq":265,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.964781+0000","last_change":"2024-05-07T14:04:59.459984+0000","last_active":"2024-05-07T14:05:30.964781+0000","last_peered":"2024-05-07T14:05:30.964781+0000","last_clean":"2024-05-07T14:05:30.964781+0000","last_became_active":"2024-05-07T14:04:59.458512+0000","last_became_peered":"2024-05-07T14:04:59.458512+0000","last_unstale":"2024-05-07T14:05:30.964781+0000","last_undegraded":"2024-05-07T14:05:30.964781+0000","last_fullsized":"2024-05-07T14:05:30.964781+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:11:09.127149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"146'142","reported_seq":456,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.485884+0000","last_change":"2024-05-07T14:03:42.700808+0000","last_active":"2024-05-07T14:05:30.485884+0000","last_peered":"2024-05-07T14:05:30.485884+0000","last_clean":"2024-05-07T14:05:30.485884+0000","last_became_active":"2024-05-07T14:03:42.700324+0000","last_became_peered":"2024-05-07T14:03:42.700324+0000","last_unstale":"2024-05-07T14:05:30.485884+0000","last_undegraded":"2024-05-07T14:05:30.485884+0000","last_fullsized":"2024-05-07T14:05:30.485884+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:47.369543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961454+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:05:18.961454+0000","last_peered":"2024-05-07T14:05:18.961454+0000","last_clean":"2024-05-07T14:05:18.961454+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:05:18.961454+0000","last_undegraded":"2024-05-07T14:05:18.961454+0000","last_fullsized":"2024-05-07T14:05:18.961454+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"124'10","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960707+0000","last_change":"2024-05-07T14:00:57.993633+0000","last_active":"2024-05-07T14:05:18.960707+0000","last_peered":"2024-05-07T14:05:18.960707+0000","last_clean":"2024-05-07T14:05:18.960707+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:05:18.960707+0000","last_undegraded":"2024-05-07T14:05:18.960707+0000","last_fullsized":"2024-05-07T14:05:18.960707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"146'72","reported_seq":329,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.595055+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:05:31.595055+0000","last_peered":"2024-05-07T14:05:31.595055+0000","last_clean":"2024-05-07T14:05:31.595055+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:05:31.595055+0000","last_undegraded":"2024-05-07T14:05:31.595055+0000","last_fullsized":"2024-05-07T14:05:31.595055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:57.375525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629126+0000","last_change":"2024-05-07T14:00:59.998863+0000","last_active":"2024-05-07T14:05:18.629126+0000","last_peered":"2024-05-07T14:05:18.629126+0000","last_clean":"2024-05-07T14:05:18.629126+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:05:18.629126+0000","last_undegraded":"2024-05-07T14:05:18.629126+0000","last_fullsized":"2024-05-07T14:05:18.629126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:01:01.389573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"146'36","reported_seq":309,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.641653+0000","last_change":"2024-05-07T14:04:59.456274+0000","last_active":"2024-05-07T14:05:31.641653+0000","last_peered":"2024-05-07T14:05:31.641653+0000","last_clean":"2024-05-07T14:05:31.641653+0000","last_became_active":"2024-05-07T14:04:59.455284+0000","last_became_peered":"2024-05-07T14:04:59.455284+0000","last_unstale":"2024-05-07T14:05:31.641653+0000","last_undegraded":"2024-05-07T14:05:31.641653+0000","last_fullsized":"2024-05-07T14:05:31.641653+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:44:18.184158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.627987+0000","last_change":"2024-05-07T14:04:59.467425+0000","last_active":"2024-05-07T14:05:18.627987+0000","last_peered":"2024-05-07T14:05:18.627987+0000","last_clean":"2024-05-07T14:05:18.627987+0000","last_became_active":"2024-05-07T14:04:59.466731+0000","last_became_peered":"2024-05-07T14:04:59.466731+0000","last_unstale":"2024-05-07T14:05:18.627987+0000","last_undegraded":"2024-05-07T14:05:18.627987+0000","last_fullsized":"2024-05-07T14:05:18.627987+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:57.541122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"121'5","reported_seq":111,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960905+0000","last_change":"2024-05-07T14:03:39.802033+0000","last_active":"2024-05-07T14:05:18.960905+0000","last_peered":"2024-05-07T14:05:18.960905+0000","last_clean":"2024-05-07T14:05:18.960905+0000","last_became_active":"2024-05-07T14:03:39.675695+0000","last_became_peered":"2024-05-07T14:03:39.675695+0000","last_unstale":"2024-05-07T14:05:18.960905+0000","last_undegraded":"2024-05-07T14:05:18.960905+0000","last_fullsized":"2024-05-07T14:05:18.960905+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:22:02.594405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"87'2","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630116+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:05:18.630116+0000","last_peered":"2024-05-07T14:05:18.630116+0000","last_clean":"2024-05-07T14:05:18.630116+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:05:18.630116+0000","last_undegraded":"2024-05-07T14:05:18.630116+0000","last_fullsized":"2024-05-07T14:05:18.630116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"146'52","reported_seq":310,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.619825+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:05:31.619825+0000","last_peered":"2024-05-07T14:05:31.619825+0000","last_clean":"2024-05-07T14:05:31.619825+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:05:31.619825+0000","last_undegraded":"2024-05-07T14:05:31.619825+0000","last_fullsized":"2024-05-07T14:05:31.619825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629530+0000","last_change":"2024-05-07T14:04:59.468095+0000","last_active":"2024-05-07T14:05:18.629530+0000","last_peered":"2024-05-07T14:05:18.629530+0000","last_clean":"2024-05-07T14:05:18.629530+0000","last_became_active":"2024-05-07T14:04:59.467463+0000","last_became_peered":"2024-05-07T14:04:59.467463+0000","last_unstale":"2024-05-07T14:05:18.629530+0000","last_undegraded":"2024-05-07T14:05:18.629530+0000","last_fullsized":"2024-05-07T14:05:18.629530+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:38.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"146'25","reported_seq":318,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.651303+0000","last_change":"2024-05-07T14:03:39.698456+0000","last_active":"2024-05-07T14:05:31.651303+0000","last_peered":"2024-05-07T14:05:31.651303+0000","last_clean":"2024-05-07T14:05:31.651303+0000","last_became_active":"2024-05-07T14:03:39.663223+0000","last_became_peered":"2024-05-07T14:03:39.663223+0000","last_unstale":"2024-05-07T14:05:31.651303+0000","last_undegraded":"2024-05-07T14:05:31.651303+0000","last_fullsized":"2024-05-07T14:05:31.651303+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:58.582121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959866+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:05:18.959866+0000","last_peered":"2024-05-07T14:05:18.959866+0000","last_clean":"2024-05-07T14:05:18.959866+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:05:18.959866+0000","last_undegraded":"2024-05-07T14:05:18.959866+0000","last_fullsized":"2024-05-07T14:05:18.959866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:47:58.889542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"106'6","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959722+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:05:18.959722+0000","last_peered":"2024-05-07T14:05:18.959722+0000","last_clean":"2024-05-07T14:05:18.959722+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:05:18.959722+0000","last_undegraded":"2024-05-07T14:05:18.959722+0000","last_fullsized":"2024-05-07T14:05:18.959722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:54:20.541355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"106'12","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630558+0000","last_change":"2024-05-07T14:00:58.003358+0000","last_active":"2024-05-07T14:05:18.630558+0000","last_peered":"2024-05-07T14:05:18.630558+0000","last_clean":"2024-05-07T14:05:18.630558+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:05:18.630558+0000","last_undegraded":"2024-05-07T14:05:18.630558+0000","last_fullsized":"2024-05-07T14:05:18.630558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:24.130073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"146'32","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.458929+0000","last_change":"2024-05-07T14:00:55.986864+0000","last_active":"2024-05-07T14:05:31.458929+0000","last_peered":"2024-05-07T14:05:31.458929+0000","last_clean":"2024-05-07T14:05:31.458929+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:05:31.458929+0000","last_undegraded":"2024-05-07T14:05:31.458929+0000","last_fullsized":"2024-05-07T14:05:31.458929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":126,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.425236+0000","last_change":"2024-05-07T14:03:39.714297+0000","last_active":"2024-05-07T14:05:30.425236+0000","last_peered":"2024-05-07T14:05:30.425236+0000","last_clean":"2024-05-07T14:05:30.425236+0000","last_became_active":"2024-05-07T14:03:39.663013+0000","last_became_peered":"2024-05-07T14:03:39.663013+0000","last_unstale":"2024-05-07T14:05:30.425236+0000","last_undegraded":"2024-05-07T14:05:30.425236+0000","last_fullsized":"2024-05-07T14:05:30.425236+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:40:56.207747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"146'27","reported_seq":285,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.476180+0000","last_change":"2024-05-07T14:01:02.011361+0000","last_active":"2024-05-07T14:05:31.476180+0000","last_peered":"2024-05-07T14:05:31.476180+0000","last_clean":"2024-05-07T14:05:31.476180+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:05:31.476180+0000","last_undegraded":"2024-05-07T14:05:31.476180+0000","last_fullsized":"2024-05-07T14:05:31.476180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:23.608703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"146'138","reported_seq":444,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.474796+0000","last_change":"2024-05-07T14:01:04.017471+0000","last_active":"2024-05-07T14:05:30.474796+0000","last_peered":"2024-05-07T14:05:30.474796+0000","last_clean":"2024-05-07T14:05:30.474796+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:05:30.474796+0000","last_undegraded":"2024-05-07T14:05:30.474796+0000","last_fullsized":"2024-05-07T14:05:30.474796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:50.224280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"87'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962770+0000","last_change":"2024-05-07T14:01:06.027000+0000","last_active":"2024-05-07T14:05:18.962770+0000","last_peered":"2024-05-07T14:05:18.962770+0000","last_clean":"2024-05-07T14:05:18.962770+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:05:18.962770+0000","last_undegraded":"2024-05-07T14:05:18.962770+0000","last_fullsized":"2024-05-07T14:05:18.962770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:54.683498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"106'8","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630951+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:05:18.630951+0000","last_peered":"2024-05-07T14:05:18.630951+0000","last_clean":"2024-05-07T14:05:18.630951+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:05:18.630951+0000","last_undegraded":"2024-05-07T14:05:18.630951+0000","last_fullsized":"2024-05-07T14:05:18.630951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"146'38","reported_seq":298,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.575801+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:05:31.575801+0000","last_peered":"2024-05-07T14:05:31.575801+0000","last_clean":"2024-05-07T14:05:31.575801+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:05:31.575801+0000","last_undegraded":"2024-05-07T14:05:31.575801+0000","last_fullsized":"2024-05-07T14:05:31.575801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:03.900615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"26'2","reported_seq":433,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.460876+0000","last_change":"2024-05-07T14:01:00.007272+0000","last_active":"2024-05-07T14:05:30.460876+0000","last_peered":"2024-05-07T14:05:30.460876+0000","last_clean":"2024-05-07T14:05:30.460876+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:05:30.460876+0000","last_undegraded":"2024-05-07T14:05:30.460876+0000","last_fullsized":"2024-05-07T14:05:30.460876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:50.577657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"33'10","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964591+0000","last_change":"2024-05-07T14:01:02.148223+0000","last_active":"2024-05-07T14:05:18.964591+0000","last_peered":"2024-05-07T14:05:18.964591+0000","last_clean":"2024-05-07T14:05:18.964591+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:05:18.964591+0000","last_undegraded":"2024-05-07T14:05:18.964591+0000","last_fullsized":"2024-05-07T14:05:18.964591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:22.532018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"146'138","reported_seq":433,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.481056+0000","last_change":"2024-05-07T14:01:04.016479+0000","last_active":"2024-05-07T14:05:30.481056+0000","last_peered":"2024-05-07T14:05:30.481056+0000","last_clean":"2024-05-07T14:05:30.481056+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:05:30.481056+0000","last_undegraded":"2024-05-07T14:05:30.481056+0000","last_fullsized":"2024-05-07T14:05:30.481056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:57:33.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"87'6","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629046+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:05:18.629046+0000","last_peered":"2024-05-07T14:05:18.629046+0000","last_clean":"2024-05-07T14:05:18.629046+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:05:18.629046+0000","last_undegraded":"2024-05-07T14:05:18.629046+0000","last_fullsized":"2024-05-07T14:05:18.629046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:48.504072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"124'6","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961297+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:05:18.961297+0000","last_peered":"2024-05-07T14:05:18.961297+0000","last_clean":"2024-05-07T14:05:18.961297+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:05:18.961297+0000","last_undegraded":"2024-05-07T14:05:18.961297+0000","last_fullsized":"2024-05-07T14:05:18.961297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"146'48","reported_seq":340,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.571003+0000","last_change":"2024-05-07T14:03:39.814768+0000","last_active":"2024-05-07T14:05:31.571003+0000","last_peered":"2024-05-07T14:05:31.571003+0000","last_clean":"2024-05-07T14:05:31.571003+0000","last_became_active":"2024-05-07T14:03:39.666192+0000","last_became_peered":"2024-05-07T14:03:39.666192+0000","last_unstale":"2024-05-07T14:05:31.571003+0000","last_undegraded":"2024-05-07T14:05:31.571003+0000","last_fullsized":"2024-05-07T14:05:31.571003+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:21:10.720455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":251,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630640+0000","last_change":"2024-05-07T14:01:00.006555+0000","last_active":"2024-05-07T14:05:18.630640+0000","last_peered":"2024-05-07T14:05:18.630640+0000","last_clean":"2024-05-07T14:05:18.630640+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:05:18.630640+0000","last_undegraded":"2024-05-07T14:05:18.630640+0000","last_fullsized":"2024-05-07T14:05:18.630640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:49.395870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"146'28","reported_seq":334,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.947707+0000","last_change":"2024-05-07T14:03:39.845058+0000","last_active":"2024-05-07T14:05:30.947707+0000","last_peered":"2024-05-07T14:05:30.947707+0000","last_clean":"2024-05-07T14:05:30.947707+0000","last_became_active":"2024-05-07T14:03:39.673995+0000","last_became_peered":"2024-05-07T14:03:39.673995+0000","last_unstale":"2024-05-07T14:05:30.947707+0000","last_undegraded":"2024-05-07T14:05:30.947707+0000","last_fullsized":"2024-05-07T14:05:30.947707+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:52:43.919444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959774+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:05:18.959774+0000","last_peered":"2024-05-07T14:05:18.959774+0000","last_clean":"2024-05-07T14:05:18.959774+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:05:18.959774+0000","last_undegraded":"2024-05-07T14:05:18.959774+0000","last_fullsized":"2024-05-07T14:05:18.959774+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:51.675108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"124'2","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960409+0000","last_change":"2024-05-07T14:03:39.666268+0000","last_active":"2024-05-07T14:05:18.960409+0000","last_peered":"2024-05-07T14:05:18.960409+0000","last_clean":"2024-05-07T14:05:18.960409+0000","last_became_active":"2024-05-07T14:03:39.665838+0000","last_became_peered":"2024-05-07T14:03:39.665838+0000","last_unstale":"2024-05-07T14:05:18.960409+0000","last_undegraded":"2024-05-07T14:05:18.960409+0000","last_fullsized":"2024-05-07T14:05:18.960409+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:54:00.122392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963437+0000","last_change":"2024-05-07T14:00:58.005538+0000","last_active":"2024-05-07T14:05:18.963437+0000","last_peered":"2024-05-07T14:05:18.963437+0000","last_clean":"2024-05-07T14:05:18.963437+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:05:18.963437+0000","last_undegraded":"2024-05-07T14:05:18.963437+0000","last_fullsized":"2024-05-07T14:05:18.963437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:17.520155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":313,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958642+0000","last_change":"2024-05-07T14:02:39.729323+0000","last_active":"2024-05-07T14:05:18.958642+0000","last_peered":"2024-05-07T14:05:18.958642+0000","last_clean":"2024-05-07T14:05:18.958642+0000","last_became_active":"2024-05-07T14:02:39.728189+0000","last_became_peered":"2024-05-07T14:02:39.728189+0000","last_unstale":"2024-05-07T14:05:18.958642+0000","last_undegraded":"2024-05-07T14:05:18.958642+0000","last_fullsized":"2024-05-07T14:05:18.958642+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:53:59.368912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721172+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:05:18.721172+0000","last_peered":"2024-05-07T14:05:18.721172+0000","last_clean":"2024-05-07T14:05:18.721172+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:05:18.721172+0000","last_undegraded":"2024-05-07T14:05:18.721172+0000","last_fullsized":"2024-05-07T14:05:18.721172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:35:42.608213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"146'40","reported_seq":246,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.610222+0000","last_change":"2024-05-07T14:01:37.317794+0000","last_active":"2024-05-07T14:05:31.610222+0000","last_peered":"2024-05-07T14:05:31.610222+0000","last_clean":"2024-05-07T14:05:31.610222+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:05:31.610222+0000","last_undegraded":"2024-05-07T14:05:31.610222+0000","last_fullsized":"2024-05-07T14:05:31.610222+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:17.582561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":50,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962017+0000","last_change":"2024-05-07T14:04:59.458347+0000","last_active":"2024-05-07T14:05:18.962017+0000","last_peered":"2024-05-07T14:05:18.962017+0000","last_clean":"2024-05-07T14:05:18.962017+0000","last_became_active":"2024-05-07T14:04:59.453884+0000","last_became_peered":"2024-05-07T14:04:59.453884+0000","last_unstale":"2024-05-07T14:05:18.962017+0000","last_undegraded":"2024-05-07T14:05:18.962017+0000","last_fullsized":"2024-05-07T14:05:18.962017+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:55:06.867992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"146'47","reported_seq":318,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.311380+0000","last_change":"2024-05-07T14:01:02.010191+0000","last_active":"2024-05-07T14:05:31.311380+0000","last_peered":"2024-05-07T14:05:31.311380+0000","last_clean":"2024-05-07T14:05:31.311380+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:05:31.311380+0000","last_undegraded":"2024-05-07T14:05:31.311380+0000","last_fullsized":"2024-05-07T14:05:31.311380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961662+0000","last_change":"2024-05-07T14:04:59.457814+0000","last_active":"2024-05-07T14:05:18.961662+0000","last_peered":"2024-05-07T14:05:18.961662+0000","last_clean":"2024-05-07T14:05:18.961662+0000","last_became_active":"2024-05-07T14:04:59.456477+0000","last_became_peered":"2024-05-07T14:04:59.456477+0000","last_unstale":"2024-05-07T14:05:18.961662+0000","last_undegraded":"2024-05-07T14:05:18.961662+0000","last_fullsized":"2024-05-07T14:05:18.961662+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:10:28.939206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959013+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:05:18.959013+0000","last_peered":"2024-05-07T14:05:18.959013+0000","last_clean":"2024-05-07T14:05:18.959013+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:05:18.959013+0000","last_undegraded":"2024-05-07T14:05:18.959013+0000","last_fullsized":"2024-05-07T14:05:18.959013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:00.607631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962392+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:05:18.962392+0000","last_peered":"2024-05-07T14:05:18.962392+0000","last_clean":"2024-05-07T14:05:18.962392+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:05:18.962392+0000","last_undegraded":"2024-05-07T14:05:18.962392+0000","last_fullsized":"2024-05-07T14:05:18.962392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:00:44.199926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":224,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961946+0000","last_change":"2024-05-07T14:04:59.425099+0000","last_active":"2024-05-07T14:05:18.961946+0000","last_peered":"2024-05-07T14:05:18.961946+0000","last_clean":"2024-05-07T14:05:18.961946+0000","last_became_active":"2024-05-07T14:04:59.422224+0000","last_became_peered":"2024-05-07T14:04:59.422224+0000","last_unstale":"2024-05-07T14:05:18.961946+0000","last_undegraded":"2024-05-07T14:05:18.961946+0000","last_fullsized":"2024-05-07T14:05:18.961946+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:23.398977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"146'44","reported_seq":302,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.600255+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:05:31.600255+0000","last_peered":"2024-05-07T14:05:31.600255+0000","last_clean":"2024-05-07T14:05:31.600255+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:05:31.600255+0000","last_undegraded":"2024-05-07T14:05:31.600255+0000","last_fullsized":"2024-05-07T14:05:31.600255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722613+0000","last_change":"2024-05-07T14:01:00.002704+0000","last_active":"2024-05-07T14:05:18.722613+0000","last_peered":"2024-05-07T14:05:18.722613+0000","last_clean":"2024-05-07T14:05:18.722613+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:05:18.722613+0000","last_undegraded":"2024-05-07T14:05:18.722613+0000","last_fullsized":"2024-05-07T14:05:18.722613+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:31:57.017107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"146'153","reported_seq":540,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.494917+0000","last_change":"2024-05-07T14:03:42.708479+0000","last_active":"2024-05-07T14:05:31.494917+0000","last_peered":"2024-05-07T14:05:31.494917+0000","last_clean":"2024-05-07T14:05:31.494917+0000","last_became_active":"2024-05-07T14:03:42.708117+0000","last_became_peered":"2024-05-07T14:03:42.708117+0000","last_unstale":"2024-05-07T14:05:31.494917+0000","last_undegraded":"2024-05-07T14:05:31.494917+0000","last_fullsized":"2024-05-07T14:05:31.494917+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:19:35.961283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":202,"num_read_kb":198,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962840+0000","last_change":"2024-05-07T14:04:59.462996+0000","last_active":"2024-05-07T14:05:18.962840+0000","last_peered":"2024-05-07T14:05:18.962840+0000","last_clean":"2024-05-07T14:05:18.962840+0000","last_became_active":"2024-05-07T14:04:59.461354+0000","last_became_peered":"2024-05-07T14:04:59.461354+0000","last_unstale":"2024-05-07T14:05:18.962840+0000","last_undegraded":"2024-05-07T14:05:18.962840+0000","last_fullsized":"2024-05-07T14:05:18.962840+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:55:55.900168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"80'4","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962268+0000","last_change":"2024-05-07T14:01:06.368732+0000","last_active":"2024-05-07T14:05:18.962268+0000","last_peered":"2024-05-07T14:05:18.962268+0000","last_clean":"2024-05-07T14:05:18.962268+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:05:18.962268+0000","last_undegraded":"2024-05-07T14:05:18.962268+0000","last_fullsized":"2024-05-07T14:05:18.962268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:06:03.970057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"81'2","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960614+0000","last_change":"2024-05-07T14:03:39.711373+0000","last_active":"2024-05-07T14:05:18.960614+0000","last_peered":"2024-05-07T14:05:18.960614+0000","last_clean":"2024-05-07T14:05:18.960614+0000","last_became_active":"2024-05-07T14:03:39.667130+0000","last_became_peered":"2024-05-07T14:03:39.667130+0000","last_unstale":"2024-05-07T14:05:18.960614+0000","last_undegraded":"2024-05-07T14:05:18.960614+0000","last_fullsized":"2024-05-07T14:05:18.960614+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:36.006963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628882+0000","last_change":"2024-05-07T14:00:50.425961+0000","last_active":"2024-05-07T14:05:18.628882+0000","last_peered":"2024-05-07T14:05:18.628882+0000","last_clean":"2024-05-07T14:05:18.628882+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:05:18.628882+0000","last_undegraded":"2024-05-07T14:05:18.628882+0000","last_fullsized":"2024-05-07T14:05:18.628882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:40:23.672170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"146'54","reported_seq":311,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.459462+0000","last_change":"2024-05-07T14:00:55.971067+0000","last_active":"2024-05-07T14:05:31.459462+0000","last_peered":"2024-05-07T14:05:31.459462+0000","last_clean":"2024-05-07T14:05:31.459462+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:05:31.459462+0000","last_undegraded":"2024-05-07T14:05:31.459462+0000","last_fullsized":"2024-05-07T14:05:31.459462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"26'1","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630125+0000","last_change":"2024-05-07T14:00:59.998159+0000","last_active":"2024-05-07T14:05:18.630125+0000","last_peered":"2024-05-07T14:05:18.630125+0000","last_clean":"2024-05-07T14:05:18.630125+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:05:18.630125+0000","last_undegraded":"2024-05-07T14:05:18.630125+0000","last_fullsized":"2024-05-07T14:05:18.630125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:24.883686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"146'19","reported_seq":292,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:20.272772+0000","last_change":"2024-05-07T14:04:59.461913+0000","last_active":"2024-05-07T14:05:20.272772+0000","last_peered":"2024-05-07T14:05:20.272772+0000","last_clean":"2024-05-07T14:05:20.272772+0000","last_became_active":"2024-05-07T14:04:59.456018+0000","last_became_peered":"2024-05-07T14:04:59.456018+0000","last_unstale":"2024-05-07T14:05:20.272772+0000","last_undegraded":"2024-05-07T14:05:20.272772+0000","last_fullsized":"2024-05-07T14:05:20.272772+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:42:03.359344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959826+0000","last_change":"2024-05-07T14:01:04.000367+0000","last_active":"2024-05-07T14:05:18.959826+0000","last_peered":"2024-05-07T14:05:18.959826+0000","last_clean":"2024-05-07T14:05:18.959826+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:05:18.959826+0000","last_undegraded":"2024-05-07T14:05:18.959826+0000","last_fullsized":"2024-05-07T14:05:18.959826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:16:15.443881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965082+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:05:18.965082+0000","last_peered":"2024-05-07T14:05:18.965082+0000","last_clean":"2024-05-07T14:05:18.965082+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:05:18.965082+0000","last_undegraded":"2024-05-07T14:05:18.965082+0000","last_fullsized":"2024-05-07T14:05:18.965082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:18:22.438113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"81'4","reported_seq":106,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961642+0000","last_change":"2024-05-07T14:03:39.687600+0000","last_active":"2024-05-07T14:05:18.961642+0000","last_peered":"2024-05-07T14:05:18.961642+0000","last_clean":"2024-05-07T14:05:18.961642+0000","last_became_active":"2024-05-07T14:03:39.661295+0000","last_became_peered":"2024-05-07T14:03:39.661295+0000","last_unstale":"2024-05-07T14:05:18.961642+0000","last_undegraded":"2024-05-07T14:05:18.961642+0000","last_fullsized":"2024-05-07T14:05:18.961642+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:17:58.416324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721116+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:05:18.721116+0000","last_peered":"2024-05-07T14:05:18.721116+0000","last_clean":"2024-05-07T14:05:18.721116+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:05:18.721116+0000","last_undegraded":"2024-05-07T14:05:18.721116+0000","last_fullsized":"2024-05-07T14:05:18.721116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:23:44.399245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"146'28","reported_seq":288,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.491751+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:05:31.491751+0000","last_peered":"2024-05-07T14:05:31.491751+0000","last_clean":"2024-05-07T14:05:31.491751+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:05:31.491751+0000","last_undegraded":"2024-05-07T14:05:31.491751+0000","last_fullsized":"2024-05-07T14:05:31.491751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":38,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959150+0000","last_change":"2024-05-07T14:00:59.998833+0000","last_active":"2024-05-07T14:05:18.959150+0000","last_peered":"2024-05-07T14:05:18.959150+0000","last_clean":"2024-05-07T14:05:18.959150+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:05:18.959150+0000","last_undegraded":"2024-05-07T14:05:18.959150+0000","last_fullsized":"2024-05-07T14:05:18.959150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:21.596610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964612+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:05:18.964612+0000","last_peered":"2024-05-07T14:05:18.964612+0000","last_clean":"2024-05-07T14:05:18.964612+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:05:18.964612+0000","last_undegraded":"2024-05-07T14:05:18.964612+0000","last_fullsized":"2024-05-07T14:05:18.964612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.610001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960727+0000","last_change":"2024-05-07T14:01:04.018558+0000","last_active":"2024-05-07T14:05:18.960727+0000","last_peered":"2024-05-07T14:05:18.960727+0000","last_clean":"2024-05-07T14:05:18.960727+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:05:18.960727+0000","last_undegraded":"2024-05-07T14:05:18.960727+0000","last_fullsized":"2024-05-07T14:05:18.960727+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:09.561416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.719766+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:05:18.719766+0000","last_peered":"2024-05-07T14:05:18.719766+0000","last_clean":"2024-05-07T14:05:18.719766+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:05:18.719766+0000","last_undegraded":"2024-05-07T14:05:18.719766+0000","last_fullsized":"2024-05-07T14:05:18.719766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:13:19.513607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962141+0000","last_change":"2024-05-07T14:03:39.659916+0000","last_active":"2024-05-07T14:05:18.962141+0000","last_peered":"2024-05-07T14:05:18.962141+0000","last_clean":"2024-05-07T14:05:18.962141+0000","last_became_active":"2024-05-07T14:03:39.659515+0000","last_became_peered":"2024-05-07T14:03:39.659515+0000","last_unstale":"2024-05-07T14:05:18.962141+0000","last_undegraded":"2024-05-07T14:05:18.962141+0000","last_fullsized":"2024-05-07T14:05:18.962141+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:49:16.796937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"146'38","reported_seq":295,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.599930+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:05:31.599930+0000","last_peered":"2024-05-07T14:05:31.599930+0000","last_clean":"2024-05-07T14:05:31.599930+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:05:31.599930+0000","last_undegraded":"2024-05-07T14:05:31.599930+0000","last_fullsized":"2024-05-07T14:05:31.599930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:15.626607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961947+0000","last_change":"2024-05-07T14:00:49.930694+0000","last_active":"2024-05-07T14:05:18.961947+0000","last_peered":"2024-05-07T14:05:18.961947+0000","last_clean":"2024-05-07T14:05:18.961947+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:05:18.961947+0000","last_undegraded":"2024-05-07T14:05:18.961947+0000","last_fullsized":"2024-05-07T14:05:18.961947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:08:28.200414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960414+0000","last_change":"2024-05-07T14:00:59.997132+0000","last_active":"2024-05-07T14:05:18.960414+0000","last_peered":"2024-05-07T14:05:18.960414+0000","last_clean":"2024-05-07T14:05:18.960414+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:05:18.960414+0000","last_undegraded":"2024-05-07T14:05:18.960414+0000","last_fullsized":"2024-05-07T14:05:18.960414+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:16:26.136801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"146'43","reported_seq":311,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.469526+0000","last_change":"2024-05-07T14:01:02.002111+0000","last_active":"2024-05-07T14:05:31.469526+0000","last_peered":"2024-05-07T14:05:31.469526+0000","last_clean":"2024-05-07T14:05:31.469526+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:05:31.469526+0000","last_undegraded":"2024-05-07T14:05:31.469526+0000","last_fullsized":"2024-05-07T14:05:31.469526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:27:52.589171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":157,"num_write":28,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628294+0000","last_change":"2024-05-07T14:01:04.023731+0000","last_active":"2024-05-07T14:05:18.628294+0000","last_peered":"2024-05-07T14:05:18.628294+0000","last_clean":"2024-05-07T14:05:18.628294+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:05:18.628294+0000","last_undegraded":"2024-05-07T14:05:18.628294+0000","last_fullsized":"2024-05-07T14:05:18.628294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:39:01.625768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"80'1","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960715+0000","last_change":"2024-05-07T14:01:06.368317+0000","last_active":"2024-05-07T14:05:18.960715+0000","last_peered":"2024-05-07T14:05:18.960715+0000","last_clean":"2024-05-07T14:05:18.960715+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:05:18.960715+0000","last_undegraded":"2024-05-07T14:05:18.960715+0000","last_fullsized":"2024-05-07T14:05:18.960715+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:13:30.101803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":254,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960639+0000","last_change":"2024-05-07T14:00:57.994481+0000","last_active":"2024-05-07T14:05:18.960639+0000","last_peered":"2024-05-07T14:05:18.960639+0000","last_clean":"2024-05-07T14:05:18.960639+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:05:18.960639+0000","last_undegraded":"2024-05-07T14:05:18.960639+0000","last_fullsized":"2024-05-07T14:05:18.960639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"146'46","reported_seq":303,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.567426+0000","last_change":"2024-05-07T14:00:55.970506+0000","last_active":"2024-05-07T14:05:31.567426+0000","last_peered":"2024-05-07T14:05:31.567426+0000","last_clean":"2024-05-07T14:05:31.567426+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:05:31.567426+0000","last_undegraded":"2024-05-07T14:05:31.567426+0000","last_fullsized":"2024-05-07T14:05:31.567426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961641+0000","last_change":"2024-05-07T14:04:59.452453+0000","last_active":"2024-05-07T14:05:18.961641+0000","last_peered":"2024-05-07T14:05:18.961641+0000","last_clean":"2024-05-07T14:05:18.961641+0000","last_became_active":"2024-05-07T14:04:59.451719+0000","last_became_peered":"2024-05-07T14:04:59.451719+0000","last_unstale":"2024-05-07T14:05:18.961641+0000","last_undegraded":"2024-05-07T14:05:18.961641+0000","last_fullsized":"2024-05-07T14:05:18.961641+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:58:01.882244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959572+0000","last_change":"2024-05-07T14:00:59.999111+0000","last_active":"2024-05-07T14:05:18.959572+0000","last_peered":"2024-05-07T14:05:18.959572+0000","last_clean":"2024-05-07T14:05:18.959572+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:05:18.959572+0000","last_undegraded":"2024-05-07T14:05:18.959572+0000","last_fullsized":"2024-05-07T14:05:18.959572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:52.034282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"33'14","reported_seq":116,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962572+0000","last_change":"2024-05-07T14:03:39.707679+0000","last_active":"2024-05-07T14:05:18.962572+0000","last_peered":"2024-05-07T14:05:18.962572+0000","last_clean":"2024-05-07T14:05:18.962572+0000","last_became_active":"2024-05-07T14:03:39.664751+0000","last_became_peered":"2024-05-07T14:03:39.664751+0000","last_unstale":"2024-05-07T14:05:18.962572+0000","last_undegraded":"2024-05-07T14:05:18.962572+0000","last_fullsized":"2024-05-07T14:05:18.962572+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:55.535011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"146'142","reported_seq":485,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.472733+0000","last_change":"2024-05-07T14:03:42.707530+0000","last_active":"2024-05-07T14:05:30.472733+0000","last_peered":"2024-05-07T14:05:30.472733+0000","last_clean":"2024-05-07T14:05:30.472733+0000","last_became_active":"2024-05-07T14:03:42.707207+0000","last_became_peered":"2024-05-07T14:03:42.707207+0000","last_unstale":"2024-05-07T14:05:30.472733+0000","last_undegraded":"2024-05-07T14:05:30.472733+0000","last_fullsized":"2024-05-07T14:05:30.472733+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:20:22.698141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964049+0000","last_change":"2024-05-07T14:01:06.370275+0000","last_active":"2024-05-07T14:05:18.964049+0000","last_peered":"2024-05-07T14:05:18.964049+0000","last_clean":"2024-05-07T14:05:18.964049+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:05:18.964049+0000","last_undegraded":"2024-05-07T14:05:18.964049+0000","last_fullsized":"2024-05-07T14:05:18.964049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:46.426289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"115'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959440+0000","last_change":"2024-05-07T14:04:59.447585+0000","last_active":"2024-05-07T14:05:18.959440+0000","last_peered":"2024-05-07T14:05:18.959440+0000","last_clean":"2024-05-07T14:05:18.959440+0000","last_became_active":"2024-05-07T14:04:59.446674+0000","last_became_peered":"2024-05-07T14:04:59.446674+0000","last_unstale":"2024-05-07T14:05:18.959440+0000","last_undegraded":"2024-05-07T14:05:18.959440+0000","last_fullsized":"2024-05-07T14:05:18.959440+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:35.485711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"146'34","reported_seq":317,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.556159+0000","last_change":"2024-05-07T14:05:00.492095+0000","last_active":"2024-05-07T14:05:31.556159+0000","last_peered":"2024-05-07T14:05:31.556159+0000","last_clean":"2024-05-07T14:05:31.556159+0000","last_became_active":"2024-05-07T14:04:59.460381+0000","last_became_peered":"2024-05-07T14:04:59.460381+0000","last_unstale":"2024-05-07T14:05:31.556159+0000","last_undegraded":"2024-05-07T14:05:31.556159+0000","last_fullsized":"2024-05-07T14:05:31.556159+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:12:40.498963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":44,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959581+0000","last_change":"2024-05-07T14:03:39.672724+0000","last_active":"2024-05-07T14:05:18.959581+0000","last_peered":"2024-05-07T14:05:18.959581+0000","last_clean":"2024-05-07T14:05:18.959581+0000","last_became_active":"2024-05-07T14:03:39.671518+0000","last_became_peered":"2024-05-07T14:03:39.671518+0000","last_unstale":"2024-05-07T14:05:18.959581+0000","last_undegraded":"2024-05-07T14:05:18.959581+0000","last_fullsized":"2024-05-07T14:05:18.959581+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:25.485797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":251,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628580+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:05:18.628580+0000","last_peered":"2024-05-07T14:05:18.628580+0000","last_clean":"2024-05-07T14:05:18.628580+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:05:18.628580+0000","last_undegraded":"2024-05-07T14:05:18.628580+0000","last_fullsized":"2024-05-07T14:05:18.628580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629354+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:05:18.629354+0000","last_peered":"2024-05-07T14:05:18.629354+0000","last_clean":"2024-05-07T14:05:18.629354+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:05:18.629354+0000","last_undegraded":"2024-05-07T14:05:18.629354+0000","last_fullsized":"2024-05-07T14:05:18.629354+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"146'138","reported_seq":480,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.480712+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:05:30.480712+0000","last_peered":"2024-05-07T14:05:30.480712+0000","last_clean":"2024-05-07T14:05:30.480712+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:05:30.480712+0000","last_undegraded":"2024-05-07T14:05:30.480712+0000","last_fullsized":"2024-05-07T14:05:30.480712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:34:39.910406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"81'3","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960070+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:05:18.960070+0000","last_peered":"2024-05-07T14:05:18.960070+0000","last_clean":"2024-05-07T14:05:18.960070+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:05:18.960070+0000","last_undegraded":"2024-05-07T14:05:18.960070+0000","last_fullsized":"2024-05-07T14:05:18.960070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:47:24.377324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"124'4","reported_seq":272,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630423+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:05:18.630423+0000","last_peered":"2024-05-07T14:05:18.630423+0000","last_clean":"2024-05-07T14:05:18.630423+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:05:18.630423+0000","last_undegraded":"2024-05-07T14:05:18.630423+0000","last_fullsized":"2024-05-07T14:05:18.630423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:02:19.590460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"146'46","reported_seq":304,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.534018+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:05:31.534018+0000","last_peered":"2024-05-07T14:05:31.534018+0000","last_clean":"2024-05-07T14:05:31.534018+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:05:31.534018+0000","last_undegraded":"2024-05-07T14:05:31.534018+0000","last_fullsized":"2024-05-07T14:05:31.534018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:12:35.436139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964431+0000","last_change":"2024-05-07T14:04:59.469514+0000","last_active":"2024-05-07T14:05:18.964431+0000","last_peered":"2024-05-07T14:05:18.964431+0000","last_clean":"2024-05-07T14:05:18.964431+0000","last_became_active":"2024-05-07T14:04:59.469021+0000","last_became_peered":"2024-05-07T14:04:59.469021+0000","last_unstale":"2024-05-07T14:05:18.964431+0000","last_undegraded":"2024-05-07T14:05:18.964431+0000","last_fullsized":"2024-05-07T14:05:18.964431+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:17:47.533593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959578+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:05:18.959578+0000","last_peered":"2024-05-07T14:05:18.959578+0000","last_clean":"2024-05-07T14:05:18.959578+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:05:18.959578+0000","last_undegraded":"2024-05-07T14:05:18.959578+0000","last_fullsized":"2024-05-07T14:05:18.959578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:05.543791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"146'55","reported_seq":310,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.497762+0000","last_change":"2024-05-07T14:04:59.918491+0000","last_active":"2024-05-07T14:05:31.497762+0000","last_peered":"2024-05-07T14:05:31.497762+0000","last_clean":"2024-05-07T14:05:31.497762+0000","last_became_active":"2024-05-07T14:04:59.442492+0000","last_became_peered":"2024-05-07T14:04:59.442492+0000","last_unstale":"2024-05-07T14:05:31.497762+0000","last_undegraded":"2024-05-07T14:05:31.497762+0000","last_fullsized":"2024-05-07T14:05:31.497762+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:46:58.713363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":61,"num_read_kb":279,"num_write":32,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":116761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":252,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963779+0000","last_change":"2024-05-07T14:03:39.665240+0000","last_active":"2024-05-07T14:05:18.963779+0000","last_peered":"2024-05-07T14:05:18.963779+0000","last_clean":"2024-05-07T14:05:18.963779+0000","last_became_active":"2024-05-07T14:03:39.664810+0000","last_became_peered":"2024-05-07T14:03:39.664810+0000","last_unstale":"2024-05-07T14:05:18.963779+0000","last_undegraded":"2024-05-07T14:05:18.963779+0000","last_fullsized":"2024-05-07T14:05:18.963779+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:18:01.610207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721214+0000","last_change":"2024-05-07T14:04:59.465509+0000","last_active":"2024-05-07T14:05:18.721214+0000","last_peered":"2024-05-07T14:05:18.721214+0000","last_clean":"2024-05-07T14:05:18.721214+0000","last_became_active":"2024-05-07T14:04:59.464840+0000","last_became_peered":"2024-05-07T14:04:59.464840+0000","last_unstale":"2024-05-07T14:05:18.721214+0000","last_undegraded":"2024-05-07T14:05:18.721214+0000","last_fullsized":"2024-05-07T14:05:18.721214+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:42.823262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959673+0000","last_change":"2024-05-07T14:01:06.037210+0000","last_active":"2024-05-07T14:05:18.959673+0000","last_peered":"2024-05-07T14:05:18.959673+0000","last_clean":"2024-05-07T14:05:18.959673+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:05:18.959673+0000","last_undegraded":"2024-05-07T14:05:18.959673+0000","last_fullsized":"2024-05-07T14:05:18.959673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'8","reported_seq":290,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629203+0000","last_change":"2024-05-07T14:00:58.007055+0000","last_active":"2024-05-07T14:05:18.629203+0000","last_peered":"2024-05-07T14:05:18.629203+0000","last_clean":"2024-05-07T14:05:18.629203+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:05:18.629203+0000","last_undegraded":"2024-05-07T14:05:18.629203+0000","last_fullsized":"2024-05-07T14:05:18.629203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:17:50.027553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"146'46","reported_seq":326,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.528560+0000","last_change":"2024-05-07T14:04:59.669798+0000","last_active":"2024-05-07T14:05:31.528560+0000","last_peered":"2024-05-07T14:05:31.528560+0000","last_clean":"2024-05-07T14:05:31.528560+0000","last_became_active":"2024-05-07T14:04:59.428245+0000","last_became_peered":"2024-05-07T14:04:59.428245+0000","last_unstale":"2024-05-07T14:05:31.528560+0000","last_undegraded":"2024-05-07T14:05:31.528560+0000","last_fullsized":"2024-05-07T14:05:31.528560+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:40.955811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962422+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:05:18.962422+0000","last_peered":"2024-05-07T14:05:18.962422+0000","last_clean":"2024-05-07T14:05:18.962422+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:05:18.962422+0000","last_undegraded":"2024-05-07T14:05:18.962422+0000","last_fullsized":"2024-05-07T14:05:18.962422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:42.401960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"146'23","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.960325+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:05:30.960325+0000","last_peered":"2024-05-07T14:05:30.960325+0000","last_clean":"2024-05-07T14:05:30.960325+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:05:30.960325+0000","last_undegraded":"2024-05-07T14:05:30.960325+0000","last_fullsized":"2024-05-07T14:05:30.960325+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:39:50.671214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959679+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:05:18.959679+0000","last_peered":"2024-05-07T14:05:18.959679+0000","last_clean":"2024-05-07T14:05:18.959679+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:05:18.959679+0000","last_undegraded":"2024-05-07T14:05:18.959679+0000","last_fullsized":"2024-05-07T14:05:18.959679+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:15:17.270095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":245,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963898+0000","last_change":"2024-05-07T14:04:59.447528+0000","last_active":"2024-05-07T14:05:18.963898+0000","last_peered":"2024-05-07T14:05:18.963898+0000","last_clean":"2024-05-07T14:05:18.963898+0000","last_became_active":"2024-05-07T14:04:59.446699+0000","last_became_peered":"2024-05-07T14:04:59.446699+0000","last_unstale":"2024-05-07T14:05:18.963898+0000","last_undegraded":"2024-05-07T14:05:18.963898+0000","last_fullsized":"2024-05-07T14:05:18.963898+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:42.823262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"115'8","reported_seq":129,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962079+0000","last_change":"2024-05-07T14:03:39.692877+0000","last_active":"2024-05-07T14:05:18.962079+0000","last_peered":"2024-05-07T14:05:18.962079+0000","last_clean":"2024-05-07T14:05:18.962079+0000","last_became_active":"2024-05-07T14:03:39.663976+0000","last_became_peered":"2024-05-07T14:03:39.663976+0000","last_unstale":"2024-05-07T14:05:18.962079+0000","last_undegraded":"2024-05-07T14:05:18.962079+0000","last_fullsized":"2024-05-07T14:05:18.962079+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:50:36.548454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"146'42","reported_seq":288,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.518031+0000","last_change":"2024-05-07T14:05:00.456893+0000","last_active":"2024-05-07T14:05:31.518031+0000","last_peered":"2024-05-07T14:05:31.518031+0000","last_clean":"2024-05-07T14:05:31.518031+0000","last_became_active":"2024-05-07T14:04:59.445956+0000","last_became_peered":"2024-05-07T14:04:59.445956+0000","last_unstale":"2024-05-07T14:05:31.518031+0000","last_undegraded":"2024-05-07T14:05:31.518031+0000","last_fullsized":"2024-05-07T14:05:31.518031+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:07.979587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964857+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:05:18.964857+0000","last_peered":"2024-05-07T14:05:18.964857+0000","last_clean":"2024-05-07T14:05:18.964857+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:05:18.964857+0000","last_undegraded":"2024-05-07T14:05:18.964857+0000","last_fullsized":"2024-05-07T14:05:18.964857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:28.151372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"124'9","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958697+0000","last_change":"2024-05-07T14:01:02.003975+0000","last_active":"2024-05-07T14:05:18.958697+0000","last_peered":"2024-05-07T14:05:18.958697+0000","last_clean":"2024-05-07T14:05:18.958697+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:05:18.958697+0000","last_undegraded":"2024-05-07T14:05:18.958697+0000","last_fullsized":"2024-05-07T14:05:18.958697+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:41:51.407384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962740+0000","last_change":"2024-05-07T14:04:59.445953+0000","last_active":"2024-05-07T14:05:18.962740+0000","last_peered":"2024-05-07T14:05:18.962740+0000","last_clean":"2024-05-07T14:05:18.962740+0000","last_became_active":"2024-05-07T14:04:59.444830+0000","last_became_peered":"2024-05-07T14:04:59.444830+0000","last_unstale":"2024-05-07T14:05:18.962740+0000","last_undegraded":"2024-05-07T14:05:18.962740+0000","last_fullsized":"2024-05-07T14:05:18.962740+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:10:54.814821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"106'2","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959004+0000","last_change":"2024-05-07T14:01:06.028182+0000","last_active":"2024-05-07T14:05:18.959004+0000","last_peered":"2024-05-07T14:05:18.959004+0000","last_clean":"2024-05-07T14:05:18.959004+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:05:18.959004+0000","last_undegraded":"2024-05-07T14:05:18.959004+0000","last_fullsized":"2024-05-07T14:05:18.959004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:52:42.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"81'4","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960024+0000","last_change":"2024-05-07T14:04:59.460718+0000","last_active":"2024-05-07T14:05:18.960024+0000","last_peered":"2024-05-07T14:05:18.960024+0000","last_clean":"2024-05-07T14:05:18.960024+0000","last_became_active":"2024-05-07T14:04:59.460037+0000","last_became_peered":"2024-05-07T14:04:59.460037+0000","last_unstale":"2024-05-07T14:05:18.960024+0000","last_undegraded":"2024-05-07T14:05:18.960024+0000","last_fullsized":"2024-05-07T14:05:18.960024+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:28.266490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"146'42","reported_seq":326,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.455067+0000","last_change":"2024-05-07T14:05:00.840128+0000","last_active":"2024-05-07T14:05:31.455067+0000","last_peered":"2024-05-07T14:05:31.455067+0000","last_clean":"2024-05-07T14:05:31.455067+0000","last_became_active":"2024-05-07T14:04:59.460944+0000","last_became_peered":"2024-05-07T14:04:59.460944+0000","last_unstale":"2024-05-07T14:05:31.455067+0000","last_undegraded":"2024-05-07T14:05:31.455067+0000","last_fullsized":"2024-05-07T14:05:31.455067+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:30:26.259170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960783+0000","last_change":"2024-05-07T14:04:59.431660+0000","last_active":"2024-05-07T14:05:18.960783+0000","last_peered":"2024-05-07T14:05:18.960783+0000","last_clean":"2024-05-07T14:05:18.960783+0000","last_became_active":"2024-05-07T14:04:59.430654+0000","last_became_peered":"2024-05-07T14:04:59.430654+0000","last_unstale":"2024-05-07T14:05:18.960783+0000","last_undegraded":"2024-05-07T14:05:18.960783+0000","last_fullsized":"2024-05-07T14:05:18.960783+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:27:01.765321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"146'24","reported_seq":281,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.919412+0000","last_change":"2024-05-07T14:01:02.014850+0000","last_active":"2024-05-07T14:05:30.919412+0000","last_peered":"2024-05-07T14:05:30.919412+0000","last_clean":"2024-05-07T14:05:30.919412+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:05:30.919412+0000","last_undegraded":"2024-05-07T14:05:30.919412+0000","last_fullsized":"2024-05-07T14:05:30.919412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:38.950454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959502+0000","last_change":"2024-05-07T14:01:04.018524+0000","last_active":"2024-05-07T14:05:18.959502+0000","last_peered":"2024-05-07T14:05:18.959502+0000","last_clean":"2024-05-07T14:05:18.959502+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:05:18.959502+0000","last_undegraded":"2024-05-07T14:05:18.959502+0000","last_fullsized":"2024-05-07T14:05:18.959502+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:25.614235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720402+0000","last_change":"2024-05-07T14:04:59.444373+0000","last_active":"2024-05-07T14:05:18.720402+0000","last_peered":"2024-05-07T14:05:18.720402+0000","last_clean":"2024-05-07T14:05:18.720402+0000","last_became_active":"2024-05-07T14:04:59.443620+0000","last_became_peered":"2024-05-07T14:04:59.443620+0000","last_unstale":"2024-05-07T14:05:18.720402+0000","last_undegraded":"2024-05-07T14:05:18.720402+0000","last_fullsized":"2024-05-07T14:05:18.720402+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:44:00.772402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"124'4","reported_seq":94,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958941+0000","last_change":"2024-05-07T14:03:52.789742+0000","last_active":"2024-05-07T14:05:18.958941+0000","last_peered":"2024-05-07T14:05:18.958941+0000","last_clean":"2024-05-07T14:05:18.958941+0000","last_became_active":"2024-05-07T14:03:52.787675+0000","last_became_peered":"2024-05-07T14:03:52.787675+0000","last_unstale":"2024-05-07T14:05:18.958941+0000","last_undegraded":"2024-05-07T14:05:18.958941+0000","last_fullsized":"2024-05-07T14:05:18.958941+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:39.000431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"146'48","reported_seq":253,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.581906+0000","last_change":"2024-05-07T14:01:37.318408+0000","last_active":"2024-05-07T14:05:31.581906+0000","last_peered":"2024-05-07T14:05:31.581906+0000","last_clean":"2024-05-07T14:05:31.581906+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:05:31.581906+0000","last_undegraded":"2024-05-07T14:05:31.581906+0000","last_fullsized":"2024-05-07T14:05:31.581906+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:43.643434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959480+0000","last_change":"2024-05-07T14:00:59.996853+0000","last_active":"2024-05-07T14:05:18.959480+0000","last_peered":"2024-05-07T14:05:18.959480+0000","last_clean":"2024-05-07T14:05:18.959480+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:05:18.959480+0000","last_undegraded":"2024-05-07T14:05:18.959480+0000","last_fullsized":"2024-05-07T14:05:18.959480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:15.770879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"146'20","reported_seq":256,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.573075+0000","last_change":"2024-05-07T14:04:59.459641+0000","last_active":"2024-05-07T14:05:30.573075+0000","last_peered":"2024-05-07T14:05:30.573075+0000","last_clean":"2024-05-07T14:05:30.573075+0000","last_became_active":"2024-05-07T14:04:59.459102+0000","last_became_peered":"2024-05-07T14:04:59.459102+0000","last_unstale":"2024-05-07T14:05:30.573075+0000","last_undegraded":"2024-05-07T14:05:30.573075+0000","last_fullsized":"2024-05-07T14:05:30.573075+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:09:18.267555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958858+0000","last_change":"2024-05-07T14:04:59.449322+0000","last_active":"2024-05-07T14:05:18.958858+0000","last_peered":"2024-05-07T14:05:18.958858+0000","last_clean":"2024-05-07T14:05:18.958858+0000","last_became_active":"2024-05-07T14:04:59.448594+0000","last_became_peered":"2024-05-07T14:04:59.448594+0000","last_unstale":"2024-05-07T14:05:18.958858+0000","last_undegraded":"2024-05-07T14:05:18.958858+0000","last_fullsized":"2024-05-07T14:05:18.958858+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:24:32.423884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"115'6","reported_seq":264,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964236+0000","last_change":"2024-05-07T14:00:57.989040+0000","last_active":"2024-05-07T14:05:18.964236+0000","last_peered":"2024-05-07T14:05:18.964236+0000","last_clean":"2024-05-07T14:05:18.964236+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:05:18.964236+0000","last_undegraded":"2024-05-07T14:05:18.964236+0000","last_fullsized":"2024-05-07T14:05:18.964236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:59:22.876958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"146'52","reported_seq":310,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.580391+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:05:31.580391+0000","last_peered":"2024-05-07T14:05:31.580391+0000","last_clean":"2024-05-07T14:05:31.580391+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:05:31.580391+0000","last_undegraded":"2024-05-07T14:05:31.580391+0000","last_fullsized":"2024-05-07T14:05:31.580391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":257,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961778+0000","last_change":"2024-05-07T14:04:59.457249+0000","last_active":"2024-05-07T14:05:18.961778+0000","last_peered":"2024-05-07T14:05:18.961778+0000","last_clean":"2024-05-07T14:05:18.961778+0000","last_became_active":"2024-05-07T14:04:59.455608+0000","last_became_peered":"2024-05-07T14:04:59.455608+0000","last_unstale":"2024-05-07T14:05:18.961778+0000","last_undegraded":"2024-05-07T14:05:18.961778+0000","last_fullsized":"2024-05-07T14:05:18.961778+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:55:28.165004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"146'36","reported_seq":299,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.653129+0000","last_change":"2024-05-07T14:01:02.017235+0000","last_active":"2024-05-07T14:05:31.653129+0000","last_peered":"2024-05-07T14:05:31.653129+0000","last_clean":"2024-05-07T14:05:31.653129+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:05:31.653129+0000","last_undegraded":"2024-05-07T14:05:31.653129+0000","last_fullsized":"2024-05-07T14:05:31.653129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:07.555305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":240,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720945+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:05:18.720945+0000","last_peered":"2024-05-07T14:05:18.720945+0000","last_clean":"2024-05-07T14:05:18.720945+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:05:18.720945+0000","last_undegraded":"2024-05-07T14:05:18.720945+0000","last_fullsized":"2024-05-07T14:05:18.720945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"81'2","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963561+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:05:18.963561+0000","last_peered":"2024-05-07T14:05:18.963561+0000","last_clean":"2024-05-07T14:05:18.963561+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:05:18.963561+0000","last_undegraded":"2024-05-07T14:05:18.963561+0000","last_fullsized":"2024-05-07T14:05:18.963561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:19:34.157470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"115'8","reported_seq":295,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962152+0000","last_change":"2024-05-07T14:04:59.457999+0000","last_active":"2024-05-07T14:05:18.962152+0000","last_peered":"2024-05-07T14:05:18.962152+0000","last_clean":"2024-05-07T14:05:18.962152+0000","last_became_active":"2024-05-07T14:04:59.456492+0000","last_became_peered":"2024-05-07T14:04:59.456492+0000","last_unstale":"2024-05-07T14:05:18.962152+0000","last_undegraded":"2024-05-07T14:05:18.962152+0000","last_fullsized":"2024-05-07T14:05:18.962152+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:15:41.936460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"146'44","reported_seq":300,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.605227+0000","last_change":"2024-05-07T14:00:55.968813+0000","last_active":"2024-05-07T14:05:31.605227+0000","last_peered":"2024-05-07T14:05:31.605227+0000","last_clean":"2024-05-07T14:05:31.605227+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:05:31.605227+0000","last_undegraded":"2024-05-07T14:05:31.605227+0000","last_fullsized":"2024-05-07T14:05:31.605227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:35.540483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":249,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960857+0000","last_change":"2024-05-07T14:00:59.997119+0000","last_active":"2024-05-07T14:05:18.960857+0000","last_peered":"2024-05-07T14:05:18.960857+0000","last_clean":"2024-05-07T14:05:18.960857+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:05:18.960857+0000","last_undegraded":"2024-05-07T14:05:18.960857+0000","last_fullsized":"2024-05-07T14:05:18.960857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:15.308090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"146'26","reported_seq":265,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.581643+0000","last_change":"2024-05-07T14:04:59.440283+0000","last_active":"2024-05-07T14:05:30.581643+0000","last_peered":"2024-05-07T14:05:30.581643+0000","last_clean":"2024-05-07T14:05:30.581643+0000","last_became_active":"2024-05-07T14:04:59.439603+0000","last_became_peered":"2024-05-07T14:04:59.439603+0000","last_unstale":"2024-05-07T14:05:30.581643+0000","last_undegraded":"2024-05-07T14:05:30.581643+0000","last_fullsized":"2024-05-07T14:05:30.581643+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:19.505619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964150+0000","last_change":"2024-05-07T14:03:39.667564+0000","last_active":"2024-05-07T14:05:18.964150+0000","last_peered":"2024-05-07T14:05:18.964150+0000","last_clean":"2024-05-07T14:05:18.964150+0000","last_became_active":"2024-05-07T14:03:39.666888+0000","last_became_peered":"2024-05-07T14:03:39.666888+0000","last_unstale":"2024-05-07T14:05:18.964150+0000","last_undegraded":"2024-05-07T14:05:18.964150+0000","last_fullsized":"2024-05-07T14:05:18.964150+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:53:33.367980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959043+0000","last_change":"2024-05-07T14:04:59.456030+0000","last_active":"2024-05-07T14:05:18.959043+0000","last_peered":"2024-05-07T14:05:18.959043+0000","last_clean":"2024-05-07T14:05:18.959043+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:18.959043+0000","last_undegraded":"2024-05-07T14:05:18.959043+0000","last_fullsized":"2024-05-07T14:05:18.959043+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:20:24.704314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"81'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963522+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:05:18.963522+0000","last_peered":"2024-05-07T14:05:18.963522+0000","last_clean":"2024-05-07T14:05:18.963522+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:05:18.963522+0000","last_undegraded":"2024-05-07T14:05:18.963522+0000","last_fullsized":"2024-05-07T14:05:18.963522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:32:40.395231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"146'54","reported_seq":312,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.637804+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:05:31.637804+0000","last_peered":"2024-05-07T14:05:31.637804+0000","last_clean":"2024-05-07T14:05:31.637804+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:05:31.637804+0000","last_undegraded":"2024-05-07T14:05:31.637804+0000","last_fullsized":"2024-05-07T14:05:31.637804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:59:04.451214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631091+0000","last_change":"2024-05-07T14:01:00.004903+0000","last_active":"2024-05-07T14:05:18.631091+0000","last_peered":"2024-05-07T14:05:18.631091+0000","last_clean":"2024-05-07T14:05:18.631091+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:05:18.631091+0000","last_undegraded":"2024-05-07T14:05:18.631091+0000","last_fullsized":"2024-05-07T14:05:18.631091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:54.583832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"146'22","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.977970+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:05:30.977970+0000","last_peered":"2024-05-07T14:05:30.977970+0000","last_clean":"2024-05-07T14:05:30.977970+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:05:30.977970+0000","last_undegraded":"2024-05-07T14:05:30.977970+0000","last_fullsized":"2024-05-07T14:05:30.977970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:50.584418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960106+0000","last_change":"2024-05-07T14:03:39.664184+0000","last_active":"2024-05-07T14:05:18.960106+0000","last_peered":"2024-05-07T14:05:18.960106+0000","last_clean":"2024-05-07T14:05:18.960106+0000","last_became_active":"2024-05-07T14:03:39.663569+0000","last_became_peered":"2024-05-07T14:03:39.663569+0000","last_unstale":"2024-05-07T14:05:18.960106+0000","last_undegraded":"2024-05-07T14:05:18.960106+0000","last_fullsized":"2024-05-07T14:05:18.960106+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:51.998663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":243,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720030+0000","last_change":"2024-05-07T14:04:59.447765+0000","last_active":"2024-05-07T14:05:18.720030+0000","last_peered":"2024-05-07T14:05:18.720030+0000","last_clean":"2024-05-07T14:05:18.720030+0000","last_became_active":"2024-05-07T14:04:59.447025+0000","last_became_peered":"2024-05-07T14:04:59.447025+0000","last_unstale":"2024-05-07T14:05:18.720030+0000","last_undegraded":"2024-05-07T14:05:18.720030+0000","last_fullsized":"2024-05-07T14:05:18.720030+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:14.299214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"124'14","reported_seq":298,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629778+0000","last_change":"2024-05-07T14:00:57.996676+0000","last_active":"2024-05-07T14:05:18.629778+0000","last_peered":"2024-05-07T14:05:18.629778+0000","last_clean":"2024-05-07T14:05:18.629778+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:05:18.629778+0000","last_undegraded":"2024-05-07T14:05:18.629778+0000","last_fullsized":"2024-05-07T14:05:18.629778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:58.154451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"146'40","reported_seq":297,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.618771+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:05:31.618771+0000","last_peered":"2024-05-07T14:05:31.618771+0000","last_clean":"2024-05-07T14:05:31.618771+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:05:31.618771+0000","last_undegraded":"2024-05-07T14:05:31.618771+0000","last_fullsized":"2024-05-07T14:05:31.618771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:29.952509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964629+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:05:18.964629+0000","last_peered":"2024-05-07T14:05:18.964629+0000","last_clean":"2024-05-07T14:05:18.964629+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:05:18.964629+0000","last_undegraded":"2024-05-07T14:05:18.964629+0000","last_fullsized":"2024-05-07T14:05:18.964629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:58:55.715619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'10","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630297+0000","last_change":"2024-05-07T14:01:02.148076+0000","last_active":"2024-05-07T14:05:18.630297+0000","last_peered":"2024-05-07T14:05:18.630297+0000","last_clean":"2024-05-07T14:05:18.630297+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:05:18.630297+0000","last_undegraded":"2024-05-07T14:05:18.630297+0000","last_fullsized":"2024-05-07T14:05:18.630297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:59:07.485774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"146'138","reported_seq":509,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.469857+0000","last_change":"2024-05-07T14:01:04.017501+0000","last_active":"2024-05-07T14:05:30.469857+0000","last_peered":"2024-05-07T14:05:30.469857+0000","last_clean":"2024-05-07T14:05:30.469857+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:05:30.469857+0000","last_undegraded":"2024-05-07T14:05:30.469857+0000","last_fullsized":"2024-05-07T14:05:30.469857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:31:32.168997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"81'7","reported_seq":161,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961656+0000","last_change":"2024-05-07T14:04:59.448265+0000","last_active":"2024-05-07T14:05:18.961656+0000","last_peered":"2024-05-07T14:05:18.961656+0000","last_clean":"2024-05-07T14:05:18.961656+0000","last_became_active":"2024-05-07T14:04:59.444580+0000","last_became_peered":"2024-05-07T14:04:59.444580+0000","last_unstale":"2024-05-07T14:05:18.961656+0000","last_undegraded":"2024-05-07T14:05:18.961656+0000","last_fullsized":"2024-05-07T14:05:18.961656+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:54.087416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"124'8","reported_seq":289,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629103+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:05:18.629103+0000","last_peered":"2024-05-07T14:05:18.629103+0000","last_clean":"2024-05-07T14:05:18.629103+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:05:18.629103+0000","last_undegraded":"2024-05-07T14:05:18.629103+0000","last_fullsized":"2024-05-07T14:05:18.629103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:20:13.764150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"146'40","reported_seq":296,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.584234+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:05:31.584234+0000","last_peered":"2024-05-07T14:05:31.584234+0000","last_clean":"2024-05-07T14:05:31.584234+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:05:31.584234+0000","last_undegraded":"2024-05-07T14:05:31.584234+0000","last_fullsized":"2024-05-07T14:05:31.584234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:52.736158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":217,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961289+0000","last_change":"2024-05-07T14:04:59.425730+0000","last_active":"2024-05-07T14:05:18.961289+0000","last_peered":"2024-05-07T14:05:18.961289+0000","last_clean":"2024-05-07T14:05:18.961289+0000","last_became_active":"2024-05-07T14:04:59.421636+0000","last_became_peered":"2024-05-07T14:04:59.421636+0000","last_unstale":"2024-05-07T14:05:18.961289+0000","last_undegraded":"2024-05-07T14:05:18.961289+0000","last_fullsized":"2024-05-07T14:05:18.961289+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:15:27.691007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"146'26","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.478989+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:05:31.478989+0000","last_peered":"2024-05-07T14:05:31.478989+0000","last_clean":"2024-05-07T14:05:31.478989+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:05:31.478989+0000","last_undegraded":"2024-05-07T14:05:31.478989+0000","last_fullsized":"2024-05-07T14:05:31.478989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:22.598642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958232+0000","last_change":"2024-05-07T14:01:04.012694+0000","last_active":"2024-05-07T14:05:18.958232+0000","last_peered":"2024-05-07T14:05:18.958232+0000","last_clean":"2024-05-07T14:05:18.958232+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:05:18.958232+0000","last_undegraded":"2024-05-07T14:05:18.958232+0000","last_fullsized":"2024-05-07T14:05:18.958232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.590529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"124'7","reported_seq":157,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964433+0000","last_change":"2024-05-07T14:05:02.242073+0000","last_active":"2024-05-07T14:05:18.964433+0000","last_peered":"2024-05-07T14:05:18.964433+0000","last_clean":"2024-05-07T14:05:18.964433+0000","last_became_active":"2024-05-07T14:04:59.467712+0000","last_became_peered":"2024-05-07T14:04:59.467712+0000","last_unstale":"2024-05-07T14:05:18.964433+0000","last_undegraded":"2024-05-07T14:05:18.964433+0000","last_fullsized":"2024-05-07T14:05:18.964433+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:31.624262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"115'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629455+0000","last_change":"2024-05-07T14:00:58.003248+0000","last_active":"2024-05-07T14:05:18.629455+0000","last_peered":"2024-05-07T14:05:18.629455+0000","last_clean":"2024-05-07T14:05:18.629455+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:05:18.629455+0000","last_undegraded":"2024-05-07T14:05:18.629455+0000","last_fullsized":"2024-05-07T14:05:18.629455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"146'50","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.617902+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:05:31.617902+0000","last_peered":"2024-05-07T14:05:31.617902+0000","last_clean":"2024-05-07T14:05:31.617902+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:05:31.617902+0000","last_undegraded":"2024-05-07T14:05:31.617902+0000","last_fullsized":"2024-05-07T14:05:31.617902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:01:15.512835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":248,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.720667+0000","last_change":"2024-05-07T14:01:00.000834+0000","last_active":"2024-05-07T14:05:18.720667+0000","last_peered":"2024-05-07T14:05:18.720667+0000","last_clean":"2024-05-07T14:05:18.720667+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:05:18.720667+0000","last_undegraded":"2024-05-07T14:05:18.720667+0000","last_fullsized":"2024-05-07T14:05:18.720667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:52.783749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"146'20","reported_seq":276,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.481874+0000","last_change":"2024-05-07T14:01:02.013691+0000","last_active":"2024-05-07T14:05:31.481874+0000","last_peered":"2024-05-07T14:05:31.481874+0000","last_clean":"2024-05-07T14:05:31.481874+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:05:31.481874+0000","last_undegraded":"2024-05-07T14:05:31.481874+0000","last_fullsized":"2024-05-07T14:05:31.481874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:31:56.595347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":247,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959103+0000","last_change":"2024-05-07T14:04:59.466240+0000","last_active":"2024-05-07T14:05:18.959103+0000","last_peered":"2024-05-07T14:05:18.959103+0000","last_clean":"2024-05-07T14:05:18.959103+0000","last_became_active":"2024-05-07T14:04:59.465509+0000","last_became_peered":"2024-05-07T14:04:59.465509+0000","last_unstale":"2024-05-07T14:05:18.959103+0000","last_undegraded":"2024-05-07T14:05:18.959103+0000","last_fullsized":"2024-05-07T14:05:18.959103+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:28:23.609814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":237,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.964136+0000","last_change":"2024-05-07T14:01:06.372183+0000","last_active":"2024-05-07T14:05:18.964136+0000","last_peered":"2024-05-07T14:05:18.964136+0000","last_clean":"2024-05-07T14:05:18.964136+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:05:18.964136+0000","last_undegraded":"2024-05-07T14:05:18.964136+0000","last_fullsized":"2024-05-07T14:05:18.964136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:37:31.665284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"87'6","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960098+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:05:18.960098+0000","last_peered":"2024-05-07T14:05:18.960098+0000","last_clean":"2024-05-07T14:05:18.960098+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:05:18.960098+0000","last_undegraded":"2024-05-07T14:05:18.960098+0000","last_fullsized":"2024-05-07T14:05:18.960098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:19:39.587078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"146'38","reported_seq":296,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.556656+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:05:31.556656+0000","last_peered":"2024-05-07T14:05:31.556656+0000","last_clean":"2024-05-07T14:05:31.556656+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:05:31.556656+0000","last_undegraded":"2024-05-07T14:05:31.556656+0000","last_fullsized":"2024-05-07T14:05:31.556656+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":250,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628160+0000","last_change":"2024-05-07T14:01:00.000718+0000","last_active":"2024-05-07T14:05:18.628160+0000","last_peered":"2024-05-07T14:05:18.628160+0000","last_clean":"2024-05-07T14:05:18.628160+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:05:18.628160+0000","last_undegraded":"2024-05-07T14:05:18.628160+0000","last_fullsized":"2024-05-07T14:05:18.628160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:34:40.554030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"146'16","reported_seq":278,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.968023+0000","last_change":"2024-05-07T14:04:59.460738+0000","last_active":"2024-05-07T14:05:30.968023+0000","last_peered":"2024-05-07T14:05:30.968023+0000","last_clean":"2024-05-07T14:05:30.968023+0000","last_became_active":"2024-05-07T14:04:59.459963+0000","last_became_peered":"2024-05-07T14:04:59.459963+0000","last_unstale":"2024-05-07T14:05:30.968023+0000","last_undegraded":"2024-05-07T14:05:30.968023+0000","last_fullsized":"2024-05-07T14:05:30.968023+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:14:25.517514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":242,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628526+0000","last_change":"2024-05-07T14:01:04.013186+0000","last_active":"2024-05-07T14:05:18.628526+0000","last_peered":"2024-05-07T14:05:18.628526+0000","last_clean":"2024-05-07T14:05:18.628526+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:05:18.628526+0000","last_undegraded":"2024-05-07T14:05:18.628526+0000","last_fullsized":"2024-05-07T14:05:18.628526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"81'8","reported_seq":222,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.963108+0000","last_change":"2024-05-07T14:04:59.462387+0000","last_active":"2024-05-07T14:05:18.963108+0000","last_peered":"2024-05-07T14:05:18.963108+0000","last_clean":"2024-05-07T14:05:18.963108+0000","last_became_active":"2024-05-07T14:04:59.456842+0000","last_became_peered":"2024-05-07T14:04:59.456842+0000","last_unstale":"2024-05-07T14:05:18.963108+0000","last_undegraded":"2024-05-07T14:05:18.963108+0000","last_fullsized":"2024-05-07T14:05:18.963108+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:43:26.257882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"115'10","reported_seq":294,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.628969+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:05:18.628969+0000","last_peered":"2024-05-07T14:05:18.628969+0000","last_clean":"2024-05-07T14:05:18.628969+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:05:18.628969+0000","last_undegraded":"2024-05-07T14:05:18.628969+0000","last_fullsized":"2024-05-07T14:05:18.628969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:38.991649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"146'44","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.582793+0000","last_change":"2024-05-07T14:01:37.554242+0000","last_active":"2024-05-07T14:05:31.582793+0000","last_peered":"2024-05-07T14:05:31.582793+0000","last_clean":"2024-05-07T14:05:31.582793+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:05:31.582793+0000","last_undegraded":"2024-05-07T14:05:31.582793+0000","last_fullsized":"2024-05-07T14:05:31.582793+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:16:22.149514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"26'1","reported_seq":104,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.962634+0000","last_change":"2024-05-07T14:03:39.674947+0000","last_active":"2024-05-07T14:05:18.962634+0000","last_peered":"2024-05-07T14:05:18.962634+0000","last_clean":"2024-05-07T14:05:18.962634+0000","last_became_active":"2024-05-07T14:03:39.659887+0000","last_became_peered":"2024-05-07T14:03:39.659887+0000","last_unstale":"2024-05-07T14:05:18.962634+0000","last_undegraded":"2024-05-07T14:05:18.962634+0000","last_fullsized":"2024-05-07T14:05:18.962634+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:18:06.217561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"146'20","reported_seq":277,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:30.982399+0000","last_change":"2024-05-07T14:01:02.004656+0000","last_active":"2024-05-07T14:05:30.982399+0000","last_peered":"2024-05-07T14:05:30.982399+0000","last_clean":"2024-05-07T14:05:30.982399+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:05:30.982399+0000","last_undegraded":"2024-05-07T14:05:30.982399+0000","last_fullsized":"2024-05-07T14:05:30.982399+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:05:59.957772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":241,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958734+0000","last_change":"2024-05-07T14:01:04.007317+0000","last_active":"2024-05-07T14:05:18.958734+0000","last_peered":"2024-05-07T14:05:18.958734+0000","last_clean":"2024-05-07T14:05:18.958734+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:05:18.958734+0000","last_undegraded":"2024-05-07T14:05:18.958734+0000","last_fullsized":"2024-05-07T14:05:18.958734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:35.228037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631326+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:05:18.631326+0000","last_peered":"2024-05-07T14:05:18.631326+0000","last_clean":"2024-05-07T14:05:18.631326+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:05:18.631326+0000","last_undegraded":"2024-05-07T14:05:18.631326+0000","last_fullsized":"2024-05-07T14:05:18.631326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:43:48.708680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"87'16","reported_seq":110,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960757+0000","last_change":"2024-05-07T14:03:39.799013+0000","last_active":"2024-05-07T14:05:18.960757+0000","last_peered":"2024-05-07T14:05:18.960757+0000","last_clean":"2024-05-07T14:05:18.960757+0000","last_became_active":"2024-05-07T14:03:39.671068+0000","last_became_peered":"2024-05-07T14:03:39.671068+0000","last_unstale":"2024-05-07T14:05:18.960757+0000","last_undegraded":"2024-05-07T14:05:18.960757+0000","last_fullsized":"2024-05-07T14:05:18.960757+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:11:13.746128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"146'44","reported_seq":301,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.594350+0000","last_change":"2024-05-07T14:00:55.978743+0000","last_active":"2024-05-07T14:05:31.594350+0000","last_peered":"2024-05-07T14:05:31.594350+0000","last_clean":"2024-05-07T14:05:31.594350+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:05:31.594350+0000","last_undegraded":"2024-05-07T14:05:31.594350+0000","last_fullsized":"2024-05-07T14:05:31.594350+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:18:25.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":100,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959826+0000","last_change":"2024-05-07T14:03:39.661724+0000","last_active":"2024-05-07T14:05:18.959826+0000","last_peered":"2024-05-07T14:05:18.959826+0000","last_clean":"2024-05-07T14:05:18.959826+0000","last_became_active":"2024-05-07T14:03:39.661339+0000","last_became_peered":"2024-05-07T14:03:39.661339+0000","last_unstale":"2024-05-07T14:05:18.959826+0000","last_undegraded":"2024-05-07T14:05:18.959826+0000","last_fullsized":"2024-05-07T14:05:18.959826+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:36:34.633849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"146'34","reported_seq":295,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.535287+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:05:31.535287+0000","last_peered":"2024-05-07T14:05:31.535287+0000","last_clean":"2024-05-07T14:05:31.535287+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:05:31.535287+0000","last_undegraded":"2024-05-07T14:05:31.535287+0000","last_fullsized":"2024-05-07T14:05:31.535287+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:06:01.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"81'6","reported_seq":284,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.721729+0000","last_change":"2024-05-07T14:04:59.467441+0000","last_active":"2024-05-07T14:05:18.721729+0000","last_peered":"2024-05-07T14:05:18.721729+0000","last_clean":"2024-05-07T14:05:18.721729+0000","last_became_active":"2024-05-07T14:04:59.466443+0000","last_became_peered":"2024-05-07T14:04:59.466443+0000","last_unstale":"2024-05-07T14:05:18.721729+0000","last_undegraded":"2024-05-07T14:05:18.721729+0000","last_fullsized":"2024-05-07T14:05:18.721729+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:34:35.485711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"146'50","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.611325+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:05:31.611325+0000","last_peered":"2024-05-07T14:05:31.611325+0000","last_clean":"2024-05-07T14:05:31.611325+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:05:31.611325+0000","last_undegraded":"2024-05-07T14:05:31.611325+0000","last_fullsized":"2024-05-07T14:05:31.611325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"124'4","reported_seq":124,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961882+0000","last_change":"2024-05-07T14:04:59.861145+0000","last_active":"2024-05-07T14:05:18.961882+0000","last_peered":"2024-05-07T14:05:18.961882+0000","last_clean":"2024-05-07T14:05:18.961882+0000","last_became_active":"2024-05-07T14:04:59.445932+0000","last_became_peered":"2024-05-07T14:04:59.445932+0000","last_unstale":"2024-05-07T14:05:18.961882+0000","last_undegraded":"2024-05-07T14:05:18.961882+0000","last_fullsized":"2024-05-07T14:05:18.961882+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:40:42.963131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"146'54","reported_seq":313,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.575266+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:05:31.575266+0000","last_peered":"2024-05-07T14:05:31.575266+0000","last_clean":"2024-05-07T14:05:31.575266+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:05:31.575266+0000","last_undegraded":"2024-05-07T14:05:31.575266+0000","last_fullsized":"2024-05-07T14:05:31.575266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:46:38.889451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"81'2","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.965417+0000","last_change":"2024-05-07T14:04:59.448690+0000","last_active":"2024-05-07T14:05:18.965417+0000","last_peered":"2024-05-07T14:05:18.965417+0000","last_clean":"2024-05-07T14:05:18.965417+0000","last_became_active":"2024-05-07T14:04:59.447844+0000","last_became_peered":"2024-05-07T14:04:59.447844+0000","last_unstale":"2024-05-07T14:05:18.965417+0000","last_undegraded":"2024-05-07T14:05:18.965417+0000","last_fullsized":"2024-05-07T14:05:18.965417+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:48:36.699391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"146'42","reported_seq":300,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.571879+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:05:31.571879+0000","last_peered":"2024-05-07T14:05:31.571879+0000","last_clean":"2024-05-07T14:05:31.571879+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:05:31.571879+0000","last_undegraded":"2024-05-07T14:05:31.571879+0000","last_fullsized":"2024-05-07T14:05:31.571879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.629774+0000","last_change":"2024-05-07T14:00:58.003880+0000","last_active":"2024-05-07T14:05:18.629774+0000","last_peered":"2024-05-07T14:05:18.629774+0000","last_clean":"2024-05-07T14:05:18.629774+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:05:18.629774+0000","last_undegraded":"2024-05-07T14:05:18.629774+0000","last_fullsized":"2024-05-07T14:05:18.629774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:33:31.436886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"146'56","reported_seq":161,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.595360+0000","last_change":"2024-05-07T14:03:39.789159+0000","last_active":"2024-05-07T14:05:31.595360+0000","last_peered":"2024-05-07T14:05:31.595360+0000","last_clean":"2024-05-07T14:05:31.595360+0000","last_became_active":"2024-05-07T14:03:39.668790+0000","last_became_peered":"2024-05-07T14:03:39.668790+0000","last_unstale":"2024-05-07T14:05:31.595360+0000","last_undegraded":"2024-05-07T14:05:31.595360+0000","last_fullsized":"2024-05-07T14:05:31.595360+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:36:14.798045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"81'8","reported_seq":319,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959979+0000","last_change":"2024-05-07T14:03:39.855375+0000","last_active":"2024-05-07T14:05:18.959979+0000","last_peered":"2024-05-07T14:05:18.959979+0000","last_clean":"2024-05-07T14:05:18.959979+0000","last_became_active":"2024-05-07T14:03:39.666451+0000","last_became_peered":"2024-05-07T14:03:39.666451+0000","last_unstale":"2024-05-07T14:05:18.959979+0000","last_undegraded":"2024-05-07T14:05:18.959979+0000","last_fullsized":"2024-05-07T14:05:18.959979+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:37.171990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"146'44","reported_seq":319,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.587750+0000","last_change":"2024-05-07T14:05:00.248173+0000","last_active":"2024-05-07T14:05:31.587750+0000","last_peered":"2024-05-07T14:05:31.587750+0000","last_clean":"2024-05-07T14:05:31.587750+0000","last_became_active":"2024-05-07T14:04:59.455622+0000","last_became_peered":"2024-05-07T14:04:59.455622+0000","last_unstale":"2024-05-07T14:05:31.587750+0000","last_undegraded":"2024-05-07T14:05:31.587750+0000","last_fullsized":"2024-05-07T14:05:31.587750+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:27:03.691207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"115'2","reported_seq":261,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959101+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:05:18.959101+0000","last_peered":"2024-05-07T14:05:18.959101+0000","last_clean":"2024-05-07T14:05:18.959101+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:05:18.959101+0000","last_undegraded":"2024-05-07T14:05:18.959101+0000","last_fullsized":"2024-05-07T14:05:18.959101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:54.743478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"146'40","reported_seq":298,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.559565+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:05:31.559565+0000","last_peered":"2024-05-07T14:05:31.559565+0000","last_clean":"2024-05-07T14:05:31.559565+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:05:31.559565+0000","last_undegraded":"2024-05-07T14:05:31.559565+0000","last_fullsized":"2024-05-07T14:05:31.559565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:15:22.458669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"106'2","reported_seq":262,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960114+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:05:18.960114+0000","last_peered":"2024-05-07T14:05:18.960114+0000","last_clean":"2024-05-07T14:05:18.960114+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:05:18.960114+0000","last_undegraded":"2024-05-07T14:05:18.960114+0000","last_fullsized":"2024-05-07T14:05:18.960114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"146'56","reported_seq":314,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.632960+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:05:31.632960+0000","last_peered":"2024-05-07T14:05:31.632960+0000","last_clean":"2024-05-07T14:05:31.632960+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:05:31.632960+0000","last_undegraded":"2024-05-07T14:05:31.632960+0000","last_fullsized":"2024-05-07T14:05:31.632960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:08:03.784070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630722+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:05:18.630722+0000","last_peered":"2024-05-07T14:05:18.630722+0000","last_clean":"2024-05-07T14:05:18.630722+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:05:18.630722+0000","last_undegraded":"2024-05-07T14:05:18.630722+0000","last_fullsized":"2024-05-07T14:05:18.630722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:16:26.218620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"146'48","reported_seq":306,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.599804+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:05:31.599804+0000","last_peered":"2024-05-07T14:05:31.599804+0000","last_clean":"2024-05-07T14:05:31.599804+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:05:31.599804+0000","last_undegraded":"2024-05-07T14:05:31.599804+0000","last_fullsized":"2024-05-07T14:05:31.599804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:39:19.574627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"106'4","reported_seq":270,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.630125+0000","last_change":"2024-05-07T14:00:57.973215+0000","last_active":"2024-05-07T14:05:18.630125+0000","last_peered":"2024-05-07T14:05:18.630125+0000","last_clean":"2024-05-07T14:05:18.630125+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:05:18.630125+0000","last_undegraded":"2024-05-07T14:05:18.630125+0000","last_fullsized":"2024-05-07T14:05:18.630125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:04:18.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"146'54","reported_seq":331,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.637791+0000","last_change":"2024-05-07T14:04:59.856502+0000","last_active":"2024-05-07T14:05:31.637791+0000","last_peered":"2024-05-07T14:05:31.637791+0000","last_clean":"2024-05-07T14:05:31.637791+0000","last_became_active":"2024-05-07T14:04:59.443769+0000","last_became_peered":"2024-05-07T14:04:59.443769+0000","last_unstale":"2024-05-07T14:05:31.637791+0000","last_undegraded":"2024-05-07T14:05:31.637791+0000","last_fullsized":"2024-05-07T14:05:31.637791+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:48:34.692070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":255,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.631323+0000","last_change":"2024-05-07T14:00:58.003468+0000","last_active":"2024-05-07T14:05:18.631323+0000","last_peered":"2024-05-07T14:05:18.631323+0000","last_clean":"2024-05-07T14:05:18.631323+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:05:18.631323+0000","last_undegraded":"2024-05-07T14:05:18.631323+0000","last_fullsized":"2024-05-07T14:05:18.631323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:55:40.048214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"146'54","reported_seq":336,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.619729+0000","last_change":"2024-05-07T14:05:01.098433+0000","last_active":"2024-05-07T14:05:31.619729+0000","last_peered":"2024-05-07T14:05:31.619729+0000","last_clean":"2024-05-07T14:05:31.619729+0000","last_became_active":"2024-05-07T14:04:59.458388+0000","last_became_peered":"2024-05-07T14:04:59.458388+0000","last_unstale":"2024-05-07T14:05:31.619729+0000","last_undegraded":"2024-05-07T14:05:31.619729+0000","last_fullsized":"2024-05-07T14:05:31.619729+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:29:00.050525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"81'6","reported_seq":238,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.961340+0000","last_change":"2024-05-07T14:04:59.449854+0000","last_active":"2024-05-07T14:05:18.961340+0000","last_peered":"2024-05-07T14:05:18.961340+0000","last_clean":"2024-05-07T14:05:18.961340+0000","last_became_active":"2024-05-07T14:04:59.448913+0000","last_became_peered":"2024-05-07T14:04:59.448913+0000","last_unstale":"2024-05-07T14:05:18.961340+0000","last_undegraded":"2024-05-07T14:05:18.961340+0000","last_fullsized":"2024-05-07T14:05:18.961340+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:39.717523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"146'58","reported_seq":315,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.594036+0000","last_change":"2024-05-07T14:00:55.991497+0000","last_active":"2024-05-07T14:05:31.594036+0000","last_peered":"2024-05-07T14:05:31.594036+0000","last_clean":"2024-05-07T14:05:31.594036+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:05:31.594036+0000","last_undegraded":"2024-05-07T14:05:31.594036+0000","last_fullsized":"2024-05-07T14:05:31.594036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:56.147130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"87'2","reported_seq":263,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.958982+0000","last_change":"2024-05-07T14:00:57.993124+0000","last_active":"2024-05-07T14:05:18.958982+0000","last_peered":"2024-05-07T14:05:18.958982+0000","last_clean":"2024-05-07T14:05:18.958982+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:05:18.958982+0000","last_undegraded":"2024-05-07T14:05:18.958982+0000","last_fullsized":"2024-05-07T14:05:18.958982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:54:54.525599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"146'46","reported_seq":293,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.421624+0000","last_change":"2024-05-07T14:05:02.233669+0000","last_active":"2024-05-07T14:05:31.421624+0000","last_peered":"2024-05-07T14:05:31.421624+0000","last_clean":"2024-05-07T14:05:31.421624+0000","last_became_active":"2024-05-07T14:04:59.459490+0000","last_became_peered":"2024-05-07T14:04:59.459490+0000","last_unstale":"2024-05-07T14:05:31.421624+0000","last_undegraded":"2024-05-07T14:05:31.421624+0000","last_fullsized":"2024-05-07T14:05:31.421624+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:58:24.042272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"81'6","reported_seq":280,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959954+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:05:18.959954+0000","last_peered":"2024-05-07T14:05:18.959954+0000","last_clean":"2024-05-07T14:05:18.959954+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:05:18.959954+0000","last_undegraded":"2024-05-07T14:05:18.959954+0000","last_fullsized":"2024-05-07T14:05:18.959954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"146'52","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.534420+0000","last_change":"2024-05-07T14:00:55.978198+0000","last_active":"2024-05-07T14:05:31.534420+0000","last_peered":"2024-05-07T14:05:31.534420+0000","last_clean":"2024-05-07T14:05:31.534420+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:05:31.534420+0000","last_undegraded":"2024-05-07T14:05:31.534420+0000","last_fullsized":"2024-05-07T14:05:31.534420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:43:49.114623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"124'6","reported_seq":199,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.960492+0000","last_change":"2024-05-07T14:05:00.223495+0000","last_active":"2024-05-07T14:05:18.960492+0000","last_peered":"2024-05-07T14:05:18.960492+0000","last_clean":"2024-05-07T14:05:18.960492+0000","last_became_active":"2024-05-07T14:04:59.442569+0000","last_became_peered":"2024-05-07T14:04:59.442569+0000","last_unstale":"2024-05-07T14:05:18.960492+0000","last_undegraded":"2024-05-07T14:05:18.960492+0000","last_fullsized":"2024-05-07T14:05:18.960492+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:10.158704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"146'52","reported_seq":326,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.575677+0000","last_change":"2024-05-07T14:05:01.256475+0000","last_active":"2024-05-07T14:05:31.575677+0000","last_peered":"2024-05-07T14:05:31.575677+0000","last_clean":"2024-05-07T14:05:31.575677+0000","last_became_active":"2024-05-07T14:04:59.461335+0000","last_became_peered":"2024-05-07T14:04:59.461335+0000","last_unstale":"2024-05-07T14:05:31.575677+0000","last_undegraded":"2024-05-07T14:05:31.575677+0000","last_fullsized":"2024-05-07T14:05:31.575677+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:34.213014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"146'48","reported_seq":304,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.568295+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:05:31.568295+0000","last_peered":"2024-05-07T14:05:31.568295+0000","last_clean":"2024-05-07T14:05:31.568295+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:05:31.568295+0000","last_undegraded":"2024-05-07T14:05:31.568295+0000","last_fullsized":"2024-05-07T14:05:31.568295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:52.579475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"124'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.959984+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:05:18.959984+0000","last_peered":"2024-05-07T14:05:18.959984+0000","last_clean":"2024-05-07T14:05:18.959984+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:05:18.959984+0000","last_undegraded":"2024-05-07T14:05:18.959984+0000","last_fullsized":"2024-05-07T14:05:18.959984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:37:13.301362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"146'42","reported_seq":298,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:31.529957+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:05:31.529957+0000","last_peered":"2024-05-07T14:05:31.529957+0000","last_clean":"2024-05-07T14:05:31.529957+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:05:31.529957+0000","last_undegraded":"2024-05-07T14:05:31.529957+0000","last_fullsized":"2024-05-07T14:05:31.529957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:44:40.765638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"106'4","reported_seq":269,"reported_epoch":146,"state":"active+clean","last_fresh":"2024-05-07T14:05:18.722115+0000","last_change":"2024-05-07T14:00:57.984860+0000","last_active":"2024-05-07T14:05:18.722115+0000","last_peered":"2024-05-07T14:05:18.722115+0000","last_clean":"2024-05-07T14:05:18.722115+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:05:18.722115+0000","last_undegraded":"2024-05-07T14:05:18.722115+0000","last_fullsized":"2024-05-07T14:05:18.722115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:20:19.589882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":313,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1118,"ondisk_log_size":1118,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1062,"num_read_kb":1544,"num_write":545,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":121255,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":351,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1436,"num_read_kb":1404,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":620756992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":129,"seq":554050781193,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38172,"kb_used_data":1764,"kb_used_omap":6,"kb_used_meta":36217,"kb_avail":94333668,"statfs":{"total":96636764160,"available":96597676032,"internally_reserved":0,"allocated":1806336,"data_stored":1056833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6345,"internal_metadata":37087031},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37656,"kb_used_data":2320,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334184,"statfs":{"total":96636764160,"available":96598204416,"internally_reserved":0,"allocated":2375680,"data_stored":1646541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37240,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334600,"statfs":{"total":96636764160,"available":96598630400,"internally_reserved":0,"allocated":1826816,"data_stored":1057001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37072,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334768,"statfs":{"total":96636764160,"available":96598802432,"internally_reserved":0,"allocated":1773568,"data_stored":1056664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37736,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334104,"statfs":{"total":96636764160,"available":96598122496,"internally_reserved":0,"allocated":2396160,"data_stored":1647329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37072,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334768,"statfs":{"total":96636764160,"available":96598802432,"internally_reserved":0,"allocated":1777664,"data_stored":1056182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37108,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334732,"statfs":{"total":96636764160,"available":96598765568,"internally_reserved":0,"allocated":1806336,"data_stored":1057808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37212,"kb_used_data":1752,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334628,"statfs":{"total":96636764160,"available":96598659072,"internally_reserved":0,"allocated":1794048,"data_stored":1056686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:05:38.164 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.165 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.165 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.165 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.165 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.165 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.165 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.165 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.165 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.165 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.166 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.166 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.166 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.166 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.166 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.166 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.166 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.166 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.167 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.167 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.167 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.167 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.167 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.167 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.167 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.167 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.167 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.167 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.168 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.168 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.168 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.168 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.168 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.168 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.168 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.168 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.168 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.169 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.169 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.169 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.169 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.169 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.169 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.170 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.170 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.170 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.170 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.170 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.170 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.170 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.170 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.170 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.171 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.171 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.171 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.171 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.171 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.171 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.171 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.171 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.171 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.172 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.172 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.172 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.172 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.172 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.172 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.172 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.172 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.172 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.172 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.173 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.173 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.173 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.173 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.173 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.173 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.173 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.173 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.173 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.174 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.174 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.174 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.174 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.174 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.174 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.174 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.174 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.174 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.175 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.175 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.175 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.175 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.175 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.175 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.175 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.175 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.175 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.176 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.176 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.176 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.176 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-07T14:00:43.807655+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.176 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-07T14:00:48.897311+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=48, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.176 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.176 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.176 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.176 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.176 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.177 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.177 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-07T14:00:48.897311+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=48, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.177 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.177 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.177 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.177 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.177 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.177 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.177 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-07T14:00:48.897311+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=48, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.178 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.178 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.178 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.178 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.178 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.178 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.178 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-07T14:00:48.897311+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=48, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.178 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.178 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.179 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.179 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.179 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.179 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.179 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.179 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-07T14:00:48.897311+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=48, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.179 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.179 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.179 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.180 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.180 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.180 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.180 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-07T14:00:48.897311+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=48, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.180 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.180 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.180 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.180 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.180 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.181 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.181 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-07T14:00:48.897311+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=48, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.181 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.181 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.181 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.181 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.181 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.181 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.181 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-07T14:00:48.897311+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=48, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.182 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.182 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.182 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.182 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.182 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.182 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.182 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.182 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.182 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.183 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.183 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.183 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.183 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.183 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.183 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.183 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.183 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.183 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.184 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.184 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.184 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.184 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.184 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.184 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.184 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.184 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.184 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.185 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.185 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.185 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.185 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.185 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.185 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.185 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.185 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.185 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.186 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.186 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.186 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.186 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.186 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.186 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.186 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.186 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.186 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.187 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.187 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.187 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.187 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.187 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.187 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.187 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.187 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.187 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.188 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.188 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.188 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.188 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.188 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.188 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.188 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.188 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.188 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.189 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.189 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.189 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.189 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.189 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.189 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.189 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.189 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.189 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.190 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.190 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.190 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.190 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.190 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.190 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.190 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.190 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.190 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.191 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.191 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.191 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.191 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.191 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.191 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.191 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.191 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.191 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.192 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.192 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.192 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.192 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.192 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.192 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.192 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.192 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.192 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.193 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.193 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.193 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.193 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.193 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.193 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.193 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.193 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.193 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.194 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.194 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.194 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.194 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:38.194 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-07T14:05:58.195 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:05:58.552 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:05:58.558 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:05:58.572 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-05-07T14:05:57.340568+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":623988,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4834,"num_read_kb":3736,"num_write":4429,"num_write_kb":6187921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":621470484,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5538,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5644,"ondisk_log_size":5644,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":298968,"kb_used_data":15384,"kb_used_omap":17,"kb_used_meta":283502,"kb_avail":754675752,"statfs":{"total":773094113280,"available":772787970048,"internally_reserved":0,"allocated":15753216,"data_stored":9762172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17505,"internal_metadata":290306975},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5538,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005904"},"pg_stats":[{"pgid":"3.3f","version":"146'58","reported_seq":315,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.843806+0000","last_change":"2024-05-07T14:05:02.012333+0000","last_active":"2024-05-07T14:05:38.843806+0000","last_peered":"2024-05-07T14:05:38.843806+0000","last_clean":"2024-05-07T14:05:38.843806+0000","last_became_active":"2024-05-07T14:04:59.458324+0000","last_became_peered":"2024-05-07T14:04:59.458324+0000","last_unstale":"2024-05-07T14:05:38.843806+0000","last_undegraded":"2024-05-07T14:05:38.843806+0000","last_fullsized":"2024-05-07T14:05:38.843806+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'2","reported_seq":274,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.754705+0000","last_change":"2024-05-07T14:05:46.754782+0000","last_active":"2024-05-07T14:05:46.754705+0000","last_peered":"2024-05-07T14:05:46.754705+0000","last_clean":"2024-05-07T14:05:46.754705+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:05:46.754705+0000","last_undegraded":"2024-05-07T14:05:46.754705+0000","last_fullsized":"2024-05-07T14:05:46.754705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:05:46.754495+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:05:46.754495+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.754495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:36.485364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"146'58","reported_seq":168,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.443427+0000","last_change":"2024-05-07T14:03:39.850495+0000","last_active":"2024-05-07T14:05:38.443427+0000","last_peered":"2024-05-07T14:05:38.443427+0000","last_clean":"2024-05-07T14:05:38.443427+0000","last_became_active":"2024-05-07T14:03:39.676092+0000","last_became_peered":"2024-05-07T14:03:39.676092+0000","last_unstale":"2024-05-07T14:05:38.443427+0000","last_undegraded":"2024-05-07T14:05:38.443427+0000","last_fullsized":"2024-05-07T14:05:38.443427+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"80'2","reported_seq":177,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.842708+0000","last_change":"2024-05-07T14:04:59.442787+0000","last_active":"2024-05-07T14:05:38.842708+0000","last_peered":"2024-05-07T14:05:38.842708+0000","last_clean":"2024-05-07T14:05:38.842708+0000","last_became_active":"2024-05-07T14:04:59.430479+0000","last_became_peered":"2024-05-07T14:04:59.430479+0000","last_unstale":"2024-05-07T14:05:38.842708+0000","last_undegraded":"2024-05-07T14:05:38.842708+0000","last_fullsized":"2024-05-07T14:05:38.842708+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"146'40","reported_seq":303,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817771+0000","last_change":"2024-05-07T14:00:55.967946+0000","last_active":"2024-05-07T14:05:38.817771+0000","last_peered":"2024-05-07T14:05:38.817771+0000","last_clean":"2024-05-07T14:05:38.817771+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:05:38.817771+0000","last_undegraded":"2024-05-07T14:05:38.817771+0000","last_fullsized":"2024-05-07T14:05:38.817771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'2","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.574489+0000","last_change":"2024-05-07T14:05:41.574550+0000","last_active":"2024-05-07T14:05:41.574489+0000","last_peered":"2024-05-07T14:05:41.574489+0000","last_clean":"2024-05-07T14:05:41.574489+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:05:41.574489+0000","last_undegraded":"2024-05-07T14:05:41.574489+0000","last_fullsized":"2024-05-07T14:05:41.574489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:05:41.574288+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:05:41.574288+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.574288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:37.366593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"146'50","reported_seq":312,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620921+0000","last_change":"2024-05-07T14:00:56.012308+0000","last_active":"2024-05-07T14:05:38.620921+0000","last_peered":"2024-05-07T14:05:38.620921+0000","last_clean":"2024-05-07T14:05:38.620921+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:05:38.620921+0000","last_undegraded":"2024-05-07T14:05:38.620921+0000","last_fullsized":"2024-05-07T14:05:38.620921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"81'2","reported_seq":267,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817752+0000","last_change":"2024-05-07T14:00:57.992705+0000","last_active":"2024-05-07T14:05:38.817752+0000","last_peered":"2024-05-07T14:05:38.817752+0000","last_clean":"2024-05-07T14:05:38.817752+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:05:38.817752+0000","last_undegraded":"2024-05-07T14:05:38.817752+0000","last_fullsized":"2024-05-07T14:05:38.817752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"146'48","reported_seq":301,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.842412+0000","last_change":"2024-05-07T14:05:01.033639+0000","last_active":"2024-05-07T14:05:38.842412+0000","last_peered":"2024-05-07T14:05:38.842412+0000","last_clean":"2024-05-07T14:05:38.842412+0000","last_became_active":"2024-05-07T14:04:59.455288+0000","last_became_peered":"2024-05-07T14:04:59.455288+0000","last_unstale":"2024-05-07T14:05:38.842412+0000","last_undegraded":"2024-05-07T14:05:38.842412+0000","last_fullsized":"2024-05-07T14:05:38.842412+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"115'4","reported_seq":274,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.481236+0000","last_change":"2024-05-07T14:00:57.986102+0000","last_active":"2024-05-07T14:05:38.481236+0000","last_peered":"2024-05-07T14:05:38.481236+0000","last_clean":"2024-05-07T14:05:38.481236+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:05:38.481236+0000","last_undegraded":"2024-05-07T14:05:38.481236+0000","last_fullsized":"2024-05-07T14:05:38.481236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"146'38","reported_seq":299,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620398+0000","last_change":"2024-05-07T14:00:56.006198+0000","last_active":"2024-05-07T14:05:38.620398+0000","last_peered":"2024-05-07T14:05:38.620398+0000","last_clean":"2024-05-07T14:05:38.620398+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:05:38.620398+0000","last_undegraded":"2024-05-07T14:05:38.620398+0000","last_fullsized":"2024-05-07T14:05:38.620398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"115'4","reported_seq":285,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.714859+0000","last_change":"2024-05-07T14:05:50.714975+0000","last_active":"2024-05-07T14:05:50.714859+0000","last_peered":"2024-05-07T14:05:50.714859+0000","last_clean":"2024-05-07T14:05:50.714859+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:05:50.714859+0000","last_undegraded":"2024-05-07T14:05:50.714859+0000","last_fullsized":"2024-05-07T14:05:50.714859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'4","last_scrub_stamp":"2024-05-07T14:05:50.714550+0000","last_deep_scrub":"115'4","last_deep_scrub_stamp":"2024-05-07T14:05:50.714550+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.714550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:35.945284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"146'50","reported_seq":312,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.052088+0000","last_change":"2024-05-07T14:05:51.052149+0000","last_active":"2024-05-07T14:05:51.052088+0000","last_peered":"2024-05-07T14:05:51.052088+0000","last_clean":"2024-05-07T14:05:51.052088+0000","last_became_active":"2024-05-07T14:04:59.444214+0000","last_became_peered":"2024-05-07T14:04:59.444214+0000","last_unstale":"2024-05-07T14:05:51.052088+0000","last_undegraded":"2024-05-07T14:05:51.052088+0000","last_fullsized":"2024-05-07T14:05:51.052088+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'50","last_scrub_stamp":"2024-05-07T14:05:51.051888+0000","last_deep_scrub":"146'50","last_deep_scrub_stamp":"2024-05-07T14:05:51.051888+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.051888+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:56:42.668989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"81'2","reported_seq":274,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.774289+0000","last_change":"2024-05-07T14:05:48.774351+0000","last_active":"2024-05-07T14:05:48.774289+0000","last_peered":"2024-05-07T14:05:48.774289+0000","last_clean":"2024-05-07T14:05:48.774289+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:05:48.774289+0000","last_undegraded":"2024-05-07T14:05:48.774289+0000","last_fullsized":"2024-05-07T14:05:48.774289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:05:48.774054+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:05:48.774054+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.774054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:12.303840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"146'46","reported_seq":308,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.431609+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:05:38.431609+0000","last_peered":"2024-05-07T14:05:38.431609+0000","last_clean":"2024-05-07T14:05:38.431609+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:05:38.431609+0000","last_undegraded":"2024-05-07T14:05:38.431609+0000","last_fullsized":"2024-05-07T14:05:38.431609+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"124'4","reported_seq":282,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.891811+0000","last_change":"2024-05-07T14:05:42.891878+0000","last_active":"2024-05-07T14:05:42.891811+0000","last_peered":"2024-05-07T14:05:42.891811+0000","last_clean":"2024-05-07T14:05:42.891811+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:05:42.891811+0000","last_undegraded":"2024-05-07T14:05:42.891811+0000","last_fullsized":"2024-05-07T14:05:42.891811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'4","last_scrub_stamp":"2024-05-07T14:05:42.891601+0000","last_deep_scrub":"124'4","last_deep_scrub_stamp":"2024-05-07T14:05:42.891601+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.891601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:55:14.857156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2","reported_seq":277,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.591369+0000","last_change":"2024-05-07T14:05:43.591429+0000","last_active":"2024-05-07T14:05:43.591369+0000","last_peered":"2024-05-07T14:05:43.591369+0000","last_clean":"2024-05-07T14:05:43.591369+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:05:43.591369+0000","last_undegraded":"2024-05-07T14:05:43.591369+0000","last_fullsized":"2024-05-07T14:05:43.591369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:05:43.591140+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:05:43.591140+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.591140+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:24:48.976262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"146'46","reported_seq":297,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.843782+0000","last_change":"2024-05-07T14:05:01.245123+0000","last_active":"2024-05-07T14:05:38.843782+0000","last_peered":"2024-05-07T14:05:38.843782+0000","last_clean":"2024-05-07T14:05:38.843782+0000","last_became_active":"2024-05-07T14:04:59.452315+0000","last_became_peered":"2024-05-07T14:04:59.452315+0000","last_unstale":"2024-05-07T14:05:38.843782+0000","last_undegraded":"2024-05-07T14:05:38.843782+0000","last_fullsized":"2024-05-07T14:05:38.843782+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":222,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.842147+0000","last_change":"2024-05-07T14:04:59.435447+0000","last_active":"2024-05-07T14:05:38.842147+0000","last_peered":"2024-05-07T14:05:38.842147+0000","last_clean":"2024-05-07T14:05:38.842147+0000","last_became_active":"2024-05-07T14:04:59.429254+0000","last_became_peered":"2024-05-07T14:04:59.429254+0000","last_unstale":"2024-05-07T14:05:38.842147+0000","last_undegraded":"2024-05-07T14:05:38.842147+0000","last_fullsized":"2024-05-07T14:05:38.842147+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"146'46","reported_seq":316,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.458093+0000","last_change":"2024-05-07T14:05:52.458159+0000","last_active":"2024-05-07T14:05:52.458093+0000","last_peered":"2024-05-07T14:05:52.458093+0000","last_clean":"2024-05-07T14:05:52.458093+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:05:52.458093+0000","last_undegraded":"2024-05-07T14:05:52.458093+0000","last_fullsized":"2024-05-07T14:05:52.458093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:05:52.457878+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:05:52.457878+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.457878+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:31.728642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":258,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620690+0000","last_change":"2024-05-07T14:00:57.977448+0000","last_active":"2024-05-07T14:05:38.620690+0000","last_peered":"2024-05-07T14:05:38.620690+0000","last_clean":"2024-05-07T14:05:38.620690+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:05:38.620690+0000","last_undegraded":"2024-05-07T14:05:38.620690+0000","last_fullsized":"2024-05-07T14:05:38.620690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"146'62","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.503780+0000","last_change":"2024-05-07T14:05:51.503907+0000","last_active":"2024-05-07T14:05:51.503780+0000","last_peered":"2024-05-07T14:05:51.503780+0000","last_clean":"2024-05-07T14:05:51.503780+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:05:51.503780+0000","last_undegraded":"2024-05-07T14:05:51.503780+0000","last_fullsized":"2024-05-07T14:05:51.503780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'62","last_scrub_stamp":"2024-05-07T14:05:51.503543+0000","last_deep_scrub":"146'62","last_deep_scrub_stamp":"2024-05-07T14:05:51.503543+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.503543+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:22.820463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"124'10","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.920441+0000","last_change":"2024-05-07T14:05:51.920505+0000","last_active":"2024-05-07T14:05:51.920441+0000","last_peered":"2024-05-07T14:05:51.920441+0000","last_clean":"2024-05-07T14:05:51.920441+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:05:51.920441+0000","last_undegraded":"2024-05-07T14:05:51.920441+0000","last_fullsized":"2024-05-07T14:05:51.920441+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'10","last_scrub_stamp":"2024-05-07T14:05:51.919944+0000","last_deep_scrub":"124'10","last_deep_scrub_stamp":"2024-05-07T14:05:51.919944+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.919944+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:21.369904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"146'54","reported_seq":318,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.427783+0000","last_change":"2024-05-07T14:00:55.987844+0000","last_active":"2024-05-07T14:05:38.427783+0000","last_peered":"2024-05-07T14:05:38.427783+0000","last_clean":"2024-05-07T14:05:38.427783+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:05:38.427783+0000","last_undegraded":"2024-05-07T14:05:38.427783+0000","last_fullsized":"2024-05-07T14:05:38.427783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"106'8","reported_seq":286,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.934186+0000","last_change":"2024-05-07T14:05:44.934186+0000","last_active":"2024-05-07T14:05:44.934186+0000","last_peered":"2024-05-07T14:05:44.934186+0000","last_clean":"2024-05-07T14:05:44.934186+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:05:44.934186+0000","last_undegraded":"2024-05-07T14:05:44.934186+0000","last_fullsized":"2024-05-07T14:05:44.934186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'8","last_scrub_stamp":"2024-05-07T14:05:44.933739+0000","last_deep_scrub":"106'8","last_deep_scrub_stamp":"2024-05-07T14:05:44.933739+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.933739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:16:10.865536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"146'64","reported_seq":327,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.433157+0000","last_change":"2024-05-07T14:00:55.975633+0000","last_active":"2024-05-07T14:05:38.433157+0000","last_peered":"2024-05-07T14:05:38.433157+0000","last_clean":"2024-05-07T14:05:38.433157+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:05:38.433157+0000","last_undegraded":"2024-05-07T14:05:38.433157+0000","last_fullsized":"2024-05-07T14:05:38.433157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"106'2","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.428073+0000","last_change":"2024-05-07T14:03:39.848413+0000","last_active":"2024-05-07T14:05:38.428073+0000","last_peered":"2024-05-07T14:05:38.428073+0000","last_clean":"2024-05-07T14:05:38.428073+0000","last_became_active":"2024-05-07T14:03:39.663590+0000","last_became_peered":"2024-05-07T14:03:39.663590+0000","last_unstale":"2024-05-07T14:05:38.428073+0000","last_undegraded":"2024-05-07T14:05:38.428073+0000","last_fullsized":"2024-05-07T14:05:38.428073+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"146'38","reported_seq":301,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817275+0000","last_change":"2024-05-07T14:00:55.969567+0000","last_active":"2024-05-07T14:05:38.817275+0000","last_peered":"2024-05-07T14:05:38.817275+0000","last_clean":"2024-05-07T14:05:38.817275+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:05:38.817275+0000","last_undegraded":"2024-05-07T14:05:38.817275+0000","last_fullsized":"2024-05-07T14:05:38.817275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":243,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426043+0000","last_change":"2024-05-07T14:01:06.010956+0000","last_active":"2024-05-07T14:05:38.426043+0000","last_peered":"2024-05-07T14:05:38.426043+0000","last_clean":"2024-05-07T14:05:38.426043+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:05:38.426043+0000","last_undegraded":"2024-05-07T14:05:38.426043+0000","last_fullsized":"2024-05-07T14:05:38.426043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"81'2","reported_seq":302,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.488541+0000","last_change":"2024-05-07T14:05:39.488599+0000","last_active":"2024-05-07T14:05:39.488541+0000","last_peered":"2024-05-07T14:05:39.488541+0000","last_clean":"2024-05-07T14:05:39.488541+0000","last_became_active":"2024-05-07T14:05:38.439123+0000","last_became_peered":"2024-05-07T14:05:38.439123+0000","last_unstale":"2024-05-07T14:05:39.488541+0000","last_undegraded":"2024-05-07T14:05:39.488541+0000","last_fullsized":"2024-05-07T14:05:39.488541+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:05:39.488348+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:05:39.488348+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.488348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:20:26.483034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"146'38","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.894987+0000","last_change":"2024-05-07T14:05:48.895102+0000","last_active":"2024-05-07T14:05:48.894987+0000","last_peered":"2024-05-07T14:05:48.894987+0000","last_clean":"2024-05-07T14:05:48.894987+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:05:48.894987+0000","last_undegraded":"2024-05-07T14:05:48.894987+0000","last_fullsized":"2024-05-07T14:05:48.894987+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'38","last_scrub_stamp":"2024-05-07T14:05:48.894689+0000","last_deep_scrub":"146'38","last_deep_scrub_stamp":"2024-05-07T14:05:48.894689+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.894689+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:38:49.851294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.749510+0000","last_change":"2024-05-07T14:05:47.749510+0000","last_active":"2024-05-07T14:05:47.749510+0000","last_peered":"2024-05-07T14:05:47.749510+0000","last_clean":"2024-05-07T14:05:47.749510+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:05:47.749510+0000","last_undegraded":"2024-05-07T14:05:47.749510+0000","last_fullsized":"2024-05-07T14:05:47.749510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:47.749269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:47.749269+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.749269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:48.516892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"146'20","reported_seq":290,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817937+0000","last_change":"2024-05-07T14:04:59.457299+0000","last_active":"2024-05-07T14:05:38.817937+0000","last_peered":"2024-05-07T14:05:38.817937+0000","last_clean":"2024-05-07T14:05:38.817937+0000","last_became_active":"2024-05-07T14:04:59.455429+0000","last_became_peered":"2024-05-07T14:04:59.455429+0000","last_unstale":"2024-05-07T14:05:38.817937+0000","last_undegraded":"2024-05-07T14:05:38.817937+0000","last_fullsized":"2024-05-07T14:05:38.817937+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.998040+0000","last_change":"2024-05-07T14:05:39.998091+0000","last_active":"2024-05-07T14:05:39.998040+0000","last_peered":"2024-05-07T14:05:39.998040+0000","last_clean":"2024-05-07T14:05:39.998040+0000","last_became_active":"2024-05-07T14:04:59.456374+0000","last_became_peered":"2024-05-07T14:04:59.456374+0000","last_unstale":"2024-05-07T14:05:39.998040+0000","last_undegraded":"2024-05-07T14:05:39.998040+0000","last_fullsized":"2024-05-07T14:05:39.998040+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:39.997849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:39.997849+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.997849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:36.795773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"148'51","reported_seq":321,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.680590+0000","last_change":"2024-05-07T14:05:42.680748+0000","last_active":"2024-05-07T14:05:42.680590+0000","last_peered":"2024-05-07T14:05:42.680590+0000","last_clean":"2024-05-07T14:05:42.680590+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:05:42.680590+0000","last_undegraded":"2024-05-07T14:05:42.680590+0000","last_fullsized":"2024-05-07T14:05:42.680590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'51","last_scrub_stamp":"2024-05-07T14:05:42.680364+0000","last_deep_scrub":"148'51","last_deep_scrub_stamp":"2024-05-07T14:05:42.680364+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.680364+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:36:42.767270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"81'6","reported_seq":289,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.622069+0000","last_change":"2024-05-07T14:04:59.467076+0000","last_active":"2024-05-07T14:05:38.622069+0000","last_peered":"2024-05-07T14:05:38.622069+0000","last_clean":"2024-05-07T14:05:38.622069+0000","last_became_active":"2024-05-07T14:04:59.466480+0000","last_became_peered":"2024-05-07T14:04:59.466480+0000","last_unstale":"2024-05-07T14:05:38.622069+0000","last_undegraded":"2024-05-07T14:05:38.622069+0000","last_fullsized":"2024-05-07T14:05:38.622069+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"146'40","reported_seq":327,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817362+0000","last_change":"2024-05-07T14:05:00.106363+0000","last_active":"2024-05-07T14:05:38.817362+0000","last_peered":"2024-05-07T14:05:38.817362+0000","last_clean":"2024-05-07T14:05:38.817362+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:38.817362+0000","last_undegraded":"2024-05-07T14:05:38.817362+0000","last_fullsized":"2024-05-07T14:05:38.817362+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":270,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.484711+0000","last_change":"2024-05-07T14:05:45.484764+0000","last_active":"2024-05-07T14:05:45.484711+0000","last_peered":"2024-05-07T14:05:45.484711+0000","last_clean":"2024-05-07T14:05:45.484711+0000","last_became_active":"2024-05-07T14:04:59.445994+0000","last_became_peered":"2024-05-07T14:04:59.445994+0000","last_unstale":"2024-05-07T14:05:45.484711+0000","last_undegraded":"2024-05-07T14:05:45.484711+0000","last_fullsized":"2024-05-07T14:05:45.484711+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:45.484518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:45.484518+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.484518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:36:45.571424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"81'7","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.428375+0000","last_change":"2024-05-07T14:01:01.996728+0000","last_active":"2024-05-07T14:05:38.428375+0000","last_peered":"2024-05-07T14:05:38.428375+0000","last_clean":"2024-05-07T14:05:38.428375+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:05:38.428375+0000","last_undegraded":"2024-05-07T14:05:38.428375+0000","last_fullsized":"2024-05-07T14:05:38.428375+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.427914+0000","last_change":"2024-05-07T14:05:37.597661+0000","last_active":"2024-05-07T14:05:38.427914+0000","last_peered":"2024-05-07T14:05:38.427914+0000","last_clean":"2024-05-07T14:05:38.427914+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:05:38.427914+0000","last_undegraded":"2024-05-07T14:05:38.427914+0000","last_fullsized":"2024-05-07T14:05:38.427914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.597397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.597397+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.597397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:07.047357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"115'8","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.855990+0000","last_change":"2024-05-07T14:05:40.856052+0000","last_active":"2024-05-07T14:05:40.855990+0000","last_peered":"2024-05-07T14:05:40.855990+0000","last_clean":"2024-05-07T14:05:40.855990+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:05:40.855990+0000","last_undegraded":"2024-05-07T14:05:40.855990+0000","last_fullsized":"2024-05-07T14:05:40.855990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'8","last_scrub_stamp":"2024-05-07T14:05:40.855774+0000","last_deep_scrub":"115'8","last_deep_scrub_stamp":"2024-05-07T14:05:40.855774+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.855774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:55.295194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"81'4","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.819753+0000","last_change":"2024-05-07T14:00:57.981285+0000","last_active":"2024-05-07T14:05:38.819753+0000","last_peered":"2024-05-07T14:05:38.819753+0000","last_clean":"2024-05-07T14:05:38.819753+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:05:38.819753+0000","last_undegraded":"2024-05-07T14:05:38.819753+0000","last_fullsized":"2024-05-07T14:05:38.819753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"146'32","reported_seq":288,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.027629+0000","last_change":"2024-05-07T14:05:47.027693+0000","last_active":"2024-05-07T14:05:47.027629+0000","last_peered":"2024-05-07T14:05:47.027629+0000","last_clean":"2024-05-07T14:05:47.027629+0000","last_became_active":"2024-05-07T14:04:59.436710+0000","last_became_peered":"2024-05-07T14:04:59.436710+0000","last_unstale":"2024-05-07T14:05:47.027629+0000","last_undegraded":"2024-05-07T14:05:47.027629+0000","last_fullsized":"2024-05-07T14:05:47.027629+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'32","last_scrub_stamp":"2024-05-07T14:05:47.027424+0000","last_deep_scrub":"146'32","last_deep_scrub_stamp":"2024-05-07T14:05:47.027424+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.027424+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:00.845074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":273,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.460794+0000","last_change":"2024-05-07T14:05:46.460794+0000","last_active":"2024-05-07T14:05:46.460794+0000","last_peered":"2024-05-07T14:05:46.460794+0000","last_clean":"2024-05-07T14:05:46.460794+0000","last_became_active":"2024-05-07T14:03:39.680482+0000","last_became_peered":"2024-05-07T14:03:39.680482+0000","last_unstale":"2024-05-07T14:05:46.460794+0000","last_undegraded":"2024-05-07T14:05:46.460794+0000","last_fullsized":"2024-05-07T14:05:46.460794+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:46.460537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:46.460537+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.460537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:48:46.840513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"146'18","reported_seq":280,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426015+0000","last_change":"2024-05-07T14:05:36.059934+0000","last_active":"2024-05-07T14:05:38.426015+0000","last_peered":"2024-05-07T14:05:38.426015+0000","last_clean":"2024-05-07T14:05:38.426015+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:05:38.426015+0000","last_undegraded":"2024-05-07T14:05:38.426015+0000","last_fullsized":"2024-05-07T14:05:38.426015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'18","last_scrub_stamp":"2024-05-07T14:05:36.059800+0000","last_deep_scrub":"146'18","last_deep_scrub_stamp":"2024-05-07T14:05:36.059800+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.059800+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:08:00.724380+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"146'144","reported_seq":421,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.843857+0000","last_change":"2024-05-07T14:05:02.234601+0000","last_active":"2024-05-07T14:05:38.843857+0000","last_peered":"2024-05-07T14:05:38.843857+0000","last_clean":"2024-05-07T14:05:38.843857+0000","last_became_active":"2024-05-07T14:04:59.463533+0000","last_became_peered":"2024-05-07T14:04:59.463533+0000","last_unstale":"2024-05-07T14:05:38.843857+0000","last_undegraded":"2024-05-07T14:05:38.843857+0000","last_fullsized":"2024-05-07T14:05:38.843857+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":243,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.427145+0000","last_change":"2024-05-07T14:01:06.367852+0000","last_active":"2024-05-07T14:05:38.427145+0000","last_peered":"2024-05-07T14:05:38.427145+0000","last_clean":"2024-05-07T14:05:38.427145+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:05:38.427145+0000","last_undegraded":"2024-05-07T14:05:38.427145+0000","last_fullsized":"2024-05-07T14:05:38.427145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"87'16","reported_seq":309,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.436718+0000","last_change":"2024-05-07T14:04:59.462968+0000","last_active":"2024-05-07T14:05:38.436718+0000","last_peered":"2024-05-07T14:05:38.436718+0000","last_clean":"2024-05-07T14:05:38.436718+0000","last_became_active":"2024-05-07T14:04:59.461575+0000","last_became_peered":"2024-05-07T14:04:59.461575+0000","last_unstale":"2024-05-07T14:05:38.436718+0000","last_undegraded":"2024-05-07T14:05:38.436718+0000","last_fullsized":"2024-05-07T14:05:38.436718+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"146'52","reported_seq":322,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.480149+0000","last_change":"2024-05-07T14:05:47.480262+0000","last_active":"2024-05-07T14:05:47.480149+0000","last_peered":"2024-05-07T14:05:47.480149+0000","last_clean":"2024-05-07T14:05:47.480149+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:05:47.480149+0000","last_undegraded":"2024-05-07T14:05:47.480149+0000","last_fullsized":"2024-05-07T14:05:47.480149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'52","last_scrub_stamp":"2024-05-07T14:05:47.479956+0000","last_deep_scrub":"146'52","last_deep_scrub_stamp":"2024-05-07T14:05:47.479956+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.479956+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:33:52.588231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.661760+0000","last_change":"2024-05-07T14:05:43.661760+0000","last_active":"2024-05-07T14:05:43.661760+0000","last_peered":"2024-05-07T14:05:43.661760+0000","last_clean":"2024-05-07T14:05:43.661760+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:05:43.661760+0000","last_undegraded":"2024-05-07T14:05:43.661760+0000","last_fullsized":"2024-05-07T14:05:43.661760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:43.661509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:43.661509+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.661509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:48:44.041486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"148'23","reported_seq":272,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.982444+0000","last_change":"2024-05-07T14:05:40.982516+0000","last_active":"2024-05-07T14:05:40.982444+0000","last_peered":"2024-05-07T14:05:40.982444+0000","last_clean":"2024-05-07T14:05:40.982444+0000","last_became_active":"2024-05-07T14:04:59.459905+0000","last_became_peered":"2024-05-07T14:04:59.459905+0000","last_unstale":"2024-05-07T14:05:40.982444+0000","last_undegraded":"2024-05-07T14:05:40.982444+0000","last_fullsized":"2024-05-07T14:05:40.982444+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'23","last_scrub_stamp":"2024-05-07T14:05:40.982249+0000","last_deep_scrub":"148'23","last_deep_scrub_stamp":"2024-05-07T14:05:40.982249+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.982249+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:22:06.341816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"146'138","reported_seq":437,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.435410+0000","last_change":"2024-05-07T14:01:04.023414+0000","last_active":"2024-05-07T14:05:38.435410+0000","last_peered":"2024-05-07T14:05:38.435410+0000","last_clean":"2024-05-07T14:05:38.435410+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:05:38.435410+0000","last_undegraded":"2024-05-07T14:05:38.435410+0000","last_fullsized":"2024-05-07T14:05:38.435410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"81'4","reported_seq":290,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.632057+0000","last_change":"2024-05-07T14:05:41.632117+0000","last_active":"2024-05-07T14:05:41.632057+0000","last_peered":"2024-05-07T14:05:41.632057+0000","last_clean":"2024-05-07T14:05:41.632057+0000","last_became_active":"2024-05-07T14:04:59.446891+0000","last_became_peered":"2024-05-07T14:04:59.446891+0000","last_unstale":"2024-05-07T14:05:41.632057+0000","last_undegraded":"2024-05-07T14:05:41.632057+0000","last_fullsized":"2024-05-07T14:05:41.632057+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-05-07T14:05:41.631851+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-05-07T14:05:41.631851+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.631851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:17:36.333634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"146'66","reported_seq":324,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.844125+0000","last_change":"2024-05-07T14:05:01.651799+0000","last_active":"2024-05-07T14:05:38.844125+0000","last_peered":"2024-05-07T14:05:38.844125+0000","last_clean":"2024-05-07T14:05:38.844125+0000","last_became_active":"2024-05-07T14:04:59.452426+0000","last_became_peered":"2024-05-07T14:04:59.452426+0000","last_unstale":"2024-05-07T14:05:38.844125+0000","last_undegraded":"2024-05-07T14:05:38.844125+0000","last_fullsized":"2024-05-07T14:05:38.844125+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":222,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.843304+0000","last_change":"2024-05-07T14:04:59.445984+0000","last_active":"2024-05-07T14:05:38.843304+0000","last_peered":"2024-05-07T14:05:38.843304+0000","last_clean":"2024-05-07T14:05:38.843304+0000","last_became_active":"2024-05-07T14:04:59.445281+0000","last_became_peered":"2024-05-07T14:04:59.445281+0000","last_unstale":"2024-05-07T14:05:38.843304+0000","last_undegraded":"2024-05-07T14:05:38.843304+0000","last_fullsized":"2024-05-07T14:05:38.843304+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"146'31","reported_seq":297,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.619844+0000","last_change":"2024-05-07T14:01:02.147355+0000","last_active":"2024-05-07T14:05:38.619844+0000","last_peered":"2024-05-07T14:05:38.619844+0000","last_clean":"2024-05-07T14:05:38.619844+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:05:38.619844+0000","last_undegraded":"2024-05-07T14:05:38.619844+0000","last_fullsized":"2024-05-07T14:05:38.619844+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":113,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.441688+0000","last_change":"2024-05-07T14:05:35.125928+0000","last_active":"2024-05-07T14:05:38.441688+0000","last_peered":"2024-05-07T14:05:38.441688+0000","last_clean":"2024-05-07T14:05:38.441688+0000","last_became_active":"2024-05-07T14:03:39.666160+0000","last_became_peered":"2024-05-07T14:03:39.666160+0000","last_unstale":"2024-05-07T14:05:38.441688+0000","last_undegraded":"2024-05-07T14:05:38.441688+0000","last_fullsized":"2024-05-07T14:05:38.441688+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:35.125820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:35.125820+0000","last_clean_scrub_stamp":"2024-05-07T14:05:35.125820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:29:32.617948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":250,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.659495+0000","last_change":"2024-05-07T14:05:40.659600+0000","last_active":"2024-05-07T14:05:40.659495+0000","last_peered":"2024-05-07T14:05:40.659495+0000","last_clean":"2024-05-07T14:05:40.659495+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:05:40.659495+0000","last_undegraded":"2024-05-07T14:05:40.659495+0000","last_fullsized":"2024-05-07T14:05:40.659495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:40.659258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:40.659258+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.659258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:13:49.643039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":260,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426590+0000","last_change":"2024-05-07T14:00:58.001773+0000","last_active":"2024-05-07T14:05:38.426590+0000","last_peered":"2024-05-07T14:05:38.426590+0000","last_clean":"2024-05-07T14:05:38.426590+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:05:38.426590+0000","last_undegraded":"2024-05-07T14:05:38.426590+0000","last_fullsized":"2024-05-07T14:05:38.426590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"146'54","reported_seq":317,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.999034+0000","last_change":"2024-05-07T14:05:44.999096+0000","last_active":"2024-05-07T14:05:44.999034+0000","last_peered":"2024-05-07T14:05:44.999034+0000","last_clean":"2024-05-07T14:05:44.999034+0000","last_became_active":"2024-05-07T14:04:59.421863+0000","last_became_peered":"2024-05-07T14:04:59.421863+0000","last_unstale":"2024-05-07T14:05:44.999034+0000","last_undegraded":"2024-05-07T14:05:44.999034+0000","last_fullsized":"2024-05-07T14:05:44.999034+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:05:44.998813+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:05:44.998813+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.998813+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:11.327557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"148'2","reported_seq":354,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.892612+0000","last_change":"2024-05-07T14:05:45.892680+0000","last_active":"2024-05-07T14:05:45.892612+0000","last_peered":"2024-05-07T14:05:45.892612+0000","last_clean":"2024-05-07T14:05:45.892612+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:05:45.892612+0000","last_undegraded":"2024-05-07T14:05:45.892612+0000","last_fullsized":"2024-05-07T14:05:45.892612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'2","last_scrub_stamp":"2024-05-07T14:05:45.892424+0000","last_deep_scrub":"148'2","last_deep_scrub_stamp":"2024-05-07T14:05:45.892424+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.892424+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:16:45.413388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"146'20","reported_seq":290,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.433715+0000","last_change":"2024-05-07T14:04:59.447540+0000","last_active":"2024-05-07T14:05:38.433715+0000","last_peered":"2024-05-07T14:05:38.433715+0000","last_clean":"2024-05-07T14:05:38.433715+0000","last_became_active":"2024-05-07T14:04:59.446737+0000","last_became_peered":"2024-05-07T14:04:59.446737+0000","last_unstale":"2024-05-07T14:05:38.433715+0000","last_undegraded":"2024-05-07T14:05:38.433715+0000","last_fullsized":"2024-05-07T14:05:38.433715+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":247,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.431961+0000","last_change":"2024-05-07T14:01:04.027508+0000","last_active":"2024-05-07T14:05:38.431961+0000","last_peered":"2024-05-07T14:05:38.431961+0000","last_clean":"2024-05-07T14:05:38.431961+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:05:38.431961+0000","last_undegraded":"2024-05-07T14:05:38.431961+0000","last_fullsized":"2024-05-07T14:05:38.431961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"115'4","reported_seq":248,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.481245+0000","last_change":"2024-05-07T14:01:06.026604+0000","last_active":"2024-05-07T14:05:38.481245+0000","last_peered":"2024-05-07T14:05:38.481245+0000","last_clean":"2024-05-07T14:05:38.481245+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:05:38.481245+0000","last_undegraded":"2024-05-07T14:05:38.481245+0000","last_fullsized":"2024-05-07T14:05:38.481245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"81'6","reported_seq":292,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.495700+0000","last_change":"2024-05-07T14:05:46.495767+0000","last_active":"2024-05-07T14:05:46.495700+0000","last_peered":"2024-05-07T14:05:46.495700+0000","last_clean":"2024-05-07T14:05:46.495700+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:05:46.495700+0000","last_undegraded":"2024-05-07T14:05:46.495700+0000","last_fullsized":"2024-05-07T14:05:46.495700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-05-07T14:05:46.495497+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-05-07T14:05:46.495497+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.495497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:20:31.482387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"146'58","reported_seq":318,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.842838+0000","last_change":"2024-05-07T14:05:37.984970+0000","last_active":"2024-05-07T14:05:38.842838+0000","last_peered":"2024-05-07T14:05:38.842838+0000","last_clean":"2024-05-07T14:05:38.842838+0000","last_became_active":"2024-05-07T14:04:59.449454+0000","last_became_peered":"2024-05-07T14:04:59.449454+0000","last_unstale":"2024-05-07T14:05:38.842838+0000","last_undegraded":"2024-05-07T14:05:38.842838+0000","last_fullsized":"2024-05-07T14:05:38.842838+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'58","last_scrub_stamp":"2024-05-07T14:05:37.984690+0000","last_deep_scrub":"146'58","last_deep_scrub_stamp":"2024-05-07T14:05:37.984690+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.984690+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:51.666200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":261,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.927875+0000","last_change":"2024-05-07T14:05:46.927979+0000","last_active":"2024-05-07T14:05:46.927875+0000","last_peered":"2024-05-07T14:05:46.927875+0000","last_clean":"2024-05-07T14:05:46.927875+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:05:46.927875+0000","last_undegraded":"2024-05-07T14:05:46.927875+0000","last_fullsized":"2024-05-07T14:05:46.927875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:46.927640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:46.927640+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.927640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:07.934671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"148'32","reported_seq":284,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.050877+0000","last_change":"2024-05-07T14:05:44.050966+0000","last_active":"2024-05-07T14:05:44.050877+0000","last_peered":"2024-05-07T14:05:44.050877+0000","last_clean":"2024-05-07T14:05:44.050877+0000","last_became_active":"2024-05-07T14:04:59.458512+0000","last_became_peered":"2024-05-07T14:04:59.458512+0000","last_unstale":"2024-05-07T14:05:44.050877+0000","last_undegraded":"2024-05-07T14:05:44.050877+0000","last_fullsized":"2024-05-07T14:05:44.050877+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'32","last_scrub_stamp":"2024-05-07T14:05:44.050666+0000","last_deep_scrub":"148'32","last_deep_scrub_stamp":"2024-05-07T14:05:44.050666+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.050666+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:35:28.204523+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"146'142","reported_seq":469,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.816317+0000","last_change":"2024-05-07T14:05:35.870612+0000","last_active":"2024-05-07T14:05:38.816317+0000","last_peered":"2024-05-07T14:05:38.816317+0000","last_clean":"2024-05-07T14:05:38.816317+0000","last_became_active":"2024-05-07T14:03:42.700324+0000","last_became_peered":"2024-05-07T14:03:42.700324+0000","last_unstale":"2024-05-07T14:05:38.816317+0000","last_undegraded":"2024-05-07T14:05:38.816317+0000","last_fullsized":"2024-05-07T14:05:38.816317+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'142","last_scrub_stamp":"2024-05-07T14:05:35.870457+0000","last_deep_scrub":"146'142","last_deep_scrub_stamp":"2024-05-07T14:05:35.870457+0000","last_clean_scrub_stamp":"2024-05-07T14:05:35.870457+0000","objects_scrubbed":1,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:45.950605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":243,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.818088+0000","last_change":"2024-05-07T14:01:06.026182+0000","last_active":"2024-05-07T14:05:38.818088+0000","last_peered":"2024-05-07T14:05:38.818088+0000","last_clean":"2024-05-07T14:05:38.818088+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:05:38.818088+0000","last_undegraded":"2024-05-07T14:05:38.818088+0000","last_fullsized":"2024-05-07T14:05:38.818088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"124'10","reported_seq":297,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.793018+0000","last_change":"2024-05-07T14:05:48.793083+0000","last_active":"2024-05-07T14:05:48.793018+0000","last_peered":"2024-05-07T14:05:48.793018+0000","last_clean":"2024-05-07T14:05:48.793018+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:05:48.793018+0000","last_undegraded":"2024-05-07T14:05:48.793018+0000","last_fullsized":"2024-05-07T14:05:48.793018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'10","last_scrub_stamp":"2024-05-07T14:05:48.792805+0000","last_deep_scrub":"124'10","last_deep_scrub_stamp":"2024-05-07T14:05:48.792805+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.792805+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:38.523674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"146'72","reported_seq":334,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.621336+0000","last_change":"2024-05-07T14:00:56.005873+0000","last_active":"2024-05-07T14:05:38.621336+0000","last_peered":"2024-05-07T14:05:38.621336+0000","last_clean":"2024-05-07T14:05:38.621336+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:05:38.621336+0000","last_undegraded":"2024-05-07T14:05:38.621336+0000","last_fullsized":"2024-05-07T14:05:38.621336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":261,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.425462+0000","last_change":"2024-05-07T14:05:37.005828+0000","last_active":"2024-05-07T14:05:38.425462+0000","last_peered":"2024-05-07T14:05:38.425462+0000","last_clean":"2024-05-07T14:05:38.425462+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:05:38.425462+0000","last_undegraded":"2024-05-07T14:05:38.425462+0000","last_fullsized":"2024-05-07T14:05:38.425462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.005735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.005735+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.005735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:36:36.882585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"148'39","reported_seq":325,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.843926+0000","last_change":"2024-05-07T14:05:39.843992+0000","last_active":"2024-05-07T14:05:39.843926+0000","last_peered":"2024-05-07T14:05:39.843926+0000","last_clean":"2024-05-07T14:05:39.843926+0000","last_became_active":"2024-05-07T14:04:59.455284+0000","last_became_peered":"2024-05-07T14:04:59.455284+0000","last_unstale":"2024-05-07T14:05:39.843926+0000","last_undegraded":"2024-05-07T14:05:39.843926+0000","last_fullsized":"2024-05-07T14:05:39.843926+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'39","last_scrub_stamp":"2024-05-07T14:05:39.843733+0000","last_deep_scrub":"148'39","last_deep_scrub_stamp":"2024-05-07T14:05:39.843733+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.843733+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:06:50.443554+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":252,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.424588+0000","last_change":"2024-05-07T14:04:59.467425+0000","last_active":"2024-05-07T14:05:38.424588+0000","last_peered":"2024-05-07T14:05:38.424588+0000","last_clean":"2024-05-07T14:05:38.424588+0000","last_became_active":"2024-05-07T14:04:59.466731+0000","last_became_peered":"2024-05-07T14:04:59.466731+0000","last_unstale":"2024-05-07T14:05:38.424588+0000","last_undegraded":"2024-05-07T14:05:38.424588+0000","last_fullsized":"2024-05-07T14:05:38.424588+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"121'5","reported_seq":117,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.443505+0000","last_change":"2024-05-07T14:03:39.802033+0000","last_active":"2024-05-07T14:05:38.443505+0000","last_peered":"2024-05-07T14:05:38.443505+0000","last_clean":"2024-05-07T14:05:38.443505+0000","last_became_active":"2024-05-07T14:03:39.675695+0000","last_became_peered":"2024-05-07T14:03:39.675695+0000","last_unstale":"2024-05-07T14:05:38.443505+0000","last_undegraded":"2024-05-07T14:05:38.443505+0000","last_fullsized":"2024-05-07T14:05:38.443505+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"87'2","reported_seq":269,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.428231+0000","last_change":"2024-05-07T14:00:57.994823+0000","last_active":"2024-05-07T14:05:38.428231+0000","last_peered":"2024-05-07T14:05:38.428231+0000","last_clean":"2024-05-07T14:05:38.428231+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:05:38.428231+0000","last_undegraded":"2024-05-07T14:05:38.428231+0000","last_fullsized":"2024-05-07T14:05:38.428231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"146'52","reported_seq":315,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.432026+0000","last_change":"2024-05-07T14:00:55.976954+0000","last_active":"2024-05-07T14:05:38.432026+0000","last_peered":"2024-05-07T14:05:38.432026+0000","last_clean":"2024-05-07T14:05:38.432026+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:05:38.432026+0000","last_undegraded":"2024-05-07T14:05:38.432026+0000","last_fullsized":"2024-05-07T14:05:38.432026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":260,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.425714+0000","last_change":"2024-05-07T14:04:59.468095+0000","last_active":"2024-05-07T14:05:38.425714+0000","last_peered":"2024-05-07T14:05:38.425714+0000","last_clean":"2024-05-07T14:05:38.425714+0000","last_became_active":"2024-05-07T14:04:59.467463+0000","last_became_peered":"2024-05-07T14:04:59.467463+0000","last_unstale":"2024-05-07T14:05:38.425714+0000","last_undegraded":"2024-05-07T14:05:38.425714+0000","last_fullsized":"2024-05-07T14:05:38.425714+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"146'25","reported_seq":323,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.428558+0000","last_change":"2024-05-07T14:03:39.698456+0000","last_active":"2024-05-07T14:05:38.428558+0000","last_peered":"2024-05-07T14:05:38.428558+0000","last_clean":"2024-05-07T14:05:38.428558+0000","last_became_active":"2024-05-07T14:03:39.663223+0000","last_became_peered":"2024-05-07T14:03:39.663223+0000","last_unstale":"2024-05-07T14:05:38.428558+0000","last_undegraded":"2024-05-07T14:05:38.428558+0000","last_fullsized":"2024-05-07T14:05:38.428558+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":247,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.818025+0000","last_change":"2024-05-07T14:01:04.026056+0000","last_active":"2024-05-07T14:05:38.818025+0000","last_peered":"2024-05-07T14:05:38.818025+0000","last_clean":"2024-05-07T14:05:38.818025+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:05:38.818025+0000","last_undegraded":"2024-05-07T14:05:38.818025+0000","last_fullsized":"2024-05-07T14:05:38.818025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"106'6","reported_seq":252,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.433093+0000","last_change":"2024-05-07T14:01:06.037838+0000","last_active":"2024-05-07T14:05:38.433093+0000","last_peered":"2024-05-07T14:05:38.433093+0000","last_clean":"2024-05-07T14:05:38.433093+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:05:38.433093+0000","last_undegraded":"2024-05-07T14:05:38.433093+0000","last_fullsized":"2024-05-07T14:05:38.433093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"106'12","reported_seq":320,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.589914+0000","last_change":"2024-05-07T14:05:46.589973+0000","last_active":"2024-05-07T14:05:46.589914+0000","last_peered":"2024-05-07T14:05:46.589914+0000","last_clean":"2024-05-07T14:05:46.589914+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:05:46.589914+0000","last_undegraded":"2024-05-07T14:05:46.589914+0000","last_fullsized":"2024-05-07T14:05:46.589914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'12","last_scrub_stamp":"2024-05-07T14:05:46.589665+0000","last_deep_scrub":"106'12","last_deep_scrub_stamp":"2024-05-07T14:05:46.589665+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.589665+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:32.146378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"146'32","reported_seq":302,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.490098+0000","last_change":"2024-05-07T14:05:49.490218+0000","last_active":"2024-05-07T14:05:49.490098+0000","last_peered":"2024-05-07T14:05:49.490098+0000","last_clean":"2024-05-07T14:05:49.490098+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:05:49.490098+0000","last_undegraded":"2024-05-07T14:05:49.490098+0000","last_fullsized":"2024-05-07T14:05:49.490098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'32","last_scrub_stamp":"2024-05-07T14:05:49.489775+0000","last_deep_scrub":"146'32","last_deep_scrub_stamp":"2024-05-07T14:05:49.489775+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.489775+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:58.808891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"26'1","reported_seq":131,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.441376+0000","last_change":"2024-05-07T14:03:39.714297+0000","last_active":"2024-05-07T14:05:38.441376+0000","last_peered":"2024-05-07T14:05:38.441376+0000","last_clean":"2024-05-07T14:05:38.441376+0000","last_became_active":"2024-05-07T14:03:39.663013+0000","last_became_peered":"2024-05-07T14:03:39.663013+0000","last_unstale":"2024-05-07T14:05:38.441376+0000","last_undegraded":"2024-05-07T14:05:38.441376+0000","last_fullsized":"2024-05-07T14:05:38.441376+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"147'33","reported_seq":304,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426862+0000","last_change":"2024-05-07T14:05:38.003955+0000","last_active":"2024-05-07T14:05:38.426862+0000","last_peered":"2024-05-07T14:05:38.426862+0000","last_clean":"2024-05-07T14:05:38.426862+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:05:38.426862+0000","last_undegraded":"2024-05-07T14:05:38.426862+0000","last_fullsized":"2024-05-07T14:05:38.426862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"147'33","last_scrub_stamp":"2024-05-07T14:05:38.003643+0000","last_deep_scrub":"147'33","last_deep_scrub_stamp":"2024-05-07T14:05:38.003643+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.003643+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:21.738975+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"146'138","reported_seq":458,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.881728+0000","last_change":"2024-05-07T14:05:47.881792+0000","last_active":"2024-05-07T14:05:47.881728+0000","last_peered":"2024-05-07T14:05:47.881728+0000","last_clean":"2024-05-07T14:05:47.881728+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:05:47.881728+0000","last_undegraded":"2024-05-07T14:05:47.881728+0000","last_fullsized":"2024-05-07T14:05:47.881728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'138","last_scrub_stamp":"2024-05-07T14:05:47.881523+0000","last_deep_scrub":"146'138","last_deep_scrub_stamp":"2024-05-07T14:05:47.881523+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.881523+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:41:39.022938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"87'4","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.230323+0000","last_change":"2024-05-07T14:05:46.230484+0000","last_active":"2024-05-07T14:05:46.230323+0000","last_peered":"2024-05-07T14:05:46.230323+0000","last_clean":"2024-05-07T14:05:46.230323+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:05:46.230323+0000","last_undegraded":"2024-05-07T14:05:46.230323+0000","last_fullsized":"2024-05-07T14:05:46.230323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'4","last_scrub_stamp":"2024-05-07T14:05:46.230060+0000","last_deep_scrub":"87'4","last_deep_scrub_stamp":"2024-05-07T14:05:46.230060+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.230060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:40.346247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"106'8","reported_seq":294,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.429181+0000","last_change":"2024-05-07T14:00:58.000026+0000","last_active":"2024-05-07T14:05:38.429181+0000","last_peered":"2024-05-07T14:05:38.429181+0000","last_clean":"2024-05-07T14:05:38.429181+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:05:38.429181+0000","last_undegraded":"2024-05-07T14:05:38.429181+0000","last_fullsized":"2024-05-07T14:05:38.429181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"146'38","reported_seq":303,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.427417+0000","last_change":"2024-05-07T14:00:55.975330+0000","last_active":"2024-05-07T14:05:38.427417+0000","last_peered":"2024-05-07T14:05:38.427417+0000","last_clean":"2024-05-07T14:05:38.427417+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:05:38.427417+0000","last_undegraded":"2024-05-07T14:05:38.427417+0000","last_fullsized":"2024-05-07T14:05:38.427417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"148'4","reported_seq":448,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.794077+0000","last_change":"2024-05-07T14:05:49.794153+0000","last_active":"2024-05-07T14:05:49.794077+0000","last_peered":"2024-05-07T14:05:49.794077+0000","last_clean":"2024-05-07T14:05:49.794077+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:05:49.794077+0000","last_undegraded":"2024-05-07T14:05:49.794077+0000","last_fullsized":"2024-05-07T14:05:49.794077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'4","last_scrub_stamp":"2024-05-07T14:05:49.793887+0000","last_deep_scrub":"148'4","last_deep_scrub_stamp":"2024-05-07T14:05:49.793887+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.793887+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:52:34.017572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"148'15","reported_seq":279,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.451639+0000","last_change":"2024-05-07T14:05:51.451714+0000","last_active":"2024-05-07T14:05:51.451639+0000","last_peered":"2024-05-07T14:05:51.451639+0000","last_clean":"2024-05-07T14:05:51.451639+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:05:51.451639+0000","last_undegraded":"2024-05-07T14:05:51.451639+0000","last_fullsized":"2024-05-07T14:05:51.451639+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'15","last_scrub_stamp":"2024-05-07T14:05:51.451437+0000","last_deep_scrub":"148'15","last_deep_scrub_stamp":"2024-05-07T14:05:51.451437+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.451437+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:14.981223+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"146'138","reported_seq":447,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.515099+0000","last_change":"2024-05-07T14:05:39.515165+0000","last_active":"2024-05-07T14:05:39.515099+0000","last_peered":"2024-05-07T14:05:39.515099+0000","last_clean":"2024-05-07T14:05:39.515099+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:05:39.515099+0000","last_undegraded":"2024-05-07T14:05:39.515099+0000","last_fullsized":"2024-05-07T14:05:39.515099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'138","last_scrub_stamp":"2024-05-07T14:05:39.514876+0000","last_deep_scrub":"146'138","last_deep_scrub_stamp":"2024-05-07T14:05:39.514876+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.514876+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:10.324260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"87'6","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426980+0000","last_change":"2024-05-07T14:01:06.021393+0000","last_active":"2024-05-07T14:05:38.426980+0000","last_peered":"2024-05-07T14:05:38.426980+0000","last_clean":"2024-05-07T14:05:38.426980+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:05:38.426980+0000","last_undegraded":"2024-05-07T14:05:38.426980+0000","last_fullsized":"2024-05-07T14:05:38.426980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"124'6","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.443712+0000","last_change":"2024-05-07T14:00:57.984510+0000","last_active":"2024-05-07T14:05:38.443712+0000","last_peered":"2024-05-07T14:05:38.443712+0000","last_clean":"2024-05-07T14:05:38.443712+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:05:38.443712+0000","last_undegraded":"2024-05-07T14:05:38.443712+0000","last_fullsized":"2024-05-07T14:05:38.443712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"146'48","reported_seq":353,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.453337+0000","last_change":"2024-05-07T14:05:44.453402+0000","last_active":"2024-05-07T14:05:44.453337+0000","last_peered":"2024-05-07T14:05:44.453337+0000","last_clean":"2024-05-07T14:05:44.453337+0000","last_became_active":"2024-05-07T14:03:39.666192+0000","last_became_peered":"2024-05-07T14:03:39.666192+0000","last_unstale":"2024-05-07T14:05:44.453337+0000","last_undegraded":"2024-05-07T14:05:44.453337+0000","last_fullsized":"2024-05-07T14:05:44.453337+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'48","last_scrub_stamp":"2024-05-07T14:05:44.453140+0000","last_deep_scrub":"146'48","last_deep_scrub_stamp":"2024-05-07T14:05:44.453140+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.453140+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:30.552148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":264,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.683305+0000","last_change":"2024-05-07T14:05:51.683360+0000","last_active":"2024-05-07T14:05:51.683305+0000","last_peered":"2024-05-07T14:05:51.683305+0000","last_clean":"2024-05-07T14:05:51.683305+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:05:51.683305+0000","last_undegraded":"2024-05-07T14:05:51.683305+0000","last_fullsized":"2024-05-07T14:05:51.683305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:51.683083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:51.683083+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.683083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:06.122503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"148'35","reported_seq":354,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.657561+0000","last_change":"2024-05-07T14:05:39.657649+0000","last_active":"2024-05-07T14:05:39.657561+0000","last_peered":"2024-05-07T14:05:39.657561+0000","last_clean":"2024-05-07T14:05:39.657561+0000","last_became_active":"2024-05-07T14:03:39.673995+0000","last_became_peered":"2024-05-07T14:03:39.673995+0000","last_unstale":"2024-05-07T14:05:39.657561+0000","last_undegraded":"2024-05-07T14:05:39.657561+0000","last_fullsized":"2024-05-07T14:05:39.657561+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'35","last_scrub_stamp":"2024-05-07T14:05:39.657374+0000","last_deep_scrub":"148'35","last_deep_scrub_stamp":"2024-05-07T14:05:39.657374+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.657374+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:53:39.083704+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":246,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.480600+0000","last_change":"2024-05-07T14:01:04.025710+0000","last_active":"2024-05-07T14:05:38.480600+0000","last_peered":"2024-05-07T14:05:38.480600+0000","last_clean":"2024-05-07T14:05:38.480600+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:05:38.480600+0000","last_undegraded":"2024-05-07T14:05:38.480600+0000","last_fullsized":"2024-05-07T14:05:38.480600+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"124'2","reported_seq":118,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.442063+0000","last_change":"2024-05-07T14:05:36.169322+0000","last_active":"2024-05-07T14:05:38.442063+0000","last_peered":"2024-05-07T14:05:38.442063+0000","last_clean":"2024-05-07T14:05:38.442063+0000","last_became_active":"2024-05-07T14:03:39.665838+0000","last_became_peered":"2024-05-07T14:03:39.665838+0000","last_unstale":"2024-05-07T14:05:38.442063+0000","last_undegraded":"2024-05-07T14:05:38.442063+0000","last_fullsized":"2024-05-07T14:05:38.442063+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'2","last_scrub_stamp":"2024-05-07T14:05:36.169228+0000","last_deep_scrub":"124'2","last_deep_scrub_stamp":"2024-05-07T14:05:36.169228+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.169228+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:05.619187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'2","reported_seq":275,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.496398+0000","last_change":"2024-05-07T14:05:42.496470+0000","last_active":"2024-05-07T14:05:42.496398+0000","last_peered":"2024-05-07T14:05:42.496398+0000","last_clean":"2024-05-07T14:05:42.496398+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:05:42.496398+0000","last_undegraded":"2024-05-07T14:05:42.496398+0000","last_fullsized":"2024-05-07T14:05:42.496398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:05:42.496172+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:05:42.496172+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.496172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:08.117356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":318,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.479875+0000","last_change":"2024-05-07T14:02:39.729323+0000","last_active":"2024-05-07T14:05:38.479875+0000","last_peered":"2024-05-07T14:05:38.479875+0000","last_clean":"2024-05-07T14:05:38.479875+0000","last_became_active":"2024-05-07T14:02:39.728189+0000","last_became_peered":"2024-05-07T14:02:39.728189+0000","last_unstale":"2024-05-07T14:05:38.479875+0000","last_undegraded":"2024-05-07T14:05:38.479875+0000","last_fullsized":"2024-05-07T14:05:38.479875+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:43.807655+0000","last_clean_scrub_stamp":"2024-05-07T14:00:43.807655+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":268,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620593+0000","last_change":"2024-05-07T14:00:49.933432+0000","last_active":"2024-05-07T14:05:38.620593+0000","last_peered":"2024-05-07T14:05:38.620593+0000","last_clean":"2024-05-07T14:05:38.620593+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:05:38.620593+0000","last_undegraded":"2024-05-07T14:05:38.620593+0000","last_fullsized":"2024-05-07T14:05:38.620593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"146'40","reported_seq":260,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.896294+0000","last_change":"2024-05-07T14:05:49.896351+0000","last_active":"2024-05-07T14:05:49.896294+0000","last_peered":"2024-05-07T14:05:49.896294+0000","last_clean":"2024-05-07T14:05:49.896294+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:05:49.896294+0000","last_undegraded":"2024-05-07T14:05:49.896294+0000","last_fullsized":"2024-05-07T14:05:49.896294+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'40","last_scrub_stamp":"2024-05-07T14:05:49.896090+0000","last_deep_scrub":"146'40","last_deep_scrub_stamp":"2024-05-07T14:05:49.896090+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.896090+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.517274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":50,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.047023+0000","last_change":"2024-05-07T14:05:48.047075+0000","last_active":"2024-05-07T14:05:48.047023+0000","last_peered":"2024-05-07T14:05:48.047023+0000","last_clean":"2024-05-07T14:05:48.047023+0000","last_became_active":"2024-05-07T14:04:59.453884+0000","last_became_peered":"2024-05-07T14:04:59.453884+0000","last_unstale":"2024-05-07T14:05:48.047023+0000","last_undegraded":"2024-05-07T14:05:48.047023+0000","last_fullsized":"2024-05-07T14:05:48.047023+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:48.046779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:48.046779+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.046779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:29.471937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"148'49","reported_seq":333,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.848365+0000","last_change":"2024-05-07T14:05:51.848447+0000","last_active":"2024-05-07T14:05:51.848365+0000","last_peered":"2024-05-07T14:05:51.848365+0000","last_clean":"2024-05-07T14:05:51.848365+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:05:51.848365+0000","last_undegraded":"2024-05-07T14:05:51.848365+0000","last_fullsized":"2024-05-07T14:05:51.848365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'49","last_scrub_stamp":"2024-05-07T14:05:51.848139+0000","last_deep_scrub":"148'49","last_deep_scrub_stamp":"2024-05-07T14:05:51.848139+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.848139+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:28.943832+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.818347+0000","last_change":"2024-05-07T14:04:59.457814+0000","last_active":"2024-05-07T14:05:38.818347+0000","last_peered":"2024-05-07T14:05:38.818347+0000","last_clean":"2024-05-07T14:05:38.818347+0000","last_became_active":"2024-05-07T14:04:59.456477+0000","last_became_peered":"2024-05-07T14:04:59.456477+0000","last_unstale":"2024-05-07T14:05:38.818347+0000","last_undegraded":"2024-05-07T14:05:38.818347+0000","last_fullsized":"2024-05-07T14:05:38.818347+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":242,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.480107+0000","last_change":"2024-05-07T14:01:06.023820+0000","last_active":"2024-05-07T14:05:38.480107+0000","last_peered":"2024-05-07T14:05:38.480107+0000","last_clean":"2024-05-07T14:05:38.480107+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:05:38.480107+0000","last_undegraded":"2024-05-07T14:05:38.480107+0000","last_fullsized":"2024-05-07T14:05:38.480107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'2","reported_seq":267,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.819212+0000","last_change":"2024-05-07T14:00:57.982540+0000","last_active":"2024-05-07T14:05:38.819212+0000","last_peered":"2024-05-07T14:05:38.819212+0000","last_clean":"2024-05-07T14:05:38.819212+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:05:38.819212+0000","last_undegraded":"2024-05-07T14:05:38.819212+0000","last_fullsized":"2024-05-07T14:05:38.819212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.842378+0000","last_change":"2024-05-07T14:04:59.425099+0000","last_active":"2024-05-07T14:05:38.842378+0000","last_peered":"2024-05-07T14:05:38.842378+0000","last_clean":"2024-05-07T14:05:38.842378+0000","last_became_active":"2024-05-07T14:04:59.422224+0000","last_became_peered":"2024-05-07T14:04:59.422224+0000","last_unstale":"2024-05-07T14:05:38.842378+0000","last_undegraded":"2024-05-07T14:05:38.842378+0000","last_fullsized":"2024-05-07T14:05:38.842378+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"146'44","reported_seq":307,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.816652+0000","last_change":"2024-05-07T14:00:55.986210+0000","last_active":"2024-05-07T14:05:38.816652+0000","last_peered":"2024-05-07T14:05:38.816652+0000","last_clean":"2024-05-07T14:05:38.816652+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:05:38.816652+0000","last_undegraded":"2024-05-07T14:05:38.816652+0000","last_fullsized":"2024-05-07T14:05:38.816652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.715081+0000","last_change":"2024-05-07T14:05:45.715136+0000","last_active":"2024-05-07T14:05:45.715081+0000","last_peered":"2024-05-07T14:05:45.715081+0000","last_clean":"2024-05-07T14:05:45.715081+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:05:45.715081+0000","last_undegraded":"2024-05-07T14:05:45.715081+0000","last_fullsized":"2024-05-07T14:05:45.715081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:45.714883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:45.714883+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.714883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:20.093461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"146'153","reported_seq":546,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.442028+0000","last_change":"2024-05-07T14:03:42.708479+0000","last_active":"2024-05-07T14:05:38.442028+0000","last_peered":"2024-05-07T14:05:38.442028+0000","last_clean":"2024-05-07T14:05:38.442028+0000","last_became_active":"2024-05-07T14:03:42.708117+0000","last_became_peered":"2024-05-07T14:03:42.708117+0000","last_unstale":"2024-05-07T14:05:38.442028+0000","last_undegraded":"2024-05-07T14:05:38.442028+0000","last_fullsized":"2024-05-07T14:05:38.442028+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":202,"num_read_kb":198,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.008569+0000","last_change":"2024-05-07T14:05:43.008624+0000","last_active":"2024-05-07T14:05:43.008569+0000","last_peered":"2024-05-07T14:05:43.008569+0000","last_clean":"2024-05-07T14:05:43.008569+0000","last_became_active":"2024-05-07T14:04:59.461354+0000","last_became_peered":"2024-05-07T14:04:59.461354+0000","last_unstale":"2024-05-07T14:05:43.008569+0000","last_undegraded":"2024-05-07T14:05:43.008569+0000","last_fullsized":"2024-05-07T14:05:43.008569+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:43.008372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:43.008372+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.008372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:47:45.743047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"80'4","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.177883+0000","last_change":"2024-05-07T14:05:44.177944+0000","last_active":"2024-05-07T14:05:44.177883+0000","last_peered":"2024-05-07T14:05:44.177883+0000","last_clean":"2024-05-07T14:05:44.177883+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:05:44.177883+0000","last_undegraded":"2024-05-07T14:05:44.177883+0000","last_fullsized":"2024-05-07T14:05:44.177883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-05-07T14:05:44.177682+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-05-07T14:05:44.177682+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.177682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:19:08.727384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"81'2","reported_seq":110,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.442673+0000","last_change":"2024-05-07T14:03:39.711373+0000","last_active":"2024-05-07T14:05:38.442673+0000","last_peered":"2024-05-07T14:05:38.442673+0000","last_clean":"2024-05-07T14:05:38.442673+0000","last_became_active":"2024-05-07T14:03:39.667130+0000","last_became_peered":"2024-05-07T14:03:39.667130+0000","last_unstale":"2024-05-07T14:05:38.442673+0000","last_undegraded":"2024-05-07T14:05:38.442673+0000","last_fullsized":"2024-05-07T14:05:38.442673+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":275,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.930965+0000","last_change":"2024-05-07T14:05:39.931024+0000","last_active":"2024-05-07T14:05:39.930965+0000","last_peered":"2024-05-07T14:05:39.930965+0000","last_clean":"2024-05-07T14:05:39.930965+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:05:39.930965+0000","last_undegraded":"2024-05-07T14:05:39.930965+0000","last_fullsized":"2024-05-07T14:05:39.930965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:39.930722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:39.930722+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.930722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:25:55.708927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"146'54","reported_seq":324,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.203380+0000","last_change":"2024-05-07T14:05:52.203445+0000","last_active":"2024-05-07T14:05:52.203380+0000","last_peered":"2024-05-07T14:05:52.203380+0000","last_clean":"2024-05-07T14:05:52.203380+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:05:52.203380+0000","last_undegraded":"2024-05-07T14:05:52.203380+0000","last_fullsized":"2024-05-07T14:05:52.203380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:05:52.203119+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:05:52.203119+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.203119+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:45:56.078625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"148'2","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.949508+0000","last_change":"2024-05-07T14:05:38.949702+0000","last_active":"2024-05-07T14:05:38.949508+0000","last_peered":"2024-05-07T14:05:38.949508+0000","last_clean":"2024-05-07T14:05:38.949508+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:05:38.949508+0000","last_undegraded":"2024-05-07T14:05:38.949508+0000","last_fullsized":"2024-05-07T14:05:38.949508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'2","last_scrub_stamp":"2024-05-07T14:05:38.949276+0000","last_deep_scrub":"148'2","last_deep_scrub_stamp":"2024-05-07T14:05:38.949276+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.949276+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:32:59.585166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"148'26","reported_seq":312,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.975153+0000","last_change":"2024-05-07T14:05:41.975241+0000","last_active":"2024-05-07T14:05:41.975153+0000","last_peered":"2024-05-07T14:05:41.975153+0000","last_clean":"2024-05-07T14:05:41.975153+0000","last_became_active":"2024-05-07T14:04:59.456018+0000","last_became_peered":"2024-05-07T14:04:59.456018+0000","last_unstale":"2024-05-07T14:05:41.975153+0000","last_undegraded":"2024-05-07T14:05:41.975153+0000","last_fullsized":"2024-05-07T14:05:41.975153+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'26","last_scrub_stamp":"2024-05-07T14:05:41.974940+0000","last_deep_scrub":"148'26","last_deep_scrub_stamp":"2024-05-07T14:05:41.974940+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.974940+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:45:59.365603+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.759315+0000","last_change":"2024-05-07T14:05:47.759374+0000","last_active":"2024-05-07T14:05:47.759315+0000","last_peered":"2024-05-07T14:05:47.759315+0000","last_clean":"2024-05-07T14:05:47.759315+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:05:47.759315+0000","last_undegraded":"2024-05-07T14:05:47.759315+0000","last_fullsized":"2024-05-07T14:05:47.759315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:47.759099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:47.759099+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.759099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:27.409820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":243,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.433314+0000","last_change":"2024-05-07T14:01:06.016589+0000","last_active":"2024-05-07T14:05:38.433314+0000","last_peered":"2024-05-07T14:05:38.433314+0000","last_clean":"2024-05-07T14:05:38.433314+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:05:38.433314+0000","last_undegraded":"2024-05-07T14:05:38.433314+0000","last_fullsized":"2024-05-07T14:05:38.433314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"81'4","reported_seq":120,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.202102+0000","last_change":"2024-05-07T14:05:43.202102+0000","last_active":"2024-05-07T14:05:43.202102+0000","last_peered":"2024-05-07T14:05:43.202102+0000","last_clean":"2024-05-07T14:05:43.202102+0000","last_became_active":"2024-05-07T14:03:39.661295+0000","last_became_peered":"2024-05-07T14:03:39.661295+0000","last_unstale":"2024-05-07T14:05:43.202102+0000","last_undegraded":"2024-05-07T14:05:43.202102+0000","last_fullsized":"2024-05-07T14:05:43.202102+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-05-07T14:05:43.201833+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-05-07T14:05:43.201833+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.201833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:53:22.951653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":268,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.621071+0000","last_change":"2024-05-07T14:00:49.934803+0000","last_active":"2024-05-07T14:05:38.621071+0000","last_peered":"2024-05-07T14:05:38.621071+0000","last_clean":"2024-05-07T14:05:38.621071+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:05:38.621071+0000","last_undegraded":"2024-05-07T14:05:38.621071+0000","last_fullsized":"2024-05-07T14:05:38.621071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"146'28","reported_seq":293,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.427924+0000","last_change":"2024-05-07T14:00:55.971883+0000","last_active":"2024-05-07T14:05:38.427924+0000","last_peered":"2024-05-07T14:05:38.427924+0000","last_clean":"2024-05-07T14:05:38.427924+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:05:38.427924+0000","last_undegraded":"2024-05-07T14:05:38.427924+0000","last_fullsized":"2024-05-07T14:05:38.427924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":38,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.842219+0000","last_change":"2024-05-07T14:05:42.842270+0000","last_active":"2024-05-07T14:05:42.842219+0000","last_peered":"2024-05-07T14:05:42.842219+0000","last_clean":"2024-05-07T14:05:42.842219+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:05:42.842219+0000","last_undegraded":"2024-05-07T14:05:42.842219+0000","last_fullsized":"2024-05-07T14:05:42.842219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:42.842025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:42.842025+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.842025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:20:29.836711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'12","reported_seq":269,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.435499+0000","last_change":"2024-05-07T14:01:02.006241+0000","last_active":"2024-05-07T14:05:38.435499+0000","last_peered":"2024-05-07T14:05:38.435499+0000","last_clean":"2024-05-07T14:05:38.435499+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:05:38.435499+0000","last_undegraded":"2024-05-07T14:05:38.435499+0000","last_fullsized":"2024-05-07T14:05:38.435499+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.451049+0000","last_change":"2024-05-07T14:05:45.451111+0000","last_active":"2024-05-07T14:05:45.451049+0000","last_peered":"2024-05-07T14:05:45.451049+0000","last_clean":"2024-05-07T14:05:45.451049+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:05:45.451049+0000","last_undegraded":"2024-05-07T14:05:45.451049+0000","last_fullsized":"2024-05-07T14:05:45.451049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:45.450822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:45.450822+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.450822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:46:13.537065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":242,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.619713+0000","last_change":"2024-05-07T14:01:06.038273+0000","last_active":"2024-05-07T14:05:38.619713+0000","last_peered":"2024-05-07T14:05:38.619713+0000","last_clean":"2024-05-07T14:05:38.619713+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:05:38.619713+0000","last_undegraded":"2024-05-07T14:05:38.619713+0000","last_fullsized":"2024-05-07T14:05:38.619713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.164645+0000","last_change":"2024-05-07T14:05:42.164645+0000","last_active":"2024-05-07T14:05:42.164645+0000","last_peered":"2024-05-07T14:05:42.164645+0000","last_clean":"2024-05-07T14:05:42.164645+0000","last_became_active":"2024-05-07T14:03:39.659515+0000","last_became_peered":"2024-05-07T14:03:39.659515+0000","last_unstale":"2024-05-07T14:05:42.164645+0000","last_undegraded":"2024-05-07T14:05:42.164645+0000","last_fullsized":"2024-05-07T14:05:42.164645+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:42.164378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:42.164378+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.164378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:24:47.549501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"146'38","reported_seq":300,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.622217+0000","last_change":"2024-05-07T14:00:56.005367+0000","last_active":"2024-05-07T14:05:38.622217+0000","last_peered":"2024-05-07T14:05:38.622217+0000","last_clean":"2024-05-07T14:05:38.622217+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:05:38.622217+0000","last_undegraded":"2024-05-07T14:05:38.622217+0000","last_fullsized":"2024-05-07T14:05:38.622217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.223910+0000","last_change":"2024-05-07T14:05:49.224051+0000","last_active":"2024-05-07T14:05:49.223910+0000","last_peered":"2024-05-07T14:05:49.223910+0000","last_clean":"2024-05-07T14:05:49.223910+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:05:49.223910+0000","last_undegraded":"2024-05-07T14:05:49.223910+0000","last_fullsized":"2024-05-07T14:05:49.223910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:49.223689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:49.223689+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.223689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:53:09.917608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.816128+0000","last_change":"2024-05-07T14:05:44.816178+0000","last_active":"2024-05-07T14:05:44.816128+0000","last_peered":"2024-05-07T14:05:44.816128+0000","last_clean":"2024-05-07T14:05:44.816128+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:05:44.816128+0000","last_undegraded":"2024-05-07T14:05:44.816128+0000","last_fullsized":"2024-05-07T14:05:44.816128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:44.815925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:44.815925+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.815925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:30.914933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"148'49","reported_seq":330,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.898403+0000","last_change":"2024-05-07T14:05:41.898478+0000","last_active":"2024-05-07T14:05:41.898403+0000","last_peered":"2024-05-07T14:05:41.898403+0000","last_clean":"2024-05-07T14:05:41.898403+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:05:41.898403+0000","last_undegraded":"2024-05-07T14:05:41.898403+0000","last_fullsized":"2024-05-07T14:05:41.898403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'49","last_scrub_stamp":"2024-05-07T14:05:41.898210+0000","last_deep_scrub":"148'49","last_deep_scrub_stamp":"2024-05-07T14:05:41.898210+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.898210+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:45:45.773716+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":157,"num_write":28,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.583332+0000","last_change":"2024-05-07T14:05:39.583489+0000","last_active":"2024-05-07T14:05:39.583332+0000","last_peered":"2024-05-07T14:05:39.583332+0000","last_clean":"2024-05-07T14:05:39.583332+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:05:39.583332+0000","last_undegraded":"2024-05-07T14:05:39.583332+0000","last_fullsized":"2024-05-07T14:05:39.583332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:39.583104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:39.583104+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.583104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:05.548386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"146'2","reported_seq":253,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817343+0000","last_change":"2024-05-07T14:05:36.847888+0000","last_active":"2024-05-07T14:05:38.817343+0000","last_peered":"2024-05-07T14:05:38.817343+0000","last_clean":"2024-05-07T14:05:38.817343+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:05:38.817343+0000","last_undegraded":"2024-05-07T14:05:38.817343+0000","last_fullsized":"2024-05-07T14:05:38.817343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'2","last_scrub_stamp":"2024-05-07T14:05:36.847644+0000","last_deep_scrub":"146'2","last_deep_scrub_stamp":"2024-05-07T14:05:36.847644+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.847644+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:47.884397+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":267,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.806194+0000","last_change":"2024-05-07T14:05:46.806344+0000","last_active":"2024-05-07T14:05:46.806194+0000","last_peered":"2024-05-07T14:05:46.806194+0000","last_clean":"2024-05-07T14:05:46.806194+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:05:46.806194+0000","last_undegraded":"2024-05-07T14:05:46.806194+0000","last_fullsized":"2024-05-07T14:05:46.806194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:46.805972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:46.805972+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.805972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:06:18.209798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"146'46","reported_seq":316,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.201907+0000","last_change":"2024-05-07T14:05:51.201972+0000","last_active":"2024-05-07T14:05:51.201907+0000","last_peered":"2024-05-07T14:05:51.201907+0000","last_clean":"2024-05-07T14:05:51.201907+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:05:51.201907+0000","last_undegraded":"2024-05-07T14:05:51.201907+0000","last_fullsized":"2024-05-07T14:05:51.201907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:05:51.201707+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:05:51.201707+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.201707+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:05.641126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.071032+0000","last_change":"2024-05-07T14:05:50.071134+0000","last_active":"2024-05-07T14:05:50.071032+0000","last_peered":"2024-05-07T14:05:50.071032+0000","last_clean":"2024-05-07T14:05:50.071032+0000","last_became_active":"2024-05-07T14:04:59.451719+0000","last_became_peered":"2024-05-07T14:04:59.451719+0000","last_unstale":"2024-05-07T14:05:50.071032+0000","last_undegraded":"2024-05-07T14:05:50.071032+0000","last_fullsized":"2024-05-07T14:05:50.071032+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:50.070785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:50.070785+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.070785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:21.878853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.481574+0000","last_change":"2024-05-07T14:05:37.476888+0000","last_active":"2024-05-07T14:05:38.481574+0000","last_peered":"2024-05-07T14:05:38.481574+0000","last_clean":"2024-05-07T14:05:38.481574+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:05:38.481574+0000","last_undegraded":"2024-05-07T14:05:38.481574+0000","last_fullsized":"2024-05-07T14:05:38.481574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.476486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.476486+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.476486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:16:03.408284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"148'21","reported_seq":137,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.285587+0000","last_change":"2024-05-07T14:05:47.285587+0000","last_active":"2024-05-07T14:05:47.285587+0000","last_peered":"2024-05-07T14:05:47.285587+0000","last_clean":"2024-05-07T14:05:47.285587+0000","last_became_active":"2024-05-07T14:03:39.664751+0000","last_became_peered":"2024-05-07T14:03:39.664751+0000","last_unstale":"2024-05-07T14:05:47.285587+0000","last_undegraded":"2024-05-07T14:05:47.285587+0000","last_fullsized":"2024-05-07T14:05:47.285587+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'21","last_scrub_stamp":"2024-05-07T14:05:47.285316+0000","last_deep_scrub":"148'21","last_deep_scrub_stamp":"2024-05-07T14:05:47.285316+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.285316+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:58.322069+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"146'142","reported_seq":498,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620137+0000","last_change":"2024-05-07T14:05:38.619420+0000","last_active":"2024-05-07T14:05:38.620137+0000","last_peered":"2024-05-07T14:05:38.620137+0000","last_clean":"2024-05-07T14:05:38.620137+0000","last_became_active":"2024-05-07T14:03:42.707207+0000","last_became_peered":"2024-05-07T14:03:42.707207+0000","last_unstale":"2024-05-07T14:05:38.620137+0000","last_undegraded":"2024-05-07T14:05:38.620137+0000","last_fullsized":"2024-05-07T14:05:38.620137+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'142","last_scrub_stamp":"2024-05-07T14:05:38.619146+0000","last_deep_scrub":"146'142","last_deep_scrub_stamp":"2024-05-07T14:05:38.619146+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.619146+0000","objects_scrubbed":1,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:53.058565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.466213+0000","last_change":"2024-05-07T14:05:50.466272+0000","last_active":"2024-05-07T14:05:50.466213+0000","last_peered":"2024-05-07T14:05:50.466213+0000","last_clean":"2024-05-07T14:05:50.466213+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:05:50.466213+0000","last_undegraded":"2024-05-07T14:05:50.466213+0000","last_fullsized":"2024-05-07T14:05:50.466213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:50.466014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:50.466014+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.466014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:51.233636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"115'4","reported_seq":282,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.432088+0000","last_change":"2024-05-07T14:04:59.447585+0000","last_active":"2024-05-07T14:05:38.432088+0000","last_peered":"2024-05-07T14:05:38.432088+0000","last_clean":"2024-05-07T14:05:38.432088+0000","last_became_active":"2024-05-07T14:04:59.446674+0000","last_became_peered":"2024-05-07T14:04:59.446674+0000","last_unstale":"2024-05-07T14:05:38.432088+0000","last_undegraded":"2024-05-07T14:05:38.432088+0000","last_fullsized":"2024-05-07T14:05:38.432088+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"146'34","reported_seq":322,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.436435+0000","last_change":"2024-05-07T14:05:00.492095+0000","last_active":"2024-05-07T14:05:38.436435+0000","last_peered":"2024-05-07T14:05:38.436435+0000","last_clean":"2024-05-07T14:05:38.436435+0000","last_became_active":"2024-05-07T14:04:59.460381+0000","last_became_peered":"2024-05-07T14:04:59.460381+0000","last_unstale":"2024-05-07T14:05:38.436435+0000","last_undegraded":"2024-05-07T14:05:38.436435+0000","last_fullsized":"2024-05-07T14:05:38.436435+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":44,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.207861+0000","last_change":"2024-05-07T14:05:39.207861+0000","last_active":"2024-05-07T14:05:39.207861+0000","last_peered":"2024-05-07T14:05:39.207861+0000","last_clean":"2024-05-07T14:05:39.207861+0000","last_became_active":"2024-05-07T14:03:39.671518+0000","last_became_peered":"2024-05-07T14:03:39.671518+0000","last_unstale":"2024-05-07T14:05:39.207861+0000","last_undegraded":"2024-05-07T14:05:39.207861+0000","last_fullsized":"2024-05-07T14:05:39.207861+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:39.207489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:39.207489+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.207489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:38:47.516131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426541+0000","last_change":"2024-05-07T14:01:00.009069+0000","last_active":"2024-05-07T14:05:38.426541+0000","last_peered":"2024-05-07T14:05:38.426541+0000","last_clean":"2024-05-07T14:05:38.426541+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:05:38.426541+0000","last_undegraded":"2024-05-07T14:05:38.426541+0000","last_fullsized":"2024-05-07T14:05:38.426541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"33'10","reported_seq":267,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.427349+0000","last_change":"2024-05-07T14:01:02.001550+0000","last_active":"2024-05-07T14:05:38.427349+0000","last_peered":"2024-05-07T14:05:38.427349+0000","last_clean":"2024-05-07T14:05:38.427349+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:05:38.427349+0000","last_undegraded":"2024-05-07T14:05:38.427349+0000","last_fullsized":"2024-05-07T14:05:38.427349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"146'138","reported_seq":485,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.434185+0000","last_change":"2024-05-07T14:01:04.027889+0000","last_active":"2024-05-07T14:05:38.434185+0000","last_peered":"2024-05-07T14:05:38.434185+0000","last_clean":"2024-05-07T14:05:38.434185+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:05:38.434185+0000","last_undegraded":"2024-05-07T14:05:38.434185+0000","last_fullsized":"2024-05-07T14:05:38.434185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"81'3","reported_seq":247,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817684+0000","last_change":"2024-05-07T14:01:06.025946+0000","last_active":"2024-05-07T14:05:38.817684+0000","last_peered":"2024-05-07T14:05:38.817684+0000","last_clean":"2024-05-07T14:05:38.817684+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:05:38.817684+0000","last_undegraded":"2024-05-07T14:05:38.817684+0000","last_fullsized":"2024-05-07T14:05:38.817684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"124'4","reported_seq":277,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.427353+0000","last_change":"2024-05-07T14:00:58.000276+0000","last_active":"2024-05-07T14:05:38.427353+0000","last_peered":"2024-05-07T14:05:38.427353+0000","last_clean":"2024-05-07T14:05:38.427353+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:05:38.427353+0000","last_undegraded":"2024-05-07T14:05:38.427353+0000","last_fullsized":"2024-05-07T14:05:38.427353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"146'46","reported_seq":309,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.819884+0000","last_change":"2024-05-07T14:00:55.969195+0000","last_active":"2024-05-07T14:05:38.819884+0000","last_peered":"2024-05-07T14:05:38.819884+0000","last_clean":"2024-05-07T14:05:38.819884+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:05:38.819884+0000","last_undegraded":"2024-05-07T14:05:38.819884+0000","last_fullsized":"2024-05-07T14:05:38.819884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":274,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.482222+0000","last_change":"2024-05-07T14:04:59.469514+0000","last_active":"2024-05-07T14:05:38.482222+0000","last_peered":"2024-05-07T14:05:38.482222+0000","last_clean":"2024-05-07T14:05:38.482222+0000","last_became_active":"2024-05-07T14:04:59.469021+0000","last_became_peered":"2024-05-07T14:04:59.469021+0000","last_unstale":"2024-05-07T14:05:38.482222+0000","last_undegraded":"2024-05-07T14:05:38.482222+0000","last_fullsized":"2024-05-07T14:05:38.482222+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:48.897311+0000","last_clean_scrub_stamp":"2024-05-07T14:00:48.897311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.432486+0000","last_change":"2024-05-07T14:00:59.988813+0000","last_active":"2024-05-07T14:05:38.432486+0000","last_peered":"2024-05-07T14:05:38.432486+0000","last_clean":"2024-05-07T14:05:38.432486+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:05:38.432486+0000","last_undegraded":"2024-05-07T14:05:38.432486+0000","last_fullsized":"2024-05-07T14:05:38.432486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"148'60","reported_seq":328,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.033972+0000","last_change":"2024-05-07T14:05:49.034056+0000","last_active":"2024-05-07T14:05:49.033972+0000","last_peered":"2024-05-07T14:05:49.033972+0000","last_clean":"2024-05-07T14:05:49.033972+0000","last_became_active":"2024-05-07T14:04:59.442492+0000","last_became_peered":"2024-05-07T14:04:59.442492+0000","last_unstale":"2024-05-07T14:05:49.033972+0000","last_undegraded":"2024-05-07T14:05:49.033972+0000","last_fullsized":"2024-05-07T14:05:49.033972+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'60","last_scrub_stamp":"2024-05-07T14:05:49.033759+0000","last_deep_scrub":"148'60","last_deep_scrub_stamp":"2024-05-07T14:05:49.033759+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.033759+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:16:26.253219+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":61,"num_read_kb":279,"num_write":32,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":116761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":265,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.507426+0000","last_change":"2024-05-07T14:05:47.507486+0000","last_active":"2024-05-07T14:05:47.507426+0000","last_peered":"2024-05-07T14:05:47.507426+0000","last_clean":"2024-05-07T14:05:47.507426+0000","last_became_active":"2024-05-07T14:03:39.664810+0000","last_became_peered":"2024-05-07T14:03:39.664810+0000","last_unstale":"2024-05-07T14:05:47.507426+0000","last_undegraded":"2024-05-07T14:05:47.507426+0000","last_fullsized":"2024-05-07T14:05:47.507426+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:47.507097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:47.507097+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.507097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:36.691906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":253,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620970+0000","last_change":"2024-05-07T14:04:59.465509+0000","last_active":"2024-05-07T14:05:38.620970+0000","last_peered":"2024-05-07T14:05:38.620970+0000","last_clean":"2024-05-07T14:05:38.620970+0000","last_became_active":"2024-05-07T14:04:59.464840+0000","last_became_peered":"2024-05-07T14:04:59.464840+0000","last_unstale":"2024-05-07T14:05:38.620970+0000","last_undegraded":"2024-05-07T14:05:38.620970+0000","last_fullsized":"2024-05-07T14:05:38.620970+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817584+0000","last_change":"2024-05-07T14:05:37.833141+0000","last_active":"2024-05-07T14:05:38.817584+0000","last_peered":"2024-05-07T14:05:38.817584+0000","last_clean":"2024-05-07T14:05:38.817584+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:05:38.817584+0000","last_undegraded":"2024-05-07T14:05:38.817584+0000","last_fullsized":"2024-05-07T14:05:38.817584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.833020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.833020+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.833020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:01.034811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'8","reported_seq":304,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.561068+0000","last_change":"2024-05-07T14:05:45.561131+0000","last_active":"2024-05-07T14:05:45.561068+0000","last_peered":"2024-05-07T14:05:45.561068+0000","last_clean":"2024-05-07T14:05:45.561068+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:05:45.561068+0000","last_undegraded":"2024-05-07T14:05:45.561068+0000","last_fullsized":"2024-05-07T14:05:45.561068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'8","last_scrub_stamp":"2024-05-07T14:05:45.560869+0000","last_deep_scrub":"87'8","last_deep_scrub_stamp":"2024-05-07T14:05:45.560869+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.560869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:19:10.110570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"146'46","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.427359+0000","last_change":"2024-05-07T14:04:59.669798+0000","last_active":"2024-05-07T14:05:38.427359+0000","last_peered":"2024-05-07T14:05:38.427359+0000","last_clean":"2024-05-07T14:05:38.427359+0000","last_became_active":"2024-05-07T14:04:59.428245+0000","last_became_peered":"2024-05-07T14:04:59.428245+0000","last_unstale":"2024-05-07T14:05:38.427359+0000","last_undegraded":"2024-05-07T14:05:38.427359+0000","last_fullsized":"2024-05-07T14:05:38.427359+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.443337+0000","last_change":"2024-05-07T14:01:00.002525+0000","last_active":"2024-05-07T14:05:38.443337+0000","last_peered":"2024-05-07T14:05:38.443337+0000","last_clean":"2024-05-07T14:05:38.443337+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:05:38.443337+0000","last_undegraded":"2024-05-07T14:05:38.443337+0000","last_fullsized":"2024-05-07T14:05:38.443337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"146'23","reported_seq":286,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.431500+0000","last_change":"2024-05-07T14:01:02.004529+0000","last_active":"2024-05-07T14:05:38.431500+0000","last_peered":"2024-05-07T14:05:38.431500+0000","last_clean":"2024-05-07T14:05:38.431500+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:05:38.431500+0000","last_undegraded":"2024-05-07T14:05:38.431500+0000","last_fullsized":"2024-05-07T14:05:38.431500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"user requested deep scrub scheduled @ 2024-05-07T14:05:43.442572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":247,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.432961+0000","last_change":"2024-05-07T14:01:04.023226+0000","last_active":"2024-05-07T14:05:38.432961+0000","last_peered":"2024-05-07T14:05:38.432961+0000","last_clean":"2024-05-07T14:05:38.432961+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:05:38.432961+0000","last_undegraded":"2024-05-07T14:05:38.432961+0000","last_fullsized":"2024-05-07T14:05:38.432961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":258,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.482953+0000","last_change":"2024-05-07T14:05:49.483004+0000","last_active":"2024-05-07T14:05:49.482953+0000","last_peered":"2024-05-07T14:05:49.482953+0000","last_clean":"2024-05-07T14:05:49.482953+0000","last_became_active":"2024-05-07T14:04:59.446699+0000","last_became_peered":"2024-05-07T14:04:59.446699+0000","last_unstale":"2024-05-07T14:05:49.482953+0000","last_undegraded":"2024-05-07T14:05:49.482953+0000","last_fullsized":"2024-05-07T14:05:49.482953+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:49.482756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:49.482756+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.482756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:46:17.977501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"115'8","reported_seq":142,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.205196+0000","last_change":"2024-05-07T14:05:45.205253+0000","last_active":"2024-05-07T14:05:45.205196+0000","last_peered":"2024-05-07T14:05:45.205196+0000","last_clean":"2024-05-07T14:05:45.205196+0000","last_became_active":"2024-05-07T14:03:39.663976+0000","last_became_peered":"2024-05-07T14:03:39.663976+0000","last_unstale":"2024-05-07T14:05:45.205196+0000","last_undegraded":"2024-05-07T14:05:45.205196+0000","last_fullsized":"2024-05-07T14:05:45.205196+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'8","last_scrub_stamp":"2024-05-07T14:05:45.204988+0000","last_deep_scrub":"115'8","last_deep_scrub_stamp":"2024-05-07T14:05:45.204988+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.204988+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:48.179740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"146'42","reported_seq":293,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.842699+0000","last_change":"2024-05-07T14:05:00.456893+0000","last_active":"2024-05-07T14:05:38.842699+0000","last_peered":"2024-05-07T14:05:38.842699+0000","last_clean":"2024-05-07T14:05:38.842699+0000","last_became_active":"2024-05-07T14:04:59.445956+0000","last_became_peered":"2024-05-07T14:04:59.445956+0000","last_unstale":"2024-05-07T14:05:38.842699+0000","last_undegraded":"2024-05-07T14:05:38.842699+0000","last_fullsized":"2024-05-07T14:05:38.842699+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.433396+0000","last_change":"2024-05-07T14:01:00.001861+0000","last_active":"2024-05-07T14:05:38.433396+0000","last_peered":"2024-05-07T14:05:38.433396+0000","last_clean":"2024-05-07T14:05:38.433396+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:05:38.433396+0000","last_undegraded":"2024-05-07T14:05:38.433396+0000","last_fullsized":"2024-05-07T14:05:38.433396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"user requested deep scrub scheduled @ 2024-05-07T14:05:43.442544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"148'12","reported_seq":273,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.845888+0000","last_change":"2024-05-07T14:05:43.845956+0000","last_active":"2024-05-07T14:05:43.845888+0000","last_peered":"2024-05-07T14:05:43.845888+0000","last_clean":"2024-05-07T14:05:43.845888+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:05:43.845888+0000","last_undegraded":"2024-05-07T14:05:43.845888+0000","last_fullsized":"2024-05-07T14:05:43.845888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'12","last_scrub_stamp":"2024-05-07T14:05:43.845686+0000","last_deep_scrub":"148'12","last_deep_scrub_stamp":"2024-05-07T14:05:43.845686+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.845686+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:26.632677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5538,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":222,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.842513+0000","last_change":"2024-05-07T14:04:59.445953+0000","last_active":"2024-05-07T14:05:38.842513+0000","last_peered":"2024-05-07T14:05:38.842513+0000","last_clean":"2024-05-07T14:05:38.842513+0000","last_became_active":"2024-05-07T14:04:59.444830+0000","last_became_peered":"2024-05-07T14:04:59.444830+0000","last_unstale":"2024-05-07T14:05:38.842513+0000","last_undegraded":"2024-05-07T14:05:38.842513+0000","last_fullsized":"2024-05-07T14:05:38.842513+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"106'2","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817019+0000","last_change":"2024-05-07T14:05:38.814609+0000","last_active":"2024-05-07T14:05:38.817019+0000","last_peered":"2024-05-07T14:05:38.817019+0000","last_clean":"2024-05-07T14:05:38.817019+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:05:38.817019+0000","last_undegraded":"2024-05-07T14:05:38.817019+0000","last_fullsized":"2024-05-07T14:05:38.817019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'2","last_scrub_stamp":"2024-05-07T14:05:38.814267+0000","last_deep_scrub":"106'2","last_deep_scrub_stamp":"2024-05-07T14:05:38.814267+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.814267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:43:19.964109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"81'4","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.431905+0000","last_change":"2024-05-07T14:04:59.460718+0000","last_active":"2024-05-07T14:05:38.431905+0000","last_peered":"2024-05-07T14:05:38.431905+0000","last_clean":"2024-05-07T14:05:38.431905+0000","last_became_active":"2024-05-07T14:04:59.460037+0000","last_became_peered":"2024-05-07T14:04:59.460037+0000","last_unstale":"2024-05-07T14:05:38.431905+0000","last_undegraded":"2024-05-07T14:05:38.431905+0000","last_fullsized":"2024-05-07T14:05:38.431905+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"146'42","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.622452+0000","last_change":"2024-05-07T14:05:00.840128+0000","last_active":"2024-05-07T14:05:38.622452+0000","last_peered":"2024-05-07T14:05:38.622452+0000","last_clean":"2024-05-07T14:05:38.622452+0000","last_became_active":"2024-05-07T14:04:59.460944+0000","last_became_peered":"2024-05-07T14:04:59.460944+0000","last_unstale":"2024-05-07T14:05:38.622452+0000","last_undegraded":"2024-05-07T14:05:38.622452+0000","last_fullsized":"2024-05-07T14:05:38.622452+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":222,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.841623+0000","last_change":"2024-05-07T14:04:59.431660+0000","last_active":"2024-05-07T14:05:38.841623+0000","last_peered":"2024-05-07T14:05:38.841623+0000","last_clean":"2024-05-07T14:05:38.841623+0000","last_became_active":"2024-05-07T14:04:59.430654+0000","last_became_peered":"2024-05-07T14:04:59.430654+0000","last_unstale":"2024-05-07T14:05:38.841623+0000","last_undegraded":"2024-05-07T14:05:38.841623+0000","last_fullsized":"2024-05-07T14:05:38.841623+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"148'28","reported_seq":299,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.476616+0000","last_change":"2024-05-07T14:05:52.476786+0000","last_active":"2024-05-07T14:05:52.476616+0000","last_peered":"2024-05-07T14:05:52.476616+0000","last_clean":"2024-05-07T14:05:52.476616+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:05:52.476616+0000","last_undegraded":"2024-05-07T14:05:52.476616+0000","last_fullsized":"2024-05-07T14:05:52.476616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'28","last_scrub_stamp":"2024-05-07T14:05:52.476367+0000","last_deep_scrub":"148'28","last_deep_scrub_stamp":"2024-05-07T14:05:52.476367+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.476367+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:55:57.556167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.485049+0000","last_change":"2024-05-07T14:05:43.485049+0000","last_active":"2024-05-07T14:05:43.485049+0000","last_peered":"2024-05-07T14:05:43.485049+0000","last_clean":"2024-05-07T14:05:43.485049+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:05:43.485049+0000","last_undegraded":"2024-05-07T14:05:43.485049+0000","last_fullsized":"2024-05-07T14:05:43.485049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:43.484792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:43.484792+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.484792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:29:40.976920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":248,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620152+0000","last_change":"2024-05-07T14:04:59.444373+0000","last_active":"2024-05-07T14:05:38.620152+0000","last_peered":"2024-05-07T14:05:38.620152+0000","last_clean":"2024-05-07T14:05:38.620152+0000","last_became_active":"2024-05-07T14:04:59.443620+0000","last_became_peered":"2024-05-07T14:04:59.443620+0000","last_unstale":"2024-05-07T14:05:38.620152+0000","last_undegraded":"2024-05-07T14:05:38.620152+0000","last_fullsized":"2024-05-07T14:05:38.620152+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"124'4","reported_seq":107,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.431015+0000","last_change":"2024-05-07T14:05:36.444547+0000","last_active":"2024-05-07T14:05:38.431015+0000","last_peered":"2024-05-07T14:05:38.431015+0000","last_clean":"2024-05-07T14:05:38.431015+0000","last_became_active":"2024-05-07T14:03:52.787675+0000","last_became_peered":"2024-05-07T14:03:52.787675+0000","last_unstale":"2024-05-07T14:05:38.431015+0000","last_undegraded":"2024-05-07T14:05:38.431015+0000","last_fullsized":"2024-05-07T14:05:38.431015+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'4","last_scrub_stamp":"2024-05-07T14:05:36.444446+0000","last_deep_scrub":"124'4","last_deep_scrub_stamp":"2024-05-07T14:05:36.444446+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.444446+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:36:14.354690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"146'48","reported_seq":266,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.897040+0000","last_change":"2024-05-07T14:05:50.897104+0000","last_active":"2024-05-07T14:05:50.897040+0000","last_peered":"2024-05-07T14:05:50.897040+0000","last_clean":"2024-05-07T14:05:50.897040+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:05:50.897040+0000","last_undegraded":"2024-05-07T14:05:50.897040+0000","last_fullsized":"2024-05-07T14:05:50.897040+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'48","last_scrub_stamp":"2024-05-07T14:05:50.896842+0000","last_deep_scrub":"146'48","last_deep_scrub_stamp":"2024-05-07T14:05:50.896842+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.896842+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:29:48.388971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.545058+0000","last_change":"2024-05-07T14:05:40.545058+0000","last_active":"2024-05-07T14:05:40.545058+0000","last_peered":"2024-05-07T14:05:40.545058+0000","last_clean":"2024-05-07T14:05:40.545058+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:05:40.545058+0000","last_undegraded":"2024-05-07T14:05:40.545058+0000","last_fullsized":"2024-05-07T14:05:40.545058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:40.544810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:40.544810+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.544810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:20.574590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"148'23","reported_seq":272,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.000772+0000","last_change":"2024-05-07T14:05:46.000847+0000","last_active":"2024-05-07T14:05:46.000772+0000","last_peered":"2024-05-07T14:05:46.000772+0000","last_clean":"2024-05-07T14:05:46.000772+0000","last_became_active":"2024-05-07T14:04:59.459102+0000","last_became_peered":"2024-05-07T14:04:59.459102+0000","last_unstale":"2024-05-07T14:05:46.000772+0000","last_undegraded":"2024-05-07T14:05:46.000772+0000","last_fullsized":"2024-05-07T14:05:46.000772+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'23","last_scrub_stamp":"2024-05-07T14:05:46.000594+0000","last_deep_scrub":"148'23","last_deep_scrub_stamp":"2024-05-07T14:05:46.000594+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.000594+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:54.187159+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817537+0000","last_change":"2024-05-07T14:04:59.449322+0000","last_active":"2024-05-07T14:05:38.817537+0000","last_peered":"2024-05-07T14:05:38.817537+0000","last_clean":"2024-05-07T14:05:38.817537+0000","last_became_active":"2024-05-07T14:04:59.448594+0000","last_became_peered":"2024-05-07T14:04:59.448594+0000","last_unstale":"2024-05-07T14:05:38.817537+0000","last_undegraded":"2024-05-07T14:05:38.817537+0000","last_fullsized":"2024-05-07T14:05:38.817537+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"115'6","reported_seq":277,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.457812+0000","last_change":"2024-05-07T14:05:44.457873+0000","last_active":"2024-05-07T14:05:44.457812+0000","last_peered":"2024-05-07T14:05:44.457812+0000","last_clean":"2024-05-07T14:05:44.457812+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:05:44.457812+0000","last_undegraded":"2024-05-07T14:05:44.457812+0000","last_fullsized":"2024-05-07T14:05:44.457812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'6","last_scrub_stamp":"2024-05-07T14:05:44.457606+0000","last_deep_scrub":"115'6","last_deep_scrub_stamp":"2024-05-07T14:05:44.457606+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.457606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:49:01.673952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"146'52","reported_seq":316,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.433753+0000","last_change":"2024-05-07T14:00:55.976868+0000","last_active":"2024-05-07T14:05:38.433753+0000","last_peered":"2024-05-07T14:05:38.433753+0000","last_clean":"2024-05-07T14:05:38.433753+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:05:38.433753+0000","last_undegraded":"2024-05-07T14:05:38.433753+0000","last_fullsized":"2024-05-07T14:05:38.433753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.818575+0000","last_change":"2024-05-07T14:04:59.457249+0000","last_active":"2024-05-07T14:05:38.818575+0000","last_peered":"2024-05-07T14:05:38.818575+0000","last_clean":"2024-05-07T14:05:38.818575+0000","last_became_active":"2024-05-07T14:04:59.455608+0000","last_became_peered":"2024-05-07T14:04:59.455608+0000","last_unstale":"2024-05-07T14:05:38.818575+0000","last_undegraded":"2024-05-07T14:05:38.818575+0000","last_fullsized":"2024-05-07T14:05:38.818575+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"148'39","reported_seq":315,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.249188+0000","last_change":"2024-05-07T14:05:48.249295+0000","last_active":"2024-05-07T14:05:48.249188+0000","last_peered":"2024-05-07T14:05:48.249188+0000","last_clean":"2024-05-07T14:05:48.249188+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:05:48.249188+0000","last_undegraded":"2024-05-07T14:05:48.249188+0000","last_fullsized":"2024-05-07T14:05:48.249188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'39","last_scrub_stamp":"2024-05-07T14:05:48.248967+0000","last_deep_scrub":"148'39","last_deep_scrub_stamp":"2024-05-07T14:05:48.248967+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.248967+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:11.450758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":245,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620696+0000","last_change":"2024-05-07T14:01:04.025771+0000","last_active":"2024-05-07T14:05:38.620696+0000","last_peered":"2024-05-07T14:05:38.620696+0000","last_clean":"2024-05-07T14:05:38.620696+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:05:38.620696+0000","last_undegraded":"2024-05-07T14:05:38.620696+0000","last_fullsized":"2024-05-07T14:05:38.620696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"81'2","reported_seq":247,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.432128+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:05:38.432128+0000","last_peered":"2024-05-07T14:05:38.432128+0000","last_clean":"2024-05-07T14:05:38.432128+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:05:38.432128+0000","last_undegraded":"2024-05-07T14:05:38.432128+0000","last_fullsized":"2024-05-07T14:05:38.432128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"115'8","reported_seq":300,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.818962+0000","last_change":"2024-05-07T14:04:59.457999+0000","last_active":"2024-05-07T14:05:38.818962+0000","last_peered":"2024-05-07T14:05:38.818962+0000","last_clean":"2024-05-07T14:05:38.818962+0000","last_became_active":"2024-05-07T14:04:59.456492+0000","last_became_peered":"2024-05-07T14:04:59.456492+0000","last_unstale":"2024-05-07T14:05:38.818962+0000","last_undegraded":"2024-05-07T14:05:38.818962+0000","last_fullsized":"2024-05-07T14:05:38.818962+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"146'44","reported_seq":314,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.201457+0000","last_change":"2024-05-07T14:05:50.201517+0000","last_active":"2024-05-07T14:05:50.201457+0000","last_peered":"2024-05-07T14:05:50.201457+0000","last_clean":"2024-05-07T14:05:50.201457+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:05:50.201457+0000","last_undegraded":"2024-05-07T14:05:50.201457+0000","last_fullsized":"2024-05-07T14:05:50.201457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'44","last_scrub_stamp":"2024-05-07T14:05:50.201259+0000","last_deep_scrub":"146'44","last_deep_scrub_stamp":"2024-05-07T14:05:50.201259+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.201259+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:07:00.801081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.481649+0000","last_change":"2024-05-07T14:05:38.478809+0000","last_active":"2024-05-07T14:05:38.481649+0000","last_peered":"2024-05-07T14:05:38.481649+0000","last_clean":"2024-05-07T14:05:38.481649+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:05:38.481649+0000","last_undegraded":"2024-05-07T14:05:38.481649+0000","last_fullsized":"2024-05-07T14:05:38.481649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:38.478574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:38.478574+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.478574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:16:37.999538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"146'26","reported_seq":270,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.843008+0000","last_change":"2024-05-07T14:04:59.440283+0000","last_active":"2024-05-07T14:05:38.843008+0000","last_peered":"2024-05-07T14:05:38.843008+0000","last_clean":"2024-05-07T14:05:38.843008+0000","last_became_active":"2024-05-07T14:04:59.439603+0000","last_became_peered":"2024-05-07T14:04:59.439603+0000","last_unstale":"2024-05-07T14:05:38.843008+0000","last_undegraded":"2024-05-07T14:05:38.843008+0000","last_fullsized":"2024-05-07T14:05:38.843008+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":113,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.442175+0000","last_change":"2024-05-07T14:05:37.201385+0000","last_active":"2024-05-07T14:05:38.442175+0000","last_peered":"2024-05-07T14:05:38.442175+0000","last_clean":"2024-05-07T14:05:38.442175+0000","last_became_active":"2024-05-07T14:03:39.666888+0000","last_became_peered":"2024-05-07T14:03:39.666888+0000","last_unstale":"2024-05-07T14:05:38.442175+0000","last_undegraded":"2024-05-07T14:05:38.442175+0000","last_fullsized":"2024-05-07T14:05:38.442175+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.201219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.201219+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.201219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:06.409925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":249,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.480401+0000","last_change":"2024-05-07T14:04:59.456030+0000","last_active":"2024-05-07T14:05:38.480401+0000","last_peered":"2024-05-07T14:05:38.480401+0000","last_clean":"2024-05-07T14:05:38.480401+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:38.480401+0000","last_undegraded":"2024-05-07T14:05:38.480401+0000","last_fullsized":"2024-05-07T14:05:38.480401+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"81'4","reported_seq":274,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.434770+0000","last_change":"2024-05-07T14:00:57.988951+0000","last_active":"2024-05-07T14:05:38.434770+0000","last_peered":"2024-05-07T14:05:38.434770+0000","last_clean":"2024-05-07T14:05:38.434770+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:05:38.434770+0000","last_undegraded":"2024-05-07T14:05:38.434770+0000","last_fullsized":"2024-05-07T14:05:38.434770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"146'54","reported_seq":317,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.428698+0000","last_change":"2024-05-07T14:00:55.978170+0000","last_active":"2024-05-07T14:05:38.428698+0000","last_peered":"2024-05-07T14:05:38.428698+0000","last_clean":"2024-05-07T14:05:38.428698+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:05:38.428698+0000","last_undegraded":"2024-05-07T14:05:38.428698+0000","last_fullsized":"2024-05-07T14:05:38.428698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.691516+0000","last_change":"2024-05-07T14:05:49.691568+0000","last_active":"2024-05-07T14:05:49.691516+0000","last_peered":"2024-05-07T14:05:49.691516+0000","last_clean":"2024-05-07T14:05:49.691516+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:05:49.691516+0000","last_undegraded":"2024-05-07T14:05:49.691516+0000","last_fullsized":"2024-05-07T14:05:49.691516+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:49.691319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:49.691319+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.691319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:26.349257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"146'22","reported_seq":285,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.437184+0000","last_change":"2024-05-07T14:01:02.148494+0000","last_active":"2024-05-07T14:05:38.437184+0000","last_peered":"2024-05-07T14:05:38.437184+0000","last_clean":"2024-05-07T14:05:38.437184+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:05:38.437184+0000","last_undegraded":"2024-05-07T14:05:38.437184+0000","last_fullsized":"2024-05-07T14:05:38.437184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.443659+0000","last_change":"2024-05-07T14:05:38.238816+0000","last_active":"2024-05-07T14:05:38.443659+0000","last_peered":"2024-05-07T14:05:38.443659+0000","last_clean":"2024-05-07T14:05:38.443659+0000","last_became_active":"2024-05-07T14:03:39.663569+0000","last_became_peered":"2024-05-07T14:03:39.663569+0000","last_unstale":"2024-05-07T14:05:38.443659+0000","last_undegraded":"2024-05-07T14:05:38.443659+0000","last_fullsized":"2024-05-07T14:05:38.443659+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:38.238679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:38.238679+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.238679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:04.203961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":257,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.619962+0000","last_change":"2024-05-07T14:05:37.626705+0000","last_active":"2024-05-07T14:05:38.619962+0000","last_peered":"2024-05-07T14:05:38.619962+0000","last_clean":"2024-05-07T14:05:38.619962+0000","last_became_active":"2024-05-07T14:04:59.447025+0000","last_became_peered":"2024-05-07T14:04:59.447025+0000","last_unstale":"2024-05-07T14:05:38.619962+0000","last_undegraded":"2024-05-07T14:05:38.619962+0000","last_fullsized":"2024-05-07T14:05:38.619962+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.626305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.626305+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.626305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:22.857038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"124'14","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.927323+0000","last_change":"2024-05-07T14:05:43.927389+0000","last_active":"2024-05-07T14:05:43.927323+0000","last_peered":"2024-05-07T14:05:43.927323+0000","last_clean":"2024-05-07T14:05:43.927323+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:05:43.927323+0000","last_undegraded":"2024-05-07T14:05:43.927323+0000","last_fullsized":"2024-05-07T14:05:43.927323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'14","last_scrub_stamp":"2024-05-07T14:05:43.927105+0000","last_deep_scrub":"124'14","last_deep_scrub_stamp":"2024-05-07T14:05:43.927105+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.927105+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:35:13.144108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"146'40","reported_seq":302,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817464+0000","last_change":"2024-05-07T14:00:55.978226+0000","last_active":"2024-05-07T14:05:38.817464+0000","last_peered":"2024-05-07T14:05:38.817464+0000","last_clean":"2024-05-07T14:05:38.817464+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:05:38.817464+0000","last_undegraded":"2024-05-07T14:05:38.817464+0000","last_fullsized":"2024-05-07T14:05:38.817464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":253,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.442466+0000","last_change":"2024-05-07T14:00:59.996897+0000","last_active":"2024-05-07T14:05:38.442466+0000","last_peered":"2024-05-07T14:05:38.442466+0000","last_clean":"2024-05-07T14:05:38.442466+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:05:38.442466+0000","last_undegraded":"2024-05-07T14:05:38.442466+0000","last_fullsized":"2024-05-07T14:05:38.442466+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"148'15","reported_seq":280,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.613898+0000","last_change":"2024-05-07T14:05:38.614039+0000","last_active":"2024-05-07T14:05:38.613898+0000","last_peered":"2024-05-07T14:05:38.613898+0000","last_clean":"2024-05-07T14:05:38.613898+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:05:38.613898+0000","last_undegraded":"2024-05-07T14:05:38.613898+0000","last_fullsized":"2024-05-07T14:05:38.613898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'15","last_scrub_stamp":"2024-05-07T14:05:38.613662+0000","last_deep_scrub":"148'15","last_deep_scrub_stamp":"2024-05-07T14:05:38.613662+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.613662+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:07.822368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"146'138","reported_seq":522,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.542933+0000","last_change":"2024-05-07T14:05:41.543002+0000","last_active":"2024-05-07T14:05:41.542933+0000","last_peered":"2024-05-07T14:05:41.542933+0000","last_clean":"2024-05-07T14:05:41.542933+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:05:41.542933+0000","last_undegraded":"2024-05-07T14:05:41.542933+0000","last_fullsized":"2024-05-07T14:05:41.542933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'138","last_scrub_stamp":"2024-05-07T14:05:41.542673+0000","last_deep_scrub":"146'138","last_deep_scrub_stamp":"2024-05-07T14:05:41.542673+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.542673+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:59:42.861721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"81'7","reported_seq":166,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.842180+0000","last_change":"2024-05-07T14:04:59.448265+0000","last_active":"2024-05-07T14:05:38.842180+0000","last_peered":"2024-05-07T14:05:38.842180+0000","last_clean":"2024-05-07T14:05:38.842180+0000","last_became_active":"2024-05-07T14:04:59.444580+0000","last_became_peered":"2024-05-07T14:04:59.444580+0000","last_unstale":"2024-05-07T14:05:38.842180+0000","last_undegraded":"2024-05-07T14:05:38.842180+0000","last_fullsized":"2024-05-07T14:05:38.842180+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"124'8","reported_seq":294,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.427388+0000","last_change":"2024-05-07T14:00:58.000221+0000","last_active":"2024-05-07T14:05:38.427388+0000","last_peered":"2024-05-07T14:05:38.427388+0000","last_clean":"2024-05-07T14:05:38.427388+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:05:38.427388+0000","last_undegraded":"2024-05-07T14:05:38.427388+0000","last_fullsized":"2024-05-07T14:05:38.427388+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"146'40","reported_seq":301,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.621013+0000","last_change":"2024-05-07T14:00:56.012890+0000","last_active":"2024-05-07T14:05:38.621013+0000","last_peered":"2024-05-07T14:05:38.621013+0000","last_clean":"2024-05-07T14:05:38.621013+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:05:38.621013+0000","last_undegraded":"2024-05-07T14:05:38.621013+0000","last_fullsized":"2024-05-07T14:05:38.621013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":222,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.842770+0000","last_change":"2024-05-07T14:04:59.425730+0000","last_active":"2024-05-07T14:05:38.842770+0000","last_peered":"2024-05-07T14:05:38.842770+0000","last_clean":"2024-05-07T14:05:38.842770+0000","last_became_active":"2024-05-07T14:04:59.421636+0000","last_became_peered":"2024-05-07T14:04:59.421636+0000","last_unstale":"2024-05-07T14:05:38.842770+0000","last_undegraded":"2024-05-07T14:05:38.842770+0000","last_fullsized":"2024-05-07T14:05:38.842770+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:58.956299+0000","last_clean_scrub_stamp":"2024-05-07T14:00:58.956299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"146'26","reported_seq":290,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620256+0000","last_change":"2024-05-07T14:01:02.014353+0000","last_active":"2024-05-07T14:05:38.620256+0000","last_peered":"2024-05-07T14:05:38.620256+0000","last_clean":"2024-05-07T14:05:38.620256+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:05:38.620256+0000","last_undegraded":"2024-05-07T14:05:38.620256+0000","last_fullsized":"2024-05-07T14:05:38.620256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.824228+0000","last_change":"2024-05-07T14:05:51.824280+0000","last_active":"2024-05-07T14:05:51.824228+0000","last_peered":"2024-05-07T14:05:51.824228+0000","last_clean":"2024-05-07T14:05:51.824228+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:05:51.824228+0000","last_undegraded":"2024-05-07T14:05:51.824228+0000","last_fullsized":"2024-05-07T14:05:51.824228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:51.824017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:51.824017+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.824017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:29.249577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"124'7","reported_seq":162,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.844458+0000","last_change":"2024-05-07T14:05:02.242073+0000","last_active":"2024-05-07T14:05:38.844458+0000","last_peered":"2024-05-07T14:05:38.844458+0000","last_clean":"2024-05-07T14:05:38.844458+0000","last_became_active":"2024-05-07T14:04:59.467712+0000","last_became_peered":"2024-05-07T14:04:59.467712+0000","last_unstale":"2024-05-07T14:05:38.844458+0000","last_undegraded":"2024-05-07T14:05:38.844458+0000","last_fullsized":"2024-05-07T14:05:38.844458+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"115'2","reported_seq":275,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.653875+0000","last_change":"2024-05-07T14:05:48.653939+0000","last_active":"2024-05-07T14:05:48.653875+0000","last_peered":"2024-05-07T14:05:48.653875+0000","last_clean":"2024-05-07T14:05:48.653875+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:05:48.653875+0000","last_undegraded":"2024-05-07T14:05:48.653875+0000","last_fullsized":"2024-05-07T14:05:48.653875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'2","last_scrub_stamp":"2024-05-07T14:05:48.653679+0000","last_deep_scrub":"115'2","last_deep_scrub_stamp":"2024-05-07T14:05:48.653679+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.653679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:44.088893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"146'50","reported_seq":312,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.622029+0000","last_change":"2024-05-07T14:00:56.005192+0000","last_active":"2024-05-07T14:05:38.622029+0000","last_peered":"2024-05-07T14:05:38.622029+0000","last_clean":"2024-05-07T14:05:38.622029+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:05:38.622029+0000","last_undegraded":"2024-05-07T14:05:38.622029+0000","last_fullsized":"2024-05-07T14:05:38.622029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":261,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.701197+0000","last_change":"2024-05-07T14:05:44.701255+0000","last_active":"2024-05-07T14:05:44.701197+0000","last_peered":"2024-05-07T14:05:44.701197+0000","last_clean":"2024-05-07T14:05:44.701197+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:05:44.701197+0000","last_undegraded":"2024-05-07T14:05:44.701197+0000","last_fullsized":"2024-05-07T14:05:44.701197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:44.700991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:44.700991+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.700991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:33.885801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"148'23","reported_seq":293,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.859633+0000","last_change":"2024-05-07T14:05:45.859633+0000","last_active":"2024-05-07T14:05:45.859633+0000","last_peered":"2024-05-07T14:05:45.859633+0000","last_clean":"2024-05-07T14:05:45.859633+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:05:45.859633+0000","last_undegraded":"2024-05-07T14:05:45.859633+0000","last_fullsized":"2024-05-07T14:05:45.859633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'23","last_scrub_stamp":"2024-05-07T14:05:45.859366+0000","last_deep_scrub":"148'23","last_deep_scrub_stamp":"2024-05-07T14:05:45.859366+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.859366+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:10.494494+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":252,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.480285+0000","last_change":"2024-05-07T14:04:59.466240+0000","last_active":"2024-05-07T14:05:38.480285+0000","last_peered":"2024-05-07T14:05:38.480285+0000","last_clean":"2024-05-07T14:05:38.480285+0000","last_became_active":"2024-05-07T14:04:59.465509+0000","last_became_peered":"2024-05-07T14:04:59.465509+0000","last_unstale":"2024-05-07T14:05:38.480285+0000","last_undegraded":"2024-05-07T14:05:38.480285+0000","last_fullsized":"2024-05-07T14:05:38.480285+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:02.973924+0000","last_clean_scrub_stamp":"2024-05-07T14:01:02.973924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":250,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.488975+0000","last_change":"2024-05-07T14:05:48.489035+0000","last_active":"2024-05-07T14:05:48.488975+0000","last_peered":"2024-05-07T14:05:48.488975+0000","last_clean":"2024-05-07T14:05:48.488975+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:05:48.488975+0000","last_undegraded":"2024-05-07T14:05:48.488975+0000","last_fullsized":"2024-05-07T14:05:48.488975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:48.488773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:48.488773+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.488773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:22.867351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"87'6","reported_seq":284,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.432315+0000","last_change":"2024-05-07T14:00:57.978808+0000","last_active":"2024-05-07T14:05:38.432315+0000","last_peered":"2024-05-07T14:05:38.432315+0000","last_clean":"2024-05-07T14:05:38.432315+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:05:38.432315+0000","last_undegraded":"2024-05-07T14:05:38.432315+0000","last_fullsized":"2024-05-07T14:05:38.432315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"146'38","reported_seq":301,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.435902+0000","last_change":"2024-05-07T14:00:55.978358+0000","last_active":"2024-05-07T14:05:38.435902+0000","last_peered":"2024-05-07T14:05:38.435902+0000","last_clean":"2024-05-07T14:05:38.435902+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:05:38.435902+0000","last_undegraded":"2024-05-07T14:05:38.435902+0000","last_fullsized":"2024-05-07T14:05:38.435902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":264,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.624574+0000","last_change":"2024-05-07T14:05:47.624574+0000","last_active":"2024-05-07T14:05:47.624574+0000","last_peered":"2024-05-07T14:05:47.624574+0000","last_clean":"2024-05-07T14:05:47.624574+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:05:47.624574+0000","last_undegraded":"2024-05-07T14:05:47.624574+0000","last_fullsized":"2024-05-07T14:05:47.624574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:47.624325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:47.624325+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.624325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:41.740511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"146'16","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.433867+0000","last_change":"2024-05-07T14:04:59.460738+0000","last_active":"2024-05-07T14:05:38.433867+0000","last_peered":"2024-05-07T14:05:38.433867+0000","last_clean":"2024-05-07T14:05:38.433867+0000","last_became_active":"2024-05-07T14:04:59.459963+0000","last_became_peered":"2024-05-07T14:04:59.459963+0000","last_unstale":"2024-05-07T14:05:38.433867+0000","last_undegraded":"2024-05-07T14:05:38.433867+0000","last_fullsized":"2024-05-07T14:05:38.433867+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426461+0000","last_change":"2024-05-07T14:05:36.573639+0000","last_active":"2024-05-07T14:05:38.426461+0000","last_peered":"2024-05-07T14:05:38.426461+0000","last_clean":"2024-05-07T14:05:38.426461+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:05:38.426461+0000","last_undegraded":"2024-05-07T14:05:38.426461+0000","last_fullsized":"2024-05-07T14:05:38.426461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:36.573247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:36.573247+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.573247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:29:34.065375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"81'8","reported_seq":235,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.000527+0000","last_change":"2024-05-07T14:05:39.000586+0000","last_active":"2024-05-07T14:05:39.000527+0000","last_peered":"2024-05-07T14:05:39.000527+0000","last_clean":"2024-05-07T14:05:39.000527+0000","last_became_active":"2024-05-07T14:04:59.456842+0000","last_became_peered":"2024-05-07T14:04:59.456842+0000","last_unstale":"2024-05-07T14:05:39.000527+0000","last_undegraded":"2024-05-07T14:05:39.000527+0000","last_fullsized":"2024-05-07T14:05:39.000527+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-05-07T14:05:39.000323+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-05-07T14:05:39.000323+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.000323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:29:10.124568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"115'10","reported_seq":300,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426794+0000","last_change":"2024-05-07T14:00:57.995559+0000","last_active":"2024-05-07T14:05:38.426794+0000","last_peered":"2024-05-07T14:05:38.426794+0000","last_clean":"2024-05-07T14:05:38.426794+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:05:38.426794+0000","last_undegraded":"2024-05-07T14:05:38.426794+0000","last_fullsized":"2024-05-07T14:05:38.426794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"146'44","reported_seq":320,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.818253+0000","last_change":"2024-05-07T14:05:34.912199+0000","last_active":"2024-05-07T14:05:38.818253+0000","last_peered":"2024-05-07T14:05:38.818253+0000","last_clean":"2024-05-07T14:05:38.818253+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:05:38.818253+0000","last_undegraded":"2024-05-07T14:05:38.818253+0000","last_fullsized":"2024-05-07T14:05:38.818253+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'44","last_scrub_stamp":"2024-05-07T14:05:34.912082+0000","last_deep_scrub":"146'44","last_deep_scrub_stamp":"2024-05-07T14:05:34.912082+0000","last_clean_scrub_stamp":"2024-05-07T14:05:34.912082+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:37.886834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"148'2","reported_seq":118,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.173949+0000","last_change":"2024-05-07T14:05:41.174020+0000","last_active":"2024-05-07T14:05:41.173949+0000","last_peered":"2024-05-07T14:05:41.173949+0000","last_clean":"2024-05-07T14:05:41.173949+0000","last_became_active":"2024-05-07T14:03:39.659887+0000","last_became_peered":"2024-05-07T14:03:39.659887+0000","last_unstale":"2024-05-07T14:05:41.173949+0000","last_undegraded":"2024-05-07T14:05:41.173949+0000","last_fullsized":"2024-05-07T14:05:41.173949+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'2","last_scrub_stamp":"2024-05-07T14:05:41.173764+0000","last_deep_scrub":"148'2","last_deep_scrub_stamp":"2024-05-07T14:05:41.173764+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.173764+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:50.492880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"148'23","reported_seq":293,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.594996+0000","last_change":"2024-05-07T14:05:40.595078+0000","last_active":"2024-05-07T14:05:40.594996+0000","last_peered":"2024-05-07T14:05:40.594996+0000","last_clean":"2024-05-07T14:05:40.594996+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:05:40.594996+0000","last_undegraded":"2024-05-07T14:05:40.594996+0000","last_fullsized":"2024-05-07T14:05:40.594996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'23","last_scrub_stamp":"2024-05-07T14:05:40.594787+0000","last_deep_scrub":"148'23","last_deep_scrub_stamp":"2024-05-07T14:05:40.594787+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.594787+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:38:48.903429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.790798+0000","last_change":"2024-05-07T14:05:49.790915+0000","last_active":"2024-05-07T14:05:49.790798+0000","last_peered":"2024-05-07T14:05:49.790798+0000","last_clean":"2024-05-07T14:05:49.790798+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:05:49.790798+0000","last_undegraded":"2024-05-07T14:05:49.790798+0000","last_fullsized":"2024-05-07T14:05:49.790798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:49.790525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:49.790525+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.790525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:41:50.118541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":244,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.429135+0000","last_change":"2024-05-07T14:01:06.028196+0000","last_active":"2024-05-07T14:05:38.429135+0000","last_peered":"2024-05-07T14:05:38.429135+0000","last_clean":"2024-05-07T14:05:38.429135+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:05:38.429135+0000","last_undegraded":"2024-05-07T14:05:38.429135+0000","last_fullsized":"2024-05-07T14:05:38.429135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"87'16","reported_seq":116,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.443063+0000","last_change":"2024-05-07T14:03:39.799013+0000","last_active":"2024-05-07T14:05:38.443063+0000","last_peered":"2024-05-07T14:05:38.443063+0000","last_clean":"2024-05-07T14:05:38.443063+0000","last_became_active":"2024-05-07T14:03:39.671068+0000","last_became_peered":"2024-05-07T14:03:39.671068+0000","last_unstale":"2024-05-07T14:05:38.443063+0000","last_undegraded":"2024-05-07T14:05:38.443063+0000","last_fullsized":"2024-05-07T14:05:38.443063+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"146'44","reported_seq":314,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.440941+0000","last_change":"2024-05-07T14:05:48.441055+0000","last_active":"2024-05-07T14:05:48.440941+0000","last_peered":"2024-05-07T14:05:48.440941+0000","last_clean":"2024-05-07T14:05:48.440941+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:05:48.440941+0000","last_undegraded":"2024-05-07T14:05:48.440941+0000","last_fullsized":"2024-05-07T14:05:48.440941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'44","last_scrub_stamp":"2024-05-07T14:05:48.440708+0000","last_deep_scrub":"146'44","last_deep_scrub_stamp":"2024-05-07T14:05:48.440708+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.440708+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:44.233012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.157085+0000","last_change":"2024-05-07T14:05:40.157085+0000","last_active":"2024-05-07T14:05:40.157085+0000","last_peered":"2024-05-07T14:05:40.157085+0000","last_clean":"2024-05-07T14:05:40.157085+0000","last_became_active":"2024-05-07T14:03:39.661339+0000","last_became_peered":"2024-05-07T14:03:39.661339+0000","last_unstale":"2024-05-07T14:05:40.157085+0000","last_undegraded":"2024-05-07T14:05:40.157085+0000","last_fullsized":"2024-05-07T14:05:40.157085+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:40.156796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:40.156796+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.156796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:35.949101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"146'34","reported_seq":300,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.424727+0000","last_change":"2024-05-07T14:01:37.554125+0000","last_active":"2024-05-07T14:05:38.424727+0000","last_peered":"2024-05-07T14:05:38.424727+0000","last_clean":"2024-05-07T14:05:38.424727+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:05:38.424727+0000","last_undegraded":"2024-05-07T14:05:38.424727+0000","last_fullsized":"2024-05-07T14:05:38.424727+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"81'6","reported_seq":289,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.621600+0000","last_change":"2024-05-07T14:04:59.467441+0000","last_active":"2024-05-07T14:05:38.621600+0000","last_peered":"2024-05-07T14:05:38.621600+0000","last_clean":"2024-05-07T14:05:38.621600+0000","last_became_active":"2024-05-07T14:04:59.466443+0000","last_became_peered":"2024-05-07T14:04:59.466443+0000","last_unstale":"2024-05-07T14:05:38.621600+0000","last_undegraded":"2024-05-07T14:05:38.621600+0000","last_fullsized":"2024-05-07T14:05:38.621600+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"146'50","reported_seq":312,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620955+0000","last_change":"2024-05-07T14:00:56.005638+0000","last_active":"2024-05-07T14:05:38.620955+0000","last_peered":"2024-05-07T14:05:38.620955+0000","last_clean":"2024-05-07T14:05:38.620955+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:05:38.620955+0000","last_undegraded":"2024-05-07T14:05:38.620955+0000","last_fullsized":"2024-05-07T14:05:38.620955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"124'4","reported_seq":130,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.443283+0000","last_change":"2024-05-07T14:04:59.861145+0000","last_active":"2024-05-07T14:05:38.443283+0000","last_peered":"2024-05-07T14:05:38.443283+0000","last_clean":"2024-05-07T14:05:38.443283+0000","last_became_active":"2024-05-07T14:04:59.445932+0000","last_became_peered":"2024-05-07T14:04:59.445932+0000","last_unstale":"2024-05-07T14:05:38.443283+0000","last_undegraded":"2024-05-07T14:05:38.443283+0000","last_fullsized":"2024-05-07T14:05:38.443283+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"146'54","reported_seq":318,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817775+0000","last_change":"2024-05-07T14:00:55.976849+0000","last_active":"2024-05-07T14:05:38.817775+0000","last_peered":"2024-05-07T14:05:38.817775+0000","last_clean":"2024-05-07T14:05:38.817775+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:05:38.817775+0000","last_undegraded":"2024-05-07T14:05:38.817775+0000","last_fullsized":"2024-05-07T14:05:38.817775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"81'2","reported_seq":274,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.433609+0000","last_change":"2024-05-07T14:04:59.448690+0000","last_active":"2024-05-07T14:05:38.433609+0000","last_peered":"2024-05-07T14:05:38.433609+0000","last_clean":"2024-05-07T14:05:38.433609+0000","last_became_active":"2024-05-07T14:04:59.447844+0000","last_became_peered":"2024-05-07T14:04:59.447844+0000","last_unstale":"2024-05-07T14:05:38.433609+0000","last_undegraded":"2024-05-07T14:05:38.433609+0000","last_fullsized":"2024-05-07T14:05:38.433609+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"146'42","reported_seq":305,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.434988+0000","last_change":"2024-05-07T14:00:55.986747+0000","last_active":"2024-05-07T14:05:38.434988+0000","last_peered":"2024-05-07T14:05:38.434988+0000","last_clean":"2024-05-07T14:05:38.434988+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:05:38.434988+0000","last_undegraded":"2024-05-07T14:05:38.434988+0000","last_fullsized":"2024-05-07T14:05:38.434988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":268,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.614242+0000","last_change":"2024-05-07T14:05:42.614305+0000","last_active":"2024-05-07T14:05:42.614242+0000","last_peered":"2024-05-07T14:05:42.614242+0000","last_clean":"2024-05-07T14:05:42.614242+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:05:42.614242+0000","last_undegraded":"2024-05-07T14:05:42.614242+0000","last_fullsized":"2024-05-07T14:05:42.614242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:42.614017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:42.614017+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.614017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:51.933134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"146'56","reported_seq":167,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.443272+0000","last_change":"2024-05-07T14:03:39.789159+0000","last_active":"2024-05-07T14:05:38.443272+0000","last_peered":"2024-05-07T14:05:38.443272+0000","last_clean":"2024-05-07T14:05:38.443272+0000","last_became_active":"2024-05-07T14:03:39.668790+0000","last_became_peered":"2024-05-07T14:03:39.668790+0000","last_unstale":"2024-05-07T14:05:38.443272+0000","last_undegraded":"2024-05-07T14:05:38.443272+0000","last_fullsized":"2024-05-07T14:05:38.443272+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"81'8","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.431720+0000","last_change":"2024-05-07T14:05:37.485873+0000","last_active":"2024-05-07T14:05:38.431720+0000","last_peered":"2024-05-07T14:05:38.431720+0000","last_clean":"2024-05-07T14:05:38.431720+0000","last_became_active":"2024-05-07T14:03:39.666451+0000","last_became_peered":"2024-05-07T14:03:39.666451+0000","last_unstale":"2024-05-07T14:05:38.431720+0000","last_undegraded":"2024-05-07T14:05:38.431720+0000","last_fullsized":"2024-05-07T14:05:38.431720+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-05-07T14:05:37.485738+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-05-07T14:05:37.485738+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.485738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:47:16.171782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"146'44","reported_seq":324,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.481915+0000","last_change":"2024-05-07T14:05:00.248173+0000","last_active":"2024-05-07T14:05:38.481915+0000","last_peered":"2024-05-07T14:05:38.481915+0000","last_clean":"2024-05-07T14:05:38.481915+0000","last_became_active":"2024-05-07T14:04:59.455622+0000","last_became_peered":"2024-05-07T14:04:59.455622+0000","last_unstale":"2024-05-07T14:05:38.481915+0000","last_undegraded":"2024-05-07T14:05:38.481915+0000","last_fullsized":"2024-05-07T14:05:38.481915+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"115'2","reported_seq":266,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.480265+0000","last_change":"2024-05-07T14:00:57.979288+0000","last_active":"2024-05-07T14:05:38.480265+0000","last_peered":"2024-05-07T14:05:38.480265+0000","last_clean":"2024-05-07T14:05:38.480265+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:05:38.480265+0000","last_undegraded":"2024-05-07T14:05:38.480265+0000","last_fullsized":"2024-05-07T14:05:38.480265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"146'40","reported_seq":303,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.436727+0000","last_change":"2024-05-07T14:00:55.987687+0000","last_active":"2024-05-07T14:05:38.436727+0000","last_peered":"2024-05-07T14:05:38.436727+0000","last_clean":"2024-05-07T14:05:38.436727+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:05:38.436727+0000","last_undegraded":"2024-05-07T14:05:38.436727+0000","last_fullsized":"2024-05-07T14:05:38.436727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"106'2","reported_seq":268,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.818248+0000","last_change":"2024-05-07T14:00:57.981305+0000","last_active":"2024-05-07T14:05:38.818248+0000","last_peered":"2024-05-07T14:05:38.818248+0000","last_clean":"2024-05-07T14:05:38.818248+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:05:38.818248+0000","last_undegraded":"2024-05-07T14:05:38.818248+0000","last_fullsized":"2024-05-07T14:05:38.818248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"146'56","reported_seq":319,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.621257+0000","last_change":"2024-05-07T14:00:56.011138+0000","last_active":"2024-05-07T14:05:38.621257+0000","last_peered":"2024-05-07T14:05:38.621257+0000","last_clean":"2024-05-07T14:05:38.621257+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:05:38.621257+0000","last_undegraded":"2024-05-07T14:05:38.621257+0000","last_fullsized":"2024-05-07T14:05:38.621257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.429101+0000","last_change":"2024-05-07T14:00:58.001596+0000","last_active":"2024-05-07T14:05:38.429101+0000","last_peered":"2024-05-07T14:05:38.429101+0000","last_clean":"2024-05-07T14:05:38.429101+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:05:38.429101+0000","last_undegraded":"2024-05-07T14:05:38.429101+0000","last_fullsized":"2024-05-07T14:05:38.429101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"146'48","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.432189+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:05:38.432189+0000","last_peered":"2024-05-07T14:05:38.432189+0000","last_clean":"2024-05-07T14:05:38.432189+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:05:38.432189+0000","last_undegraded":"2024-05-07T14:05:38.432189+0000","last_fullsized":"2024-05-07T14:05:38.432189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"106'4","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.907874+0000","last_change":"2024-05-07T14:05:41.907938+0000","last_active":"2024-05-07T14:05:41.907874+0000","last_peered":"2024-05-07T14:05:41.907874+0000","last_clean":"2024-05-07T14:05:41.907874+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:05:41.907874+0000","last_undegraded":"2024-05-07T14:05:41.907874+0000","last_fullsized":"2024-05-07T14:05:41.907874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'4","last_scrub_stamp":"2024-05-07T14:05:41.907625+0000","last_deep_scrub":"106'4","last_deep_scrub_stamp":"2024-05-07T14:05:41.907625+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.907625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:29.391287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"146'54","reported_seq":336,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620758+0000","last_change":"2024-05-07T14:04:59.856502+0000","last_active":"2024-05-07T14:05:38.620758+0000","last_peered":"2024-05-07T14:05:38.620758+0000","last_clean":"2024-05-07T14:05:38.620758+0000","last_became_active":"2024-05-07T14:04:59.443769+0000","last_became_peered":"2024-05-07T14:04:59.443769+0000","last_unstale":"2024-05-07T14:05:38.620758+0000","last_undegraded":"2024-05-07T14:05:38.620758+0000","last_fullsized":"2024-05-07T14:05:38.620758+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":268,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.570398+0000","last_change":"2024-05-07T14:05:44.570475+0000","last_active":"2024-05-07T14:05:44.570398+0000","last_peered":"2024-05-07T14:05:44.570398+0000","last_clean":"2024-05-07T14:05:44.570398+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:05:44.570398+0000","last_undegraded":"2024-05-07T14:05:44.570398+0000","last_fullsized":"2024-05-07T14:05:44.570398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:44.570170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:44.570170+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.570170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:53:24.319990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"146'54","reported_seq":341,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.818088+0000","last_change":"2024-05-07T14:05:01.098433+0000","last_active":"2024-05-07T14:05:38.818088+0000","last_peered":"2024-05-07T14:05:38.818088+0000","last_clean":"2024-05-07T14:05:38.818088+0000","last_became_active":"2024-05-07T14:04:59.458388+0000","last_became_peered":"2024-05-07T14:04:59.458388+0000","last_unstale":"2024-05-07T14:05:38.818088+0000","last_undegraded":"2024-05-07T14:05:38.818088+0000","last_fullsized":"2024-05-07T14:05:38.818088+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"81'6","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.013642+0000","last_change":"2024-05-07T14:05:52.013748+0000","last_active":"2024-05-07T14:05:52.013642+0000","last_peered":"2024-05-07T14:05:52.013642+0000","last_clean":"2024-05-07T14:05:52.013642+0000","last_became_active":"2024-05-07T14:04:59.448913+0000","last_became_peered":"2024-05-07T14:04:59.448913+0000","last_unstale":"2024-05-07T14:05:52.013642+0000","last_undegraded":"2024-05-07T14:05:52.013642+0000","last_fullsized":"2024-05-07T14:05:52.013642+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-05-07T14:05:52.013425+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-05-07T14:05:52.013425+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.013425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:49.967919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"146'58","reported_seq":328,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.479580+0000","last_change":"2024-05-07T14:05:50.479646+0000","last_active":"2024-05-07T14:05:50.479580+0000","last_peered":"2024-05-07T14:05:50.479580+0000","last_clean":"2024-05-07T14:05:50.479580+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:05:50.479580+0000","last_undegraded":"2024-05-07T14:05:50.479580+0000","last_fullsized":"2024-05-07T14:05:50.479580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'58","last_scrub_stamp":"2024-05-07T14:05:50.479363+0000","last_deep_scrub":"146'58","last_deep_scrub_stamp":"2024-05-07T14:05:50.479363+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.479363+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:39:29.015503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"87'2","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.802716+0000","last_change":"2024-05-07T14:05:50.802841+0000","last_active":"2024-05-07T14:05:50.802716+0000","last_peered":"2024-05-07T14:05:50.802716+0000","last_clean":"2024-05-07T14:05:50.802716+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:05:50.802716+0000","last_undegraded":"2024-05-07T14:05:50.802716+0000","last_fullsized":"2024-05-07T14:05:50.802716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-05-07T14:05:50.802458+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-05-07T14:05:50.802458+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.802458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:18:14.732397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"146'46","reported_seq":298,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.843214+0000","last_change":"2024-05-07T14:05:02.233669+0000","last_active":"2024-05-07T14:05:38.843214+0000","last_peered":"2024-05-07T14:05:38.843214+0000","last_clean":"2024-05-07T14:05:38.843214+0000","last_became_active":"2024-05-07T14:04:59.459490+0000","last_became_peered":"2024-05-07T14:04:59.459490+0000","last_unstale":"2024-05-07T14:05:38.843214+0000","last_undegraded":"2024-05-07T14:05:38.843214+0000","last_fullsized":"2024-05-07T14:05:38.843214+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"81'6","reported_seq":285,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.431631+0000","last_change":"2024-05-07T14:00:57.983177+0000","last_active":"2024-05-07T14:05:38.431631+0000","last_peered":"2024-05-07T14:05:38.431631+0000","last_clean":"2024-05-07T14:05:38.431631+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:05:38.431631+0000","last_undegraded":"2024-05-07T14:05:38.431631+0000","last_fullsized":"2024-05-07T14:05:38.431631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"146'52","reported_seq":321,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.917840+0000","last_change":"2024-05-07T14:05:40.917902+0000","last_active":"2024-05-07T14:05:40.917840+0000","last_peered":"2024-05-07T14:05:40.917840+0000","last_clean":"2024-05-07T14:05:40.917840+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:05:40.917840+0000","last_undegraded":"2024-05-07T14:05:40.917840+0000","last_fullsized":"2024-05-07T14:05:40.917840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'52","last_scrub_stamp":"2024-05-07T14:05:40.917639+0000","last_deep_scrub":"146'52","last_deep_scrub_stamp":"2024-05-07T14:05:40.917639+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.917639+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:24:20.060632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"124'6","reported_seq":204,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.841662+0000","last_change":"2024-05-07T14:05:00.223495+0000","last_active":"2024-05-07T14:05:38.841662+0000","last_peered":"2024-05-07T14:05:38.841662+0000","last_clean":"2024-05-07T14:05:38.841662+0000","last_became_active":"2024-05-07T14:04:59.442569+0000","last_became_peered":"2024-05-07T14:04:59.442569+0000","last_unstale":"2024-05-07T14:05:38.841662+0000","last_undegraded":"2024-05-07T14:05:38.841662+0000","last_fullsized":"2024-05-07T14:05:38.841662+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"146'52","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.622630+0000","last_change":"2024-05-07T14:05:01.256475+0000","last_active":"2024-05-07T14:05:38.622630+0000","last_peered":"2024-05-07T14:05:38.622630+0000","last_clean":"2024-05-07T14:05:38.622630+0000","last_became_active":"2024-05-07T14:04:59.461335+0000","last_became_peered":"2024-05-07T14:04:59.461335+0000","last_unstale":"2024-05-07T14:05:38.622630+0000","last_undegraded":"2024-05-07T14:05:38.622630+0000","last_fullsized":"2024-05-07T14:05:38.622630+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"146'48","reported_seq":310,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620956+0000","last_change":"2024-05-07T14:00:55.995389+0000","last_active":"2024-05-07T14:05:38.620956+0000","last_peered":"2024-05-07T14:05:38.620956+0000","last_clean":"2024-05-07T14:05:38.620956+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:05:38.620956+0000","last_undegraded":"2024-05-07T14:05:38.620956+0000","last_fullsized":"2024-05-07T14:05:38.620956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"124'4","reported_seq":275,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.818155+0000","last_change":"2024-05-07T14:00:57.982183+0000","last_active":"2024-05-07T14:05:38.818155+0000","last_peered":"2024-05-07T14:05:38.818155+0000","last_clean":"2024-05-07T14:05:38.818155+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:05:38.818155+0000","last_undegraded":"2024-05-07T14:05:38.818155+0000","last_fullsized":"2024-05-07T14:05:38.818155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"146'42","reported_seq":304,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.441648+0000","last_change":"2024-05-07T14:00:55.981423+0000","last_active":"2024-05-07T14:05:38.441648+0000","last_peered":"2024-05-07T14:05:38.441648+0000","last_clean":"2024-05-07T14:05:38.441648+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:05:38.441648+0000","last_undegraded":"2024-05-07T14:05:38.441648+0000","last_fullsized":"2024-05-07T14:05:38.441648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"106'4","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.828674+0000","last_change":"2024-05-07T14:05:50.828744+0000","last_active":"2024-05-07T14:05:50.828674+0000","last_peered":"2024-05-07T14:05:50.828674+0000","last_clean":"2024-05-07T14:05:50.828674+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:05:50.828674+0000","last_undegraded":"2024-05-07T14:05:50.828674+0000","last_fullsized":"2024-05-07T14:05:50.828674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'4","last_scrub_stamp":"2024-05-07T14:05:50.828427+0000","last_deep_scrub":"106'4","last_deep_scrub_stamp":"2024-05-07T14:05:50.828427+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.828427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:06.508029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":313,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1118,"ondisk_log_size":1118,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1062,"num_read_kb":1544,"num_write":545,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":121255,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5538,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":954,"ondisk_log_size":954,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":351,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1436,"num_read_kb":1404,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":620756992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":129,"seq":554050781197,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38020,"kb_used_data":1788,"kb_used_omap":6,"kb_used_meta":36217,"kb_avail":94333820,"statfs":{"total":96636764160,"available":96597831680,"internally_reserved":0,"allocated":1830912,"data_stored":1072724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6345,"internal_metadata":37087031},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37680,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334160,"statfs":{"total":96636764160,"available":96598179840,"internally_reserved":0,"allocated":2400256,"data_stored":1662432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37144,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334696,"statfs":{"total":96636764160,"available":96598728704,"internally_reserved":0,"allocated":1851392,"data_stored":1072892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37092,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1798144,"data_stored":1072555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37700,"kb_used_data":2364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334140,"statfs":{"total":96636764160,"available":96598159360,"internally_reserved":0,"allocated":2420736,"data_stored":1663220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1802240,"data_stored":1072073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37124,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334716,"statfs":{"total":96636764160,"available":96598749184,"internally_reserved":0,"allocated":1830912,"data_stored":1073699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37112,"kb_used_data":1776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334728,"statfs":{"total":96636764160,"available":96598761472,"internally_reserved":0,"allocated":1818624,"data_stored":1072577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:05:58.584 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.584 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.584 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.584 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.584 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.584 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.585 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.585 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.585 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.585 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.585 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.585 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.585 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.585 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.586 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.586 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.586 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.586 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.586 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.586 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.586 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.586 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.587 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.587 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.587 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.587 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.587 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.587 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.587 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.587 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.588 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.588 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.588 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.588 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.588 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.588 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.588 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.588 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.588 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.589 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.589 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.589 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.589 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.589 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.589 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.589 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.589 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.590 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.590 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.590 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.590 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-07T14:00:43.807655+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=43, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.590 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-07T14:00:48.897311+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=48, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.590 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.590 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.590 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.591 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-07T14:00:48.897311+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=48, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.591 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.591 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.591 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.591 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.592 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-07T14:00:48.897311+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=48, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.592 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.592 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.592 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.592 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.593 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.593 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.593 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.593 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.593 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.593 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.593 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.593 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.594 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-07T14:00:48.897311+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=48, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.594 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.594 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.594 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.594 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.594 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.594 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.594 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.595 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.595 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.595 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.595 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.595 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.595 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.595 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.595 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.596 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.596 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.596 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.596 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.596 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.596 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.596 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.596 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.596 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.597 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.597 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.597 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.597 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.597 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.597 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-07T14:00:58.956299+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=58, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.597 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.597 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.598 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.598 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-07T14:01:02.973924+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=2, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.598 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.598 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.599 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.599 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.599 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.599 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.599 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.599 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.599 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.599 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.600 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.600 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.600 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.600 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.600 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.600 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.600 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.600 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.600 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.601 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.601 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.601 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.601 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.601 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.601 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.601 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.601 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.602 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.602 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.602 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:05:58.602 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-07T14:06:18.604 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:06:18.933 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:06:18.939 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:06:18.951 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-05-07T14:06:17.351121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":623988,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4834,"num_read_kb":3736,"num_write":4429,"num_write_kb":6187921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":621470484,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5538,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5710,"ondisk_log_size":5710,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":303128,"kb_used_data":15384,"kb_used_omap":17,"kb_used_meta":287662,"kb_avail":754671592,"statfs":{"total":773094113280,"available":772783710208,"internally_reserved":0,"allocated":15753216,"data_stored":9762172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17505,"internal_metadata":294566815},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005934"},"pg_stats":[{"pgid":"3.3f","version":"146'58","reported_seq":323,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:06.988956+0000","last_change":"2024-05-07T14:06:06.989079+0000","last_active":"2024-05-07T14:06:06.988956+0000","last_peered":"2024-05-07T14:06:06.988956+0000","last_clean":"2024-05-07T14:06:06.988956+0000","last_became_active":"2024-05-07T14:04:59.458324+0000","last_became_peered":"2024-05-07T14:04:59.458324+0000","last_unstale":"2024-05-07T14:06:06.988956+0000","last_undegraded":"2024-05-07T14:06:06.988956+0000","last_fullsized":"2024-05-07T14:06:06.988956+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'58","last_scrub_stamp":"2024-05-07T14:06:06.988657+0000","last_deep_scrub":"146'58","last_deep_scrub_stamp":"2024-05-07T14:06:06.988657+0000","last_clean_scrub_stamp":"2024-05-07T14:06:06.988657+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:45.205091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'2","reported_seq":275,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.754782+0000","last_change":"2024-05-07T14:05:46.754782+0000","last_active":"2024-05-07T14:05:46.754782+0000","last_peered":"2024-05-07T14:05:46.754782+0000","last_clean":"2024-05-07T14:05:46.754782+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:05:46.754782+0000","last_undegraded":"2024-05-07T14:05:46.754782+0000","last_fullsized":"2024-05-07T14:05:46.754782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:05:46.754495+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:05:46.754495+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.754495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:36.485364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"146'58","reported_seq":176,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:02.265950+0000","last_change":"2024-05-07T14:06:02.266011+0000","last_active":"2024-05-07T14:06:02.265950+0000","last_peered":"2024-05-07T14:06:02.265950+0000","last_clean":"2024-05-07T14:06:02.265950+0000","last_became_active":"2024-05-07T14:03:39.676092+0000","last_became_peered":"2024-05-07T14:03:39.676092+0000","last_unstale":"2024-05-07T14:06:02.265950+0000","last_undegraded":"2024-05-07T14:06:02.265950+0000","last_fullsized":"2024-05-07T14:06:02.265950+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'58","last_scrub_stamp":"2024-05-07T14:06:02.265741+0000","last_deep_scrub":"146'58","last_deep_scrub_stamp":"2024-05-07T14:06:02.265741+0000","last_clean_scrub_stamp":"2024-05-07T14:06:02.265741+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:39.691301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"80'2","reported_seq":185,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.003090+0000","last_change":"2024-05-07T14:06:00.003154+0000","last_active":"2024-05-07T14:06:00.003090+0000","last_peered":"2024-05-07T14:06:00.003090+0000","last_clean":"2024-05-07T14:06:00.003090+0000","last_became_active":"2024-05-07T14:04:59.430479+0000","last_became_peered":"2024-05-07T14:04:59.430479+0000","last_unstale":"2024-05-07T14:06:00.003090+0000","last_undegraded":"2024-05-07T14:06:00.003090+0000","last_fullsized":"2024-05-07T14:06:00.003090+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:06:00.002873+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:06:00.002873+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.002873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:48.104362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"146'40","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.821171+0000","last_change":"2024-05-07T14:05:57.821293+0000","last_active":"2024-05-07T14:05:57.821171+0000","last_peered":"2024-05-07T14:05:57.821171+0000","last_clean":"2024-05-07T14:05:57.821171+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:05:57.821171+0000","last_undegraded":"2024-05-07T14:05:57.821171+0000","last_fullsized":"2024-05-07T14:05:57.821171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'40","last_scrub_stamp":"2024-05-07T14:05:57.820865+0000","last_deep_scrub":"146'40","last_deep_scrub_stamp":"2024-05-07T14:05:57.820865+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.820865+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:51:21.968189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'2","reported_seq":277,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.574550+0000","last_change":"2024-05-07T14:05:41.574550+0000","last_active":"2024-05-07T14:05:41.574550+0000","last_peered":"2024-05-07T14:05:41.574550+0000","last_clean":"2024-05-07T14:05:41.574550+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:05:41.574550+0000","last_undegraded":"2024-05-07T14:05:41.574550+0000","last_fullsized":"2024-05-07T14:05:41.574550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:05:41.574288+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:05:41.574288+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.574288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:37.366593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"146'50","reported_seq":320,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.850855+0000","last_change":"2024-05-07T14:05:58.850916+0000","last_active":"2024-05-07T14:05:58.850855+0000","last_peered":"2024-05-07T14:05:58.850855+0000","last_clean":"2024-05-07T14:05:58.850855+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:05:58.850855+0000","last_undegraded":"2024-05-07T14:05:58.850855+0000","last_fullsized":"2024-05-07T14:05:58.850855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'50","last_scrub_stamp":"2024-05-07T14:05:58.850619+0000","last_deep_scrub":"146'50","last_deep_scrub_stamp":"2024-05-07T14:05:58.850619+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.850619+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:23.658777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"81'2","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.791219+0000","last_change":"2024-05-07T14:05:52.791219+0000","last_active":"2024-05-07T14:05:52.791219+0000","last_peered":"2024-05-07T14:05:52.791219+0000","last_clean":"2024-05-07T14:05:52.791219+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:05:52.791219+0000","last_undegraded":"2024-05-07T14:05:52.791219+0000","last_fullsized":"2024-05-07T14:05:52.791219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:05:52.790950+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:05:52.790950+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.790950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:52:37.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"146'48","reported_seq":309,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.969379+0000","last_change":"2024-05-07T14:06:03.969439+0000","last_active":"2024-05-07T14:06:03.969379+0000","last_peered":"2024-05-07T14:06:03.969379+0000","last_clean":"2024-05-07T14:06:03.969379+0000","last_became_active":"2024-05-07T14:04:59.455288+0000","last_became_peered":"2024-05-07T14:04:59.455288+0000","last_unstale":"2024-05-07T14:06:03.969379+0000","last_undegraded":"2024-05-07T14:06:03.969379+0000","last_fullsized":"2024-05-07T14:06:03.969379+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'48","last_scrub_stamp":"2024-05-07T14:06:03.969182+0000","last_deep_scrub":"146'48","last_deep_scrub_stamp":"2024-05-07T14:06:03.969182+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.969182+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:51.640685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"115'4","reported_seq":282,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.550698+0000","last_change":"2024-05-07T14:05:54.550756+0000","last_active":"2024-05-07T14:05:54.550698+0000","last_peered":"2024-05-07T14:05:54.550698+0000","last_clean":"2024-05-07T14:05:54.550698+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:05:54.550698+0000","last_undegraded":"2024-05-07T14:05:54.550698+0000","last_fullsized":"2024-05-07T14:05:54.550698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'4","last_scrub_stamp":"2024-05-07T14:05:54.550511+0000","last_deep_scrub":"115'4","last_deep_scrub_stamp":"2024-05-07T14:05:54.550511+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.550511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:36:20.137024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"146'38","reported_seq":308,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:06.949130+0000","last_change":"2024-05-07T14:06:06.949195+0000","last_active":"2024-05-07T14:06:06.949130+0000","last_peered":"2024-05-07T14:06:06.949130+0000","last_clean":"2024-05-07T14:06:06.949130+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:06:06.949130+0000","last_undegraded":"2024-05-07T14:06:06.949130+0000","last_fullsized":"2024-05-07T14:06:06.949130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'38","last_scrub_stamp":"2024-05-07T14:06:06.948924+0000","last_deep_scrub":"146'38","last_deep_scrub_stamp":"2024-05-07T14:06:06.948924+0000","last_clean_scrub_stamp":"2024-05-07T14:06:06.948924+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:18:35.955083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"115'4","reported_seq":285,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.714859+0000","last_change":"2024-05-07T14:05:50.714975+0000","last_active":"2024-05-07T14:05:50.714859+0000","last_peered":"2024-05-07T14:05:50.714859+0000","last_clean":"2024-05-07T14:05:50.714859+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:05:50.714859+0000","last_undegraded":"2024-05-07T14:05:50.714859+0000","last_fullsized":"2024-05-07T14:05:50.714859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'4","last_scrub_stamp":"2024-05-07T14:05:50.714550+0000","last_deep_scrub":"115'4","last_deep_scrub_stamp":"2024-05-07T14:05:50.714550+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.714550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:35.945284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"146'50","reported_seq":312,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.052088+0000","last_change":"2024-05-07T14:05:51.052149+0000","last_active":"2024-05-07T14:05:51.052088+0000","last_peered":"2024-05-07T14:05:51.052088+0000","last_clean":"2024-05-07T14:05:51.052088+0000","last_became_active":"2024-05-07T14:04:59.444214+0000","last_became_peered":"2024-05-07T14:04:59.444214+0000","last_unstale":"2024-05-07T14:05:51.052088+0000","last_undegraded":"2024-05-07T14:05:51.052088+0000","last_fullsized":"2024-05-07T14:05:51.052088+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'50","last_scrub_stamp":"2024-05-07T14:05:51.051888+0000","last_deep_scrub":"146'50","last_deep_scrub_stamp":"2024-05-07T14:05:51.051888+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.051888+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:56:42.668989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"81'2","reported_seq":274,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.774289+0000","last_change":"2024-05-07T14:05:48.774351+0000","last_active":"2024-05-07T14:05:48.774289+0000","last_peered":"2024-05-07T14:05:48.774289+0000","last_clean":"2024-05-07T14:05:48.774289+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:05:48.774289+0000","last_undegraded":"2024-05-07T14:05:48.774289+0000","last_fullsized":"2024-05-07T14:05:48.774289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:05:48.774054+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:05:48.774054+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.774054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:12.303840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"146'46","reported_seq":309,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.431753+0000","last_change":"2024-05-07T14:00:56.015630+0000","last_active":"2024-05-07T14:05:38.431753+0000","last_peered":"2024-05-07T14:05:38.431753+0000","last_clean":"2024-05-07T14:05:38.431753+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:05:38.431753+0000","last_undegraded":"2024-05-07T14:05:38.431753+0000","last_fullsized":"2024-05-07T14:05:38.431753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"124'4","reported_seq":282,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.891811+0000","last_change":"2024-05-07T14:05:42.891878+0000","last_active":"2024-05-07T14:05:42.891811+0000","last_peered":"2024-05-07T14:05:42.891811+0000","last_clean":"2024-05-07T14:05:42.891811+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:05:42.891811+0000","last_undegraded":"2024-05-07T14:05:42.891811+0000","last_fullsized":"2024-05-07T14:05:42.891811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'4","last_scrub_stamp":"2024-05-07T14:05:42.891601+0000","last_deep_scrub":"124'4","last_deep_scrub_stamp":"2024-05-07T14:05:42.891601+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.891601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:55:14.857156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2","reported_seq":277,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.591369+0000","last_change":"2024-05-07T14:05:43.591429+0000","last_active":"2024-05-07T14:05:43.591369+0000","last_peered":"2024-05-07T14:05:43.591369+0000","last_clean":"2024-05-07T14:05:43.591369+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:05:43.591369+0000","last_undegraded":"2024-05-07T14:05:43.591369+0000","last_fullsized":"2024-05-07T14:05:43.591369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:05:43.591140+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:05:43.591140+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.591140+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:24:48.976262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"146'46","reported_seq":305,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:04.988295+0000","last_change":"2024-05-07T14:06:04.988356+0000","last_active":"2024-05-07T14:06:04.988295+0000","last_peered":"2024-05-07T14:06:04.988295+0000","last_clean":"2024-05-07T14:06:04.988295+0000","last_became_active":"2024-05-07T14:04:59.452315+0000","last_became_peered":"2024-05-07T14:04:59.452315+0000","last_unstale":"2024-05-07T14:06:04.988295+0000","last_undegraded":"2024-05-07T14:06:04.988295+0000","last_fullsized":"2024-05-07T14:06:04.988295+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:06:04.988090+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:06:04.988090+0000","last_clean_scrub_stamp":"2024-05-07T14:06:04.988090+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:56:57.640414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.033431+0000","last_change":"2024-05-07T14:05:58.033504+0000","last_active":"2024-05-07T14:05:58.033431+0000","last_peered":"2024-05-07T14:05:58.033431+0000","last_clean":"2024-05-07T14:05:58.033431+0000","last_became_active":"2024-05-07T14:04:59.429254+0000","last_became_peered":"2024-05-07T14:04:59.429254+0000","last_unstale":"2024-05-07T14:05:58.033431+0000","last_undegraded":"2024-05-07T14:05:58.033431+0000","last_fullsized":"2024-05-07T14:05:58.033431+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:58.033210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:58.033210+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.033210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:08:52.773715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"146'46","reported_seq":316,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.458093+0000","last_change":"2024-05-07T14:05:52.458159+0000","last_active":"2024-05-07T14:05:52.458093+0000","last_peered":"2024-05-07T14:05:52.458093+0000","last_clean":"2024-05-07T14:05:52.458093+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:05:52.458093+0000","last_undegraded":"2024-05-07T14:05:52.458093+0000","last_fullsized":"2024-05-07T14:05:52.458093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:05:52.457878+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:05:52.457878+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.457878+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:31.728642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":266,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.872999+0000","last_change":"2024-05-07T14:05:52.873056+0000","last_active":"2024-05-07T14:05:52.872999+0000","last_peered":"2024-05-07T14:05:52.872999+0000","last_clean":"2024-05-07T14:05:52.872999+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:05:52.872999+0000","last_undegraded":"2024-05-07T14:05:52.872999+0000","last_fullsized":"2024-05-07T14:05:52.872999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:52.872793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:52.872793+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.872793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:03:18.882228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"146'62","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.503780+0000","last_change":"2024-05-07T14:05:51.503907+0000","last_active":"2024-05-07T14:05:51.503780+0000","last_peered":"2024-05-07T14:05:51.503780+0000","last_clean":"2024-05-07T14:05:51.503780+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:05:51.503780+0000","last_undegraded":"2024-05-07T14:05:51.503780+0000","last_fullsized":"2024-05-07T14:05:51.503780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'62","last_scrub_stamp":"2024-05-07T14:05:51.503543+0000","last_deep_scrub":"146'62","last_deep_scrub_stamp":"2024-05-07T14:05:51.503543+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.503543+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:22.820463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"124'10","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.920441+0000","last_change":"2024-05-07T14:05:51.920505+0000","last_active":"2024-05-07T14:05:51.920441+0000","last_peered":"2024-05-07T14:05:51.920441+0000","last_clean":"2024-05-07T14:05:51.920441+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:05:51.920441+0000","last_undegraded":"2024-05-07T14:05:51.920441+0000","last_fullsized":"2024-05-07T14:05:51.920441+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'10","last_scrub_stamp":"2024-05-07T14:05:51.919944+0000","last_deep_scrub":"124'10","last_deep_scrub_stamp":"2024-05-07T14:05:51.919944+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.919944+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:21.369904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"146'54","reported_seq":326,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.631929+0000","last_change":"2024-05-07T14:06:00.631995+0000","last_active":"2024-05-07T14:06:00.631929+0000","last_peered":"2024-05-07T14:06:00.631929+0000","last_clean":"2024-05-07T14:06:00.631929+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:06:00.631929+0000","last_undegraded":"2024-05-07T14:06:00.631929+0000","last_fullsized":"2024-05-07T14:06:00.631929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:06:00.631705+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:06:00.631705+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.631705+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:42:00.959721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"106'8","reported_seq":286,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.934186+0000","last_change":"2024-05-07T14:05:44.934186+0000","last_active":"2024-05-07T14:05:44.934186+0000","last_peered":"2024-05-07T14:05:44.934186+0000","last_clean":"2024-05-07T14:05:44.934186+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:05:44.934186+0000","last_undegraded":"2024-05-07T14:05:44.934186+0000","last_fullsized":"2024-05-07T14:05:44.934186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'8","last_scrub_stamp":"2024-05-07T14:05:44.933739+0000","last_deep_scrub":"106'8","last_deep_scrub_stamp":"2024-05-07T14:05:44.933739+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.933739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:16:10.865536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"146'64","reported_seq":335,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:07.551158+0000","last_change":"2024-05-07T14:06:07.551272+0000","last_active":"2024-05-07T14:06:07.551158+0000","last_peered":"2024-05-07T14:06:07.551158+0000","last_clean":"2024-05-07T14:06:07.551158+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:06:07.551158+0000","last_undegraded":"2024-05-07T14:06:07.551158+0000","last_fullsized":"2024-05-07T14:06:07.551158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'64","last_scrub_stamp":"2024-05-07T14:06:07.550929+0000","last_deep_scrub":"146'64","last_deep_scrub_stamp":"2024-05-07T14:06:07.550929+0000","last_clean_scrub_stamp":"2024-05-07T14:06:07.550929+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:31:56.299265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"106'2","reported_seq":291,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:11.793604+0000","last_change":"2024-05-07T14:06:11.793724+0000","last_active":"2024-05-07T14:06:11.793604+0000","last_peered":"2024-05-07T14:06:11.793604+0000","last_clean":"2024-05-07T14:06:11.793604+0000","last_became_active":"2024-05-07T14:03:39.663590+0000","last_became_peered":"2024-05-07T14:03:39.663590+0000","last_unstale":"2024-05-07T14:06:11.793604+0000","last_undegraded":"2024-05-07T14:06:11.793604+0000","last_fullsized":"2024-05-07T14:06:11.793604+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'2","last_scrub_stamp":"2024-05-07T14:06:11.793356+0000","last_deep_scrub":"106'2","last_deep_scrub_stamp":"2024-05-07T14:06:11.793356+0000","last_clean_scrub_stamp":"2024-05-07T14:06:11.793356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:36.601514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"146'38","reported_seq":309,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.764860+0000","last_change":"2024-05-07T14:05:59.764925+0000","last_active":"2024-05-07T14:05:59.764860+0000","last_peered":"2024-05-07T14:05:59.764860+0000","last_clean":"2024-05-07T14:05:59.764860+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:05:59.764860+0000","last_undegraded":"2024-05-07T14:05:59.764860+0000","last_fullsized":"2024-05-07T14:05:59.764860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'38","last_scrub_stamp":"2024-05-07T14:05:59.764645+0000","last_deep_scrub":"146'38","last_deep_scrub_stamp":"2024-05-07T14:05:59.764645+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.764645+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:55:00.950336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":252,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:06.742612+0000","last_change":"2024-05-07T14:06:06.742668+0000","last_active":"2024-05-07T14:06:06.742612+0000","last_peered":"2024-05-07T14:06:06.742612+0000","last_clean":"2024-05-07T14:06:06.742612+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:06:06.742612+0000","last_undegraded":"2024-05-07T14:06:06.742612+0000","last_fullsized":"2024-05-07T14:06:06.742612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:06.742415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:06.742415+0000","last_clean_scrub_stamp":"2024-05-07T14:06:06.742415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:43.264418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"81'2","reported_seq":302,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.488541+0000","last_change":"2024-05-07T14:05:39.488599+0000","last_active":"2024-05-07T14:05:39.488541+0000","last_peered":"2024-05-07T14:05:39.488541+0000","last_clean":"2024-05-07T14:05:39.488541+0000","last_became_active":"2024-05-07T14:05:38.439123+0000","last_became_peered":"2024-05-07T14:05:38.439123+0000","last_unstale":"2024-05-07T14:05:39.488541+0000","last_undegraded":"2024-05-07T14:05:39.488541+0000","last_fullsized":"2024-05-07T14:05:39.488541+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:05:39.488348+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:05:39.488348+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.488348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:20:26.483034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"146'38","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.894987+0000","last_change":"2024-05-07T14:05:48.895102+0000","last_active":"2024-05-07T14:05:48.894987+0000","last_peered":"2024-05-07T14:05:48.894987+0000","last_clean":"2024-05-07T14:05:48.894987+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:05:48.894987+0000","last_undegraded":"2024-05-07T14:05:48.894987+0000","last_fullsized":"2024-05-07T14:05:48.894987+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'38","last_scrub_stamp":"2024-05-07T14:05:48.894689+0000","last_deep_scrub":"146'38","last_deep_scrub_stamp":"2024-05-07T14:05:48.894689+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.894689+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:38:49.851294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.749510+0000","last_change":"2024-05-07T14:05:47.749510+0000","last_active":"2024-05-07T14:05:47.749510+0000","last_peered":"2024-05-07T14:05:47.749510+0000","last_clean":"2024-05-07T14:05:47.749510+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:05:47.749510+0000","last_undegraded":"2024-05-07T14:05:47.749510+0000","last_fullsized":"2024-05-07T14:05:47.749510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:47.749269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:47.749269+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.749269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:48.516892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"148'24","reported_seq":302,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:07.652799+0000","last_change":"2024-05-07T14:06:07.652873+0000","last_active":"2024-05-07T14:06:07.652799+0000","last_peered":"2024-05-07T14:06:07.652799+0000","last_clean":"2024-05-07T14:06:07.652799+0000","last_became_active":"2024-05-07T14:04:59.455429+0000","last_became_peered":"2024-05-07T14:04:59.455429+0000","last_unstale":"2024-05-07T14:06:07.652799+0000","last_undegraded":"2024-05-07T14:06:07.652799+0000","last_fullsized":"2024-05-07T14:06:07.652799+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'24","last_scrub_stamp":"2024-05-07T14:06:07.652605+0000","last_deep_scrub":"148'24","last_deep_scrub_stamp":"2024-05-07T14:06:07.652605+0000","last_clean_scrub_stamp":"2024-05-07T14:06:07.652605+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:18:36.658764+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.998040+0000","last_change":"2024-05-07T14:05:39.998091+0000","last_active":"2024-05-07T14:05:39.998040+0000","last_peered":"2024-05-07T14:05:39.998040+0000","last_clean":"2024-05-07T14:05:39.998040+0000","last_became_active":"2024-05-07T14:04:59.456374+0000","last_became_peered":"2024-05-07T14:04:59.456374+0000","last_unstale":"2024-05-07T14:05:39.998040+0000","last_undegraded":"2024-05-07T14:05:39.998040+0000","last_fullsized":"2024-05-07T14:05:39.998040+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:39.997849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:39.997849+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.997849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:36.795773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"148'51","reported_seq":322,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.680748+0000","last_change":"2024-05-07T14:05:42.680748+0000","last_active":"2024-05-07T14:05:42.680748+0000","last_peered":"2024-05-07T14:05:42.680748+0000","last_clean":"2024-05-07T14:05:42.680748+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:05:42.680748+0000","last_undegraded":"2024-05-07T14:05:42.680748+0000","last_fullsized":"2024-05-07T14:05:42.680748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'51","last_scrub_stamp":"2024-05-07T14:05:42.680364+0000","last_deep_scrub":"148'51","last_deep_scrub_stamp":"2024-05-07T14:05:42.680364+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.680364+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:36:42.767270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"81'6","reported_seq":297,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:11.920696+0000","last_change":"2024-05-07T14:06:11.920760+0000","last_active":"2024-05-07T14:06:11.920696+0000","last_peered":"2024-05-07T14:06:11.920696+0000","last_clean":"2024-05-07T14:06:11.920696+0000","last_became_active":"2024-05-07T14:04:59.466480+0000","last_became_peered":"2024-05-07T14:04:59.466480+0000","last_unstale":"2024-05-07T14:06:11.920696+0000","last_undegraded":"2024-05-07T14:06:11.920696+0000","last_fullsized":"2024-05-07T14:06:11.920696+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-05-07T14:06:11.920481+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-05-07T14:06:11.920481+0000","last_clean_scrub_stamp":"2024-05-07T14:06:11.920481+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:31.763345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"146'40","reported_seq":335,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:11.645005+0000","last_change":"2024-05-07T14:06:11.645067+0000","last_active":"2024-05-07T14:06:11.645005+0000","last_peered":"2024-05-07T14:06:11.645005+0000","last_clean":"2024-05-07T14:06:11.645005+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:06:11.645005+0000","last_undegraded":"2024-05-07T14:06:11.645005+0000","last_fullsized":"2024-05-07T14:06:11.645005+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'40","last_scrub_stamp":"2024-05-07T14:06:11.644803+0000","last_deep_scrub":"146'40","last_deep_scrub_stamp":"2024-05-07T14:06:11.644803+0000","last_clean_scrub_stamp":"2024-05-07T14:06:11.644803+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:58:17.389707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":270,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.484711+0000","last_change":"2024-05-07T14:05:45.484764+0000","last_active":"2024-05-07T14:05:45.484711+0000","last_peered":"2024-05-07T14:05:45.484711+0000","last_clean":"2024-05-07T14:05:45.484711+0000","last_became_active":"2024-05-07T14:04:59.445994+0000","last_became_peered":"2024-05-07T14:04:59.445994+0000","last_unstale":"2024-05-07T14:05:45.484711+0000","last_undegraded":"2024-05-07T14:05:45.484711+0000","last_fullsized":"2024-05-07T14:05:45.484711+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:45.484518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:45.484518+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.484518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:36:45.571424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"148'10","reported_seq":273,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.667704+0000","last_change":"2024-05-07T14:05:55.667805+0000","last_active":"2024-05-07T14:05:55.667704+0000","last_peered":"2024-05-07T14:05:55.667704+0000","last_clean":"2024-05-07T14:05:55.667704+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:05:55.667704+0000","last_undegraded":"2024-05-07T14:05:55.667704+0000","last_fullsized":"2024-05-07T14:05:55.667704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'10","last_scrub_stamp":"2024-05-07T14:05:55.667518+0000","last_deep_scrub":"148'10","last_deep_scrub_stamp":"2024-05-07T14:05:55.667518+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.667518+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:41.766526+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.428033+0000","last_change":"2024-05-07T14:05:37.597661+0000","last_active":"2024-05-07T14:05:38.428033+0000","last_peered":"2024-05-07T14:05:38.428033+0000","last_clean":"2024-05-07T14:05:38.428033+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:05:38.428033+0000","last_undegraded":"2024-05-07T14:05:38.428033+0000","last_fullsized":"2024-05-07T14:05:38.428033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.597397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.597397+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.597397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:07.047357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"115'8","reported_seq":264,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.856052+0000","last_change":"2024-05-07T14:05:40.856052+0000","last_active":"2024-05-07T14:05:40.856052+0000","last_peered":"2024-05-07T14:05:40.856052+0000","last_clean":"2024-05-07T14:05:40.856052+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:05:40.856052+0000","last_undegraded":"2024-05-07T14:05:40.856052+0000","last_fullsized":"2024-05-07T14:05:40.856052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'8","last_scrub_stamp":"2024-05-07T14:05:40.855774+0000","last_deep_scrub":"115'8","last_deep_scrub_stamp":"2024-05-07T14:05:40.855774+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.855774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:55.295194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"81'4","reported_seq":284,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.693425+0000","last_change":"2024-05-07T14:06:03.693491+0000","last_active":"2024-05-07T14:06:03.693425+0000","last_peered":"2024-05-07T14:06:03.693425+0000","last_clean":"2024-05-07T14:06:03.693425+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:06:03.693425+0000","last_undegraded":"2024-05-07T14:06:03.693425+0000","last_fullsized":"2024-05-07T14:06:03.693425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-05-07T14:06:03.693219+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-05-07T14:06:03.693219+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.693219+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:50:31.682172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"146'32","reported_seq":288,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.027629+0000","last_change":"2024-05-07T14:05:47.027693+0000","last_active":"2024-05-07T14:05:47.027629+0000","last_peered":"2024-05-07T14:05:47.027629+0000","last_clean":"2024-05-07T14:05:47.027629+0000","last_became_active":"2024-05-07T14:04:59.436710+0000","last_became_peered":"2024-05-07T14:04:59.436710+0000","last_unstale":"2024-05-07T14:05:47.027629+0000","last_undegraded":"2024-05-07T14:05:47.027629+0000","last_fullsized":"2024-05-07T14:05:47.027629+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'32","last_scrub_stamp":"2024-05-07T14:05:47.027424+0000","last_deep_scrub":"146'32","last_deep_scrub_stamp":"2024-05-07T14:05:47.027424+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.027424+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:00.845074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":273,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.460794+0000","last_change":"2024-05-07T14:05:46.460794+0000","last_active":"2024-05-07T14:05:46.460794+0000","last_peered":"2024-05-07T14:05:46.460794+0000","last_clean":"2024-05-07T14:05:46.460794+0000","last_became_active":"2024-05-07T14:03:39.680482+0000","last_became_peered":"2024-05-07T14:03:39.680482+0000","last_unstale":"2024-05-07T14:05:46.460794+0000","last_undegraded":"2024-05-07T14:05:46.460794+0000","last_fullsized":"2024-05-07T14:05:46.460794+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:46.460537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:46.460537+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.460537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:48:46.840513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"146'18","reported_seq":280,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426015+0000","last_change":"2024-05-07T14:05:36.059934+0000","last_active":"2024-05-07T14:05:38.426015+0000","last_peered":"2024-05-07T14:05:38.426015+0000","last_clean":"2024-05-07T14:05:38.426015+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:05:38.426015+0000","last_undegraded":"2024-05-07T14:05:38.426015+0000","last_fullsized":"2024-05-07T14:05:38.426015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'18","last_scrub_stamp":"2024-05-07T14:05:36.059800+0000","last_deep_scrub":"146'18","last_deep_scrub_stamp":"2024-05-07T14:05:36.059800+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.059800+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:08:00.724380+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"148'145","reported_seq":430,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:08.950459+0000","last_change":"2024-05-07T14:06:08.950520+0000","last_active":"2024-05-07T14:06:08.950459+0000","last_peered":"2024-05-07T14:06:08.950459+0000","last_clean":"2024-05-07T14:06:08.950459+0000","last_became_active":"2024-05-07T14:04:59.463533+0000","last_became_peered":"2024-05-07T14:04:59.463533+0000","last_unstale":"2024-05-07T14:06:08.950459+0000","last_undegraded":"2024-05-07T14:06:08.950459+0000","last_fullsized":"2024-05-07T14:06:08.950459+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'145","last_scrub_stamp":"2024-05-07T14:06:08.950262+0000","last_deep_scrub":"148'145","last_deep_scrub_stamp":"2024-05-07T14:06:08.950262+0000","last_clean_scrub_stamp":"2024-05-07T14:06:08.950262+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:48:22.388505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":252,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:09.771661+0000","last_change":"2024-05-07T14:06:09.771715+0000","last_active":"2024-05-07T14:06:09.771661+0000","last_peered":"2024-05-07T14:06:09.771661+0000","last_clean":"2024-05-07T14:06:09.771661+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:06:09.771661+0000","last_undegraded":"2024-05-07T14:06:09.771661+0000","last_fullsized":"2024-05-07T14:06:09.771661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:09.771416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:09.771416+0000","last_clean_scrub_stamp":"2024-05-07T14:06:09.771416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:39.553281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"87'16","reported_seq":309,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.436718+0000","last_change":"2024-05-07T14:04:59.462968+0000","last_active":"2024-05-07T14:05:38.436718+0000","last_peered":"2024-05-07T14:05:38.436718+0000","last_clean":"2024-05-07T14:05:38.436718+0000","last_became_active":"2024-05-07T14:04:59.461575+0000","last_became_peered":"2024-05-07T14:04:59.461575+0000","last_unstale":"2024-05-07T14:05:38.436718+0000","last_undegraded":"2024-05-07T14:05:38.436718+0000","last_fullsized":"2024-05-07T14:05:38.436718+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"146'52","reported_seq":322,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.480149+0000","last_change":"2024-05-07T14:05:47.480262+0000","last_active":"2024-05-07T14:05:47.480149+0000","last_peered":"2024-05-07T14:05:47.480149+0000","last_clean":"2024-05-07T14:05:47.480149+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:05:47.480149+0000","last_undegraded":"2024-05-07T14:05:47.480149+0000","last_fullsized":"2024-05-07T14:05:47.480149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'52","last_scrub_stamp":"2024-05-07T14:05:47.479956+0000","last_deep_scrub":"146'52","last_deep_scrub_stamp":"2024-05-07T14:05:47.479956+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.479956+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:33:52.588231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.661760+0000","last_change":"2024-05-07T14:05:43.661760+0000","last_active":"2024-05-07T14:05:43.661760+0000","last_peered":"2024-05-07T14:05:43.661760+0000","last_clean":"2024-05-07T14:05:43.661760+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:05:43.661760+0000","last_undegraded":"2024-05-07T14:05:43.661760+0000","last_fullsized":"2024-05-07T14:05:43.661760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:43.661509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:43.661509+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.661509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:48:44.041486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"148'23","reported_seq":272,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.982444+0000","last_change":"2024-05-07T14:05:40.982516+0000","last_active":"2024-05-07T14:05:40.982444+0000","last_peered":"2024-05-07T14:05:40.982444+0000","last_clean":"2024-05-07T14:05:40.982444+0000","last_became_active":"2024-05-07T14:04:59.459905+0000","last_became_peered":"2024-05-07T14:04:59.459905+0000","last_unstale":"2024-05-07T14:05:40.982444+0000","last_undegraded":"2024-05-07T14:05:40.982444+0000","last_fullsized":"2024-05-07T14:05:40.982444+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'23","last_scrub_stamp":"2024-05-07T14:05:40.982249+0000","last_deep_scrub":"148'23","last_deep_scrub_stamp":"2024-05-07T14:05:40.982249+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.982249+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:22:06.341816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"146'138","reported_seq":445,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.509726+0000","last_change":"2024-05-07T14:05:57.509792+0000","last_active":"2024-05-07T14:05:57.509726+0000","last_peered":"2024-05-07T14:05:57.509726+0000","last_clean":"2024-05-07T14:05:57.509726+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:05:57.509726+0000","last_undegraded":"2024-05-07T14:05:57.509726+0000","last_fullsized":"2024-05-07T14:05:57.509726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'138","last_scrub_stamp":"2024-05-07T14:05:57.509471+0000","last_deep_scrub":"146'138","last_deep_scrub_stamp":"2024-05-07T14:05:57.509471+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.509471+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:51:21.656794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"81'4","reported_seq":290,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.632057+0000","last_change":"2024-05-07T14:05:41.632117+0000","last_active":"2024-05-07T14:05:41.632057+0000","last_peered":"2024-05-07T14:05:41.632057+0000","last_clean":"2024-05-07T14:05:41.632057+0000","last_became_active":"2024-05-07T14:04:59.446891+0000","last_became_peered":"2024-05-07T14:04:59.446891+0000","last_unstale":"2024-05-07T14:05:41.632057+0000","last_undegraded":"2024-05-07T14:05:41.632057+0000","last_fullsized":"2024-05-07T14:05:41.632057+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-05-07T14:05:41.631851+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-05-07T14:05:41.631851+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.631851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:17:36.333634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"146'66","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:05.963473+0000","last_change":"2024-05-07T14:06:05.963536+0000","last_active":"2024-05-07T14:06:05.963473+0000","last_peered":"2024-05-07T14:06:05.963473+0000","last_clean":"2024-05-07T14:06:05.963473+0000","last_became_active":"2024-05-07T14:04:59.452426+0000","last_became_peered":"2024-05-07T14:04:59.452426+0000","last_unstale":"2024-05-07T14:06:05.963473+0000","last_undegraded":"2024-05-07T14:06:05.963473+0000","last_fullsized":"2024-05-07T14:06:05.963473+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'66","last_scrub_stamp":"2024-05-07T14:06:05.963271+0000","last_deep_scrub":"146'66","last_deep_scrub_stamp":"2024-05-07T14:06:05.963271+0000","last_clean_scrub_stamp":"2024-05-07T14:06:05.963271+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:39.617457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.995021+0000","last_change":"2024-05-07T14:06:01.995084+0000","last_active":"2024-05-07T14:06:01.995021+0000","last_peered":"2024-05-07T14:06:01.995021+0000","last_clean":"2024-05-07T14:06:01.995021+0000","last_became_active":"2024-05-07T14:04:59.445281+0000","last_became_peered":"2024-05-07T14:04:59.445281+0000","last_unstale":"2024-05-07T14:06:01.995021+0000","last_undegraded":"2024-05-07T14:06:01.995021+0000","last_fullsized":"2024-05-07T14:06:01.995021+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:01.994790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:01.994790+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.994790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:16:53.780576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"148'39","reported_seq":313,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.898284+0000","last_change":"2024-05-07T14:05:55.898362+0000","last_active":"2024-05-07T14:05:55.898284+0000","last_peered":"2024-05-07T14:05:55.898284+0000","last_clean":"2024-05-07T14:05:55.898284+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:05:55.898284+0000","last_undegraded":"2024-05-07T14:05:55.898284+0000","last_fullsized":"2024-05-07T14:05:55.898284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'39","last_scrub_stamp":"2024-05-07T14:05:55.898103+0000","last_deep_scrub":"148'39","last_deep_scrub_stamp":"2024-05-07T14:05:55.898103+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.898103+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:47:55.298985+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.441789+0000","last_change":"2024-05-07T14:05:35.125928+0000","last_active":"2024-05-07T14:05:38.441789+0000","last_peered":"2024-05-07T14:05:38.441789+0000","last_clean":"2024-05-07T14:05:38.441789+0000","last_became_active":"2024-05-07T14:03:39.666160+0000","last_became_peered":"2024-05-07T14:03:39.666160+0000","last_unstale":"2024-05-07T14:05:38.441789+0000","last_undegraded":"2024-05-07T14:05:38.441789+0000","last_fullsized":"2024-05-07T14:05:38.441789+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:35.125820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:35.125820+0000","last_clean_scrub_stamp":"2024-05-07T14:05:35.125820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:29:32.617948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":250,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.659495+0000","last_change":"2024-05-07T14:05:40.659600+0000","last_active":"2024-05-07T14:05:40.659495+0000","last_peered":"2024-05-07T14:05:40.659495+0000","last_clean":"2024-05-07T14:05:40.659495+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:05:40.659495+0000","last_undegraded":"2024-05-07T14:05:40.659495+0000","last_fullsized":"2024-05-07T14:05:40.659495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:40.659258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:40.659258+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.659258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:13:49.643039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":268,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.665415+0000","last_change":"2024-05-07T14:05:52.665470+0000","last_active":"2024-05-07T14:05:52.665415+0000","last_peered":"2024-05-07T14:05:52.665415+0000","last_clean":"2024-05-07T14:05:52.665415+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:05:52.665415+0000","last_undegraded":"2024-05-07T14:05:52.665415+0000","last_fullsized":"2024-05-07T14:05:52.665415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:52.665190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:52.665190+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.665190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:45:56.540696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"146'54","reported_seq":317,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.999034+0000","last_change":"2024-05-07T14:05:44.999096+0000","last_active":"2024-05-07T14:05:44.999034+0000","last_peered":"2024-05-07T14:05:44.999034+0000","last_clean":"2024-05-07T14:05:44.999034+0000","last_became_active":"2024-05-07T14:04:59.421863+0000","last_became_peered":"2024-05-07T14:04:59.421863+0000","last_unstale":"2024-05-07T14:05:44.999034+0000","last_undegraded":"2024-05-07T14:05:44.999034+0000","last_fullsized":"2024-05-07T14:05:44.999034+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:05:44.998813+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:05:44.998813+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.998813+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:11.327557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"148'2","reported_seq":354,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.892612+0000","last_change":"2024-05-07T14:05:45.892680+0000","last_active":"2024-05-07T14:05:45.892612+0000","last_peered":"2024-05-07T14:05:45.892612+0000","last_clean":"2024-05-07T14:05:45.892612+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:05:45.892612+0000","last_undegraded":"2024-05-07T14:05:45.892612+0000","last_fullsized":"2024-05-07T14:05:45.892612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'2","last_scrub_stamp":"2024-05-07T14:05:45.892424+0000","last_deep_scrub":"148'2","last_deep_scrub_stamp":"2024-05-07T14:05:45.892424+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.892424+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:16:45.413388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"146'20","reported_seq":290,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.433715+0000","last_change":"2024-05-07T14:04:59.447540+0000","last_active":"2024-05-07T14:05:38.433715+0000","last_peered":"2024-05-07T14:05:38.433715+0000","last_clean":"2024-05-07T14:05:38.433715+0000","last_became_active":"2024-05-07T14:04:59.446737+0000","last_became_peered":"2024-05-07T14:04:59.446737+0000","last_unstale":"2024-05-07T14:05:38.433715+0000","last_undegraded":"2024-05-07T14:05:38.433715+0000","last_fullsized":"2024-05-07T14:05:38.433715+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.517159+0000","last_change":"2024-05-07T14:05:59.517210+0000","last_active":"2024-05-07T14:05:59.517159+0000","last_peered":"2024-05-07T14:05:59.517159+0000","last_clean":"2024-05-07T14:05:59.517159+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:05:59.517159+0000","last_undegraded":"2024-05-07T14:05:59.517159+0000","last_fullsized":"2024-05-07T14:05:59.517159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:59.516967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:59.516967+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.516967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:29.298832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"115'4","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.517294+0000","last_change":"2024-05-07T14:05:57.517354+0000","last_active":"2024-05-07T14:05:57.517294+0000","last_peered":"2024-05-07T14:05:57.517294+0000","last_clean":"2024-05-07T14:05:57.517294+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:05:57.517294+0000","last_undegraded":"2024-05-07T14:05:57.517294+0000","last_fullsized":"2024-05-07T14:05:57.517294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'4","last_scrub_stamp":"2024-05-07T14:05:57.517103+0000","last_deep_scrub":"115'4","last_deep_scrub_stamp":"2024-05-07T14:05:57.517103+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.517103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:53:18.211022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"81'6","reported_seq":292,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.495700+0000","last_change":"2024-05-07T14:05:46.495767+0000","last_active":"2024-05-07T14:05:46.495700+0000","last_peered":"2024-05-07T14:05:46.495700+0000","last_clean":"2024-05-07T14:05:46.495700+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:05:46.495700+0000","last_undegraded":"2024-05-07T14:05:46.495700+0000","last_fullsized":"2024-05-07T14:05:46.495700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-05-07T14:05:46.495497+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-05-07T14:05:46.495497+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.495497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:20:31.482387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"146'58","reported_seq":318,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.842838+0000","last_change":"2024-05-07T14:05:37.984970+0000","last_active":"2024-05-07T14:05:38.842838+0000","last_peered":"2024-05-07T14:05:38.842838+0000","last_clean":"2024-05-07T14:05:38.842838+0000","last_became_active":"2024-05-07T14:04:59.449454+0000","last_became_peered":"2024-05-07T14:04:59.449454+0000","last_unstale":"2024-05-07T14:05:38.842838+0000","last_undegraded":"2024-05-07T14:05:38.842838+0000","last_fullsized":"2024-05-07T14:05:38.842838+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'58","last_scrub_stamp":"2024-05-07T14:05:37.984690+0000","last_deep_scrub":"146'58","last_deep_scrub_stamp":"2024-05-07T14:05:37.984690+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.984690+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:51.666200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":261,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.927875+0000","last_change":"2024-05-07T14:05:46.927979+0000","last_active":"2024-05-07T14:05:46.927875+0000","last_peered":"2024-05-07T14:05:46.927875+0000","last_clean":"2024-05-07T14:05:46.927875+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:05:46.927875+0000","last_undegraded":"2024-05-07T14:05:46.927875+0000","last_fullsized":"2024-05-07T14:05:46.927875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:46.927640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:46.927640+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.927640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:07.934671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"148'32","reported_seq":284,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.050877+0000","last_change":"2024-05-07T14:05:44.050966+0000","last_active":"2024-05-07T14:05:44.050877+0000","last_peered":"2024-05-07T14:05:44.050877+0000","last_clean":"2024-05-07T14:05:44.050877+0000","last_became_active":"2024-05-07T14:04:59.458512+0000","last_became_peered":"2024-05-07T14:04:59.458512+0000","last_unstale":"2024-05-07T14:05:44.050877+0000","last_undegraded":"2024-05-07T14:05:44.050877+0000","last_fullsized":"2024-05-07T14:05:44.050877+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'32","last_scrub_stamp":"2024-05-07T14:05:44.050666+0000","last_deep_scrub":"148'32","last_deep_scrub_stamp":"2024-05-07T14:05:44.050666+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.050666+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:35:28.204523+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"146'142","reported_seq":469,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.816317+0000","last_change":"2024-05-07T14:05:35.870612+0000","last_active":"2024-05-07T14:05:38.816317+0000","last_peered":"2024-05-07T14:05:38.816317+0000","last_clean":"2024-05-07T14:05:38.816317+0000","last_became_active":"2024-05-07T14:03:42.700324+0000","last_became_peered":"2024-05-07T14:03:42.700324+0000","last_unstale":"2024-05-07T14:05:38.816317+0000","last_undegraded":"2024-05-07T14:05:38.816317+0000","last_fullsized":"2024-05-07T14:05:38.816317+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'142","last_scrub_stamp":"2024-05-07T14:05:35.870457+0000","last_deep_scrub":"146'142","last_deep_scrub_stamp":"2024-05-07T14:05:35.870457+0000","last_clean_scrub_stamp":"2024-05-07T14:05:35.870457+0000","objects_scrubbed":1,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:45.950605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:05.696993+0000","last_change":"2024-05-07T14:06:05.697102+0000","last_active":"2024-05-07T14:06:05.696993+0000","last_peered":"2024-05-07T14:06:05.696993+0000","last_clean":"2024-05-07T14:06:05.696993+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:06:05.696993+0000","last_undegraded":"2024-05-07T14:06:05.696993+0000","last_fullsized":"2024-05-07T14:06:05.696993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:05.696679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:05.696679+0000","last_clean_scrub_stamp":"2024-05-07T14:06:05.696679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:23.874396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"124'10","reported_seq":297,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.793018+0000","last_change":"2024-05-07T14:05:48.793083+0000","last_active":"2024-05-07T14:05:48.793018+0000","last_peered":"2024-05-07T14:05:48.793018+0000","last_clean":"2024-05-07T14:05:48.793018+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:05:48.793018+0000","last_undegraded":"2024-05-07T14:05:48.793018+0000","last_fullsized":"2024-05-07T14:05:48.793018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'10","last_scrub_stamp":"2024-05-07T14:05:48.792805+0000","last_deep_scrub":"124'10","last_deep_scrub_stamp":"2024-05-07T14:05:48.792805+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.792805+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:38.523674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"146'72","reported_seq":342,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:04.960341+0000","last_change":"2024-05-07T14:06:04.960403+0000","last_active":"2024-05-07T14:06:04.960341+0000","last_peered":"2024-05-07T14:06:04.960341+0000","last_clean":"2024-05-07T14:06:04.960341+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:06:04.960341+0000","last_undegraded":"2024-05-07T14:06:04.960341+0000","last_fullsized":"2024-05-07T14:06:04.960341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'72","last_scrub_stamp":"2024-05-07T14:06:04.960135+0000","last_deep_scrub":"146'72","last_deep_scrub_stamp":"2024-05-07T14:06:04.960135+0000","last_clean_scrub_stamp":"2024-05-07T14:06:04.960135+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:23.137853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":261,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.425462+0000","last_change":"2024-05-07T14:05:37.005828+0000","last_active":"2024-05-07T14:05:38.425462+0000","last_peered":"2024-05-07T14:05:38.425462+0000","last_clean":"2024-05-07T14:05:38.425462+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:05:38.425462+0000","last_undegraded":"2024-05-07T14:05:38.425462+0000","last_fullsized":"2024-05-07T14:05:38.425462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.005735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.005735+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.005735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:36:36.882585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"148'39","reported_seq":325,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.843926+0000","last_change":"2024-05-07T14:05:39.843992+0000","last_active":"2024-05-07T14:05:39.843926+0000","last_peered":"2024-05-07T14:05:39.843926+0000","last_clean":"2024-05-07T14:05:39.843926+0000","last_became_active":"2024-05-07T14:04:59.455284+0000","last_became_peered":"2024-05-07T14:04:59.455284+0000","last_unstale":"2024-05-07T14:05:39.843926+0000","last_undegraded":"2024-05-07T14:05:39.843926+0000","last_fullsized":"2024-05-07T14:05:39.843926+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'39","last_scrub_stamp":"2024-05-07T14:05:39.843733+0000","last_deep_scrub":"148'39","last_deep_scrub_stamp":"2024-05-07T14:05:39.843733+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.843733+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:06:50.443554+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":260,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.859526+0000","last_change":"2024-05-07T14:05:53.859577+0000","last_active":"2024-05-07T14:05:53.859526+0000","last_peered":"2024-05-07T14:05:53.859526+0000","last_clean":"2024-05-07T14:05:53.859526+0000","last_became_active":"2024-05-07T14:04:59.466731+0000","last_became_peered":"2024-05-07T14:04:59.466731+0000","last_unstale":"2024-05-07T14:05:53.859526+0000","last_undegraded":"2024-05-07T14:05:53.859526+0000","last_fullsized":"2024-05-07T14:05:53.859526+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:53.859333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:53.859333+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.859333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:19.824614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"148'6","reported_seq":126,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.260494+0000","last_change":"2024-05-07T14:06:01.260653+0000","last_active":"2024-05-07T14:06:01.260494+0000","last_peered":"2024-05-07T14:06:01.260494+0000","last_clean":"2024-05-07T14:06:01.260494+0000","last_became_active":"2024-05-07T14:03:39.675695+0000","last_became_peered":"2024-05-07T14:03:39.675695+0000","last_unstale":"2024-05-07T14:06:01.260494+0000","last_undegraded":"2024-05-07T14:06:01.260494+0000","last_fullsized":"2024-05-07T14:06:01.260494+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'6","last_scrub_stamp":"2024-05-07T14:06:01.260264+0000","last_deep_scrub":"148'6","last_deep_scrub_stamp":"2024-05-07T14:06:01.260264+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.260264+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:18:25.190203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"87'2","reported_seq":277,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.636671+0000","last_change":"2024-05-07T14:06:01.636735+0000","last_active":"2024-05-07T14:06:01.636671+0000","last_peered":"2024-05-07T14:06:01.636671+0000","last_clean":"2024-05-07T14:06:01.636671+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:06:01.636671+0000","last_undegraded":"2024-05-07T14:06:01.636671+0000","last_fullsized":"2024-05-07T14:06:01.636671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-05-07T14:06:01.636441+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-05-07T14:06:01.636441+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.636441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:18:25.566380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"146'52","reported_seq":323,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:09.616241+0000","last_change":"2024-05-07T14:06:09.616311+0000","last_active":"2024-05-07T14:06:09.616241+0000","last_peered":"2024-05-07T14:06:09.616241+0000","last_clean":"2024-05-07T14:06:09.616241+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:06:09.616241+0000","last_undegraded":"2024-05-07T14:06:09.616241+0000","last_fullsized":"2024-05-07T14:06:09.616241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'52","last_scrub_stamp":"2024-05-07T14:06:09.616015+0000","last_deep_scrub":"146'52","last_deep_scrub_stamp":"2024-05-07T14:06:09.616015+0000","last_clean_scrub_stamp":"2024-05-07T14:06:09.616015+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:52:34.090310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":268,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.851104+0000","last_change":"2024-05-07T14:05:54.851241+0000","last_active":"2024-05-07T14:05:54.851104+0000","last_peered":"2024-05-07T14:05:54.851104+0000","last_clean":"2024-05-07T14:05:54.851104+0000","last_became_active":"2024-05-07T14:04:59.467463+0000","last_became_peered":"2024-05-07T14:04:59.467463+0000","last_unstale":"2024-05-07T14:05:54.851104+0000","last_undegraded":"2024-05-07T14:05:54.851104+0000","last_fullsized":"2024-05-07T14:05:54.851104+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:54.850826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:54.850826+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.850826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:39:03.159468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"148'30","reported_seq":336,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:10.806360+0000","last_change":"2024-05-07T14:06:10.806453+0000","last_active":"2024-05-07T14:06:10.806360+0000","last_peered":"2024-05-07T14:06:10.806360+0000","last_clean":"2024-05-07T14:06:10.806360+0000","last_became_active":"2024-05-07T14:03:39.663223+0000","last_became_peered":"2024-05-07T14:03:39.663223+0000","last_unstale":"2024-05-07T14:06:10.806360+0000","last_undegraded":"2024-05-07T14:06:10.806360+0000","last_fullsized":"2024-05-07T14:06:10.806360+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'30","last_scrub_stamp":"2024-05-07T14:06:10.806171+0000","last_deep_scrub":"148'30","last_deep_scrub_stamp":"2024-05-07T14:06:10.806171+0000","last_clean_scrub_stamp":"2024-05-07T14:06:10.806171+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:55:11.991862+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.811262+0000","last_change":"2024-05-07T14:05:53.811338+0000","last_active":"2024-05-07T14:05:53.811262+0000","last_peered":"2024-05-07T14:05:53.811262+0000","last_clean":"2024-05-07T14:05:53.811262+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:05:53.811262+0000","last_undegraded":"2024-05-07T14:05:53.811262+0000","last_fullsized":"2024-05-07T14:05:53.811262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:53.811063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:53.811063+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.811063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:15.944992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"106'6","reported_seq":260,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:05.561208+0000","last_change":"2024-05-07T14:06:05.561325+0000","last_active":"2024-05-07T14:06:05.561208+0000","last_peered":"2024-05-07T14:06:05.561208+0000","last_clean":"2024-05-07T14:06:05.561208+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:06:05.561208+0000","last_undegraded":"2024-05-07T14:06:05.561208+0000","last_fullsized":"2024-05-07T14:06:05.561208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'6","last_scrub_stamp":"2024-05-07T14:06:05.560897+0000","last_deep_scrub":"106'6","last_deep_scrub_stamp":"2024-05-07T14:06:05.560897+0000","last_clean_scrub_stamp":"2024-05-07T14:06:05.560897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:49:58.293086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"106'12","reported_seq":320,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.589914+0000","last_change":"2024-05-07T14:05:46.589973+0000","last_active":"2024-05-07T14:05:46.589914+0000","last_peered":"2024-05-07T14:05:46.589914+0000","last_clean":"2024-05-07T14:05:46.589914+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:05:46.589914+0000","last_undegraded":"2024-05-07T14:05:46.589914+0000","last_fullsized":"2024-05-07T14:05:46.589914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'12","last_scrub_stamp":"2024-05-07T14:05:46.589665+0000","last_deep_scrub":"106'12","last_deep_scrub_stamp":"2024-05-07T14:05:46.589665+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.589665+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:32.146378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"146'32","reported_seq":302,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.490098+0000","last_change":"2024-05-07T14:05:49.490218+0000","last_active":"2024-05-07T14:05:49.490098+0000","last_peered":"2024-05-07T14:05:49.490098+0000","last_clean":"2024-05-07T14:05:49.490098+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:05:49.490098+0000","last_undegraded":"2024-05-07T14:05:49.490098+0000","last_fullsized":"2024-05-07T14:05:49.490098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'32","last_scrub_stamp":"2024-05-07T14:05:49.489775+0000","last_deep_scrub":"146'32","last_deep_scrub_stamp":"2024-05-07T14:05:49.489775+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.489775+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:58.808891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"148'2","reported_seq":141,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.239719+0000","last_change":"2024-05-07T14:05:58.239795+0000","last_active":"2024-05-07T14:05:58.239719+0000","last_peered":"2024-05-07T14:05:58.239719+0000","last_clean":"2024-05-07T14:05:58.239719+0000","last_became_active":"2024-05-07T14:03:39.663013+0000","last_became_peered":"2024-05-07T14:03:39.663013+0000","last_unstale":"2024-05-07T14:05:58.239719+0000","last_undegraded":"2024-05-07T14:05:58.239719+0000","last_fullsized":"2024-05-07T14:05:58.239719+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'2","last_scrub_stamp":"2024-05-07T14:05:58.239564+0000","last_deep_scrub":"148'2","last_deep_scrub_stamp":"2024-05-07T14:05:58.239564+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.239564+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:37.890285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"147'33","reported_seq":304,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426862+0000","last_change":"2024-05-07T14:05:38.003955+0000","last_active":"2024-05-07T14:05:38.426862+0000","last_peered":"2024-05-07T14:05:38.426862+0000","last_clean":"2024-05-07T14:05:38.426862+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:05:38.426862+0000","last_undegraded":"2024-05-07T14:05:38.426862+0000","last_fullsized":"2024-05-07T14:05:38.426862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"147'33","last_scrub_stamp":"2024-05-07T14:05:38.003643+0000","last_deep_scrub":"147'33","last_deep_scrub_stamp":"2024-05-07T14:05:38.003643+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.003643+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:21.738975+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"146'138","reported_seq":458,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.881728+0000","last_change":"2024-05-07T14:05:47.881792+0000","last_active":"2024-05-07T14:05:47.881728+0000","last_peered":"2024-05-07T14:05:47.881728+0000","last_clean":"2024-05-07T14:05:47.881728+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:05:47.881728+0000","last_undegraded":"2024-05-07T14:05:47.881728+0000","last_fullsized":"2024-05-07T14:05:47.881728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'138","last_scrub_stamp":"2024-05-07T14:05:47.881523+0000","last_deep_scrub":"146'138","last_deep_scrub_stamp":"2024-05-07T14:05:47.881523+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.881523+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:41:39.022938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"87'4","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.230323+0000","last_change":"2024-05-07T14:05:46.230484+0000","last_active":"2024-05-07T14:05:46.230323+0000","last_peered":"2024-05-07T14:05:46.230323+0000","last_clean":"2024-05-07T14:05:46.230323+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:05:46.230323+0000","last_undegraded":"2024-05-07T14:05:46.230323+0000","last_fullsized":"2024-05-07T14:05:46.230323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'4","last_scrub_stamp":"2024-05-07T14:05:46.230060+0000","last_deep_scrub":"87'4","last_deep_scrub_stamp":"2024-05-07T14:05:46.230060+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.230060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:40.346247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"106'8","reported_seq":302,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.678118+0000","last_change":"2024-05-07T14:06:03.678253+0000","last_active":"2024-05-07T14:06:03.678118+0000","last_peered":"2024-05-07T14:06:03.678118+0000","last_clean":"2024-05-07T14:06:03.678118+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:06:03.678118+0000","last_undegraded":"2024-05-07T14:06:03.678118+0000","last_fullsized":"2024-05-07T14:06:03.678118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'8","last_scrub_stamp":"2024-05-07T14:06:03.677855+0000","last_deep_scrub":"106'8","last_deep_scrub_stamp":"2024-05-07T14:06:03.677855+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.677855+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:52:47.901540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"146'38","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.615512+0000","last_change":"2024-05-07T14:05:58.615576+0000","last_active":"2024-05-07T14:05:58.615512+0000","last_peered":"2024-05-07T14:05:58.615512+0000","last_clean":"2024-05-07T14:05:58.615512+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:05:58.615512+0000","last_undegraded":"2024-05-07T14:05:58.615512+0000","last_fullsized":"2024-05-07T14:05:58.615512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'38","last_scrub_stamp":"2024-05-07T14:05:58.615312+0000","last_deep_scrub":"146'38","last_deep_scrub_stamp":"2024-05-07T14:05:58.615312+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.615312+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:38.266033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"148'4","reported_seq":448,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.794077+0000","last_change":"2024-05-07T14:05:49.794153+0000","last_active":"2024-05-07T14:05:49.794077+0000","last_peered":"2024-05-07T14:05:49.794077+0000","last_clean":"2024-05-07T14:05:49.794077+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:05:49.794077+0000","last_undegraded":"2024-05-07T14:05:49.794077+0000","last_fullsized":"2024-05-07T14:05:49.794077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'4","last_scrub_stamp":"2024-05-07T14:05:49.793887+0000","last_deep_scrub":"148'4","last_deep_scrub_stamp":"2024-05-07T14:05:49.793887+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.793887+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:52:34.017572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"148'15","reported_seq":279,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.451639+0000","last_change":"2024-05-07T14:05:51.451714+0000","last_active":"2024-05-07T14:05:51.451639+0000","last_peered":"2024-05-07T14:05:51.451639+0000","last_clean":"2024-05-07T14:05:51.451639+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:05:51.451639+0000","last_undegraded":"2024-05-07T14:05:51.451639+0000","last_fullsized":"2024-05-07T14:05:51.451639+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'15","last_scrub_stamp":"2024-05-07T14:05:51.451437+0000","last_deep_scrub":"148'15","last_deep_scrub_stamp":"2024-05-07T14:05:51.451437+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.451437+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:14.981223+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"146'138","reported_seq":447,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.515099+0000","last_change":"2024-05-07T14:05:39.515165+0000","last_active":"2024-05-07T14:05:39.515099+0000","last_peered":"2024-05-07T14:05:39.515099+0000","last_clean":"2024-05-07T14:05:39.515099+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:05:39.515099+0000","last_undegraded":"2024-05-07T14:05:39.515099+0000","last_fullsized":"2024-05-07T14:05:39.515099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'138","last_scrub_stamp":"2024-05-07T14:05:39.514876+0000","last_deep_scrub":"146'138","last_deep_scrub_stamp":"2024-05-07T14:05:39.514876+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.514876+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:10.324260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"87'6","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:07.752334+0000","last_change":"2024-05-07T14:06:07.752400+0000","last_active":"2024-05-07T14:06:07.752334+0000","last_peered":"2024-05-07T14:06:07.752334+0000","last_clean":"2024-05-07T14:06:07.752334+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:06:07.752334+0000","last_undegraded":"2024-05-07T14:06:07.752334+0000","last_fullsized":"2024-05-07T14:06:07.752334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'6","last_scrub_stamp":"2024-05-07T14:06:07.752132+0000","last_deep_scrub":"87'6","last_deep_scrub_stamp":"2024-05-07T14:06:07.752132+0000","last_clean_scrub_stamp":"2024-05-07T14:06:07.752132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:42.745328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"124'6","reported_seq":291,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.281171+0000","last_change":"2024-05-07T14:05:54.281289+0000","last_active":"2024-05-07T14:05:54.281171+0000","last_peered":"2024-05-07T14:05:54.281171+0000","last_clean":"2024-05-07T14:05:54.281171+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:05:54.281171+0000","last_undegraded":"2024-05-07T14:05:54.281171+0000","last_fullsized":"2024-05-07T14:05:54.281171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'6","last_scrub_stamp":"2024-05-07T14:05:54.280845+0000","last_deep_scrub":"124'6","last_deep_scrub_stamp":"2024-05-07T14:05:54.280845+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.280845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:37.067836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"146'48","reported_seq":353,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.453337+0000","last_change":"2024-05-07T14:05:44.453402+0000","last_active":"2024-05-07T14:05:44.453337+0000","last_peered":"2024-05-07T14:05:44.453337+0000","last_clean":"2024-05-07T14:05:44.453337+0000","last_became_active":"2024-05-07T14:03:39.666192+0000","last_became_peered":"2024-05-07T14:03:39.666192+0000","last_unstale":"2024-05-07T14:05:44.453337+0000","last_undegraded":"2024-05-07T14:05:44.453337+0000","last_fullsized":"2024-05-07T14:05:44.453337+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'48","last_scrub_stamp":"2024-05-07T14:05:44.453140+0000","last_deep_scrub":"146'48","last_deep_scrub_stamp":"2024-05-07T14:05:44.453140+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.453140+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:30.552148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":264,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.683305+0000","last_change":"2024-05-07T14:05:51.683360+0000","last_active":"2024-05-07T14:05:51.683305+0000","last_peered":"2024-05-07T14:05:51.683305+0000","last_clean":"2024-05-07T14:05:51.683305+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:05:51.683305+0000","last_undegraded":"2024-05-07T14:05:51.683305+0000","last_fullsized":"2024-05-07T14:05:51.683305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:51.683083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:51.683083+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.683083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:06.122503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"148'35","reported_seq":354,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.657561+0000","last_change":"2024-05-07T14:05:39.657649+0000","last_active":"2024-05-07T14:05:39.657561+0000","last_peered":"2024-05-07T14:05:39.657561+0000","last_clean":"2024-05-07T14:05:39.657561+0000","last_became_active":"2024-05-07T14:03:39.673995+0000","last_became_peered":"2024-05-07T14:03:39.673995+0000","last_unstale":"2024-05-07T14:05:39.657561+0000","last_undegraded":"2024-05-07T14:05:39.657561+0000","last_fullsized":"2024-05-07T14:05:39.657561+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'35","last_scrub_stamp":"2024-05-07T14:05:39.657374+0000","last_deep_scrub":"148'35","last_deep_scrub_stamp":"2024-05-07T14:05:39.657374+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.657374+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:53:39.083704+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.534447+0000","last_change":"2024-05-07T14:05:55.534501+0000","last_active":"2024-05-07T14:05:55.534447+0000","last_peered":"2024-05-07T14:05:55.534447+0000","last_clean":"2024-05-07T14:05:55.534447+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:05:55.534447+0000","last_undegraded":"2024-05-07T14:05:55.534447+0000","last_fullsized":"2024-05-07T14:05:55.534447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:55.534249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:55.534249+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.534249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:50.969463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"124'2","reported_seq":118,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.442063+0000","last_change":"2024-05-07T14:05:36.169322+0000","last_active":"2024-05-07T14:05:38.442063+0000","last_peered":"2024-05-07T14:05:38.442063+0000","last_clean":"2024-05-07T14:05:38.442063+0000","last_became_active":"2024-05-07T14:03:39.665838+0000","last_became_peered":"2024-05-07T14:03:39.665838+0000","last_unstale":"2024-05-07T14:05:38.442063+0000","last_undegraded":"2024-05-07T14:05:38.442063+0000","last_fullsized":"2024-05-07T14:05:38.442063+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'2","last_scrub_stamp":"2024-05-07T14:05:36.169228+0000","last_deep_scrub":"124'2","last_deep_scrub_stamp":"2024-05-07T14:05:36.169228+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.169228+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:05.619187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'2","reported_seq":275,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.496398+0000","last_change":"2024-05-07T14:05:42.496470+0000","last_active":"2024-05-07T14:05:42.496398+0000","last_peered":"2024-05-07T14:05:42.496398+0000","last_clean":"2024-05-07T14:05:42.496398+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:05:42.496398+0000","last_undegraded":"2024-05-07T14:05:42.496398+0000","last_fullsized":"2024-05-07T14:05:42.496398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:05:42.496172+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:05:42.496172+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.496172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:08.117356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"148'119","reported_seq":328,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.519046+0000","last_change":"2024-05-07T14:05:58.519125+0000","last_active":"2024-05-07T14:05:58.519046+0000","last_peered":"2024-05-07T14:05:58.519046+0000","last_clean":"2024-05-07T14:05:58.519046+0000","last_became_active":"2024-05-07T14:02:39.728189+0000","last_became_peered":"2024-05-07T14:02:39.728189+0000","last_unstale":"2024-05-07T14:05:58.519046+0000","last_undegraded":"2024-05-07T14:05:58.519046+0000","last_fullsized":"2024-05-07T14:05:58.519046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'119","last_scrub_stamp":"2024-05-07T14:05:58.518830+0000","last_deep_scrub":"148'119","last_deep_scrub_stamp":"2024-05-07T14:05:58.518830+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.518830+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:36:36.429075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.856801+0000","last_change":"2024-05-07T14:05:59.856861+0000","last_active":"2024-05-07T14:05:59.856801+0000","last_peered":"2024-05-07T14:05:59.856801+0000","last_clean":"2024-05-07T14:05:59.856801+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:05:59.856801+0000","last_undegraded":"2024-05-07T14:05:59.856801+0000","last_fullsized":"2024-05-07T14:05:59.856801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:59.856598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:59.856598+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.856598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:27:47.818900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"146'40","reported_seq":260,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.896294+0000","last_change":"2024-05-07T14:05:49.896351+0000","last_active":"2024-05-07T14:05:49.896294+0000","last_peered":"2024-05-07T14:05:49.896294+0000","last_clean":"2024-05-07T14:05:49.896294+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:05:49.896294+0000","last_undegraded":"2024-05-07T14:05:49.896294+0000","last_fullsized":"2024-05-07T14:05:49.896294+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'40","last_scrub_stamp":"2024-05-07T14:05:49.896090+0000","last_deep_scrub":"146'40","last_deep_scrub_stamp":"2024-05-07T14:05:49.896090+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.896090+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.517274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":50,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.047023+0000","last_change":"2024-05-07T14:05:48.047075+0000","last_active":"2024-05-07T14:05:48.047023+0000","last_peered":"2024-05-07T14:05:48.047023+0000","last_clean":"2024-05-07T14:05:48.047023+0000","last_became_active":"2024-05-07T14:04:59.453884+0000","last_became_peered":"2024-05-07T14:04:59.453884+0000","last_unstale":"2024-05-07T14:05:48.047023+0000","last_undegraded":"2024-05-07T14:05:48.047023+0000","last_fullsized":"2024-05-07T14:05:48.047023+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:48.046779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:48.046779+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.046779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:29.471937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"148'49","reported_seq":333,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.848365+0000","last_change":"2024-05-07T14:05:51.848447+0000","last_active":"2024-05-07T14:05:51.848365+0000","last_peered":"2024-05-07T14:05:51.848365+0000","last_clean":"2024-05-07T14:05:51.848365+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:05:51.848365+0000","last_undegraded":"2024-05-07T14:05:51.848365+0000","last_fullsized":"2024-05-07T14:05:51.848365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'49","last_scrub_stamp":"2024-05-07T14:05:51.848139+0000","last_deep_scrub":"148'49","last_deep_scrub_stamp":"2024-05-07T14:05:51.848139+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.848139+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:28.943832+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:08.677065+0000","last_change":"2024-05-07T14:06:08.677121+0000","last_active":"2024-05-07T14:06:08.677065+0000","last_peered":"2024-05-07T14:06:08.677065+0000","last_clean":"2024-05-07T14:06:08.677065+0000","last_became_active":"2024-05-07T14:04:59.456477+0000","last_became_peered":"2024-05-07T14:04:59.456477+0000","last_unstale":"2024-05-07T14:06:08.677065+0000","last_undegraded":"2024-05-07T14:06:08.677065+0000","last_fullsized":"2024-05-07T14:06:08.677065+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:08.676852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:08.676852+0000","last_clean_scrub_stamp":"2024-05-07T14:06:08.676852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:10:27.857200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":250,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.546092+0000","last_change":"2024-05-07T14:05:56.546145+0000","last_active":"2024-05-07T14:05:56.546092+0000","last_peered":"2024-05-07T14:05:56.546092+0000","last_clean":"2024-05-07T14:05:56.546092+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:05:56.546092+0000","last_undegraded":"2024-05-07T14:05:56.546092+0000","last_fullsized":"2024-05-07T14:05:56.546092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:56.545882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:56.545882+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.545882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:33.203820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'2","reported_seq":275,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.837056+0000","last_change":"2024-05-07T14:05:54.837119+0000","last_active":"2024-05-07T14:05:54.837056+0000","last_peered":"2024-05-07T14:05:54.837056+0000","last_clean":"2024-05-07T14:05:54.837056+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:05:54.837056+0000","last_undegraded":"2024-05-07T14:05:54.837056+0000","last_fullsized":"2024-05-07T14:05:54.837056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:05:54.836855+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:05:54.836855+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.836855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:38:49.202501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":237,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.093679+0000","last_change":"2024-05-07T14:05:55.093736+0000","last_active":"2024-05-07T14:05:55.093679+0000","last_peered":"2024-05-07T14:05:55.093679+0000","last_clean":"2024-05-07T14:05:55.093679+0000","last_became_active":"2024-05-07T14:04:59.422224+0000","last_became_peered":"2024-05-07T14:04:59.422224+0000","last_unstale":"2024-05-07T14:05:55.093679+0000","last_undegraded":"2024-05-07T14:05:55.093679+0000","last_fullsized":"2024-05-07T14:05:55.093679+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:55.093491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:55.093491+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.093491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:56:12.513534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"146'44","reported_seq":315,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:02.709673+0000","last_change":"2024-05-07T14:06:02.709733+0000","last_active":"2024-05-07T14:06:02.709673+0000","last_peered":"2024-05-07T14:06:02.709673+0000","last_clean":"2024-05-07T14:06:02.709673+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:06:02.709673+0000","last_undegraded":"2024-05-07T14:06:02.709673+0000","last_fullsized":"2024-05-07T14:06:02.709673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'44","last_scrub_stamp":"2024-05-07T14:06:02.709470+0000","last_deep_scrub":"146'44","last_deep_scrub_stamp":"2024-05-07T14:06:02.709470+0000","last_clean_scrub_stamp":"2024-05-07T14:06:02.709470+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:03:50.999807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.715081+0000","last_change":"2024-05-07T14:05:45.715136+0000","last_active":"2024-05-07T14:05:45.715081+0000","last_peered":"2024-05-07T14:05:45.715081+0000","last_clean":"2024-05-07T14:05:45.715081+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:05:45.715081+0000","last_undegraded":"2024-05-07T14:05:45.715081+0000","last_fullsized":"2024-05-07T14:05:45.715081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:45.714883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:45.714883+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.714883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:20.093461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"148'163","reported_seq":564,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.286083+0000","last_change":"2024-05-07T14:06:03.286170+0000","last_active":"2024-05-07T14:06:03.286083+0000","last_peered":"2024-05-07T14:06:03.286083+0000","last_clean":"2024-05-07T14:06:03.286083+0000","last_became_active":"2024-05-07T14:03:42.708117+0000","last_became_peered":"2024-05-07T14:03:42.708117+0000","last_unstale":"2024-05-07T14:06:03.286083+0000","last_undegraded":"2024-05-07T14:06:03.286083+0000","last_fullsized":"2024-05-07T14:06:03.286083+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'163","last_scrub_stamp":"2024-05-07T14:06:03.285871+0000","last_deep_scrub":"148'163","last_deep_scrub_stamp":"2024-05-07T14:06:03.285871+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.285871+0000","objects_scrubbed":10,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:52:47.509556+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":202,"num_read_kb":198,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.008569+0000","last_change":"2024-05-07T14:05:43.008624+0000","last_active":"2024-05-07T14:05:43.008569+0000","last_peered":"2024-05-07T14:05:43.008569+0000","last_clean":"2024-05-07T14:05:43.008569+0000","last_became_active":"2024-05-07T14:04:59.461354+0000","last_became_peered":"2024-05-07T14:04:59.461354+0000","last_unstale":"2024-05-07T14:05:43.008569+0000","last_undegraded":"2024-05-07T14:05:43.008569+0000","last_fullsized":"2024-05-07T14:05:43.008569+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:43.008372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:43.008372+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.008372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:47:45.743047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"80'4","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.177883+0000","last_change":"2024-05-07T14:05:44.177944+0000","last_active":"2024-05-07T14:05:44.177883+0000","last_peered":"2024-05-07T14:05:44.177883+0000","last_clean":"2024-05-07T14:05:44.177883+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:05:44.177883+0000","last_undegraded":"2024-05-07T14:05:44.177883+0000","last_fullsized":"2024-05-07T14:05:44.177883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-05-07T14:05:44.177682+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-05-07T14:05:44.177682+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.177682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:19:08.727384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"81'2","reported_seq":118,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.283849+0000","last_change":"2024-05-07T14:05:57.283996+0000","last_active":"2024-05-07T14:05:57.283849+0000","last_peered":"2024-05-07T14:05:57.283849+0000","last_clean":"2024-05-07T14:05:57.283849+0000","last_became_active":"2024-05-07T14:03:39.667130+0000","last_became_peered":"2024-05-07T14:03:39.667130+0000","last_unstale":"2024-05-07T14:05:57.283849+0000","last_undegraded":"2024-05-07T14:05:57.283849+0000","last_fullsized":"2024-05-07T14:05:57.283849+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:05:57.283618+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:05:57.283618+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.283618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:06:28.687444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":275,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.930965+0000","last_change":"2024-05-07T14:05:39.931024+0000","last_active":"2024-05-07T14:05:39.930965+0000","last_peered":"2024-05-07T14:05:39.930965+0000","last_clean":"2024-05-07T14:05:39.930965+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:05:39.930965+0000","last_undegraded":"2024-05-07T14:05:39.930965+0000","last_fullsized":"2024-05-07T14:05:39.930965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:39.930722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:39.930722+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.930722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:25:55.708927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"146'54","reported_seq":324,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.203380+0000","last_change":"2024-05-07T14:05:52.203445+0000","last_active":"2024-05-07T14:05:52.203380+0000","last_peered":"2024-05-07T14:05:52.203380+0000","last_clean":"2024-05-07T14:05:52.203380+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:05:52.203380+0000","last_undegraded":"2024-05-07T14:05:52.203380+0000","last_fullsized":"2024-05-07T14:05:52.203380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:05:52.203119+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:05:52.203119+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.203119+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:45:56.078625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"148'2","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.949508+0000","last_change":"2024-05-07T14:05:38.949702+0000","last_active":"2024-05-07T14:05:38.949508+0000","last_peered":"2024-05-07T14:05:38.949508+0000","last_clean":"2024-05-07T14:05:38.949508+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:05:38.949508+0000","last_undegraded":"2024-05-07T14:05:38.949508+0000","last_fullsized":"2024-05-07T14:05:38.949508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'2","last_scrub_stamp":"2024-05-07T14:05:38.949276+0000","last_deep_scrub":"148'2","last_deep_scrub_stamp":"2024-05-07T14:05:38.949276+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.949276+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:32:59.585166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"148'26","reported_seq":312,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.975153+0000","last_change":"2024-05-07T14:05:41.975241+0000","last_active":"2024-05-07T14:05:41.975153+0000","last_peered":"2024-05-07T14:05:41.975153+0000","last_clean":"2024-05-07T14:05:41.975153+0000","last_became_active":"2024-05-07T14:04:59.456018+0000","last_became_peered":"2024-05-07T14:04:59.456018+0000","last_unstale":"2024-05-07T14:05:41.975153+0000","last_undegraded":"2024-05-07T14:05:41.975153+0000","last_fullsized":"2024-05-07T14:05:41.975153+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'26","last_scrub_stamp":"2024-05-07T14:05:41.974940+0000","last_deep_scrub":"148'26","last_deep_scrub_stamp":"2024-05-07T14:05:41.974940+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.974940+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:45:59.365603+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.759315+0000","last_change":"2024-05-07T14:05:47.759374+0000","last_active":"2024-05-07T14:05:47.759315+0000","last_peered":"2024-05-07T14:05:47.759315+0000","last_clean":"2024-05-07T14:05:47.759315+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:05:47.759315+0000","last_undegraded":"2024-05-07T14:05:47.759315+0000","last_fullsized":"2024-05-07T14:05:47.759315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:47.759099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:47.759099+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.759099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:27.409820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.566348+0000","last_change":"2024-05-07T14:06:03.566427+0000","last_active":"2024-05-07T14:06:03.566348+0000","last_peered":"2024-05-07T14:06:03.566348+0000","last_clean":"2024-05-07T14:06:03.566348+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:06:03.566348+0000","last_undegraded":"2024-05-07T14:06:03.566348+0000","last_fullsized":"2024-05-07T14:06:03.566348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:03.566056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:03.566056+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.566056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:07.625070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"81'4","reported_seq":120,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.202102+0000","last_change":"2024-05-07T14:05:43.202102+0000","last_active":"2024-05-07T14:05:43.202102+0000","last_peered":"2024-05-07T14:05:43.202102+0000","last_clean":"2024-05-07T14:05:43.202102+0000","last_became_active":"2024-05-07T14:03:39.661295+0000","last_became_peered":"2024-05-07T14:03:39.661295+0000","last_unstale":"2024-05-07T14:05:43.202102+0000","last_undegraded":"2024-05-07T14:05:43.202102+0000","last_fullsized":"2024-05-07T14:05:43.202102+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-05-07T14:05:43.201833+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-05-07T14:05:43.201833+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.201833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:53:22.951653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.897454+0000","last_change":"2024-05-07T14:06:00.897509+0000","last_active":"2024-05-07T14:06:00.897454+0000","last_peered":"2024-05-07T14:06:00.897454+0000","last_clean":"2024-05-07T14:06:00.897454+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:06:00.897454+0000","last_undegraded":"2024-05-07T14:06:00.897454+0000","last_fullsized":"2024-05-07T14:06:00.897454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:00.897257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:00.897257+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.897257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:04.956272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"146'28","reported_seq":301,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.624912+0000","last_change":"2024-05-07T14:05:57.624978+0000","last_active":"2024-05-07T14:05:57.624912+0000","last_peered":"2024-05-07T14:05:57.624912+0000","last_clean":"2024-05-07T14:05:57.624912+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:05:57.624912+0000","last_undegraded":"2024-05-07T14:05:57.624912+0000","last_fullsized":"2024-05-07T14:05:57.624912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'28","last_scrub_stamp":"2024-05-07T14:05:57.624709+0000","last_deep_scrub":"146'28","last_deep_scrub_stamp":"2024-05-07T14:05:57.624709+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.624709+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:06:29.028535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":38,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.842219+0000","last_change":"2024-05-07T14:05:42.842270+0000","last_active":"2024-05-07T14:05:42.842219+0000","last_peered":"2024-05-07T14:05:42.842219+0000","last_clean":"2024-05-07T14:05:42.842219+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:05:42.842219+0000","last_undegraded":"2024-05-07T14:05:42.842219+0000","last_fullsized":"2024-05-07T14:05:42.842219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:42.842025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:42.842025+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.842025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:20:29.836711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"148'18","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.441470+0000","last_change":"2024-05-07T14:05:54.441554+0000","last_active":"2024-05-07T14:05:54.441470+0000","last_peered":"2024-05-07T14:05:54.441470+0000","last_clean":"2024-05-07T14:05:54.441470+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:05:54.441470+0000","last_undegraded":"2024-05-07T14:05:54.441470+0000","last_fullsized":"2024-05-07T14:05:54.441470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'18","last_scrub_stamp":"2024-05-07T14:05:54.441267+0000","last_deep_scrub":"148'18","last_deep_scrub_stamp":"2024-05-07T14:05:54.441267+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.441267+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:31.536960+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.451049+0000","last_change":"2024-05-07T14:05:45.451111+0000","last_active":"2024-05-07T14:05:45.451049+0000","last_peered":"2024-05-07T14:05:45.451049+0000","last_clean":"2024-05-07T14:05:45.451049+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:05:45.451049+0000","last_undegraded":"2024-05-07T14:05:45.451049+0000","last_fullsized":"2024-05-07T14:05:45.451049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:45.450822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:45.450822+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.450822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:46:13.537065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":250,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:07.942087+0000","last_change":"2024-05-07T14:06:07.942191+0000","last_active":"2024-05-07T14:06:07.942087+0000","last_peered":"2024-05-07T14:06:07.942087+0000","last_clean":"2024-05-07T14:06:07.942087+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:06:07.942087+0000","last_undegraded":"2024-05-07T14:06:07.942087+0000","last_fullsized":"2024-05-07T14:06:07.942087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:07.941778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:07.941778+0000","last_clean_scrub_stamp":"2024-05-07T14:06:07.941778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:10:27.122126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.164645+0000","last_change":"2024-05-07T14:05:42.164645+0000","last_active":"2024-05-07T14:05:42.164645+0000","last_peered":"2024-05-07T14:05:42.164645+0000","last_clean":"2024-05-07T14:05:42.164645+0000","last_became_active":"2024-05-07T14:03:39.659515+0000","last_became_peered":"2024-05-07T14:03:39.659515+0000","last_unstale":"2024-05-07T14:05:42.164645+0000","last_undegraded":"2024-05-07T14:05:42.164645+0000","last_fullsized":"2024-05-07T14:05:42.164645+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:42.164378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:42.164378+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.164378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:24:47.549501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"146'38","reported_seq":308,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:02.894143+0000","last_change":"2024-05-07T14:06:02.894207+0000","last_active":"2024-05-07T14:06:02.894143+0000","last_peered":"2024-05-07T14:06:02.894143+0000","last_clean":"2024-05-07T14:06:02.894143+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:06:02.894143+0000","last_undegraded":"2024-05-07T14:06:02.894143+0000","last_fullsized":"2024-05-07T14:06:02.894143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'38","last_scrub_stamp":"2024-05-07T14:06:02.893936+0000","last_deep_scrub":"146'38","last_deep_scrub_stamp":"2024-05-07T14:06:02.893936+0000","last_clean_scrub_stamp":"2024-05-07T14:06:02.893936+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T02:03:14.714059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.223910+0000","last_change":"2024-05-07T14:05:49.224051+0000","last_active":"2024-05-07T14:05:49.223910+0000","last_peered":"2024-05-07T14:05:49.223910+0000","last_clean":"2024-05-07T14:05:49.223910+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:05:49.223910+0000","last_undegraded":"2024-05-07T14:05:49.223910+0000","last_fullsized":"2024-05-07T14:05:49.223910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:49.223689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:49.223689+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.223689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:53:09.917608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.816128+0000","last_change":"2024-05-07T14:05:44.816178+0000","last_active":"2024-05-07T14:05:44.816128+0000","last_peered":"2024-05-07T14:05:44.816128+0000","last_clean":"2024-05-07T14:05:44.816128+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:05:44.816128+0000","last_undegraded":"2024-05-07T14:05:44.816128+0000","last_fullsized":"2024-05-07T14:05:44.816128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:44.815925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:44.815925+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.815925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:30.914933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"148'49","reported_seq":330,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.898403+0000","last_change":"2024-05-07T14:05:41.898478+0000","last_active":"2024-05-07T14:05:41.898403+0000","last_peered":"2024-05-07T14:05:41.898403+0000","last_clean":"2024-05-07T14:05:41.898403+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:05:41.898403+0000","last_undegraded":"2024-05-07T14:05:41.898403+0000","last_fullsized":"2024-05-07T14:05:41.898403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'49","last_scrub_stamp":"2024-05-07T14:05:41.898210+0000","last_deep_scrub":"148'49","last_deep_scrub_stamp":"2024-05-07T14:05:41.898210+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.898210+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:45:45.773716+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":157,"num_write":28,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.583332+0000","last_change":"2024-05-07T14:05:39.583489+0000","last_active":"2024-05-07T14:05:39.583332+0000","last_peered":"2024-05-07T14:05:39.583332+0000","last_clean":"2024-05-07T14:05:39.583332+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:05:39.583332+0000","last_undegraded":"2024-05-07T14:05:39.583332+0000","last_fullsized":"2024-05-07T14:05:39.583332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:39.583104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:39.583104+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.583104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:05.548386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"146'2","reported_seq":253,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817343+0000","last_change":"2024-05-07T14:05:36.847888+0000","last_active":"2024-05-07T14:05:38.817343+0000","last_peered":"2024-05-07T14:05:38.817343+0000","last_clean":"2024-05-07T14:05:38.817343+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:05:38.817343+0000","last_undegraded":"2024-05-07T14:05:38.817343+0000","last_fullsized":"2024-05-07T14:05:38.817343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'2","last_scrub_stamp":"2024-05-07T14:05:36.847644+0000","last_deep_scrub":"146'2","last_deep_scrub_stamp":"2024-05-07T14:05:36.847644+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.847644+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:47.884397+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":267,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.806194+0000","last_change":"2024-05-07T14:05:46.806344+0000","last_active":"2024-05-07T14:05:46.806194+0000","last_peered":"2024-05-07T14:05:46.806194+0000","last_clean":"2024-05-07T14:05:46.806194+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:05:46.806194+0000","last_undegraded":"2024-05-07T14:05:46.806194+0000","last_fullsized":"2024-05-07T14:05:46.806194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:46.805972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:46.805972+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.805972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:06:18.209798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"146'46","reported_seq":316,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.201907+0000","last_change":"2024-05-07T14:05:51.201972+0000","last_active":"2024-05-07T14:05:51.201907+0000","last_peered":"2024-05-07T14:05:51.201907+0000","last_clean":"2024-05-07T14:05:51.201907+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:05:51.201907+0000","last_undegraded":"2024-05-07T14:05:51.201907+0000","last_fullsized":"2024-05-07T14:05:51.201907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:05:51.201707+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:05:51.201707+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.201707+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:05.641126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.071032+0000","last_change":"2024-05-07T14:05:50.071134+0000","last_active":"2024-05-07T14:05:50.071032+0000","last_peered":"2024-05-07T14:05:50.071032+0000","last_clean":"2024-05-07T14:05:50.071032+0000","last_became_active":"2024-05-07T14:04:59.451719+0000","last_became_peered":"2024-05-07T14:04:59.451719+0000","last_unstale":"2024-05-07T14:05:50.071032+0000","last_undegraded":"2024-05-07T14:05:50.071032+0000","last_fullsized":"2024-05-07T14:05:50.071032+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:50.070785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:50.070785+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.070785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:21.878853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.481574+0000","last_change":"2024-05-07T14:05:37.476888+0000","last_active":"2024-05-07T14:05:38.481574+0000","last_peered":"2024-05-07T14:05:38.481574+0000","last_clean":"2024-05-07T14:05:38.481574+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:05:38.481574+0000","last_undegraded":"2024-05-07T14:05:38.481574+0000","last_fullsized":"2024-05-07T14:05:38.481574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.476486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.476486+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.476486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:16:03.408284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"148'21","reported_seq":137,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.285587+0000","last_change":"2024-05-07T14:05:47.285587+0000","last_active":"2024-05-07T14:05:47.285587+0000","last_peered":"2024-05-07T14:05:47.285587+0000","last_clean":"2024-05-07T14:05:47.285587+0000","last_became_active":"2024-05-07T14:03:39.664751+0000","last_became_peered":"2024-05-07T14:03:39.664751+0000","last_unstale":"2024-05-07T14:05:47.285587+0000","last_undegraded":"2024-05-07T14:05:47.285587+0000","last_fullsized":"2024-05-07T14:05:47.285587+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'21","last_scrub_stamp":"2024-05-07T14:05:47.285316+0000","last_deep_scrub":"148'21","last_deep_scrub_stamp":"2024-05-07T14:05:47.285316+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.285316+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:58.322069+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"146'142","reported_seq":498,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620137+0000","last_change":"2024-05-07T14:05:38.619420+0000","last_active":"2024-05-07T14:05:38.620137+0000","last_peered":"2024-05-07T14:05:38.620137+0000","last_clean":"2024-05-07T14:05:38.620137+0000","last_became_active":"2024-05-07T14:03:42.707207+0000","last_became_peered":"2024-05-07T14:03:42.707207+0000","last_unstale":"2024-05-07T14:05:38.620137+0000","last_undegraded":"2024-05-07T14:05:38.620137+0000","last_fullsized":"2024-05-07T14:05:38.620137+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'142","last_scrub_stamp":"2024-05-07T14:05:38.619146+0000","last_deep_scrub":"146'142","last_deep_scrub_stamp":"2024-05-07T14:05:38.619146+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.619146+0000","objects_scrubbed":1,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:53.058565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.466213+0000","last_change":"2024-05-07T14:05:50.466272+0000","last_active":"2024-05-07T14:05:50.466213+0000","last_peered":"2024-05-07T14:05:50.466213+0000","last_clean":"2024-05-07T14:05:50.466213+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:05:50.466213+0000","last_undegraded":"2024-05-07T14:05:50.466213+0000","last_fullsized":"2024-05-07T14:05:50.466213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:50.466014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:50.466014+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.466014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:51.233636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"115'4","reported_seq":282,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.432088+0000","last_change":"2024-05-07T14:04:59.447585+0000","last_active":"2024-05-07T14:05:38.432088+0000","last_peered":"2024-05-07T14:05:38.432088+0000","last_clean":"2024-05-07T14:05:38.432088+0000","last_became_active":"2024-05-07T14:04:59.446674+0000","last_became_peered":"2024-05-07T14:04:59.446674+0000","last_unstale":"2024-05-07T14:05:38.432088+0000","last_undegraded":"2024-05-07T14:05:38.432088+0000","last_fullsized":"2024-05-07T14:05:38.432088+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"146'34","reported_seq":322,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.436435+0000","last_change":"2024-05-07T14:05:00.492095+0000","last_active":"2024-05-07T14:05:38.436435+0000","last_peered":"2024-05-07T14:05:38.436435+0000","last_clean":"2024-05-07T14:05:38.436435+0000","last_became_active":"2024-05-07T14:04:59.460381+0000","last_became_peered":"2024-05-07T14:04:59.460381+0000","last_unstale":"2024-05-07T14:05:38.436435+0000","last_undegraded":"2024-05-07T14:05:38.436435+0000","last_fullsized":"2024-05-07T14:05:38.436435+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":44,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.207861+0000","last_change":"2024-05-07T14:05:39.207861+0000","last_active":"2024-05-07T14:05:39.207861+0000","last_peered":"2024-05-07T14:05:39.207861+0000","last_clean":"2024-05-07T14:05:39.207861+0000","last_became_active":"2024-05-07T14:03:39.671518+0000","last_became_peered":"2024-05-07T14:03:39.671518+0000","last_unstale":"2024-05-07T14:05:39.207861+0000","last_undegraded":"2024-05-07T14:05:39.207861+0000","last_fullsized":"2024-05-07T14:05:39.207861+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:39.207489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:39.207489+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.207489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:38:47.516131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":264,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.698653+0000","last_change":"2024-05-07T14:05:53.698756+0000","last_active":"2024-05-07T14:05:53.698653+0000","last_peered":"2024-05-07T14:05:53.698653+0000","last_clean":"2024-05-07T14:05:53.698653+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:05:53.698653+0000","last_undegraded":"2024-05-07T14:05:53.698653+0000","last_fullsized":"2024-05-07T14:05:53.698653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:53.698424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:53.698424+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.698424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:14:02.682205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"148'15","reported_seq":280,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:05.703816+0000","last_change":"2024-05-07T14:06:05.703887+0000","last_active":"2024-05-07T14:06:05.703816+0000","last_peered":"2024-05-07T14:06:05.703816+0000","last_clean":"2024-05-07T14:06:05.703816+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:06:05.703816+0000","last_undegraded":"2024-05-07T14:06:05.703816+0000","last_fullsized":"2024-05-07T14:06:05.703816+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'15","last_scrub_stamp":"2024-05-07T14:06:05.703611+0000","last_deep_scrub":"148'15","last_deep_scrub_stamp":"2024-05-07T14:06:05.703611+0000","last_clean_scrub_stamp":"2024-05-07T14:06:05.703611+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:39:00.069257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"146'138","reported_seq":493,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.567164+0000","last_change":"2024-05-07T14:06:01.567224+0000","last_active":"2024-05-07T14:06:01.567164+0000","last_peered":"2024-05-07T14:06:01.567164+0000","last_clean":"2024-05-07T14:06:01.567164+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:06:01.567164+0000","last_undegraded":"2024-05-07T14:06:01.567164+0000","last_fullsized":"2024-05-07T14:06:01.567164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'138","last_scrub_stamp":"2024-05-07T14:06:01.566956+0000","last_deep_scrub":"146'138","last_deep_scrub_stamp":"2024-05-07T14:06:01.566956+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.566956+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:22:14.787756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"81'3","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.860436+0000","last_change":"2024-05-07T14:05:55.860501+0000","last_active":"2024-05-07T14:05:55.860436+0000","last_peered":"2024-05-07T14:05:55.860436+0000","last_clean":"2024-05-07T14:05:55.860436+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:05:55.860436+0000","last_undegraded":"2024-05-07T14:05:55.860436+0000","last_fullsized":"2024-05-07T14:05:55.860436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-05-07T14:05:55.860237+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-05-07T14:05:55.860237+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.860237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:32.382239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"124'4","reported_seq":285,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.649450+0000","last_change":"2024-05-07T14:05:56.649513+0000","last_active":"2024-05-07T14:05:56.649450+0000","last_peered":"2024-05-07T14:05:56.649450+0000","last_clean":"2024-05-07T14:05:56.649450+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:05:56.649450+0000","last_undegraded":"2024-05-07T14:05:56.649450+0000","last_fullsized":"2024-05-07T14:05:56.649450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'4","last_scrub_stamp":"2024-05-07T14:05:56.649228+0000","last_deep_scrub":"124'4","last_deep_scrub_stamp":"2024-05-07T14:05:56.649228+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.649228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:21.284356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"146'46","reported_seq":317,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.778168+0000","last_change":"2024-05-07T14:05:58.778227+0000","last_active":"2024-05-07T14:05:58.778168+0000","last_peered":"2024-05-07T14:05:58.778168+0000","last_clean":"2024-05-07T14:05:58.778168+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:05:58.778168+0000","last_undegraded":"2024-05-07T14:05:58.778168+0000","last_fullsized":"2024-05-07T14:05:58.778168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:05:58.777969+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:05:58.777969+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.777969+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:28.559834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":282,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.520416+0000","last_change":"2024-05-07T14:06:01.520470+0000","last_active":"2024-05-07T14:06:01.520416+0000","last_peered":"2024-05-07T14:06:01.520416+0000","last_clean":"2024-05-07T14:06:01.520416+0000","last_became_active":"2024-05-07T14:04:59.469021+0000","last_became_peered":"2024-05-07T14:04:59.469021+0000","last_unstale":"2024-05-07T14:06:01.520416+0000","last_undegraded":"2024-05-07T14:06:01.520416+0000","last_fullsized":"2024-05-07T14:06:01.520416+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:01.520195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:01.520195+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.520195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:14:10.503976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.519524+0000","last_change":"2024-05-07T14:06:00.519586+0000","last_active":"2024-05-07T14:06:00.519524+0000","last_peered":"2024-05-07T14:06:00.519524+0000","last_clean":"2024-05-07T14:06:00.519524+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:06:00.519524+0000","last_undegraded":"2024-05-07T14:06:00.519524+0000","last_fullsized":"2024-05-07T14:06:00.519524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:00.519279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:00.519279+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.519279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:29:45.676696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"148'60","reported_seq":328,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.033972+0000","last_change":"2024-05-07T14:05:49.034056+0000","last_active":"2024-05-07T14:05:49.033972+0000","last_peered":"2024-05-07T14:05:49.033972+0000","last_clean":"2024-05-07T14:05:49.033972+0000","last_became_active":"2024-05-07T14:04:59.442492+0000","last_became_peered":"2024-05-07T14:04:59.442492+0000","last_unstale":"2024-05-07T14:05:49.033972+0000","last_undegraded":"2024-05-07T14:05:49.033972+0000","last_fullsized":"2024-05-07T14:05:49.033972+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'60","last_scrub_stamp":"2024-05-07T14:05:49.033759+0000","last_deep_scrub":"148'60","last_deep_scrub_stamp":"2024-05-07T14:05:49.033759+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.033759+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:16:26.253219+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":61,"num_read_kb":279,"num_write":32,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":116761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":265,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.507426+0000","last_change":"2024-05-07T14:05:47.507486+0000","last_active":"2024-05-07T14:05:47.507426+0000","last_peered":"2024-05-07T14:05:47.507426+0000","last_clean":"2024-05-07T14:05:47.507426+0000","last_became_active":"2024-05-07T14:03:39.664810+0000","last_became_peered":"2024-05-07T14:03:39.664810+0000","last_unstale":"2024-05-07T14:05:47.507426+0000","last_undegraded":"2024-05-07T14:05:47.507426+0000","last_fullsized":"2024-05-07T14:05:47.507426+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:47.507097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:47.507097+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.507097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:36.691906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":261,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:09.922437+0000","last_change":"2024-05-07T14:06:09.922499+0000","last_active":"2024-05-07T14:06:09.922437+0000","last_peered":"2024-05-07T14:06:09.922437+0000","last_clean":"2024-05-07T14:06:09.922437+0000","last_became_active":"2024-05-07T14:04:59.464840+0000","last_became_peered":"2024-05-07T14:04:59.464840+0000","last_unstale":"2024-05-07T14:06:09.922437+0000","last_undegraded":"2024-05-07T14:06:09.922437+0000","last_fullsized":"2024-05-07T14:06:09.922437+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-05-07T14:06:09.922230+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-05-07T14:06:09.922230+0000","last_clean_scrub_stamp":"2024-05-07T14:06:09.922230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:35:51.631145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817584+0000","last_change":"2024-05-07T14:05:37.833141+0000","last_active":"2024-05-07T14:05:38.817584+0000","last_peered":"2024-05-07T14:05:38.817584+0000","last_clean":"2024-05-07T14:05:38.817584+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:05:38.817584+0000","last_undegraded":"2024-05-07T14:05:38.817584+0000","last_fullsized":"2024-05-07T14:05:38.817584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.833020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.833020+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.833020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:01.034811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'8","reported_seq":304,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.561068+0000","last_change":"2024-05-07T14:05:45.561131+0000","last_active":"2024-05-07T14:05:45.561068+0000","last_peered":"2024-05-07T14:05:45.561068+0000","last_clean":"2024-05-07T14:05:45.561068+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:05:45.561068+0000","last_undegraded":"2024-05-07T14:05:45.561068+0000","last_fullsized":"2024-05-07T14:05:45.561068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'8","last_scrub_stamp":"2024-05-07T14:05:45.560869+0000","last_deep_scrub":"87'8","last_deep_scrub_stamp":"2024-05-07T14:05:45.560869+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.560869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:19:10.110570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"146'46","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.427359+0000","last_change":"2024-05-07T14:04:59.669798+0000","last_active":"2024-05-07T14:05:38.427359+0000","last_peered":"2024-05-07T14:05:38.427359+0000","last_clean":"2024-05-07T14:05:38.427359+0000","last_became_active":"2024-05-07T14:04:59.428245+0000","last_became_peered":"2024-05-07T14:04:59.428245+0000","last_unstale":"2024-05-07T14:05:38.427359+0000","last_undegraded":"2024-05-07T14:05:38.427359+0000","last_fullsized":"2024-05-07T14:05:38.427359+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.308208+0000","last_change":"2024-05-07T14:05:56.308312+0000","last_active":"2024-05-07T14:05:56.308208+0000","last_peered":"2024-05-07T14:05:56.308208+0000","last_clean":"2024-05-07T14:05:56.308208+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:05:56.308208+0000","last_undegraded":"2024-05-07T14:05:56.308208+0000","last_fullsized":"2024-05-07T14:05:56.308208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:56.307973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:56.307973+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.307973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:20.943101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"148'27","reported_seq":298,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.476217+0000","last_change":"2024-05-07T14:05:56.476316+0000","last_active":"2024-05-07T14:05:56.476217+0000","last_peered":"2024-05-07T14:05:56.476217+0000","last_clean":"2024-05-07T14:05:56.476217+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:05:56.476217+0000","last_undegraded":"2024-05-07T14:05:56.476217+0000","last_fullsized":"2024-05-07T14:05:56.476217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'27","last_scrub_stamp":"2024-05-07T14:05:56.476028+0000","last_deep_scrub":"148'27","last_deep_scrub_stamp":"2024-05-07T14:05:56.476028+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.476028+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:31.469224+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.419916+0000","last_change":"2024-05-07T14:05:55.420057+0000","last_active":"2024-05-07T14:05:55.419916+0000","last_peered":"2024-05-07T14:05:55.419916+0000","last_clean":"2024-05-07T14:05:55.419916+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:05:55.419916+0000","last_undegraded":"2024-05-07T14:05:55.419916+0000","last_fullsized":"2024-05-07T14:05:55.419916+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:55.419676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:55.419676+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.419676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:03:21.429111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":258,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.482953+0000","last_change":"2024-05-07T14:05:49.483004+0000","last_active":"2024-05-07T14:05:49.482953+0000","last_peered":"2024-05-07T14:05:49.482953+0000","last_clean":"2024-05-07T14:05:49.482953+0000","last_became_active":"2024-05-07T14:04:59.446699+0000","last_became_peered":"2024-05-07T14:04:59.446699+0000","last_unstale":"2024-05-07T14:05:49.482953+0000","last_undegraded":"2024-05-07T14:05:49.482953+0000","last_fullsized":"2024-05-07T14:05:49.482953+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:49.482756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:49.482756+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.482756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:46:17.977501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"115'8","reported_seq":143,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.205253+0000","last_change":"2024-05-07T14:05:45.205253+0000","last_active":"2024-05-07T14:05:45.205253+0000","last_peered":"2024-05-07T14:05:45.205253+0000","last_clean":"2024-05-07T14:05:45.205253+0000","last_became_active":"2024-05-07T14:03:39.663976+0000","last_became_peered":"2024-05-07T14:03:39.663976+0000","last_unstale":"2024-05-07T14:05:45.205253+0000","last_undegraded":"2024-05-07T14:05:45.205253+0000","last_fullsized":"2024-05-07T14:05:45.205253+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'8","last_scrub_stamp":"2024-05-07T14:05:45.204988+0000","last_deep_scrub":"115'8","last_deep_scrub_stamp":"2024-05-07T14:05:45.204988+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.204988+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:48.179740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"146'42","reported_seq":301,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.011371+0000","last_change":"2024-05-07T14:06:03.011429+0000","last_active":"2024-05-07T14:06:03.011371+0000","last_peered":"2024-05-07T14:06:03.011371+0000","last_clean":"2024-05-07T14:06:03.011371+0000","last_became_active":"2024-05-07T14:04:59.445956+0000","last_became_peered":"2024-05-07T14:04:59.445956+0000","last_unstale":"2024-05-07T14:06:03.011371+0000","last_undegraded":"2024-05-07T14:06:03.011371+0000","last_fullsized":"2024-05-07T14:06:03.011371+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'42","last_scrub_stamp":"2024-05-07T14:06:03.011176+0000","last_deep_scrub":"146'42","last_deep_scrub_stamp":"2024-05-07T14:06:03.011176+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.011176+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:54.437904+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.512025+0000","last_change":"2024-05-07T14:05:58.512075+0000","last_active":"2024-05-07T14:05:58.512025+0000","last_peered":"2024-05-07T14:05:58.512025+0000","last_clean":"2024-05-07T14:05:58.512025+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:05:58.512025+0000","last_undegraded":"2024-05-07T14:05:58.512025+0000","last_fullsized":"2024-05-07T14:05:58.512025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:58.511758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:58.511758+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.511758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:47:57.912640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"148'12","reported_seq":273,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.845888+0000","last_change":"2024-05-07T14:05:43.845956+0000","last_active":"2024-05-07T14:05:43.845888+0000","last_peered":"2024-05-07T14:05:43.845888+0000","last_clean":"2024-05-07T14:05:43.845888+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:05:43.845888+0000","last_undegraded":"2024-05-07T14:05:43.845888+0000","last_fullsized":"2024-05-07T14:05:43.845888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'12","last_scrub_stamp":"2024-05-07T14:05:43.845686+0000","last_deep_scrub":"148'12","last_deep_scrub_stamp":"2024-05-07T14:05:43.845686+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.845686+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:26.632677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5538,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.957426+0000","last_change":"2024-05-07T14:06:00.957526+0000","last_active":"2024-05-07T14:06:00.957426+0000","last_peered":"2024-05-07T14:06:00.957426+0000","last_clean":"2024-05-07T14:06:00.957426+0000","last_became_active":"2024-05-07T14:04:59.444830+0000","last_became_peered":"2024-05-07T14:04:59.444830+0000","last_unstale":"2024-05-07T14:06:00.957426+0000","last_undegraded":"2024-05-07T14:06:00.957426+0000","last_fullsized":"2024-05-07T14:06:00.957426+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:00.957186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:00.957186+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.957186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:05:39.601200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"106'2","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817153+0000","last_change":"2024-05-07T14:05:38.814609+0000","last_active":"2024-05-07T14:05:38.817153+0000","last_peered":"2024-05-07T14:05:38.817153+0000","last_clean":"2024-05-07T14:05:38.817153+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:05:38.817153+0000","last_undegraded":"2024-05-07T14:05:38.817153+0000","last_fullsized":"2024-05-07T14:05:38.817153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'2","last_scrub_stamp":"2024-05-07T14:05:38.814267+0000","last_deep_scrub":"106'2","last_deep_scrub_stamp":"2024-05-07T14:05:38.814267+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.814267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:43:19.964109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"81'4","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.431905+0000","last_change":"2024-05-07T14:04:59.460718+0000","last_active":"2024-05-07T14:05:38.431905+0000","last_peered":"2024-05-07T14:05:38.431905+0000","last_clean":"2024-05-07T14:05:38.431905+0000","last_became_active":"2024-05-07T14:04:59.460037+0000","last_became_peered":"2024-05-07T14:04:59.460037+0000","last_unstale":"2024-05-07T14:05:38.431905+0000","last_undegraded":"2024-05-07T14:05:38.431905+0000","last_fullsized":"2024-05-07T14:05:38.431905+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"146'42","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.622452+0000","last_change":"2024-05-07T14:05:00.840128+0000","last_active":"2024-05-07T14:05:38.622452+0000","last_peered":"2024-05-07T14:05:38.622452+0000","last_clean":"2024-05-07T14:05:38.622452+0000","last_became_active":"2024-05-07T14:04:59.460944+0000","last_became_peered":"2024-05-07T14:04:59.460944+0000","last_unstale":"2024-05-07T14:05:38.622452+0000","last_undegraded":"2024-05-07T14:05:38.622452+0000","last_fullsized":"2024-05-07T14:05:38.622452+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.077615+0000","last_change":"2024-05-07T14:05:57.077670+0000","last_active":"2024-05-07T14:05:57.077615+0000","last_peered":"2024-05-07T14:05:57.077615+0000","last_clean":"2024-05-07T14:05:57.077615+0000","last_became_active":"2024-05-07T14:04:59.430654+0000","last_became_peered":"2024-05-07T14:04:59.430654+0000","last_unstale":"2024-05-07T14:05:57.077615+0000","last_undegraded":"2024-05-07T14:05:57.077615+0000","last_fullsized":"2024-05-07T14:05:57.077615+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:57.077420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:57.077420+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.077420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:30.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"148'28","reported_seq":299,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.476616+0000","last_change":"2024-05-07T14:05:52.476786+0000","last_active":"2024-05-07T14:05:52.476616+0000","last_peered":"2024-05-07T14:05:52.476616+0000","last_clean":"2024-05-07T14:05:52.476616+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:05:52.476616+0000","last_undegraded":"2024-05-07T14:05:52.476616+0000","last_fullsized":"2024-05-07T14:05:52.476616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'28","last_scrub_stamp":"2024-05-07T14:05:52.476367+0000","last_deep_scrub":"148'28","last_deep_scrub_stamp":"2024-05-07T14:05:52.476367+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.476367+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:55:57.556167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.485049+0000","last_change":"2024-05-07T14:05:43.485049+0000","last_active":"2024-05-07T14:05:43.485049+0000","last_peered":"2024-05-07T14:05:43.485049+0000","last_clean":"2024-05-07T14:05:43.485049+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:05:43.485049+0000","last_undegraded":"2024-05-07T14:05:43.485049+0000","last_fullsized":"2024-05-07T14:05:43.485049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:43.484792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:43.484792+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.484792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:29:40.976920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":257,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:08.967683+0000","last_change":"2024-05-07T14:06:08.967739+0000","last_active":"2024-05-07T14:06:08.967683+0000","last_peered":"2024-05-07T14:06:08.967683+0000","last_clean":"2024-05-07T14:06:08.967683+0000","last_became_active":"2024-05-07T14:04:59.443620+0000","last_became_peered":"2024-05-07T14:04:59.443620+0000","last_unstale":"2024-05-07T14:06:08.967683+0000","last_undegraded":"2024-05-07T14:06:08.967683+0000","last_fullsized":"2024-05-07T14:06:08.967683+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:08.967468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:08.967468+0000","last_clean_scrub_stamp":"2024-05-07T14:06:08.967468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:37:57.589066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"124'4","reported_seq":108,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.431161+0000","last_change":"2024-05-07T14:05:36.444547+0000","last_active":"2024-05-07T14:05:38.431161+0000","last_peered":"2024-05-07T14:05:38.431161+0000","last_clean":"2024-05-07T14:05:38.431161+0000","last_became_active":"2024-05-07T14:03:52.787675+0000","last_became_peered":"2024-05-07T14:03:52.787675+0000","last_unstale":"2024-05-07T14:05:38.431161+0000","last_undegraded":"2024-05-07T14:05:38.431161+0000","last_fullsized":"2024-05-07T14:05:38.431161+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'4","last_scrub_stamp":"2024-05-07T14:05:36.444446+0000","last_deep_scrub":"124'4","last_deep_scrub_stamp":"2024-05-07T14:05:36.444446+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.444446+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:36:14.354690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"146'48","reported_seq":266,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.897040+0000","last_change":"2024-05-07T14:05:50.897104+0000","last_active":"2024-05-07T14:05:50.897040+0000","last_peered":"2024-05-07T14:05:50.897040+0000","last_clean":"2024-05-07T14:05:50.897040+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:05:50.897040+0000","last_undegraded":"2024-05-07T14:05:50.897040+0000","last_fullsized":"2024-05-07T14:05:50.897040+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'48","last_scrub_stamp":"2024-05-07T14:05:50.896842+0000","last_deep_scrub":"146'48","last_deep_scrub_stamp":"2024-05-07T14:05:50.896842+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.896842+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:29:48.388971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.545058+0000","last_change":"2024-05-07T14:05:40.545058+0000","last_active":"2024-05-07T14:05:40.545058+0000","last_peered":"2024-05-07T14:05:40.545058+0000","last_clean":"2024-05-07T14:05:40.545058+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:05:40.545058+0000","last_undegraded":"2024-05-07T14:05:40.545058+0000","last_fullsized":"2024-05-07T14:05:40.545058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:40.544810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:40.544810+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.544810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:20.574590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"148'23","reported_seq":272,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.000772+0000","last_change":"2024-05-07T14:05:46.000847+0000","last_active":"2024-05-07T14:05:46.000772+0000","last_peered":"2024-05-07T14:05:46.000772+0000","last_clean":"2024-05-07T14:05:46.000772+0000","last_became_active":"2024-05-07T14:04:59.459102+0000","last_became_peered":"2024-05-07T14:04:59.459102+0000","last_unstale":"2024-05-07T14:05:46.000772+0000","last_undegraded":"2024-05-07T14:05:46.000772+0000","last_fullsized":"2024-05-07T14:05:46.000772+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'23","last_scrub_stamp":"2024-05-07T14:05:46.000594+0000","last_deep_scrub":"148'23","last_deep_scrub_stamp":"2024-05-07T14:05:46.000594+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.000594+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:54.187159+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:06.676260+0000","last_change":"2024-05-07T14:06:06.676312+0000","last_active":"2024-05-07T14:06:06.676260+0000","last_peered":"2024-05-07T14:06:06.676260+0000","last_clean":"2024-05-07T14:06:06.676260+0000","last_became_active":"2024-05-07T14:04:59.448594+0000","last_became_peered":"2024-05-07T14:04:59.448594+0000","last_unstale":"2024-05-07T14:06:06.676260+0000","last_undegraded":"2024-05-07T14:06:06.676260+0000","last_fullsized":"2024-05-07T14:06:06.676260+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:06.676064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:06.676064+0000","last_clean_scrub_stamp":"2024-05-07T14:06:06.676064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:49.790047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"115'6","reported_seq":277,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.457812+0000","last_change":"2024-05-07T14:05:44.457873+0000","last_active":"2024-05-07T14:05:44.457812+0000","last_peered":"2024-05-07T14:05:44.457812+0000","last_clean":"2024-05-07T14:05:44.457812+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:05:44.457812+0000","last_undegraded":"2024-05-07T14:05:44.457812+0000","last_fullsized":"2024-05-07T14:05:44.457812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'6","last_scrub_stamp":"2024-05-07T14:05:44.457606+0000","last_deep_scrub":"115'6","last_deep_scrub_stamp":"2024-05-07T14:05:44.457606+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.457606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:49:01.673952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"146'52","reported_seq":324,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:08.567249+0000","last_change":"2024-05-07T14:06:08.567333+0000","last_active":"2024-05-07T14:06:08.567249+0000","last_peered":"2024-05-07T14:06:08.567249+0000","last_clean":"2024-05-07T14:06:08.567249+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:06:08.567249+0000","last_undegraded":"2024-05-07T14:06:08.567249+0000","last_fullsized":"2024-05-07T14:06:08.567249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'52","last_scrub_stamp":"2024-05-07T14:06:08.567041+0000","last_deep_scrub":"146'52","last_deep_scrub_stamp":"2024-05-07T14:06:08.567041+0000","last_clean_scrub_stamp":"2024-05-07T14:06:08.567041+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:46:01.051197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":270,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:09.699858+0000","last_change":"2024-05-07T14:06:09.699913+0000","last_active":"2024-05-07T14:06:09.699858+0000","last_peered":"2024-05-07T14:06:09.699858+0000","last_clean":"2024-05-07T14:06:09.699858+0000","last_became_active":"2024-05-07T14:04:59.455608+0000","last_became_peered":"2024-05-07T14:04:59.455608+0000","last_unstale":"2024-05-07T14:06:09.699858+0000","last_undegraded":"2024-05-07T14:06:09.699858+0000","last_fullsized":"2024-05-07T14:06:09.699858+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:09.699648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:09.699648+0000","last_clean_scrub_stamp":"2024-05-07T14:06:09.699648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:37:58.321246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"148'39","reported_seq":316,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.249295+0000","last_change":"2024-05-07T14:05:48.249295+0000","last_active":"2024-05-07T14:05:48.249295+0000","last_peered":"2024-05-07T14:05:48.249295+0000","last_clean":"2024-05-07T14:05:48.249295+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:05:48.249295+0000","last_undegraded":"2024-05-07T14:05:48.249295+0000","last_fullsized":"2024-05-07T14:05:48.249295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'39","last_scrub_stamp":"2024-05-07T14:05:48.248967+0000","last_deep_scrub":"148'39","last_deep_scrub_stamp":"2024-05-07T14:05:48.248967+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.248967+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:11.450758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.857125+0000","last_change":"2024-05-07T14:05:57.857125+0000","last_active":"2024-05-07T14:05:57.857125+0000","last_peered":"2024-05-07T14:05:57.857125+0000","last_clean":"2024-05-07T14:05:57.857125+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:05:57.857125+0000","last_undegraded":"2024-05-07T14:05:57.857125+0000","last_fullsized":"2024-05-07T14:05:57.857125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:57.856658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:57.856658+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.856658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:29:43.014075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"81'2","reported_seq":247,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.432128+0000","last_change":"2024-05-07T14:01:06.368735+0000","last_active":"2024-05-07T14:05:38.432128+0000","last_peered":"2024-05-07T14:05:38.432128+0000","last_clean":"2024-05-07T14:05:38.432128+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:05:38.432128+0000","last_undegraded":"2024-05-07T14:05:38.432128+0000","last_fullsized":"2024-05-07T14:05:38.432128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:04.980097+0000","last_clean_scrub_stamp":"2024-05-07T14:01:04.980097+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"115'8","reported_seq":308,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:10.671271+0000","last_change":"2024-05-07T14:06:10.671373+0000","last_active":"2024-05-07T14:06:10.671271+0000","last_peered":"2024-05-07T14:06:10.671271+0000","last_clean":"2024-05-07T14:06:10.671271+0000","last_became_active":"2024-05-07T14:04:59.456492+0000","last_became_peered":"2024-05-07T14:04:59.456492+0000","last_unstale":"2024-05-07T14:06:10.671271+0000","last_undegraded":"2024-05-07T14:06:10.671271+0000","last_fullsized":"2024-05-07T14:06:10.671271+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'8","last_scrub_stamp":"2024-05-07T14:06:10.671067+0000","last_deep_scrub":"115'8","last_deep_scrub_stamp":"2024-05-07T14:06:10.671067+0000","last_clean_scrub_stamp":"2024-05-07T14:06:10.671067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:35:52.379982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"146'44","reported_seq":314,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.201457+0000","last_change":"2024-05-07T14:05:50.201517+0000","last_active":"2024-05-07T14:05:50.201457+0000","last_peered":"2024-05-07T14:05:50.201457+0000","last_clean":"2024-05-07T14:05:50.201457+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:05:50.201457+0000","last_undegraded":"2024-05-07T14:05:50.201457+0000","last_fullsized":"2024-05-07T14:05:50.201457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'44","last_scrub_stamp":"2024-05-07T14:05:50.201259+0000","last_deep_scrub":"146'44","last_deep_scrub_stamp":"2024-05-07T14:05:50.201259+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.201259+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:07:00.801081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.481649+0000","last_change":"2024-05-07T14:05:38.478809+0000","last_active":"2024-05-07T14:05:38.481649+0000","last_peered":"2024-05-07T14:05:38.481649+0000","last_clean":"2024-05-07T14:05:38.481649+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:05:38.481649+0000","last_undegraded":"2024-05-07T14:05:38.481649+0000","last_fullsized":"2024-05-07T14:05:38.481649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:38.478574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:38.478574+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.478574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:16:37.999538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"148'32","reported_seq":284,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.033194+0000","last_change":"2024-05-07T14:05:59.033277+0000","last_active":"2024-05-07T14:05:59.033194+0000","last_peered":"2024-05-07T14:05:59.033194+0000","last_clean":"2024-05-07T14:05:59.033194+0000","last_became_active":"2024-05-07T14:04:59.439603+0000","last_became_peered":"2024-05-07T14:04:59.439603+0000","last_unstale":"2024-05-07T14:05:59.033194+0000","last_undegraded":"2024-05-07T14:05:59.033194+0000","last_fullsized":"2024-05-07T14:05:59.033194+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'32","last_scrub_stamp":"2024-05-07T14:05:59.033002+0000","last_deep_scrub":"148'32","last_deep_scrub_stamp":"2024-05-07T14:05:59.033002+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.033002+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:37:03.416302+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.442281+0000","last_change":"2024-05-07T14:05:37.201385+0000","last_active":"2024-05-07T14:05:38.442281+0000","last_peered":"2024-05-07T14:05:38.442281+0000","last_clean":"2024-05-07T14:05:38.442281+0000","last_became_active":"2024-05-07T14:03:39.666888+0000","last_became_peered":"2024-05-07T14:03:39.666888+0000","last_unstale":"2024-05-07T14:05:38.442281+0000","last_undegraded":"2024-05-07T14:05:38.442281+0000","last_fullsized":"2024-05-07T14:05:38.442281+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.201219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.201219+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.201219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:06.409925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":257,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.545142+0000","last_change":"2024-05-07T14:05:59.545196+0000","last_active":"2024-05-07T14:05:59.545142+0000","last_peered":"2024-05-07T14:05:59.545142+0000","last_clean":"2024-05-07T14:05:59.545142+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:59.545142+0000","last_undegraded":"2024-05-07T14:05:59.545142+0000","last_fullsized":"2024-05-07T14:05:59.545142+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:59.544944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:59.544944+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.544944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:47:38.230988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"81'4","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:02.600528+0000","last_change":"2024-05-07T14:06:02.600586+0000","last_active":"2024-05-07T14:06:02.600528+0000","last_peered":"2024-05-07T14:06:02.600528+0000","last_clean":"2024-05-07T14:06:02.600528+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:06:02.600528+0000","last_undegraded":"2024-05-07T14:06:02.600528+0000","last_fullsized":"2024-05-07T14:06:02.600528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-05-07T14:06:02.600288+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-05-07T14:06:02.600288+0000","last_clean_scrub_stamp":"2024-05-07T14:06:02.600288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:27:50.562590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"146'54","reported_seq":326,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.624309+0000","last_change":"2024-05-07T14:05:59.624373+0000","last_active":"2024-05-07T14:05:59.624309+0000","last_peered":"2024-05-07T14:05:59.624309+0000","last_clean":"2024-05-07T14:05:59.624309+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:05:59.624309+0000","last_undegraded":"2024-05-07T14:05:59.624309+0000","last_fullsized":"2024-05-07T14:05:59.624309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:05:59.624075+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:05:59.624075+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.624075+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:11:34.365597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":264,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.691568+0000","last_change":"2024-05-07T14:05:49.691568+0000","last_active":"2024-05-07T14:05:49.691568+0000","last_peered":"2024-05-07T14:05:49.691568+0000","last_clean":"2024-05-07T14:05:49.691568+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:05:49.691568+0000","last_undegraded":"2024-05-07T14:05:49.691568+0000","last_fullsized":"2024-05-07T14:05:49.691568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:49.691319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:49.691319+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.691319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:26.349257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"148'26","reported_seq":297,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.488875+0000","last_change":"2024-05-07T14:05:53.488960+0000","last_active":"2024-05-07T14:05:53.488875+0000","last_peered":"2024-05-07T14:05:53.488875+0000","last_clean":"2024-05-07T14:05:53.488875+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:05:53.488875+0000","last_undegraded":"2024-05-07T14:05:53.488875+0000","last_fullsized":"2024-05-07T14:05:53.488875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'26","last_scrub_stamp":"2024-05-07T14:05:53.488692+0000","last_deep_scrub":"148'26","last_deep_scrub_stamp":"2024-05-07T14:05:53.488692+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.488692+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:16.144965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.443659+0000","last_change":"2024-05-07T14:05:38.238816+0000","last_active":"2024-05-07T14:05:38.443659+0000","last_peered":"2024-05-07T14:05:38.443659+0000","last_clean":"2024-05-07T14:05:38.443659+0000","last_became_active":"2024-05-07T14:03:39.663569+0000","last_became_peered":"2024-05-07T14:03:39.663569+0000","last_unstale":"2024-05-07T14:05:38.443659+0000","last_undegraded":"2024-05-07T14:05:38.443659+0000","last_fullsized":"2024-05-07T14:05:38.443659+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:38.238679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:38.238679+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.238679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:04.203961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":257,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.619962+0000","last_change":"2024-05-07T14:05:37.626705+0000","last_active":"2024-05-07T14:05:38.619962+0000","last_peered":"2024-05-07T14:05:38.619962+0000","last_clean":"2024-05-07T14:05:38.619962+0000","last_became_active":"2024-05-07T14:04:59.447025+0000","last_became_peered":"2024-05-07T14:04:59.447025+0000","last_unstale":"2024-05-07T14:05:38.619962+0000","last_undegraded":"2024-05-07T14:05:38.619962+0000","last_fullsized":"2024-05-07T14:05:38.619962+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.626305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.626305+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.626305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:22.857038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"124'14","reported_seq":312,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.927389+0000","last_change":"2024-05-07T14:05:43.927389+0000","last_active":"2024-05-07T14:05:43.927389+0000","last_peered":"2024-05-07T14:05:43.927389+0000","last_clean":"2024-05-07T14:05:43.927389+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:05:43.927389+0000","last_undegraded":"2024-05-07T14:05:43.927389+0000","last_fullsized":"2024-05-07T14:05:43.927389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'14","last_scrub_stamp":"2024-05-07T14:05:43.927105+0000","last_deep_scrub":"124'14","last_deep_scrub_stamp":"2024-05-07T14:05:43.927105+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.927105+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:35:13.144108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"146'40","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.725248+0000","last_change":"2024-05-07T14:06:01.725305+0000","last_active":"2024-05-07T14:06:01.725248+0000","last_peered":"2024-05-07T14:06:01.725248+0000","last_clean":"2024-05-07T14:06:01.725248+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:06:01.725248+0000","last_undegraded":"2024-05-07T14:06:01.725248+0000","last_fullsized":"2024-05-07T14:06:01.725248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'40","last_scrub_stamp":"2024-05-07T14:06:01.725057+0000","last_deep_scrub":"146'40","last_deep_scrub_stamp":"2024-05-07T14:06:01.725057+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.725057+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:56:16.264084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.268579+0000","last_change":"2024-05-07T14:05:55.268579+0000","last_active":"2024-05-07T14:05:55.268579+0000","last_peered":"2024-05-07T14:05:55.268579+0000","last_clean":"2024-05-07T14:05:55.268579+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:05:55.268579+0000","last_undegraded":"2024-05-07T14:05:55.268579+0000","last_fullsized":"2024-05-07T14:05:55.268579+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:55.268317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:55.268317+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.268317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:41.367324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"148'15","reported_seq":280,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.613898+0000","last_change":"2024-05-07T14:05:38.614039+0000","last_active":"2024-05-07T14:05:38.613898+0000","last_peered":"2024-05-07T14:05:38.613898+0000","last_clean":"2024-05-07T14:05:38.613898+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:05:38.613898+0000","last_undegraded":"2024-05-07T14:05:38.613898+0000","last_fullsized":"2024-05-07T14:05:38.613898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'15","last_scrub_stamp":"2024-05-07T14:05:38.613662+0000","last_deep_scrub":"148'15","last_deep_scrub_stamp":"2024-05-07T14:05:38.613662+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.613662+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:07.822368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"146'138","reported_seq":522,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.542933+0000","last_change":"2024-05-07T14:05:41.543002+0000","last_active":"2024-05-07T14:05:41.542933+0000","last_peered":"2024-05-07T14:05:41.542933+0000","last_clean":"2024-05-07T14:05:41.542933+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:05:41.542933+0000","last_undegraded":"2024-05-07T14:05:41.542933+0000","last_fullsized":"2024-05-07T14:05:41.542933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'138","last_scrub_stamp":"2024-05-07T14:05:41.542673+0000","last_deep_scrub":"146'138","last_deep_scrub_stamp":"2024-05-07T14:05:41.542673+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.542673+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:59:42.861721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"81'7","reported_seq":174,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.048791+0000","last_change":"2024-05-07T14:05:54.048853+0000","last_active":"2024-05-07T14:05:54.048791+0000","last_peered":"2024-05-07T14:05:54.048791+0000","last_clean":"2024-05-07T14:05:54.048791+0000","last_became_active":"2024-05-07T14:04:59.444580+0000","last_became_peered":"2024-05-07T14:04:59.444580+0000","last_unstale":"2024-05-07T14:05:54.048791+0000","last_undegraded":"2024-05-07T14:05:54.048791+0000","last_fullsized":"2024-05-07T14:05:54.048791+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-05-07T14:05:54.048591+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-05-07T14:05:54.048591+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.048591+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:39:46.109066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"124'8","reported_seq":303,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:04.722821+0000","last_change":"2024-05-07T14:06:04.722905+0000","last_active":"2024-05-07T14:06:04.722821+0000","last_peered":"2024-05-07T14:06:04.722821+0000","last_clean":"2024-05-07T14:06:04.722821+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:06:04.722821+0000","last_undegraded":"2024-05-07T14:06:04.722821+0000","last_fullsized":"2024-05-07T14:06:04.722821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'8","last_scrub_stamp":"2024-05-07T14:06:04.722616+0000","last_deep_scrub":"124'8","last_deep_scrub_stamp":"2024-05-07T14:06:04.722616+0000","last_clean_scrub_stamp":"2024-05-07T14:06:04.722616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:20.402218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"146'40","reported_seq":310,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.841863+0000","last_change":"2024-05-07T14:05:56.841863+0000","last_active":"2024-05-07T14:05:56.841863+0000","last_peered":"2024-05-07T14:05:56.841863+0000","last_clean":"2024-05-07T14:05:56.841863+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:05:56.841863+0000","last_undegraded":"2024-05-07T14:05:56.841863+0000","last_fullsized":"2024-05-07T14:05:56.841863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'40","last_scrub_stamp":"2024-05-07T14:05:56.841574+0000","last_deep_scrub":"146'40","last_deep_scrub_stamp":"2024-05-07T14:05:56.841574+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.841574+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:26.623439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.099350+0000","last_change":"2024-05-07T14:05:56.099401+0000","last_active":"2024-05-07T14:05:56.099350+0000","last_peered":"2024-05-07T14:05:56.099350+0000","last_clean":"2024-05-07T14:05:56.099350+0000","last_became_active":"2024-05-07T14:04:59.421636+0000","last_became_peered":"2024-05-07T14:04:59.421636+0000","last_unstale":"2024-05-07T14:05:56.099350+0000","last_undegraded":"2024-05-07T14:05:56.099350+0000","last_fullsized":"2024-05-07T14:05:56.099350+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:56.099165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:56.099165+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.099165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:22.405401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"148'32","reported_seq":304,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.912105+0000","last_change":"2024-05-07T14:05:53.912191+0000","last_active":"2024-05-07T14:05:53.912105+0000","last_peered":"2024-05-07T14:05:53.912105+0000","last_clean":"2024-05-07T14:05:53.912105+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:05:53.912105+0000","last_undegraded":"2024-05-07T14:05:53.912105+0000","last_fullsized":"2024-05-07T14:05:53.912105+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'32","last_scrub_stamp":"2024-05-07T14:05:53.911918+0000","last_deep_scrub":"148'32","last_deep_scrub_stamp":"2024-05-07T14:05:53.911918+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.911918+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:28.905114+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.824280+0000","last_change":"2024-05-07T14:05:51.824280+0000","last_active":"2024-05-07T14:05:51.824280+0000","last_peered":"2024-05-07T14:05:51.824280+0000","last_clean":"2024-05-07T14:05:51.824280+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:05:51.824280+0000","last_undegraded":"2024-05-07T14:05:51.824280+0000","last_fullsized":"2024-05-07T14:05:51.824280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:51.824017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:51.824017+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.824017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:29.249577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"124'7","reported_seq":170,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:09.940667+0000","last_change":"2024-05-07T14:06:09.940725+0000","last_active":"2024-05-07T14:06:09.940667+0000","last_peered":"2024-05-07T14:06:09.940667+0000","last_clean":"2024-05-07T14:06:09.940667+0000","last_became_active":"2024-05-07T14:04:59.467712+0000","last_became_peered":"2024-05-07T14:04:59.467712+0000","last_unstale":"2024-05-07T14:06:09.940667+0000","last_undegraded":"2024-05-07T14:06:09.940667+0000","last_fullsized":"2024-05-07T14:06:09.940667+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'7","last_scrub_stamp":"2024-05-07T14:06:09.940469+0000","last_deep_scrub":"124'7","last_deep_scrub_stamp":"2024-05-07T14:06:09.940469+0000","last_clean_scrub_stamp":"2024-05-07T14:06:09.940469+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:14:09.680319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"115'2","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.653939+0000","last_change":"2024-05-07T14:05:48.653939+0000","last_active":"2024-05-07T14:05:48.653939+0000","last_peered":"2024-05-07T14:05:48.653939+0000","last_clean":"2024-05-07T14:05:48.653939+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:05:48.653939+0000","last_undegraded":"2024-05-07T14:05:48.653939+0000","last_fullsized":"2024-05-07T14:05:48.653939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'2","last_scrub_stamp":"2024-05-07T14:05:48.653679+0000","last_deep_scrub":"115'2","last_deep_scrub_stamp":"2024-05-07T14:05:48.653679+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.653679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:44.088893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"146'50","reported_seq":321,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:05.919924+0000","last_change":"2024-05-07T14:06:05.919991+0000","last_active":"2024-05-07T14:06:05.919924+0000","last_peered":"2024-05-07T14:06:05.919924+0000","last_clean":"2024-05-07T14:06:05.919924+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:06:05.919924+0000","last_undegraded":"2024-05-07T14:06:05.919924+0000","last_fullsized":"2024-05-07T14:06:05.919924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'50","last_scrub_stamp":"2024-05-07T14:06:05.919717+0000","last_deep_scrub":"146'50","last_deep_scrub_stamp":"2024-05-07T14:06:05.919717+0000","last_clean_scrub_stamp":"2024-05-07T14:06:05.919717+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:49.033699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.701255+0000","last_change":"2024-05-07T14:05:44.701255+0000","last_active":"2024-05-07T14:05:44.701255+0000","last_peered":"2024-05-07T14:05:44.701255+0000","last_clean":"2024-05-07T14:05:44.701255+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:05:44.701255+0000","last_undegraded":"2024-05-07T14:05:44.701255+0000","last_fullsized":"2024-05-07T14:05:44.701255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:44.700991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:44.700991+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.700991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:33.885801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"148'23","reported_seq":293,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.859633+0000","last_change":"2024-05-07T14:05:45.859633+0000","last_active":"2024-05-07T14:05:45.859633+0000","last_peered":"2024-05-07T14:05:45.859633+0000","last_clean":"2024-05-07T14:05:45.859633+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:05:45.859633+0000","last_undegraded":"2024-05-07T14:05:45.859633+0000","last_fullsized":"2024-05-07T14:05:45.859633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'23","last_scrub_stamp":"2024-05-07T14:05:45.859366+0000","last_deep_scrub":"148'23","last_deep_scrub_stamp":"2024-05-07T14:05:45.859366+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.859366+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:10.494494+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":261,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.530458+0000","last_change":"2024-05-07T14:06:00.530523+0000","last_active":"2024-05-07T14:06:00.530458+0000","last_peered":"2024-05-07T14:06:00.530458+0000","last_clean":"2024-05-07T14:06:00.530458+0000","last_became_active":"2024-05-07T14:04:59.465509+0000","last_became_peered":"2024-05-07T14:04:59.465509+0000","last_unstale":"2024-05-07T14:06:00.530458+0000","last_undegraded":"2024-05-07T14:06:00.530458+0000","last_fullsized":"2024-05-07T14:06:00.530458+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:00.530260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:00.530260+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.530260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:53:59.956590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.489035+0000","last_change":"2024-05-07T14:05:48.489035+0000","last_active":"2024-05-07T14:05:48.489035+0000","last_peered":"2024-05-07T14:05:48.489035+0000","last_clean":"2024-05-07T14:05:48.489035+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:05:48.489035+0000","last_undegraded":"2024-05-07T14:05:48.489035+0000","last_fullsized":"2024-05-07T14:05:48.489035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:48.488773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:48.488773+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.488773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:22.867351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"87'6","reported_seq":292,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:06.532076+0000","last_change":"2024-05-07T14:06:06.532138+0000","last_active":"2024-05-07T14:06:06.532076+0000","last_peered":"2024-05-07T14:06:06.532076+0000","last_clean":"2024-05-07T14:06:06.532076+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:06:06.532076+0000","last_undegraded":"2024-05-07T14:06:06.532076+0000","last_fullsized":"2024-05-07T14:06:06.532076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'6","last_scrub_stamp":"2024-05-07T14:06:06.531865+0000","last_deep_scrub":"87'6","last_deep_scrub_stamp":"2024-05-07T14:06:06.531865+0000","last_clean_scrub_stamp":"2024-05-07T14:06:06.531865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:50:02.575674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"146'38","reported_seq":309,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:10.591021+0000","last_change":"2024-05-07T14:06:10.591084+0000","last_active":"2024-05-07T14:06:10.591021+0000","last_peered":"2024-05-07T14:06:10.591021+0000","last_clean":"2024-05-07T14:06:10.591021+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:06:10.591021+0000","last_undegraded":"2024-05-07T14:06:10.591021+0000","last_fullsized":"2024-05-07T14:06:10.591021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'38","last_scrub_stamp":"2024-05-07T14:06:10.590818+0000","last_deep_scrub":"146'38","last_deep_scrub_stamp":"2024-05-07T14:06:10.590818+0000","last_clean_scrub_stamp":"2024-05-07T14:06:10.590818+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.898851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":264,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.624574+0000","last_change":"2024-05-07T14:05:47.624574+0000","last_active":"2024-05-07T14:05:47.624574+0000","last_peered":"2024-05-07T14:05:47.624574+0000","last_clean":"2024-05-07T14:05:47.624574+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:05:47.624574+0000","last_undegraded":"2024-05-07T14:05:47.624574+0000","last_fullsized":"2024-05-07T14:05:47.624574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:47.624325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:47.624325+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.624325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:41.740511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"146'16","reported_seq":284,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.433949+0000","last_change":"2024-05-07T14:04:59.460738+0000","last_active":"2024-05-07T14:05:38.433949+0000","last_peered":"2024-05-07T14:05:38.433949+0000","last_clean":"2024-05-07T14:05:38.433949+0000","last_became_active":"2024-05-07T14:04:59.459963+0000","last_became_peered":"2024-05-07T14:04:59.459963+0000","last_unstale":"2024-05-07T14:05:38.433949+0000","last_undegraded":"2024-05-07T14:05:38.433949+0000","last_fullsized":"2024-05-07T14:05:38.433949+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:01:00.967813+0000","last_clean_scrub_stamp":"2024-05-07T14:01:00.967813+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426623+0000","last_change":"2024-05-07T14:05:36.573639+0000","last_active":"2024-05-07T14:05:38.426623+0000","last_peered":"2024-05-07T14:05:38.426623+0000","last_clean":"2024-05-07T14:05:38.426623+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:05:38.426623+0000","last_undegraded":"2024-05-07T14:05:38.426623+0000","last_fullsized":"2024-05-07T14:05:38.426623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:36.573247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:36.573247+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.573247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:29:34.065375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"81'8","reported_seq":235,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.000527+0000","last_change":"2024-05-07T14:05:39.000586+0000","last_active":"2024-05-07T14:05:39.000527+0000","last_peered":"2024-05-07T14:05:39.000527+0000","last_clean":"2024-05-07T14:05:39.000527+0000","last_became_active":"2024-05-07T14:04:59.456842+0000","last_became_peered":"2024-05-07T14:04:59.456842+0000","last_unstale":"2024-05-07T14:05:39.000527+0000","last_undegraded":"2024-05-07T14:05:39.000527+0000","last_fullsized":"2024-05-07T14:05:39.000527+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-05-07T14:05:39.000323+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-05-07T14:05:39.000323+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.000323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:29:10.124568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"115'10","reported_seq":308,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:02.652829+0000","last_change":"2024-05-07T14:06:02.652887+0000","last_active":"2024-05-07T14:06:02.652829+0000","last_peered":"2024-05-07T14:06:02.652829+0000","last_clean":"2024-05-07T14:06:02.652829+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:06:02.652829+0000","last_undegraded":"2024-05-07T14:06:02.652829+0000","last_fullsized":"2024-05-07T14:06:02.652829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'10","last_scrub_stamp":"2024-05-07T14:06:02.652618+0000","last_deep_scrub":"115'10","last_deep_scrub_stamp":"2024-05-07T14:06:02.652618+0000","last_clean_scrub_stamp":"2024-05-07T14:06:02.652618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:40.078178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"146'44","reported_seq":320,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.818253+0000","last_change":"2024-05-07T14:05:34.912199+0000","last_active":"2024-05-07T14:05:38.818253+0000","last_peered":"2024-05-07T14:05:38.818253+0000","last_clean":"2024-05-07T14:05:38.818253+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:05:38.818253+0000","last_undegraded":"2024-05-07T14:05:38.818253+0000","last_fullsized":"2024-05-07T14:05:38.818253+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'44","last_scrub_stamp":"2024-05-07T14:05:34.912082+0000","last_deep_scrub":"146'44","last_deep_scrub_stamp":"2024-05-07T14:05:34.912082+0000","last_clean_scrub_stamp":"2024-05-07T14:05:34.912082+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:37.886834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"148'2","reported_seq":119,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.174020+0000","last_change":"2024-05-07T14:05:41.174020+0000","last_active":"2024-05-07T14:05:41.174020+0000","last_peered":"2024-05-07T14:05:41.174020+0000","last_clean":"2024-05-07T14:05:41.174020+0000","last_became_active":"2024-05-07T14:03:39.659887+0000","last_became_peered":"2024-05-07T14:03:39.659887+0000","last_unstale":"2024-05-07T14:05:41.174020+0000","last_undegraded":"2024-05-07T14:05:41.174020+0000","last_fullsized":"2024-05-07T14:05:41.174020+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'2","last_scrub_stamp":"2024-05-07T14:05:41.173764+0000","last_deep_scrub":"148'2","last_deep_scrub_stamp":"2024-05-07T14:05:41.173764+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.173764+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:50.492880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"148'23","reported_seq":294,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.595078+0000","last_change":"2024-05-07T14:05:40.595078+0000","last_active":"2024-05-07T14:05:40.595078+0000","last_peered":"2024-05-07T14:05:40.595078+0000","last_clean":"2024-05-07T14:05:40.595078+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:05:40.595078+0000","last_undegraded":"2024-05-07T14:05:40.595078+0000","last_fullsized":"2024-05-07T14:05:40.595078+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'23","last_scrub_stamp":"2024-05-07T14:05:40.594787+0000","last_deep_scrub":"148'23","last_deep_scrub_stamp":"2024-05-07T14:05:40.594787+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.594787+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:38:48.903429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.790915+0000","last_change":"2024-05-07T14:05:49.790915+0000","last_active":"2024-05-07T14:05:49.790915+0000","last_peered":"2024-05-07T14:05:49.790915+0000","last_clean":"2024-05-07T14:05:49.790915+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:05:49.790915+0000","last_undegraded":"2024-05-07T14:05:49.790915+0000","last_fullsized":"2024-05-07T14:05:49.790915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:49.790525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:49.790525+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.790525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:41:50.118541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":252,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:08.741907+0000","last_change":"2024-05-07T14:06:08.741966+0000","last_active":"2024-05-07T14:06:08.741907+0000","last_peered":"2024-05-07T14:06:08.741907+0000","last_clean":"2024-05-07T14:06:08.741907+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:06:08.741907+0000","last_undegraded":"2024-05-07T14:06:08.741907+0000","last_fullsized":"2024-05-07T14:06:08.741907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:08.741704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:08.741704+0000","last_clean_scrub_stamp":"2024-05-07T14:06:08.741704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:51:32.889028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"87'16","reported_seq":124,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.217638+0000","last_change":"2024-05-07T14:06:00.217698+0000","last_active":"2024-05-07T14:06:00.217638+0000","last_peered":"2024-05-07T14:06:00.217638+0000","last_clean":"2024-05-07T14:06:00.217638+0000","last_became_active":"2024-05-07T14:03:39.671068+0000","last_became_peered":"2024-05-07T14:03:39.671068+0000","last_unstale":"2024-05-07T14:06:00.217638+0000","last_undegraded":"2024-05-07T14:06:00.217638+0000","last_fullsized":"2024-05-07T14:06:00.217638+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'16","last_scrub_stamp":"2024-05-07T14:06:00.217433+0000","last_deep_scrub":"87'16","last_deep_scrub_stamp":"2024-05-07T14:06:00.217433+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.217433+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:42:00.545449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"146'44","reported_seq":314,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.440941+0000","last_change":"2024-05-07T14:05:48.441055+0000","last_active":"2024-05-07T14:05:48.440941+0000","last_peered":"2024-05-07T14:05:48.440941+0000","last_clean":"2024-05-07T14:05:48.440941+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:05:48.440941+0000","last_undegraded":"2024-05-07T14:05:48.440941+0000","last_fullsized":"2024-05-07T14:05:48.440941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'44","last_scrub_stamp":"2024-05-07T14:05:48.440708+0000","last_deep_scrub":"146'44","last_deep_scrub_stamp":"2024-05-07T14:05:48.440708+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.440708+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:44.233012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.157085+0000","last_change":"2024-05-07T14:05:40.157085+0000","last_active":"2024-05-07T14:05:40.157085+0000","last_peered":"2024-05-07T14:05:40.157085+0000","last_clean":"2024-05-07T14:05:40.157085+0000","last_became_active":"2024-05-07T14:03:39.661339+0000","last_became_peered":"2024-05-07T14:03:39.661339+0000","last_unstale":"2024-05-07T14:05:40.157085+0000","last_undegraded":"2024-05-07T14:05:40.157085+0000","last_fullsized":"2024-05-07T14:05:40.157085+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:40.156796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:40.156796+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.156796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:35.949101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"146'34","reported_seq":308,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.889952+0000","last_change":"2024-05-07T14:05:52.890010+0000","last_active":"2024-05-07T14:05:52.889952+0000","last_peered":"2024-05-07T14:05:52.889952+0000","last_clean":"2024-05-07T14:05:52.889952+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:05:52.889952+0000","last_undegraded":"2024-05-07T14:05:52.889952+0000","last_fullsized":"2024-05-07T14:05:52.889952+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'34","last_scrub_stamp":"2024-05-07T14:05:52.889760+0000","last_deep_scrub":"146'34","last_deep_scrub_stamp":"2024-05-07T14:05:52.889760+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.889760+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:22.098465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"81'6","reported_seq":297,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:10.891049+0000","last_change":"2024-05-07T14:06:10.891108+0000","last_active":"2024-05-07T14:06:10.891049+0000","last_peered":"2024-05-07T14:06:10.891049+0000","last_clean":"2024-05-07T14:06:10.891049+0000","last_became_active":"2024-05-07T14:04:59.466443+0000","last_became_peered":"2024-05-07T14:04:59.466443+0000","last_unstale":"2024-05-07T14:06:10.891049+0000","last_undegraded":"2024-05-07T14:06:10.891049+0000","last_fullsized":"2024-05-07T14:06:10.891049+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-05-07T14:06:10.890810+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-05-07T14:06:10.890810+0000","last_clean_scrub_stamp":"2024-05-07T14:06:10.890810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:58:16.635715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"146'50","reported_seq":320,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.933990+0000","last_change":"2024-05-07T14:06:03.934054+0000","last_active":"2024-05-07T14:06:03.933990+0000","last_peered":"2024-05-07T14:06:03.933990+0000","last_clean":"2024-05-07T14:06:03.933990+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:06:03.933990+0000","last_undegraded":"2024-05-07T14:06:03.933990+0000","last_fullsized":"2024-05-07T14:06:03.933990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'50","last_scrub_stamp":"2024-05-07T14:06:03.933744+0000","last_deep_scrub":"146'50","last_deep_scrub_stamp":"2024-05-07T14:06:03.933744+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.933744+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:49:59.977552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"124'4","reported_seq":138,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:04.225047+0000","last_change":"2024-05-07T14:06:04.225180+0000","last_active":"2024-05-07T14:06:04.225047+0000","last_peered":"2024-05-07T14:06:04.225047+0000","last_clean":"2024-05-07T14:06:04.225047+0000","last_became_active":"2024-05-07T14:04:59.445932+0000","last_became_peered":"2024-05-07T14:04:59.445932+0000","last_unstale":"2024-05-07T14:06:04.225047+0000","last_undegraded":"2024-05-07T14:06:04.225047+0000","last_fullsized":"2024-05-07T14:06:04.225047+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'4","last_scrub_stamp":"2024-05-07T14:06:04.224812+0000","last_deep_scrub":"124'4","last_deep_scrub_stamp":"2024-05-07T14:06:04.224812+0000","last_clean_scrub_stamp":"2024-05-07T14:06:04.224812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:19.904414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"146'54","reported_seq":326,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.742533+0000","last_change":"2024-05-07T14:06:00.742593+0000","last_active":"2024-05-07T14:06:00.742533+0000","last_peered":"2024-05-07T14:06:00.742533+0000","last_clean":"2024-05-07T14:06:00.742533+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:06:00.742533+0000","last_undegraded":"2024-05-07T14:06:00.742533+0000","last_fullsized":"2024-05-07T14:06:00.742533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:06:00.742295+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:06:00.742295+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.742295+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:25.550453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"81'2","reported_seq":274,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.433609+0000","last_change":"2024-05-07T14:04:59.448690+0000","last_active":"2024-05-07T14:05:38.433609+0000","last_peered":"2024-05-07T14:05:38.433609+0000","last_clean":"2024-05-07T14:05:38.433609+0000","last_became_active":"2024-05-07T14:04:59.447844+0000","last_became_peered":"2024-05-07T14:04:59.447844+0000","last_unstale":"2024-05-07T14:05:38.433609+0000","last_undegraded":"2024-05-07T14:05:38.433609+0000","last_fullsized":"2024-05-07T14:05:38.433609+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:56.949570+0000","last_clean_scrub_stamp":"2024-05-07T14:00:56.949570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"146'42","reported_seq":313,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:11.604068+0000","last_change":"2024-05-07T14:06:11.604141+0000","last_active":"2024-05-07T14:06:11.604068+0000","last_peered":"2024-05-07T14:06:11.604068+0000","last_clean":"2024-05-07T14:06:11.604068+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:06:11.604068+0000","last_undegraded":"2024-05-07T14:06:11.604068+0000","last_fullsized":"2024-05-07T14:06:11.604068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'42","last_scrub_stamp":"2024-05-07T14:06:11.603859+0000","last_deep_scrub":"146'42","last_deep_scrub_stamp":"2024-05-07T14:06:11.603859+0000","last_clean_scrub_stamp":"2024-05-07T14:06:11.603859+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:28:00.479167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":268,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.614242+0000","last_change":"2024-05-07T14:05:42.614305+0000","last_active":"2024-05-07T14:05:42.614242+0000","last_peered":"2024-05-07T14:05:42.614242+0000","last_clean":"2024-05-07T14:05:42.614242+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:05:42.614242+0000","last_undegraded":"2024-05-07T14:05:42.614242+0000","last_fullsized":"2024-05-07T14:05:42.614242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:42.614017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:42.614017+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.614017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:51.933134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"146'56","reported_seq":175,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.238395+0000","last_change":"2024-05-07T14:05:59.238518+0000","last_active":"2024-05-07T14:05:59.238395+0000","last_peered":"2024-05-07T14:05:59.238395+0000","last_clean":"2024-05-07T14:05:59.238395+0000","last_became_active":"2024-05-07T14:03:39.668790+0000","last_became_peered":"2024-05-07T14:03:39.668790+0000","last_unstale":"2024-05-07T14:05:59.238395+0000","last_undegraded":"2024-05-07T14:05:59.238395+0000","last_fullsized":"2024-05-07T14:05:59.238395+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'56","last_scrub_stamp":"2024-05-07T14:05:59.238165+0000","last_deep_scrub":"146'56","last_deep_scrub_stamp":"2024-05-07T14:05:59.238165+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.238165+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:11:33.979687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"81'8","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.431720+0000","last_change":"2024-05-07T14:05:37.485873+0000","last_active":"2024-05-07T14:05:38.431720+0000","last_peered":"2024-05-07T14:05:38.431720+0000","last_clean":"2024-05-07T14:05:38.431720+0000","last_became_active":"2024-05-07T14:03:39.666451+0000","last_became_peered":"2024-05-07T14:03:39.666451+0000","last_unstale":"2024-05-07T14:05:38.431720+0000","last_undegraded":"2024-05-07T14:05:38.431720+0000","last_fullsized":"2024-05-07T14:05:38.431720+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-05-07T14:05:37.485738+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-05-07T14:05:37.485738+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.485738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:47:16.171782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"146'44","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:02.476777+0000","last_change":"2024-05-07T14:06:02.476841+0000","last_active":"2024-05-07T14:06:02.476777+0000","last_peered":"2024-05-07T14:06:02.476777+0000","last_clean":"2024-05-07T14:06:02.476777+0000","last_became_active":"2024-05-07T14:04:59.455622+0000","last_became_peered":"2024-05-07T14:04:59.455622+0000","last_unstale":"2024-05-07T14:06:02.476777+0000","last_undegraded":"2024-05-07T14:06:02.476777+0000","last_fullsized":"2024-05-07T14:06:02.476777+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'44","last_scrub_stamp":"2024-05-07T14:06:02.476566+0000","last_deep_scrub":"146'44","last_deep_scrub_stamp":"2024-05-07T14:06:02.476566+0000","last_clean_scrub_stamp":"2024-05-07T14:06:02.476566+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:45.263557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"115'2","reported_seq":274,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.503949+0000","last_change":"2024-05-07T14:05:53.504095+0000","last_active":"2024-05-07T14:05:53.503949+0000","last_peered":"2024-05-07T14:05:53.503949+0000","last_clean":"2024-05-07T14:05:53.503949+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:05:53.503949+0000","last_undegraded":"2024-05-07T14:05:53.503949+0000","last_fullsized":"2024-05-07T14:05:53.503949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'2","last_scrub_stamp":"2024-05-07T14:05:53.503677+0000","last_deep_scrub":"115'2","last_deep_scrub_stamp":"2024-05-07T14:05:53.503677+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.503677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:39.060389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"146'40","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:12.622256+0000","last_change":"2024-05-07T14:06:12.622318+0000","last_active":"2024-05-07T14:06:12.622256+0000","last_peered":"2024-05-07T14:06:12.622256+0000","last_clean":"2024-05-07T14:06:12.622256+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:06:12.622256+0000","last_undegraded":"2024-05-07T14:06:12.622256+0000","last_fullsized":"2024-05-07T14:06:12.622256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'40","last_scrub_stamp":"2024-05-07T14:06:12.622041+0000","last_deep_scrub":"146'40","last_deep_scrub_stamp":"2024-05-07T14:06:12.622041+0000","last_clean_scrub_stamp":"2024-05-07T14:06:12.622041+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:18:46.021119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"106'2","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:04.650205+0000","last_change":"2024-05-07T14:06:04.650264+0000","last_active":"2024-05-07T14:06:04.650205+0000","last_peered":"2024-05-07T14:06:04.650205+0000","last_clean":"2024-05-07T14:06:04.650205+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:06:04.650205+0000","last_undegraded":"2024-05-07T14:06:04.650205+0000","last_fullsized":"2024-05-07T14:06:04.650205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'2","last_scrub_stamp":"2024-05-07T14:06:04.649997+0000","last_deep_scrub":"106'2","last_deep_scrub_stamp":"2024-05-07T14:06:04.649997+0000","last_clean_scrub_stamp":"2024-05-07T14:06:04.649997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:50:00.693805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"146'56","reported_seq":327,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.910553+0000","last_change":"2024-05-07T14:05:54.910675+0000","last_active":"2024-05-07T14:05:54.910553+0000","last_peered":"2024-05-07T14:05:54.910553+0000","last_clean":"2024-05-07T14:05:54.910553+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:05:54.910553+0000","last_undegraded":"2024-05-07T14:05:54.910553+0000","last_fullsized":"2024-05-07T14:05:54.910553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'56","last_scrub_stamp":"2024-05-07T14:05:54.910241+0000","last_deep_scrub":"146'56","last_deep_scrub_stamp":"2024-05-07T14:05:54.910241+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.910241+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:51:19.057565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":284,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.659031+0000","last_change":"2024-05-07T14:05:54.659097+0000","last_active":"2024-05-07T14:05:54.659031+0000","last_peered":"2024-05-07T14:05:54.659031+0000","last_clean":"2024-05-07T14:05:54.659031+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:05:54.659031+0000","last_undegraded":"2024-05-07T14:05:54.659031+0000","last_fullsized":"2024-05-07T14:05:54.659031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-05-07T14:05:54.658810+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-05-07T14:05:54.658810+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.658810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:37.445801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"146'48","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.432189+0000","last_change":"2024-05-07T14:00:55.992203+0000","last_active":"2024-05-07T14:05:38.432189+0000","last_peered":"2024-05-07T14:05:38.432189+0000","last_clean":"2024-05-07T14:05:38.432189+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:05:38.432189+0000","last_undegraded":"2024-05-07T14:05:38.432189+0000","last_fullsized":"2024-05-07T14:05:38.432189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"106'4","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.907874+0000","last_change":"2024-05-07T14:05:41.907938+0000","last_active":"2024-05-07T14:05:41.907874+0000","last_peered":"2024-05-07T14:05:41.907874+0000","last_clean":"2024-05-07T14:05:41.907874+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:05:41.907874+0000","last_undegraded":"2024-05-07T14:05:41.907874+0000","last_fullsized":"2024-05-07T14:05:41.907874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'4","last_scrub_stamp":"2024-05-07T14:05:41.907625+0000","last_deep_scrub":"106'4","last_deep_scrub_stamp":"2024-05-07T14:05:41.907625+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.907625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:29.391287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"146'54","reported_seq":336,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620758+0000","last_change":"2024-05-07T14:04:59.856502+0000","last_active":"2024-05-07T14:05:38.620758+0000","last_peered":"2024-05-07T14:05:38.620758+0000","last_clean":"2024-05-07T14:05:38.620758+0000","last_became_active":"2024-05-07T14:04:59.443769+0000","last_became_peered":"2024-05-07T14:04:59.443769+0000","last_unstale":"2024-05-07T14:05:38.620758+0000","last_undegraded":"2024-05-07T14:05:38.620758+0000","last_fullsized":"2024-05-07T14:05:38.620758+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":268,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.570398+0000","last_change":"2024-05-07T14:05:44.570475+0000","last_active":"2024-05-07T14:05:44.570398+0000","last_peered":"2024-05-07T14:05:44.570398+0000","last_clean":"2024-05-07T14:05:44.570398+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:05:44.570398+0000","last_undegraded":"2024-05-07T14:05:44.570398+0000","last_fullsized":"2024-05-07T14:05:44.570398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:44.570170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:44.570170+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.570170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:53:24.319990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"146'54","reported_seq":349,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:12.611720+0000","last_change":"2024-05-07T14:06:12.611780+0000","last_active":"2024-05-07T14:06:12.611720+0000","last_peered":"2024-05-07T14:06:12.611720+0000","last_clean":"2024-05-07T14:06:12.611720+0000","last_became_active":"2024-05-07T14:04:59.458388+0000","last_became_peered":"2024-05-07T14:04:59.458388+0000","last_unstale":"2024-05-07T14:06:12.611720+0000","last_undegraded":"2024-05-07T14:06:12.611720+0000","last_fullsized":"2024-05-07T14:06:12.611720+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:06:12.611505+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:06:12.611505+0000","last_clean_scrub_stamp":"2024-05-07T14:06:12.611505+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:32.454369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"81'6","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.013642+0000","last_change":"2024-05-07T14:05:52.013748+0000","last_active":"2024-05-07T14:05:52.013642+0000","last_peered":"2024-05-07T14:05:52.013642+0000","last_clean":"2024-05-07T14:05:52.013642+0000","last_became_active":"2024-05-07T14:04:59.448913+0000","last_became_peered":"2024-05-07T14:04:59.448913+0000","last_unstale":"2024-05-07T14:05:52.013642+0000","last_undegraded":"2024-05-07T14:05:52.013642+0000","last_fullsized":"2024-05-07T14:05:52.013642+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-05-07T14:05:52.013425+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-05-07T14:05:52.013425+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.013425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:49.967919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"146'58","reported_seq":328,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.479580+0000","last_change":"2024-05-07T14:05:50.479646+0000","last_active":"2024-05-07T14:05:50.479580+0000","last_peered":"2024-05-07T14:05:50.479580+0000","last_clean":"2024-05-07T14:05:50.479580+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:05:50.479580+0000","last_undegraded":"2024-05-07T14:05:50.479580+0000","last_fullsized":"2024-05-07T14:05:50.479580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'58","last_scrub_stamp":"2024-05-07T14:05:50.479363+0000","last_deep_scrub":"146'58","last_deep_scrub_stamp":"2024-05-07T14:05:50.479363+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.479363+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:39:29.015503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"87'2","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.802716+0000","last_change":"2024-05-07T14:05:50.802841+0000","last_active":"2024-05-07T14:05:50.802716+0000","last_peered":"2024-05-07T14:05:50.802716+0000","last_clean":"2024-05-07T14:05:50.802716+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:05:50.802716+0000","last_undegraded":"2024-05-07T14:05:50.802716+0000","last_fullsized":"2024-05-07T14:05:50.802716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-05-07T14:05:50.802458+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-05-07T14:05:50.802458+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.802458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:18:14.732397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"146'46","reported_seq":306,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:07.995705+0000","last_change":"2024-05-07T14:06:07.995767+0000","last_active":"2024-05-07T14:06:07.995705+0000","last_peered":"2024-05-07T14:06:07.995705+0000","last_clean":"2024-05-07T14:06:07.995705+0000","last_became_active":"2024-05-07T14:04:59.459490+0000","last_became_peered":"2024-05-07T14:04:59.459490+0000","last_unstale":"2024-05-07T14:06:07.995705+0000","last_undegraded":"2024-05-07T14:06:07.995705+0000","last_fullsized":"2024-05-07T14:06:07.995705+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:06:07.995508+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:06:07.995508+0000","last_clean_scrub_stamp":"2024-05-07T14:06:07.995508+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:30:55.127515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"81'6","reported_seq":293,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:04.547155+0000","last_change":"2024-05-07T14:06:04.547215+0000","last_active":"2024-05-07T14:06:04.547155+0000","last_peered":"2024-05-07T14:06:04.547155+0000","last_clean":"2024-05-07T14:06:04.547155+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:06:04.547155+0000","last_undegraded":"2024-05-07T14:06:04.547155+0000","last_fullsized":"2024-05-07T14:06:04.547155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-05-07T14:06:04.546908+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-05-07T14:06:04.546908+0000","last_clean_scrub_stamp":"2024-05-07T14:06:04.546908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:17:19.853557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"146'52","reported_seq":321,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.917840+0000","last_change":"2024-05-07T14:05:40.917902+0000","last_active":"2024-05-07T14:05:40.917840+0000","last_peered":"2024-05-07T14:05:40.917840+0000","last_clean":"2024-05-07T14:05:40.917840+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:05:40.917840+0000","last_undegraded":"2024-05-07T14:05:40.917840+0000","last_fullsized":"2024-05-07T14:05:40.917840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'52","last_scrub_stamp":"2024-05-07T14:05:40.917639+0000","last_deep_scrub":"146'52","last_deep_scrub_stamp":"2024-05-07T14:05:40.917639+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.917639+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:24:20.060632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"124'6","reported_seq":212,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.044822+0000","last_change":"2024-05-07T14:05:53.044878+0000","last_active":"2024-05-07T14:05:53.044822+0000","last_peered":"2024-05-07T14:05:53.044822+0000","last_clean":"2024-05-07T14:05:53.044822+0000","last_became_active":"2024-05-07T14:04:59.442569+0000","last_became_peered":"2024-05-07T14:04:59.442569+0000","last_unstale":"2024-05-07T14:05:53.044822+0000","last_undegraded":"2024-05-07T14:05:53.044822+0000","last_fullsized":"2024-05-07T14:05:53.044822+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'6","last_scrub_stamp":"2024-05-07T14:05:53.044626+0000","last_deep_scrub":"124'6","last_deep_scrub_stamp":"2024-05-07T14:05:53.044626+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.044626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:42:52.957080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"146'52","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.622630+0000","last_change":"2024-05-07T14:05:01.256475+0000","last_active":"2024-05-07T14:05:38.622630+0000","last_peered":"2024-05-07T14:05:38.622630+0000","last_clean":"2024-05-07T14:05:38.622630+0000","last_became_active":"2024-05-07T14:04:59.461335+0000","last_became_peered":"2024-05-07T14:04:59.461335+0000","last_unstale":"2024-05-07T14:05:38.622630+0000","last_undegraded":"2024-05-07T14:05:38.622630+0000","last_fullsized":"2024-05-07T14:05:38.622630+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:00:54.942250+0000","last_clean_scrub_stamp":"2024-05-07T14:00:54.942250+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"146'48","reported_seq":318,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.933293+0000","last_change":"2024-05-07T14:06:01.933354+0000","last_active":"2024-05-07T14:06:01.933293+0000","last_peered":"2024-05-07T14:06:01.933293+0000","last_clean":"2024-05-07T14:06:01.933293+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:06:01.933293+0000","last_undegraded":"2024-05-07T14:06:01.933293+0000","last_fullsized":"2024-05-07T14:06:01.933293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'48","last_scrub_stamp":"2024-05-07T14:06:01.933089+0000","last_deep_scrub":"146'48","last_deep_scrub_stamp":"2024-05-07T14:06:01.933089+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.933089+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:17:17.239738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"124'4","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.848870+0000","last_change":"2024-05-07T14:05:56.848934+0000","last_active":"2024-05-07T14:05:56.848870+0000","last_peered":"2024-05-07T14:05:56.848870+0000","last_clean":"2024-05-07T14:05:56.848870+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:05:56.848870+0000","last_undegraded":"2024-05-07T14:05:56.848870+0000","last_fullsized":"2024-05-07T14:05:56.848870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'4","last_scrub_stamp":"2024-05-07T14:05:56.848653+0000","last_deep_scrub":"124'4","last_deep_scrub_stamp":"2024-05-07T14:05:56.848653+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.848653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:31.841849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"146'42","reported_seq":312,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.238833+0000","last_change":"2024-05-07T14:05:53.238891+0000","last_active":"2024-05-07T14:05:53.238833+0000","last_peered":"2024-05-07T14:05:53.238833+0000","last_clean":"2024-05-07T14:05:53.238833+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:05:53.238833+0000","last_undegraded":"2024-05-07T14:05:53.238833+0000","last_fullsized":"2024-05-07T14:05:53.238833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'42","last_scrub_stamp":"2024-05-07T14:05:53.238636+0000","last_deep_scrub":"146'42","last_deep_scrub_stamp":"2024-05-07T14:05:53.238636+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.238636+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:20:40.233322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"106'4","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.828674+0000","last_change":"2024-05-07T14:05:50.828744+0000","last_active":"2024-05-07T14:05:50.828674+0000","last_peered":"2024-05-07T14:05:50.828674+0000","last_clean":"2024-05-07T14:05:50.828674+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:05:50.828674+0000","last_undegraded":"2024-05-07T14:05:50.828674+0000","last_fullsized":"2024-05-07T14:05:50.828674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'4","last_scrub_stamp":"2024-05-07T14:05:50.828427+0000","last_deep_scrub":"106'4","last_deep_scrub_stamp":"2024-05-07T14:05:50.828427+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.828427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:06.508029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":313,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1119,"ondisk_log_size":1119,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1062,"num_read_kb":1544,"num_write":545,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":121255,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5538,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1015,"ondisk_log_size":1015,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":351,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1436,"num_read_kb":1404,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":620756992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":129,"seq":554050781201,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42180,"kb_used_data":1788,"kb_used_omap":6,"kb_used_meta":40377,"kb_avail":94329660,"statfs":{"total":96636764160,"available":96593571840,"internally_reserved":0,"allocated":1830912,"data_stored":1072724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6345,"internal_metadata":41346871},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37680,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334160,"statfs":{"total":96636764160,"available":96598179840,"internally_reserved":0,"allocated":2400256,"data_stored":1662432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574920,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37144,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334696,"statfs":{"total":96636764160,"available":96598728704,"internally_reserved":0,"allocated":1851392,"data_stored":1072892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37092,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1798144,"data_stored":1072555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37700,"kb_used_data":2364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334140,"statfs":{"total":96636764160,"available":96598159360,"internally_reserved":0,"allocated":2420736,"data_stored":1663220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574920,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1802240,"data_stored":1072073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37124,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334716,"statfs":{"total":96636764160,"available":96598749184,"internally_reserved":0,"allocated":1830912,"data_stored":1073699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37112,"kb_used_data":1776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334728,"statfs":{"total":96636764160,"available":96598761472,"internally_reserved":0,"allocated":1818624,"data_stored":1072577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:06:18.962 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.963 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.963 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.964 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.964 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.965 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.965 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.965 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.965 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-07T14:01:04.980097+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=4, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.966 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-07T14:01:00.967813+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=1, tm_sec=0, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.966 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-07T14:00:56.949570+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=56, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.966 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.967 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.967 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-07T14:00:54.942250+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=0, tm_sec=54, tm_wday=1, tm_yday=128, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=7, tm_hour=14, tm_min=5, tm_sec=33, tm_wday=1, tm_yday=128, tm_isdst=0) 2024-05-07T14:06:18.967 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-07T14:06:38.968 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-07T14:06:39.325 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-05-07T14:06:39.332 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-05-07T14:06:39.340 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-05-07T14:06:37.361525+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":623988,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4834,"num_read_kb":3736,"num_write":4429,"num_write_kb":6187921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":253,"num_bytes_recovered":621470484,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5538,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5716,"ondisk_log_size":5716,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":303128,"kb_used_data":15384,"kb_used_omap":17,"kb_used_meta":287662,"kb_avail":754671592,"statfs":{"total":773094113280,"available":772783710208,"internally_reserved":0,"allocated":15753216,"data_stored":9762172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17505,"internal_metadata":294566815},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005887"},"pg_stats":[{"pgid":"3.3f","version":"146'58","reported_seq":323,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:06.988956+0000","last_change":"2024-05-07T14:06:06.989079+0000","last_active":"2024-05-07T14:06:06.988956+0000","last_peered":"2024-05-07T14:06:06.988956+0000","last_clean":"2024-05-07T14:06:06.988956+0000","last_became_active":"2024-05-07T14:04:59.458324+0000","last_became_peered":"2024-05-07T14:04:59.458324+0000","last_unstale":"2024-05-07T14:06:06.988956+0000","last_undegraded":"2024-05-07T14:06:06.988956+0000","last_fullsized":"2024-05-07T14:06:06.988956+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'58","last_scrub_stamp":"2024-05-07T14:06:06.988657+0000","last_deep_scrub":"146'58","last_deep_scrub_stamp":"2024-05-07T14:06:06.988657+0000","last_clean_scrub_stamp":"2024-05-07T14:06:06.988657+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:53:45.205091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":50331648,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"80'2","reported_seq":275,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.754782+0000","last_change":"2024-05-07T14:05:46.754782+0000","last_active":"2024-05-07T14:05:46.754782+0000","last_peered":"2024-05-07T14:05:46.754782+0000","last_clean":"2024-05-07T14:05:46.754782+0000","last_became_active":"2024-05-07T14:00:58.006605+0000","last_became_peered":"2024-05-07T14:00:58.006605+0000","last_unstale":"2024-05-07T14:05:46.754782+0000","last_undegraded":"2024-05-07T14:05:46.754782+0000","last_fullsized":"2024-05-07T14:05:46.754782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:05:46.754495+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:05:46.754495+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.754495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:36.485364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"146'58","reported_seq":176,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:02.265950+0000","last_change":"2024-05-07T14:06:02.266011+0000","last_active":"2024-05-07T14:06:02.265950+0000","last_peered":"2024-05-07T14:06:02.265950+0000","last_clean":"2024-05-07T14:06:02.265950+0000","last_became_active":"2024-05-07T14:03:39.676092+0000","last_became_peered":"2024-05-07T14:03:39.676092+0000","last_unstale":"2024-05-07T14:06:02.265950+0000","last_undegraded":"2024-05-07T14:06:02.265950+0000","last_fullsized":"2024-05-07T14:06:02.265950+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'58","last_scrub_stamp":"2024-05-07T14:06:02.265741+0000","last_deep_scrub":"146'58","last_deep_scrub_stamp":"2024-05-07T14:06:02.265741+0000","last_clean_scrub_stamp":"2024-05-07T14:06:02.265741+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:39.691301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"80'2","reported_seq":185,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.003090+0000","last_change":"2024-05-07T14:06:00.003154+0000","last_active":"2024-05-07T14:06:00.003090+0000","last_peered":"2024-05-07T14:06:00.003090+0000","last_clean":"2024-05-07T14:06:00.003090+0000","last_became_active":"2024-05-07T14:04:59.430479+0000","last_became_peered":"2024-05-07T14:04:59.430479+0000","last_unstale":"2024-05-07T14:06:00.003090+0000","last_undegraded":"2024-05-07T14:06:00.003090+0000","last_fullsized":"2024-05-07T14:06:00.003090+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:06:00.002873+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:06:00.002873+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.002873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:48.104362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"146'40","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.821171+0000","last_change":"2024-05-07T14:05:57.821293+0000","last_active":"2024-05-07T14:05:57.821171+0000","last_peered":"2024-05-07T14:05:57.821171+0000","last_clean":"2024-05-07T14:05:57.821171+0000","last_became_active":"2024-05-07T14:00:55.967535+0000","last_became_peered":"2024-05-07T14:00:55.967535+0000","last_unstale":"2024-05-07T14:05:57.821171+0000","last_undegraded":"2024-05-07T14:05:57.821171+0000","last_fullsized":"2024-05-07T14:05:57.821171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'40","last_scrub_stamp":"2024-05-07T14:05:57.820865+0000","last_deep_scrub":"146'40","last_deep_scrub_stamp":"2024-05-07T14:05:57.820865+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.820865+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:51:21.968189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"80'2","reported_seq":277,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.574550+0000","last_change":"2024-05-07T14:05:41.574550+0000","last_active":"2024-05-07T14:05:41.574550+0000","last_peered":"2024-05-07T14:05:41.574550+0000","last_clean":"2024-05-07T14:05:41.574550+0000","last_became_active":"2024-05-07T14:00:58.003177+0000","last_became_peered":"2024-05-07T14:00:58.003177+0000","last_unstale":"2024-05-07T14:05:41.574550+0000","last_undegraded":"2024-05-07T14:05:41.574550+0000","last_fullsized":"2024-05-07T14:05:41.574550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:05:41.574288+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:05:41.574288+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.574288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:37.366593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"146'50","reported_seq":320,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.850855+0000","last_change":"2024-05-07T14:05:58.850916+0000","last_active":"2024-05-07T14:05:58.850855+0000","last_peered":"2024-05-07T14:05:58.850855+0000","last_clean":"2024-05-07T14:05:58.850855+0000","last_became_active":"2024-05-07T14:00:56.011561+0000","last_became_peered":"2024-05-07T14:00:56.011561+0000","last_unstale":"2024-05-07T14:05:58.850855+0000","last_undegraded":"2024-05-07T14:05:58.850855+0000","last_fullsized":"2024-05-07T14:05:58.850855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'50","last_scrub_stamp":"2024-05-07T14:05:58.850619+0000","last_deep_scrub":"146'50","last_deep_scrub_stamp":"2024-05-07T14:05:58.850619+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.850619+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:23.658777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"81'2","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.791219+0000","last_change":"2024-05-07T14:05:52.791219+0000","last_active":"2024-05-07T14:05:52.791219+0000","last_peered":"2024-05-07T14:05:52.791219+0000","last_clean":"2024-05-07T14:05:52.791219+0000","last_became_active":"2024-05-07T14:00:57.983481+0000","last_became_peered":"2024-05-07T14:00:57.983481+0000","last_unstale":"2024-05-07T14:05:52.791219+0000","last_undegraded":"2024-05-07T14:05:52.791219+0000","last_fullsized":"2024-05-07T14:05:52.791219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:05:52.790950+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:05:52.790950+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.790950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:52:37.014635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"146'48","reported_seq":309,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.969379+0000","last_change":"2024-05-07T14:06:03.969439+0000","last_active":"2024-05-07T14:06:03.969379+0000","last_peered":"2024-05-07T14:06:03.969379+0000","last_clean":"2024-05-07T14:06:03.969379+0000","last_became_active":"2024-05-07T14:04:59.455288+0000","last_became_peered":"2024-05-07T14:04:59.455288+0000","last_unstale":"2024-05-07T14:06:03.969379+0000","last_undegraded":"2024-05-07T14:06:03.969379+0000","last_fullsized":"2024-05-07T14:06:03.969379+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'48","last_scrub_stamp":"2024-05-07T14:06:03.969182+0000","last_deep_scrub":"146'48","last_deep_scrub_stamp":"2024-05-07T14:06:03.969182+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.969182+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:51.640685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"115'4","reported_seq":282,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.550698+0000","last_change":"2024-05-07T14:05:54.550756+0000","last_active":"2024-05-07T14:05:54.550698+0000","last_peered":"2024-05-07T14:05:54.550698+0000","last_clean":"2024-05-07T14:05:54.550698+0000","last_became_active":"2024-05-07T14:00:57.983839+0000","last_became_peered":"2024-05-07T14:00:57.983839+0000","last_unstale":"2024-05-07T14:05:54.550698+0000","last_undegraded":"2024-05-07T14:05:54.550698+0000","last_fullsized":"2024-05-07T14:05:54.550698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'4","last_scrub_stamp":"2024-05-07T14:05:54.550511+0000","last_deep_scrub":"115'4","last_deep_scrub_stamp":"2024-05-07T14:05:54.550511+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.550511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:36:20.137024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"146'38","reported_seq":308,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:06.949130+0000","last_change":"2024-05-07T14:06:06.949195+0000","last_active":"2024-05-07T14:06:06.949130+0000","last_peered":"2024-05-07T14:06:06.949130+0000","last_clean":"2024-05-07T14:06:06.949130+0000","last_became_active":"2024-05-07T14:00:56.001678+0000","last_became_peered":"2024-05-07T14:00:56.001678+0000","last_unstale":"2024-05-07T14:06:06.949130+0000","last_undegraded":"2024-05-07T14:06:06.949130+0000","last_fullsized":"2024-05-07T14:06:06.949130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'38","last_scrub_stamp":"2024-05-07T14:06:06.948924+0000","last_deep_scrub":"146'38","last_deep_scrub_stamp":"2024-05-07T14:06:06.948924+0000","last_clean_scrub_stamp":"2024-05-07T14:06:06.948924+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:18:35.955083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"115'4","reported_seq":285,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.714859+0000","last_change":"2024-05-07T14:05:50.714975+0000","last_active":"2024-05-07T14:05:50.714859+0000","last_peered":"2024-05-07T14:05:50.714859+0000","last_clean":"2024-05-07T14:05:50.714859+0000","last_became_active":"2024-05-07T14:00:58.002013+0000","last_became_peered":"2024-05-07T14:00:58.002013+0000","last_unstale":"2024-05-07T14:05:50.714859+0000","last_undegraded":"2024-05-07T14:05:50.714859+0000","last_fullsized":"2024-05-07T14:05:50.714859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'4","last_scrub_stamp":"2024-05-07T14:05:50.714550+0000","last_deep_scrub":"115'4","last_deep_scrub_stamp":"2024-05-07T14:05:50.714550+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.714550+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:35.945284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"146'50","reported_seq":312,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.052088+0000","last_change":"2024-05-07T14:05:51.052149+0000","last_active":"2024-05-07T14:05:51.052088+0000","last_peered":"2024-05-07T14:05:51.052088+0000","last_clean":"2024-05-07T14:05:51.052088+0000","last_became_active":"2024-05-07T14:04:59.444214+0000","last_became_peered":"2024-05-07T14:04:59.444214+0000","last_unstale":"2024-05-07T14:05:51.052088+0000","last_undegraded":"2024-05-07T14:05:51.052088+0000","last_fullsized":"2024-05-07T14:05:51.052088+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'50","last_scrub_stamp":"2024-05-07T14:05:51.051888+0000","last_deep_scrub":"146'50","last_deep_scrub_stamp":"2024-05-07T14:05:51.051888+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.051888+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:56:42.668989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"81'2","reported_seq":274,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.774289+0000","last_change":"2024-05-07T14:05:48.774351+0000","last_active":"2024-05-07T14:05:48.774289+0000","last_peered":"2024-05-07T14:05:48.774289+0000","last_clean":"2024-05-07T14:05:48.774289+0000","last_became_active":"2024-05-07T14:00:57.988988+0000","last_became_peered":"2024-05-07T14:00:57.988988+0000","last_unstale":"2024-05-07T14:05:48.774289+0000","last_undegraded":"2024-05-07T14:05:48.774289+0000","last_fullsized":"2024-05-07T14:05:48.774289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:05:48.774054+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:05:48.774054+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.774054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:12.303840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"146'46","reported_seq":317,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:14.719203+0000","last_change":"2024-05-07T14:06:14.719267+0000","last_active":"2024-05-07T14:06:14.719203+0000","last_peered":"2024-05-07T14:06:14.719203+0000","last_clean":"2024-05-07T14:06:14.719203+0000","last_became_active":"2024-05-07T14:00:56.015246+0000","last_became_peered":"2024-05-07T14:00:56.015246+0000","last_unstale":"2024-05-07T14:06:14.719203+0000","last_undegraded":"2024-05-07T14:06:14.719203+0000","last_fullsized":"2024-05-07T14:06:14.719203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:06:14.718969+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:06:14.718969+0000","last_clean_scrub_stamp":"2024-05-07T14:06:14.718969+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:14:33.684653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"124'4","reported_seq":282,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.891811+0000","last_change":"2024-05-07T14:05:42.891878+0000","last_active":"2024-05-07T14:05:42.891811+0000","last_peered":"2024-05-07T14:05:42.891811+0000","last_clean":"2024-05-07T14:05:42.891811+0000","last_became_active":"2024-05-07T14:00:57.996058+0000","last_became_peered":"2024-05-07T14:00:57.996058+0000","last_unstale":"2024-05-07T14:05:42.891811+0000","last_undegraded":"2024-05-07T14:05:42.891811+0000","last_fullsized":"2024-05-07T14:05:42.891811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'4","last_scrub_stamp":"2024-05-07T14:05:42.891601+0000","last_deep_scrub":"124'4","last_deep_scrub_stamp":"2024-05-07T14:05:42.891601+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.891601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:55:14.857156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"80'2","reported_seq":277,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.591369+0000","last_change":"2024-05-07T14:05:43.591429+0000","last_active":"2024-05-07T14:05:43.591369+0000","last_peered":"2024-05-07T14:05:43.591369+0000","last_clean":"2024-05-07T14:05:43.591369+0000","last_became_active":"2024-05-07T14:00:58.003894+0000","last_became_peered":"2024-05-07T14:00:58.003894+0000","last_unstale":"2024-05-07T14:05:43.591369+0000","last_undegraded":"2024-05-07T14:05:43.591369+0000","last_fullsized":"2024-05-07T14:05:43.591369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:05:43.591140+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:05:43.591140+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.591140+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:24:48.976262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"146'46","reported_seq":305,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:04.988295+0000","last_change":"2024-05-07T14:06:04.988356+0000","last_active":"2024-05-07T14:06:04.988295+0000","last_peered":"2024-05-07T14:06:04.988295+0000","last_clean":"2024-05-07T14:06:04.988295+0000","last_became_active":"2024-05-07T14:04:59.452315+0000","last_became_peered":"2024-05-07T14:04:59.452315+0000","last_unstale":"2024-05-07T14:06:04.988295+0000","last_undegraded":"2024-05-07T14:06:04.988295+0000","last_fullsized":"2024-05-07T14:06:04.988295+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:06:04.988090+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:06:04.988090+0000","last_clean_scrub_stamp":"2024-05-07T14:06:04.988090+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:56:57.640414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.033431+0000","last_change":"2024-05-07T14:05:58.033504+0000","last_active":"2024-05-07T14:05:58.033431+0000","last_peered":"2024-05-07T14:05:58.033431+0000","last_clean":"2024-05-07T14:05:58.033431+0000","last_became_active":"2024-05-07T14:04:59.429254+0000","last_became_peered":"2024-05-07T14:04:59.429254+0000","last_unstale":"2024-05-07T14:05:58.033431+0000","last_undegraded":"2024-05-07T14:05:58.033431+0000","last_fullsized":"2024-05-07T14:05:58.033431+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:58.033210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:58.033210+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.033210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:08:52.773715+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"146'46","reported_seq":316,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.458093+0000","last_change":"2024-05-07T14:05:52.458159+0000","last_active":"2024-05-07T14:05:52.458093+0000","last_peered":"2024-05-07T14:05:52.458093+0000","last_clean":"2024-05-07T14:05:52.458093+0000","last_became_active":"2024-05-07T14:00:56.006504+0000","last_became_peered":"2024-05-07T14:00:56.006504+0000","last_unstale":"2024-05-07T14:05:52.458093+0000","last_undegraded":"2024-05-07T14:05:52.458093+0000","last_fullsized":"2024-05-07T14:05:52.458093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:05:52.457878+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:05:52.457878+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.457878+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:04:31.728642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":266,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.872999+0000","last_change":"2024-05-07T14:05:52.873056+0000","last_active":"2024-05-07T14:05:52.872999+0000","last_peered":"2024-05-07T14:05:52.872999+0000","last_clean":"2024-05-07T14:05:52.872999+0000","last_became_active":"2024-05-07T14:00:57.976176+0000","last_became_peered":"2024-05-07T14:00:57.976176+0000","last_unstale":"2024-05-07T14:05:52.872999+0000","last_undegraded":"2024-05-07T14:05:52.872999+0000","last_fullsized":"2024-05-07T14:05:52.872999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:52.872793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:52.872793+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.872793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:03:18.882228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"146'62","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.503780+0000","last_change":"2024-05-07T14:05:51.503907+0000","last_active":"2024-05-07T14:05:51.503780+0000","last_peered":"2024-05-07T14:05:51.503780+0000","last_clean":"2024-05-07T14:05:51.503780+0000","last_became_active":"2024-05-07T14:00:56.007299+0000","last_became_peered":"2024-05-07T14:00:56.007299+0000","last_unstale":"2024-05-07T14:05:51.503780+0000","last_undegraded":"2024-05-07T14:05:51.503780+0000","last_fullsized":"2024-05-07T14:05:51.503780+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'62","last_scrub_stamp":"2024-05-07T14:05:51.503543+0000","last_deep_scrub":"146'62","last_deep_scrub_stamp":"2024-05-07T14:05:51.503543+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.503543+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:35:22.820463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"124'10","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.920441+0000","last_change":"2024-05-07T14:05:51.920505+0000","last_active":"2024-05-07T14:05:51.920441+0000","last_peered":"2024-05-07T14:05:51.920441+0000","last_clean":"2024-05-07T14:05:51.920441+0000","last_became_active":"2024-05-07T14:01:37.318366+0000","last_became_peered":"2024-05-07T14:01:37.318366+0000","last_unstale":"2024-05-07T14:05:51.920441+0000","last_undegraded":"2024-05-07T14:05:51.920441+0000","last_fullsized":"2024-05-07T14:05:51.920441+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'10","last_scrub_stamp":"2024-05-07T14:05:51.919944+0000","last_deep_scrub":"124'10","last_deep_scrub_stamp":"2024-05-07T14:05:51.919944+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.919944+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:21.369904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"146'54","reported_seq":326,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.631929+0000","last_change":"2024-05-07T14:06:00.631995+0000","last_active":"2024-05-07T14:06:00.631929+0000","last_peered":"2024-05-07T14:06:00.631929+0000","last_clean":"2024-05-07T14:06:00.631929+0000","last_became_active":"2024-05-07T14:00:55.986590+0000","last_became_peered":"2024-05-07T14:00:55.986590+0000","last_unstale":"2024-05-07T14:06:00.631929+0000","last_undegraded":"2024-05-07T14:06:00.631929+0000","last_fullsized":"2024-05-07T14:06:00.631929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:06:00.631705+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:06:00.631705+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.631705+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:42:00.959721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"106'8","reported_seq":286,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.934186+0000","last_change":"2024-05-07T14:05:44.934186+0000","last_active":"2024-05-07T14:05:44.934186+0000","last_peered":"2024-05-07T14:05:44.934186+0000","last_clean":"2024-05-07T14:05:44.934186+0000","last_became_active":"2024-05-07T14:00:58.005599+0000","last_became_peered":"2024-05-07T14:00:58.005599+0000","last_unstale":"2024-05-07T14:05:44.934186+0000","last_undegraded":"2024-05-07T14:05:44.934186+0000","last_fullsized":"2024-05-07T14:05:44.934186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'8","last_scrub_stamp":"2024-05-07T14:05:44.933739+0000","last_deep_scrub":"106'8","last_deep_scrub_stamp":"2024-05-07T14:05:44.933739+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.933739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:16:10.865536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"146'64","reported_seq":335,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:07.551158+0000","last_change":"2024-05-07T14:06:07.551272+0000","last_active":"2024-05-07T14:06:07.551158+0000","last_peered":"2024-05-07T14:06:07.551158+0000","last_clean":"2024-05-07T14:06:07.551158+0000","last_became_active":"2024-05-07T14:00:55.974942+0000","last_became_peered":"2024-05-07T14:00:55.974942+0000","last_unstale":"2024-05-07T14:06:07.551158+0000","last_undegraded":"2024-05-07T14:06:07.551158+0000","last_fullsized":"2024-05-07T14:06:07.551158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'64","last_scrub_stamp":"2024-05-07T14:06:07.550929+0000","last_deep_scrub":"146'64","last_deep_scrub_stamp":"2024-05-07T14:06:07.550929+0000","last_clean_scrub_stamp":"2024-05-07T14:06:07.550929+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:31:56.299265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":0,"num_write":64,"num_write_kb":131072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"106'2","reported_seq":291,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:11.793604+0000","last_change":"2024-05-07T14:06:11.793724+0000","last_active":"2024-05-07T14:06:11.793604+0000","last_peered":"2024-05-07T14:06:11.793604+0000","last_clean":"2024-05-07T14:06:11.793604+0000","last_became_active":"2024-05-07T14:03:39.663590+0000","last_became_peered":"2024-05-07T14:03:39.663590+0000","last_unstale":"2024-05-07T14:06:11.793604+0000","last_undegraded":"2024-05-07T14:06:11.793604+0000","last_fullsized":"2024-05-07T14:06:11.793604+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'2","last_scrub_stamp":"2024-05-07T14:06:11.793356+0000","last_deep_scrub":"106'2","last_deep_scrub_stamp":"2024-05-07T14:06:11.793356+0000","last_clean_scrub_stamp":"2024-05-07T14:06:11.793356+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:36.601514+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"146'38","reported_seq":309,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.764860+0000","last_change":"2024-05-07T14:05:59.764925+0000","last_active":"2024-05-07T14:05:59.764860+0000","last_peered":"2024-05-07T14:05:59.764860+0000","last_clean":"2024-05-07T14:05:59.764860+0000","last_became_active":"2024-05-07T14:00:55.969164+0000","last_became_peered":"2024-05-07T14:00:55.969164+0000","last_unstale":"2024-05-07T14:05:59.764860+0000","last_undegraded":"2024-05-07T14:05:59.764860+0000","last_fullsized":"2024-05-07T14:05:59.764860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'38","last_scrub_stamp":"2024-05-07T14:05:59.764645+0000","last_deep_scrub":"146'38","last_deep_scrub_stamp":"2024-05-07T14:05:59.764645+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.764645+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:55:00.950336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":252,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:06.742612+0000","last_change":"2024-05-07T14:06:06.742668+0000","last_active":"2024-05-07T14:06:06.742612+0000","last_peered":"2024-05-07T14:06:06.742612+0000","last_clean":"2024-05-07T14:06:06.742612+0000","last_became_active":"2024-05-07T14:01:06.010156+0000","last_became_peered":"2024-05-07T14:01:06.010156+0000","last_unstale":"2024-05-07T14:06:06.742612+0000","last_undegraded":"2024-05-07T14:06:06.742612+0000","last_fullsized":"2024-05-07T14:06:06.742612+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:06.742415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:06.742415+0000","last_clean_scrub_stamp":"2024-05-07T14:06:06.742415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:43.264418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"81'2","reported_seq":302,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.488541+0000","last_change":"2024-05-07T14:05:39.488599+0000","last_active":"2024-05-07T14:05:39.488541+0000","last_peered":"2024-05-07T14:05:39.488541+0000","last_clean":"2024-05-07T14:05:39.488541+0000","last_became_active":"2024-05-07T14:05:38.439123+0000","last_became_peered":"2024-05-07T14:05:38.439123+0000","last_unstale":"2024-05-07T14:05:39.488541+0000","last_undegraded":"2024-05-07T14:05:39.488541+0000","last_fullsized":"2024-05-07T14:05:39.488541+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:05:39.488348+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:05:39.488348+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.488348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:20:26.483034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"146'38","reported_seq":257,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.895102+0000","last_change":"2024-05-07T14:05:48.895102+0000","last_active":"2024-05-07T14:05:48.895102+0000","last_peered":"2024-05-07T14:05:48.895102+0000","last_clean":"2024-05-07T14:05:48.895102+0000","last_became_active":"2024-05-07T14:01:37.311008+0000","last_became_peered":"2024-05-07T14:01:37.311008+0000","last_unstale":"2024-05-07T14:05:48.895102+0000","last_undegraded":"2024-05-07T14:05:48.895102+0000","last_fullsized":"2024-05-07T14:05:48.895102+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'38","last_scrub_stamp":"2024-05-07T14:05:48.894689+0000","last_deep_scrub":"146'38","last_deep_scrub_stamp":"2024-05-07T14:05:48.894689+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.894689+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:38:49.851294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.749510+0000","last_change":"2024-05-07T14:05:47.749510+0000","last_active":"2024-05-07T14:05:47.749510+0000","last_peered":"2024-05-07T14:05:47.749510+0000","last_clean":"2024-05-07T14:05:47.749510+0000","last_became_active":"2024-05-07T14:01:00.001000+0000","last_became_peered":"2024-05-07T14:01:00.001000+0000","last_unstale":"2024-05-07T14:05:47.749510+0000","last_undegraded":"2024-05-07T14:05:47.749510+0000","last_fullsized":"2024-05-07T14:05:47.749510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:47.749269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:47.749269+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.749269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:48.516892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"148'24","reported_seq":302,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:07.652799+0000","last_change":"2024-05-07T14:06:07.652873+0000","last_active":"2024-05-07T14:06:07.652799+0000","last_peered":"2024-05-07T14:06:07.652799+0000","last_clean":"2024-05-07T14:06:07.652799+0000","last_became_active":"2024-05-07T14:04:59.455429+0000","last_became_peered":"2024-05-07T14:04:59.455429+0000","last_unstale":"2024-05-07T14:06:07.652799+0000","last_undegraded":"2024-05-07T14:06:07.652799+0000","last_fullsized":"2024-05-07T14:06:07.652799+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'24","last_scrub_stamp":"2024-05-07T14:06:07.652605+0000","last_deep_scrub":"148'24","last_deep_scrub_stamp":"2024-05-07T14:06:07.652605+0000","last_clean_scrub_stamp":"2024-05-07T14:06:07.652605+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:18:36.658764+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.998040+0000","last_change":"2024-05-07T14:05:39.998091+0000","last_active":"2024-05-07T14:05:39.998040+0000","last_peered":"2024-05-07T14:05:39.998040+0000","last_clean":"2024-05-07T14:05:39.998040+0000","last_became_active":"2024-05-07T14:04:59.456374+0000","last_became_peered":"2024-05-07T14:04:59.456374+0000","last_unstale":"2024-05-07T14:05:39.998040+0000","last_undegraded":"2024-05-07T14:05:39.998040+0000","last_fullsized":"2024-05-07T14:05:39.998040+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:39.997849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:39.997849+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.997849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:04:36.795773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"148'51","reported_seq":322,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.680748+0000","last_change":"2024-05-07T14:05:42.680748+0000","last_active":"2024-05-07T14:05:42.680748+0000","last_peered":"2024-05-07T14:05:42.680748+0000","last_clean":"2024-05-07T14:05:42.680748+0000","last_became_active":"2024-05-07T14:01:06.035913+0000","last_became_peered":"2024-05-07T14:01:06.035913+0000","last_unstale":"2024-05-07T14:05:42.680748+0000","last_undegraded":"2024-05-07T14:05:42.680748+0000","last_fullsized":"2024-05-07T14:05:42.680748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'51","last_scrub_stamp":"2024-05-07T14:05:42.680364+0000","last_deep_scrub":"148'51","last_deep_scrub_stamp":"2024-05-07T14:05:42.680364+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.680364+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:36:42.767270+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":100,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"81'6","reported_seq":297,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:11.920696+0000","last_change":"2024-05-07T14:06:11.920760+0000","last_active":"2024-05-07T14:06:11.920696+0000","last_peered":"2024-05-07T14:06:11.920696+0000","last_clean":"2024-05-07T14:06:11.920696+0000","last_became_active":"2024-05-07T14:04:59.466480+0000","last_became_peered":"2024-05-07T14:04:59.466480+0000","last_unstale":"2024-05-07T14:06:11.920696+0000","last_undegraded":"2024-05-07T14:06:11.920696+0000","last_fullsized":"2024-05-07T14:06:11.920696+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-05-07T14:06:11.920481+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-05-07T14:06:11.920481+0000","last_clean_scrub_stamp":"2024-05-07T14:06:11.920481+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:31.763345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"146'40","reported_seq":335,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:11.645005+0000","last_change":"2024-05-07T14:06:11.645067+0000","last_active":"2024-05-07T14:06:11.645005+0000","last_peered":"2024-05-07T14:06:11.645005+0000","last_clean":"2024-05-07T14:06:11.645005+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:06:11.645005+0000","last_undegraded":"2024-05-07T14:06:11.645005+0000","last_fullsized":"2024-05-07T14:06:11.645005+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'40","last_scrub_stamp":"2024-05-07T14:06:11.644803+0000","last_deep_scrub":"146'40","last_deep_scrub_stamp":"2024-05-07T14:06:11.644803+0000","last_clean_scrub_stamp":"2024-05-07T14:06:11.644803+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:58:17.389707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":79872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":270,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.484711+0000","last_change":"2024-05-07T14:05:45.484764+0000","last_active":"2024-05-07T14:05:45.484711+0000","last_peered":"2024-05-07T14:05:45.484711+0000","last_clean":"2024-05-07T14:05:45.484711+0000","last_became_active":"2024-05-07T14:04:59.445994+0000","last_became_peered":"2024-05-07T14:04:59.445994+0000","last_unstale":"2024-05-07T14:05:45.484711+0000","last_undegraded":"2024-05-07T14:05:45.484711+0000","last_fullsized":"2024-05-07T14:05:45.484711+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:45.484518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:45.484518+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.484518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:36:45.571424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"148'10","reported_seq":273,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.667704+0000","last_change":"2024-05-07T14:05:55.667805+0000","last_active":"2024-05-07T14:05:55.667704+0000","last_peered":"2024-05-07T14:05:55.667704+0000","last_clean":"2024-05-07T14:05:55.667704+0000","last_became_active":"2024-05-07T14:01:01.995934+0000","last_became_peered":"2024-05-07T14:01:01.995934+0000","last_unstale":"2024-05-07T14:05:55.667704+0000","last_undegraded":"2024-05-07T14:05:55.667704+0000","last_fullsized":"2024-05-07T14:05:55.667704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'10","last_scrub_stamp":"2024-05-07T14:05:55.667518+0000","last_deep_scrub":"148'10","last_deep_scrub_stamp":"2024-05-07T14:05:55.667518+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.667518+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:41.766526+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.428033+0000","last_change":"2024-05-07T14:05:37.597661+0000","last_active":"2024-05-07T14:05:38.428033+0000","last_peered":"2024-05-07T14:05:38.428033+0000","last_clean":"2024-05-07T14:05:38.428033+0000","last_became_active":"2024-05-07T14:01:03.997888+0000","last_became_peered":"2024-05-07T14:01:03.997888+0000","last_unstale":"2024-05-07T14:05:38.428033+0000","last_undegraded":"2024-05-07T14:05:38.428033+0000","last_fullsized":"2024-05-07T14:05:38.428033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.597397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.597397+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.597397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:07.047357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"115'8","reported_seq":264,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.856052+0000","last_change":"2024-05-07T14:05:40.856052+0000","last_active":"2024-05-07T14:05:40.856052+0000","last_peered":"2024-05-07T14:05:40.856052+0000","last_clean":"2024-05-07T14:05:40.856052+0000","last_became_active":"2024-05-07T14:01:06.026027+0000","last_became_peered":"2024-05-07T14:01:06.026027+0000","last_unstale":"2024-05-07T14:05:40.856052+0000","last_undegraded":"2024-05-07T14:05:40.856052+0000","last_fullsized":"2024-05-07T14:05:40.856052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'8","last_scrub_stamp":"2024-05-07T14:05:40.855774+0000","last_deep_scrub":"115'8","last_deep_scrub_stamp":"2024-05-07T14:05:40.855774+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.855774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:55.295194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"81'4","reported_seq":284,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.693425+0000","last_change":"2024-05-07T14:06:03.693491+0000","last_active":"2024-05-07T14:06:03.693425+0000","last_peered":"2024-05-07T14:06:03.693425+0000","last_clean":"2024-05-07T14:06:03.693425+0000","last_became_active":"2024-05-07T14:00:57.980271+0000","last_became_peered":"2024-05-07T14:00:57.980271+0000","last_unstale":"2024-05-07T14:06:03.693425+0000","last_undegraded":"2024-05-07T14:06:03.693425+0000","last_fullsized":"2024-05-07T14:06:03.693425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-05-07T14:06:03.693219+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-05-07T14:06:03.693219+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.693219+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:50:31.682172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"146'32","reported_seq":288,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.027629+0000","last_change":"2024-05-07T14:05:47.027693+0000","last_active":"2024-05-07T14:05:47.027629+0000","last_peered":"2024-05-07T14:05:47.027629+0000","last_clean":"2024-05-07T14:05:47.027629+0000","last_became_active":"2024-05-07T14:04:59.436710+0000","last_became_peered":"2024-05-07T14:04:59.436710+0000","last_unstale":"2024-05-07T14:05:47.027629+0000","last_undegraded":"2024-05-07T14:05:47.027629+0000","last_fullsized":"2024-05-07T14:05:47.027629+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'32","last_scrub_stamp":"2024-05-07T14:05:47.027424+0000","last_deep_scrub":"146'32","last_deep_scrub_stamp":"2024-05-07T14:05:47.027424+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.027424+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:09:00.845074+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":273,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.460794+0000","last_change":"2024-05-07T14:05:46.460794+0000","last_active":"2024-05-07T14:05:46.460794+0000","last_peered":"2024-05-07T14:05:46.460794+0000","last_clean":"2024-05-07T14:05:46.460794+0000","last_became_active":"2024-05-07T14:03:39.680482+0000","last_became_peered":"2024-05-07T14:03:39.680482+0000","last_unstale":"2024-05-07T14:05:46.460794+0000","last_undegraded":"2024-05-07T14:05:46.460794+0000","last_fullsized":"2024-05-07T14:05:46.460794+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:46.460537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:46.460537+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.460537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:48:46.840513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"146'18","reported_seq":280,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426015+0000","last_change":"2024-05-07T14:05:36.059934+0000","last_active":"2024-05-07T14:05:38.426015+0000","last_peered":"2024-05-07T14:05:38.426015+0000","last_clean":"2024-05-07T14:05:38.426015+0000","last_became_active":"2024-05-07T14:01:01.995899+0000","last_became_peered":"2024-05-07T14:01:01.995899+0000","last_unstale":"2024-05-07T14:05:38.426015+0000","last_undegraded":"2024-05-07T14:05:38.426015+0000","last_fullsized":"2024-05-07T14:05:38.426015+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'18","last_scrub_stamp":"2024-05-07T14:05:36.059800+0000","last_deep_scrub":"146'18","last_deep_scrub_stamp":"2024-05-07T14:05:36.059800+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.059800+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:08:00.724380+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"148'145","reported_seq":430,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:08.950459+0000","last_change":"2024-05-07T14:06:08.950520+0000","last_active":"2024-05-07T14:06:08.950459+0000","last_peered":"2024-05-07T14:06:08.950459+0000","last_clean":"2024-05-07T14:06:08.950459+0000","last_became_active":"2024-05-07T14:04:59.463533+0000","last_became_peered":"2024-05-07T14:04:59.463533+0000","last_unstale":"2024-05-07T14:06:08.950459+0000","last_undegraded":"2024-05-07T14:06:08.950459+0000","last_fullsized":"2024-05-07T14:06:08.950459+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'145","last_scrub_stamp":"2024-05-07T14:06:08.950262+0000","last_deep_scrub":"148'145","last_deep_scrub_stamp":"2024-05-07T14:06:08.950262+0000","last_clean_scrub_stamp":"2024-05-07T14:06:08.950262+0000","objects_scrubbed":1,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:48:22.388505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":252,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:09.771661+0000","last_change":"2024-05-07T14:06:09.771715+0000","last_active":"2024-05-07T14:06:09.771661+0000","last_peered":"2024-05-07T14:06:09.771661+0000","last_clean":"2024-05-07T14:06:09.771661+0000","last_became_active":"2024-05-07T14:01:06.367256+0000","last_became_peered":"2024-05-07T14:01:06.367256+0000","last_unstale":"2024-05-07T14:06:09.771661+0000","last_undegraded":"2024-05-07T14:06:09.771661+0000","last_fullsized":"2024-05-07T14:06:09.771661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:09.771416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:09.771416+0000","last_clean_scrub_stamp":"2024-05-07T14:06:09.771416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:39.553281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"87'16","reported_seq":317,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:21.627466+0000","last_change":"2024-05-07T14:06:21.627536+0000","last_active":"2024-05-07T14:06:21.627466+0000","last_peered":"2024-05-07T14:06:21.627466+0000","last_clean":"2024-05-07T14:06:21.627466+0000","last_became_active":"2024-05-07T14:04:59.461575+0000","last_became_peered":"2024-05-07T14:04:59.461575+0000","last_unstale":"2024-05-07T14:06:21.627466+0000","last_undegraded":"2024-05-07T14:06:21.627466+0000","last_fullsized":"2024-05-07T14:06:21.627466+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'16","last_scrub_stamp":"2024-05-07T14:06:21.627237+0000","last_deep_scrub":"87'16","last_deep_scrub_stamp":"2024-05-07T14:06:21.627237+0000","last_clean_scrub_stamp":"2024-05-07T14:06:21.627237+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:12:54.013328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":63,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"146'52","reported_seq":322,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.480149+0000","last_change":"2024-05-07T14:05:47.480262+0000","last_active":"2024-05-07T14:05:47.480149+0000","last_peered":"2024-05-07T14:05:47.480149+0000","last_clean":"2024-05-07T14:05:47.480149+0000","last_became_active":"2024-05-07T14:00:55.976456+0000","last_became_peered":"2024-05-07T14:00:55.976456+0000","last_unstale":"2024-05-07T14:05:47.480149+0000","last_undegraded":"2024-05-07T14:05:47.480149+0000","last_fullsized":"2024-05-07T14:05:47.480149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'52","last_scrub_stamp":"2024-05-07T14:05:47.479956+0000","last_deep_scrub":"146'52","last_deep_scrub_stamp":"2024-05-07T14:05:47.479956+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.479956+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:33:52.588231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.661760+0000","last_change":"2024-05-07T14:05:43.661760+0000","last_active":"2024-05-07T14:05:43.661760+0000","last_peered":"2024-05-07T14:05:43.661760+0000","last_clean":"2024-05-07T14:05:43.661760+0000","last_became_active":"2024-05-07T14:01:00.000751+0000","last_became_peered":"2024-05-07T14:01:00.000751+0000","last_unstale":"2024-05-07T14:05:43.661760+0000","last_undegraded":"2024-05-07T14:05:43.661760+0000","last_fullsized":"2024-05-07T14:05:43.661760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:43.661509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:43.661509+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.661509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:48:44.041486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"148'23","reported_seq":272,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.982444+0000","last_change":"2024-05-07T14:05:40.982516+0000","last_active":"2024-05-07T14:05:40.982444+0000","last_peered":"2024-05-07T14:05:40.982444+0000","last_clean":"2024-05-07T14:05:40.982444+0000","last_became_active":"2024-05-07T14:04:59.459905+0000","last_became_peered":"2024-05-07T14:04:59.459905+0000","last_unstale":"2024-05-07T14:05:40.982444+0000","last_undegraded":"2024-05-07T14:05:40.982444+0000","last_fullsized":"2024-05-07T14:05:40.982444+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'23","last_scrub_stamp":"2024-05-07T14:05:40.982249+0000","last_deep_scrub":"148'23","last_deep_scrub_stamp":"2024-05-07T14:05:40.982249+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.982249+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:22:06.341816+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"146'138","reported_seq":445,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.509726+0000","last_change":"2024-05-07T14:05:57.509792+0000","last_active":"2024-05-07T14:05:57.509726+0000","last_peered":"2024-05-07T14:05:57.509726+0000","last_clean":"2024-05-07T14:05:57.509726+0000","last_became_active":"2024-05-07T14:01:04.022596+0000","last_became_peered":"2024-05-07T14:01:04.022596+0000","last_unstale":"2024-05-07T14:05:57.509726+0000","last_undegraded":"2024-05-07T14:05:57.509726+0000","last_fullsized":"2024-05-07T14:05:57.509726+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'138","last_scrub_stamp":"2024-05-07T14:05:57.509471+0000","last_deep_scrub":"146'138","last_deep_scrub_stamp":"2024-05-07T14:05:57.509471+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.509471+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:51:21.656794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"81'4","reported_seq":290,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.632057+0000","last_change":"2024-05-07T14:05:41.632117+0000","last_active":"2024-05-07T14:05:41.632057+0000","last_peered":"2024-05-07T14:05:41.632057+0000","last_clean":"2024-05-07T14:05:41.632057+0000","last_became_active":"2024-05-07T14:04:59.446891+0000","last_became_peered":"2024-05-07T14:04:59.446891+0000","last_unstale":"2024-05-07T14:05:41.632057+0000","last_undegraded":"2024-05-07T14:05:41.632057+0000","last_fullsized":"2024-05-07T14:05:41.632057+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-05-07T14:05:41.631851+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-05-07T14:05:41.631851+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.631851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:17:36.333634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"146'66","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:05.963473+0000","last_change":"2024-05-07T14:06:05.963536+0000","last_active":"2024-05-07T14:06:05.963473+0000","last_peered":"2024-05-07T14:06:05.963473+0000","last_clean":"2024-05-07T14:06:05.963473+0000","last_became_active":"2024-05-07T14:04:59.452426+0000","last_became_peered":"2024-05-07T14:04:59.452426+0000","last_unstale":"2024-05-07T14:06:05.963473+0000","last_undegraded":"2024-05-07T14:06:05.963473+0000","last_fullsized":"2024-05-07T14:06:05.963473+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'66","last_scrub_stamp":"2024-05-07T14:06:05.963271+0000","last_deep_scrub":"146'66","last_deep_scrub_stamp":"2024-05-07T14:06:05.963271+0000","last_clean_scrub_stamp":"2024-05-07T14:06:05.963271+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:18:39.617457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.995021+0000","last_change":"2024-05-07T14:06:01.995084+0000","last_active":"2024-05-07T14:06:01.995021+0000","last_peered":"2024-05-07T14:06:01.995021+0000","last_clean":"2024-05-07T14:06:01.995021+0000","last_became_active":"2024-05-07T14:04:59.445281+0000","last_became_peered":"2024-05-07T14:04:59.445281+0000","last_unstale":"2024-05-07T14:06:01.995021+0000","last_undegraded":"2024-05-07T14:06:01.995021+0000","last_fullsized":"2024-05-07T14:06:01.995021+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:01.994790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:01.994790+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.994790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:16:53.780576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"148'39","reported_seq":313,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.898284+0000","last_change":"2024-05-07T14:05:55.898362+0000","last_active":"2024-05-07T14:05:55.898284+0000","last_peered":"2024-05-07T14:05:55.898284+0000","last_clean":"2024-05-07T14:05:55.898284+0000","last_became_active":"2024-05-07T14:01:02.146529+0000","last_became_peered":"2024-05-07T14:01:02.146529+0000","last_unstale":"2024-05-07T14:05:55.898284+0000","last_undegraded":"2024-05-07T14:05:55.898284+0000","last_fullsized":"2024-05-07T14:05:55.898284+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'39","last_scrub_stamp":"2024-05-07T14:05:55.898103+0000","last_deep_scrub":"148'39","last_deep_scrub_stamp":"2024-05-07T14:05:55.898103+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.898103+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:47:55.298985+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.441789+0000","last_change":"2024-05-07T14:05:35.125928+0000","last_active":"2024-05-07T14:05:38.441789+0000","last_peered":"2024-05-07T14:05:38.441789+0000","last_clean":"2024-05-07T14:05:38.441789+0000","last_became_active":"2024-05-07T14:03:39.666160+0000","last_became_peered":"2024-05-07T14:03:39.666160+0000","last_unstale":"2024-05-07T14:05:38.441789+0000","last_undegraded":"2024-05-07T14:05:38.441789+0000","last_fullsized":"2024-05-07T14:05:38.441789+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:35.125820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:35.125820+0000","last_clean_scrub_stamp":"2024-05-07T14:05:35.125820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:29:32.617948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":250,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.659495+0000","last_change":"2024-05-07T14:05:40.659600+0000","last_active":"2024-05-07T14:05:40.659495+0000","last_peered":"2024-05-07T14:05:40.659495+0000","last_clean":"2024-05-07T14:05:40.659495+0000","last_became_active":"2024-05-07T14:01:06.034414+0000","last_became_peered":"2024-05-07T14:01:06.034414+0000","last_unstale":"2024-05-07T14:05:40.659495+0000","last_undegraded":"2024-05-07T14:05:40.659495+0000","last_fullsized":"2024-05-07T14:05:40.659495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:40.659258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:40.659258+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.659258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:13:49.643039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":268,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.665415+0000","last_change":"2024-05-07T14:05:52.665470+0000","last_active":"2024-05-07T14:05:52.665415+0000","last_peered":"2024-05-07T14:05:52.665415+0000","last_clean":"2024-05-07T14:05:52.665415+0000","last_became_active":"2024-05-07T14:00:58.001077+0000","last_became_peered":"2024-05-07T14:00:58.001077+0000","last_unstale":"2024-05-07T14:05:52.665415+0000","last_undegraded":"2024-05-07T14:05:52.665415+0000","last_fullsized":"2024-05-07T14:05:52.665415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:52.665190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:52.665190+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.665190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:45:56.540696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"146'54","reported_seq":317,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.999034+0000","last_change":"2024-05-07T14:05:44.999096+0000","last_active":"2024-05-07T14:05:44.999034+0000","last_peered":"2024-05-07T14:05:44.999034+0000","last_clean":"2024-05-07T14:05:44.999034+0000","last_became_active":"2024-05-07T14:04:59.421863+0000","last_became_peered":"2024-05-07T14:04:59.421863+0000","last_unstale":"2024-05-07T14:05:44.999034+0000","last_undegraded":"2024-05-07T14:05:44.999034+0000","last_fullsized":"2024-05-07T14:05:44.999034+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:05:44.998813+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:05:44.998813+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.998813+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:03:11.327557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"148'2","reported_seq":354,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.892612+0000","last_change":"2024-05-07T14:05:45.892680+0000","last_active":"2024-05-07T14:05:45.892612+0000","last_peered":"2024-05-07T14:05:45.892612+0000","last_clean":"2024-05-07T14:05:45.892612+0000","last_became_active":"2024-05-07T14:00:59.990299+0000","last_became_peered":"2024-05-07T14:00:59.990299+0000","last_unstale":"2024-05-07T14:05:45.892612+0000","last_undegraded":"2024-05-07T14:05:45.892612+0000","last_fullsized":"2024-05-07T14:05:45.892612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'2","last_scrub_stamp":"2024-05-07T14:05:45.892424+0000","last_deep_scrub":"148'2","last_deep_scrub_stamp":"2024-05-07T14:05:45.892424+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.892424+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:16:45.413388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"148'24","reported_seq":302,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:16.679196+0000","last_change":"2024-05-07T14:06:16.679269+0000","last_active":"2024-05-07T14:06:16.679196+0000","last_peered":"2024-05-07T14:06:16.679196+0000","last_clean":"2024-05-07T14:06:16.679196+0000","last_became_active":"2024-05-07T14:04:59.446737+0000","last_became_peered":"2024-05-07T14:04:59.446737+0000","last_unstale":"2024-05-07T14:06:16.679196+0000","last_undegraded":"2024-05-07T14:06:16.679196+0000","last_fullsized":"2024-05-07T14:06:16.679196+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'24","last_scrub_stamp":"2024-05-07T14:06:16.678971+0000","last_deep_scrub":"148'24","last_deep_scrub_stamp":"2024-05-07T14:06:16.678971+0000","last_clean_scrub_stamp":"2024-05-07T14:06:16.678971+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:38:14.582631+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.517159+0000","last_change":"2024-05-07T14:05:59.517210+0000","last_active":"2024-05-07T14:05:59.517159+0000","last_peered":"2024-05-07T14:05:59.517159+0000","last_clean":"2024-05-07T14:05:59.517159+0000","last_became_active":"2024-05-07T14:01:04.024399+0000","last_became_peered":"2024-05-07T14:01:04.024399+0000","last_unstale":"2024-05-07T14:05:59.517159+0000","last_undegraded":"2024-05-07T14:05:59.517159+0000","last_fullsized":"2024-05-07T14:05:59.517159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:59.516967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:59.516967+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.516967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:29.298832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"115'4","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.517294+0000","last_change":"2024-05-07T14:05:57.517354+0000","last_active":"2024-05-07T14:05:57.517294+0000","last_peered":"2024-05-07T14:05:57.517294+0000","last_clean":"2024-05-07T14:05:57.517294+0000","last_became_active":"2024-05-07T14:01:06.025861+0000","last_became_peered":"2024-05-07T14:01:06.025861+0000","last_unstale":"2024-05-07T14:05:57.517294+0000","last_undegraded":"2024-05-07T14:05:57.517294+0000","last_fullsized":"2024-05-07T14:05:57.517294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'4","last_scrub_stamp":"2024-05-07T14:05:57.517103+0000","last_deep_scrub":"115'4","last_deep_scrub_stamp":"2024-05-07T14:05:57.517103+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.517103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:53:18.211022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"81'6","reported_seq":292,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.495700+0000","last_change":"2024-05-07T14:05:46.495767+0000","last_active":"2024-05-07T14:05:46.495700+0000","last_peered":"2024-05-07T14:05:46.495700+0000","last_clean":"2024-05-07T14:05:46.495700+0000","last_became_active":"2024-05-07T14:00:57.986262+0000","last_became_peered":"2024-05-07T14:00:57.986262+0000","last_unstale":"2024-05-07T14:05:46.495700+0000","last_undegraded":"2024-05-07T14:05:46.495700+0000","last_fullsized":"2024-05-07T14:05:46.495700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-05-07T14:05:46.495497+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-05-07T14:05:46.495497+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.495497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:20:31.482387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"146'58","reported_seq":318,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.842838+0000","last_change":"2024-05-07T14:05:37.984970+0000","last_active":"2024-05-07T14:05:38.842838+0000","last_peered":"2024-05-07T14:05:38.842838+0000","last_clean":"2024-05-07T14:05:38.842838+0000","last_became_active":"2024-05-07T14:04:59.449454+0000","last_became_peered":"2024-05-07T14:04:59.449454+0000","last_unstale":"2024-05-07T14:05:38.842838+0000","last_undegraded":"2024-05-07T14:05:38.842838+0000","last_fullsized":"2024-05-07T14:05:38.842838+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'58","last_scrub_stamp":"2024-05-07T14:05:37.984690+0000","last_deep_scrub":"146'58","last_deep_scrub_stamp":"2024-05-07T14:05:37.984690+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.984690+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:26:51.666200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":261,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.927875+0000","last_change":"2024-05-07T14:05:46.927979+0000","last_active":"2024-05-07T14:05:46.927875+0000","last_peered":"2024-05-07T14:05:46.927875+0000","last_clean":"2024-05-07T14:05:46.927875+0000","last_became_active":"2024-05-07T14:00:59.994648+0000","last_became_peered":"2024-05-07T14:00:59.994648+0000","last_unstale":"2024-05-07T14:05:46.927875+0000","last_undegraded":"2024-05-07T14:05:46.927875+0000","last_fullsized":"2024-05-07T14:05:46.927875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:46.927640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:46.927640+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.927640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:04:07.934671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"148'32","reported_seq":284,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.050877+0000","last_change":"2024-05-07T14:05:44.050966+0000","last_active":"2024-05-07T14:05:44.050877+0000","last_peered":"2024-05-07T14:05:44.050877+0000","last_clean":"2024-05-07T14:05:44.050877+0000","last_became_active":"2024-05-07T14:04:59.458512+0000","last_became_peered":"2024-05-07T14:04:59.458512+0000","last_unstale":"2024-05-07T14:05:44.050877+0000","last_undegraded":"2024-05-07T14:05:44.050877+0000","last_fullsized":"2024-05-07T14:05:44.050877+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'32","last_scrub_stamp":"2024-05-07T14:05:44.050666+0000","last_deep_scrub":"148'32","last_deep_scrub_stamp":"2024-05-07T14:05:44.050666+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.050666+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:35:28.204523+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"146'142","reported_seq":469,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.816317+0000","last_change":"2024-05-07T14:05:35.870612+0000","last_active":"2024-05-07T14:05:38.816317+0000","last_peered":"2024-05-07T14:05:38.816317+0000","last_clean":"2024-05-07T14:05:38.816317+0000","last_became_active":"2024-05-07T14:03:42.700324+0000","last_became_peered":"2024-05-07T14:03:42.700324+0000","last_unstale":"2024-05-07T14:05:38.816317+0000","last_undegraded":"2024-05-07T14:05:38.816317+0000","last_fullsized":"2024-05-07T14:05:38.816317+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'142","last_scrub_stamp":"2024-05-07T14:05:35.870457+0000","last_deep_scrub":"146'142","last_deep_scrub_stamp":"2024-05-07T14:05:35.870457+0000","last_clean_scrub_stamp":"2024-05-07T14:05:35.870457+0000","objects_scrubbed":1,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:08:45.950605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:05.696993+0000","last_change":"2024-05-07T14:06:05.697102+0000","last_active":"2024-05-07T14:06:05.696993+0000","last_peered":"2024-05-07T14:06:05.696993+0000","last_clean":"2024-05-07T14:06:05.696993+0000","last_became_active":"2024-05-07T14:01:06.025587+0000","last_became_peered":"2024-05-07T14:01:06.025587+0000","last_unstale":"2024-05-07T14:06:05.696993+0000","last_undegraded":"2024-05-07T14:06:05.696993+0000","last_fullsized":"2024-05-07T14:06:05.696993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:05.696679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:05.696679+0000","last_clean_scrub_stamp":"2024-05-07T14:06:05.696679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:23.874396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"124'10","reported_seq":297,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.793018+0000","last_change":"2024-05-07T14:05:48.793083+0000","last_active":"2024-05-07T14:05:48.793018+0000","last_peered":"2024-05-07T14:05:48.793018+0000","last_clean":"2024-05-07T14:05:48.793018+0000","last_became_active":"2024-05-07T14:00:57.993085+0000","last_became_peered":"2024-05-07T14:00:57.993085+0000","last_unstale":"2024-05-07T14:05:48.793018+0000","last_undegraded":"2024-05-07T14:05:48.793018+0000","last_fullsized":"2024-05-07T14:05:48.793018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'10","last_scrub_stamp":"2024-05-07T14:05:48.792805+0000","last_deep_scrub":"124'10","last_deep_scrub_stamp":"2024-05-07T14:05:48.792805+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.792805+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:38.523674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"146'72","reported_seq":342,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:04.960341+0000","last_change":"2024-05-07T14:06:04.960403+0000","last_active":"2024-05-07T14:06:04.960341+0000","last_peered":"2024-05-07T14:06:04.960341+0000","last_clean":"2024-05-07T14:06:04.960341+0000","last_became_active":"2024-05-07T14:00:56.004978+0000","last_became_peered":"2024-05-07T14:00:56.004978+0000","last_unstale":"2024-05-07T14:06:04.960341+0000","last_undegraded":"2024-05-07T14:06:04.960341+0000","last_fullsized":"2024-05-07T14:06:04.960341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'72","last_scrub_stamp":"2024-05-07T14:06:04.960135+0000","last_deep_scrub":"146'72","last_deep_scrub_stamp":"2024-05-07T14:06:04.960135+0000","last_clean_scrub_stamp":"2024-05-07T14:06:04.960135+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:07:23.137853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":72,"num_write_kb":147456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":261,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.425462+0000","last_change":"2024-05-07T14:05:37.005828+0000","last_active":"2024-05-07T14:05:38.425462+0000","last_peered":"2024-05-07T14:05:38.425462+0000","last_clean":"2024-05-07T14:05:38.425462+0000","last_became_active":"2024-05-07T14:00:59.997528+0000","last_became_peered":"2024-05-07T14:00:59.997528+0000","last_unstale":"2024-05-07T14:05:38.425462+0000","last_undegraded":"2024-05-07T14:05:38.425462+0000","last_fullsized":"2024-05-07T14:05:38.425462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.005735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.005735+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.005735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:36:36.882585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"148'39","reported_seq":325,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.843926+0000","last_change":"2024-05-07T14:05:39.843992+0000","last_active":"2024-05-07T14:05:39.843926+0000","last_peered":"2024-05-07T14:05:39.843926+0000","last_clean":"2024-05-07T14:05:39.843926+0000","last_became_active":"2024-05-07T14:04:59.455284+0000","last_became_peered":"2024-05-07T14:04:59.455284+0000","last_unstale":"2024-05-07T14:05:39.843926+0000","last_undegraded":"2024-05-07T14:05:39.843926+0000","last_fullsized":"2024-05-07T14:05:39.843926+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'39","last_scrub_stamp":"2024-05-07T14:05:39.843733+0000","last_deep_scrub":"148'39","last_deep_scrub_stamp":"2024-05-07T14:05:39.843733+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.843733+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:06:50.443554+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":260,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.859526+0000","last_change":"2024-05-07T14:05:53.859577+0000","last_active":"2024-05-07T14:05:53.859526+0000","last_peered":"2024-05-07T14:05:53.859526+0000","last_clean":"2024-05-07T14:05:53.859526+0000","last_became_active":"2024-05-07T14:04:59.466731+0000","last_became_peered":"2024-05-07T14:04:59.466731+0000","last_unstale":"2024-05-07T14:05:53.859526+0000","last_undegraded":"2024-05-07T14:05:53.859526+0000","last_fullsized":"2024-05-07T14:05:53.859526+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:53.859333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:53.859333+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.859333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:19.824614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"148'6","reported_seq":126,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.260494+0000","last_change":"2024-05-07T14:06:01.260653+0000","last_active":"2024-05-07T14:06:01.260494+0000","last_peered":"2024-05-07T14:06:01.260494+0000","last_clean":"2024-05-07T14:06:01.260494+0000","last_became_active":"2024-05-07T14:03:39.675695+0000","last_became_peered":"2024-05-07T14:03:39.675695+0000","last_unstale":"2024-05-07T14:06:01.260494+0000","last_undegraded":"2024-05-07T14:06:01.260494+0000","last_fullsized":"2024-05-07T14:06:01.260494+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'6","last_scrub_stamp":"2024-05-07T14:06:01.260264+0000","last_deep_scrub":"148'6","last_deep_scrub_stamp":"2024-05-07T14:06:01.260264+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.260264+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:18:25.190203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"87'2","reported_seq":277,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.636671+0000","last_change":"2024-05-07T14:06:01.636735+0000","last_active":"2024-05-07T14:06:01.636671+0000","last_peered":"2024-05-07T14:06:01.636671+0000","last_clean":"2024-05-07T14:06:01.636671+0000","last_became_active":"2024-05-07T14:00:57.994104+0000","last_became_peered":"2024-05-07T14:00:57.994104+0000","last_unstale":"2024-05-07T14:06:01.636671+0000","last_undegraded":"2024-05-07T14:06:01.636671+0000","last_fullsized":"2024-05-07T14:06:01.636671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-05-07T14:06:01.636441+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-05-07T14:06:01.636441+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.636441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:18:25.566380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"146'52","reported_seq":323,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:09.616241+0000","last_change":"2024-05-07T14:06:09.616311+0000","last_active":"2024-05-07T14:06:09.616241+0000","last_peered":"2024-05-07T14:06:09.616241+0000","last_clean":"2024-05-07T14:06:09.616241+0000","last_became_active":"2024-05-07T14:00:55.976570+0000","last_became_peered":"2024-05-07T14:00:55.976570+0000","last_unstale":"2024-05-07T14:06:09.616241+0000","last_undegraded":"2024-05-07T14:06:09.616241+0000","last_fullsized":"2024-05-07T14:06:09.616241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'52","last_scrub_stamp":"2024-05-07T14:06:09.616015+0000","last_deep_scrub":"146'52","last_deep_scrub_stamp":"2024-05-07T14:06:09.616015+0000","last_clean_scrub_stamp":"2024-05-07T14:06:09.616015+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:52:34.090310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":268,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.851104+0000","last_change":"2024-05-07T14:05:54.851241+0000","last_active":"2024-05-07T14:05:54.851104+0000","last_peered":"2024-05-07T14:05:54.851104+0000","last_clean":"2024-05-07T14:05:54.851104+0000","last_became_active":"2024-05-07T14:04:59.467463+0000","last_became_peered":"2024-05-07T14:04:59.467463+0000","last_unstale":"2024-05-07T14:05:54.851104+0000","last_undegraded":"2024-05-07T14:05:54.851104+0000","last_fullsized":"2024-05-07T14:05:54.851104+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:54.850826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:54.850826+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.850826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:39:03.159468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"148'30","reported_seq":336,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:10.806360+0000","last_change":"2024-05-07T14:06:10.806453+0000","last_active":"2024-05-07T14:06:10.806360+0000","last_peered":"2024-05-07T14:06:10.806360+0000","last_clean":"2024-05-07T14:06:10.806360+0000","last_became_active":"2024-05-07T14:03:39.663223+0000","last_became_peered":"2024-05-07T14:03:39.663223+0000","last_unstale":"2024-05-07T14:06:10.806360+0000","last_undegraded":"2024-05-07T14:06:10.806360+0000","last_fullsized":"2024-05-07T14:06:10.806360+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'30","last_scrub_stamp":"2024-05-07T14:06:10.806171+0000","last_deep_scrub":"148'30","last_deep_scrub_stamp":"2024-05-07T14:06:10.806171+0000","last_clean_scrub_stamp":"2024-05-07T14:06:10.806171+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:55:11.991862+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.811262+0000","last_change":"2024-05-07T14:05:53.811338+0000","last_active":"2024-05-07T14:05:53.811262+0000","last_peered":"2024-05-07T14:05:53.811262+0000","last_clean":"2024-05-07T14:05:53.811262+0000","last_became_active":"2024-05-07T14:01:04.025305+0000","last_became_peered":"2024-05-07T14:01:04.025305+0000","last_unstale":"2024-05-07T14:05:53.811262+0000","last_undegraded":"2024-05-07T14:05:53.811262+0000","last_fullsized":"2024-05-07T14:05:53.811262+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:53.811063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:53.811063+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.811063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:23:15.944992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"106'6","reported_seq":260,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:05.561208+0000","last_change":"2024-05-07T14:06:05.561325+0000","last_active":"2024-05-07T14:06:05.561208+0000","last_peered":"2024-05-07T14:06:05.561208+0000","last_clean":"2024-05-07T14:06:05.561208+0000","last_became_active":"2024-05-07T14:01:06.037038+0000","last_became_peered":"2024-05-07T14:01:06.037038+0000","last_unstale":"2024-05-07T14:06:05.561208+0000","last_undegraded":"2024-05-07T14:06:05.561208+0000","last_fullsized":"2024-05-07T14:06:05.561208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'6","last_scrub_stamp":"2024-05-07T14:06:05.560897+0000","last_deep_scrub":"106'6","last_deep_scrub_stamp":"2024-05-07T14:06:05.560897+0000","last_clean_scrub_stamp":"2024-05-07T14:06:05.560897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:49:58.293086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"106'12","reported_seq":320,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.589914+0000","last_change":"2024-05-07T14:05:46.589973+0000","last_active":"2024-05-07T14:05:46.589914+0000","last_peered":"2024-05-07T14:05:46.589914+0000","last_clean":"2024-05-07T14:05:46.589914+0000","last_became_active":"2024-05-07T14:00:58.001383+0000","last_became_peered":"2024-05-07T14:00:58.001383+0000","last_unstale":"2024-05-07T14:05:46.589914+0000","last_undegraded":"2024-05-07T14:05:46.589914+0000","last_fullsized":"2024-05-07T14:05:46.589914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'12","last_scrub_stamp":"2024-05-07T14:05:46.589665+0000","last_deep_scrub":"106'12","last_deep_scrub_stamp":"2024-05-07T14:05:46.589665+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.589665+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:32.146378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"146'32","reported_seq":302,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.490098+0000","last_change":"2024-05-07T14:05:49.490218+0000","last_active":"2024-05-07T14:05:49.490098+0000","last_peered":"2024-05-07T14:05:49.490098+0000","last_clean":"2024-05-07T14:05:49.490098+0000","last_became_active":"2024-05-07T14:00:55.986124+0000","last_became_peered":"2024-05-07T14:00:55.986124+0000","last_unstale":"2024-05-07T14:05:49.490098+0000","last_undegraded":"2024-05-07T14:05:49.490098+0000","last_fullsized":"2024-05-07T14:05:49.490098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'32","last_scrub_stamp":"2024-05-07T14:05:49.489775+0000","last_deep_scrub":"146'32","last_deep_scrub_stamp":"2024-05-07T14:05:49.489775+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.489775+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:58.808891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"148'2","reported_seq":141,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.239719+0000","last_change":"2024-05-07T14:05:58.239795+0000","last_active":"2024-05-07T14:05:58.239719+0000","last_peered":"2024-05-07T14:05:58.239719+0000","last_clean":"2024-05-07T14:05:58.239719+0000","last_became_active":"2024-05-07T14:03:39.663013+0000","last_became_peered":"2024-05-07T14:03:39.663013+0000","last_unstale":"2024-05-07T14:05:58.239719+0000","last_undegraded":"2024-05-07T14:05:58.239719+0000","last_fullsized":"2024-05-07T14:05:58.239719+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'2","last_scrub_stamp":"2024-05-07T14:05:58.239564+0000","last_deep_scrub":"148'2","last_deep_scrub_stamp":"2024-05-07T14:05:58.239564+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.239564+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:37.890285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"147'33","reported_seq":304,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426862+0000","last_change":"2024-05-07T14:05:38.003955+0000","last_active":"2024-05-07T14:05:38.426862+0000","last_peered":"2024-05-07T14:05:38.426862+0000","last_clean":"2024-05-07T14:05:38.426862+0000","last_became_active":"2024-05-07T14:01:02.010618+0000","last_became_peered":"2024-05-07T14:01:02.010618+0000","last_unstale":"2024-05-07T14:05:38.426862+0000","last_undegraded":"2024-05-07T14:05:38.426862+0000","last_fullsized":"2024-05-07T14:05:38.426862+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"147'33","last_scrub_stamp":"2024-05-07T14:05:38.003643+0000","last_deep_scrub":"147'33","last_deep_scrub_stamp":"2024-05-07T14:05:38.003643+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.003643+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:23:21.738975+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"146'138","reported_seq":458,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.881728+0000","last_change":"2024-05-07T14:05:47.881792+0000","last_active":"2024-05-07T14:05:47.881728+0000","last_peered":"2024-05-07T14:05:47.881728+0000","last_clean":"2024-05-07T14:05:47.881728+0000","last_became_active":"2024-05-07T14:01:04.016711+0000","last_became_peered":"2024-05-07T14:01:04.016711+0000","last_unstale":"2024-05-07T14:05:47.881728+0000","last_undegraded":"2024-05-07T14:05:47.881728+0000","last_fullsized":"2024-05-07T14:05:47.881728+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'138","last_scrub_stamp":"2024-05-07T14:05:47.881523+0000","last_deep_scrub":"146'138","last_deep_scrub_stamp":"2024-05-07T14:05:47.881523+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.881523+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:41:39.022938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"87'4","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.230323+0000","last_change":"2024-05-07T14:05:46.230484+0000","last_active":"2024-05-07T14:05:46.230323+0000","last_peered":"2024-05-07T14:05:46.230323+0000","last_clean":"2024-05-07T14:05:46.230323+0000","last_became_active":"2024-05-07T14:01:06.026346+0000","last_became_peered":"2024-05-07T14:01:06.026346+0000","last_unstale":"2024-05-07T14:05:46.230323+0000","last_undegraded":"2024-05-07T14:05:46.230323+0000","last_fullsized":"2024-05-07T14:05:46.230323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'4","last_scrub_stamp":"2024-05-07T14:05:46.230060+0000","last_deep_scrub":"87'4","last_deep_scrub_stamp":"2024-05-07T14:05:46.230060+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.230060+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:40.346247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"106'8","reported_seq":302,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.678118+0000","last_change":"2024-05-07T14:06:03.678253+0000","last_active":"2024-05-07T14:06:03.678118+0000","last_peered":"2024-05-07T14:06:03.678118+0000","last_clean":"2024-05-07T14:06:03.678118+0000","last_became_active":"2024-05-07T14:00:57.999227+0000","last_became_peered":"2024-05-07T14:00:57.999227+0000","last_unstale":"2024-05-07T14:06:03.678118+0000","last_undegraded":"2024-05-07T14:06:03.678118+0000","last_fullsized":"2024-05-07T14:06:03.678118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'8","last_scrub_stamp":"2024-05-07T14:06:03.677855+0000","last_deep_scrub":"106'8","last_deep_scrub_stamp":"2024-05-07T14:06:03.677855+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.677855+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:52:47.901540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"146'38","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.615512+0000","last_change":"2024-05-07T14:05:58.615576+0000","last_active":"2024-05-07T14:05:58.615512+0000","last_peered":"2024-05-07T14:05:58.615512+0000","last_clean":"2024-05-07T14:05:58.615512+0000","last_became_active":"2024-05-07T14:00:55.974460+0000","last_became_peered":"2024-05-07T14:00:55.974460+0000","last_unstale":"2024-05-07T14:05:58.615512+0000","last_undegraded":"2024-05-07T14:05:58.615512+0000","last_fullsized":"2024-05-07T14:05:58.615512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'38","last_scrub_stamp":"2024-05-07T14:05:58.615312+0000","last_deep_scrub":"146'38","last_deep_scrub_stamp":"2024-05-07T14:05:58.615312+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.615312+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:38.266033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"148'4","reported_seq":448,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.794077+0000","last_change":"2024-05-07T14:05:49.794153+0000","last_active":"2024-05-07T14:05:49.794077+0000","last_peered":"2024-05-07T14:05:49.794077+0000","last_clean":"2024-05-07T14:05:49.794077+0000","last_became_active":"2024-05-07T14:01:00.005966+0000","last_became_peered":"2024-05-07T14:01:00.005966+0000","last_unstale":"2024-05-07T14:05:49.794077+0000","last_undegraded":"2024-05-07T14:05:49.794077+0000","last_fullsized":"2024-05-07T14:05:49.794077+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'4","last_scrub_stamp":"2024-05-07T14:05:49.793887+0000","last_deep_scrub":"148'4","last_deep_scrub_stamp":"2024-05-07T14:05:49.793887+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.793887+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:52:34.017572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":182,"num_read_kb":182,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"148'15","reported_seq":279,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.451639+0000","last_change":"2024-05-07T14:05:51.451714+0000","last_active":"2024-05-07T14:05:51.451639+0000","last_peered":"2024-05-07T14:05:51.451639+0000","last_clean":"2024-05-07T14:05:51.451639+0000","last_became_active":"2024-05-07T14:01:02.147406+0000","last_became_peered":"2024-05-07T14:01:02.147406+0000","last_unstale":"2024-05-07T14:05:51.451639+0000","last_undegraded":"2024-05-07T14:05:51.451639+0000","last_fullsized":"2024-05-07T14:05:51.451639+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'15","last_scrub_stamp":"2024-05-07T14:05:51.451437+0000","last_deep_scrub":"148'15","last_deep_scrub_stamp":"2024-05-07T14:05:51.451437+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.451437+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:05:14.981223+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"146'138","reported_seq":447,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.515099+0000","last_change":"2024-05-07T14:05:39.515165+0000","last_active":"2024-05-07T14:05:39.515099+0000","last_peered":"2024-05-07T14:05:39.515099+0000","last_clean":"2024-05-07T14:05:39.515099+0000","last_became_active":"2024-05-07T14:01:04.015699+0000","last_became_peered":"2024-05-07T14:01:04.015699+0000","last_unstale":"2024-05-07T14:05:39.515099+0000","last_undegraded":"2024-05-07T14:05:39.515099+0000","last_fullsized":"2024-05-07T14:05:39.515099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'138","last_scrub_stamp":"2024-05-07T14:05:39.514876+0000","last_deep_scrub":"146'138","last_deep_scrub_stamp":"2024-05-07T14:05:39.514876+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.514876+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:10:10.324260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"87'6","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:07.752334+0000","last_change":"2024-05-07T14:06:07.752400+0000","last_active":"2024-05-07T14:06:07.752334+0000","last_peered":"2024-05-07T14:06:07.752334+0000","last_clean":"2024-05-07T14:06:07.752334+0000","last_became_active":"2024-05-07T14:01:06.020680+0000","last_became_peered":"2024-05-07T14:01:06.020680+0000","last_unstale":"2024-05-07T14:06:07.752334+0000","last_undegraded":"2024-05-07T14:06:07.752334+0000","last_fullsized":"2024-05-07T14:06:07.752334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'6","last_scrub_stamp":"2024-05-07T14:06:07.752132+0000","last_deep_scrub":"87'6","last_deep_scrub_stamp":"2024-05-07T14:06:07.752132+0000","last_clean_scrub_stamp":"2024-05-07T14:06:07.752132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:42.745328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"124'6","reported_seq":291,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.281171+0000","last_change":"2024-05-07T14:05:54.281289+0000","last_active":"2024-05-07T14:05:54.281171+0000","last_peered":"2024-05-07T14:05:54.281171+0000","last_clean":"2024-05-07T14:05:54.281171+0000","last_became_active":"2024-05-07T14:00:57.979690+0000","last_became_peered":"2024-05-07T14:00:57.979690+0000","last_unstale":"2024-05-07T14:05:54.281171+0000","last_undegraded":"2024-05-07T14:05:54.281171+0000","last_fullsized":"2024-05-07T14:05:54.281171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'6","last_scrub_stamp":"2024-05-07T14:05:54.280845+0000","last_deep_scrub":"124'6","last_deep_scrub_stamp":"2024-05-07T14:05:54.280845+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.280845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:37.067836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"146'48","reported_seq":353,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.453337+0000","last_change":"2024-05-07T14:05:44.453402+0000","last_active":"2024-05-07T14:05:44.453337+0000","last_peered":"2024-05-07T14:05:44.453337+0000","last_clean":"2024-05-07T14:05:44.453337+0000","last_became_active":"2024-05-07T14:03:39.666192+0000","last_became_peered":"2024-05-07T14:03:39.666192+0000","last_unstale":"2024-05-07T14:05:44.453337+0000","last_undegraded":"2024-05-07T14:05:44.453337+0000","last_fullsized":"2024-05-07T14:05:44.453337+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'48","last_scrub_stamp":"2024-05-07T14:05:44.453140+0000","last_deep_scrub":"146'48","last_deep_scrub_stamp":"2024-05-07T14:05:44.453140+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.453140+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:30.552148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":264,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.683305+0000","last_change":"2024-05-07T14:05:51.683360+0000","last_active":"2024-05-07T14:05:51.683305+0000","last_peered":"2024-05-07T14:05:51.683305+0000","last_clean":"2024-05-07T14:05:51.683305+0000","last_became_active":"2024-05-07T14:01:00.006044+0000","last_became_peered":"2024-05-07T14:01:00.006044+0000","last_unstale":"2024-05-07T14:05:51.683305+0000","last_undegraded":"2024-05-07T14:05:51.683305+0000","last_fullsized":"2024-05-07T14:05:51.683305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:51.683083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:51.683083+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.683083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:06.122503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"148'35","reported_seq":354,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.657561+0000","last_change":"2024-05-07T14:05:39.657649+0000","last_active":"2024-05-07T14:05:39.657561+0000","last_peered":"2024-05-07T14:05:39.657561+0000","last_clean":"2024-05-07T14:05:39.657561+0000","last_became_active":"2024-05-07T14:03:39.673995+0000","last_became_peered":"2024-05-07T14:03:39.673995+0000","last_unstale":"2024-05-07T14:05:39.657561+0000","last_undegraded":"2024-05-07T14:05:39.657561+0000","last_fullsized":"2024-05-07T14:05:39.657561+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'35","last_scrub_stamp":"2024-05-07T14:05:39.657374+0000","last_deep_scrub":"148'35","last_deep_scrub_stamp":"2024-05-07T14:05:39.657374+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.657374+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:53:39.083704+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.534447+0000","last_change":"2024-05-07T14:05:55.534501+0000","last_active":"2024-05-07T14:05:55.534447+0000","last_peered":"2024-05-07T14:05:55.534447+0000","last_clean":"2024-05-07T14:05:55.534447+0000","last_became_active":"2024-05-07T14:01:04.024974+0000","last_became_peered":"2024-05-07T14:01:04.024974+0000","last_unstale":"2024-05-07T14:05:55.534447+0000","last_undegraded":"2024-05-07T14:05:55.534447+0000","last_fullsized":"2024-05-07T14:05:55.534447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:55.534249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:55.534249+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.534249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:50.969463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"124'2","reported_seq":118,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.442063+0000","last_change":"2024-05-07T14:05:36.169322+0000","last_active":"2024-05-07T14:05:38.442063+0000","last_peered":"2024-05-07T14:05:38.442063+0000","last_clean":"2024-05-07T14:05:38.442063+0000","last_became_active":"2024-05-07T14:03:39.665838+0000","last_became_peered":"2024-05-07T14:03:39.665838+0000","last_unstale":"2024-05-07T14:05:38.442063+0000","last_undegraded":"2024-05-07T14:05:38.442063+0000","last_fullsized":"2024-05-07T14:05:38.442063+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'2","last_scrub_stamp":"2024-05-07T14:05:36.169228+0000","last_deep_scrub":"124'2","last_deep_scrub_stamp":"2024-05-07T14:05:36.169228+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.169228+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:29:05.619187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"80'2","reported_seq":275,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.496398+0000","last_change":"2024-05-07T14:05:42.496470+0000","last_active":"2024-05-07T14:05:42.496398+0000","last_peered":"2024-05-07T14:05:42.496398+0000","last_clean":"2024-05-07T14:05:42.496398+0000","last_became_active":"2024-05-07T14:00:58.004935+0000","last_became_peered":"2024-05-07T14:00:58.004935+0000","last_unstale":"2024-05-07T14:05:42.496398+0000","last_undegraded":"2024-05-07T14:05:42.496398+0000","last_fullsized":"2024-05-07T14:05:42.496398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'2","last_scrub_stamp":"2024-05-07T14:05:42.496172+0000","last_deep_scrub":"80'2","last_deep_scrub_stamp":"2024-05-07T14:05:42.496172+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.496172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:08.117356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"148'119","reported_seq":328,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.519046+0000","last_change":"2024-05-07T14:05:58.519125+0000","last_active":"2024-05-07T14:05:58.519046+0000","last_peered":"2024-05-07T14:05:58.519046+0000","last_clean":"2024-05-07T14:05:58.519046+0000","last_became_active":"2024-05-07T14:02:39.728189+0000","last_became_peered":"2024-05-07T14:02:39.728189+0000","last_unstale":"2024-05-07T14:05:58.519046+0000","last_undegraded":"2024-05-07T14:05:58.519046+0000","last_fullsized":"2024-05-07T14:05:58.519046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'119","last_scrub_stamp":"2024-05-07T14:05:58.518830+0000","last_deep_scrub":"148'119","last_deep_scrub_stamp":"2024-05-07T14:05:58.518830+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.518830+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:36:36.429075+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.856801+0000","last_change":"2024-05-07T14:05:59.856861+0000","last_active":"2024-05-07T14:05:59.856801+0000","last_peered":"2024-05-07T14:05:59.856801+0000","last_clean":"2024-05-07T14:05:59.856801+0000","last_became_active":"2024-05-07T14:00:49.932199+0000","last_became_peered":"2024-05-07T14:00:49.932199+0000","last_unstale":"2024-05-07T14:05:59.856801+0000","last_undegraded":"2024-05-07T14:05:59.856801+0000","last_fullsized":"2024-05-07T14:05:59.856801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:59.856598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:59.856598+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.856598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:27:47.818900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"146'40","reported_seq":260,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.896294+0000","last_change":"2024-05-07T14:05:49.896351+0000","last_active":"2024-05-07T14:05:49.896294+0000","last_peered":"2024-05-07T14:05:49.896294+0000","last_clean":"2024-05-07T14:05:49.896294+0000","last_became_active":"2024-05-07T14:01:37.317570+0000","last_became_peered":"2024-05-07T14:01:37.317570+0000","last_unstale":"2024-05-07T14:05:49.896294+0000","last_undegraded":"2024-05-07T14:05:49.896294+0000","last_fullsized":"2024-05-07T14:05:49.896294+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'40","last_scrub_stamp":"2024-05-07T14:05:49.896090+0000","last_deep_scrub":"146'40","last_deep_scrub_stamp":"2024-05-07T14:05:49.896090+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.896090+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:41:15.517274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":50,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.047023+0000","last_change":"2024-05-07T14:05:48.047075+0000","last_active":"2024-05-07T14:05:48.047023+0000","last_peered":"2024-05-07T14:05:48.047023+0000","last_clean":"2024-05-07T14:05:48.047023+0000","last_became_active":"2024-05-07T14:04:59.453884+0000","last_became_peered":"2024-05-07T14:04:59.453884+0000","last_unstale":"2024-05-07T14:05:48.047023+0000","last_undegraded":"2024-05-07T14:05:48.047023+0000","last_fullsized":"2024-05-07T14:05:48.047023+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:48.046779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:48.046779+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.046779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:01:29.471937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"148'49","reported_seq":333,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.848365+0000","last_change":"2024-05-07T14:05:51.848447+0000","last_active":"2024-05-07T14:05:51.848365+0000","last_peered":"2024-05-07T14:05:51.848365+0000","last_clean":"2024-05-07T14:05:51.848365+0000","last_became_active":"2024-05-07T14:01:02.009550+0000","last_became_peered":"2024-05-07T14:01:02.009550+0000","last_unstale":"2024-05-07T14:05:51.848365+0000","last_undegraded":"2024-05-07T14:05:51.848365+0000","last_fullsized":"2024-05-07T14:05:51.848365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'49","last_scrub_stamp":"2024-05-07T14:05:51.848139+0000","last_deep_scrub":"148'49","last_deep_scrub_stamp":"2024-05-07T14:05:51.848139+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.848139+0000","objects_scrubbed":5,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:28.943832+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":37,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:08.677065+0000","last_change":"2024-05-07T14:06:08.677121+0000","last_active":"2024-05-07T14:06:08.677065+0000","last_peered":"2024-05-07T14:06:08.677065+0000","last_clean":"2024-05-07T14:06:08.677065+0000","last_became_active":"2024-05-07T14:04:59.456477+0000","last_became_peered":"2024-05-07T14:04:59.456477+0000","last_unstale":"2024-05-07T14:06:08.677065+0000","last_undegraded":"2024-05-07T14:06:08.677065+0000","last_fullsized":"2024-05-07T14:06:08.677065+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:08.676852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:08.676852+0000","last_clean_scrub_stamp":"2024-05-07T14:06:08.676852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:10:27.857200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":250,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.546092+0000","last_change":"2024-05-07T14:05:56.546145+0000","last_active":"2024-05-07T14:05:56.546092+0000","last_peered":"2024-05-07T14:05:56.546092+0000","last_clean":"2024-05-07T14:05:56.546092+0000","last_became_active":"2024-05-07T14:01:06.023109+0000","last_became_peered":"2024-05-07T14:01:06.023109+0000","last_unstale":"2024-05-07T14:05:56.546092+0000","last_undegraded":"2024-05-07T14:05:56.546092+0000","last_fullsized":"2024-05-07T14:05:56.546092+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:56.545882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:56.545882+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.545882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:33.203820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'2","reported_seq":275,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.837056+0000","last_change":"2024-05-07T14:05:54.837119+0000","last_active":"2024-05-07T14:05:54.837056+0000","last_peered":"2024-05-07T14:05:54.837056+0000","last_clean":"2024-05-07T14:05:54.837056+0000","last_became_active":"2024-05-07T14:00:57.980893+0000","last_became_peered":"2024-05-07T14:00:57.980893+0000","last_unstale":"2024-05-07T14:05:54.837056+0000","last_undegraded":"2024-05-07T14:05:54.837056+0000","last_fullsized":"2024-05-07T14:05:54.837056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:05:54.836855+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:05:54.836855+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.836855+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:38:49.202501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":237,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.093679+0000","last_change":"2024-05-07T14:05:55.093736+0000","last_active":"2024-05-07T14:05:55.093679+0000","last_peered":"2024-05-07T14:05:55.093679+0000","last_clean":"2024-05-07T14:05:55.093679+0000","last_became_active":"2024-05-07T14:04:59.422224+0000","last_became_peered":"2024-05-07T14:04:59.422224+0000","last_unstale":"2024-05-07T14:05:55.093679+0000","last_undegraded":"2024-05-07T14:05:55.093679+0000","last_fullsized":"2024-05-07T14:05:55.093679+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:55.093491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:55.093491+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.093491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:56:12.513534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"146'44","reported_seq":315,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:02.709673+0000","last_change":"2024-05-07T14:06:02.709733+0000","last_active":"2024-05-07T14:06:02.709673+0000","last_peered":"2024-05-07T14:06:02.709673+0000","last_clean":"2024-05-07T14:06:02.709673+0000","last_became_active":"2024-05-07T14:00:55.985830+0000","last_became_peered":"2024-05-07T14:00:55.985830+0000","last_unstale":"2024-05-07T14:06:02.709673+0000","last_undegraded":"2024-05-07T14:06:02.709673+0000","last_fullsized":"2024-05-07T14:06:02.709673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'44","last_scrub_stamp":"2024-05-07T14:06:02.709470+0000","last_deep_scrub":"146'44","last_deep_scrub_stamp":"2024-05-07T14:06:02.709470+0000","last_clean_scrub_stamp":"2024-05-07T14:06:02.709470+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:03:50.999807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.715081+0000","last_change":"2024-05-07T14:05:45.715136+0000","last_active":"2024-05-07T14:05:45.715081+0000","last_peered":"2024-05-07T14:05:45.715081+0000","last_clean":"2024-05-07T14:05:45.715081+0000","last_became_active":"2024-05-07T14:01:00.001853+0000","last_became_peered":"2024-05-07T14:01:00.001853+0000","last_unstale":"2024-05-07T14:05:45.715081+0000","last_undegraded":"2024-05-07T14:05:45.715081+0000","last_fullsized":"2024-05-07T14:05:45.715081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:45.714883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:45.714883+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.714883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:20.093461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"148'163","reported_seq":564,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.286083+0000","last_change":"2024-05-07T14:06:03.286170+0000","last_active":"2024-05-07T14:06:03.286083+0000","last_peered":"2024-05-07T14:06:03.286083+0000","last_clean":"2024-05-07T14:06:03.286083+0000","last_became_active":"2024-05-07T14:03:42.708117+0000","last_became_peered":"2024-05-07T14:03:42.708117+0000","last_unstale":"2024-05-07T14:06:03.286083+0000","last_undegraded":"2024-05-07T14:06:03.286083+0000","last_fullsized":"2024-05-07T14:06:03.286083+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'163","last_scrub_stamp":"2024-05-07T14:06:03.285871+0000","last_deep_scrub":"148'163","last_deep_scrub_stamp":"2024-05-07T14:06:03.285871+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.285871+0000","objects_scrubbed":10,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:52:47.509556+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":202,"num_read_kb":198,"num_write":38,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2942,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.008569+0000","last_change":"2024-05-07T14:05:43.008624+0000","last_active":"2024-05-07T14:05:43.008569+0000","last_peered":"2024-05-07T14:05:43.008569+0000","last_clean":"2024-05-07T14:05:43.008569+0000","last_became_active":"2024-05-07T14:04:59.461354+0000","last_became_peered":"2024-05-07T14:04:59.461354+0000","last_unstale":"2024-05-07T14:05:43.008569+0000","last_undegraded":"2024-05-07T14:05:43.008569+0000","last_fullsized":"2024-05-07T14:05:43.008569+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:43.008372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:43.008372+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.008372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:47:45.743047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"80'4","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.177883+0000","last_change":"2024-05-07T14:05:44.177944+0000","last_active":"2024-05-07T14:05:44.177883+0000","last_peered":"2024-05-07T14:05:44.177883+0000","last_clean":"2024-05-07T14:05:44.177883+0000","last_became_active":"2024-05-07T14:01:06.367922+0000","last_became_peered":"2024-05-07T14:01:06.367922+0000","last_unstale":"2024-05-07T14:05:44.177883+0000","last_undegraded":"2024-05-07T14:05:44.177883+0000","last_fullsized":"2024-05-07T14:05:44.177883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"80'4","last_scrub_stamp":"2024-05-07T14:05:44.177682+0000","last_deep_scrub":"80'4","last_deep_scrub_stamp":"2024-05-07T14:05:44.177682+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.177682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:19:08.727384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"81'2","reported_seq":118,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.283849+0000","last_change":"2024-05-07T14:05:57.283996+0000","last_active":"2024-05-07T14:05:57.283849+0000","last_peered":"2024-05-07T14:05:57.283849+0000","last_clean":"2024-05-07T14:05:57.283849+0000","last_became_active":"2024-05-07T14:03:39.667130+0000","last_became_peered":"2024-05-07T14:03:39.667130+0000","last_unstale":"2024-05-07T14:05:57.283849+0000","last_undegraded":"2024-05-07T14:05:57.283849+0000","last_fullsized":"2024-05-07T14:05:57.283849+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:05:57.283618+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:05:57.283618+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.283618+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:06:28.687444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":275,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.930965+0000","last_change":"2024-05-07T14:05:39.931024+0000","last_active":"2024-05-07T14:05:39.930965+0000","last_peered":"2024-05-07T14:05:39.930965+0000","last_clean":"2024-05-07T14:05:39.930965+0000","last_became_active":"2024-05-07T14:00:50.425161+0000","last_became_peered":"2024-05-07T14:00:50.425161+0000","last_unstale":"2024-05-07T14:05:39.930965+0000","last_undegraded":"2024-05-07T14:05:39.930965+0000","last_fullsized":"2024-05-07T14:05:39.930965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:39.930722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:39.930722+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.930722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:25:55.708927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"146'54","reported_seq":324,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.203380+0000","last_change":"2024-05-07T14:05:52.203445+0000","last_active":"2024-05-07T14:05:52.203380+0000","last_peered":"2024-05-07T14:05:52.203380+0000","last_clean":"2024-05-07T14:05:52.203380+0000","last_became_active":"2024-05-07T14:00:55.966925+0000","last_became_peered":"2024-05-07T14:00:55.966925+0000","last_unstale":"2024-05-07T14:05:52.203380+0000","last_undegraded":"2024-05-07T14:05:52.203380+0000","last_fullsized":"2024-05-07T14:05:52.203380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:05:52.203119+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:05:52.203119+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.203119+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:45:56.078625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"148'2","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.949508+0000","last_change":"2024-05-07T14:05:38.949702+0000","last_active":"2024-05-07T14:05:38.949508+0000","last_peered":"2024-05-07T14:05:38.949508+0000","last_clean":"2024-05-07T14:05:38.949508+0000","last_became_active":"2024-05-07T14:00:59.997361+0000","last_became_peered":"2024-05-07T14:00:59.997361+0000","last_unstale":"2024-05-07T14:05:38.949508+0000","last_undegraded":"2024-05-07T14:05:38.949508+0000","last_fullsized":"2024-05-07T14:05:38.949508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'2","last_scrub_stamp":"2024-05-07T14:05:38.949276+0000","last_deep_scrub":"148'2","last_deep_scrub_stamp":"2024-05-07T14:05:38.949276+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.949276+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:32:59.585166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"148'26","reported_seq":312,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.975153+0000","last_change":"2024-05-07T14:05:41.975241+0000","last_active":"2024-05-07T14:05:41.975153+0000","last_peered":"2024-05-07T14:05:41.975153+0000","last_clean":"2024-05-07T14:05:41.975153+0000","last_became_active":"2024-05-07T14:04:59.456018+0000","last_became_peered":"2024-05-07T14:04:59.456018+0000","last_unstale":"2024-05-07T14:05:41.975153+0000","last_undegraded":"2024-05-07T14:05:41.975153+0000","last_fullsized":"2024-05-07T14:05:41.975153+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'26","last_scrub_stamp":"2024-05-07T14:05:41.974940+0000","last_deep_scrub":"148'26","last_deep_scrub_stamp":"2024-05-07T14:05:41.974940+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.974940+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:45:59.365603+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.759315+0000","last_change":"2024-05-07T14:05:47.759374+0000","last_active":"2024-05-07T14:05:47.759315+0000","last_peered":"2024-05-07T14:05:47.759315+0000","last_clean":"2024-05-07T14:05:47.759315+0000","last_became_active":"2024-05-07T14:01:03.999826+0000","last_became_peered":"2024-05-07T14:01:03.999826+0000","last_unstale":"2024-05-07T14:05:47.759315+0000","last_undegraded":"2024-05-07T14:05:47.759315+0000","last_fullsized":"2024-05-07T14:05:47.759315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:47.759099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:47.759099+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.759099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:47:27.409820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.566348+0000","last_change":"2024-05-07T14:06:03.566427+0000","last_active":"2024-05-07T14:06:03.566348+0000","last_peered":"2024-05-07T14:06:03.566348+0000","last_clean":"2024-05-07T14:06:03.566348+0000","last_became_active":"2024-05-07T14:01:06.015887+0000","last_became_peered":"2024-05-07T14:01:06.015887+0000","last_unstale":"2024-05-07T14:06:03.566348+0000","last_undegraded":"2024-05-07T14:06:03.566348+0000","last_fullsized":"2024-05-07T14:06:03.566348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:03.566056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:03.566056+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.566056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:07.625070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"81'4","reported_seq":120,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.202102+0000","last_change":"2024-05-07T14:05:43.202102+0000","last_active":"2024-05-07T14:05:43.202102+0000","last_peered":"2024-05-07T14:05:43.202102+0000","last_clean":"2024-05-07T14:05:43.202102+0000","last_became_active":"2024-05-07T14:03:39.661295+0000","last_became_peered":"2024-05-07T14:03:39.661295+0000","last_unstale":"2024-05-07T14:05:43.202102+0000","last_undegraded":"2024-05-07T14:05:43.202102+0000","last_fullsized":"2024-05-07T14:05:43.202102+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-05-07T14:05:43.201833+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-05-07T14:05:43.201833+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.201833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:53:22.951653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.897454+0000","last_change":"2024-05-07T14:06:00.897509+0000","last_active":"2024-05-07T14:06:00.897454+0000","last_peered":"2024-05-07T14:06:00.897454+0000","last_clean":"2024-05-07T14:06:00.897454+0000","last_became_active":"2024-05-07T14:00:49.932965+0000","last_became_peered":"2024-05-07T14:00:49.932965+0000","last_unstale":"2024-05-07T14:06:00.897454+0000","last_undegraded":"2024-05-07T14:06:00.897454+0000","last_fullsized":"2024-05-07T14:06:00.897454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:00.897257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:00.897257+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.897257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:04.956272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"146'28","reported_seq":301,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.624912+0000","last_change":"2024-05-07T14:05:57.624978+0000","last_active":"2024-05-07T14:05:57.624912+0000","last_peered":"2024-05-07T14:05:57.624912+0000","last_clean":"2024-05-07T14:05:57.624912+0000","last_became_active":"2024-05-07T14:00:55.970538+0000","last_became_peered":"2024-05-07T14:00:55.970538+0000","last_unstale":"2024-05-07T14:05:57.624912+0000","last_undegraded":"2024-05-07T14:05:57.624912+0000","last_fullsized":"2024-05-07T14:05:57.624912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'28","last_scrub_stamp":"2024-05-07T14:05:57.624709+0000","last_deep_scrub":"146'28","last_deep_scrub_stamp":"2024-05-07T14:05:57.624709+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.624709+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:06:29.028535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":38,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.842219+0000","last_change":"2024-05-07T14:05:42.842270+0000","last_active":"2024-05-07T14:05:42.842219+0000","last_peered":"2024-05-07T14:05:42.842219+0000","last_clean":"2024-05-07T14:05:42.842219+0000","last_became_active":"2024-05-07T14:00:59.998156+0000","last_became_peered":"2024-05-07T14:00:59.998156+0000","last_unstale":"2024-05-07T14:05:42.842219+0000","last_undegraded":"2024-05-07T14:05:42.842219+0000","last_fullsized":"2024-05-07T14:05:42.842219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:42.842025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:42.842025+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.842025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:20:29.836711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"148'18","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.441470+0000","last_change":"2024-05-07T14:05:54.441554+0000","last_active":"2024-05-07T14:05:54.441470+0000","last_peered":"2024-05-07T14:05:54.441470+0000","last_clean":"2024-05-07T14:05:54.441470+0000","last_became_active":"2024-05-07T14:01:02.005597+0000","last_became_peered":"2024-05-07T14:01:02.005597+0000","last_unstale":"2024-05-07T14:05:54.441470+0000","last_undegraded":"2024-05-07T14:05:54.441470+0000","last_fullsized":"2024-05-07T14:05:54.441470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'18","last_scrub_stamp":"2024-05-07T14:05:54.441267+0000","last_deep_scrub":"148'18","last_deep_scrub_stamp":"2024-05-07T14:05:54.441267+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.441267+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:50:31.536960+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.451049+0000","last_change":"2024-05-07T14:05:45.451111+0000","last_active":"2024-05-07T14:05:45.451049+0000","last_peered":"2024-05-07T14:05:45.451049+0000","last_clean":"2024-05-07T14:05:45.451049+0000","last_became_active":"2024-05-07T14:01:04.018077+0000","last_became_peered":"2024-05-07T14:01:04.018077+0000","last_unstale":"2024-05-07T14:05:45.451049+0000","last_undegraded":"2024-05-07T14:05:45.451049+0000","last_fullsized":"2024-05-07T14:05:45.451049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:45.450822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:45.450822+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.450822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:46:13.537065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":250,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:07.942087+0000","last_change":"2024-05-07T14:06:07.942191+0000","last_active":"2024-05-07T14:06:07.942087+0000","last_peered":"2024-05-07T14:06:07.942087+0000","last_clean":"2024-05-07T14:06:07.942087+0000","last_became_active":"2024-05-07T14:01:06.035839+0000","last_became_peered":"2024-05-07T14:01:06.035839+0000","last_unstale":"2024-05-07T14:06:07.942087+0000","last_undegraded":"2024-05-07T14:06:07.942087+0000","last_fullsized":"2024-05-07T14:06:07.942087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:07.941778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:07.941778+0000","last_clean_scrub_stamp":"2024-05-07T14:06:07.941778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:10:27.122126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.164645+0000","last_change":"2024-05-07T14:05:42.164645+0000","last_active":"2024-05-07T14:05:42.164645+0000","last_peered":"2024-05-07T14:05:42.164645+0000","last_clean":"2024-05-07T14:05:42.164645+0000","last_became_active":"2024-05-07T14:03:39.659515+0000","last_became_peered":"2024-05-07T14:03:39.659515+0000","last_unstale":"2024-05-07T14:05:42.164645+0000","last_undegraded":"2024-05-07T14:05:42.164645+0000","last_fullsized":"2024-05-07T14:05:42.164645+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:42.164378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:42.164378+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.164378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:24:47.549501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"146'38","reported_seq":308,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:02.894143+0000","last_change":"2024-05-07T14:06:02.894207+0000","last_active":"2024-05-07T14:06:02.894143+0000","last_peered":"2024-05-07T14:06:02.894143+0000","last_clean":"2024-05-07T14:06:02.894143+0000","last_became_active":"2024-05-07T14:00:56.001695+0000","last_became_peered":"2024-05-07T14:00:56.001695+0000","last_unstale":"2024-05-07T14:06:02.894143+0000","last_undegraded":"2024-05-07T14:06:02.894143+0000","last_fullsized":"2024-05-07T14:06:02.894143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'38","last_scrub_stamp":"2024-05-07T14:06:02.893936+0000","last_deep_scrub":"146'38","last_deep_scrub_stamp":"2024-05-07T14:06:02.893936+0000","last_clean_scrub_stamp":"2024-05-07T14:06:02.893936+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T02:03:14.714059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.223910+0000","last_change":"2024-05-07T14:05:49.224051+0000","last_active":"2024-05-07T14:05:49.223910+0000","last_peered":"2024-05-07T14:05:49.223910+0000","last_clean":"2024-05-07T14:05:49.223910+0000","last_became_active":"2024-05-07T14:00:49.930318+0000","last_became_peered":"2024-05-07T14:00:49.930318+0000","last_unstale":"2024-05-07T14:05:49.223910+0000","last_undegraded":"2024-05-07T14:05:49.223910+0000","last_fullsized":"2024-05-07T14:05:49.223910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:49.223689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:49.223689+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.223689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:53:09.917608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.816128+0000","last_change":"2024-05-07T14:05:44.816178+0000","last_active":"2024-05-07T14:05:44.816128+0000","last_peered":"2024-05-07T14:05:44.816128+0000","last_clean":"2024-05-07T14:05:44.816128+0000","last_became_active":"2024-05-07T14:00:59.995964+0000","last_became_peered":"2024-05-07T14:00:59.995964+0000","last_unstale":"2024-05-07T14:05:44.816128+0000","last_undegraded":"2024-05-07T14:05:44.816128+0000","last_fullsized":"2024-05-07T14:05:44.816128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:44.815925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:44.815925+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.815925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:30.914933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"148'49","reported_seq":330,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.898403+0000","last_change":"2024-05-07T14:05:41.898478+0000","last_active":"2024-05-07T14:05:41.898403+0000","last_peered":"2024-05-07T14:05:41.898403+0000","last_clean":"2024-05-07T14:05:41.898403+0000","last_became_active":"2024-05-07T14:01:02.001371+0000","last_became_peered":"2024-05-07T14:01:02.001371+0000","last_unstale":"2024-05-07T14:05:41.898403+0000","last_undegraded":"2024-05-07T14:05:41.898403+0000","last_fullsized":"2024-05-07T14:05:41.898403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'49","last_scrub_stamp":"2024-05-07T14:05:41.898210+0000","last_deep_scrub":"148'49","last_deep_scrub_stamp":"2024-05-07T14:05:41.898210+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.898210+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:45:45.773716+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":157,"num_write":28,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.583332+0000","last_change":"2024-05-07T14:05:39.583489+0000","last_active":"2024-05-07T14:05:39.583332+0000","last_peered":"2024-05-07T14:05:39.583332+0000","last_clean":"2024-05-07T14:05:39.583332+0000","last_became_active":"2024-05-07T14:01:04.022925+0000","last_became_peered":"2024-05-07T14:01:04.022925+0000","last_unstale":"2024-05-07T14:05:39.583332+0000","last_undegraded":"2024-05-07T14:05:39.583332+0000","last_fullsized":"2024-05-07T14:05:39.583332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:39.583104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:39.583104+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.583104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:05.548386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"146'2","reported_seq":253,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817343+0000","last_change":"2024-05-07T14:05:36.847888+0000","last_active":"2024-05-07T14:05:38.817343+0000","last_peered":"2024-05-07T14:05:38.817343+0000","last_clean":"2024-05-07T14:05:38.817343+0000","last_became_active":"2024-05-07T14:01:06.367380+0000","last_became_peered":"2024-05-07T14:01:06.367380+0000","last_unstale":"2024-05-07T14:05:38.817343+0000","last_undegraded":"2024-05-07T14:05:38.817343+0000","last_fullsized":"2024-05-07T14:05:38.817343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'2","last_scrub_stamp":"2024-05-07T14:05:36.847644+0000","last_deep_scrub":"146'2","last_deep_scrub_stamp":"2024-05-07T14:05:36.847644+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.847644+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:47.884397+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":267,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.806194+0000","last_change":"2024-05-07T14:05:46.806344+0000","last_active":"2024-05-07T14:05:46.806194+0000","last_peered":"2024-05-07T14:05:46.806194+0000","last_clean":"2024-05-07T14:05:46.806194+0000","last_became_active":"2024-05-07T14:00:57.994147+0000","last_became_peered":"2024-05-07T14:00:57.994147+0000","last_unstale":"2024-05-07T14:05:46.806194+0000","last_undegraded":"2024-05-07T14:05:46.806194+0000","last_fullsized":"2024-05-07T14:05:46.806194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:46.805972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:46.805972+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.805972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:06:18.209798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"146'46","reported_seq":316,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.201907+0000","last_change":"2024-05-07T14:05:51.201972+0000","last_active":"2024-05-07T14:05:51.201907+0000","last_peered":"2024-05-07T14:05:51.201907+0000","last_clean":"2024-05-07T14:05:51.201907+0000","last_became_active":"2024-05-07T14:00:55.970125+0000","last_became_peered":"2024-05-07T14:00:55.970125+0000","last_unstale":"2024-05-07T14:05:51.201907+0000","last_undegraded":"2024-05-07T14:05:51.201907+0000","last_fullsized":"2024-05-07T14:05:51.201907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:05:51.201707+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:05:51.201707+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.201707+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:39:05.641126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.071032+0000","last_change":"2024-05-07T14:05:50.071134+0000","last_active":"2024-05-07T14:05:50.071032+0000","last_peered":"2024-05-07T14:05:50.071032+0000","last_clean":"2024-05-07T14:05:50.071032+0000","last_became_active":"2024-05-07T14:04:59.451719+0000","last_became_peered":"2024-05-07T14:04:59.451719+0000","last_unstale":"2024-05-07T14:05:50.071032+0000","last_undegraded":"2024-05-07T14:05:50.071032+0000","last_fullsized":"2024-05-07T14:05:50.071032+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:50.070785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:50.070785+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.070785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:57:21.878853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.481574+0000","last_change":"2024-05-07T14:05:37.476888+0000","last_active":"2024-05-07T14:05:38.481574+0000","last_peered":"2024-05-07T14:05:38.481574+0000","last_clean":"2024-05-07T14:05:38.481574+0000","last_became_active":"2024-05-07T14:00:59.998286+0000","last_became_peered":"2024-05-07T14:00:59.998286+0000","last_unstale":"2024-05-07T14:05:38.481574+0000","last_undegraded":"2024-05-07T14:05:38.481574+0000","last_fullsized":"2024-05-07T14:05:38.481574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.476486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.476486+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.476486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:16:03.408284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"148'21","reported_seq":137,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.285587+0000","last_change":"2024-05-07T14:05:47.285587+0000","last_active":"2024-05-07T14:05:47.285587+0000","last_peered":"2024-05-07T14:05:47.285587+0000","last_clean":"2024-05-07T14:05:47.285587+0000","last_became_active":"2024-05-07T14:03:39.664751+0000","last_became_peered":"2024-05-07T14:03:39.664751+0000","last_unstale":"2024-05-07T14:05:47.285587+0000","last_undegraded":"2024-05-07T14:05:47.285587+0000","last_fullsized":"2024-05-07T14:05:47.285587+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'21","last_scrub_stamp":"2024-05-07T14:05:47.285316+0000","last_deep_scrub":"148'21","last_deep_scrub_stamp":"2024-05-07T14:05:47.285316+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.285316+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:41:58.322069+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"146'142","reported_seq":498,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.620137+0000","last_change":"2024-05-07T14:05:38.619420+0000","last_active":"2024-05-07T14:05:38.620137+0000","last_peered":"2024-05-07T14:05:38.620137+0000","last_clean":"2024-05-07T14:05:38.620137+0000","last_became_active":"2024-05-07T14:03:42.707207+0000","last_became_peered":"2024-05-07T14:03:42.707207+0000","last_unstale":"2024-05-07T14:05:38.620137+0000","last_undegraded":"2024-05-07T14:05:38.620137+0000","last_fullsized":"2024-05-07T14:05:38.620137+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'142","last_scrub_stamp":"2024-05-07T14:05:38.619146+0000","last_deep_scrub":"146'142","last_deep_scrub_stamp":"2024-05-07T14:05:38.619146+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.619146+0000","objects_scrubbed":1,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:53.058565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.466213+0000","last_change":"2024-05-07T14:05:50.466272+0000","last_active":"2024-05-07T14:05:50.466213+0000","last_peered":"2024-05-07T14:05:50.466213+0000","last_clean":"2024-05-07T14:05:50.466213+0000","last_became_active":"2024-05-07T14:01:06.369595+0000","last_became_peered":"2024-05-07T14:01:06.369595+0000","last_unstale":"2024-05-07T14:05:50.466213+0000","last_undegraded":"2024-05-07T14:05:50.466213+0000","last_fullsized":"2024-05-07T14:05:50.466213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:50.466014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:50.466014+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.466014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:26:51.233636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"115'4","reported_seq":290,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:17.622856+0000","last_change":"2024-05-07T14:06:17.623000+0000","last_active":"2024-05-07T14:06:17.622856+0000","last_peered":"2024-05-07T14:06:17.622856+0000","last_clean":"2024-05-07T14:06:17.622856+0000","last_became_active":"2024-05-07T14:04:59.446674+0000","last_became_peered":"2024-05-07T14:04:59.446674+0000","last_unstale":"2024-05-07T14:06:17.622856+0000","last_undegraded":"2024-05-07T14:06:17.622856+0000","last_fullsized":"2024-05-07T14:06:17.622856+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'4","last_scrub_stamp":"2024-05-07T14:06:17.622549+0000","last_deep_scrub":"115'4","last_deep_scrub_stamp":"2024-05-07T14:06:17.622549+0000","last_clean_scrub_stamp":"2024-05-07T14:06:17.622549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:34:12.840872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"146'34","reported_seq":330,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:22.651288+0000","last_change":"2024-05-07T14:06:22.651431+0000","last_active":"2024-05-07T14:06:22.651288+0000","last_peered":"2024-05-07T14:06:22.651288+0000","last_clean":"2024-05-07T14:06:22.651288+0000","last_became_active":"2024-05-07T14:04:59.460381+0000","last_became_peered":"2024-05-07T14:04:59.460381+0000","last_unstale":"2024-05-07T14:06:22.651288+0000","last_undegraded":"2024-05-07T14:06:22.651288+0000","last_fullsized":"2024-05-07T14:06:22.651288+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'34","last_scrub_stamp":"2024-05-07T14:06:22.651028+0000","last_deep_scrub":"146'34","last_deep_scrub_stamp":"2024-05-07T14:06:22.651028+0000","last_clean_scrub_stamp":"2024-05-07T14:06:22.651028+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:21:05.472303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":44,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.207861+0000","last_change":"2024-05-07T14:05:39.207861+0000","last_active":"2024-05-07T14:05:39.207861+0000","last_peered":"2024-05-07T14:05:39.207861+0000","last_clean":"2024-05-07T14:05:39.207861+0000","last_became_active":"2024-05-07T14:03:39.671518+0000","last_became_peered":"2024-05-07T14:03:39.671518+0000","last_unstale":"2024-05-07T14:05:39.207861+0000","last_undegraded":"2024-05-07T14:05:39.207861+0000","last_fullsized":"2024-05-07T14:05:39.207861+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:39.207489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:39.207489+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.207489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:38:47.516131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":264,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.698653+0000","last_change":"2024-05-07T14:05:53.698756+0000","last_active":"2024-05-07T14:05:53.698653+0000","last_peered":"2024-05-07T14:05:53.698653+0000","last_clean":"2024-05-07T14:05:53.698653+0000","last_became_active":"2024-05-07T14:01:00.008298+0000","last_became_peered":"2024-05-07T14:01:00.008298+0000","last_unstale":"2024-05-07T14:05:53.698653+0000","last_undegraded":"2024-05-07T14:05:53.698653+0000","last_fullsized":"2024-05-07T14:05:53.698653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:53.698424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:53.698424+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.698424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:14:02.682205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"148'15","reported_seq":280,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:05.703816+0000","last_change":"2024-05-07T14:06:05.703887+0000","last_active":"2024-05-07T14:06:05.703816+0000","last_peered":"2024-05-07T14:06:05.703816+0000","last_clean":"2024-05-07T14:06:05.703816+0000","last_became_active":"2024-05-07T14:01:02.000440+0000","last_became_peered":"2024-05-07T14:01:02.000440+0000","last_unstale":"2024-05-07T14:06:05.703816+0000","last_undegraded":"2024-05-07T14:06:05.703816+0000","last_fullsized":"2024-05-07T14:06:05.703816+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'15","last_scrub_stamp":"2024-05-07T14:06:05.703611+0000","last_deep_scrub":"148'15","last_deep_scrub_stamp":"2024-05-07T14:06:05.703611+0000","last_clean_scrub_stamp":"2024-05-07T14:06:05.703611+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:39:00.069257+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"146'138","reported_seq":493,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.567164+0000","last_change":"2024-05-07T14:06:01.567224+0000","last_active":"2024-05-07T14:06:01.567164+0000","last_peered":"2024-05-07T14:06:01.567164+0000","last_clean":"2024-05-07T14:06:01.567164+0000","last_became_active":"2024-05-07T14:01:04.026199+0000","last_became_peered":"2024-05-07T14:01:04.026199+0000","last_unstale":"2024-05-07T14:06:01.567164+0000","last_undegraded":"2024-05-07T14:06:01.567164+0000","last_fullsized":"2024-05-07T14:06:01.567164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'138","last_scrub_stamp":"2024-05-07T14:06:01.566956+0000","last_deep_scrub":"146'138","last_deep_scrub_stamp":"2024-05-07T14:06:01.566956+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.566956+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:22:14.787756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"81'3","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.860436+0000","last_change":"2024-05-07T14:05:55.860501+0000","last_active":"2024-05-07T14:05:55.860436+0000","last_peered":"2024-05-07T14:05:55.860436+0000","last_clean":"2024-05-07T14:05:55.860436+0000","last_became_active":"2024-05-07T14:01:06.023560+0000","last_became_peered":"2024-05-07T14:01:06.023560+0000","last_unstale":"2024-05-07T14:05:55.860436+0000","last_undegraded":"2024-05-07T14:05:55.860436+0000","last_fullsized":"2024-05-07T14:05:55.860436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-05-07T14:05:55.860237+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-05-07T14:05:55.860237+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.860237+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:38:32.382239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"124'4","reported_seq":285,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.649450+0000","last_change":"2024-05-07T14:05:56.649513+0000","last_active":"2024-05-07T14:05:56.649450+0000","last_peered":"2024-05-07T14:05:56.649450+0000","last_clean":"2024-05-07T14:05:56.649450+0000","last_became_active":"2024-05-07T14:00:57.999575+0000","last_became_peered":"2024-05-07T14:00:57.999575+0000","last_unstale":"2024-05-07T14:05:56.649450+0000","last_undegraded":"2024-05-07T14:05:56.649450+0000","last_fullsized":"2024-05-07T14:05:56.649450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'4","last_scrub_stamp":"2024-05-07T14:05:56.649228+0000","last_deep_scrub":"124'4","last_deep_scrub_stamp":"2024-05-07T14:05:56.649228+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.649228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:21.284356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"146'46","reported_seq":317,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.778168+0000","last_change":"2024-05-07T14:05:58.778227+0000","last_active":"2024-05-07T14:05:58.778168+0000","last_peered":"2024-05-07T14:05:58.778168+0000","last_clean":"2024-05-07T14:05:58.778168+0000","last_became_active":"2024-05-07T14:00:55.968174+0000","last_became_peered":"2024-05-07T14:00:55.968174+0000","last_unstale":"2024-05-07T14:05:58.778168+0000","last_undegraded":"2024-05-07T14:05:58.778168+0000","last_fullsized":"2024-05-07T14:05:58.778168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:05:58.777969+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:05:58.777969+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.777969+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:28.559834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":282,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.520416+0000","last_change":"2024-05-07T14:06:01.520470+0000","last_active":"2024-05-07T14:06:01.520416+0000","last_peered":"2024-05-07T14:06:01.520416+0000","last_clean":"2024-05-07T14:06:01.520416+0000","last_became_active":"2024-05-07T14:04:59.469021+0000","last_became_peered":"2024-05-07T14:04:59.469021+0000","last_unstale":"2024-05-07T14:06:01.520416+0000","last_undegraded":"2024-05-07T14:06:01.520416+0000","last_fullsized":"2024-05-07T14:06:01.520416+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:01.520195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:01.520195+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.520195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:14:10.503976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.519524+0000","last_change":"2024-05-07T14:06:00.519586+0000","last_active":"2024-05-07T14:06:00.519524+0000","last_peered":"2024-05-07T14:06:00.519524+0000","last_clean":"2024-05-07T14:06:00.519524+0000","last_became_active":"2024-05-07T14:00:59.988247+0000","last_became_peered":"2024-05-07T14:00:59.988247+0000","last_unstale":"2024-05-07T14:06:00.519524+0000","last_undegraded":"2024-05-07T14:06:00.519524+0000","last_fullsized":"2024-05-07T14:06:00.519524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:00.519279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:00.519279+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.519279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:29:45.676696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"148'60","reported_seq":328,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.033972+0000","last_change":"2024-05-07T14:05:49.034056+0000","last_active":"2024-05-07T14:05:49.033972+0000","last_peered":"2024-05-07T14:05:49.033972+0000","last_clean":"2024-05-07T14:05:49.033972+0000","last_became_active":"2024-05-07T14:04:59.442492+0000","last_became_peered":"2024-05-07T14:04:59.442492+0000","last_unstale":"2024-05-07T14:05:49.033972+0000","last_undegraded":"2024-05-07T14:05:49.033972+0000","last_fullsized":"2024-05-07T14:05:49.033972+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'60","last_scrub_stamp":"2024-05-07T14:05:49.033759+0000","last_deep_scrub":"148'60","last_deep_scrub_stamp":"2024-05-07T14:05:49.033759+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.033759+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:16:26.253219+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":61,"num_read_kb":279,"num_write":32,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":116761,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":265,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.507426+0000","last_change":"2024-05-07T14:05:47.507486+0000","last_active":"2024-05-07T14:05:47.507426+0000","last_peered":"2024-05-07T14:05:47.507426+0000","last_clean":"2024-05-07T14:05:47.507426+0000","last_became_active":"2024-05-07T14:03:39.664810+0000","last_became_peered":"2024-05-07T14:03:39.664810+0000","last_unstale":"2024-05-07T14:05:47.507426+0000","last_undegraded":"2024-05-07T14:05:47.507426+0000","last_fullsized":"2024-05-07T14:05:47.507426+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:47.507097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:47.507097+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.507097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:36.691906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'3","reported_seq":261,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:09.922437+0000","last_change":"2024-05-07T14:06:09.922499+0000","last_active":"2024-05-07T14:06:09.922437+0000","last_peered":"2024-05-07T14:06:09.922437+0000","last_clean":"2024-05-07T14:06:09.922437+0000","last_became_active":"2024-05-07T14:04:59.464840+0000","last_became_peered":"2024-05-07T14:04:59.464840+0000","last_unstale":"2024-05-07T14:06:09.922437+0000","last_undegraded":"2024-05-07T14:06:09.922437+0000","last_fullsized":"2024-05-07T14:06:09.922437+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-05-07T14:06:09.922230+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-05-07T14:06:09.922230+0000","last_clean_scrub_stamp":"2024-05-07T14:06:09.922230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:35:51.631145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817584+0000","last_change":"2024-05-07T14:05:37.833141+0000","last_active":"2024-05-07T14:05:38.817584+0000","last_peered":"2024-05-07T14:05:38.817584+0000","last_clean":"2024-05-07T14:05:38.817584+0000","last_became_active":"2024-05-07T14:01:06.036503+0000","last_became_peered":"2024-05-07T14:01:06.036503+0000","last_unstale":"2024-05-07T14:05:38.817584+0000","last_undegraded":"2024-05-07T14:05:38.817584+0000","last_fullsized":"2024-05-07T14:05:38.817584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.833020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.833020+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.833020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:01.034811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"87'8","reported_seq":304,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.561068+0000","last_change":"2024-05-07T14:05:45.561131+0000","last_active":"2024-05-07T14:05:45.561068+0000","last_peered":"2024-05-07T14:05:45.561068+0000","last_clean":"2024-05-07T14:05:45.561068+0000","last_became_active":"2024-05-07T14:00:58.006291+0000","last_became_peered":"2024-05-07T14:00:58.006291+0000","last_unstale":"2024-05-07T14:05:45.561068+0000","last_undegraded":"2024-05-07T14:05:45.561068+0000","last_fullsized":"2024-05-07T14:05:45.561068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'8","last_scrub_stamp":"2024-05-07T14:05:45.560869+0000","last_deep_scrub":"87'8","last_deep_scrub_stamp":"2024-05-07T14:05:45.560869+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.560869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:19:10.110570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"146'46","reported_seq":340,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:12.804126+0000","last_change":"2024-05-07T14:06:12.804244+0000","last_active":"2024-05-07T14:06:12.804126+0000","last_peered":"2024-05-07T14:06:12.804126+0000","last_clean":"2024-05-07T14:06:12.804126+0000","last_became_active":"2024-05-07T14:04:59.428245+0000","last_became_peered":"2024-05-07T14:04:59.428245+0000","last_unstale":"2024-05-07T14:06:12.804126+0000","last_undegraded":"2024-05-07T14:06:12.804126+0000","last_fullsized":"2024-05-07T14:06:12.804126+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:06:12.803821+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:06:12.803821+0000","last_clean_scrub_stamp":"2024-05-07T14:06:12.803821+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:56:27.342848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.308208+0000","last_change":"2024-05-07T14:05:56.308312+0000","last_active":"2024-05-07T14:05:56.308208+0000","last_peered":"2024-05-07T14:05:56.308208+0000","last_clean":"2024-05-07T14:05:56.308208+0000","last_became_active":"2024-05-07T14:01:00.001548+0000","last_became_peered":"2024-05-07T14:01:00.001548+0000","last_unstale":"2024-05-07T14:05:56.308208+0000","last_undegraded":"2024-05-07T14:05:56.308208+0000","last_fullsized":"2024-05-07T14:05:56.308208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:56.307973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:56.307973+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.307973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:20.943101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"148'27","reported_seq":298,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.476217+0000","last_change":"2024-05-07T14:05:56.476316+0000","last_active":"2024-05-07T14:05:56.476217+0000","last_peered":"2024-05-07T14:05:56.476217+0000","last_clean":"2024-05-07T14:05:56.476217+0000","last_became_active":"2024-05-07T14:01:02.003815+0000","last_became_peered":"2024-05-07T14:01:02.003815+0000","last_unstale":"2024-05-07T14:05:56.476217+0000","last_undegraded":"2024-05-07T14:05:56.476217+0000","last_fullsized":"2024-05-07T14:05:56.476217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'27","last_scrub_stamp":"2024-05-07T14:05:56.476028+0000","last_deep_scrub":"148'27","last_deep_scrub_stamp":"2024-05-07T14:05:56.476028+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.476028+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:31.469224+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.419916+0000","last_change":"2024-05-07T14:05:55.420057+0000","last_active":"2024-05-07T14:05:55.419916+0000","last_peered":"2024-05-07T14:05:55.419916+0000","last_clean":"2024-05-07T14:05:55.419916+0000","last_became_active":"2024-05-07T14:01:04.022717+0000","last_became_peered":"2024-05-07T14:01:04.022717+0000","last_unstale":"2024-05-07T14:05:55.419916+0000","last_undegraded":"2024-05-07T14:05:55.419916+0000","last_fullsized":"2024-05-07T14:05:55.419916+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:55.419676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:55.419676+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.419676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:03:21.429111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":258,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.482953+0000","last_change":"2024-05-07T14:05:49.483004+0000","last_active":"2024-05-07T14:05:49.482953+0000","last_peered":"2024-05-07T14:05:49.482953+0000","last_clean":"2024-05-07T14:05:49.482953+0000","last_became_active":"2024-05-07T14:04:59.446699+0000","last_became_peered":"2024-05-07T14:04:59.446699+0000","last_unstale":"2024-05-07T14:05:49.482953+0000","last_undegraded":"2024-05-07T14:05:49.482953+0000","last_fullsized":"2024-05-07T14:05:49.482953+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:49.482756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:49.482756+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.482756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:46:17.977501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"115'8","reported_seq":143,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.205253+0000","last_change":"2024-05-07T14:05:45.205253+0000","last_active":"2024-05-07T14:05:45.205253+0000","last_peered":"2024-05-07T14:05:45.205253+0000","last_clean":"2024-05-07T14:05:45.205253+0000","last_became_active":"2024-05-07T14:03:39.663976+0000","last_became_peered":"2024-05-07T14:03:39.663976+0000","last_unstale":"2024-05-07T14:05:45.205253+0000","last_undegraded":"2024-05-07T14:05:45.205253+0000","last_fullsized":"2024-05-07T14:05:45.205253+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'8","last_scrub_stamp":"2024-05-07T14:05:45.204988+0000","last_deep_scrub":"115'8","last_deep_scrub_stamp":"2024-05-07T14:05:45.204988+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.204988+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:48.179740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"146'42","reported_seq":301,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.011371+0000","last_change":"2024-05-07T14:06:03.011429+0000","last_active":"2024-05-07T14:06:03.011371+0000","last_peered":"2024-05-07T14:06:03.011371+0000","last_clean":"2024-05-07T14:06:03.011371+0000","last_became_active":"2024-05-07T14:04:59.445956+0000","last_became_peered":"2024-05-07T14:04:59.445956+0000","last_unstale":"2024-05-07T14:06:03.011371+0000","last_undegraded":"2024-05-07T14:06:03.011371+0000","last_fullsized":"2024-05-07T14:06:03.011371+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'42","last_scrub_stamp":"2024-05-07T14:06:03.011176+0000","last_deep_scrub":"146'42","last_deep_scrub_stamp":"2024-05-07T14:06:03.011176+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.011176+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:01:54.437904+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":263,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:58.512025+0000","last_change":"2024-05-07T14:05:58.512075+0000","last_active":"2024-05-07T14:05:58.512025+0000","last_peered":"2024-05-07T14:05:58.512025+0000","last_clean":"2024-05-07T14:05:58.512025+0000","last_became_active":"2024-05-07T14:01:00.001113+0000","last_became_peered":"2024-05-07T14:01:00.001113+0000","last_unstale":"2024-05-07T14:05:58.512025+0000","last_undegraded":"2024-05-07T14:05:58.512025+0000","last_fullsized":"2024-05-07T14:05:58.512025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:58.511758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:58.511758+0000","last_clean_scrub_stamp":"2024-05-07T14:05:58.511758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:47:57.912640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"148'12","reported_seq":273,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.845888+0000","last_change":"2024-05-07T14:05:43.845956+0000","last_active":"2024-05-07T14:05:43.845888+0000","last_peered":"2024-05-07T14:05:43.845888+0000","last_clean":"2024-05-07T14:05:43.845888+0000","last_became_active":"2024-05-07T14:01:02.003155+0000","last_became_peered":"2024-05-07T14:01:02.003155+0000","last_unstale":"2024-05-07T14:05:43.845888+0000","last_undegraded":"2024-05-07T14:05:43.845888+0000","last_fullsized":"2024-05-07T14:05:43.845888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'12","last_scrub_stamp":"2024-05-07T14:05:43.845686+0000","last_deep_scrub":"148'12","last_deep_scrub_stamp":"2024-05-07T14:05:43.845686+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.845686+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:26.632677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":21,"num_write":38,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5538,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.957426+0000","last_change":"2024-05-07T14:06:00.957526+0000","last_active":"2024-05-07T14:06:00.957426+0000","last_peered":"2024-05-07T14:06:00.957426+0000","last_clean":"2024-05-07T14:06:00.957426+0000","last_became_active":"2024-05-07T14:04:59.444830+0000","last_became_peered":"2024-05-07T14:04:59.444830+0000","last_unstale":"2024-05-07T14:06:00.957426+0000","last_undegraded":"2024-05-07T14:06:00.957426+0000","last_fullsized":"2024-05-07T14:06:00.957426+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:00.957186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:00.957186+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.957186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:05:39.601200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"106'2","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.817153+0000","last_change":"2024-05-07T14:05:38.814609+0000","last_active":"2024-05-07T14:05:38.817153+0000","last_peered":"2024-05-07T14:05:38.817153+0000","last_clean":"2024-05-07T14:05:38.817153+0000","last_became_active":"2024-05-07T14:01:06.027607+0000","last_became_peered":"2024-05-07T14:01:06.027607+0000","last_unstale":"2024-05-07T14:05:38.817153+0000","last_undegraded":"2024-05-07T14:05:38.817153+0000","last_fullsized":"2024-05-07T14:05:38.817153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'2","last_scrub_stamp":"2024-05-07T14:05:38.814267+0000","last_deep_scrub":"106'2","last_deep_scrub_stamp":"2024-05-07T14:05:38.814267+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.814267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:43:19.964109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"81'4","reported_seq":291,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:19.662426+0000","last_change":"2024-05-07T14:06:19.662489+0000","last_active":"2024-05-07T14:06:19.662426+0000","last_peered":"2024-05-07T14:06:19.662426+0000","last_clean":"2024-05-07T14:06:19.662426+0000","last_became_active":"2024-05-07T14:04:59.460037+0000","last_became_peered":"2024-05-07T14:04:59.460037+0000","last_unstale":"2024-05-07T14:06:19.662426+0000","last_undegraded":"2024-05-07T14:06:19.662426+0000","last_fullsized":"2024-05-07T14:06:19.662426+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-05-07T14:06:19.662184+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-05-07T14:06:19.662184+0000","last_clean_scrub_stamp":"2024-05-07T14:06:19.662184+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:15:22.744419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"146'42","reported_seq":340,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:13.938483+0000","last_change":"2024-05-07T14:06:13.938553+0000","last_active":"2024-05-07T14:06:13.938483+0000","last_peered":"2024-05-07T14:06:13.938483+0000","last_clean":"2024-05-07T14:06:13.938483+0000","last_became_active":"2024-05-07T14:04:59.460944+0000","last_became_peered":"2024-05-07T14:04:59.460944+0000","last_unstale":"2024-05-07T14:06:13.938483+0000","last_undegraded":"2024-05-07T14:06:13.938483+0000","last_fullsized":"2024-05-07T14:06:13.938483+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'42","last_scrub_stamp":"2024-05-07T14:06:13.938248+0000","last_deep_scrub":"146'42","last_deep_scrub_stamp":"2024-05-07T14:06:13.938248+0000","last_clean_scrub_stamp":"2024-05-07T14:06:13.938248+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:36:20.866254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.077615+0000","last_change":"2024-05-07T14:05:57.077670+0000","last_active":"2024-05-07T14:05:57.077615+0000","last_peered":"2024-05-07T14:05:57.077615+0000","last_clean":"2024-05-07T14:05:57.077615+0000","last_became_active":"2024-05-07T14:04:59.430654+0000","last_became_peered":"2024-05-07T14:04:59.430654+0000","last_unstale":"2024-05-07T14:05:57.077615+0000","last_undegraded":"2024-05-07T14:05:57.077615+0000","last_fullsized":"2024-05-07T14:05:57.077615+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:57.077420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:57.077420+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.077420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:51:30.724639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"148'28","reported_seq":299,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.476616+0000","last_change":"2024-05-07T14:05:52.476786+0000","last_active":"2024-05-07T14:05:52.476616+0000","last_peered":"2024-05-07T14:05:52.476616+0000","last_clean":"2024-05-07T14:05:52.476616+0000","last_became_active":"2024-05-07T14:01:02.012600+0000","last_became_peered":"2024-05-07T14:01:02.012600+0000","last_unstale":"2024-05-07T14:05:52.476616+0000","last_undegraded":"2024-05-07T14:05:52.476616+0000","last_fullsized":"2024-05-07T14:05:52.476616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'28","last_scrub_stamp":"2024-05-07T14:05:52.476367+0000","last_deep_scrub":"148'28","last_deep_scrub_stamp":"2024-05-07T14:05:52.476367+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.476367+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:55:57.556167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.485049+0000","last_change":"2024-05-07T14:05:43.485049+0000","last_active":"2024-05-07T14:05:43.485049+0000","last_peered":"2024-05-07T14:05:43.485049+0000","last_clean":"2024-05-07T14:05:43.485049+0000","last_became_active":"2024-05-07T14:01:04.018005+0000","last_became_peered":"2024-05-07T14:01:04.018005+0000","last_unstale":"2024-05-07T14:05:43.485049+0000","last_undegraded":"2024-05-07T14:05:43.485049+0000","last_fullsized":"2024-05-07T14:05:43.485049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:43.484792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:43.484792+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.484792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:29:40.976920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":257,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:08.967683+0000","last_change":"2024-05-07T14:06:08.967739+0000","last_active":"2024-05-07T14:06:08.967683+0000","last_peered":"2024-05-07T14:06:08.967683+0000","last_clean":"2024-05-07T14:06:08.967683+0000","last_became_active":"2024-05-07T14:04:59.443620+0000","last_became_peered":"2024-05-07T14:04:59.443620+0000","last_unstale":"2024-05-07T14:06:08.967683+0000","last_undegraded":"2024-05-07T14:06:08.967683+0000","last_fullsized":"2024-05-07T14:06:08.967683+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:08.967468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:08.967468+0000","last_clean_scrub_stamp":"2024-05-07T14:06:08.967468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:37:57.589066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"124'4","reported_seq":108,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.431161+0000","last_change":"2024-05-07T14:05:36.444547+0000","last_active":"2024-05-07T14:05:38.431161+0000","last_peered":"2024-05-07T14:05:38.431161+0000","last_clean":"2024-05-07T14:05:38.431161+0000","last_became_active":"2024-05-07T14:03:52.787675+0000","last_became_peered":"2024-05-07T14:03:52.787675+0000","last_unstale":"2024-05-07T14:05:38.431161+0000","last_undegraded":"2024-05-07T14:05:38.431161+0000","last_fullsized":"2024-05-07T14:05:38.431161+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'4","last_scrub_stamp":"2024-05-07T14:05:36.444446+0000","last_deep_scrub":"124'4","last_deep_scrub_stamp":"2024-05-07T14:05:36.444446+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.444446+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:36:14.354690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"146'48","reported_seq":267,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.897104+0000","last_change":"2024-05-07T14:05:50.897104+0000","last_active":"2024-05-07T14:05:50.897104+0000","last_peered":"2024-05-07T14:05:50.897104+0000","last_clean":"2024-05-07T14:05:50.897104+0000","last_became_active":"2024-05-07T14:01:37.317791+0000","last_became_peered":"2024-05-07T14:01:37.317791+0000","last_unstale":"2024-05-07T14:05:50.897104+0000","last_undegraded":"2024-05-07T14:05:50.897104+0000","last_fullsized":"2024-05-07T14:05:50.897104+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'48","last_scrub_stamp":"2024-05-07T14:05:50.896842+0000","last_deep_scrub":"146'48","last_deep_scrub_stamp":"2024-05-07T14:05:50.896842+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.896842+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:29:48.388971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.545058+0000","last_change":"2024-05-07T14:05:40.545058+0000","last_active":"2024-05-07T14:05:40.545058+0000","last_peered":"2024-05-07T14:05:40.545058+0000","last_clean":"2024-05-07T14:05:40.545058+0000","last_became_active":"2024-05-07T14:00:59.996058+0000","last_became_peered":"2024-05-07T14:00:59.996058+0000","last_unstale":"2024-05-07T14:05:40.545058+0000","last_undegraded":"2024-05-07T14:05:40.545058+0000","last_fullsized":"2024-05-07T14:05:40.545058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:40.544810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:40.544810+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.544810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:24:20.574590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"148'23","reported_seq":272,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:46.000772+0000","last_change":"2024-05-07T14:05:46.000847+0000","last_active":"2024-05-07T14:05:46.000772+0000","last_peered":"2024-05-07T14:05:46.000772+0000","last_clean":"2024-05-07T14:05:46.000772+0000","last_became_active":"2024-05-07T14:04:59.459102+0000","last_became_peered":"2024-05-07T14:04:59.459102+0000","last_unstale":"2024-05-07T14:05:46.000772+0000","last_undegraded":"2024-05-07T14:05:46.000772+0000","last_fullsized":"2024-05-07T14:05:46.000772+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'23","last_scrub_stamp":"2024-05-07T14:05:46.000594+0000","last_deep_scrub":"148'23","last_deep_scrub_stamp":"2024-05-07T14:05:46.000594+0000","last_clean_scrub_stamp":"2024-05-07T14:05:46.000594+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:12:54.187159+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:06.676260+0000","last_change":"2024-05-07T14:06:06.676312+0000","last_active":"2024-05-07T14:06:06.676260+0000","last_peered":"2024-05-07T14:06:06.676260+0000","last_clean":"2024-05-07T14:06:06.676260+0000","last_became_active":"2024-05-07T14:04:59.448594+0000","last_became_peered":"2024-05-07T14:04:59.448594+0000","last_unstale":"2024-05-07T14:06:06.676260+0000","last_undegraded":"2024-05-07T14:06:06.676260+0000","last_fullsized":"2024-05-07T14:06:06.676260+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:06.676064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:06.676064+0000","last_clean_scrub_stamp":"2024-05-07T14:06:06.676064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:49.790047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"115'6","reported_seq":277,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.457812+0000","last_change":"2024-05-07T14:05:44.457873+0000","last_active":"2024-05-07T14:05:44.457812+0000","last_peered":"2024-05-07T14:05:44.457812+0000","last_clean":"2024-05-07T14:05:44.457812+0000","last_became_active":"2024-05-07T14:00:57.988218+0000","last_became_peered":"2024-05-07T14:00:57.988218+0000","last_unstale":"2024-05-07T14:05:44.457812+0000","last_undegraded":"2024-05-07T14:05:44.457812+0000","last_fullsized":"2024-05-07T14:05:44.457812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'6","last_scrub_stamp":"2024-05-07T14:05:44.457606+0000","last_deep_scrub":"115'6","last_deep_scrub_stamp":"2024-05-07T14:05:44.457606+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.457606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:49:01.673952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"146'52","reported_seq":324,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:08.567249+0000","last_change":"2024-05-07T14:06:08.567333+0000","last_active":"2024-05-07T14:06:08.567249+0000","last_peered":"2024-05-07T14:06:08.567249+0000","last_clean":"2024-05-07T14:06:08.567249+0000","last_became_active":"2024-05-07T14:00:55.976530+0000","last_became_peered":"2024-05-07T14:00:55.976530+0000","last_unstale":"2024-05-07T14:06:08.567249+0000","last_undegraded":"2024-05-07T14:06:08.567249+0000","last_fullsized":"2024-05-07T14:06:08.567249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'52","last_scrub_stamp":"2024-05-07T14:06:08.567041+0000","last_deep_scrub":"146'52","last_deep_scrub_stamp":"2024-05-07T14:06:08.567041+0000","last_clean_scrub_stamp":"2024-05-07T14:06:08.567041+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:46:01.051197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":270,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:09.699858+0000","last_change":"2024-05-07T14:06:09.699913+0000","last_active":"2024-05-07T14:06:09.699858+0000","last_peered":"2024-05-07T14:06:09.699858+0000","last_clean":"2024-05-07T14:06:09.699858+0000","last_became_active":"2024-05-07T14:04:59.455608+0000","last_became_peered":"2024-05-07T14:04:59.455608+0000","last_unstale":"2024-05-07T14:06:09.699858+0000","last_undegraded":"2024-05-07T14:06:09.699858+0000","last_fullsized":"2024-05-07T14:06:09.699858+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:09.699648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:09.699648+0000","last_clean_scrub_stamp":"2024-05-07T14:06:09.699648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:37:58.321246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"148'39","reported_seq":316,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.249295+0000","last_change":"2024-05-07T14:05:48.249295+0000","last_active":"2024-05-07T14:05:48.249295+0000","last_peered":"2024-05-07T14:05:48.249295+0000","last_clean":"2024-05-07T14:05:48.249295+0000","last_became_active":"2024-05-07T14:01:02.014519+0000","last_became_peered":"2024-05-07T14:01:02.014519+0000","last_unstale":"2024-05-07T14:05:48.249295+0000","last_undegraded":"2024-05-07T14:05:48.249295+0000","last_fullsized":"2024-05-07T14:05:48.249295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'39","last_scrub_stamp":"2024-05-07T14:05:48.248967+0000","last_deep_scrub":"148'39","last_deep_scrub_stamp":"2024-05-07T14:05:48.248967+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.248967+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:29:11.450758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":265,"num_write":22,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":254,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:57.857125+0000","last_change":"2024-05-07T14:05:57.857125+0000","last_active":"2024-05-07T14:05:57.857125+0000","last_peered":"2024-05-07T14:05:57.857125+0000","last_clean":"2024-05-07T14:05:57.857125+0000","last_became_active":"2024-05-07T14:01:04.025088+0000","last_became_peered":"2024-05-07T14:01:04.025088+0000","last_unstale":"2024-05-07T14:05:57.857125+0000","last_undegraded":"2024-05-07T14:05:57.857125+0000","last_fullsized":"2024-05-07T14:05:57.857125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:57.856658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:57.856658+0000","last_clean_scrub_stamp":"2024-05-07T14:05:57.856658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:29:43.014075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"81'2","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:15.690886+0000","last_change":"2024-05-07T14:06:15.690946+0000","last_active":"2024-05-07T14:06:15.690886+0000","last_peered":"2024-05-07T14:06:15.690886+0000","last_clean":"2024-05-07T14:06:15.690886+0000","last_became_active":"2024-05-07T14:01:06.367969+0000","last_became_peered":"2024-05-07T14:01:06.367969+0000","last_unstale":"2024-05-07T14:06:15.690886+0000","last_undegraded":"2024-05-07T14:06:15.690886+0000","last_fullsized":"2024-05-07T14:06:15.690886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:06:15.690688+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:06:15.690688+0000","last_clean_scrub_stamp":"2024-05-07T14:06:15.690688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:57:11.097821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"115'8","reported_seq":308,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:10.671271+0000","last_change":"2024-05-07T14:06:10.671373+0000","last_active":"2024-05-07T14:06:10.671271+0000","last_peered":"2024-05-07T14:06:10.671271+0000","last_clean":"2024-05-07T14:06:10.671271+0000","last_became_active":"2024-05-07T14:04:59.456492+0000","last_became_peered":"2024-05-07T14:04:59.456492+0000","last_unstale":"2024-05-07T14:06:10.671271+0000","last_undegraded":"2024-05-07T14:06:10.671271+0000","last_fullsized":"2024-05-07T14:06:10.671271+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'8","last_scrub_stamp":"2024-05-07T14:06:10.671067+0000","last_deep_scrub":"115'8","last_deep_scrub_stamp":"2024-05-07T14:06:10.671067+0000","last_clean_scrub_stamp":"2024-05-07T14:06:10.671067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:35:52.379982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"146'44","reported_seq":314,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.201457+0000","last_change":"2024-05-07T14:05:50.201517+0000","last_active":"2024-05-07T14:05:50.201457+0000","last_peered":"2024-05-07T14:05:50.201457+0000","last_clean":"2024-05-07T14:05:50.201457+0000","last_became_active":"2024-05-07T14:00:55.968549+0000","last_became_peered":"2024-05-07T14:00:55.968549+0000","last_unstale":"2024-05-07T14:05:50.201457+0000","last_undegraded":"2024-05-07T14:05:50.201457+0000","last_fullsized":"2024-05-07T14:05:50.201457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'44","last_scrub_stamp":"2024-05-07T14:05:50.201259+0000","last_deep_scrub":"146'44","last_deep_scrub_stamp":"2024-05-07T14:05:50.201259+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.201259+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:07:00.801081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.481649+0000","last_change":"2024-05-07T14:05:38.478809+0000","last_active":"2024-05-07T14:05:38.481649+0000","last_peered":"2024-05-07T14:05:38.481649+0000","last_clean":"2024-05-07T14:05:38.481649+0000","last_became_active":"2024-05-07T14:00:59.996376+0000","last_became_peered":"2024-05-07T14:00:59.996376+0000","last_unstale":"2024-05-07T14:05:38.481649+0000","last_undegraded":"2024-05-07T14:05:38.481649+0000","last_fullsized":"2024-05-07T14:05:38.481649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:38.478574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:38.478574+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.478574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:16:37.999538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"148'32","reported_seq":284,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.033194+0000","last_change":"2024-05-07T14:05:59.033277+0000","last_active":"2024-05-07T14:05:59.033194+0000","last_peered":"2024-05-07T14:05:59.033194+0000","last_clean":"2024-05-07T14:05:59.033194+0000","last_became_active":"2024-05-07T14:04:59.439603+0000","last_became_peered":"2024-05-07T14:04:59.439603+0000","last_unstale":"2024-05-07T14:05:59.033194+0000","last_undegraded":"2024-05-07T14:05:59.033194+0000","last_fullsized":"2024-05-07T14:05:59.033194+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'32","last_scrub_stamp":"2024-05-07T14:05:59.033002+0000","last_deep_scrub":"148'32","last_deep_scrub_stamp":"2024-05-07T14:05:59.033002+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.033002+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:37:03.416302+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.442281+0000","last_change":"2024-05-07T14:05:37.201385+0000","last_active":"2024-05-07T14:05:38.442281+0000","last_peered":"2024-05-07T14:05:38.442281+0000","last_clean":"2024-05-07T14:05:38.442281+0000","last_became_active":"2024-05-07T14:03:39.666888+0000","last_became_peered":"2024-05-07T14:03:39.666888+0000","last_unstale":"2024-05-07T14:05:38.442281+0000","last_undegraded":"2024-05-07T14:05:38.442281+0000","last_fullsized":"2024-05-07T14:05:38.442281+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.201219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.201219+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.201219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:06.409925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":257,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.545142+0000","last_change":"2024-05-07T14:05:59.545196+0000","last_active":"2024-05-07T14:05:59.545142+0000","last_peered":"2024-05-07T14:05:59.545142+0000","last_clean":"2024-05-07T14:05:59.545142+0000","last_became_active":"2024-05-07T14:04:59.455373+0000","last_became_peered":"2024-05-07T14:04:59.455373+0000","last_unstale":"2024-05-07T14:05:59.545142+0000","last_undegraded":"2024-05-07T14:05:59.545142+0000","last_fullsized":"2024-05-07T14:05:59.545142+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:59.544944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:59.544944+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.544944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:47:38.230988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"81'4","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:02.600528+0000","last_change":"2024-05-07T14:06:02.600586+0000","last_active":"2024-05-07T14:06:02.600528+0000","last_peered":"2024-05-07T14:06:02.600528+0000","last_clean":"2024-05-07T14:06:02.600528+0000","last_became_active":"2024-05-07T14:00:57.987674+0000","last_became_peered":"2024-05-07T14:00:57.987674+0000","last_unstale":"2024-05-07T14:06:02.600528+0000","last_undegraded":"2024-05-07T14:06:02.600528+0000","last_fullsized":"2024-05-07T14:06:02.600528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-05-07T14:06:02.600288+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-05-07T14:06:02.600288+0000","last_clean_scrub_stamp":"2024-05-07T14:06:02.600288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:27:50.562590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"146'54","reported_seq":326,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.624309+0000","last_change":"2024-05-07T14:05:59.624373+0000","last_active":"2024-05-07T14:05:59.624309+0000","last_peered":"2024-05-07T14:05:59.624309+0000","last_clean":"2024-05-07T14:05:59.624309+0000","last_became_active":"2024-05-07T14:00:55.976847+0000","last_became_peered":"2024-05-07T14:00:55.976847+0000","last_unstale":"2024-05-07T14:05:59.624309+0000","last_undegraded":"2024-05-07T14:05:59.624309+0000","last_fullsized":"2024-05-07T14:05:59.624309+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:05:59.624075+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:05:59.624075+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.624075+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:11:34.365597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":264,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.691568+0000","last_change":"2024-05-07T14:05:49.691568+0000","last_active":"2024-05-07T14:05:49.691568+0000","last_peered":"2024-05-07T14:05:49.691568+0000","last_clean":"2024-05-07T14:05:49.691568+0000","last_became_active":"2024-05-07T14:01:00.004252+0000","last_became_peered":"2024-05-07T14:01:00.004252+0000","last_unstale":"2024-05-07T14:05:49.691568+0000","last_undegraded":"2024-05-07T14:05:49.691568+0000","last_fullsized":"2024-05-07T14:05:49.691568+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:49.691319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:49.691319+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.691319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:17:26.349257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"148'26","reported_seq":297,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.488875+0000","last_change":"2024-05-07T14:05:53.488960+0000","last_active":"2024-05-07T14:05:53.488875+0000","last_peered":"2024-05-07T14:05:53.488875+0000","last_clean":"2024-05-07T14:05:53.488875+0000","last_became_active":"2024-05-07T14:01:02.147836+0000","last_became_peered":"2024-05-07T14:01:02.147836+0000","last_unstale":"2024-05-07T14:05:53.488875+0000","last_undegraded":"2024-05-07T14:05:53.488875+0000","last_fullsized":"2024-05-07T14:05:53.488875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'26","last_scrub_stamp":"2024-05-07T14:05:53.488692+0000","last_deep_scrub":"148'26","last_deep_scrub_stamp":"2024-05-07T14:05:53.488692+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.488692+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:16.144965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.443659+0000","last_change":"2024-05-07T14:05:38.238816+0000","last_active":"2024-05-07T14:05:38.443659+0000","last_peered":"2024-05-07T14:05:38.443659+0000","last_clean":"2024-05-07T14:05:38.443659+0000","last_became_active":"2024-05-07T14:03:39.663569+0000","last_became_peered":"2024-05-07T14:03:39.663569+0000","last_unstale":"2024-05-07T14:05:38.443659+0000","last_undegraded":"2024-05-07T14:05:38.443659+0000","last_fullsized":"2024-05-07T14:05:38.443659+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:38.238679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:38.238679+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.238679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:15:04.203961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":257,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.619962+0000","last_change":"2024-05-07T14:05:37.626705+0000","last_active":"2024-05-07T14:05:38.619962+0000","last_peered":"2024-05-07T14:05:38.619962+0000","last_clean":"2024-05-07T14:05:38.619962+0000","last_became_active":"2024-05-07T14:04:59.447025+0000","last_became_peered":"2024-05-07T14:04:59.447025+0000","last_unstale":"2024-05-07T14:05:38.619962+0000","last_undegraded":"2024-05-07T14:05:38.619962+0000","last_fullsized":"2024-05-07T14:05:38.619962+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:37.626305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:37.626305+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.626305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:44:22.857038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"124'14","reported_seq":312,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:43.927389+0000","last_change":"2024-05-07T14:05:43.927389+0000","last_active":"2024-05-07T14:05:43.927389+0000","last_peered":"2024-05-07T14:05:43.927389+0000","last_clean":"2024-05-07T14:05:43.927389+0000","last_became_active":"2024-05-07T14:00:57.996281+0000","last_became_peered":"2024-05-07T14:00:57.996281+0000","last_unstale":"2024-05-07T14:05:43.927389+0000","last_undegraded":"2024-05-07T14:05:43.927389+0000","last_fullsized":"2024-05-07T14:05:43.927389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'14","last_scrub_stamp":"2024-05-07T14:05:43.927105+0000","last_deep_scrub":"124'14","last_deep_scrub_stamp":"2024-05-07T14:05:43.927105+0000","last_clean_scrub_stamp":"2024-05-07T14:05:43.927105+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:35:13.144108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"146'40","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.725248+0000","last_change":"2024-05-07T14:06:01.725305+0000","last_active":"2024-05-07T14:06:01.725248+0000","last_peered":"2024-05-07T14:06:01.725248+0000","last_clean":"2024-05-07T14:06:01.725248+0000","last_became_active":"2024-05-07T14:00:55.977876+0000","last_became_peered":"2024-05-07T14:00:55.977876+0000","last_unstale":"2024-05-07T14:06:01.725248+0000","last_undegraded":"2024-05-07T14:06:01.725248+0000","last_fullsized":"2024-05-07T14:06:01.725248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'40","last_scrub_stamp":"2024-05-07T14:06:01.725057+0000","last_deep_scrub":"146'40","last_deep_scrub_stamp":"2024-05-07T14:06:01.725057+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.725057+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:56:16.264084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:55.268579+0000","last_change":"2024-05-07T14:05:55.268579+0000","last_active":"2024-05-07T14:05:55.268579+0000","last_peered":"2024-05-07T14:05:55.268579+0000","last_clean":"2024-05-07T14:05:55.268579+0000","last_became_active":"2024-05-07T14:00:59.996334+0000","last_became_peered":"2024-05-07T14:00:59.996334+0000","last_unstale":"2024-05-07T14:05:55.268579+0000","last_undegraded":"2024-05-07T14:05:55.268579+0000","last_fullsized":"2024-05-07T14:05:55.268579+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:55.268317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:55.268317+0000","last_clean_scrub_stamp":"2024-05-07T14:05:55.268317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:12:41.367324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"148'15","reported_seq":280,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.613898+0000","last_change":"2024-05-07T14:05:38.614039+0000","last_active":"2024-05-07T14:05:38.613898+0000","last_peered":"2024-05-07T14:05:38.613898+0000","last_clean":"2024-05-07T14:05:38.613898+0000","last_became_active":"2024-05-07T14:01:02.147258+0000","last_became_peered":"2024-05-07T14:01:02.147258+0000","last_unstale":"2024-05-07T14:05:38.613898+0000","last_undegraded":"2024-05-07T14:05:38.613898+0000","last_fullsized":"2024-05-07T14:05:38.613898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'15","last_scrub_stamp":"2024-05-07T14:05:38.613662+0000","last_deep_scrub":"148'15","last_deep_scrub_stamp":"2024-05-07T14:05:38.613662+0000","last_clean_scrub_stamp":"2024-05-07T14:05:38.613662+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:07.822368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"146'138","reported_seq":522,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.542933+0000","last_change":"2024-05-07T14:05:41.543002+0000","last_active":"2024-05-07T14:05:41.542933+0000","last_peered":"2024-05-07T14:05:41.542933+0000","last_clean":"2024-05-07T14:05:41.542933+0000","last_became_active":"2024-05-07T14:01:04.016926+0000","last_became_peered":"2024-05-07T14:01:04.016926+0000","last_unstale":"2024-05-07T14:05:41.542933+0000","last_undegraded":"2024-05-07T14:05:41.542933+0000","last_fullsized":"2024-05-07T14:05:41.542933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'138","last_scrub_stamp":"2024-05-07T14:05:41.542673+0000","last_deep_scrub":"146'138","last_deep_scrub_stamp":"2024-05-07T14:05:41.542673+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.542673+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:59:42.861721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"81'7","reported_seq":174,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.048791+0000","last_change":"2024-05-07T14:05:54.048853+0000","last_active":"2024-05-07T14:05:54.048791+0000","last_peered":"2024-05-07T14:05:54.048791+0000","last_clean":"2024-05-07T14:05:54.048791+0000","last_became_active":"2024-05-07T14:04:59.444580+0000","last_became_peered":"2024-05-07T14:04:59.444580+0000","last_unstale":"2024-05-07T14:05:54.048791+0000","last_undegraded":"2024-05-07T14:05:54.048791+0000","last_fullsized":"2024-05-07T14:05:54.048791+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'7","last_scrub_stamp":"2024-05-07T14:05:54.048591+0000","last_deep_scrub":"81'7","last_deep_scrub_stamp":"2024-05-07T14:05:54.048591+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.048591+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:39:46.109066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":16,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"124'8","reported_seq":303,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:04.722821+0000","last_change":"2024-05-07T14:06:04.722905+0000","last_active":"2024-05-07T14:06:04.722821+0000","last_peered":"2024-05-07T14:06:04.722821+0000","last_clean":"2024-05-07T14:06:04.722821+0000","last_became_active":"2024-05-07T14:00:57.999486+0000","last_became_peered":"2024-05-07T14:00:57.999486+0000","last_unstale":"2024-05-07T14:06:04.722821+0000","last_undegraded":"2024-05-07T14:06:04.722821+0000","last_fullsized":"2024-05-07T14:06:04.722821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'8","last_scrub_stamp":"2024-05-07T14:06:04.722616+0000","last_deep_scrub":"124'8","last_deep_scrub_stamp":"2024-05-07T14:06:04.722616+0000","last_clean_scrub_stamp":"2024-05-07T14:06:04.722616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:20.402218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"146'40","reported_seq":310,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.841863+0000","last_change":"2024-05-07T14:05:56.841863+0000","last_active":"2024-05-07T14:05:56.841863+0000","last_peered":"2024-05-07T14:05:56.841863+0000","last_clean":"2024-05-07T14:05:56.841863+0000","last_became_active":"2024-05-07T14:00:56.010531+0000","last_became_peered":"2024-05-07T14:00:56.010531+0000","last_unstale":"2024-05-07T14:05:56.841863+0000","last_undegraded":"2024-05-07T14:05:56.841863+0000","last_fullsized":"2024-05-07T14:05:56.841863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'40","last_scrub_stamp":"2024-05-07T14:05:56.841574+0000","last_deep_scrub":"146'40","last_deep_scrub_stamp":"2024-05-07T14:05:56.841574+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.841574+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:54:26.623439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":230,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.099350+0000","last_change":"2024-05-07T14:05:56.099401+0000","last_active":"2024-05-07T14:05:56.099350+0000","last_peered":"2024-05-07T14:05:56.099350+0000","last_clean":"2024-05-07T14:05:56.099350+0000","last_became_active":"2024-05-07T14:04:59.421636+0000","last_became_peered":"2024-05-07T14:04:59.421636+0000","last_unstale":"2024-05-07T14:05:56.099350+0000","last_undegraded":"2024-05-07T14:05:56.099350+0000","last_fullsized":"2024-05-07T14:05:56.099350+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:56.099165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:56.099165+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.099165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:23:22.405401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"148'32","reported_seq":304,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.912105+0000","last_change":"2024-05-07T14:05:53.912191+0000","last_active":"2024-05-07T14:05:53.912105+0000","last_peered":"2024-05-07T14:05:53.912105+0000","last_clean":"2024-05-07T14:05:53.912105+0000","last_became_active":"2024-05-07T14:01:02.013701+0000","last_became_peered":"2024-05-07T14:01:02.013701+0000","last_unstale":"2024-05-07T14:05:53.912105+0000","last_undegraded":"2024-05-07T14:05:53.912105+0000","last_fullsized":"2024-05-07T14:05:53.912105+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'32","last_scrub_stamp":"2024-05-07T14:05:53.911918+0000","last_deep_scrub":"148'32","last_deep_scrub_stamp":"2024-05-07T14:05:53.911918+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.911918+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:28.905114+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:51.824280+0000","last_change":"2024-05-07T14:05:51.824280+0000","last_active":"2024-05-07T14:05:51.824280+0000","last_peered":"2024-05-07T14:05:51.824280+0000","last_clean":"2024-05-07T14:05:51.824280+0000","last_became_active":"2024-05-07T14:01:04.011820+0000","last_became_peered":"2024-05-07T14:01:04.011820+0000","last_unstale":"2024-05-07T14:05:51.824280+0000","last_undegraded":"2024-05-07T14:05:51.824280+0000","last_fullsized":"2024-05-07T14:05:51.824280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:51.824017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:51.824017+0000","last_clean_scrub_stamp":"2024-05-07T14:05:51.824017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:29.249577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"124'7","reported_seq":170,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:09.940667+0000","last_change":"2024-05-07T14:06:09.940725+0000","last_active":"2024-05-07T14:06:09.940667+0000","last_peered":"2024-05-07T14:06:09.940667+0000","last_clean":"2024-05-07T14:06:09.940667+0000","last_became_active":"2024-05-07T14:04:59.467712+0000","last_became_peered":"2024-05-07T14:04:59.467712+0000","last_unstale":"2024-05-07T14:06:09.940667+0000","last_undegraded":"2024-05-07T14:06:09.940667+0000","last_fullsized":"2024-05-07T14:06:09.940667+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'7","last_scrub_stamp":"2024-05-07T14:06:09.940469+0000","last_deep_scrub":"124'7","last_deep_scrub_stamp":"2024-05-07T14:06:09.940469+0000","last_clean_scrub_stamp":"2024-05-07T14:06:09.940469+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:14:09.680319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"115'2","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.653939+0000","last_change":"2024-05-07T14:05:48.653939+0000","last_active":"2024-05-07T14:05:48.653939+0000","last_peered":"2024-05-07T14:05:48.653939+0000","last_clean":"2024-05-07T14:05:48.653939+0000","last_became_active":"2024-05-07T14:00:58.002590+0000","last_became_peered":"2024-05-07T14:00:58.002590+0000","last_unstale":"2024-05-07T14:05:48.653939+0000","last_undegraded":"2024-05-07T14:05:48.653939+0000","last_fullsized":"2024-05-07T14:05:48.653939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'2","last_scrub_stamp":"2024-05-07T14:05:48.653679+0000","last_deep_scrub":"115'2","last_deep_scrub_stamp":"2024-05-07T14:05:48.653679+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.653679+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:37:44.088893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"146'50","reported_seq":321,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:05.919924+0000","last_change":"2024-05-07T14:06:05.919991+0000","last_active":"2024-05-07T14:06:05.919924+0000","last_peered":"2024-05-07T14:06:05.919924+0000","last_clean":"2024-05-07T14:06:05.919924+0000","last_became_active":"2024-05-07T14:00:56.001743+0000","last_became_peered":"2024-05-07T14:00:56.001743+0000","last_unstale":"2024-05-07T14:06:05.919924+0000","last_undegraded":"2024-05-07T14:06:05.919924+0000","last_fullsized":"2024-05-07T14:06:05.919924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'50","last_scrub_stamp":"2024-05-07T14:06:05.919717+0000","last_deep_scrub":"146'50","last_deep_scrub_stamp":"2024-05-07T14:06:05.919717+0000","last_clean_scrub_stamp":"2024-05-07T14:06:05.919717+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:04:49.033699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":262,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.701255+0000","last_change":"2024-05-07T14:05:44.701255+0000","last_active":"2024-05-07T14:05:44.701255+0000","last_peered":"2024-05-07T14:05:44.701255+0000","last_clean":"2024-05-07T14:05:44.701255+0000","last_became_active":"2024-05-07T14:00:59.999975+0000","last_became_peered":"2024-05-07T14:00:59.999975+0000","last_unstale":"2024-05-07T14:05:44.701255+0000","last_undegraded":"2024-05-07T14:05:44.701255+0000","last_fullsized":"2024-05-07T14:05:44.701255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:44.700991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:44.700991+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.700991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:59:33.885801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"148'23","reported_seq":293,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:45.859633+0000","last_change":"2024-05-07T14:05:45.859633+0000","last_active":"2024-05-07T14:05:45.859633+0000","last_peered":"2024-05-07T14:05:45.859633+0000","last_clean":"2024-05-07T14:05:45.859633+0000","last_became_active":"2024-05-07T14:01:02.012962+0000","last_became_peered":"2024-05-07T14:01:02.012962+0000","last_unstale":"2024-05-07T14:05:45.859633+0000","last_undegraded":"2024-05-07T14:05:45.859633+0000","last_fullsized":"2024-05-07T14:05:45.859633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'23","last_scrub_stamp":"2024-05-07T14:05:45.859366+0000","last_deep_scrub":"148'23","last_deep_scrub_stamp":"2024-05-07T14:05:45.859366+0000","last_clean_scrub_stamp":"2024-05-07T14:05:45.859366+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:46:10.494494+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":261,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.530458+0000","last_change":"2024-05-07T14:06:00.530523+0000","last_active":"2024-05-07T14:06:00.530458+0000","last_peered":"2024-05-07T14:06:00.530458+0000","last_clean":"2024-05-07T14:06:00.530458+0000","last_became_active":"2024-05-07T14:04:59.465509+0000","last_became_peered":"2024-05-07T14:04:59.465509+0000","last_unstale":"2024-05-07T14:06:00.530458+0000","last_undegraded":"2024-05-07T14:06:00.530458+0000","last_fullsized":"2024-05-07T14:06:00.530458+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:00.530260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:00.530260+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.530260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T00:53:59.956590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.489035+0000","last_change":"2024-05-07T14:05:48.489035+0000","last_active":"2024-05-07T14:05:48.489035+0000","last_peered":"2024-05-07T14:05:48.489035+0000","last_clean":"2024-05-07T14:05:48.489035+0000","last_became_active":"2024-05-07T14:01:06.371409+0000","last_became_peered":"2024-05-07T14:01:06.371409+0000","last_unstale":"2024-05-07T14:05:48.489035+0000","last_undegraded":"2024-05-07T14:05:48.489035+0000","last_fullsized":"2024-05-07T14:05:48.489035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:48.488773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:48.488773+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.488773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:08:22.867351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"87'6","reported_seq":292,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:06.532076+0000","last_change":"2024-05-07T14:06:06.532138+0000","last_active":"2024-05-07T14:06:06.532076+0000","last_peered":"2024-05-07T14:06:06.532076+0000","last_clean":"2024-05-07T14:06:06.532076+0000","last_became_active":"2024-05-07T14:00:57.978120+0000","last_became_peered":"2024-05-07T14:00:57.978120+0000","last_unstale":"2024-05-07T14:06:06.532076+0000","last_undegraded":"2024-05-07T14:06:06.532076+0000","last_fullsized":"2024-05-07T14:06:06.532076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'6","last_scrub_stamp":"2024-05-07T14:06:06.531865+0000","last_deep_scrub":"87'6","last_deep_scrub_stamp":"2024-05-07T14:06:06.531865+0000","last_clean_scrub_stamp":"2024-05-07T14:06:06.531865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:50:02.575674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"146'38","reported_seq":309,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:10.591021+0000","last_change":"2024-05-07T14:06:10.591084+0000","last_active":"2024-05-07T14:06:10.591021+0000","last_peered":"2024-05-07T14:06:10.591021+0000","last_clean":"2024-05-07T14:06:10.591021+0000","last_became_active":"2024-05-07T14:00:55.977991+0000","last_became_peered":"2024-05-07T14:00:55.977991+0000","last_unstale":"2024-05-07T14:06:10.591021+0000","last_undegraded":"2024-05-07T14:06:10.591021+0000","last_fullsized":"2024-05-07T14:06:10.591021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'38","last_scrub_stamp":"2024-05-07T14:06:10.590818+0000","last_deep_scrub":"146'38","last_deep_scrub_stamp":"2024-05-07T14:06:10.590818+0000","last_clean_scrub_stamp":"2024-05-07T14:06:10.590818+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:53:52.898851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":264,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:47.624574+0000","last_change":"2024-05-07T14:05:47.624574+0000","last_active":"2024-05-07T14:05:47.624574+0000","last_peered":"2024-05-07T14:05:47.624574+0000","last_clean":"2024-05-07T14:05:47.624574+0000","last_became_active":"2024-05-07T14:01:00.000007+0000","last_became_peered":"2024-05-07T14:01:00.000007+0000","last_unstale":"2024-05-07T14:05:47.624574+0000","last_undegraded":"2024-05-07T14:05:47.624574+0000","last_fullsized":"2024-05-07T14:05:47.624574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:47.624325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:47.624325+0000","last_clean_scrub_stamp":"2024-05-07T14:05:47.624325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:43:41.740511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"148'18","reported_seq":294,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:20.681911+0000","last_change":"2024-05-07T14:06:20.681985+0000","last_active":"2024-05-07T14:06:20.681911+0000","last_peered":"2024-05-07T14:06:20.681911+0000","last_clean":"2024-05-07T14:06:20.681911+0000","last_became_active":"2024-05-07T14:04:59.459963+0000","last_became_peered":"2024-05-07T14:04:59.459963+0000","last_unstale":"2024-05-07T14:06:20.681911+0000","last_undegraded":"2024-05-07T14:06:20.681911+0000","last_fullsized":"2024-05-07T14:06:20.681911+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'18","last_scrub_stamp":"2024-05-07T14:06:20.681717+0000","last_deep_scrub":"148'18","last_deep_scrub_stamp":"2024-05-07T14:06:20.681717+0000","last_clean_scrub_stamp":"2024-05-07T14:06:20.681717+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:14:09.953847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":256,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.426623+0000","last_change":"2024-05-07T14:05:36.573639+0000","last_active":"2024-05-07T14:05:38.426623+0000","last_peered":"2024-05-07T14:05:38.426623+0000","last_clean":"2024-05-07T14:05:38.426623+0000","last_became_active":"2024-05-07T14:01:04.012414+0000","last_became_peered":"2024-05-07T14:01:04.012414+0000","last_unstale":"2024-05-07T14:05:38.426623+0000","last_undegraded":"2024-05-07T14:05:38.426623+0000","last_fullsized":"2024-05-07T14:05:38.426623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:36.573247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:36.573247+0000","last_clean_scrub_stamp":"2024-05-07T14:05:36.573247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:29:34.065375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"81'8","reported_seq":235,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:39.000527+0000","last_change":"2024-05-07T14:05:39.000586+0000","last_active":"2024-05-07T14:05:39.000527+0000","last_peered":"2024-05-07T14:05:39.000527+0000","last_clean":"2024-05-07T14:05:39.000527+0000","last_became_active":"2024-05-07T14:04:59.456842+0000","last_became_peered":"2024-05-07T14:04:59.456842+0000","last_unstale":"2024-05-07T14:05:39.000527+0000","last_undegraded":"2024-05-07T14:05:39.000527+0000","last_fullsized":"2024-05-07T14:05:39.000527+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-05-07T14:05:39.000323+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-05-07T14:05:39.000323+0000","last_clean_scrub_stamp":"2024-05-07T14:05:39.000323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:29:10.124568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"115'10","reported_seq":308,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:02.652829+0000","last_change":"2024-05-07T14:06:02.652887+0000","last_active":"2024-05-07T14:06:02.652829+0000","last_peered":"2024-05-07T14:06:02.652829+0000","last_clean":"2024-05-07T14:06:02.652829+0000","last_became_active":"2024-05-07T14:00:57.994574+0000","last_became_peered":"2024-05-07T14:00:57.994574+0000","last_unstale":"2024-05-07T14:06:02.652829+0000","last_undegraded":"2024-05-07T14:06:02.652829+0000","last_fullsized":"2024-05-07T14:06:02.652829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'10","last_scrub_stamp":"2024-05-07T14:06:02.652618+0000","last_deep_scrub":"115'10","last_deep_scrub_stamp":"2024-05-07T14:06:02.652618+0000","last_clean_scrub_stamp":"2024-05-07T14:06:02.652618+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:38:40.078178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"146'44","reported_seq":320,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.818253+0000","last_change":"2024-05-07T14:05:34.912199+0000","last_active":"2024-05-07T14:05:38.818253+0000","last_peered":"2024-05-07T14:05:38.818253+0000","last_clean":"2024-05-07T14:05:38.818253+0000","last_became_active":"2024-05-07T14:01:37.553325+0000","last_became_peered":"2024-05-07T14:01:37.553325+0000","last_unstale":"2024-05-07T14:05:38.818253+0000","last_undegraded":"2024-05-07T14:05:38.818253+0000","last_fullsized":"2024-05-07T14:05:38.818253+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'44","last_scrub_stamp":"2024-05-07T14:05:34.912082+0000","last_deep_scrub":"146'44","last_deep_scrub_stamp":"2024-05-07T14:05:34.912082+0000","last_clean_scrub_stamp":"2024-05-07T14:05:34.912082+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:07:37.886834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"148'2","reported_seq":119,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.174020+0000","last_change":"2024-05-07T14:05:41.174020+0000","last_active":"2024-05-07T14:05:41.174020+0000","last_peered":"2024-05-07T14:05:41.174020+0000","last_clean":"2024-05-07T14:05:41.174020+0000","last_became_active":"2024-05-07T14:03:39.659887+0000","last_became_peered":"2024-05-07T14:03:39.659887+0000","last_unstale":"2024-05-07T14:05:41.174020+0000","last_undegraded":"2024-05-07T14:05:41.174020+0000","last_fullsized":"2024-05-07T14:05:41.174020+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'2","last_scrub_stamp":"2024-05-07T14:05:41.173764+0000","last_deep_scrub":"148'2","last_deep_scrub_stamp":"2024-05-07T14:05:41.173764+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.173764+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:50.492880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"148'23","reported_seq":294,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.595078+0000","last_change":"2024-05-07T14:05:40.595078+0000","last_active":"2024-05-07T14:05:40.595078+0000","last_peered":"2024-05-07T14:05:40.595078+0000","last_clean":"2024-05-07T14:05:40.595078+0000","last_became_active":"2024-05-07T14:01:02.003907+0000","last_became_peered":"2024-05-07T14:01:02.003907+0000","last_unstale":"2024-05-07T14:05:40.595078+0000","last_undegraded":"2024-05-07T14:05:40.595078+0000","last_fullsized":"2024-05-07T14:05:40.595078+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"148'23","last_scrub_stamp":"2024-05-07T14:05:40.594787+0000","last_deep_scrub":"148'23","last_deep_scrub_stamp":"2024-05-07T14:05:40.594787+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.594787+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:38:48.903429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":255,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:49.790915+0000","last_change":"2024-05-07T14:05:49.790915+0000","last_active":"2024-05-07T14:05:49.790915+0000","last_peered":"2024-05-07T14:05:49.790915+0000","last_clean":"2024-05-07T14:05:49.790915+0000","last_became_active":"2024-05-07T14:01:04.006698+0000","last_became_peered":"2024-05-07T14:01:04.006698+0000","last_unstale":"2024-05-07T14:05:49.790915+0000","last_undegraded":"2024-05-07T14:05:49.790915+0000","last_fullsized":"2024-05-07T14:05:49.790915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:49.790525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:49.790525+0000","last_clean_scrub_stamp":"2024-05-07T14:05:49.790525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:41:50.118541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":252,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:08.741907+0000","last_change":"2024-05-07T14:06:08.741966+0000","last_active":"2024-05-07T14:06:08.741907+0000","last_peered":"2024-05-07T14:06:08.741907+0000","last_clean":"2024-05-07T14:06:08.741907+0000","last_became_active":"2024-05-07T14:01:06.027489+0000","last_became_peered":"2024-05-07T14:01:06.027489+0000","last_unstale":"2024-05-07T14:06:08.741907+0000","last_undegraded":"2024-05-07T14:06:08.741907+0000","last_fullsized":"2024-05-07T14:06:08.741907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:06:08.741704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:06:08.741704+0000","last_clean_scrub_stamp":"2024-05-07T14:06:08.741704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:51:32.889028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"87'16","reported_seq":124,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.217638+0000","last_change":"2024-05-07T14:06:00.217698+0000","last_active":"2024-05-07T14:06:00.217638+0000","last_peered":"2024-05-07T14:06:00.217638+0000","last_clean":"2024-05-07T14:06:00.217638+0000","last_became_active":"2024-05-07T14:03:39.671068+0000","last_became_peered":"2024-05-07T14:03:39.671068+0000","last_unstale":"2024-05-07T14:06:00.217638+0000","last_undegraded":"2024-05-07T14:06:00.217638+0000","last_fullsized":"2024-05-07T14:06:00.217638+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'16","last_scrub_stamp":"2024-05-07T14:06:00.217433+0000","last_deep_scrub":"87'16","last_deep_scrub_stamp":"2024-05-07T14:06:00.217433+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.217433+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:42:00.545449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":58,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"146'44","reported_seq":314,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:48.440941+0000","last_change":"2024-05-07T14:05:48.441055+0000","last_active":"2024-05-07T14:05:48.440941+0000","last_peered":"2024-05-07T14:05:48.440941+0000","last_clean":"2024-05-07T14:05:48.440941+0000","last_became_active":"2024-05-07T14:00:55.977429+0000","last_became_peered":"2024-05-07T14:00:55.977429+0000","last_unstale":"2024-05-07T14:05:48.440941+0000","last_undegraded":"2024-05-07T14:05:48.440941+0000","last_fullsized":"2024-05-07T14:05:48.440941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'44","last_scrub_stamp":"2024-05-07T14:05:48.440708+0000","last_deep_scrub":"146'44","last_deep_scrub_stamp":"2024-05-07T14:05:48.440708+0000","last_clean_scrub_stamp":"2024-05-07T14:05:48.440708+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:44.233012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":88064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":114,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.157085+0000","last_change":"2024-05-07T14:05:40.157085+0000","last_active":"2024-05-07T14:05:40.157085+0000","last_peered":"2024-05-07T14:05:40.157085+0000","last_clean":"2024-05-07T14:05:40.157085+0000","last_became_active":"2024-05-07T14:03:39.661339+0000","last_became_peered":"2024-05-07T14:03:39.661339+0000","last_unstale":"2024-05-07T14:05:40.157085+0000","last_undegraded":"2024-05-07T14:05:40.157085+0000","last_fullsized":"2024-05-07T14:05:40.157085+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:40.156796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:40.156796+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.156796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:48:35.949101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"146'34","reported_seq":308,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.889952+0000","last_change":"2024-05-07T14:05:52.890010+0000","last_active":"2024-05-07T14:05:52.889952+0000","last_peered":"2024-05-07T14:05:52.889952+0000","last_clean":"2024-05-07T14:05:52.889952+0000","last_became_active":"2024-05-07T14:01:37.553249+0000","last_became_peered":"2024-05-07T14:01:37.553249+0000","last_unstale":"2024-05-07T14:05:52.889952+0000","last_undegraded":"2024-05-07T14:05:52.889952+0000","last_fullsized":"2024-05-07T14:05:52.889952+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'34","last_scrub_stamp":"2024-05-07T14:05:52.889760+0000","last_deep_scrub":"146'34","last_deep_scrub_stamp":"2024-05-07T14:05:52.889760+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.889760+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:00:22.098465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"81'6","reported_seq":297,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:10.891049+0000","last_change":"2024-05-07T14:06:10.891108+0000","last_active":"2024-05-07T14:06:10.891049+0000","last_peered":"2024-05-07T14:06:10.891049+0000","last_clean":"2024-05-07T14:06:10.891049+0000","last_became_active":"2024-05-07T14:04:59.466443+0000","last_became_peered":"2024-05-07T14:04:59.466443+0000","last_unstale":"2024-05-07T14:06:10.891049+0000","last_undegraded":"2024-05-07T14:06:10.891049+0000","last_fullsized":"2024-05-07T14:06:10.891049+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-05-07T14:06:10.890810+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-05-07T14:06:10.890810+0000","last_clean_scrub_stamp":"2024-05-07T14:06:10.890810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:58:16.635715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"146'50","reported_seq":320,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:03.933990+0000","last_change":"2024-05-07T14:06:03.934054+0000","last_active":"2024-05-07T14:06:03.933990+0000","last_peered":"2024-05-07T14:06:03.933990+0000","last_clean":"2024-05-07T14:06:03.933990+0000","last_became_active":"2024-05-07T14:00:56.000572+0000","last_became_peered":"2024-05-07T14:00:56.000572+0000","last_unstale":"2024-05-07T14:06:03.933990+0000","last_undegraded":"2024-05-07T14:06:03.933990+0000","last_fullsized":"2024-05-07T14:06:03.933990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'50","last_scrub_stamp":"2024-05-07T14:06:03.933744+0000","last_deep_scrub":"146'50","last_deep_scrub_stamp":"2024-05-07T14:06:03.933744+0000","last_clean_scrub_stamp":"2024-05-07T14:06:03.933744+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:49:59.977552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"124'4","reported_seq":138,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:04.225047+0000","last_change":"2024-05-07T14:06:04.225180+0000","last_active":"2024-05-07T14:06:04.225047+0000","last_peered":"2024-05-07T14:06:04.225047+0000","last_clean":"2024-05-07T14:06:04.225047+0000","last_became_active":"2024-05-07T14:04:59.445932+0000","last_became_peered":"2024-05-07T14:04:59.445932+0000","last_unstale":"2024-05-07T14:06:04.225047+0000","last_undegraded":"2024-05-07T14:06:04.225047+0000","last_fullsized":"2024-05-07T14:06:04.225047+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'4","last_scrub_stamp":"2024-05-07T14:06:04.224812+0000","last_deep_scrub":"124'4","last_deep_scrub_stamp":"2024-05-07T14:06:04.224812+0000","last_clean_scrub_stamp":"2024-05-07T14:06:04.224812+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:19.904414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"146'54","reported_seq":326,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:00.742533+0000","last_change":"2024-05-07T14:06:00.742593+0000","last_active":"2024-05-07T14:06:00.742533+0000","last_peered":"2024-05-07T14:06:00.742533+0000","last_clean":"2024-05-07T14:06:00.742533+0000","last_became_active":"2024-05-07T14:00:55.976615+0000","last_became_peered":"2024-05-07T14:00:55.976615+0000","last_unstale":"2024-05-07T14:06:00.742533+0000","last_undegraded":"2024-05-07T14:06:00.742533+0000","last_fullsized":"2024-05-07T14:06:00.742533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:06:00.742295+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:06:00.742295+0000","last_clean_scrub_stamp":"2024-05-07T14:06:00.742295+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:25.550453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"81'2","reported_seq":282,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:18.618034+0000","last_change":"2024-05-07T14:06:18.618096+0000","last_active":"2024-05-07T14:06:18.618034+0000","last_peered":"2024-05-07T14:06:18.618034+0000","last_clean":"2024-05-07T14:06:18.618034+0000","last_became_active":"2024-05-07T14:04:59.447844+0000","last_became_peered":"2024-05-07T14:04:59.447844+0000","last_unstale":"2024-05-07T14:06:18.618034+0000","last_undegraded":"2024-05-07T14:06:18.618034+0000","last_fullsized":"2024-05-07T14:06:18.618034+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-05-07T14:06:18.617831+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-05-07T14:06:18.617831+0000","last_clean_scrub_stamp":"2024-05-07T14:06:18.617831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:33:24.560329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"146'42","reported_seq":313,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:11.604068+0000","last_change":"2024-05-07T14:06:11.604141+0000","last_active":"2024-05-07T14:06:11.604068+0000","last_peered":"2024-05-07T14:06:11.604068+0000","last_clean":"2024-05-07T14:06:11.604068+0000","last_became_active":"2024-05-07T14:00:55.986311+0000","last_became_peered":"2024-05-07T14:00:55.986311+0000","last_unstale":"2024-05-07T14:06:11.604068+0000","last_undegraded":"2024-05-07T14:06:11.604068+0000","last_fullsized":"2024-05-07T14:06:11.604068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'42","last_scrub_stamp":"2024-05-07T14:06:11.603859+0000","last_deep_scrub":"146'42","last_deep_scrub_stamp":"2024-05-07T14:06:11.603859+0000","last_clean_scrub_stamp":"2024-05-07T14:06:11.603859+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:28:00.479167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":268,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:42.614242+0000","last_change":"2024-05-07T14:05:42.614305+0000","last_active":"2024-05-07T14:05:42.614242+0000","last_peered":"2024-05-07T14:05:42.614242+0000","last_clean":"2024-05-07T14:05:42.614242+0000","last_became_active":"2024-05-07T14:00:58.002564+0000","last_became_peered":"2024-05-07T14:00:58.002564+0000","last_unstale":"2024-05-07T14:05:42.614242+0000","last_undegraded":"2024-05-07T14:05:42.614242+0000","last_fullsized":"2024-05-07T14:05:42.614242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:42.614017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:42.614017+0000","last_clean_scrub_stamp":"2024-05-07T14:05:42.614017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:09:51.933134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"146'56","reported_seq":175,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:59.238395+0000","last_change":"2024-05-07T14:05:59.238518+0000","last_active":"2024-05-07T14:05:59.238395+0000","last_peered":"2024-05-07T14:05:59.238395+0000","last_clean":"2024-05-07T14:05:59.238395+0000","last_became_active":"2024-05-07T14:03:39.668790+0000","last_became_peered":"2024-05-07T14:03:39.668790+0000","last_unstale":"2024-05-07T14:05:59.238395+0000","last_undegraded":"2024-05-07T14:05:59.238395+0000","last_fullsized":"2024-05-07T14:05:59.238395+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'56","last_scrub_stamp":"2024-05-07T14:05:59.238165+0000","last_deep_scrub":"146'56","last_deep_scrub_stamp":"2024-05-07T14:05:59.238165+0000","last_clean_scrub_stamp":"2024-05-07T14:05:59.238165+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:11:33.979687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"81'8","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:38.431720+0000","last_change":"2024-05-07T14:05:37.485873+0000","last_active":"2024-05-07T14:05:38.431720+0000","last_peered":"2024-05-07T14:05:38.431720+0000","last_clean":"2024-05-07T14:05:38.431720+0000","last_became_active":"2024-05-07T14:03:39.666451+0000","last_became_peered":"2024-05-07T14:03:39.666451+0000","last_unstale":"2024-05-07T14:05:38.431720+0000","last_undegraded":"2024-05-07T14:05:38.431720+0000","last_fullsized":"2024-05-07T14:05:38.431720+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'8","last_scrub_stamp":"2024-05-07T14:05:37.485738+0000","last_deep_scrub":"81'8","last_deep_scrub_stamp":"2024-05-07T14:05:37.485738+0000","last_clean_scrub_stamp":"2024-05-07T14:05:37.485738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:47:16.171782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"146'44","reported_seq":332,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:02.476777+0000","last_change":"2024-05-07T14:06:02.476841+0000","last_active":"2024-05-07T14:06:02.476777+0000","last_peered":"2024-05-07T14:06:02.476777+0000","last_clean":"2024-05-07T14:06:02.476777+0000","last_became_active":"2024-05-07T14:04:59.455622+0000","last_became_peered":"2024-05-07T14:04:59.455622+0000","last_unstale":"2024-05-07T14:06:02.476777+0000","last_undegraded":"2024-05-07T14:06:02.476777+0000","last_fullsized":"2024-05-07T14:06:02.476777+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'44","last_scrub_stamp":"2024-05-07T14:06:02.476566+0000","last_deep_scrub":"146'44","last_deep_scrub_stamp":"2024-05-07T14:06:02.476566+0000","last_clean_scrub_stamp":"2024-05-07T14:06:02.476566+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:45.263557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"115'2","reported_seq":274,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.503949+0000","last_change":"2024-05-07T14:05:53.504095+0000","last_active":"2024-05-07T14:05:53.503949+0000","last_peered":"2024-05-07T14:05:53.503949+0000","last_clean":"2024-05-07T14:05:53.503949+0000","last_became_active":"2024-05-07T14:00:57.978551+0000","last_became_peered":"2024-05-07T14:00:57.978551+0000","last_unstale":"2024-05-07T14:05:53.503949+0000","last_undegraded":"2024-05-07T14:05:53.503949+0000","last_fullsized":"2024-05-07T14:05:53.503949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"115'2","last_scrub_stamp":"2024-05-07T14:05:53.503677+0000","last_deep_scrub":"115'2","last_deep_scrub_stamp":"2024-05-07T14:05:53.503677+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.503677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:17:39.060389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"146'40","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:12.622256+0000","last_change":"2024-05-07T14:06:12.622318+0000","last_active":"2024-05-07T14:06:12.622256+0000","last_peered":"2024-05-07T14:06:12.622256+0000","last_clean":"2024-05-07T14:06:12.622256+0000","last_became_active":"2024-05-07T14:00:55.987451+0000","last_became_peered":"2024-05-07T14:00:55.987451+0000","last_unstale":"2024-05-07T14:06:12.622256+0000","last_undegraded":"2024-05-07T14:06:12.622256+0000","last_fullsized":"2024-05-07T14:06:12.622256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'40","last_scrub_stamp":"2024-05-07T14:06:12.622041+0000","last_deep_scrub":"146'40","last_deep_scrub_stamp":"2024-05-07T14:06:12.622041+0000","last_clean_scrub_stamp":"2024-05-07T14:06:12.622041+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:18:46.021119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"106'2","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:04.650205+0000","last_change":"2024-05-07T14:06:04.650264+0000","last_active":"2024-05-07T14:06:04.650205+0000","last_peered":"2024-05-07T14:06:04.650205+0000","last_clean":"2024-05-07T14:06:04.650205+0000","last_became_active":"2024-05-07T14:00:57.980923+0000","last_became_peered":"2024-05-07T14:00:57.980923+0000","last_unstale":"2024-05-07T14:06:04.650205+0000","last_undegraded":"2024-05-07T14:06:04.650205+0000","last_fullsized":"2024-05-07T14:06:04.650205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'2","last_scrub_stamp":"2024-05-07T14:06:04.649997+0000","last_deep_scrub":"106'2","last_deep_scrub_stamp":"2024-05-07T14:06:04.649997+0000","last_clean_scrub_stamp":"2024-05-07T14:06:04.649997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T15:50:00.693805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"146'56","reported_seq":327,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.910553+0000","last_change":"2024-05-07T14:05:54.910675+0000","last_active":"2024-05-07T14:05:54.910553+0000","last_peered":"2024-05-07T14:05:54.910553+0000","last_clean":"2024-05-07T14:05:54.910553+0000","last_became_active":"2024-05-07T14:00:56.010231+0000","last_became_peered":"2024-05-07T14:00:56.010231+0000","last_unstale":"2024-05-07T14:05:54.910553+0000","last_undegraded":"2024-05-07T14:05:54.910553+0000","last_fullsized":"2024-05-07T14:05:54.910553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'56","last_scrub_stamp":"2024-05-07T14:05:54.910241+0000","last_deep_scrub":"146'56","last_deep_scrub_stamp":"2024-05-07T14:05:54.910241+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.910241+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:51:19.057565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":66,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":284,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:54.659031+0000","last_change":"2024-05-07T14:05:54.659097+0000","last_active":"2024-05-07T14:05:54.659031+0000","last_peered":"2024-05-07T14:05:54.659031+0000","last_clean":"2024-05-07T14:05:54.659031+0000","last_became_active":"2024-05-07T14:00:58.000979+0000","last_became_peered":"2024-05-07T14:00:58.000979+0000","last_unstale":"2024-05-07T14:05:54.659031+0000","last_undegraded":"2024-05-07T14:05:54.659031+0000","last_fullsized":"2024-05-07T14:05:54.659031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-05-07T14:05:54.658810+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-05-07T14:05:54.658810+0000","last_clean_scrub_stamp":"2024-05-07T14:05:54.658810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T22:03:37.445801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"146'48","reported_seq":319,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:13.672843+0000","last_change":"2024-05-07T14:06:13.672912+0000","last_active":"2024-05-07T14:06:13.672843+0000","last_peered":"2024-05-07T14:06:13.672843+0000","last_clean":"2024-05-07T14:06:13.672843+0000","last_became_active":"2024-05-07T14:00:55.991851+0000","last_became_peered":"2024-05-07T14:00:55.991851+0000","last_unstale":"2024-05-07T14:06:13.672843+0000","last_undegraded":"2024-05-07T14:06:13.672843+0000","last_fullsized":"2024-05-07T14:06:13.672843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'48","last_scrub_stamp":"2024-05-07T14:06:13.672638+0000","last_deep_scrub":"146'48","last_deep_scrub_stamp":"2024-05-07T14:06:13.672638+0000","last_clean_scrub_stamp":"2024-05-07T14:06:13.672638+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:58:19.417543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"106'4","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:41.907874+0000","last_change":"2024-05-07T14:05:41.907938+0000","last_active":"2024-05-07T14:05:41.907874+0000","last_peered":"2024-05-07T14:05:41.907874+0000","last_clean":"2024-05-07T14:05:41.907874+0000","last_became_active":"2024-05-07T14:00:57.972690+0000","last_became_peered":"2024-05-07T14:00:57.972690+0000","last_unstale":"2024-05-07T14:05:41.907874+0000","last_undegraded":"2024-05-07T14:05:41.907874+0000","last_fullsized":"2024-05-07T14:05:41.907874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'4","last_scrub_stamp":"2024-05-07T14:05:41.907625+0000","last_deep_scrub":"106'4","last_deep_scrub_stamp":"2024-05-07T14:05:41.907625+0000","last_clean_scrub_stamp":"2024-05-07T14:05:41.907625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:15:29.391287+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"146'54","reported_seq":344,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:12.926365+0000","last_change":"2024-05-07T14:06:12.926429+0000","last_active":"2024-05-07T14:06:12.926365+0000","last_peered":"2024-05-07T14:06:12.926365+0000","last_clean":"2024-05-07T14:06:12.926365+0000","last_became_active":"2024-05-07T14:04:59.443769+0000","last_became_peered":"2024-05-07T14:04:59.443769+0000","last_unstale":"2024-05-07T14:06:12.926365+0000","last_undegraded":"2024-05-07T14:06:12.926365+0000","last_fullsized":"2024-05-07T14:06:12.926365+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:06:12.926150+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:06:12.926150+0000","last_clean_scrub_stamp":"2024-05-07T14:06:12.926150+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:47:56.290783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":268,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:44.570398+0000","last_change":"2024-05-07T14:05:44.570475+0000","last_active":"2024-05-07T14:05:44.570398+0000","last_peered":"2024-05-07T14:05:44.570398+0000","last_clean":"2024-05-07T14:05:44.570398+0000","last_became_active":"2024-05-07T14:00:58.002806+0000","last_became_peered":"2024-05-07T14:00:58.002806+0000","last_unstale":"2024-05-07T14:05:44.570398+0000","last_undegraded":"2024-05-07T14:05:44.570398+0000","last_fullsized":"2024-05-07T14:05:44.570398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-07T14:05:44.570170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-07T14:05:44.570170+0000","last_clean_scrub_stamp":"2024-05-07T14:05:44.570170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:53:24.319990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"146'54","reported_seq":349,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:12.611720+0000","last_change":"2024-05-07T14:06:12.611780+0000","last_active":"2024-05-07T14:06:12.611720+0000","last_peered":"2024-05-07T14:06:12.611720+0000","last_clean":"2024-05-07T14:06:12.611720+0000","last_became_active":"2024-05-07T14:04:59.458388+0000","last_became_peered":"2024-05-07T14:04:59.458388+0000","last_unstale":"2024-05-07T14:06:12.611720+0000","last_undegraded":"2024-05-07T14:06:12.611720+0000","last_fullsized":"2024-05-07T14:06:12.611720+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'54","last_scrub_stamp":"2024-05-07T14:06:12.611505+0000","last_deep_scrub":"146'54","last_deep_scrub_stamp":"2024-05-07T14:06:12.611505+0000","last_clean_scrub_stamp":"2024-05-07T14:06:12.611505+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:05:32.454369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"81'6","reported_seq":251,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:52.013642+0000","last_change":"2024-05-07T14:05:52.013748+0000","last_active":"2024-05-07T14:05:52.013642+0000","last_peered":"2024-05-07T14:05:52.013642+0000","last_clean":"2024-05-07T14:05:52.013642+0000","last_became_active":"2024-05-07T14:04:59.448913+0000","last_became_peered":"2024-05-07T14:04:59.448913+0000","last_unstale":"2024-05-07T14:05:52.013642+0000","last_undegraded":"2024-05-07T14:05:52.013642+0000","last_fullsized":"2024-05-07T14:05:52.013642+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-05-07T14:05:52.013425+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-05-07T14:05:52.013425+0000","last_clean_scrub_stamp":"2024-05-07T14:05:52.013425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T18:24:49.967919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"146'58","reported_seq":328,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.479580+0000","last_change":"2024-05-07T14:05:50.479646+0000","last_active":"2024-05-07T14:05:50.479580+0000","last_peered":"2024-05-07T14:05:50.479580+0000","last_clean":"2024-05-07T14:05:50.479580+0000","last_became_active":"2024-05-07T14:00:55.990745+0000","last_became_peered":"2024-05-07T14:00:55.990745+0000","last_unstale":"2024-05-07T14:05:50.479580+0000","last_undegraded":"2024-05-07T14:05:50.479580+0000","last_fullsized":"2024-05-07T14:05:50.479580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'58","last_scrub_stamp":"2024-05-07T14:05:50.479363+0000","last_deep_scrub":"146'58","last_deep_scrub_stamp":"2024-05-07T14:05:50.479363+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.479363+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T23:39:29.015503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":116736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"87'2","reported_seq":276,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.802716+0000","last_change":"2024-05-07T14:05:50.802841+0000","last_active":"2024-05-07T14:05:50.802716+0000","last_peered":"2024-05-07T14:05:50.802716+0000","last_clean":"2024-05-07T14:05:50.802716+0000","last_became_active":"2024-05-07T14:00:57.992826+0000","last_became_peered":"2024-05-07T14:00:57.992826+0000","last_unstale":"2024-05-07T14:05:50.802716+0000","last_undegraded":"2024-05-07T14:05:50.802716+0000","last_fullsized":"2024-05-07T14:05:50.802716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"87'2","last_scrub_stamp":"2024-05-07T14:05:50.802458+0000","last_deep_scrub":"87'2","last_deep_scrub_stamp":"2024-05-07T14:05:50.802458+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.802458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T16:18:14.732397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"146'46","reported_seq":306,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:07.995705+0000","last_change":"2024-05-07T14:06:07.995767+0000","last_active":"2024-05-07T14:06:07.995705+0000","last_peered":"2024-05-07T14:06:07.995705+0000","last_clean":"2024-05-07T14:06:07.995705+0000","last_became_active":"2024-05-07T14:04:59.459490+0000","last_became_peered":"2024-05-07T14:04:59.459490+0000","last_unstale":"2024-05-07T14:06:07.995705+0000","last_undegraded":"2024-05-07T14:06:07.995705+0000","last_fullsized":"2024-05-07T14:06:07.995705+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'46","last_scrub_stamp":"2024-05-07T14:06:07.995508+0000","last_deep_scrub":"146'46","last_deep_scrub_stamp":"2024-05-07T14:06:07.995508+0000","last_clean_scrub_stamp":"2024-05-07T14:06:07.995508+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:30:55.127515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"81'6","reported_seq":293,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:04.547155+0000","last_change":"2024-05-07T14:06:04.547215+0000","last_active":"2024-05-07T14:06:04.547155+0000","last_peered":"2024-05-07T14:06:04.547155+0000","last_clean":"2024-05-07T14:06:04.547155+0000","last_became_active":"2024-05-07T14:00:57.982883+0000","last_became_peered":"2024-05-07T14:00:57.982883+0000","last_unstale":"2024-05-07T14:06:04.547155+0000","last_undegraded":"2024-05-07T14:06:04.547155+0000","last_fullsized":"2024-05-07T14:06:04.547155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-05-07T14:06:04.546908+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-05-07T14:06:04.546908+0000","last_clean_scrub_stamp":"2024-05-07T14:06:04.546908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:17:19.853557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"146'52","reported_seq":321,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:40.917840+0000","last_change":"2024-05-07T14:05:40.917902+0000","last_active":"2024-05-07T14:05:40.917840+0000","last_peered":"2024-05-07T14:05:40.917840+0000","last_clean":"2024-05-07T14:05:40.917840+0000","last_became_active":"2024-05-07T14:00:55.977766+0000","last_became_peered":"2024-05-07T14:00:55.977766+0000","last_unstale":"2024-05-07T14:05:40.917840+0000","last_undegraded":"2024-05-07T14:05:40.917840+0000","last_fullsized":"2024-05-07T14:05:40.917840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'52","last_scrub_stamp":"2024-05-07T14:05:40.917639+0000","last_deep_scrub":"146'52","last_deep_scrub_stamp":"2024-05-07T14:05:40.917639+0000","last_clean_scrub_stamp":"2024-05-07T14:05:40.917639+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T21:24:20.060632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"124'6","reported_seq":212,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.044822+0000","last_change":"2024-05-07T14:05:53.044878+0000","last_active":"2024-05-07T14:05:53.044822+0000","last_peered":"2024-05-07T14:05:53.044822+0000","last_clean":"2024-05-07T14:05:53.044822+0000","last_became_active":"2024-05-07T14:04:59.442569+0000","last_became_peered":"2024-05-07T14:04:59.442569+0000","last_unstale":"2024-05-07T14:05:53.044822+0000","last_undegraded":"2024-05-07T14:05:53.044822+0000","last_fullsized":"2024-05-07T14:05:53.044822+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'6","last_scrub_stamp":"2024-05-07T14:05:53.044626+0000","last_deep_scrub":"124'6","last_deep_scrub_stamp":"2024-05-07T14:05:53.044626+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.044626+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:42:52.957080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"146'52","reported_seq":340,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:14.921864+0000","last_change":"2024-05-07T14:06:14.921925+0000","last_active":"2024-05-07T14:06:14.921864+0000","last_peered":"2024-05-07T14:06:14.921864+0000","last_clean":"2024-05-07T14:06:14.921864+0000","last_became_active":"2024-05-07T14:04:59.461335+0000","last_became_peered":"2024-05-07T14:04:59.461335+0000","last_unstale":"2024-05-07T14:06:14.921864+0000","last_undegraded":"2024-05-07T14:06:14.921864+0000","last_fullsized":"2024-05-07T14:06:14.921864+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'52","last_scrub_stamp":"2024-05-07T14:06:14.921670+0000","last_deep_scrub":"146'52","last_deep_scrub_stamp":"2024-05-07T14:06:14.921670+0000","last_clean_scrub_stamp":"2024-05-07T14:06:14.921670+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T20:34:10.139993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"146'48","reported_seq":318,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:06:01.933293+0000","last_change":"2024-05-07T14:06:01.933354+0000","last_active":"2024-05-07T14:06:01.933293+0000","last_peered":"2024-05-07T14:06:01.933293+0000","last_clean":"2024-05-07T14:06:01.933293+0000","last_became_active":"2024-05-07T14:00:55.994454+0000","last_became_peered":"2024-05-07T14:00:55.994454+0000","last_unstale":"2024-05-07T14:06:01.933293+0000","last_undegraded":"2024-05-07T14:06:01.933293+0000","last_fullsized":"2024-05-07T14:06:01.933293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'48","last_scrub_stamp":"2024-05-07T14:06:01.933089+0000","last_deep_scrub":"146'48","last_deep_scrub_stamp":"2024-05-07T14:06:01.933089+0000","last_clean_scrub_stamp":"2024-05-07T14:06:01.933089+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T01:17:17.239738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"124'4","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:56.848870+0000","last_change":"2024-05-07T14:05:56.848934+0000","last_active":"2024-05-07T14:05:56.848870+0000","last_peered":"2024-05-07T14:05:56.848870+0000","last_clean":"2024-05-07T14:05:56.848870+0000","last_became_active":"2024-05-07T14:00:57.981896+0000","last_became_peered":"2024-05-07T14:00:57.981896+0000","last_unstale":"2024-05-07T14:05:56.848870+0000","last_undegraded":"2024-05-07T14:05:56.848870+0000","last_fullsized":"2024-05-07T14:05:56.848870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"124'4","last_scrub_stamp":"2024-05-07T14:05:56.848653+0000","last_deep_scrub":"124'4","last_deep_scrub_stamp":"2024-05-07T14:05:56.848653+0000","last_clean_scrub_stamp":"2024-05-07T14:05:56.848653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T19:11:31.841849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"146'42","reported_seq":312,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:53.238833+0000","last_change":"2024-05-07T14:05:53.238891+0000","last_active":"2024-05-07T14:05:53.238833+0000","last_peered":"2024-05-07T14:05:53.238833+0000","last_clean":"2024-05-07T14:05:53.238833+0000","last_became_active":"2024-05-07T14:00:55.981038+0000","last_became_peered":"2024-05-07T14:00:55.981038+0000","last_unstale":"2024-05-07T14:05:53.238833+0000","last_undegraded":"2024-05-07T14:05:53.238833+0000","last_fullsized":"2024-05-07T14:05:53.238833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'42","last_scrub_stamp":"2024-05-07T14:05:53.238636+0000","last_deep_scrub":"146'42","last_deep_scrub_stamp":"2024-05-07T14:05:53.238636+0000","last_clean_scrub_stamp":"2024-05-07T14:05:53.238636+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T14:20:40.233322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"106'4","reported_seq":283,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-05-07T14:05:50.828674+0000","last_change":"2024-05-07T14:05:50.828744+0000","last_active":"2024-05-07T14:05:50.828674+0000","last_peered":"2024-05-07T14:05:50.828674+0000","last_clean":"2024-05-07T14:05:50.828674+0000","last_became_active":"2024-05-07T14:00:57.984114+0000","last_became_peered":"2024-05-07T14:00:57.984114+0000","last_unstale":"2024-05-07T14:05:50.828674+0000","last_undegraded":"2024-05-07T14:05:50.828674+0000","last_fullsized":"2024-05-07T14:05:50.828674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'4","last_scrub_stamp":"2024-05-07T14:05:50.828427+0000","last_deep_scrub":"106'4","last_deep_scrub_stamp":"2024-05-07T14:05:50.828427+0000","last_clean_scrub_stamp":"2024-05-07T14:05:50.828427+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-08T17:57:06.508029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":333,"num_read_kb":313,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":784,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1119,"ondisk_log_size":1119,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":31604,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1062,"num_read_kb":1544,"num_write":545,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":121255,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5538,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1021,"ondisk_log_size":1021,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":351,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1436,"num_read_kb":1404,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":620756992,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":7,"up_from":129,"seq":554050781205,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42180,"kb_used_data":1788,"kb_used_omap":6,"kb_used_meta":40377,"kb_avail":94329660,"statfs":{"total":96636764160,"available":96593571840,"internally_reserved":0,"allocated":1830912,"data_stored":1072724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6345,"internal_metadata":41346871},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37680,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334160,"statfs":{"total":96636764160,"available":96598179840,"internally_reserved":0,"allocated":2400256,"data_stored":1662432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37144,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334696,"statfs":{"total":96636764160,"available":96598728704,"internally_reserved":0,"allocated":1851392,"data_stored":1072892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37092,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1798144,"data_stored":1072555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37700,"kb_used_data":2364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334140,"statfs":{"total":96636764160,"available":96598159360,"internally_reserved":0,"allocated":2420736,"data_stored":1663220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1802240,"data_stored":1072073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37124,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334716,"statfs":{"total":96636764160,"available":96598749184,"internally_reserved":0,"allocated":1830912,"data_stored":1073699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574924,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37112,"kb_used_data":1776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334728,"statfs":{"total":96636764160,"available":96598761472,"internally_reserved":0,"allocated":1818624,"data_stored":1072577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4755,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-07T14:06:39.358 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-07T14:06:39.686 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-07T14:06:39.687 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-07T14:06:39.687 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-07T14:06:39.687 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:06:39.776 INFO:tasks.ceph.osd.0:Stopped 2024-05-07T14:06:39.776 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-07T14:06:39.776 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:06:39.868 INFO:tasks.ceph.osd.1:Stopped 2024-05-07T14:06:39.868 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-07T14:06:39.868 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:06:39.946 INFO:tasks.ceph.osd.2:Stopped 2024-05-07T14:06:39.946 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-07T14:06:39.946 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:06:40.034 INFO:tasks.ceph.osd.3:Stopped 2024-05-07T14:06:40.034 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-07T14:06:40.034 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:06:40.134 INFO:tasks.ceph.osd.4:Stopped 2024-05-07T14:06:40.135 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-07T14:06:40.135 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:06:40.219 INFO:tasks.ceph.osd.5:Stopped 2024-05-07T14:06:40.220 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-07T14:06:40.220 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:06:40.314 INFO:tasks.ceph.osd.6:Stopped 2024-05-07T14:06:40.314 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-07T14:06:40.315 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:06:44.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-07T14:06:46.417 INFO:tasks.ceph.osd.7:Stopped 2024-05-07T14:06:46.417 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-07T14:06:46.417 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-07T14:06:46.417 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:06:46.447 INFO:tasks.ceph.mgr.y:Stopped 2024-05-07T14:06:46.448 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-07T14:06:46.448 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:06:46.477 INFO:tasks.ceph.mgr.x:Stopped 2024-05-07T14:06:46.477 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-07T14:06:46.477 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-07T14:06:46.477 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:06:46.506 INFO:tasks.ceph.mon.a:Stopped 2024-05-07T14:06:46.506 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-07T14:06:46.506 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:06:46.561 INFO:tasks.ceph.mon.c:Stopped 2024-05-07T14:06:46.561 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-07T14:06:46.561 INFO:teuthology.orchestra.run:waiting for 300 2024-05-07T14:06:46.579 INFO:tasks.ceph.mon.b:Stopped 2024-05-07T14:06:46.580 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-07T14:06:46.580 DEBUG:teuthology.orchestra.run.smithi106:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | head -n 1 2024-05-07T14:06:46.619 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-07T14:06:46.620 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-07T14:06:46.961 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-07T14:06:46.961 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-07T14:06:47.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-07T14:06:47.215 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-07T14:06:47.450 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi106.front.sepia.ceph.com 2024-05-07T14:06:47.450 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-07T14:06:47.650 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-07T14:06:47.650 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-07T14:06:47.890 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-07T14:06:47.890 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-07T14:06:48.051 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-07T14:06:48.051 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-07T14:06:48.211 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-07T14:06:48.211 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-07T14:06:48.378 INFO:tasks.ceph:Archiving mon data... 2024-05-07T14:06:48.380 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430/data/mon.a.tgz 2024-05-07T14:06:48.380 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-05-07T14:06:48.386 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.sMLIDN6ea6 2024-05-07T14:06:48.386 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.sMLIDN6ea6 2024-05-07T14:06:48.581 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.sMLIDN6ea6 2024-05-07T14:06:48.643 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.sMLIDN6ea6 is 659KB 2024-05-07T14:06:48.710 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.sMLIDN6ea6 2024-05-07T14:06:48.716 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430/data/mon.c.tgz 2024-05-07T14:06:48.716 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-05-07T14:06:48.764 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.egGhtTskjR 2024-05-07T14:06:48.764 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.egGhtTskjR 2024-05-07T14:06:49.007 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.egGhtTskjR 2024-05-07T14:06:49.072 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.egGhtTskjR is 846KB 2024-05-07T14:06:49.090 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-07T14:06:49.189 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.egGhtTskjR 2024-05-07T14:06:49.195 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430/data/mon.b.tgz 2024-05-07T14:06:49.195 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-05-07T14:06:49.201 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.ozpfiqkQ8H 2024-05-07T14:06:49.201 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ozpfiqkQ8H 2024-05-07T14:06:49.440 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.ozpfiqkQ8H 2024-05-07T14:06:49.502 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.ozpfiqkQ8H is 846KB 2024-05-07T14:06:49.569 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.ozpfiqkQ8H 2024-05-07T14:06:49.575 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-07T14:06:49.575 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-07T14:06:49.578 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-07T14:06:49.636 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-07T14:06:49.675 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-07T14:06:49.675 INFO:tasks.ceph:Archiving crash dumps... 2024-05-07T14:06:49.677 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430/remote/smithi106/crash 2024-05-07T14:06:49.678 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-07T14:06:49.691 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430/remote/smithi107/crash 2024-05-07T14:06:49.692 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-07T14:06:49.728 INFO:tasks.ceph:Compressing logs... 2024-05-07T14:06:49.729 DEBUG:teuthology.orchestra.run.smithi106:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-07T14:06:49.736 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-07T14:06:49.760 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32961.log 2024-05-07T14:06:49.761 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54595.log 2024-05-07T14:06:49.761 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59156.log 2024-05-07T14:06:49.762 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32961.log.gz 2024-05-07T14:06:49.762 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.54595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54595.log.gz 2024-05-07T14:06:49.762 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69854.log 2024-05-07T14:06:49.764 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59156.log.gz 2024-05-07T14:06:49.764 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36344.log 2024-05-07T14:06:49.764 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62978.log 2024-05-07T14:06:49.764 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69854.log: gzip -5/var/log/ceph/ceph-client.admin.36344.log: --verbose -- /var/log/ceph/ceph-client.admin.68357.log 2024-05-07T14:06:49.764 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36344.log.gz 2024-05-07T14:06:49.764 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69854.log.gz 2024-05-07T14:06:49.764 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.62978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62978.log.gz 2024-05-07T14:06:49.764 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59013.log 2024-05-07T14:06:49.764 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68357.log.gz 2024-05-07T14:06:49.764 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69932.log 2024-05-07T14:06:49.808 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25199.log 2024-05-07T14:06:49.808 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25343.log 2024-05-07T14:06:49.808 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.25199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25295.log 2024-05-07T14:06:49.808 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25199.log.gz 2024-05-07T14:06:49.808 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.25343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25343.log.gz 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.25295.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25271.log 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25295.log.gz 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25175.log 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.25271.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.25271.log.gz -5 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr: --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.25175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25319.log 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25175.log.gz 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.25319.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25319.log.gz 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-07T14:06:49.809 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25223.log 2024-05-07T14:06:49.810 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-07T14:06:49.810 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.25223.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-07T14:06:49.810 INFO:teuthology.orchestra.run.smithi107.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25223.log.gz 2024-05-07T14:06:49.810 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25247.log 2024-05-07T14:06:49.810 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.4.log: 89.3% 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-07T14:06:49.810 INFO:teuthology.orchestra.run.smithi107.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-07T14:06:49.810 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.25247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25247.log.gz 2024-05-07T14:06:49.810 INFO:teuthology.orchestra.run.smithi107.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-07T14:06:49.834 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59013.log.gz 2024-05-07T14:06:49.834 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60333.log 2024-05-07T14:06:49.834 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54728.log 2024-05-07T14:06:49.834 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69932.log: /var/log/ceph/ceph-client.admin.60333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62960.log 2024-05-07T14:06:49.834 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69932.log.gz 2024-05-07T14:06:49.834 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60333.log.gz 2024-05-07T14:06:49.834 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.54728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43161.log 2024-05-07T14:06:49.834 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54728.log.gz 2024-05-07T14:06:49.834 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.62960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34740.log 2024-05-07T14:06:49.834 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62960.log.gz 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43161.log.gz 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50312.log 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34740.log.gz 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60749.log 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50312.log.gz 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66611.log 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.60749.log: 87.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36812.log 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60749.log.gz 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.66611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68166.log 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66611.log.gz 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36812.log.gz 2024-05-07T14:06:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59214.log 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31056.log 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68166.log.gz 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:gzip/var/log/ceph/ceph-client.admin.59214.log: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59214.log.gz 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31056.log.gz 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69594.log 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31583.log 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58901.log 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69594.log.gz 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31583.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.31583.log.gz -- 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr: /var/log/ceph/ceph-client.admin.32869.log 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.58901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58901.log.gz 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69906.log 2024-05-07T14:06:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54881.log 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69906.log: /var/log/ceph/ceph-client.admin.32869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36732.log 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69906.log.gz 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32869.log.gz 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.54881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54881.log.gz 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68168.log 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36732.log.gz 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67610.log 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36447.log 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68168.log.gz 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68570.log 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67610.log.gz 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68372.log 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36447.log.gz 2024-05-07T14:06:49.837 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68165.log 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68570.log.gz 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35612.log 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68372.log.gz 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68165.log.gz 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66639.log 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60852.log 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35612.log.gz 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.66639.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66639.log.gz 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.60852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36915.log 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60852.log.gz 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5/var/log/ceph/ceph-osd.0.log: --verbose -- /var/log/ceph/ceph-client.admin.44392.log 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36035.log 2024-05-07T14:06:49.838 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36915.log.gz 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44392.log.gz 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67985.log 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36035.log.gz 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59698.log 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34270.log 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67985.log.gz 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59698.log.gz 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34972.log 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69542.log 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34270.log.gz 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34972.log.gz 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55770.log 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:gzip/var/log/ceph/ceph-client.admin.69542.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44987.log 2024-05-07T14:06:49.839 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69542.log.gz 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.55770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55770.log.gz 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50346.log 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.44987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53954.log 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44987.log.gz 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50346.log.gz 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34565.log 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.53954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36220.log 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53954.log.gz 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34565.log.gz 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36515.log 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50973.log 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36220.log.gz 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36515.log.gz 2024-05-07T14:06:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36626.log 2024-05-07T14:06:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68163.log 2024-05-07T14:06:49.841 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50973.log.gz 2024-05-07T14:06:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36626.log.gz 2024-05-07T14:06:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55861.log 2024-05-07T14:06:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36183.log 2024-05-07T14:06:49.841 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68163.log.gz 2024-05-07T14:06:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.55861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55861.log.gz 2024-05-07T14:06:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59366.log 2024-05-07T14:06:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34625.log 2024-05-07T14:06:49.841 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36183.log.gz 2024-05-07T14:06:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59366.log.gz 2024-05-07T14:06:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67584.log 2024-05-07T14:06:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32763.log 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34625.log.gz 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67584.log.gz 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31395.log 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59323.log 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32763.log.gz 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31395.log.gz 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56381.log 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32641.log 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59323.log.gz 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.56381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56381.log.gz 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36995.log 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59493.log 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32641.log.gz 2024-05-07T14:06:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36995.log.gz 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63698.log 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25106.log 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59493.log.gz 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.63698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63698.log.gz 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67671.log 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.25106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68362.log 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25106.log.gz 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67671.log.gz 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34179.log 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50324.log 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68362.log.gz 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34179.log.gz 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68765.log 2024-05-07T14:06:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.50324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52154.log 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50324.log.gz 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68765.log.gz 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66704.log 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.52154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61531.log 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52154.log.gz 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.66704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66704.log.gz 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62869.log 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.61531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56084.log 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61531.log.gz 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.62869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62869.log.gz 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55892.log 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.56084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66750.log 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56084.log.gz 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.55892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55892.log.gz 2024-05-07T14:06:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31601.log 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.66750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32919.log 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66750.log.gz 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31601.log.gz 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31173.log 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32919.log.gz 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59287.log 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31173.log.gz 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31368.log 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69698.log 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59287.log: /var/log/ceph/ceph-client.admin.31368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59287.log.gz 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31368.log.gz 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33635.log 2024-05-07T14:06:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33585.log 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69698.log.gz 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33635.log.gz 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34113.log 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39579.log 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33585.log: 0.0%/var/log/ceph/ceph-client.admin.34113.log: -- replaced with /var/log/ceph/ceph-client.admin.33585.log.gz 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34113.log.gz 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34931.log 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36851.log 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.39579.log: 0.0%/var/log/ceph/ceph-client.admin.34931.log: -- replaced with /var/log/ceph/ceph-client.admin.39579.log.gz 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69646.log 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34931.log.gz 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63913.log 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36851.log.gz 2024-05-07T14:06:49.846 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69646.log.gz 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25260.log 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56290.log 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.63913.log: /var/log/ceph/ceph-client.admin.25260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63913.log.gz 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.25260.log.gz -5 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr: --verbose -- /var/log/ceph/ceph-client.admin.68162.log 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.56290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69750.log 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56290.log.gz 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68162.log.gz 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64150.log 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31576.log 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69750.log.gz 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.64150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64150.log.gz 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32986.log 2024-05-07T14:06:49.847 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31576.log.gz 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30932.log 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32986.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35426.log 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32986.log.gz 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.30932.log: -- /var/log/ceph/ceph-client.admin.37808.log 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30932.log.gz 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35426.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35426.log.gz 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67907.log 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37808.log.gz 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62902.log 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67907.log.gz 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33270.log 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.62902.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.37114.log -- replaced with /var/log/ceph/ceph-client.admin.62902.log.gz 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:gzip/var/log/ceph/ceph-client.admin.33270.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60462.log 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33270.log.gz 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37114.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37114.log.gz 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63110.log 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.60462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60462.log.gz 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43159.log 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.63110.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63110.log.gz 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35357.log 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43159.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43159.log.gz 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33483.log 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35357.log.gz 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31910.log 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:gzip/var/log/ceph/ceph-client.admin.33483.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33775.log 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33483.log.gz 2024-05-07T14:06:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31910.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31910.log.gz 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47958.log 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33775.log.gz 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36266.log 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47958.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47958.log.gz 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33181.log 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36266.log.gz 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42563.log 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31187.log 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33181.log.gz 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.42563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68572.log 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42563.log.gz 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31187.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.33051.log 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31187.log.gz 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31784.log 2024-05-07T14:06:49.850 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68572.log.gz 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59450.log 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33051.log.gz 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31378.log 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31784.log.gz 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68871.log 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59450.log.gz 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61535.log 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31378.log.gz 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.0.68871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25379.log 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68871.log.gz 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.61535.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.61535.log.gz -- 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr: /var/log/ceph/ceph-client.admin.68365.log 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.25379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41353.log 2024-05-07T14:06:49.851 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25379.log.gz 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31185.log 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68365.log.gz 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.41353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67933.log 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41353.log.gz 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64221.log 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31185.log.gz 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34744.log 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67933.log.gz 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.64221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41963.log 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64221.log.gz 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67829.log 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34744.log.gz 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.41963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67777.log 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41963.log.gz 2024-05-07T14:06:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59649.log 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67829.log.gz 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31385.log 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67777.log.gz 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34595.log 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59649.log.gz 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68089.log 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31385.log.gz 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67803.log 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34595.log.gz 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65999.log 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68089.log.gz 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68063.log 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67803.log.gz 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.65999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31030.log 2024-05-07T14:06:49.853 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65999.log.gz 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56420.log 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68063.log.gz 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36343.log 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31030.log.gz 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.56420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69776.log 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56420.log.gz 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57600.log 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36343.log.gz 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33829.log 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69776.log.gz 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59725.log 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.57600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57600.log.gz 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33829.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-07T14:06:49.854 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33829.log.gz 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32768.log 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59725.log.gz 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33339.log 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64004.log 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32768.log.gz 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32956.log 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33339.log.gz 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.64004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64004.log.gz 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34709.log 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69724.log 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32956.log.gz 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59106.log 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34709.log.gz 2024-05-07T14:06:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69724.log.gz 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69490.log 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35311.log 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59106.log.gz 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31603.log 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69490.log.gz 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31604.log 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35311.log.gz 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46769.log 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31603.log.gz 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31604.log.gz 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55589.log 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64083.log 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46769.log.gz 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.55589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33932.log 2024-05-07T14:06:49.856 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55589.log.gz 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33312.log 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.64083.log: /var/log/ceph/ceph-client.admin.33932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60670.log 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33932.log.gz 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64083.log.gz 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33312.log.gz 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32667.log 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59219.log 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.60670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60670.log.gz/var/log/ceph/ceph-client.admin.32667.log: 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58794.log 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32667.log.gz 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59219.log: /var/log/ceph/ceph-client.admin.58794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69672.log 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59219.log.gz 2024-05-07T14:06:49.857 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58794.log.gz 2024-05-07T14:06:49.858 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66890.log 2024-05-07T14:06:49.883 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35163.log 2024-05-07T14:06:49.883 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69672.log.gz 2024-05-07T14:06:49.883 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.66890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66890.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36314.log 2024-05-07T14:06:49.883 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.883 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35163.log.gz 2024-05-07T14:06:49.883 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31108.log 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67697.log 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36314.log.gz 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31108.log.gzgzip 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36261.log 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67697.log.gz 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68557.log 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60782.log 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36261.log.gz 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68557.log.gz 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66809.log 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.60782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60782.log.gz 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60492.log 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68164.log 2024-05-07T14:06:49.884 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.66809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66809.log.gz 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.60492.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.60492.log.gz 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31186.log 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68164.log.gz 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34207.log 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59391.log 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31186.log.gz 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34207.log.gzgzip 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31181.log 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59391.log.gz 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35113.log 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36477.log 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31181.log.gz 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35113.log.gz 2024-05-07T14:06:49.885 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67555.log 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36477.log.gz 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59610.log 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31886.log 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67555.log.gz 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59610.log.gz 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54633.log 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31886.log.gz 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63733.log 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31599.log 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.54633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54633.log.gz 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.63733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63733.log.gz 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36036.log 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31599.log.gz 2024-05-07T14:06:49.886 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67881.log 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69568.log 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36036.log: /var/log/ceph/ceph-client.admin.67881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36036.log.gz 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67881.log.gz 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54940.log 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69516.log 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69568.log.gz 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.54940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54940.log.gz 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58902.log 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69516.log.gz 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31836.log 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33245.log 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.58902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58902.log.gz 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31836.log.gz 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37177.log 2024-05-07T14:06:49.887 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33245.log.gz 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68573.log 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37177.log.gz 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68573.log.gz 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55993.log 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.log: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55932.log 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.55993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34659.log 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55993.log.gz 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.55932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52762.log 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55932.log.gz 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34659.log.gz 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35451.log 2024-05-07T14:06:49.888 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53356.log 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.52762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52762.log.gz 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35451.log.gz 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43780.log 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31396.log 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.53356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53356.log.gz 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.43780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63790.log 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43780.log.gz 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33661.log 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31396.log.gz/var/log/ceph/ceph-client.admin.63790.log: 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63790.log.gz 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46175.log 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31936.log 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33661.log.gz 2024-05-07T14:06:49.889 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.46175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46175.log.gz 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31082.log 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31936.log.gz 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67855.log 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35727.log 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31082.log.gz 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67855.log.gz 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68115.log 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35727.log.gz 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68583.log 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64184.log 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68115.log.gz 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68583.log.gz 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68817.log 2024-05-07T14:06:49.890 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.64184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64184.log.gz 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70010.log 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59573.log 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.70010.log: /var/log/ceph/ceph-client.admin.68817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68817.log.gz 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70010.log.gz 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40169.log 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70063.log 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59573.log.gz 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.40169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40169.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54911.log 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.70063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70063.log.gz 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33862.log 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.54911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54911.log.gz 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31184.log 2024-05-07T14:06:49.891 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33862.log.gz 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68349.log 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31184.log.gz 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36141.log 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68349.log.gz 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68011.log 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36141.log.gz 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36551.log 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68011.log.gz 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47368.log 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36551.log.gz 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33479.log 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.47368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47368.log.gz 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34311.log 2024-05-07T14:06:49.892 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33479.log.gz 2024-05-07T14:06:49.893 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35194.log 2024-05-07T14:06:49.893 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34311.log.gz 2024-05-07T14:06:49.893 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62804.log 2024-05-07T14:06:49.903 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35194.log.gz 2024-05-07T14:06:49.903 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38398.log 2024-05-07T14:06:49.903 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.62804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62804.log.gz 2024-05-07T14:06:49.903 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34452.log 2024-05-07T14:06:49.903 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38398.log.gz 2024-05-07T14:06:49.903 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36559.log 2024-05-07T14:06:49.903 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34452.log.gz 2024-05-07T14:06:49.903 INFO:teuthology.orchestra.run.smithi106.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-07T14:06:49.903 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53940.log 2024-05-07T14:06:49.903 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34373.log 2024-05-07T14:06:49.903 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36559.log.gz 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.53940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53940.log.gz 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34535.log 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64045.log 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34373.log.gz 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34535.log.gz 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55550.log 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.64045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69828.log 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64045.log.gz 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.55550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55550.log.gz 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36964.log 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33973.log 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69828.log: /var/log/ceph/ceph-client.admin.36964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69828.log.gz 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36964.log.gz 2024-05-07T14:06:49.904 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68584.log 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33973.log: /var/log/ceph/ops-log-ceph-client.0.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33973.log.gz 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr: 92.1% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68584.log.gz 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68037.log 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34505.log 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.68037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68037.log.gz 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31860.log 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66951.log 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34505.log: /var/log/ceph/ceph-client.admin.31860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34505.log.gz 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31860.log.gz 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58190.log 2024-05-07T14:06:49.905 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31602.log 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.66951.log: /var/log/ceph/ceph-client.admin.58190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66951.log.gz 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58190.log.gz 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56121.log 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33380.log 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31602.log.gz 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.56121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56121.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56347.log 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33380.log.gz 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70037.log 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60426.log 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.56347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56347.log.gz 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.70037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70037.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33090.log 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.906 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.60426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60426.log.gz 2024-05-07T14:06:49.915 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33117.log 2024-05-07T14:06:49.915 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55745.log 2024-05-07T14:06:49.915 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33090.log: /var/log/ceph/ceph-client.admin.33117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33090.log.gz 2024-05-07T14:06:49.915 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33117.log.gz 2024-05-07T14:06:49.915 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49138.log 2024-05-07T14:06:49.915 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31178.log 2024-05-07T14:06:49.915 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.55745.log: /var/log/ceph/ceph-client.admin.49138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55745.log.gz 2024-05-07T14:06:49.915 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49138.log.gz 2024-05-07T14:06:49.915 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35768.log 2024-05-07T14:06:49.915 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56043.log 2024-05-07T14:06:49.915 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31178.log: /var/log/ceph/ceph-client.admin.35768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31178.log.gz 2024-05-07T14:06:49.915 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35768.log.gz 2024-05-07T14:06:49.915 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36737.log 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66848.log 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.56043.log: /var/log/ceph/ceph-client.admin.36737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56043.log.gz 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36737.log.gz 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37216.log 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59611.log 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.66848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66848.log.gz 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.37216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37216.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54790.log 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59611.log.gz 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64815.log 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69984.log 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.54790.log: /var/log/ceph/ceph-client.admin.64815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54790.log.gz 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64815.log.gz 2024-05-07T14:06:49.916 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31134.log 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31382.log 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69984.log.gz 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31134.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49728.log 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31382.log.gz 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34816.log 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60382.log 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.49728.log: /var/log/ceph/ceph-client.admin.34816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49728.log.gz 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34816.log.gz 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59396.log 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58840.log 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.60382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60382.log.gz 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59396.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69620.log 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.917 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.58840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58840.log.gz 2024-05-07T14:06:49.924 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31388.log 2024-05-07T14:06:49.924 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68377.log 2024-05-07T14:06:49.924 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69620.log: /var/log/ceph/ceph-client.admin.31388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69620.log.gz 2024-05-07T14:06:49.924 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31388.log.gz 2024-05-07T14:06:49.924 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33421.log 2024-05-07T14:06:49.924 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36419.log 2024-05-07T14:06:49.924 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68377.log.gz 2024-05-07T14:06:49.924 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33421.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68585.log 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36419.log.gz 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35798.log 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36655.log 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68585.log: /var/log/ceph/ceph-client.admin.35798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68585.log.gz 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35798.log.gz 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31810.log 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70087.log 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36655.log: /var/log/ceph/ceph-client.admin.31810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36655.log.gz 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31810.log.gz 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59004.log 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35969.log 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.70087.log: /var/log/ceph/ceph-client.admin.59004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70087.log.gz 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59004.log.gz 2024-05-07T14:06:49.925 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35898.log 2024-05-07T14:06:49.926 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59005.log 2024-05-07T14:06:49.926 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35969.log: /var/log/ceph/ceph-client.admin.35898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35969.log.gz 2024-05-07T14:06:49.926 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35898.log.gz 2024-05-07T14:06:49.926 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20284.log 2024-05-07T14:06:49.926 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59005.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68374.log 2024-05-07T14:06:49.926 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59005.log.gz 2024-05-07T14:06:49.926 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.tmp-client.admin.20284.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20284.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38988.log 2024-05-07T14:06:49.926 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.926 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68374.log.gz 2024-05-07T14:06:49.931 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41343.log 2024-05-07T14:06:49.931 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35085.log 2024-05-07T14:06:49.931 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.38988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38988.log.gz 2024-05-07T14:06:49.931 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.41343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41343.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40759.log 2024-05-07T14:06:49.931 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.931 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35085.log.gz 2024-05-07T14:06:49.931 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51564.log 2024-05-07T14:06:49.931 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31188.log 2024-05-07T14:06:49.931 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.51564.log: /var/log/ceph/ceph-client.admin.40759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40759.log.gz 2024-05-07T14:06:49.931 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51564.log.gz 2024-05-07T14:06:49.931 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67640.log 2024-05-07T14:06:49.931 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35928.log 2024-05-07T14:06:49.931 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31188.log: /var/log/ceph/ceph-client.admin.67640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31188.log.gz 2024-05-07T14:06:49.932 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67640.log.gz 2024-05-07T14:06:49.932 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55696.log 2024-05-07T14:06:49.932 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60696.log 2024-05-07T14:06:49.932 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35928.log: /var/log/ceph/ceph-client.admin.55696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35928.log.gz 2024-05-07T14:06:49.932 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55696.log.gz 2024-05-07T14:06:49.932 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59539.log 2024-05-07T14:06:49.932 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69958.log 2024-05-07T14:06:49.932 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.60696.log: /var/log/ceph/ceph-client.admin.59539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60696.log.gz 2024-05-07T14:06:49.932 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59539.log.gz 2024-05-07T14:06:49.932 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54682.log 2024-05-07T14:06:49.935 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62778.log 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69958.log.gz 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.54682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54682.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35270.log 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.62778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62778.log.gz 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32693.log 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60555.log 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35270.log: /var/log/ceph/ceph-client.admin.32693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35270.log.gz 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32693.log.gz 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68569.log 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56199.log 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.60555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60555.log.gz 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68569.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55638.log 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.936 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.56199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56199.log.gz 2024-05-07T14:06:49.937 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63839.log 2024-05-07T14:06:49.939 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60893.log 2024-05-07T14:06:49.939 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.55638.log: /var/log/ceph/ceph-client.admin.63839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55638.log.gz 2024-05-07T14:06:49.940 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63839.log.gz 2024-05-07T14:06:49.940 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33738.log 2024-05-07T14:06:49.940 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45581.log 2024-05-07T14:06:49.940 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.60893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60893.log.gz 2024-05-07T14:06:49.940 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33738.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63059.log 2024-05-07T14:06:49.940 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.940 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.45581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45581.log.gz 2024-05-07T14:06:49.940 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67751.log 2024-05-07T14:06:49.940 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68158.log 2024-05-07T14:06:49.940 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67751.log: /var/log/ceph/ceph-client.admin.63059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63059.log.gz 2024-05-07T14:06:49.940 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67751.log.gz 2024-05-07T14:06:49.940 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57010.log 2024-05-07T14:06:49.944 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65405.log 2024-05-07T14:06:49.944 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68158.log: /var/log/ceph/ceph-client.admin.57010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68158.log.gz 2024-05-07T14:06:49.944 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57010.log.gz 2024-05-07T14:06:49.944 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31373.log 2024-05-07T14:06:49.944 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69464.log 2024-05-07T14:06:49.944 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.65405.log: /var/log/ceph/ceph-client.admin.31373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65405.log.gz 2024-05-07T14:06:49.944 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31373.log.gz 2024-05-07T14:06:49.944 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33185.log 2024-05-07T14:06:49.944 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34857.log 2024-05-07T14:06:49.944 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69464.log: /var/log/ceph/ceph-client.admin.33185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69464.log.gz 2024-05-07T14:06:49.944 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33185.log.gz 2024-05-07T14:06:49.944 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31005.log 2024-05-07T14:06:49.945 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36044.log 2024-05-07T14:06:49.945 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34857.log.gz 2024-05-07T14:06:49.945 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31005.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35517.log 2024-05-07T14:06:49.945 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31005.log.gz 2024-05-07T14:06:49.946 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36044.log.gz 2024-05-07T14:06:49.946 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59132.log 2024-05-07T14:06:49.946 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35001.log 2024-05-07T14:06:49.946 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35517.log.gz 2024-05-07T14:06:49.947 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.59132.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.59132.log.gz 2024-05-07T14:06:49.947 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69802.log 2024-05-07T14:06:49.947 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35001.log.gz 2024-05-07T14:06:49.947 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34426.log 2024-05-07T14:06:49.949 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36002.log 2024-05-07T14:06:49.949 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69802.log.gz 2024-05-07T14:06:49.949 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34426.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69880.log 2024-05-07T14:06:49.949 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34426.log.gz 2024-05-07T14:06:49.949 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36002.log.gz 2024-05-07T14:06:49.949 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63889.log 2024-05-07T14:06:49.949 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34018.log 2024-05-07T14:06:49.950 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.69880.log: /var/log/ceph/ceph-client.admin.63889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69880.log.gz 2024-05-07T14:06:49.950 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63889.log.gz 2024-05-07T14:06:49.950 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68360.log 2024-05-07T14:06:49.952 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67723.log 2024-05-07T14:06:49.952 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34018.log: /var/log/ceph/ceph-client.admin.68360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34018.log.gz 2024-05-07T14:06:49.952 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68360.log.gz 2024-05-07T14:06:49.952 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60488.log 2024-05-07T14:06:49.952 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62150.log 2024-05-07T14:06:49.953 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67723.log: /var/log/ceph/ceph-client.admin.60488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67723.log.gz 2024-05-07T14:06:49.953 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60488.log.gz 2024-05-07T14:06:49.953 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68791.log 2024-05-07T14:06:49.953 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35867.log 2024-05-07T14:06:49.953 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.62150.log: /var/log/ceph/ceph-client.admin.68791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62150.log.gz 2024-05-07T14:06:49.953 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68791.log.gz 2024-05-07T14:06:49.953 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32764.log 2024-05-07T14:06:49.955 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48548.log 2024-05-07T14:06:49.955 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35867.log: /var/log/ceph/ceph-client.admin.32764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35867.log.gz 2024-05-07T14:06:49.955 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32764.log.gz 2024-05-07T14:06:49.955 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32615.log 2024-05-07T14:06:49.955 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67959.log 2024-05-07T14:06:49.955 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.48548.log: /var/log/ceph/ceph-client.admin.32615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48548.log.gz 2024-05-07T14:06:49.955 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32615.log.gz 2024-05-07T14:06:49.955 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60597.log 2024-05-07T14:06:49.955 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34655.log 2024-05-07T14:06:49.958 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.67959.log: /var/log/ceph/ceph-client.admin.60597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67959.log.gz 2024-05-07T14:06:49.958 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60597.log.gz 2024-05-07T14:06:49.958 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32723.log 2024-05-07T14:06:49.958 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35657.log 2024-05-07T14:06:49.958 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34655.log.gz 2024-05-07T14:06:49.958 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32723.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35549.log 2024-05-07T14:06:49.958 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:49.958 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35657.log.gz 2024-05-07T14:06:49.958 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34088.log 2024-05-07T14:06:49.959 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31584.log 2024-05-07T14:06:49.959 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35549.log.gz 2024-05-07T14:06:49.961 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34088.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54794.log 2024-05-07T14:06:49.961 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34088.log.gz 2024-05-07T14:06:49.962 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31584.log.gzgzip 2024-05-07T14:06:49.962 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60937.log 2024-05-07T14:06:49.962 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56203.log 2024-05-07T14:06:49.962 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.54794.log: /var/log/ceph/ceph-client.admin.60937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54794.log.gz 2024-05-07T14:06:49.962 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60937.log.gz 2024-05-07T14:06:49.962 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68843.log 2024-05-07T14:06:49.962 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68169.log 2024-05-07T14:06:49.962 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.56203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56203.log.gz 2024-05-07T14:06:49.962 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68843.log.gz 2024-05-07T14:06:49.962 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.68169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68169.log.gz 2024-05-07T14:06:50.012 INFO:teuthology.orchestra.run.smithi107.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-07T14:06:50.093 INFO:teuthology.orchestra.run.smithi106.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-07T14:06:50.215 INFO:teuthology.orchestra.run.smithi106.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-07T14:06:50.539 INFO:teuthology.orchestra.run.smithi106.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-07T14:06:50.606 INFO:teuthology.orchestra.run.smithi107.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-07T14:06:50.627 INFO:teuthology.orchestra.run.smithi107.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-07T14:06:50.733 INFO:teuthology.orchestra.run.smithi107.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-07T14:06:50.831 INFO:teuthology.orchestra.run.smithi107.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-07T14:06:50.831 INFO:teuthology.orchestra.run.smithi106.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-07T14:06:50.832 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-05-07T14:06:50.832 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m1.057s 2024-05-07T14:06:50.833 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m3.682s 2024-05-07T14:06:50.833 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m0.175s 2024-05-07T14:06:50.838 INFO:teuthology.orchestra.run.smithi106.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-07T14:06:50.908 INFO:teuthology.orchestra.run.smithi106.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-07T14:06:50.910 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-05-07T14:06:50.910 INFO:teuthology.orchestra.run.smithi106.stderr:real 0m1.171s 2024-05-07T14:06:50.910 INFO:teuthology.orchestra.run.smithi106.stderr:user 0m4.765s 2024-05-07T14:06:50.910 INFO:teuthology.orchestra.run.smithi106.stderr:sys 0m0.247s 2024-05-07T14:06:50.910 INFO:tasks.ceph:Archiving logs... 2024-05-07T14:06:50.910 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430/remote/smithi106/log 2024-05-07T14:06:50.911 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-07T14:06:51.789 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430/remote/smithi107/log 2024-05-07T14:06:51.789 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-07T14:06:52.261 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-07T14:06:52.271 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-07T14:06:52.272 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-07T14:06:52.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-07T14:06:52.354 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-07T14:06:52.363 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-07T14:06:52.363 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T14:06:52.366 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-07T14:06:52.376 INFO:teuthology.orchestra.run.smithi107.stdout: remote refid st t when poll reach delay offset jitter 2024-05-07T14:06:52.376 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================== 2024-05-07T14:06:52.376 INFO:teuthology.orchestra.run.smithi107.stdout:+hv01.front.sepi 67.205.162.81 3 u 11 64 377 0.091 -4.917 1.874 2024-05-07T14:06:52.377 INFO:teuthology.orchestra.run.smithi107.stdout:*hv02.front.sepi 63.231.80.2 3 u 16 64 377 0.106 +1.816 1.862 2024-05-07T14:06:52.377 INFO:teuthology.orchestra.run.smithi107.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.056 -1.709 2.524 2024-05-07T14:06:52.377 INFO:teuthology.orchestra.run.smithi107.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-07T14:06:52.378 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2024-05-07T14:06:52.378 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2024-05-07T14:06:52.378 INFO:teuthology.orchestra.run.smithi106.stdout:+hv01.front.sepi 67.205.162.81 3 u 19 64 377 0.075 -4.887 2.074 2024-05-07T14:06:52.378 INFO:teuthology.orchestra.run.smithi106.stdout:*hv02.front.sepi 63.231.80.2 3 u 11 64 377 0.076 -2.197 3.599 2024-05-07T14:06:52.378 INFO:teuthology.orchestra.run.smithi106.stdout:+hv03.front.sepi 74.6.168.72 3 u 10 64 377 0.061 +1.264 2.054 2024-05-07T14:06:52.378 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-07T14:06:52.379 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-07T14:06:52.388 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-07T14:06:52.389 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-07T14:06:52.398 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-07T14:06:52.406 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-07T14:06:52.415 INFO:teuthology.task.internal:Duration was 971.429698 seconds 2024-05-07T14:06:52.415 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-07T14:06:52.426 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-07T14:06:52.426 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-07T14:06:52.429 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-07T14:06:52.466 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-07T14:06:52.466 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2024-05-07T14:06:52.466 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-07T14:06:52.520 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-05-07T14:06:52.520 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-07T14:06:52.530 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-07T14:06:52.530 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-07T14:06:52.564 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-07T14:06:52.601 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-07T14:06:52.602 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-07T14:06:52.641 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-07T14:06:52.738 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-07T14:06:52.749 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-07T14:06:52.749 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-07T14:06:52.760 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-07T14:06:52.771 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-07T14:06:52.784 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-07T14:06:52.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-07T14:06:52.812 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2024-05-07T14:06:52.825 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-05-07T14:06:52.908 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-07T14:06:52.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T14:06:52.913 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-07T14:06:52.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-07T14:06:52.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-07T14:06:52.965 INFO:teuthology.task.internal:Transferring archived files... 2024-05-07T14:06:52.966 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430/remote/smithi106 2024-05-07T14:06:52.966 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-07T14:06:52.989 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-05-07_13:33:35-rgw-wip-cbodley2-testing-distro-default-smithi/7695430/remote/smithi107 2024-05-07T14:06:52.989 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-07T14:06:53.020 INFO:teuthology.task.internal:Removing archive directory... 2024-05-07T14:06:53.020 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-07T14:06:53.028 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-07T14:06:53.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-07T14:06:53.079 INFO:teuthology.task.internal:Not uploading archives. 2024-05-07T14:06:53.079 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-07T14:06:53.091 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-07T14:06:53.091 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-07T14:06:53.094 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-07T14:06:53.097 INFO:teuthology.orchestra.run.smithi106.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 7 14:06 /home/ubuntu/cephtest 2024-05-07T14:06:53.115 INFO:teuthology.orchestra.run.smithi107.stdout: 658458 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 7 14:06 /home/ubuntu/cephtest 2024-05-07T14:06:53.117 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-07T14:06:53.129 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-07T14:06:53.153 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} duration: 971.4296975135803 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-05-07T14:06:53.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-07T14:06:53.224 INFO:teuthology.run:pass